2024-09-13T17:36:25.980 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T17:36:26.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T17:36:26.105 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903930 branch: wip-rishabh-testing-20240910.100730-reef description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/alternate-pool} email: null first_in_suite: false job_id: '7903930' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rishabh-testing-20240910.100730-reef ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - bad backtrace - object missing on disk - error reading table object - error reading sessionmap - unmatched fragstat - unmatched rstat - was unreadable, recreating it now - Scrub error on inode - Metadata damage detected - MDS_FAILED - MDS_DAMAGE sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 kclient: syntax: v2 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240910.100730-reef sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6439 sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 sleep_before_teardown: 0 subset: 964/1024 suite: fs suite_branch: wip-rishabh-testing-20240910.100730-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi114.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKI0Xnox+oCbcfaHzuLiDjccyf34nuO7QIgkICRj5b+G1KG8Pq+y3e345kanLbta2Izg0ACfmd//PvsPpnmPmdM= smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM55KBtgPRbtb3PXAzxDqzlbL0MzM0vVza8jdk0CbaxFrFLCGkcjQybDh38lQ3L1V6bmYwKb318lqQ4OcJeDPuc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_recovery_pool teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_14:42:16 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T17:36:26.106 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa; will attempt to use it 2024-09-13T17:36:26.106 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa/tasks 2024-09-13T17:36:26.107 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T17:36:26.108 INFO:teuthology.task.internal:Checking packages... 2024-09-13T17:36:26.131 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3' 2024-09-13T17:36:26.131 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T17:36:26.131 INFO:teuthology.packaging:ref: None 2024-09-13T17:36:26.132 INFO:teuthology.packaging:tag: None 2024-09-13T17:36:26.132 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240910.100730-reef 2024-09-13T17:36:26.132 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:36:26.132 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rishabh-testing-20240910.100730-reef 2024-09-13T17:36:26.292 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-860-g6c6b083f-1jammy 2024-09-13T17:36:26.293 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T17:36:26.299 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T17:36:26.300 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T17:36:26.306 INFO:teuthology.task.internal:Saving configuration 2024-09-13T17:36:26.324 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T17:36:26.330 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T17:36:26.363 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903930', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 17:30:50.204606', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJ2H88EEDNNw0syhahJW8khP9XR2QCA4BrObhjigq/WT'} 2024-09-13T17:36:26.397 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903930', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 17:30:50.206419', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMfFEf0q+QFAIwO0nJrOcORCdTOzfaD/XJXPdg5V7PIz'} 2024-09-13T17:36:26.397 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T17:36:26.403 INFO:teuthology.task.internal:roles: ubuntu@smithi114.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-13T17:36:26.403 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-13T17:36:26.403 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T17:36:26.486 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9f2f17fbe0>, signals=[15]) 2024-09-13T17:36:26.486 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T17:36:26.492 INFO:teuthology.task.internal:Opening connections... 2024-09-13T17:36:26.492 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi114.front.sepia.ceph.com 2024-09-13T17:36:26.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:36:26.623 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-09-13T17:36:26.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:36:26.710 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T17:36:26.716 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2024-09-13T17:36:26.725 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2024-09-13T17:36:26.725 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2024-09-13T17:36:26.772 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-13T17:36:26.772 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Ubuntu" 2024-09-13T17:36:26.772 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="22.04" 2024-09-13T17:36:26.772 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-13T17:36:26.773 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_CODENAME=jammy 2024-09-13T17:36:26.773 INFO:teuthology.orchestra.run.smithi114.stdout:ID=ubuntu 2024-09-13T17:36:26.773 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE=debian 2024-09-13T17:36:26.773 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T17:36:26.773 INFO:teuthology.orchestra.run.smithi114.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T17:36:26.773 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T17:36:26.774 INFO:teuthology.orchestra.run.smithi114.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T17:36:26.774 INFO:teuthology.orchestra.run.smithi114.stdout:UBUNTU_CODENAME=jammy 2024-09-13T17:36:26.774 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2024-09-13T17:36:26.802 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-09-13T17:36:26.807 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-09-13T17:36:26.807 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-09-13T17:36:26.859 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-13T17:36:26.859 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Ubuntu" 2024-09-13T17:36:26.859 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="22.04" 2024-09-13T17:36:26.859 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-13T17:36:26.859 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_CODENAME=jammy 2024-09-13T17:36:26.859 INFO:teuthology.orchestra.run.smithi134.stdout:ID=ubuntu 2024-09-13T17:36:26.859 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE=debian 2024-09-13T17:36:26.859 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T17:36:26.859 INFO:teuthology.orchestra.run.smithi134.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T17:36:26.859 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T17:36:26.859 INFO:teuthology.orchestra.run.smithi134.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T17:36:26.860 INFO:teuthology.orchestra.run.smithi134.stdout:UBUNTU_CODENAME=jammy 2024-09-13T17:36:26.860 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-09-13T17:36:26.893 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T17:36:26.905 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T17:36:26.910 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T17:36:26.911 DEBUG:teuthology.orchestra.run.smithi114:> test '!' -e /home/ubuntu/cephtest 2024-09-13T17:36:26.913 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-09-13T17:36:26.918 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T17:36:26.927 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T17:36:26.927 DEBUG:teuthology.orchestra.run.smithi114:> test -z $(ls -A /var/lib/ceph) 2024-09-13T17:36:26.961 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-09-13T17:36:26.969 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T17:36:27.042 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T17:36:27.078 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-13T17:36:27.079 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-09-13T17:36:27.079 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-09-13T17:36:27.079 DEBUG:teuthology.orchestra.run.smithi114:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T17:36:27.080 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T17:36:27.085 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:36:27.085 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-09-13T17:36:27.096 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:36:27.097 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-09-13T17:36:27.269 DEBUG:teuthology.task.kernel:sha1 for client.1 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T17:36:27.269 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-13T17:36:27.270 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-09-13T17:36:27.271 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T17:36:27.271 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-13T17:36:27.271 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2024-09-13T17:36:27.276 INFO:teuthology.orchestra.run.smithi114.stdout:5.15.0-56-generic 2024-09-13T17:36:27.276 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T17:36:27.276 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-13T17:36:27.277 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-09-13T17:36:27.277 DEBUG:teuthology.orchestra.run.smithi114:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-09-13T17:36:27.278 INFO:teuthology.orchestra.run.smithi134.stdout:5.15.0-56-generic 2024-09-13T17:36:27.278 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T17:36:27.278 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-13T17:36:27.278 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-09-13T17:36:27.279 DEBUG:teuthology.orchestra.run.smithi134:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-09-13T17:36:27.337 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-09-13T17:36:27.339 INFO:teuthology.orchestra.run.smithi114.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-09-13T17:36:27.469 INFO:teuthology.orchestra.run.smithi114.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-09-13T17:36:27.469 INFO:teuthology.orchestra.run.smithi114.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-09-13T17:36:27.469 INFO:teuthology.orchestra.run.smithi114.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-09-13T17:36:27.469 INFO:teuthology.orchestra.run.smithi114.stderr:hint: 2024-09-13T17:36:27.469 INFO:teuthology.orchestra.run.smithi114.stderr:hint: git config --global init.defaultBranch 2024-09-13T17:36:27.469 INFO:teuthology.orchestra.run.smithi114.stderr:hint: 2024-09-13T17:36:27.470 INFO:teuthology.orchestra.run.smithi114.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-09-13T17:36:27.470 INFO:teuthology.orchestra.run.smithi114.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-09-13T17:36:27.470 INFO:teuthology.orchestra.run.smithi114.stderr:hint: 2024-09-13T17:36:27.470 INFO:teuthology.orchestra.run.smithi114.stderr:hint: git branch -m 2024-09-13T17:36:27.470 INFO:teuthology.orchestra.run.smithi114.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-09-13T17:36:27.471 INFO:teuthology.orchestra.run.smithi134.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-09-13T17:36:27.471 INFO:teuthology.orchestra.run.smithi134.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-09-13T17:36:27.471 INFO:teuthology.orchestra.run.smithi134.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-09-13T17:36:27.471 INFO:teuthology.orchestra.run.smithi134.stderr:hint: 2024-09-13T17:36:27.472 INFO:teuthology.orchestra.run.smithi134.stderr:hint: git config --global init.defaultBranch 2024-09-13T17:36:27.472 INFO:teuthology.orchestra.run.smithi134.stderr:hint: 2024-09-13T17:36:27.472 INFO:teuthology.orchestra.run.smithi134.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-09-13T17:36:27.472 INFO:teuthology.orchestra.run.smithi134.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-09-13T17:36:27.472 INFO:teuthology.orchestra.run.smithi134.stderr:hint: 2024-09-13T17:36:27.472 INFO:teuthology.orchestra.run.smithi134.stderr:hint: git branch -m 2024-09-13T17:36:27.473 DEBUG:teuthology.orchestra.run.smithi114:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-09-13T17:36:27.473 INFO:teuthology.orchestra.run.smithi134.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-09-13T17:36:27.475 DEBUG:teuthology.orchestra.run.smithi134:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-09-13T17:36:27.545 DEBUG:teuthology.orchestra.run.smithi114:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-09-13T17:36:27.546 DEBUG:teuthology.orchestra.run.smithi134:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-09-13T17:36:27.600 DEBUG:teuthology.orchestra.run.smithi114:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-09-13T17:36:27.603 DEBUG:teuthology.orchestra.run.smithi134:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-09-13T17:37:07.805 INFO:teuthology.orchestra.run.smithi134.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-09-13T17:37:07.805 INFO:teuthology.orchestra.run.smithi134.stderr: * [new branch] main -> origin/main 2024-09-13T17:37:07.842 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20190312 -> 20190312 2024-09-13T17:37:07.842 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20190416 -> 20190416 2024-09-13T17:37:07.842 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20190514 -> 20190514 2024-09-13T17:37:07.842 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20190618 -> 20190618 2024-09-13T17:37:07.842 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20190717 -> 20190717 2024-09-13T17:37:07.842 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20190815 -> 20190815 2024-09-13T17:37:07.842 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20190923 -> 20190923 2024-09-13T17:37:07.843 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20191022 -> 20191022 2024-09-13T17:37:07.843 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20191215 -> 20191215 2024-09-13T17:37:07.843 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20200122 -> 20200122 2024-09-13T17:37:07.843 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20200316 -> 20200316 2024-09-13T17:37:07.847 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20200421 -> 20200421 2024-09-13T17:37:07.847 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20200519 -> 20200519 2024-09-13T17:37:07.847 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20200619 -> 20200619 2024-09-13T17:37:07.847 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20200721 -> 20200721 2024-09-13T17:37:07.847 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20200817 -> 20200817 2024-09-13T17:37:07.847 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20200918 -> 20200918 2024-09-13T17:37:07.848 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20201022 -> 20201022 2024-09-13T17:37:07.848 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20201118 -> 20201118 2024-09-13T17:37:07.848 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20201218 -> 20201218 2024-09-13T17:37:07.848 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20210208 -> 20210208 2024-09-13T17:37:07.848 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20210315 -> 20210315 2024-09-13T17:37:07.848 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20210511 -> 20210511 2024-09-13T17:37:07.848 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20210716 -> 20210716 2024-09-13T17:37:07.848 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20210818 -> 20210818 2024-09-13T17:37:07.848 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20210919 -> 20210919 2024-09-13T17:37:07.848 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20211027 -> 20211027 2024-09-13T17:37:07.848 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20211216 -> 20211216 2024-09-13T17:37:07.849 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20220209 -> 20220209 2024-09-13T17:37:07.849 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20220310 -> 20220310 2024-09-13T17:37:07.849 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20220411 -> 20220411 2024-09-13T17:37:07.849 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20220509 -> 20220509 2024-09-13T17:37:07.849 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20220610 -> 20220610 2024-09-13T17:37:07.849 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20220708 -> 20220708 2024-09-13T17:37:07.849 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20220815 -> 20220815 2024-09-13T17:37:07.849 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20220913 -> 20220913 2024-09-13T17:37:07.849 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20221012 -> 20221012 2024-09-13T17:37:07.849 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20221109 -> 20221109 2024-09-13T17:37:07.849 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20221214 -> 20221214 2024-09-13T17:37:07.849 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20230117 -> 20230117 2024-09-13T17:37:07.849 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20230210 -> 20230210 2024-09-13T17:37:07.849 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20230310 -> 20230310 2024-09-13T17:37:07.849 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20230404 -> 20230404 2024-09-13T17:37:07.850 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20230515 -> 20230515 2024-09-13T17:37:07.850 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20230625 -> 20230625 2024-09-13T17:37:07.850 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20230804 -> 20230804 2024-09-13T17:37:07.850 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20230919 -> 20230919 2024-09-13T17:37:07.850 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20231030 -> 20231030 2024-09-13T17:37:07.850 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20231111 -> 20231111 2024-09-13T17:37:07.850 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20231211 -> 20231211 2024-09-13T17:37:07.851 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20240115 -> 20240115 2024-09-13T17:37:07.851 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20240220 -> 20240220 2024-09-13T17:37:07.852 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20240312 -> 20240312 2024-09-13T17:37:07.852 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20240410 -> 20240410 2024-09-13T17:37:07.852 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20240513 -> 20240513 2024-09-13T17:37:07.852 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20240610 -> 20240610 2024-09-13T17:37:07.852 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20240709 -> 20240709 2024-09-13T17:37:07.852 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20240811 -> 20240811 2024-09-13T17:37:07.852 INFO:teuthology.orchestra.run.smithi134.stderr: * [new tag] 20240909 -> 20240909 2024-09-13T17:37:08.037 INFO:teuthology.orchestra.run.smithi114.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-09-13T17:37:08.038 INFO:teuthology.orchestra.run.smithi114.stderr: * [new branch] main -> origin/main 2024-09-13T17:37:08.074 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190312 -> 20190312 2024-09-13T17:37:08.074 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190416 -> 20190416 2024-09-13T17:37:08.074 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190514 -> 20190514 2024-09-13T17:37:08.074 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190618 -> 20190618 2024-09-13T17:37:08.074 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190717 -> 20190717 2024-09-13T17:37:08.074 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190815 -> 20190815 2024-09-13T17:37:08.074 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190923 -> 20190923 2024-09-13T17:37:08.074 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20191022 -> 20191022 2024-09-13T17:37:08.074 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20191215 -> 20191215 2024-09-13T17:37:08.076 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200122 -> 20200122 2024-09-13T17:37:08.077 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200316 -> 20200316 2024-09-13T17:37:08.077 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200421 -> 20200421 2024-09-13T17:37:08.077 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200519 -> 20200519 2024-09-13T17:37:08.077 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200619 -> 20200619 2024-09-13T17:37:08.077 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200721 -> 20200721 2024-09-13T17:37:08.077 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200817 -> 20200817 2024-09-13T17:37:08.077 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200918 -> 20200918 2024-09-13T17:37:08.077 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20201022 -> 20201022 2024-09-13T17:37:08.077 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20201118 -> 20201118 2024-09-13T17:37:08.077 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20201218 -> 20201218 2024-09-13T17:37:08.077 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20210208 -> 20210208 2024-09-13T17:37:08.077 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20210315 -> 20210315 2024-09-13T17:37:08.077 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20210511 -> 20210511 2024-09-13T17:37:08.078 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20210716 -> 20210716 2024-09-13T17:37:08.078 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20210818 -> 20210818 2024-09-13T17:37:08.078 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20210919 -> 20210919 2024-09-13T17:37:08.078 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20211027 -> 20211027 2024-09-13T17:37:08.078 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20211216 -> 20211216 2024-09-13T17:37:08.081 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220209 -> 20220209 2024-09-13T17:37:08.081 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220310 -> 20220310 2024-09-13T17:37:08.081 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220411 -> 20220411 2024-09-13T17:37:08.081 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220509 -> 20220509 2024-09-13T17:37:08.082 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220610 -> 20220610 2024-09-13T17:37:08.082 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220708 -> 20220708 2024-09-13T17:37:08.082 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220815 -> 20220815 2024-09-13T17:37:08.082 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220913 -> 20220913 2024-09-13T17:37:08.082 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20221012 -> 20221012 2024-09-13T17:37:08.082 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20221109 -> 20221109 2024-09-13T17:37:08.082 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20221214 -> 20221214 2024-09-13T17:37:08.082 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230117 -> 20230117 2024-09-13T17:37:08.082 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230210 -> 20230210 2024-09-13T17:37:08.082 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230310 -> 20230310 2024-09-13T17:37:08.082 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230404 -> 20230404 2024-09-13T17:37:08.082 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230515 -> 20230515 2024-09-13T17:37:08.082 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230625 -> 20230625 2024-09-13T17:37:08.083 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230804 -> 20230804 2024-09-13T17:37:08.083 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230919 -> 20230919 2024-09-13T17:37:08.083 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20231030 -> 20231030 2024-09-13T17:37:08.083 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20231111 -> 20231111 2024-09-13T17:37:08.083 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20231211 -> 20231211 2024-09-13T17:37:08.083 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20240115 -> 20240115 2024-09-13T17:37:08.083 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20240220 -> 20240220 2024-09-13T17:37:08.083 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20240312 -> 20240312 2024-09-13T17:37:08.083 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20240410 -> 20240410 2024-09-13T17:37:08.083 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20240513 -> 20240513 2024-09-13T17:37:08.083 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20240610 -> 20240610 2024-09-13T17:37:08.083 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20240709 -> 20240709 2024-09-13T17:37:08.083 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20240811 -> 20240811 2024-09-13T17:37:08.083 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20240909 -> 20240909 2024-09-13T17:37:12.472 INFO:teuthology.orchestra.run.smithi134.stderr:Updating files: 32% (1153/3520) Updating files: 33% (1162/3520) Updating files: 34% (1197/3520) Updating files: 35% (1232/3520) Updating files: 36% (1268/3520) Updating files: 37% (1303/3520) Updating files: 38% (1338/3520) Updating files: 39% (1373/3520) Updating files: 40% (1408/3520) Updating files: 41% (1444/3520) Updating files: 42% (1479/3520) Updating files: 43% (1514/3520) Updating files: 44% (1549/3520) Updating files: 45% (1584/3520) Updating files: 46% (1620/3520) Updating files: 47% (1655/3520) Updating files: 48% (1690/3520) Updating files: 49% (1725/3520) Updating files: 50% (1760/3520) Updating files: 51% (1796/3520) Updating files: 52% (1831/3520) Updating files: 53% (1866/3520) Updating files: 54% (1901/3520) Updating files: 55% (1936/3520) Updating files: 56% (1972/3520) Updating files: 57% (2007/3520) Updating files: 58% (2042/3520) Updating files: 58% (2070/3520) Updating files: 59% (2077/3520) Updating files: 60% (2112/3520) Updating files: 61% (2148/3520) Updating files: 62% (2183/3520) Updating files: 63% (2218/3520) Updating files: 64% (2253/3520) Updating files: 65% (2288/3520) Updating files: 66% (2324/3520) Updating files: 67% (2359/3520) Updating files: 68% (2394/3520) Updating files: 69% (2429/3520) Updating files: 69% (2433/3520) Updating files: 70% (2464/3520) Updating files: 71% (2500/3520) Updating files: 72% (2535/3520) Updating files: 73% (2570/3520) Updating files: 74% (2605/3520) Updating files: 75% (2640/3520) Updating files: 76% (2676/3520) Updating files: 77% (2711/3520) Updating files: 78% (2746/3520) Updating files: 79% (2781/3520) Updating files: 80% (2816/3520) Updating files: 81% (2852/3520) Updating files: 82% (2887/3520) Updating files: 82% (2902/3520) Updating files: 83% (2922/3520) Updating files: 84% (2957/3520) Updating files: 85% (2992/3520) Updating files: 86% (3028/3520) Updating files: 87% (3063/3520) Updating files: 88% (3098/3520) Updating files: 89% (3133/3520) Updating files: 90% (3168/3520) Updating files: 91% (3204/3520) Updating files: 92% (3239/3520) Updating files: 93% (3274/3520) Updating files: 94% (3309/3520) Updating files: 95% (3344/3520) Updating files: 96% (3380/3520) Updating files: 97% (3415/3520) Updating files: 98% (3450/3520) Updating files: 99% (3485/3520) Updating files: 100% (3520/3520) Updating files: 100% (3520/3520), done. 2024-09-13T17:37:12.477 INFO:teuthology.orchestra.run.smithi134.stdout:HEAD is now at a34e7a5f Merge branch 'fix-rawfile-links' into 'main' 2024-09-13T17:37:12.497 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-13T17:37:12.498 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T17:37:12.657 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T17:37:12.658 DEBUG:teuthology.orchestra.run.smithi134:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ --input-file=- 2024-09-13T17:37:12.660 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi134.front.sepia.ceph.com to complete... 2024-09-13T17:37:12.695 INFO:teuthology.orchestra.run.smithi114.stderr:Updating files: 31% (1107/3520) Updating files: 32% (1127/3520) Updating files: 33% (1162/3520) Updating files: 34% (1197/3520) Updating files: 35% (1232/3520) Updating files: 36% (1268/3520) Updating files: 37% (1303/3520) Updating files: 38% (1338/3520) Updating files: 39% (1373/3520) Updating files: 40% (1408/3520) Updating files: 41% (1444/3520) Updating files: 42% (1479/3520) Updating files: 43% (1514/3520) Updating files: 44% (1549/3520) Updating files: 45% (1584/3520) Updating files: 46% (1620/3520) Updating files: 47% (1655/3520) Updating files: 48% (1690/3520) Updating files: 49% (1725/3520) Updating files: 50% (1760/3520) Updating files: 51% (1796/3520) Updating files: 52% (1831/3520) Updating files: 53% (1866/3520) Updating files: 54% (1901/3520) Updating files: 55% (1936/3520) Updating files: 56% (1972/3520) Updating files: 57% (2007/3520) Updating files: 58% (2042/3520) Updating files: 58% (2069/3520) Updating files: 59% (2077/3520) Updating files: 60% (2112/3520) Updating files: 61% (2148/3520) Updating files: 62% (2183/3520) Updating files: 63% (2218/3520) Updating files: 64% (2253/3520) Updating files: 65% (2288/3520) Updating files: 66% (2324/3520) Updating files: 67% (2359/3520) Updating files: 68% (2394/3520) Updating files: 69% (2429/3520) Updating files: 69% (2433/3520) Updating files: 70% (2464/3520) Updating files: 71% (2500/3520) Updating files: 72% (2535/3520) Updating files: 73% (2570/3520) Updating files: 74% (2605/3520) Updating files: 75% (2640/3520) Updating files: 76% (2676/3520) Updating files: 77% (2711/3520) Updating files: 78% (2746/3520) Updating files: 79% (2781/3520) Updating files: 80% (2816/3520) Updating files: 81% (2852/3520) Updating files: 82% (2887/3520) Updating files: 82% (2902/3520) Updating files: 83% (2922/3520) Updating files: 84% (2957/3520) Updating files: 85% (2992/3520) Updating files: 86% (3028/3520) Updating files: 87% (3063/3520) Updating files: 88% (3098/3520) Updating files: 89% (3133/3520) Updating files: 90% (3168/3520) Updating files: 91% (3204/3520) Updating files: 92% (3239/3520) Updating files: 93% (3274/3520) Updating files: 94% (3309/3520) Updating files: 95% (3344/3520) Updating files: 96% (3380/3520) Updating files: 97% (3415/3520) Updating files: 98% (3450/3520) Updating files: 99% (3485/3520) Updating files: 100% (3520/3520) Updating files: 100% (3520/3520), done. 2024-09-13T17:37:12.701 INFO:teuthology.orchestra.run.smithi114.stdout:HEAD is now at a34e7a5f Merge branch 'fix-rawfile-links' into 'main' 2024-09-13T17:37:12.722 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-13T17:37:12.723 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T17:37:12.876 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T17:37:12.877 DEBUG:teuthology.orchestra.run.smithi114:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ --input-file=- 2024-09-13T17:37:12.879 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi114.front.sepia.ceph.com to complete... 2024-09-13T17:37:13.836 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13 17:37:13 URL:https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb [45349154/45349154] -> "/tmp/linux-image.deb" [1] 2024-09-13T17:37:13.836 INFO:teuthology.orchestra.run.smithi134.stderr:FINISHED --2024-09-13 17:37:13-- 2024-09-13T17:37:13.836 INFO:teuthology.orchestra.run.smithi134.stderr:Total wall clock time: 1.0s 2024-09-13T17:37:13.836 INFO:teuthology.orchestra.run.smithi134.stderr:Downloaded: 1 files, 43M in 0.9s (48.5 MB/s) 2024-09-13T17:37:13.840 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-13T17:37:13.841 DEBUG:teuthology.orchestra.run.smithi134:> sudo dpkg -i /tmp/linux-image.deb 2024-09-13T17:37:14.091 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g2ca44a2f35ca. 2024-09-13T17:37:14.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13 17:37:14 URL:https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb [45349154/45349154] -> "/tmp/linux-image.deb" [1] 2024-09-13T17:37:14.820 INFO:teuthology.orchestra.run.smithi114.stderr:FINISHED --2024-09-13 17:37:14-- 2024-09-13T17:37:14.820 INFO:teuthology.orchestra.run.smithi114.stderr:Total wall clock time: 1.8s 2024-09-13T17:37:14.820 INFO:teuthology.orchestra.run.smithi114.stderr:Downloaded: 1 files, 43M in 1.7s (25.6 MB/s) 2024-09-13T17:37:14.824 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-13T17:37:14.824 DEBUG:teuthology.orchestra.run.smithi114:> sudo dpkg -i /tmp/linux-image.deb 2024-09-13T17:37:15.059 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g2ca44a2f35ca. 2024-09-13T17:37:15.992 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-09-13T17:37:15.996 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-09-13T17:37:16.116 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-13T17:37:17.090 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-09-13T17:37:17.094 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-09-13T17:37:17.302 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-13T17:37:20.330 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-13T17:37:20.437 INFO:teuthology.orchestra.run.smithi134.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:37:20.884 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-13T17:37:20.984 INFO:teuthology.orchestra.run.smithi114.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:37:43.312 INFO:teuthology.orchestra.run.smithi134.stderr:Sourcing file `/etc/default/grub' 2024-09-13T17:37:43.322 INFO:teuthology.orchestra.run.smithi134.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T17:37:43.352 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2024-09-13T17:37:43.402 INFO:teuthology.orchestra.run.smithi114.stderr:Sourcing file `/etc/default/grub' 2024-09-13T17:37:43.415 INFO:teuthology.orchestra.run.smithi114.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T17:37:43.439 INFO:teuthology.orchestra.run.smithi114.stderr:Generating grub configuration file ... 2024-09-13T17:37:43.709 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:37:43.727 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:37:43.750 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:37:43.764 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:37:44.004 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T17:37:44.018 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T17:37:44.064 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T17:37:44.076 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T17:37:44.080 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T17:37:44.086 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T17:37:44.137 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T17:37:44.145 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T17:37:44.225 INFO:teuthology.orchestra.run.smithi134.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T17:37:44.226 INFO:teuthology.orchestra.run.smithi134.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T17:37:44.226 INFO:teuthology.orchestra.run.smithi134.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T17:37:44.266 INFO:teuthology.orchestra.run.smithi134.stderr:done 2024-09-13T17:37:44.291 INFO:teuthology.orchestra.run.smithi114.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T17:37:44.291 INFO:teuthology.orchestra.run.smithi114.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T17:37:44.291 INFO:teuthology.orchestra.run.smithi114.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T17:37:44.321 INFO:teuthology.orchestra.run.smithi114.stderr:done 2024-09-13T17:37:44.449 DEBUG:teuthology.orchestra.run.smithi134:> dpkg-deb -c /tmp/linux-image.deb 2024-09-13T17:37:44.498 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./ 2024-09-13T17:37:44.498 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./boot/ 2024-09-13T17:37:44.498 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7098725 2024-09-06 14:57 ./boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:37:44.502 DEBUG:teuthology.orchestra.run.smithi114:> dpkg-deb -c /tmp/linux-image.deb 2024-09-13T17:37:44.510 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./ 2024-09-13T17:37:44.510 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./boot/ 2024-09-13T17:37:44.510 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7098725 2024-09-06 14:57 ./boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:37:44.512 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 174121 2024-09-06 14:57 ./boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:37:44.512 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13292544 2024-09-06 14:57 ./boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:37:44.525 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 174121 2024-09-06 14:57 ./boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:37:44.525 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13292544 2024-09-06 14:57 ./boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:37:44.535 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/ 2024-09-13T17:37:44.535 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/ 2024-09-13T17:37:44.535 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postinst.d/ 2024-09-13T17:37:44.535 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postrm.d/ 2024-09-13T17:37:44.535 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/preinst.d/ 2024-09-13T17:37:44.536 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/prerm.d/ 2024-09-13T17:37:44.536 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/ 2024-09-13T17:37:44.536 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/ 2024-09-13T17:37:44.536 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T17:37:44.536 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/ 2024-09-13T17:37:44.536 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/ 2024-09-13T17:37:44.536 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/ 2024-09-13T17:37:44.536 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ 2024-09-13T17:37:44.536 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 189809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/aesni-intel.ko 2024-09-13T17:37:44.536 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-13T17:37:44.536 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-13T17:37:44.537 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-13T17:37:44.537 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 97321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-13T17:37:44.537 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 109985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-13T17:37:44.537 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 155337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-13T17:37:44.537 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-13T17:37:44.537 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-13T17:37:44.537 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 87097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-13T17:37:44.537 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-13T17:37:44.537 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 49905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-13T17:37:44.537 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 50457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-13T17:37:44.537 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 54593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-13T17:37:44.537 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-13T17:37:44.538 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 48073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-13T17:37:44.538 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 62961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-13T17:37:44.538 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 53657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-13T17:37:44.538 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-13T17:37:44.538 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-13T17:37:44.538 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/ 2024-09-13T17:37:44.538 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/ 2024-09-13T17:37:44.538 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/ 2024-09-13T17:37:44.538 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 49497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-13T17:37:44.538 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpuid.ko 2024-09-13T17:37:44.538 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/msr.ko 2024-09-13T17:37:44.538 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/ 2024-09-13T17:37:44.539 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 505169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-13T17:37:44.539 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1060585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-13T17:37:44.539 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 2858865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-13T17:37:44.872 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ 2024-09-13T17:37:44.872 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 62113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/af_alg.ko 2024-09-13T17:37:44.872 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_hash.ko 2024-09-13T17:37:44.872 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_skcipher.ko 2024-09-13T17:37:44.872 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-13T17:37:44.872 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-13T17:37:44.872 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-13T17:37:44.873 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/ 2024-09-13T17:37:44.873 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-09-13T17:37:44.873 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/ 2024-09-13T17:37:44.873 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-13T17:37:44.873 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-13T17:37:44.873 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-13T17:37:44.873 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-13T17:37:44.873 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-13T17:37:44.873 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-13T17:37:44.873 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-13T17:37:44.873 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-13T17:37:44.873 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-13T17:37:44.874 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-13T17:37:44.874 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-13T17:37:44.874 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-13T17:37:44.874 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-13T17:37:44.874 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-13T17:37:44.874 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-13T17:37:44.874 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 43377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-13T17:37:44.874 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-13T17:37:44.874 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-13T17:37:44.874 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 57801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cryptd.ko 2024-09-13T17:37:44.874 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-13T17:37:44.874 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_simd.ko 2024-09-13T17:37:44.874 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-13T17:37:44.875 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-13T17:37:44.875 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-13T17:37:44.875 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-13T17:37:44.875 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-13T17:37:44.875 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-13T17:37:44.875 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-13T17:37:44.875 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-13T17:37:44.875 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lrw.ko 2024-09-13T17:37:44.875 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-13T17:37:44.875 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-13T17:37:44.875 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-13T17:37:44.875 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-13T17:37:44.875 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-13T17:37:44.876 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-13T17:37:44.876 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-13T17:37:44.876 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-13T17:37:44.876 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-13T17:37:44.876 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 169521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-13T17:37:44.876 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-13T17:37:44.876 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-13T17:37:44.876 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-13T17:37:44.876 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-13T17:37:44.876 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-13T17:37:44.876 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-13T17:37:44.876 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-13T17:37:44.876 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xts.ko 2024-09-13T17:37:44.877 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-13T17:37:44.877 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ 2024-09-13T17:37:44.877 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ 2024-09-13T17:37:44.877 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_extlog.ko 2024-09-13T17:37:44.877 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-13T17:37:44.877 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-13T17:37:44.877 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/ 2024-09-13T17:37:44.877 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/einj.ko 2024-09-13T17:37:44.877 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-13T17:37:44.877 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-13T17:37:44.877 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-13T17:37:44.877 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-13T17:37:44.877 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 120321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-13T17:37:44.878 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ 2024-09-13T17:37:44.878 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-13T17:37:44.878 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 100457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci.ko 2024-09-13T17:37:44.878 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-13T17:37:44.878 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 105105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci.ko 2024-09-13T17:37:44.878 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-13T17:37:44.878 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-13T17:37:44.878 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-13T17:37:44.878 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-13T17:37:44.878 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-13T17:37:44.878 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-13T17:37:44.878 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-13T17:37:44.879 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-13T17:37:44.879 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-13T17:37:44.879 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-13T17:37:44.879 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-13T17:37:44.879 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-13T17:37:44.879 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-13T17:37:44.879 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-13T17:37:44.879 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-13T17:37:44.879 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-13T17:37:44.879 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 41385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-13T17:37:44.879 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-13T17:37:44.879 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 60665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_legacy.ko 2024-09-13T17:37:44.879 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-13T17:37:44.880 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-13T17:37:44.880 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-13T17:37:44.880 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-13T17:37:44.880 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-13T17:37:44.880 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-13T17:37:44.880 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-13T17:37:44.880 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-13T17:37:44.880 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-13T17:37:44.880 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-13T17:37:44.880 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-13T17:37:44.880 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-13T17:37:44.880 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-13T17:37:44.880 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_radisys.ko 2024-09-13T17:37:44.881 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-13T17:37:44.881 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rz1000.ko 2024-09-13T17:37:44.881 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-13T17:37:44.881 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-13T17:37:44.881 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-13T17:37:44.881 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-13T17:37:44.881 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-13T17:37:44.881 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-13T17:37:44.881 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-13T17:37:44.881 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-13T17:37:44.881 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 102273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-13T17:37:44.881 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 85385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-13T17:37:44.881 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-13T17:37:44.882 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-13T17:37:44.882 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-13T17:37:44.882 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 45993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-13T17:37:44.882 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-13T17:37:44.882 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-13T17:37:44.882 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 53449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-13T17:37:44.882 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-13T17:37:44.882 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 41137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-13T17:37:44.882 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-13T17:37:44.882 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ 2024-09-13T17:37:44.882 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-13T17:37:44.882 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/ 2024-09-13T17:37:44.882 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 161225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-13T17:37:44.883 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/ 2024-09-13T17:37:44.883 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/ 2024-09-13T17:37:44.883 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 141025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-13T17:37:44.883 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/ 2024-09-13T17:37:44.883 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1240825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-13T17:37:44.883 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 203657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-13T17:37:44.883 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/ 2024-09-13T17:37:44.883 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 115057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-13T17:37:44.883 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 143337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-13T17:37:44.883 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/ 2024-09-13T17:37:44.883 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 133345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-13T17:37:44.883 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 119929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-13T17:37:44.883 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 312817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-13T17:37:44.884 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/ 2024-09-13T17:37:44.884 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 117753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-13T17:37:44.884 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/ 2024-09-13T17:37:44.884 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 70201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-13T17:37:44.884 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ 2024-09-13T17:37:44.884 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/applicom.ko 2024-09-13T17:37:44.884 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-13T17:37:44.884 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/ 2024-09-13T17:37:44.884 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-13T17:37:44.884 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-13T17:37:44.884 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-13T17:37:44.884 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-13T17:37:44.884 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-13T17:37:44.885 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ 2024-09-13T17:37:44.885 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 37353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-13T17:37:44.885 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 183745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-13T17:37:44.885 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-13T17:37:44.885 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 179465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-13T17:37:44.885 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 85465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-13T17:37:44.885 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 65425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-13T17:37:44.885 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 43993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-13T17:37:44.885 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/ 2024-09-13T17:37:44.885 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 103521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-13T17:37:44.885 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/nvram.ko 2024-09-13T17:37:44.885 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-13T17:37:44.885 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-13T17:37:44.886 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/ 2024-09-13T17:37:44.886 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-13T17:37:44.886 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-09-13T17:37:44.886 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-09-13T17:37:44.886 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-09-13T17:37:44.886 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-13T17:37:44.886 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-13T17:37:44.886 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-09-13T17:37:44.886 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/ 2024-09-13T17:37:44.886 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_class.ko 2024-09-13T17:37:44.886 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 62201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_core.ko 2024-09-13T17:37:44.886 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-09-13T17:37:44.886 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/ 2024-09-13T17:37:44.886 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-palmas.ko 2024-09-13T17:37:44.887 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 57313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-si5351.ko 2024-09-13T17:37:44.887 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-twl6040.ko 2024-09-13T17:37:44.887 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-wm831x.ko 2024-09-13T17:37:44.887 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/ 2024-09-13T17:37:44.887 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-13T17:37:44.887 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-13T17:37:44.887 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-13T17:37:44.887 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ 2024-09-13T17:37:44.887 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ 2024-09-13T17:37:44.887 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 89361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-13T17:37:44.887 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 334505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-13T17:37:44.887 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/ 2024-09-13T17:37:44.887 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/ 2024-09-13T17:37:44.888 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/ 2024-09-13T17:37:44.888 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 833113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-13T17:37:44.888 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-09-13T17:37:44.888 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-13T17:37:44.888 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-13T17:37:44.888 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-13T17:37:44.888 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/ 2024-09-13T17:37:44.888 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 90209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-13T17:37:44.888 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/ 2024-09-13T17:37:44.888 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-13T17:37:44.888 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ 2024-09-13T17:37:44.888 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/ 2024-09-13T17:37:44.889 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-13T17:37:44.889 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ 2024-09-13T17:37:44.889 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 147345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-13T17:37:44.889 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ 2024-09-13T17:37:44.889 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 90201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-13T17:37:44.889 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 42073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-13T17:37:44.889 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 50729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-13T17:37:44.889 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-13T17:37:44.889 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-13T17:37:44.889 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-13T17:37:44.889 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-13T17:37:44.889 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-13T17:37:44.889 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 64265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-13T17:37:44.889 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-13T17:37:44.890 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-13T17:37:44.890 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 68801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-13T17:37:44.890 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-13T17:37:44.890 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/ 2024-09-13T17:37:44.890 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-gpio.ko 2024-09-13T17:37:44.890 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max14577.ko 2024-09-13T17:37:44.890 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max77693.ko 2024-09-13T17:37:44.890 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max8997.ko 2024-09-13T17:37:44.890 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-palmas.ko 2024-09-13T17:37:44.890 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-rt8973a.ko 2024-09-13T17:37:44.890 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-sm5502.ko 2024-09-13T17:37:44.890 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/ 2024-09-13T17:37:44.890 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 43049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/dmi-sysfs.ko 2024-09-13T17:37:44.891 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/ 2024-09-13T17:37:44.891 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/efi-pstore.ko 2024-09-13T17:37:44.891 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-13T17:37:44.891 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/ 2024-09-13T17:37:44.891 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-adp5520.ko 2024-09-13T17:37:44.891 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-amd8111.ko 2024-09-13T17:37:44.891 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-arizona.ko 2024-09-13T17:37:44.891 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9052.ko 2024-09-13T17:37:44.891 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9055.ko 2024-09-13T17:37:44.891 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-dln2.ko 2024-09-13T17:37:44.891 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 81153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-f7188x.ko 2024-09-13T17:37:44.891 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-generic.ko 2024-09-13T17:37:44.891 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-13T17:37:44.891 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-09-13T17:37:44.892 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-kempld.ko 2024-09-13T17:37:44.892 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-lp3943.ko 2024-09-13T17:37:44.892 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max7300.ko 2024-09-13T17:37:44.892 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max730x.ko 2024-09-13T17:37:44.892 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max732x.ko 2024-09-13T17:37:44.892 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-09-13T17:37:44.892 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 56001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pca953x.ko 2024-09-13T17:37:44.892 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pcf857x.ko 2024-09-13T17:37:44.892 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-rdc321x.ko 2024-09-13T17:37:44.892 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch.ko 2024-09-13T17:37:44.892 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch311x.ko 2024-09-13T17:37:44.892 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-tps65912.ko 2024-09-13T17:37:44.892 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl4030.ko 2024-09-13T17:37:44.892 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl6040.ko 2024-09-13T17:37:44.893 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-13T17:37:44.893 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-vx855.ko 2024-09-13T17:37:44.893 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm831x.ko 2024-09-13T17:37:44.893 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8350.ko 2024-09-13T17:37:44.893 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8994.ko 2024-09-13T17:37:44.893 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/ 2024-09-13T17:37:44.893 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-a4tech.ko 2024-09-13T17:37:44.893 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-apple.ko 2024-09-13T17:37:44.896 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-13T17:37:44.896 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-13T17:37:44.896 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-13T17:37:44.896 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-belkin.ko 2024-09-13T17:37:44.897 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cherry.ko 2024-09-13T17:37:44.897 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-chicony.ko 2024-09-13T17:37:44.897 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 74497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cp2112.ko 2024-09-13T17:37:44.897 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cypress.ko 2024-09-13T17:37:44.897 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-13T17:37:44.897 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-13T17:37:44.897 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-13T17:37:44.897 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-13T17:37:44.897 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ezkey.ko 2024-09-13T17:37:44.897 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-13T17:37:44.897 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-generic.ko 2024-09-13T17:37:44.897 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-13T17:37:44.897 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-13T17:37:44.898 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-13T17:37:44.898 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-13T17:37:44.898 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-13T17:37:44.898 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-13T17:37:44.898 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-13T17:37:44.898 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kensington.ko 2024-09-13T17:37:44.898 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-13T17:37:44.898 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-13T17:37:44.898 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-13T17:37:44.898 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-13T17:37:44.898 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 54337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-13T17:37:44.898 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 37753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lg-g15.ko 2024-09-13T17:37:44.898 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 67841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-13T17:37:44.899 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 122145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-13T17:37:44.899 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 98177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech.ko 2024-09-13T17:37:44.899 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-magicmouse.ko 2024-09-13T17:37:44.899 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-microsoft.ko 2024-09-13T17:37:44.899 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-monterey.ko 2024-09-13T17:37:44.899 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 60505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-13T17:37:44.899 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ntrig.ko 2024-09-13T17:37:44.899 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-13T17:37:44.899 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-13T17:37:44.899 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-13T17:37:44.899 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 91217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-13T17:37:44.899 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-13T17:37:44.899 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-13T17:37:44.899 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-13T17:37:44.900 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-13T17:37:44.900 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-13T17:37:44.900 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-13T17:37:44.900 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-13T17:37:44.900 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-13T17:37:44.900 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-13T17:37:44.900 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-13T17:37:44.900 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-13T17:37:44.900 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-13T17:37:44.900 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-13T17:37:44.900 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-13T17:37:44.900 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-13T17:37:44.900 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-13T17:37:44.901 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-13T17:37:44.901 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 42505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-13T17:37:44.901 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 42609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-13T17:37:44.901 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-13T17:37:44.901 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 62345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-13T17:37:44.901 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-13T17:37:44.901 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-13T17:37:44.901 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-13T17:37:44.901 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-13T17:37:44.901 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-13T17:37:44.901 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-13T17:37:44.901 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-13T17:37:44.901 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-13T17:37:44.902 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 81673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-13T17:37:44.902 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-13T17:37:44.902 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 184865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-13T17:37:44.902 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-13T17:37:44.902 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-13T17:37:44.902 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-13T17:37:44.902 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 462849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid.ko 2024-09-13T17:37:44.902 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-13T17:37:44.902 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/ 2024-09-13T17:37:44.902 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 153953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbhid.ko 2024-09-13T17:37:44.902 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbkbd.ko 2024-09-13T17:37:44.902 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbmouse.ko 2024-09-13T17:37:44.902 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 261241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-13T17:37:44.903 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/ 2024-09-13T17:37:44.903 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 76441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-13T17:37:44.903 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 96073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-13T17:37:44.903 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 378337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-13T17:37:44.903 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ 2024-09-13T17:37:44.903 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 77217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-13T17:37:44.903 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 67097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-13T17:37:44.903 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 43273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-13T17:37:44.903 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-13T17:37:44.903 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-13T17:37:44.903 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-13T17:37:44.903 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-13T17:37:44.903 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 115201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-13T17:37:44.904 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-13T17:37:44.904 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 55225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-13T17:37:44.904 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-13T17:37:44.904 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-13T17:37:44.904 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-13T17:37:44.904 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-13T17:37:44.904 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 89113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-13T17:37:44.904 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 49233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-13T17:37:44.904 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 81665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-13T17:37:44.904 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-13T17:37:44.904 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-13T17:37:44.904 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 68953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-13T17:37:44.904 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 60281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-13T17:37:44.905 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 69097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-13T17:37:44.905 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 48145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-13T17:37:44.905 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-13T17:37:44.905 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-13T17:37:44.905 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-09-13T17:37:44.905 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9052-hwmon.ko 2024-09-13T17:37:44.905 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9055-hwmon.ko 2024-09-13T17:37:44.905 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 57681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-13T17:37:44.905 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-13T17:37:44.905 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-13T17:37:44.905 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-13T17:37:44.905 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-13T17:37:44.905 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 40265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc2103.ko 2024-09-13T17:37:44.905 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-13T17:37:44.906 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 79009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-13T17:37:44.906 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 109049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-13T17:37:44.906 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 50769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-13T17:37:44.906 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-13T17:37:44.906 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 65849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-13T17:37:44.906 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-13T17:37:44.906 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-13T17:37:44.906 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 59849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-13T17:37:44.906 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 56393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-13T17:37:44.906 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hih6130.ko 2024-09-13T17:37:44.906 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-13T17:37:44.906 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-13T17:37:44.907 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-13T17:37:44.907 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 42681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-13T17:37:44.907 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-13T17:37:44.907 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-13T17:37:44.907 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-13T17:37:44.907 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 150681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-13T17:37:44.907 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/jc42.ko 2024-09-13T17:37:44.907 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-13T17:37:44.908 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-13T17:37:44.908 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-13T17:37:44.908 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 57769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-13T17:37:44.908 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-13T17:37:44.908 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-13T17:37:44.908 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-13T17:37:44.908 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 41537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-13T17:37:44.908 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 37129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-13T17:37:44.908 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-13T17:37:44.908 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 86561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-13T17:37:44.908 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 55721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-13T17:37:44.908 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 73649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-13T17:37:44.908 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-13T17:37:44.909 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 131585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-13T17:37:44.909 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 40369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-13T17:37:44.909 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-13T17:37:44.909 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-13T17:37:44.909 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-13T17:37:44.909 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-13T17:37:44.909 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-13T17:37:44.909 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-13T17:37:44.909 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-13T17:37:44.909 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-13T17:37:44.909 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-13T17:37:44.909 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-13T17:37:44.910 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-13T17:37:44.910 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-13T17:37:44.910 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-13T17:37:44.910 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-13T17:37:44.910 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-13T17:37:44.910 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-13T17:37:44.910 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mc13783-adc.ko 2024-09-13T17:37:44.910 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-13T17:37:44.910 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-09-13T17:37:44.910 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 56825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-13T17:37:44.910 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 140657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-13T17:37:44.910 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 72761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-13T17:37:44.910 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 67865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-13T17:37:44.910 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 97865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-13T17:37:44.911 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 62009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-13T17:37:44.911 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-13T17:37:44.911 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ 2024-09-13T17:37:44.911 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-13T17:37:44.911 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-13T17:37:44.911 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-13T17:37:44.911 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-13T17:37:44.911 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-13T17:37:44.911 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-13T17:37:44.911 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-13T17:37:44.911 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 98961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-13T17:37:44.911 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-13T17:37:44.911 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-13T17:37:44.912 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-13T17:37:44.912 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-13T17:37:44.912 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-13T17:37:44.912 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-13T17:37:44.912 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-13T17:37:44.912 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-13T17:37:44.912 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 40937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-13T17:37:44.912 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-13T17:37:44.912 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-13T17:37:44.912 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 48793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-13T17:37:44.912 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-13T17:37:44.912 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 46561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-13T17:37:44.913 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-13T17:37:44.913 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-13T17:37:44.913 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-13T17:37:44.913 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-13T17:37:44.913 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-13T17:37:44.913 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-13T17:37:44.913 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-13T17:37:44.913 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 50297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-13T17:37:44.913 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 59745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-13T17:37:44.913 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 62817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-13T17:37:44.913 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 71193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-13T17:37:44.913 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 96665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-13T17:37:44.913 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 85977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-13T17:37:44.914 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 75217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-13T17:37:44.914 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 83505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-13T17:37:44.914 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 116873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-13T17:37:44.914 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 134513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-13T17:37:44.914 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-13T17:37:44.914 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 43473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-13T17:37:44.914 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-09-13T17:37:44.914 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-09-13T17:37:44.914 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/ 2024-09-13T17:37:44.914 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/ 2024-09-13T17:37:44.914 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-13T17:37:44.914 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-13T17:37:44.914 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/ 2024-09-13T17:37:44.914 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-09-13T17:37:44.915 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-09-13T17:37:44.915 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-09-13T17:37:44.915 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-13T17:37:44.915 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-13T17:37:44.915 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-13T17:37:44.915 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-09-13T17:37:44.915 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-13T17:37:44.915 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-09-13T17:37:44.915 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 63537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-13T17:37:44.915 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-13T17:37:44.915 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-13T17:37:44.915 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-13T17:37:44.915 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-09-13T17:37:44.916 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-09-13T17:37:44.916 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 78577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-13T17:37:44.916 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-13T17:37:44.916 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-13T17:37:44.916 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-09-13T17:37:44.916 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-13T17:37:44.916 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-13T17:37:44.916 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-09-13T17:37:44.916 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-13T17:37:44.916 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-13T17:37:44.916 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 57137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-13T17:37:44.916 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-09-13T17:37:44.916 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-13T17:37:44.917 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-13T17:37:44.917 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-09-13T17:37:44.917 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-09-13T17:37:44.917 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-13T17:37:44.917 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-09-13T17:37:44.917 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-13T17:37:44.917 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-13T17:37:44.917 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-13T17:37:44.917 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-13T17:37:44.917 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 59145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-09-13T17:37:44.917 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-13T17:37:44.917 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-13T17:37:44.917 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-13T17:37:44.918 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/ 2024-09-13T17:37:44.918 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-09-13T17:37:44.918 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-09-13T17:37:44.918 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-09-13T17:37:44.918 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ 2024-09-13T17:37:44.918 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ 2024-09-13T17:37:44.918 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 328633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-13T17:37:44.918 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1107329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-13T17:37:44.918 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 84409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-13T17:37:44.918 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 404889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-13T17:37:44.918 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 120105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-13T17:37:44.918 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 343753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-13T17:37:44.918 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 85057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-13T17:37:44.919 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ 2024-09-13T17:37:44.919 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/ 2024-09-13T17:37:44.919 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 591177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-13T17:37:44.919 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/ 2024-09-13T17:37:44.919 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 515585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-13T17:37:44.919 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/ 2024-09-13T17:37:44.919 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 919921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-13T17:37:44.919 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ 2024-09-13T17:37:44.919 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 375761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-13T17:37:44.919 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ 2024-09-13T17:37:44.919 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 203241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-09-13T17:37:44.919 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/ 2024-09-13T17:37:44.919 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 212353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-09-13T17:37:44.920 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ 2024-09-13T17:37:44.920 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ 2024-09-13T17:37:44.920 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 334665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-13T17:37:44.920 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ 2024-09-13T17:37:44.920 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 120785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-13T17:37:44.920 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ 2024-09-13T17:37:44.920 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 132457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-13T17:37:44.920 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ 2024-09-13T17:37:44.920 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 158257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-13T17:37:44.920 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ 2024-09-13T17:37:44.920 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 157209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-13T17:37:44.920 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ 2024-09-13T17:37:44.920 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/evbug.ko 2024-09-13T17:37:44.921 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ff-memless.ko 2024-09-13T17:37:44.921 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/ 2024-09-13T17:37:44.921 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-13T17:37:44.921 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-13T17:37:44.921 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 49769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-13T17:37:44.921 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 49697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-13T17:37:44.921 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/ 2024-09-13T17:37:44.921 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-09-13T17:37:44.921 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-09-13T17:37:44.921 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-09-13T17:37:44.921 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-09-13T17:37:44.921 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 45537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-13T17:37:44.921 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-09-13T17:37:44.922 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lkkbd.ko 2024-09-13T17:37:44.922 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8323.ko 2024-09-13T17:37:44.922 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8333.ko 2024-09-13T17:37:44.922 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-09-13T17:37:44.922 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-09-13T17:37:44.922 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-09-13T17:37:44.922 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-09-13T17:37:44.922 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/newtonkbd.ko 2024-09-13T17:37:44.922 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-09-13T17:37:44.922 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt1070.ko 2024-09-13T17:37:44.922 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt2160.ko 2024-09-13T17:37:44.922 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-09-13T17:37:44.922 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/stowaway.ko 2024-09-13T17:37:44.923 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/sunkbd.ko 2024-09-13T17:37:44.923 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-09-13T17:37:44.923 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-09-13T17:37:44.923 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-09-13T17:37:44.923 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/xtkbd.ko 2024-09-13T17:37:44.923 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/matrix-keymap.ko 2024-09-13T17:37:44.923 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/ 2024-09-13T17:37:44.923 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-13T17:37:44.923 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-13T17:37:44.923 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 160569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-13T17:37:44.923 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 114801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-13T17:37:44.923 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/gpio_mouse.ko 2024-09-13T17:37:44.923 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 430033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/psmouse.ko 2024-09-13T17:37:44.923 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-13T17:37:44.924 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-13T17:37:44.924 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-13T17:37:44.924 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-13T17:37:44.924 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/ 2024-09-13T17:37:44.924 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 139497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-13T17:37:44.924 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ 2024-09-13T17:37:44.924 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-13T17:37:44.924 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-13T17:37:44.924 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ct82c710.ko 2024-09-13T17:37:44.924 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-13T17:37:44.924 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/parkbd.ko 2024-09-13T17:37:44.924 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/pcips2.ko 2024-09-13T17:37:44.924 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ps2mult.ko 2024-09-13T17:37:44.925 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-13T17:37:44.925 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serport.ko 2024-09-13T17:37:44.925 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-13T17:37:44.925 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/ 2024-09-13T17:37:44.925 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-88pm860x.ko 2024-09-13T17:37:44.925 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-adp5520.ko 2024-09-13T17:37:44.925 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 77345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-bd2802.ko 2024-09-13T17:37:44.925 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-13T17:37:44.925 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da903x.ko 2024-09-13T17:37:44.925 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da9052.ko 2024-09-13T17:37:44.926 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-gpio.ko 2024-09-13T17:37:44.926 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-13T17:37:44.926 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3533.ko 2024-09-13T17:37:44.926 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm355x.ko 2024-09-13T17:37:44.926 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3642.ko 2024-09-13T17:37:44.926 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-13T17:37:44.926 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp8788.ko 2024-09-13T17:37:44.926 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-max8997.ko 2024-09-13T17:37:44.926 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-mc13783.ko 2024-09-13T17:37:44.926 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-menf21bmc.ko 2024-09-13T17:37:44.926 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca9532.ko 2024-09-13T17:37:44.926 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca955x.ko 2024-09-13T17:37:44.926 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca963x.ko 2024-09-13T17:37:44.927 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-13T17:37:44.927 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-tca6507.ko 2024-09-13T17:37:44.927 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm831x-status.ko 2024-09-13T17:37:44.927 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm8350.ko 2024-09-13T17:37:44.927 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ 2024-09-13T17:37:44.927 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-13T17:37:44.927 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-13T17:37:44.927 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-13T17:37:44.927 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-13T17:37:44.927 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-13T17:37:44.927 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-13T17:37:44.927 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-13T17:37:44.928 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-13T17:37:44.928 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/ 2024-09-13T17:37:44.928 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/ 2024-09-13T17:37:44.928 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 776777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-13T17:37:44.928 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 46361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-13T17:37:44.928 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 113977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bufio.ko 2024-09-13T17:37:44.928 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 58393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-13T17:37:44.928 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 197121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-13T17:37:44.928 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 137841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-13T17:37:44.928 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-13T17:37:44.928 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 67153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-era.ko 2024-09-13T17:37:44.928 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-13T17:37:44.928 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 50665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-13T17:37:44.929 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log.ko 2024-09-13T17:37:44.929 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 61073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-mirror.ko 2024-09-13T17:37:44.929 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 96937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-13T17:37:44.929 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-13T17:37:44.929 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 86937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-13T17:37:44.929 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 42121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-region-hash.ko 2024-09-13T17:37:44.929 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-13T17:37:44.929 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-13T17:37:44.929 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 139257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-snapshot.ko 2024-09-13T17:37:44.929 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-13T17:37:44.929 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 234353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-13T17:37:44.929 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 64945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-13T17:37:44.929 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-zero.ko 2024-09-13T17:37:44.930 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/ 2024-09-13T17:37:44.930 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 257025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-13T17:37:44.930 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 43417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-13T17:37:44.930 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 124833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-13T17:37:44.930 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 157401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-13T17:37:44.930 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 443385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-13T17:37:44.930 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/ 2024-09-13T17:37:44.930 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/ 2024-09-13T17:37:44.930 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 211273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-13T17:37:44.930 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 78081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-13T17:37:44.930 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 54889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-13T17:37:44.930 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-13T17:37:44.930 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 150977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-13T17:37:44.930 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 94401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-13T17:37:44.931 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 64033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-13T17:37:44.931 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/ 2024-09-13T17:37:44.931 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm800.ko 2024-09-13T17:37:44.931 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm805.ko 2024-09-13T17:37:44.931 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm80x.ko 2024-09-13T17:37:44.931 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona-i2c.ko 2024-09-13T17:37:44.931 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 146569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona.ko 2024-09-13T17:37:44.931 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/bcm590xx.ko 2024-09-13T17:37:44.931 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/cros_ec_dev.ko 2024-09-13T17:37:44.931 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 40657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/dln2.ko 2024-09-13T17:37:44.931 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/janz-cmodio.ko 2024-09-13T17:37:44.931 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 54473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/kempld-core.ko 2024-09-13T17:37:44.931 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-core.ko 2024-09-13T17:37:44.932 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-09-13T17:37:44.932 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lp3943.ko 2024-09-13T17:37:44.932 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 60577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-13T17:37:44.932 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-13T17:37:44.932 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/max8907.ko 2024-09-13T17:37:44.932 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-core.ko 2024-09-13T17:37:44.932 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-09-13T17:37:44.932 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/menf21bmc.ko 2024-09-13T17:37:44.932 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-adc.ko 2024-09-13T17:37:44.932 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-gpio.ko 2024-09-13T17:37:44.932 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 41041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633.ko 2024-09-13T17:37:44.932 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-09-13T17:37:44.932 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/retu-mfd.ko 2024-09-13T17:37:44.933 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 95625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/si476x-core.ko 2024-09-13T17:37:44.933 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 57473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-13T17:37:44.933 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 59801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps65010.ko 2024-09-13T17:37:44.933 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps6507x.ko 2024-09-13T17:37:44.933 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-13T17:37:44.933 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-13T17:37:44.933 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-13T17:37:44.933 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 51201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wm8994.ko 2024-09-13T17:37:44.933 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ 2024-09-13T17:37:44.933 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-09-13T17:37:44.933 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 63993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot.ko 2024-09-13T17:37:44.933 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/ 2024-09-13T17:37:44.933 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 57393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-13T17:37:44.934 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-13T17:37:44.934 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 47785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-13T17:37:44.934 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 58785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-13T17:37:44.934 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/ 2024-09-13T17:37:44.934 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-09-13T17:37:44.934 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 47313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/core.ko 2024-09-13T17:37:44.934 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/ 2024-09-13T17:37:44.934 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-13T17:37:44.934 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ds1682.ko 2024-09-13T17:37:44.934 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/dummy-irq.ko 2024-09-13T17:37:44.934 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/ 2024-09-13T17:37:44.934 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/echo.ko 2024-09-13T17:37:44.934 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/ 2024-09-13T17:37:44.935 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-13T17:37:44.935 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-13T17:37:44.935 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-13T17:37:44.935 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 40305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-13T17:37:44.935 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/ 2024-09-13T17:37:44.935 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 191761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-09-13T17:37:44.935 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hmc6352.ko 2024-09-13T17:37:44.935 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 37857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-13T17:37:44.935 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ 2024-09-13T17:37:44.935 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 92489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-09-13T17:37:44.935 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ics932s401.ko 2024-09-13T17:37:44.935 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-13T17:37:44.935 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-13T17:37:44.935 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/ 2024-09-13T17:37:44.936 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 53961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-13T17:37:44.936 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-13T17:37:44.936 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/ 2024-09-13T17:37:44.936 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 153777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-13T17:37:44.936 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 69897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-13T17:37:44.936 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 381905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-13T17:37:44.936 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/phantom.ko 2024-09-13T17:37:44.936 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/ 2024-09-13T17:37:44.936 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 90881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/st_drv.ko 2024-09-13T17:37:44.936 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-13T17:37:44.936 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-13T17:37:44.936 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-13T17:37:44.936 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 56809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-13T17:37:44.937 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/ 2024-09-13T17:37:44.937 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 232257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-13T17:37:44.937 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ 2024-09-13T17:37:44.937 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/ 2024-09-13T17:37:44.937 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 623361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-13T17:37:44.937 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/ 2024-09-13T17:37:44.937 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/ 2024-09-13T17:37:44.937 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 133161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-13T17:37:44.937 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 49641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-13T17:37:44.937 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-13T17:37:44.937 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/ 2024-09-13T17:37:44.937 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 592833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-13T17:37:44.937 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-13T17:37:44.938 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-13T17:37:44.938 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ 2024-09-13T17:37:44.938 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/ 2024-09-13T17:37:44.938 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 53841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-13T17:37:44.938 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 49281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-13T17:37:44.938 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 158537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-13T17:37:44.938 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 86233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-13T17:37:44.938 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ 2024-09-13T17:37:44.938 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-13T17:37:44.938 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 73953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-13T17:37:44.938 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-13T17:37:44.938 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 109673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-13T17:37:44.938 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/ 2024-09-13T17:37:44.939 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 64817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-13T17:37:44.939 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/ 2024-09-13T17:37:44.939 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 84433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-13T17:37:44.939 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/ 2024-09-13T17:37:44.939 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 70897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-13T17:37:44.939 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/ 2024-09-13T17:37:44.939 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 52713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-13T17:37:44.939 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/ 2024-09-13T17:37:44.939 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 65945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-13T17:37:44.939 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 56145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-13T17:37:44.939 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 116105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-13T17:37:44.939 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/ 2024-09-13T17:37:44.939 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/ 2024-09-13T17:37:44.939 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 124721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-13T17:37:44.940 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-09-13T17:37:44.940 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 128625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-13T17:37:44.940 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-09-13T17:37:44.940 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 110505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-13T17:37:44.940 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/ 2024-09-13T17:37:44.940 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 102017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-13T17:37:44.940 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 89121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-13T17:37:44.940 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/ 2024-09-13T17:37:44.940 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 106593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-13T17:37:44.940 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 229409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-13T17:37:44.940 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-09-13T17:37:44.940 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1734265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-13T17:37:44.940 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 166913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-13T17:37:44.941 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/ 2024-09-13T17:37:44.941 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 164665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-13T17:37:44.941 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 439633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-13T17:37:44.941 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/ 2024-09-13T17:37:44.941 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/ 2024-09-13T17:37:44.941 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 432417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-13T17:37:44.941 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/ 2024-09-13T17:37:44.941 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-09-13T17:37:44.941 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 257433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-13T17:37:44.941 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-09-13T17:37:44.941 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 444721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-13T17:37:44.941 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-09-13T17:37:44.941 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1309441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-13T17:37:44.942 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-09-13T17:37:44.942 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 207073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-13T17:37:44.942 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-09-13T17:37:44.942 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-13T17:37:44.942 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/ 2024-09-13T17:37:44.942 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/ 2024-09-13T17:37:44.942 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 269777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-13T17:37:44.942 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/ 2024-09-13T17:37:44.942 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/ 2024-09-13T17:37:44.942 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 85609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-13T17:37:44.942 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 77601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-13T17:37:44.942 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 169313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-13T17:37:44.942 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 66065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-13T17:37:44.943 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 76361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-13T17:37:44.943 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-13T17:37:44.943 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/ 2024-09-13T17:37:44.943 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 76161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-13T17:37:44.943 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 78929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-13T17:37:44.943 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 52401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-13T17:37:44.943 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ec_bhf.ko 2024-09-13T17:37:44.943 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/ 2024-09-13T17:37:44.943 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/ 2024-09-13T17:37:44.943 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 356153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-13T17:37:44.943 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 61881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-13T17:37:44.943 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 63345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-13T17:37:44.943 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/ 2024-09-13T17:37:44.944 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 51657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-09-13T17:37:44.944 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ 2024-09-13T17:37:44.944 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 115697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-13T17:37:44.944 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/ 2024-09-13T17:37:44.944 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 366465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-13T17:37:44.944 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/ 2024-09-13T17:37:44.944 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 755425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-13T17:37:44.944 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/ 2024-09-13T17:37:44.944 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 324721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-13T17:37:44.944 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/ 2024-09-13T17:37:44.944 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1193705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-13T17:37:44.944 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/ 2024-09-13T17:37:44.944 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 356609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-13T17:37:44.944 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/ 2024-09-13T17:37:44.945 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 672177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-13T17:37:44.945 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/ 2024-09-13T17:37:44.945 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 121609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-13T17:37:44.945 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-09-13T17:37:44.945 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 966193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-13T17:37:44.945 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-09-13T17:37:44.945 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 193889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-13T17:37:44.945 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/ 2024-09-13T17:37:44.945 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-13T17:37:44.945 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/ 2024-09-13T17:37:44.945 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 5969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-13T17:37:44.945 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 109353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-13T17:37:44.945 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/ 2024-09-13T17:37:44.946 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-13T17:37:44.946 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 127057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-13T17:37:44.946 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 151049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-13T17:37:44.946 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/ 2024-09-13T17:37:44.946 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-09-13T17:37:44.946 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 888945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-13T17:37:44.946 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 346977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-13T17:37:44.946 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-09-13T17:37:44.946 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-09-13T17:37:44.946 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1408481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-13T17:37:44.946 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ 2024-09-13T17:37:44.946 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 66097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-09-13T17:37:44.946 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 53497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-09-13T17:37:44.946 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-09-13T17:37:44.947 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 117585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-13T17:37:44.947 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/ 2024-09-13T17:37:44.947 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-09-13T17:37:44.947 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 131601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-13T17:37:44.947 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ 2024-09-13T17:37:44.947 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 91689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-13T17:37:44.947 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 56777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-13T17:37:44.947 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/ 2024-09-13T17:37:44.947 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 181409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-13T17:37:44.947 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/ 2024-09-13T17:37:44.947 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 171649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-13T17:37:44.947 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/ 2024-09-13T17:37:44.947 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 58529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-13T17:37:44.948 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 50409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-13T17:37:44.948 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/ 2024-09-13T17:37:44.948 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-09-13T17:37:44.948 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 301017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-13T17:37:44.948 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 105857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-13T17:37:44.948 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-09-13T17:37:44.948 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 885465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-13T17:37:44.948 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/ 2024-09-13T17:37:44.948 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 52481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-13T17:37:44.948 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/ 2024-09-13T17:37:44.948 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 81785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-13T17:37:44.948 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 100833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-13T17:37:44.948 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-13T17:37:44.949 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 264393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-13T17:37:44.949 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/ 2024-09-13T17:37:44.949 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-09-13T17:37:44.949 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 142481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-09-13T17:37:44.949 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/ 2024-09-13T17:37:44.949 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1346017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-13T17:37:44.949 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/ 2024-09-13T17:37:44.949 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 58097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-13T17:37:44.949 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/ 2024-09-13T17:37:44.949 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 66737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-13T17:37:44.949 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 80233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-13T17:37:44.949 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/ 2024-09-13T17:37:44.949 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 74529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-13T17:37:44.949 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 79601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-13T17:37:44.950 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 100937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-13T17:37:44.950 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 83593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-13T17:37:44.950 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/ 2024-09-13T17:37:44.950 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-09-13T17:37:44.950 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-09-13T17:37:44.950 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-13T17:37:44.950 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-09-13T17:37:44.950 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 644913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-13T17:37:44.950 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/ 2024-09-13T17:37:44.950 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 129089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-13T17:37:44.950 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 208177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-13T17:37:44.950 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 82033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-13T17:37:44.950 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 91641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-13T17:37:44.951 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/ 2024-09-13T17:37:44.951 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 60113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-13T17:37:44.951 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/ 2024-09-13T17:37:44.951 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 110881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-13T17:37:44.951 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/ 2024-09-13T17:37:44.951 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 98993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-13T17:37:44.951 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 102745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-13T17:37:44.951 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/ 2024-09-13T17:37:44.951 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 61121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-13T17:37:44.951 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 40689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-13T17:37:44.952 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/ 2024-09-13T17:37:44.952 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 70057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-13T17:37:44.952 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/ 2024-09-13T17:37:44.952 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 49537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/defxx.ko 2024-09-13T17:37:44.952 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/ 2024-09-13T17:37:44.952 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 275889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/skfp.ko 2024-09-13T17:37:44.952 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 91785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-13T17:37:44.952 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/ 2024-09-13T17:37:44.952 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 290697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-13T17:37:44.952 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/ 2024-09-13T17:37:44.952 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-13T17:37:44.952 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-13T17:37:44.953 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ 2024-09-13T17:37:44.953 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 107849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-13T17:37:44.953 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 77585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-13T17:37:44.953 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-13T17:37:44.953 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/ 2024-09-13T17:37:44.953 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-13T17:37:44.953 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-13T17:37:44.953 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-gpio.ko 2024-09-13T17:37:44.953 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-13T17:37:44.953 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-13T17:37:44.953 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-13T17:37:44.953 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 62857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-13T17:37:44.953 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-13T17:37:44.953 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/ 2024-09-13T17:37:44.954 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-13T17:37:44.954 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 72969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-13T17:37:44.954 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ 2024-09-13T17:37:44.954 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-13T17:37:44.954 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 61801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-13T17:37:44.954 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-13T17:37:44.954 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-13T17:37:44.954 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 58729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-13T17:37:44.954 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-13T17:37:44.954 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-13T17:37:44.954 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-13T17:37:44.954 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-13T17:37:44.954 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-13T17:37:44.955 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 113681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-13T17:37:44.955 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 108257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-13T17:37:44.955 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-13T17:37:44.955 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 118505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-13T17:37:44.955 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-13T17:37:44.955 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 76177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-13T17:37:44.955 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-13T17:37:44.955 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-13T17:37:44.955 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-13T17:37:44.955 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/ 2024-09-13T17:37:44.955 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 55377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/plip.ko 2024-09-13T17:37:44.955 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ 2024-09-13T17:37:44.955 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-13T17:37:44.956 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-13T17:37:44.956 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-13T17:37:44.956 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-13T17:37:44.956 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-13T17:37:44.956 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 53409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-13T17:37:44.956 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-13T17:37:44.956 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-13T17:37:44.956 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/ 2024-09-13T17:37:44.956 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 52177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-13T17:37:44.956 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 42257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-13T17:37:44.956 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 79233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-13T17:37:44.956 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/ 2024-09-13T17:37:44.956 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 136729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-13T17:37:44.956 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-13T17:37:44.957 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-13T17:37:44.957 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-13T17:37:44.957 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-13T17:37:44.957 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-13T17:37:44.957 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 108409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-13T17:37:44.957 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/ 2024-09-13T17:37:44.957 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 179329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-13T17:37:44.957 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/ 2024-09-13T17:37:44.957 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 384193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-13T17:37:44.957 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/ 2024-09-13T17:37:44.957 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 175857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-13T17:37:44.957 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ 2024-09-13T17:37:44.957 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-13T17:37:44.958 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/ 2024-09-13T17:37:44.958 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/ 2024-09-13T17:37:44.958 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 337697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-13T17:37:44.958 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 128353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-13T17:37:44.958 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/ 2024-09-13T17:37:44.958 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 164153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-13T17:37:44.958 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-13T17:37:44.958 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 103657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-13T17:37:44.958 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-13T17:37:44.958 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/ 2024-09-13T17:37:44.958 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/ 2024-09-13T17:37:44.958 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-13T17:37:44.958 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-09-13T17:37:44.959 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-09-13T17:37:44.959 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pci-stub.ko 2024-09-13T17:37:44.959 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-13T17:37:44.959 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/ 2024-09-13T17:37:44.959 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-13T17:37:44.959 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 177817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia.ko 2024-09-13T17:37:44.959 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 76785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_core.ko 2024-09-13T17:37:44.959 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 41777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-09-13T17:37:44.959 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-13T17:37:44.959 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 133969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-13T17:37:44.959 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/ 2024-09-13T17:37:44.959 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/ 2024-09-13T17:37:44.959 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-09-13T17:37:44.959 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/ 2024-09-13T17:37:44.960 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-09-13T17:37:44.960 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/ 2024-09-13T17:37:44.960 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/ 2024-09-13T17:37:44.960 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 78281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-13T17:37:44.960 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/ 2024-09-13T17:37:44.960 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/ 2024-09-13T17:37:44.960 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 60889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-09-13T17:37:44.960 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec.ko 2024-09-13T17:37:44.960 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-09-13T17:37:44.960 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-09-13T17:37:44.960 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-09-13T17:37:44.960 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-09-13T17:37:44.960 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-09-13T17:37:44.961 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ 2024-09-13T17:37:44.961 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 88017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-13T17:37:44.961 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-13T17:37:44.961 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 48353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-13T17:37:44.961 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 74033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-13T17:37:44.961 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-13T17:37:44.961 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 172313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-13T17:37:44.961 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 46505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-13T17:37:44.961 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 62105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-13T17:37:44.961 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-13T17:37:44.961 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 52665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-13T17:37:44.961 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-13T17:37:44.961 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 42913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-13T17:37:44.962 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ibm_rtl.ko 2024-09-13T17:37:44.962 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/ 2024-09-13T17:37:44.962 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-13T17:37:44.962 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-09-13T17:37:44.962 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 53801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-13T17:37:44.962 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-13T17:37:44.962 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-13T17:37:44.962 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 43793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-13T17:37:44.962 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 51857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-13T17:37:44.962 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-13T17:37:44.962 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-13T17:37:44.962 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-13T17:37:44.962 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-13T17:37:44.962 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-13T17:37:44.963 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 59729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-13T17:37:44.963 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/ 2024-09-13T17:37:44.963 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ 2024-09-13T17:37:44.963 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_battery.ko 2024-09-13T17:37:44.963 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 40449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_charger.ko 2024-09-13T17:37:44.963 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 68921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq2415x_charger.ko 2024-09-13T17:37:44.963 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 73161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24190_charger.ko 2024-09-13T17:37:44.963 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24735-charger.ko 2024-09-13T17:37:44.963 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_charge-control.ko 2024-09-13T17:37:44.963 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-09-13T17:37:44.963 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9030_battery.ko 2024-09-13T17:37:44.963 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9052-battery.ko 2024-09-13T17:37:44.963 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2760_battery.ko 2024-09-13T17:37:44.964 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2780_battery.ko 2024-09-13T17:37:44.964 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2781_battery.ko 2024-09-13T17:37:44.964 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2782_battery.ko 2024-09-13T17:37:44.964 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/gpio-charger.ko 2024-09-13T17:37:44.964 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/isp1704_charger.ko 2024-09-13T17:37:44.964 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/lp8727_charger.ko 2024-09-13T17:37:44.964 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max14577_charger.ko 2024-09-13T17:37:44.964 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 37929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max17042_battery.ko 2024-09-13T17:37:44.964 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8903_charger.ko 2024-09-13T17:37:44.964 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8925_power.ko 2024-09-13T17:37:44.964 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/pcf50633-charger.ko 2024-09-13T17:37:44.964 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/sbs-battery.ko 2024-09-13T17:37:44.964 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/test_power.ko 2024-09-13T17:37:44.965 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/tps65090-charger.ko 2024-09-13T17:37:44.965 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_backup.ko 2024-09-13T17:37:44.965 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_power.ko 2024-09-13T17:37:44.965 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm8350_power.ko 2024-09-13T17:37:44.965 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/ 2024-09-13T17:37:44.965 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 98737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-13T17:37:44.965 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-13T17:37:44.965 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/ 2024-09-13T17:37:44.965 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/ 2024-09-13T17:37:44.965 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-13T17:37:44.965 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-13T17:37:44.965 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-13T17:37:44.965 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 49385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-13T17:37:44.966 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ 2024-09-13T17:37:44.966 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 90617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-13T17:37:44.966 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-13T17:37:44.966 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/ 2024-09-13T17:37:44.966 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/ 2024-09-13T17:37:44.966 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/ 2024-09-13T17:37:44.966 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 89769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-13T17:37:44.966 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 47369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-13T17:37:44.966 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/ 2024-09-13T17:37:44.966 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm80x.ko 2024-09-13T17:37:44.966 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm860x.ko 2024-09-13T17:37:44.966 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-13T17:37:44.966 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9052.ko 2024-09-13T17:37:44.966 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9055.ko 2024-09-13T17:37:44.967 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9063.ko 2024-09-13T17:37:44.967 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-13T17:37:44.967 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 82585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-13T17:37:44.967 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-13T17:37:44.967 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-13T17:37:44.967 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-13T17:37:44.967 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-13T17:37:44.967 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-13T17:37:44.967 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-13T17:37:44.967 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-13T17:37:44.967 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-13T17:37:44.967 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-13T17:37:44.967 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-13T17:37:44.968 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-13T17:37:44.968 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-lp8788.ko 2024-09-13T17:37:44.968 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 47001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-13T17:37:44.968 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-13T17:37:44.968 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-13T17:37:44.968 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t86.ko 2024-09-13T17:37:44.968 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-13T17:37:44.968 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8907.ko 2024-09-13T17:37:44.968 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8925.ko 2024-09-13T17:37:44.968 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8997.ko 2024-09-13T17:37:44.968 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8998.ko 2024-09-13T17:37:44.968 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-09-13T17:37:44.968 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-13T17:37:44.969 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-palmas.ko 2024-09-13T17:37:44.969 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 56873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-13T17:37:44.969 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf50633.ko 2024-09-13T17:37:44.969 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-13T17:37:44.969 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-13T17:37:44.969 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-13T17:37:44.969 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-13T17:37:44.969 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rc5t583.ko 2024-09-13T17:37:44.969 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-13T17:37:44.969 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 40169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-13T17:37:44.969 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-13T17:37:44.969 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-13T17:37:44.969 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-13T17:37:44.970 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-s35390a.ko 2024-09-13T17:37:44.970 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-13T17:37:44.970 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps6586x.ko 2024-09-13T17:37:44.970 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps65910.ko 2024-09-13T17:37:44.970 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm831x.ko 2024-09-13T17:37:44.970 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm8350.ko 2024-09-13T17:37:44.970 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-13T17:37:44.970 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ 2024-09-13T17:37:44.970 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 90537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-13T17:37:44.970 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 69689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-13T17:37:44.970 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 66033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-13T17:37:44.970 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 164753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-13T17:37:44.970 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-13T17:37:44.971 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/ 2024-09-13T17:37:44.971 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 341105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-13T17:37:44.971 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 120833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-13T17:37:44.971 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/ 2024-09-13T17:37:44.971 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 468305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-13T17:37:44.971 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 380857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-13T17:37:44.971 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/ 2024-09-13T17:37:44.971 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 244049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-09-13T17:37:44.971 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-13T17:37:44.971 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/ 2024-09-13T17:37:44.971 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 135801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-13T17:37:44.971 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-13T17:37:44.971 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/ 2024-09-13T17:37:44.972 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 305161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-13T17:37:44.972 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/ 2024-09-13T17:37:44.972 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1526289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-13T17:37:44.972 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/ 2024-09-13T17:37:44.972 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 298321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-13T17:37:44.972 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/ 2024-09-13T17:37:44.972 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 144553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-13T17:37:44.972 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 47673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-13T17:37:44.972 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/ 2024-09-13T17:37:44.972 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 390817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-13T17:37:44.972 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/ 2024-09-13T17:37:44.972 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-09-13T17:37:44.972 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 89041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-13T17:37:44.973 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-09-13T17:37:44.973 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 117561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-13T17:37:44.973 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 168361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-13T17:37:44.973 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 91777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-13T17:37:44.973 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 45489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-13T17:37:44.973 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/ 2024-09-13T17:37:44.973 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 267737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-13T17:37:44.973 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 78441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-13T17:37:44.973 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/ 2024-09-13T17:37:44.973 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 95553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-13T17:37:44.973 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 191041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-13T17:37:44.973 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fdomain.ko 2024-09-13T17:37:44.973 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/ 2024-09-13T17:37:44.973 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 366737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-13T17:37:44.974 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 251641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-13T17:37:44.974 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 65529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-13T17:37:44.974 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 57201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-13T17:37:44.974 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/imm.ko 2024-09-13T17:37:44.974 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 55241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-13T17:37:44.974 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 327841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-13T17:37:44.974 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 129881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-13T17:37:44.974 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/ 2024-09-13T17:37:44.974 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 398505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-13T17:37:44.974 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-13T17:37:44.974 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 62785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-13T17:37:44.974 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/ 2024-09-13T17:37:44.974 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 380649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-13T17:37:44.975 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 172833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-13T17:37:44.975 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 63097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-13T17:37:44.975 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/ 2024-09-13T17:37:44.975 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 274913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-13T17:37:44.975 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/ 2024-09-13T17:37:44.975 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 2737441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-13T17:37:44.975 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/ 2024-09-13T17:37:44.975 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 88625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-13T17:37:44.975 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-13T17:37:44.975 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 388737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-13T17:37:44.975 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 105177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-13T17:37:44.975 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/ 2024-09-13T17:37:44.975 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 833969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-13T17:37:44.975 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/ 2024-09-13T17:37:44.976 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 158857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-13T17:37:44.976 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 96697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-13T17:37:44.976 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/ 2024-09-13T17:37:44.976 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 102113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-09-13T17:37:44.976 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-09-13T17:37:44.976 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-09-13T17:37:44.976 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-09-13T17:37:44.976 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/ 2024-09-13T17:37:44.976 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 444273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-13T17:37:44.976 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 152097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-13T17:37:44.976 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 41265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ppa.ko 2024-09-13T17:37:44.976 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 67129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-13T17:37:44.976 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/ 2024-09-13T17:37:44.977 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 2323537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-13T17:37:44.977 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 103793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-13T17:37:44.977 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/ 2024-09-13T17:37:44.977 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 697393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-13T17:37:44.977 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qlogicfas408.ko 2024-09-13T17:37:44.977 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-13T17:37:44.977 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 331577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-13T17:37:44.977 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 219497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-13T17:37:44.977 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 349593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-13T17:37:44.977 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 121777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-13T17:37:44.977 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 92385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-13T17:37:44.977 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 54097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-13T17:37:44.977 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-13T17:37:44.978 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 138265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-13T17:37:44.978 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 57489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-13T17:37:44.978 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/ 2024-09-13T17:37:44.978 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 205137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-13T17:37:44.978 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 55009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-13T17:37:44.978 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 59289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-13T17:37:44.978 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 48865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-13T17:37:44.978 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 59521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/xen-scsifront.ko 2024-09-13T17:37:44.978 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ 2024-09-13T17:37:44.978 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 172697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-13T17:37:44.978 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/ 2024-09-13T17:37:44.978 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/ 2024-09-13T17:37:44.978 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 915121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-13T17:37:44.978 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/ 2024-09-13T17:37:44.979 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 60497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-13T17:37:44.979 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 48281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-13T17:37:44.979 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 53881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-13T17:37:44.979 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1161521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-13T17:37:44.979 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 51985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-13T17:37:44.979 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 149801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-13T17:37:44.979 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/ 2024-09-13T17:37:44.979 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 90217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-13T17:37:44.979 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/ 2024-09-13T17:37:44.979 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/ 2024-09-13T17:37:44.979 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/ 2024-09-13T17:37:44.979 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-13T17:37:44.979 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-13T17:37:44.980 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-13T17:37:44.980 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-13T17:37:44.980 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-13T17:37:44.980 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-13T17:37:44.980 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-13T17:37:44.980 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-13T17:37:44.980 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-13T17:37:44.980 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-13T17:37:44.980 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-13T17:37:44.980 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-13T17:37:44.980 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 46289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-13T17:37:44.980 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-13T17:37:44.980 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-13T17:37:44.981 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-09-13T17:37:44.981 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-13T17:37:44.981 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-13T17:37:44.981 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-13T17:37:44.981 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ 2024-09-13T17:37:44.981 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ 2024-09-13T17:37:44.981 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 99417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-13T17:37:44.981 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 69825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/moxa.ko 2024-09-13T17:37:44.981 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 61737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/mxser.ko 2024-09-13T17:37:44.981 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 134633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-13T17:37:44.981 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 37993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-13T17:37:44.981 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 79057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-13T17:37:44.981 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/ 2024-09-13T17:37:44.981 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/ 2024-09-13T17:37:44.982 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 43209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-09-13T17:37:44.982 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 65273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-13T17:37:44.982 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-09-13T17:37:44.982 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_uart.ko 2024-09-13T17:37:44.982 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-13T17:37:44.982 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 90697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-09-13T17:37:44.982 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/ 2024-09-13T17:37:44.982 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 121249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-13T17:37:44.982 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/rp2.ko 2024-09-13T17:37:44.982 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 68009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx.ko 2024-09-13T17:37:44.982 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-09-13T17:37:44.982 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/ 2024-09-13T17:37:44.982 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ 2024-09-13T17:37:44.982 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 689289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-13T17:37:44.983 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ 2024-09-13T17:37:44.983 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-13T17:37:44.983 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-09-13T17:37:44.983 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/ 2024-09-13T17:37:44.983 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 55041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-13T17:37:44.983 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-13T17:37:44.983 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-13T17:37:44.983 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_dmem_genirq.ko 2024-09-13T17:37:44.983 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_mf624.ko 2024-09-13T17:37:44.983 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_netx.ko 2024-09-13T17:37:44.983 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-13T17:37:44.983 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-09-13T17:37:44.983 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-13T17:37:44.983 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/ 2024-09-13T17:37:44.984 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/ 2024-09-13T17:37:44.984 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 90417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/c67x00.ko 2024-09-13T17:37:44.984 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ 2024-09-13T17:37:44.984 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 187689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-09-13T17:37:44.984 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-09-13T17:37:44.984 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-09-13T17:37:44.984 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-09-13T17:37:44.984 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-09-13T17:37:44.984 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/ 2024-09-13T17:37:44.984 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 101657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-13T17:37:44.984 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 63545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-13T17:37:44.984 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 56841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-13T17:37:44.984 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 107633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-13T17:37:44.985 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ 2024-09-13T17:37:44.985 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ulpi.ko 2024-09-13T17:37:44.985 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/ 2024-09-13T17:37:44.985 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-09-13T17:37:44.985 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/ 2024-09-13T17:37:44.985 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-09-13T17:37:44.985 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-09-13T17:37:44.985 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 576329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3.ko 2024-09-13T17:37:44.985 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/ 2024-09-13T17:37:44.985 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/ 2024-09-13T17:37:44.985 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 70081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_ether.ko 2024-09-13T17:37:44.985 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 61153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_serial.ko 2024-09-13T17:37:44.985 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-09-13T17:37:44.985 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 49945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-09-13T17:37:44.986 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-09-13T17:37:44.986 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 43705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-09-13T17:37:44.986 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 132897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-09-13T17:37:44.986 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 62473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-09-13T17:37:44.986 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 142801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-09-13T17:37:44.986 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 70785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-09-13T17:37:44.986 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-09-13T17:37:44.986 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 37801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-09-13T17:37:44.986 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 70241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-09-13T17:37:44.986 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 99913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-09-13T17:37:44.986 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-09-13T17:37:44.986 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 71577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-09-13T17:37:44.986 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 85089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-09-13T17:37:44.987 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/ 2024-09-13T17:37:44.987 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-09-13T17:37:44.987 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-09-13T17:37:44.987 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-09-13T17:37:44.987 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-09-13T17:37:44.987 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-09-13T17:37:44.987 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-09-13T17:37:44.987 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-09-13T17:37:44.987 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-09-13T17:37:44.987 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-09-13T17:37:44.987 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-09-13T17:37:44.987 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-09-13T17:37:44.987 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-09-13T17:37:44.988 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 78185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-09-13T17:37:44.988 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-09-13T17:37:44.988 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 200137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/libcomposite.ko 2024-09-13T17:37:44.988 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/ 2024-09-13T17:37:44.988 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-09-13T17:37:44.988 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/ 2024-09-13T17:37:44.988 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 182665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-09-13T17:37:44.988 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 45633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-09-13T17:37:44.988 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 66545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-09-13T17:37:44.988 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 85393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-09-13T17:37:44.988 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 69409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-09-13T17:37:44.988 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 90409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2272.ko 2024-09-13T17:37:44.988 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 90457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2280.ko 2024-09-13T17:37:44.988 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 94929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-09-13T17:37:44.989 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 80617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-09-13T17:37:44.989 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 87561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-09-13T17:37:44.989 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 94385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-09-13T17:37:44.989 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 191281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-09-13T17:37:44.989 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ 2024-09-13T17:37:44.989 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/bcma-hcd.ko 2024-09-13T17:37:44.989 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 108417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/isp116x-hcd.ko 2024-09-13T17:37:44.989 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 104817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-09-13T17:37:44.989 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 102361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-09-13T17:37:44.989 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 59905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-13T17:37:44.989 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811_cs.ko 2024-09-13T17:37:44.989 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ssb-hcd.ko 2024-09-13T17:37:44.989 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-09-13T17:37:44.990 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/ 2024-09-13T17:37:44.990 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 40633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-13T17:37:44.990 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-13T17:37:44.990 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ 2024-09-13T17:37:44.990 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 47593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-13T17:37:44.990 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-13T17:37:44.990 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-09-13T17:37:44.990 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cytherm.ko 2024-09-13T17:37:44.990 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ehset.ko 2024-09-13T17:37:44.990 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-13T17:37:44.990 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-13T17:37:44.990 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-13T17:37:44.990 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-13T17:37:44.990 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 42889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-13T17:37:44.991 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-13T17:37:44.991 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 42345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-13T17:37:44.991 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 42337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-13T17:37:44.991 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/lvstest.ko 2024-09-13T17:37:44.991 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/ 2024-09-13T17:37:44.991 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 85417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-13T17:37:44.991 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-13T17:37:44.991 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-13T17:37:44.991 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-13T17:37:44.991 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-13T17:37:44.991 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 84369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbtest.ko 2024-09-13T17:37:44.991 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 52377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-13T17:37:44.991 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-13T17:37:44.992 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/ 2024-09-13T17:37:44.992 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 91561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/usbmon.ko 2024-09-13T17:37:44.992 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/ 2024-09-13T17:37:44.992 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 391209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/musb_hdrc.ko 2024-09-13T17:37:44.992 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/ 2024-09-13T17:37:44.992 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-13T17:37:44.992 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-09-13T17:37:44.992 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-isp1301.ko 2024-09-13T17:37:44.992 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-tahvo.ko 2024-09-13T17:37:44.992 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ 2024-09-13T17:37:44.992 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-13T17:37:44.992 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-13T17:37:44.992 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-13T17:37:44.993 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-13T17:37:44.993 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 79769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-13T17:37:44.993 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-13T17:37:44.993 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 66961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-13T17:37:44.993 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 58425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-13T17:37:44.993 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-13T17:37:44.993 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 53161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/f81232.ko 2024-09-13T17:37:44.993 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 188729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-13T17:37:44.993 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 61601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-13T17:37:44.993 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 152409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-13T17:37:44.993 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 142937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-13T17:37:44.993 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 69297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-13T17:37:44.993 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-13T17:37:44.993 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-13T17:37:44.994 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 66449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-13T17:37:44.994 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 122425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-13T17:37:44.994 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 41393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-13T17:37:44.994 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-13T17:37:44.994 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-13T17:37:44.994 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-13T17:37:44.994 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/metro-usb.ko 2024-09-13T17:37:44.994 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 79801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-13T17:37:44.994 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 91625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-13T17:37:44.994 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 65281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mxuport.ko 2024-09-13T17:37:44.994 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-13T17:37:44.994 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-13T17:37:44.994 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-13T17:37:44.995 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 201257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-13T17:37:44.995 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 45433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-13T17:37:44.995 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 61857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-13T17:37:44.995 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-13T17:37:44.995 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 40081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-13T17:37:44.995 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 40625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-13T17:37:44.995 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-13T17:37:44.995 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-13T17:37:44.995 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-13T17:37:44.995 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-13T17:37:44.995 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-13T17:37:44.995 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 70601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-13T17:37:44.995 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-13T17:37:44.995 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-13T17:37:44.996 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-13T17:37:44.996 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 148729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usbserial.ko 2024-09-13T17:37:44.996 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-13T17:37:44.996 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 43673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-13T17:37:44.996 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/wishbone-serial.ko 2024-09-13T17:37:44.996 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-13T17:37:44.996 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ 2024-09-13T17:37:44.996 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 63361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-13T17:37:44.996 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-13T17:37:44.996 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-13T17:37:44.996 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-13T17:37:44.996 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 41177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-13T17:37:44.996 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-13T17:37:44.997 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-13T17:37:44.997 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-13T17:37:44.997 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-13T17:37:44.997 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-13T17:37:44.997 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-13T17:37:44.997 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-13T17:37:44.997 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-13T17:37:44.997 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 41953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-13T17:37:44.997 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 201057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-13T17:37:44.997 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/ 2024-09-13T17:37:44.997 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 74449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-13T17:37:44.997 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 85513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-13T17:37:44.997 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 122537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-13T17:37:44.998 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/ 2024-09-13T17:37:44.998 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/ 2024-09-13T17:37:44.998 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 196977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-13T17:37:44.998 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-13T17:37:44.998 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 134401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-13T17:37:44.998 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 93481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-13T17:37:44.998 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/ 2024-09-13T17:37:44.998 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 135241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-13T17:37:44.998 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-13T17:37:44.998 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 71553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-13T17:37:44.998 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 110185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-13T17:37:44.998 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/ 2024-09-13T17:37:44.998 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/ 2024-09-13T17:37:44.998 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-09-13T17:37:44.999 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/aat2870_bl.ko 2024-09-13T17:37:44.999 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp5520_bl.ko 2024-09-13T17:37:44.999 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 41257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8860_bl.ko 2024-09-13T17:37:44.999 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 51825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8870_bl.ko 2024-09-13T17:37:44.999 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-13T17:37:44.999 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/as3711_bl.ko 2024-09-13T17:37:44.999 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/bd6107.ko 2024-09-13T17:37:44.999 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da903x_bl.ko 2024-09-13T17:37:44.999 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da9052_bl.ko 2024-09-13T17:37:44.999 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/gpio_backlight.ko 2024-09-13T17:37:44.999 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/kb3886_bl.ko 2024-09-13T17:37:44.999 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-13T17:37:44.999 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3533_bl.ko 2024-09-13T17:37:45.000 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3639_bl.ko 2024-09-13T17:37:45.000 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lv5207lp.ko 2024-09-13T17:37:45.000 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/max8925_bl.ko 2024-09-13T17:37:45.000 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pandora_bl.ko 2024-09-13T17:37:45.000 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-09-13T17:37:45.000 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-13T17:37:45.000 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/wm831x_bl.ko 2024-09-13T17:37:45.000 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/ 2024-09-13T17:37:45.000 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ 2024-09-13T17:37:45.000 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-13T17:37:45.000 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 46913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-13T17:37:45.000 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/matrox_w1.ko 2024-09-13T17:37:45.000 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/w1-gpio.ko 2024-09-13T17:37:45.001 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/ 2024-09-13T17:37:45.001 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-13T17:37:45.001 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-13T17:37:45.001 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-13T17:37:45.001 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-13T17:37:45.001 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-13T17:37:45.001 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-13T17:37:45.001 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-13T17:37:45.001 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-13T17:37:45.001 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-13T17:37:45.001 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-13T17:37:45.001 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 70473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-13T17:37:45.001 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 127601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-13T17:37:45.001 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ 2024-09-13T17:37:45.002 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/acquirewdt.ko 2024-09-13T17:37:45.002 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/advantechwdt.ko 2024-09-13T17:37:45.002 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-13T17:37:45.002 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-13T17:37:45.002 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/cpu5wdt.ko 2024-09-13T17:37:45.002 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9052_wdt.ko 2024-09-13T17:37:45.002 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9055_wdt.ko 2024-09-13T17:37:45.002 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9063_wdt.ko 2024-09-13T17:37:45.002 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/dw_wdt.ko 2024-09-13T17:37:45.002 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/eurotechwdt.ko 2024-09-13T17:37:45.002 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-13T17:37:45.002 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-13T17:37:45.002 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-13T17:37:45.003 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-13T17:37:45.003 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-13T17:37:45.003 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-13T17:37:45.003 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-13T17:37:45.003 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-13T17:37:45.003 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-13T17:37:45.003 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-13T17:37:45.003 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/kempld_wdt.ko 2024-09-13T17:37:45.003 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-13T17:37:45.003 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/mena21_wdt.ko 2024-09-13T17:37:45.003 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-09-13T17:37:45.003 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-13T17:37:45.003 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-09-13T17:37:45.003 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pc87413_wdt.ko 2024-09-13T17:37:45.004 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 47033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-13T17:37:45.004 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 37289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-13T17:37:45.004 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/retu_wdt.ko 2024-09-13T17:37:45.004 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-09-13T17:37:45.004 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-09-13T17:37:45.004 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-13T17:37:45.004 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sc1200wdt.ko 2024-09-13T17:37:45.004 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-13T17:37:45.004 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-09-13T17:37:45.004 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-13T17:37:45.004 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-13T17:37:45.004 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/twl4030_wdt.ko 2024-09-13T17:37:45.004 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-13T17:37:45.005 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-13T17:37:45.005 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-13T17:37:45.005 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-13T17:37:45.005 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wafer5823wdt.ko 2024-09-13T17:37:45.005 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-13T17:37:45.005 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm831x_wdt.ko 2024-09-13T17:37:45.005 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm8350_wdt.ko 2024-09-13T17:37:45.005 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-13T17:37:45.005 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/ 2024-09-13T17:37:45.005 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-13T17:37:45.005 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-13T17:37:45.005 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-13T17:37:45.005 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/ 2024-09-13T17:37:45.006 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 214065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-13T17:37:45.006 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 46705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-13T17:37:45.006 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 85905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-scsiback.ko 2024-09-13T17:37:45.006 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/ 2024-09-13T17:37:45.006 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-13T17:37:45.006 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ 2024-09-13T17:37:45.006 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/ 2024-09-13T17:37:45.006 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 195161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-13T17:37:45.006 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/ 2024-09-13T17:37:45.006 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 78369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/adfs.ko 2024-09-13T17:37:45.006 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/ 2024-09-13T17:37:45.006 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 197849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-13T17:37:45.006 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/ 2024-09-13T17:37:45.006 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1259073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/kafs.ko 2024-09-13T17:37:45.007 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/ 2024-09-13T17:37:45.007 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 127665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/autofs4.ko 2024-09-13T17:37:45.007 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/ 2024-09-13T17:37:45.007 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 80561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-13T17:37:45.007 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/ 2024-09-13T17:37:45.007 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 50577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/bfs.ko 2024-09-13T17:37:45.007 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 45705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-13T17:37:45.007 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/ 2024-09-13T17:37:45.007 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 4575041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-13T17:37:45.007 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/ 2024-09-13T17:37:45.007 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 384329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-13T17:37:45.008 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ 2024-09-13T17:37:45.008 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1591681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-13T17:37:45.008 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/ 2024-09-13T17:37:45.008 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 130593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-13T17:37:45.008 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/ 2024-09-13T17:37:45.008 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 137313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/configfs.ko 2024-09-13T17:37:45.008 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/ 2024-09-13T17:37:45.008 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-13T17:37:45.008 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/ 2024-09-13T17:37:45.008 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 841817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-13T17:37:45.008 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/ 2024-09-13T17:37:45.009 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 45713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/efs.ko 2024-09-13T17:37:45.009 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/ 2024-09-13T17:37:45.009 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1901633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-13T17:37:45.009 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/ 2024-09-13T17:37:45.009 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-13T17:37:45.009 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/ 2024-09-13T17:37:45.009 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/freevxfs.ko 2024-09-13T17:37:45.009 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/ 2024-09-13T17:37:45.009 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-13T17:37:45.009 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/ 2024-09-13T17:37:45.009 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1488329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-13T17:37:45.009 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/ 2024-09-13T17:37:45.009 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 183553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-13T17:37:45.010 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/ 2024-09-13T17:37:45.010 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 282177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-13T17:37:45.010 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/ 2024-09-13T17:37:45.010 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 248625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/hpfs.ko 2024-09-13T17:37:45.010 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/ 2024-09-13T17:37:45.010 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 93513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-13T17:37:45.010 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/ 2024-09-13T17:37:45.010 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 529833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-13T17:37:45.010 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/ 2024-09-13T17:37:45.010 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 359969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-13T17:37:45.010 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/ 2024-09-13T17:37:45.010 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-13T17:37:45.010 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/ 2024-09-13T17:37:45.010 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 646793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-13T17:37:45.011 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/ 2024-09-13T17:37:45.011 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/ 2024-09-13T17:37:45.011 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 111585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-13T17:37:45.011 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/ 2024-09-13T17:37:45.011 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 74345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-13T17:37:45.011 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/ 2024-09-13T17:37:45.011 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 147553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-13T17:37:45.011 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1291361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-13T17:37:45.011 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 83001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv2.ko 2024-09-13T17:37:45.011 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 152537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-13T17:37:45.011 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 2526953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-13T17:37:45.011 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/ 2024-09-13T17:37:45.011 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-13T17:37:45.012 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-13T17:37:45.012 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/ 2024-09-13T17:37:45.012 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 2119673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-13T17:37:45.012 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/ 2024-09-13T17:37:45.012 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 734385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-13T17:37:45.012 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/ 2024-09-13T17:37:45.012 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-13T17:37:45.012 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-13T17:37:45.012 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-13T17:37:45.012 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-13T17:37:45.012 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-13T17:37:45.012 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-13T17:37:45.012 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-13T17:37:45.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-13T17:37:45.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-13T17:37:45.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-13T17:37:45.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-13T17:37:45.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ascii.ko 2024-09-13T17:37:45.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-13T17:37:45.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-13T17:37:45.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-13T17:37:45.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-13T17:37:45.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-13T17:37:45.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-13T17:37:45.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-13T17:37:45.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-13T17:37:45.013 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-13T17:37:45.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-13T17:37:45.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-13T17:37:45.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-13T17:37:45.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-13T17:37:45.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-13T17:37:45.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-13T17:37:45.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-13T17:37:45.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-13T17:37:45.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-13T17:37:45.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 95761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-13T17:37:45.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 144409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-13T17:37:45.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 167273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-13T17:37:45.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 119649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-13T17:37:45.014 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-13T17:37:45.015 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-13T17:37:45.015 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-13T17:37:45.015 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-13T17:37:45.015 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-13T17:37:45.015 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-13T17:37:45.015 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-13T17:37:45.015 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-13T17:37:45.015 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-13T17:37:45.015 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-13T17:37:45.015 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-13T17:37:45.015 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-13T17:37:45.015 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-13T17:37:45.015 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-13T17:37:45.016 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-13T17:37:45.016 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-13T17:37:45.016 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-13T17:37:45.016 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ 2024-09-13T17:37:45.016 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 632217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ntfs3.ko 2024-09-13T17:37:45.016 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ 2024-09-13T17:37:45.016 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ 2024-09-13T17:37:45.016 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 299761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-13T17:37:45.016 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ 2024-09-13T17:37:45.016 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 547233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-13T17:37:45.016 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ 2024-09-13T17:37:45.016 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 66465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-13T17:37:45.016 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 3255305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-13T17:37:45.017 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-13T17:37:45.017 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-13T17:37:45.017 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 41297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-13T17:37:45.017 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/ 2024-09-13T17:37:45.017 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 67633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/omfs.ko 2024-09-13T17:37:45.017 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/ 2024-09-13T17:37:45.017 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 468161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-13T17:37:45.017 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ 2024-09-13T17:37:45.017 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 69433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-13T17:37:45.017 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/ 2024-09-13T17:37:45.017 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/qnx4.ko 2024-09-13T17:37:45.017 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/ 2024-09-13T17:37:45.017 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 58177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/qnx6.ko 2024-09-13T17:37:45.017 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/ 2024-09-13T17:37:45.018 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_tree.ko 2024-09-13T17:37:45.018 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v1.ko 2024-09-13T17:37:45.018 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v2.ko 2024-09-13T17:37:45.018 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/ 2024-09-13T17:37:45.018 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 684489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-13T17:37:45.018 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/ 2024-09-13T17:37:45.018 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-13T17:37:45.018 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/ 2024-09-13T17:37:45.018 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/ 2024-09-13T17:37:45.018 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 3333977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-13T17:37:45.018 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/ 2024-09-13T17:37:45.018 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-13T17:37:45.018 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-13T17:37:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/ 2024-09-13T17:37:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 163081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-13T17:37:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/ 2024-09-13T17:37:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 116065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-13T17:37:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/ 2024-09-13T17:37:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 309513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-13T17:37:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ 2024-09-13T17:37:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 198129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-13T17:37:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/ 2024-09-13T17:37:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 5454809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-13T17:37:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/ 2024-09-13T17:37:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/ 2024-09-13T17:37:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 97945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/locktorture.ko 2024-09-13T17:37:45.019 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/ 2024-09-13T17:37:45.020 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/test_udelay.ko 2024-09-13T17:37:45.020 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 70441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-13T17:37:45.020 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ 2024-09-13T17:37:45.020 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-13T17:37:45.020 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 6793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc7.ko 2024-09-13T17:37:45.020 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-13T17:37:45.020 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/ 2024-09-13T17:37:45.020 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-13T17:37:45.020 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-13T17:37:45.020 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/interval_tree_test.ko 2024-09-13T17:37:45.020 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-13T17:37:45.020 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-13T17:37:45.020 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/ 2024-09-13T17:37:45.021 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-13T17:37:45.021 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-13T17:37:45.021 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/ 2024-09-13T17:37:45.021 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-13T17:37:45.021 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/memory-notifier-error-inject.ko 2024-09-13T17:37:45.021 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/notifier-error-inject.ko 2024-09-13T17:37:45.021 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/percpu_test.ko 2024-09-13T17:37:45.021 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/pm-notifier-error-inject.ko 2024-09-13T17:37:45.021 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/ 2024-09-13T17:37:45.021 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 151073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-13T17:37:45.021 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/rbtree_test.ko 2024-09-13T17:37:45.021 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/ 2024-09-13T17:37:45.021 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-13T17:37:45.021 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 41169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test-kstrtox.ko 2024-09-13T17:37:45.022 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 4912673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_bpf.ko 2024-09-13T17:37:45.022 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 61249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_firmware.ko 2024-09-13T17:37:45.022 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_module.ko 2024-09-13T17:37:45.022 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-13T17:37:45.022 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-13T17:37:45.022 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-13T17:37:45.022 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/ 2024-09-13T17:37:45.022 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/xz_dec_test.ko 2024-09-13T17:37:45.022 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/ 2024-09-13T17:37:45.022 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-13T17:37:45.022 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ 2024-09-13T17:37:45.022 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/ 2024-09-13T17:37:45.022 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 66073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-13T17:37:45.022 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-13T17:37:45.023 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-13T17:37:45.023 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-13T17:37:45.023 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-13T17:37:45.023 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-13T17:37:45.023 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-13T17:37:45.023 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-13T17:37:45.023 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/ 2024-09-13T17:37:45.023 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-13T17:37:45.023 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 41673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-13T17:37:45.023 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-13T17:37:45.023 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-13T17:37:45.023 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-13T17:37:45.023 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/ 2024-09-13T17:37:45.024 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 106841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-13T17:37:45.024 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/ 2024-09-13T17:37:45.024 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 234745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-13T17:37:45.024 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 45337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-13T17:37:45.024 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-13T17:37:45.024 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-13T17:37:45.024 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/ 2024-09-13T17:37:45.024 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 875441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-13T17:37:45.024 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/ 2024-09-13T17:37:45.024 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 88073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-13T17:37:45.024 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1026825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-13T17:37:45.024 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ 2024-09-13T17:37:45.025 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-13T17:37:45.025 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-13T17:37:45.025 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-13T17:37:45.025 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-13T17:37:45.025 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-13T17:37:45.025 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-13T17:37:45.025 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-13T17:37:45.025 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-13T17:37:45.025 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-13T17:37:45.025 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-13T17:37:45.025 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-13T17:37:45.025 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-13T17:37:45.025 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-13T17:37:45.025 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-13T17:37:45.026 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-13T17:37:45.026 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-13T17:37:45.026 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-13T17:37:45.026 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-13T17:37:45.026 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-13T17:37:45.026 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-13T17:37:45.026 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 69849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-13T17:37:45.026 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-13T17:37:45.026 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-13T17:37:45.026 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/ 2024-09-13T17:37:45.026 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1229873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-13T17:37:45.026 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/ 2024-09-13T17:37:45.026 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 154121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-13T17:37:45.027 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/ 2024-09-13T17:37:45.027 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 239393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-13T17:37:45.027 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-13T17:37:45.027 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 69873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-13T17:37:45.027 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 74433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-13T17:37:45.027 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/ 2024-09-13T17:37:45.027 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 498249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-13T17:37:45.027 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-13T17:37:45.027 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-13T17:37:45.027 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-13T17:37:45.027 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-13T17:37:45.027 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/ 2024-09-13T17:37:45.027 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 137945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/hsr.ko 2024-09-13T17:37:45.027 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ 2024-09-13T17:37:45.028 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ 2024-09-13T17:37:45.028 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 55409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-13T17:37:45.028 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 356385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-13T17:37:45.028 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 59457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-13T17:37:45.028 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ 2024-09-13T17:37:45.028 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-13T17:37:45.028 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 46153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-13T17:37:45.028 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 59793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-13T17:37:45.028 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-13T17:37:45.028 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 64777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-13T17:37:45.028 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 77777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-13T17:37:45.028 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 78481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-13T17:37:45.028 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 43153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-13T17:37:45.029 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-13T17:37:45.029 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-13T17:37:45.029 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ 2024-09-13T17:37:45.029 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-13T17:37:45.029 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-13T17:37:45.029 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-13T17:37:45.029 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 49609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ip_tables.ko 2024-09-13T17:37:45.029 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-13T17:37:45.029 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-09-13T17:37:45.029 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-13T17:37:45.029 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-13T17:37:45.029 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-13T17:37:45.029 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-09-13T17:37:45.030 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-13T17:37:45.030 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-13T17:37:45.030 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-13T17:37:45.030 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-13T17:37:45.030 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-13T17:37:45.030 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-13T17:37:45.030 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-13T17:37:45.030 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-13T17:37:45.030 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-13T17:37:45.030 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-09-13T17:37:45.030 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-13T17:37:45.030 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-13T17:37:45.030 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-13T17:37:45.031 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-13T17:37:45.031 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-13T17:37:45.031 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-13T17:37:45.031 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-13T17:37:45.031 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-13T17:37:45.031 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-13T17:37:45.031 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-13T17:37:45.031 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-13T17:37:45.031 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-13T17:37:45.031 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-13T17:37:45.031 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-13T17:37:45.031 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-13T17:37:45.031 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-13T17:37:45.031 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-13T17:37:45.032 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-13T17:37:45.032 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-13T17:37:45.032 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-13T17:37:45.032 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-13T17:37:45.032 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-13T17:37:45.032 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ 2024-09-13T17:37:45.032 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-13T17:37:45.032 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-13T17:37:45.032 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-13T17:37:45.032 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 102889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_gre.ko 2024-09-13T17:37:45.032 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 117649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-13T17:37:45.032 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-13T17:37:45.032 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 69881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-13T17:37:45.033 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-13T17:37:45.033 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/mip6.ko 2024-09-13T17:37:45.033 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ 2024-09-13T17:37:45.033 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 50137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-13T17:37:45.033 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-09-13T17:37:45.033 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-13T17:37:45.033 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-13T17:37:45.033 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-13T17:37:45.033 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-13T17:37:45.033 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-13T17:37:45.033 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-13T17:37:45.033 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-13T17:37:45.033 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-13T17:37:45.034 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-13T17:37:45.034 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-13T17:37:45.034 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-13T17:37:45.034 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-13T17:37:45.034 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-13T17:37:45.034 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-13T17:37:45.034 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-13T17:37:45.034 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 46033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-13T17:37:45.034 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-13T17:37:45.034 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 29017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-13T17:37:45.034 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-13T17:37:45.034 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-13T17:37:45.034 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-13T17:37:45.035 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-13T17:37:45.035 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-13T17:37:45.035 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 94433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-13T17:37:45.035 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-13T17:37:45.035 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-13T17:37:45.035 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/ 2024-09-13T17:37:45.035 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 106217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-13T17:37:45.035 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/ 2024-09-13T17:37:45.035 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 155593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-13T17:37:45.035 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-13T17:37:45.035 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-13T17:37:45.035 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 43553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-13T17:37:45.035 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 45057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-13T17:37:45.035 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 42041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-13T17:37:45.036 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 66137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-13T17:37:45.036 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/ 2024-09-13T17:37:45.036 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 61609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/lapb.ko 2024-09-13T17:37:45.036 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/ 2024-09-13T17:37:45.036 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-13T17:37:45.036 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 333641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc2.ko 2024-09-13T17:37:45.036 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/ 2024-09-13T17:37:45.036 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 388577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-13T17:37:45.036 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/ 2024-09-13T17:37:45.036 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-13T17:37:45.036 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ 2024-09-13T17:37:45.036 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ 2024-09-13T17:37:45.036 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 144881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-13T17:37:45.037 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-13T17:37:45.037 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-13T17:37:45.037 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-13T17:37:45.037 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 124137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-13T17:37:45.037 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 124449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-13T17:37:45.037 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 126777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-13T17:37:45.037 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 126577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-13T17:37:45.037 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 137937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-13T17:37:45.037 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 72457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-13T17:37:45.037 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 133785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-13T17:37:45.037 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 139177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-13T17:37:45.037 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 138369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-13T17:37:45.037 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 136281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-13T17:37:45.037 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 140001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-13T17:37:45.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-13T17:37:45.038 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ 2024-09-13T17:37:45.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 532393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-13T17:37:45.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-13T17:37:45.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-13T17:37:45.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-13T17:37:45.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-13T17:37:45.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-13T17:37:45.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-13T17:37:45.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-13T17:37:45.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-13T17:37:45.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-13T17:37:45.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-13T17:37:45.038 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-13T17:37:45.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-13T17:37:45.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-13T17:37:45.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 54465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-13T17:37:45.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 485769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-13T17:37:45.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-13T17:37:45.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-13T17:37:45.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 37729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-13T17:37:45.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 134177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-13T17:37:45.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-13T17:37:45.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-13T17:37:45.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 140921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-13T17:37:45.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-13T17:37:45.039 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-13T17:37:45.040 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 79081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-13T17:37:45.040 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-13T17:37:45.040 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-13T17:37:45.040 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-13T17:37:45.040 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 119745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-13T17:37:45.040 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-13T17:37:45.040 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 46193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-13T17:37:45.040 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 115817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-13T17:37:45.040 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-13T17:37:45.040 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-13T17:37:45.040 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-13T17:37:45.040 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-13T17:37:45.040 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-13T17:37:45.040 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 51953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-13T17:37:45.041 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 813705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-13T17:37:45.041 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 52913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-13T17:37:45.041 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-13T17:37:45.041 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 37241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-09-13T17:37:45.041 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 49457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-13T17:37:45.041 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-13T17:37:45.041 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 66593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-13T17:37:45.041 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-13T17:37:45.041 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 41849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-13T17:37:45.041 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 50641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-13T17:37:45.041 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-13T17:37:45.041 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-13T17:37:45.041 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-13T17:37:45.042 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-13T17:37:45.042 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-13T17:37:45.042 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-13T17:37:45.042 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-13T17:37:45.042 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-13T17:37:45.042 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-13T17:37:45.042 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_osf.ko 2024-09-13T17:37:45.042 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-13T17:37:45.042 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-13T17:37:45.042 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-13T17:37:45.042 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-13T17:37:45.042 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-13T17:37:45.042 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_synproxy.ko 2024-09-13T17:37:45.043 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tproxy.ko 2024-09-13T17:37:45.043 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 104257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/x_tables.ko 2024-09-13T17:37:45.043 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-13T17:37:45.043 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-13T17:37:45.043 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-13T17:37:45.043 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-13T17:37:45.043 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 21953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-13T17:37:45.043 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-13T17:37:45.043 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-13T17:37:45.043 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-13T17:37:45.043 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 45305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-13T17:37:45.043 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-13T17:37:45.043 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-13T17:37:45.043 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-13T17:37:45.044 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-13T17:37:45.044 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-13T17:37:45.044 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-13T17:37:45.044 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-13T17:37:45.044 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-13T17:37:45.044 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-13T17:37:45.044 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-13T17:37:45.044 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-13T17:37:45.044 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-13T17:37:45.044 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-13T17:37:45.044 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-13T17:37:45.044 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-13T17:37:45.045 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-13T17:37:45.045 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-13T17:37:45.045 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-13T17:37:45.045 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-13T17:37:45.045 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-13T17:37:45.045 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-13T17:37:45.045 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-13T17:37:45.045 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-13T17:37:45.045 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-13T17:37:45.045 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-13T17:37:45.045 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-13T17:37:45.045 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-13T17:37:45.045 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-13T17:37:45.045 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-13T17:37:45.046 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-13T17:37:45.046 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 52929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-13T17:37:45.046 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-13T17:37:45.046 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-13T17:37:45.046 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-13T17:37:45.046 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-13T17:37:45.046 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-13T17:37:45.046 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-13T17:37:45.046 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-13T17:37:45.046 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-13T17:37:45.046 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-13T17:37:45.046 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-13T17:37:45.046 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-13T17:37:45.047 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-13T17:37:45.047 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-13T17:37:45.047 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-13T17:37:45.047 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-13T17:37:45.047 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-13T17:37:45.047 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-13T17:37:45.047 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-13T17:37:45.047 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-13T17:37:45.047 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-13T17:37:45.047 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-13T17:37:45.047 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 43569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-13T17:37:45.047 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 14985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-13T17:37:45.047 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-13T17:37:45.047 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-13T17:37:45.048 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-13T17:37:45.048 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-13T17:37:45.048 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-13T17:37:45.048 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-13T17:37:45.048 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpudp.ko 2024-09-13T17:37:45.048 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-13T17:37:45.048 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-13T17:37:45.048 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/ 2024-09-13T17:37:45.048 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 17321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-13T17:37:45.048 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/ 2024-09-13T17:37:45.048 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-13T17:37:45.048 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/ 2024-09-13T17:37:45.048 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 485961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-13T17:37:45.049 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-13T17:37:45.049 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-13T17:37:45.049 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-13T17:37:45.049 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/ 2024-09-13T17:37:45.049 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-13T17:37:45.049 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/ 2024-09-13T17:37:45.049 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 141545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/phonet.ko 2024-09-13T17:37:45.049 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 69001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/pn_pep.ko 2024-09-13T17:37:45.049 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/ 2024-09-13T17:37:45.049 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 314473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-13T17:37:45.049 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 202161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-13T17:37:45.049 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 85265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-13T17:37:45.049 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/ 2024-09-13T17:37:45.049 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1024009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/rxrpc.ko 2024-09-13T17:37:45.050 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/ 2024-09-13T17:37:45.050 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-13T17:37:45.050 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-13T17:37:45.050 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 45505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-13T17:37:45.050 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 27689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-13T17:37:45.050 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 53577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-13T17:37:45.050 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-13T17:37:45.050 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-13T17:37:45.050 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 43513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-13T17:37:45.050 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 45769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-13T17:37:45.050 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-13T17:37:45.050 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 41561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-13T17:37:45.050 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_cgroup.ko 2024-09-13T17:37:45.051 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 37409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-13T17:37:45.051 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-13T17:37:45.051 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 49417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-13T17:37:45.051 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 79257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-13T17:37:45.051 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-13T17:37:45.051 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 15481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-13T17:37:45.051 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 48889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-13T17:37:45.051 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-13T17:37:45.051 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-13T17:37:45.051 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 8457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-13T17:37:45.052 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-13T17:37:45.052 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-13T17:37:45.052 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 43577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-13T17:37:45.052 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 43865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-13T17:37:45.052 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 39273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq_codel.ko 2024-09-13T17:37:45.052 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 42985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-13T17:37:45.052 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 60913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-13T17:37:45.052 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 26689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-13T17:37:45.052 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 81065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-13T17:37:45.052 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-13T17:37:45.052 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 36713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-13T17:37:45.052 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 11905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-13T17:37:45.052 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-13T17:37:45.053 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 44857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-13T17:37:45.053 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 32425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-13T17:37:45.053 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 13593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-13T17:37:45.053 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 31889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-13T17:37:45.053 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 60337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-13T17:37:45.053 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-13T17:37:45.053 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 33521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-13T17:37:45.053 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 38457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-13T17:37:45.053 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 35857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-13T17:37:45.053 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 34241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-13T17:37:45.053 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/ 2024-09-13T17:37:45.053 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1184689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-13T17:37:45.053 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 24001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-13T17:37:45.054 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/ 2024-09-13T17:37:45.054 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/ 2024-09-13T17:37:45.054 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 426969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-13T17:37:45.054 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 70273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-13T17:37:45.054 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1895553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-13T17:37:45.054 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/ 2024-09-13T17:37:45.054 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 925089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-13T17:37:45.054 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/ 2024-09-13T17:37:45.054 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 1122601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-13T17:37:45.054 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-13T17:37:45.054 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/ 2024-09-13T17:37:45.054 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 18273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-13T17:37:45.054 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/ 2024-09-13T17:37:45.054 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 101161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-13T17:37:45.055 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 90369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-13T17:37:45.055 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 120625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-13T17:37:45.055 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 12985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-13T17:37:45.055 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-13T17:37:45.055 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/ 2024-09-13T17:37:45.055 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 165529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/x25.ko 2024-09-13T17:37:45.055 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/ 2024-09-13T17:37:45.055 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_algo.ko 2024-09-13T17:37:45.055 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-13T17:37:45.055 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 135873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_user.ko 2024-09-13T17:37:45.055 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 649700 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-13T17:37:45.055 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 633853 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-13T17:37:45.055 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 7850 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-13T17:37:45.056 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 23959 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-13T17:37:45.056 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 10056 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-13T17:37:45.056 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 74053 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-13T17:37:45.056 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 147543 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-13T17:37:45.056 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 233297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-13T17:37:45.056 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 210 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-13T17:37:45.056 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 72756 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-13T17:37:45.056 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 879 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-13T17:37:45.056 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 261535 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-13T17:37:45.056 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 316586 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-13T17:37:45.056 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/ 2024-09-13T17:37:45.056 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/ 2024-09-13T17:37:45.056 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/ 2024-09-13T17:37:45.056 INFO:teuthology.orchestra.run.smithi134.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T17:37:45.057 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 176 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/changelog.Debian.gz 2024-09-13T17:37:45.057 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r-- root/root 691 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/copyright 2024-09-13T17:37:45.062 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:37:45.062 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:37:45.062 DEBUG:teuthology.orchestra.run.smithi134:> egrep '(submenu|menuentry.*6.11.0-rc5-g2ca44a2f35ca).*{' /boot/grub/grub.cfg 2024-09-13T17:37:45.073 INFO:teuthology.orchestra.run.smithi134.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-13T17:37:45.073 INFO:teuthology.orchestra.run.smithi134.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-13T17:37:45.073 INFO:teuthology.orchestra.run.smithi134.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-13T17:37:45.073 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-09-13T17:37:45.074 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:37:45.074 DEBUG:teuthology.orchestra.run.smithi134:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-09-13T17:37:45.086 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/ 2024-09-13T17:37:45.086 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/ 2024-09-13T17:37:45.086 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postinst.d/ 2024-09-13T17:37:45.087 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postrm.d/ 2024-09-13T17:37:45.087 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/preinst.d/ 2024-09-13T17:37:45.087 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/prerm.d/ 2024-09-13T17:37:45.087 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/ 2024-09-13T17:37:45.087 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/ 2024-09-13T17:37:45.087 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T17:37:45.087 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/ 2024-09-13T17:37:45.087 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/ 2024-09-13T17:37:45.087 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/ 2024-09-13T17:37:45.087 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ 2024-09-13T17:37:45.087 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 189809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/aesni-intel.ko 2024-09-13T17:37:45.087 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-13T17:37:45.087 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-13T17:37:45.088 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-13T17:37:45.088 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 97321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-13T17:37:45.088 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 109985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-13T17:37:45.088 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 155337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-13T17:37:45.088 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-13T17:37:45.088 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-13T17:37:45.088 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 87097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-13T17:37:45.088 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-13T17:37:45.088 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-13T17:37:45.088 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-13T17:37:45.088 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-13T17:37:45.088 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-13T17:37:45.088 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-13T17:37:45.089 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-13T17:37:45.089 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-13T17:37:45.089 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-13T17:37:45.089 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-13T17:37:45.089 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/ 2024-09-13T17:37:45.089 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/ 2024-09-13T17:37:45.089 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/ 2024-09-13T17:37:45.089 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-13T17:37:45.089 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpuid.ko 2024-09-13T17:37:45.089 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/msr.ko 2024-09-13T17:37:45.089 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/ 2024-09-13T17:37:45.089 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 505169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-13T17:37:45.089 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1060585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-13T17:37:45.089 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 2858865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-13T17:37:45.090 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ 2024-09-13T17:37:45.090 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/af_alg.ko 2024-09-13T17:37:45.090 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_hash.ko 2024-09-13T17:37:45.090 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_skcipher.ko 2024-09-13T17:37:45.090 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-13T17:37:45.090 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-13T17:37:45.090 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-13T17:37:45.090 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/ 2024-09-13T17:37:45.090 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-09-13T17:37:45.090 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/ 2024-09-13T17:37:45.090 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-13T17:37:45.090 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-13T17:37:45.090 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-13T17:37:45.091 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-13T17:37:45.091 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-13T17:37:45.091 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-13T17:37:45.091 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-13T17:37:45.091 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-13T17:37:45.091 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-13T17:37:45.091 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-13T17:37:45.091 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-13T17:37:45.091 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-13T17:37:45.091 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-13T17:37:45.091 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-13T17:37:45.091 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-13T17:37:45.091 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-13T17:37:45.091 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-13T17:37:45.092 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-13T17:37:45.092 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cryptd.ko 2024-09-13T17:37:45.092 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-13T17:37:45.092 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_simd.ko 2024-09-13T17:37:45.092 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-13T17:37:45.092 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-13T17:37:45.092 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-13T17:37:45.092 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-13T17:37:45.092 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-13T17:37:45.092 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-13T17:37:45.092 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-13T17:37:45.092 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-13T17:37:45.093 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lrw.ko 2024-09-13T17:37:45.093 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-13T17:37:45.093 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-13T17:37:45.093 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-13T17:37:45.093 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-13T17:37:45.093 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-13T17:37:45.093 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-13T17:37:45.093 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-13T17:37:45.093 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-13T17:37:45.093 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-13T17:37:45.093 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 169521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-13T17:37:45.093 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-13T17:37:45.093 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-13T17:37:45.093 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-13T17:37:45.094 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-13T17:37:45.094 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-13T17:37:45.094 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-13T17:37:45.094 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-13T17:37:45.094 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xts.ko 2024-09-13T17:37:45.094 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-13T17:37:45.094 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ 2024-09-13T17:37:45.094 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ 2024-09-13T17:37:45.094 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_extlog.ko 2024-09-13T17:37:45.094 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-13T17:37:45.094 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-13T17:37:45.094 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/ 2024-09-13T17:37:45.094 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/einj.ko 2024-09-13T17:37:45.094 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-13T17:37:45.095 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-13T17:37:45.095 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-13T17:37:45.095 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-13T17:37:45.095 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 120321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-13T17:37:45.095 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ 2024-09-13T17:37:45.095 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-13T17:37:45.095 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 100457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci.ko 2024-09-13T17:37:45.095 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-13T17:37:45.095 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 105105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci.ko 2024-09-13T17:37:45.095 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-13T17:37:45.095 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-13T17:37:45.095 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-13T17:37:45.095 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-13T17:37:45.096 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-13T17:37:45.096 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-13T17:37:45.096 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-13T17:37:45.096 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-13T17:37:45.096 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-13T17:37:45.096 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-13T17:37:45.096 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-13T17:37:45.096 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-13T17:37:45.096 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-13T17:37:45.096 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-13T17:37:45.096 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-13T17:37:45.096 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-13T17:37:45.096 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-13T17:37:45.096 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-13T17:37:45.097 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_legacy.ko 2024-09-13T17:37:45.097 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-13T17:37:45.097 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-13T17:37:45.097 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-13T17:37:45.097 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-13T17:37:45.097 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-13T17:37:45.097 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-13T17:37:45.097 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-13T17:37:45.097 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-13T17:37:45.097 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-13T17:37:45.097 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-13T17:37:45.097 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-13T17:37:45.097 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-13T17:37:45.098 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-13T17:37:45.098 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_radisys.ko 2024-09-13T17:37:45.098 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-13T17:37:45.098 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rz1000.ko 2024-09-13T17:37:45.098 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-13T17:37:45.098 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-13T17:37:45.098 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-13T17:37:45.098 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-13T17:37:45.098 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-13T17:37:45.098 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-13T17:37:45.098 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-13T17:37:45.098 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-13T17:37:45.098 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 102273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-13T17:37:45.099 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-13T17:37:45.099 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-13T17:37:45.099 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-13T17:37:45.099 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-13T17:37:45.099 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-13T17:37:45.099 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-13T17:37:45.099 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-13T17:37:45.099 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-13T17:37:45.099 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-13T17:37:45.099 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-13T17:37:45.099 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-13T17:37:45.099 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ 2024-09-13T17:37:45.099 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-13T17:37:45.099 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/ 2024-09-13T17:37:45.100 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 161225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-13T17:37:45.100 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/ 2024-09-13T17:37:45.100 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/ 2024-09-13T17:37:45.100 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 141025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-13T17:37:45.100 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/ 2024-09-13T17:37:45.100 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1240825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-13T17:37:45.100 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 203657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-13T17:37:45.100 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/ 2024-09-13T17:37:45.100 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 115057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-13T17:37:45.100 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 143337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-13T17:37:45.100 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/ 2024-09-13T17:37:45.100 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 133345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-13T17:37:45.100 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 119929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-13T17:37:45.101 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 312817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-13T17:37:45.101 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/ 2024-09-13T17:37:45.101 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 117753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-13T17:37:45.101 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/ 2024-09-13T17:37:45.101 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-13T17:37:45.101 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ 2024-09-13T17:37:45.101 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/applicom.ko 2024-09-13T17:37:45.101 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-13T17:37:45.101 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/ 2024-09-13T17:37:45.101 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-13T17:37:45.101 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-13T17:37:45.101 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-13T17:37:45.101 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-13T17:37:45.102 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-13T17:37:45.102 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ 2024-09-13T17:37:45.102 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-13T17:37:45.102 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 183745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-13T17:37:45.102 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-13T17:37:45.102 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 179465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-13T17:37:45.102 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-13T17:37:45.102 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 65425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-13T17:37:45.102 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-13T17:37:45.102 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/ 2024-09-13T17:37:45.102 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 103521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-13T17:37:45.102 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/nvram.ko 2024-09-13T17:37:45.102 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-13T17:37:45.103 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-13T17:37:45.103 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/ 2024-09-13T17:37:45.103 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-13T17:37:45.103 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-09-13T17:37:45.103 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-09-13T17:37:45.103 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-09-13T17:37:45.103 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-13T17:37:45.103 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-13T17:37:45.103 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-09-13T17:37:45.103 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/ 2024-09-13T17:37:45.103 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_class.ko 2024-09-13T17:37:45.103 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_core.ko 2024-09-13T17:37:45.103 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-09-13T17:37:45.104 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/ 2024-09-13T17:37:45.104 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-palmas.ko 2024-09-13T17:37:45.104 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-si5351.ko 2024-09-13T17:37:45.104 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-twl6040.ko 2024-09-13T17:37:45.104 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-wm831x.ko 2024-09-13T17:37:45.104 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/ 2024-09-13T17:37:45.104 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-13T17:37:45.104 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-13T17:37:45.104 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-13T17:37:45.104 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ 2024-09-13T17:37:45.104 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ 2024-09-13T17:37:45.104 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 89361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-13T17:37:45.104 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 334505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-13T17:37:45.105 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/ 2024-09-13T17:37:45.105 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/ 2024-09-13T17:37:45.105 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/ 2024-09-13T17:37:45.105 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 833113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-13T17:37:45.105 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-09-13T17:37:45.105 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-13T17:37:45.105 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-13T17:37:45.105 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-13T17:37:45.105 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/ 2024-09-13T17:37:45.105 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 90209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-13T17:37:45.105 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/ 2024-09-13T17:37:45.105 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-13T17:37:45.105 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ 2024-09-13T17:37:45.106 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/ 2024-09-13T17:37:45.106 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-13T17:37:45.106 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ 2024-09-13T17:37:45.106 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 147345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-13T17:37:45.106 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ 2024-09-13T17:37:45.106 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 90201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-13T17:37:45.106 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-13T17:37:45.106 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-13T17:37:45.106 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-13T17:37:45.106 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-13T17:37:45.106 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-13T17:37:45.106 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-13T17:37:45.106 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-13T17:37:45.106 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 64265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-13T17:37:45.107 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-13T17:37:45.107 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-13T17:37:45.107 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 68801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-13T17:37:45.107 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-13T17:37:45.107 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/ 2024-09-13T17:37:45.107 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-gpio.ko 2024-09-13T17:37:45.107 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max14577.ko 2024-09-13T17:37:45.107 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max77693.ko 2024-09-13T17:37:45.107 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max8997.ko 2024-09-13T17:37:45.107 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-palmas.ko 2024-09-13T17:37:45.107 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-rt8973a.ko 2024-09-13T17:37:45.107 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-sm5502.ko 2024-09-13T17:37:45.107 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/ 2024-09-13T17:37:45.108 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/dmi-sysfs.ko 2024-09-13T17:37:45.108 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/ 2024-09-13T17:37:45.108 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/efi-pstore.ko 2024-09-13T17:37:45.108 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-13T17:37:45.108 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/ 2024-09-13T17:37:45.108 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-adp5520.ko 2024-09-13T17:37:45.108 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-amd8111.ko 2024-09-13T17:37:45.108 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-arizona.ko 2024-09-13T17:37:45.108 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9052.ko 2024-09-13T17:37:45.109 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9055.ko 2024-09-13T17:37:45.109 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-dln2.ko 2024-09-13T17:37:45.109 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 81153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-f7188x.ko 2024-09-13T17:37:45.109 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-generic.ko 2024-09-13T17:37:45.109 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-13T17:37:45.109 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-09-13T17:37:45.109 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-kempld.ko 2024-09-13T17:37:45.109 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-lp3943.ko 2024-09-13T17:37:45.109 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max7300.ko 2024-09-13T17:37:45.109 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max730x.ko 2024-09-13T17:37:45.109 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max732x.ko 2024-09-13T17:37:45.109 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-09-13T17:37:45.109 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 56001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pca953x.ko 2024-09-13T17:37:45.110 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pcf857x.ko 2024-09-13T17:37:45.110 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-rdc321x.ko 2024-09-13T17:37:45.110 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch.ko 2024-09-13T17:37:45.110 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch311x.ko 2024-09-13T17:37:45.110 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-tps65912.ko 2024-09-13T17:37:45.110 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl4030.ko 2024-09-13T17:37:45.110 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl6040.ko 2024-09-13T17:37:45.110 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-13T17:37:45.110 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-vx855.ko 2024-09-13T17:37:45.110 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm831x.ko 2024-09-13T17:37:45.110 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8350.ko 2024-09-13T17:37:45.110 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8994.ko 2024-09-13T17:37:45.110 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/ 2024-09-13T17:37:45.110 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-a4tech.ko 2024-09-13T17:37:45.111 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-apple.ko 2024-09-13T17:37:45.111 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-13T17:37:45.111 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-13T17:37:45.111 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-13T17:37:45.111 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-belkin.ko 2024-09-13T17:37:45.111 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cherry.ko 2024-09-13T17:37:45.111 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-chicony.ko 2024-09-13T17:37:45.111 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 74497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cp2112.ko 2024-09-13T17:37:45.111 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cypress.ko 2024-09-13T17:37:45.111 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-13T17:37:45.111 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-13T17:37:45.111 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-13T17:37:45.111 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-13T17:37:45.112 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ezkey.ko 2024-09-13T17:37:45.112 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-13T17:37:45.112 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-generic.ko 2024-09-13T17:37:45.112 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-13T17:37:45.112 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-13T17:37:45.112 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-13T17:37:45.112 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-13T17:37:45.112 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-13T17:37:45.112 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-13T17:37:45.112 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-13T17:37:45.112 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kensington.ko 2024-09-13T17:37:45.112 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-13T17:37:45.112 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-13T17:37:45.113 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-13T17:37:45.113 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-13T17:37:45.113 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-13T17:37:45.113 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lg-g15.ko 2024-09-13T17:37:45.113 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-13T17:37:45.113 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 122145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-13T17:37:45.113 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 98177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech.ko 2024-09-13T17:37:45.113 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-magicmouse.ko 2024-09-13T17:37:45.113 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-microsoft.ko 2024-09-13T17:37:45.113 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-monterey.ko 2024-09-13T17:37:45.113 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-13T17:37:45.113 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ntrig.ko 2024-09-13T17:37:45.113 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-13T17:37:45.114 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-13T17:37:45.114 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-13T17:37:45.114 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 91217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-13T17:37:45.114 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-13T17:37:45.114 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-13T17:37:45.114 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-13T17:37:45.114 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-13T17:37:45.114 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-13T17:37:45.114 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-13T17:37:45.114 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-13T17:37:45.114 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-13T17:37:45.114 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-13T17:37:45.114 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-13T17:37:45.114 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-13T17:37:45.115 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-13T17:37:45.115 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-13T17:37:45.115 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-13T17:37:45.115 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-13T17:37:45.115 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-13T17:37:45.115 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-13T17:37:45.115 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-13T17:37:45.115 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-13T17:37:45.115 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-13T17:37:45.115 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-13T17:37:45.115 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-13T17:37:45.115 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-13T17:37:45.115 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-13T17:37:45.116 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-13T17:37:45.116 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-13T17:37:45.116 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-13T17:37:45.116 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-13T17:37:45.116 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-13T17:37:45.116 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 81673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-13T17:37:45.116 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-13T17:37:45.116 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 184865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-13T17:37:45.116 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-13T17:37:45.116 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-13T17:37:45.116 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-13T17:37:45.116 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 462849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid.ko 2024-09-13T17:37:45.116 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-13T17:37:45.117 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/ 2024-09-13T17:37:45.117 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 153953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbhid.ko 2024-09-13T17:37:45.117 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbkbd.ko 2024-09-13T17:37:45.117 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbmouse.ko 2024-09-13T17:37:45.117 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 261241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-13T17:37:45.117 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/ 2024-09-13T17:37:45.117 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 76441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-13T17:37:45.117 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 96073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-13T17:37:45.117 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 378337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-13T17:37:45.117 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ 2024-09-13T17:37:45.117 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 77217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-13T17:37:45.117 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-13T17:37:45.117 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-13T17:37:45.117 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-13T17:37:45.118 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-13T17:37:45.118 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-13T17:37:45.118 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-13T17:37:45.118 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 115201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-13T17:37:45.118 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-13T17:37:45.118 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-13T17:37:45.118 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-13T17:37:45.118 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-13T17:37:45.118 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-13T17:37:45.118 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-13T17:37:45.118 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 89113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-13T17:37:45.118 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-13T17:37:45.118 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 81665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-13T17:37:45.119 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-13T17:37:45.119 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-13T17:37:45.119 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 68953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-13T17:37:45.119 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-13T17:37:45.119 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-13T17:37:45.119 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-13T17:37:45.119 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-13T17:37:45.119 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-13T17:37:45.119 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-09-13T17:37:45.119 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9052-hwmon.ko 2024-09-13T17:37:45.119 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9055-hwmon.ko 2024-09-13T17:37:45.119 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-13T17:37:45.119 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-13T17:37:45.119 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-13T17:37:45.120 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-13T17:37:45.120 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-13T17:37:45.120 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc2103.ko 2024-09-13T17:37:45.120 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-13T17:37:45.120 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 79009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-13T17:37:45.120 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 109049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-13T17:37:45.120 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-13T17:37:45.120 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-13T17:37:45.120 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 65849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-13T17:37:45.120 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-13T17:37:45.120 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-13T17:37:45.120 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-13T17:37:45.120 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 56393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-13T17:37:45.121 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hih6130.ko 2024-09-13T17:37:45.121 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-13T17:37:45.121 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-13T17:37:45.121 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-13T17:37:45.121 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-13T17:37:45.121 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-13T17:37:45.121 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-13T17:37:45.121 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-13T17:37:45.121 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 150681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-13T17:37:45.121 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/jc42.ko 2024-09-13T17:37:45.121 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-13T17:37:45.121 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-13T17:37:45.121 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-13T17:37:45.121 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-13T17:37:45.122 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-13T17:37:45.122 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-13T17:37:45.122 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-13T17:37:45.122 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-13T17:37:45.122 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-13T17:37:45.122 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-13T17:37:45.122 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 86561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-13T17:37:45.122 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-13T17:37:45.122 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 73649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-13T17:37:45.122 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-13T17:37:45.122 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 131585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-13T17:37:45.122 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-13T17:37:45.122 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-13T17:37:45.123 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-13T17:37:45.123 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-13T17:37:45.123 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-13T17:37:45.123 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-13T17:37:45.123 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-13T17:37:45.123 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-13T17:37:45.123 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-13T17:37:45.123 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-13T17:37:45.123 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-13T17:37:45.123 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-13T17:37:45.123 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-13T17:37:45.123 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-13T17:37:45.123 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-13T17:37:45.123 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-13T17:37:45.124 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-13T17:37:45.124 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mc13783-adc.ko 2024-09-13T17:37:45.124 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-13T17:37:45.124 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-09-13T17:37:45.124 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 56825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-13T17:37:45.124 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 140657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-13T17:37:45.124 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 72761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-13T17:37:45.124 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-13T17:37:45.124 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 97865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-13T17:37:45.124 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-13T17:37:45.124 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-13T17:37:45.124 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ 2024-09-13T17:37:45.124 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-13T17:37:45.125 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-13T17:37:45.125 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-13T17:37:45.125 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-13T17:37:45.125 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-13T17:37:45.125 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-13T17:37:45.125 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-13T17:37:45.125 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 98961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-13T17:37:45.125 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-13T17:37:45.125 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-13T17:37:45.125 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-13T17:37:45.125 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-13T17:37:45.125 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-13T17:37:45.125 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-13T17:37:45.125 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-13T17:37:45.126 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-13T17:37:45.126 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-13T17:37:45.126 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-13T17:37:45.126 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-13T17:37:45.126 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-13T17:37:45.126 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-13T17:37:45.126 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-13T17:37:45.126 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-13T17:37:45.126 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-13T17:37:45.126 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-13T17:37:45.126 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-13T17:37:45.126 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-13T17:37:45.127 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-13T17:37:45.127 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-13T17:37:45.127 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-13T17:37:45.127 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-13T17:37:45.127 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-13T17:37:45.127 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 71193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-13T17:37:45.127 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 96665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-13T17:37:45.127 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-13T17:37:45.127 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 75217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-13T17:37:45.127 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 83505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-13T17:37:45.127 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 116873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-13T17:37:45.127 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 134513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-13T17:37:45.127 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-13T17:37:45.128 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-13T17:37:45.128 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-09-13T17:37:45.128 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-09-13T17:37:45.128 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/ 2024-09-13T17:37:45.128 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/ 2024-09-13T17:37:45.128 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-13T17:37:45.128 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-13T17:37:45.128 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/ 2024-09-13T17:37:45.128 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-09-13T17:37:45.128 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-09-13T17:37:45.128 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-09-13T17:37:45.128 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-13T17:37:45.128 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-13T17:37:45.129 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-13T17:37:45.129 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-09-13T17:37:45.129 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-13T17:37:45.129 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-09-13T17:37:45.129 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 63537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-13T17:37:45.129 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-13T17:37:45.129 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-13T17:37:45.129 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-13T17:37:45.129 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-09-13T17:37:45.129 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-09-13T17:37:45.129 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-13T17:37:45.129 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-13T17:37:45.129 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-13T17:37:45.130 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-09-13T17:37:45.130 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-13T17:37:45.130 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-13T17:37:45.130 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-09-13T17:37:45.130 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-13T17:37:45.130 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-13T17:37:45.130 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-13T17:37:45.130 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-09-13T17:37:45.130 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-13T17:37:45.130 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-13T17:37:45.130 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-09-13T17:37:45.130 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-09-13T17:37:45.130 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-13T17:37:45.131 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-09-13T17:37:45.131 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-13T17:37:45.131 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-13T17:37:45.131 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-13T17:37:45.131 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-13T17:37:45.131 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-09-13T17:37:45.131 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-13T17:37:45.131 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-13T17:37:45.131 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-13T17:37:45.131 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/ 2024-09-13T17:37:45.131 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-09-13T17:37:45.131 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-09-13T17:37:45.131 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-09-13T17:37:45.131 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ 2024-09-13T17:37:45.132 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ 2024-09-13T17:37:45.132 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 328633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-13T17:37:45.132 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1107329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-13T17:37:45.132 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 84409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-13T17:37:45.132 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 404889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-13T17:37:45.132 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 120105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-13T17:37:45.132 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 343753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-13T17:37:45.132 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-13T17:37:45.132 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ 2024-09-13T17:37:45.132 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/ 2024-09-13T17:37:45.132 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 591177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-13T17:37:45.132 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/ 2024-09-13T17:37:45.132 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 515585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-13T17:37:45.132 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/ 2024-09-13T17:37:45.133 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 919921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-13T17:37:45.133 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ 2024-09-13T17:37:45.133 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 375761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-13T17:37:45.133 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ 2024-09-13T17:37:45.133 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 203241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-09-13T17:37:45.133 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/ 2024-09-13T17:37:45.133 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 212353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-09-13T17:37:45.133 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ 2024-09-13T17:37:45.133 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ 2024-09-13T17:37:45.133 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 334665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-13T17:37:45.133 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ 2024-09-13T17:37:45.133 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 120785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-13T17:37:45.133 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ 2024-09-13T17:37:45.134 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 132457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-13T17:37:45.134 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ 2024-09-13T17:37:45.134 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 158257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-13T17:37:45.134 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ 2024-09-13T17:37:45.134 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 157209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-13T17:37:45.134 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ 2024-09-13T17:37:45.134 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/evbug.ko 2024-09-13T17:37:45.134 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ff-memless.ko 2024-09-13T17:37:45.134 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/ 2024-09-13T17:37:45.134 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-13T17:37:45.134 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-13T17:37:45.134 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-13T17:37:45.134 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-13T17:37:45.134 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/ 2024-09-13T17:37:45.135 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-09-13T17:37:45.135 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-09-13T17:37:45.135 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-09-13T17:37:45.135 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-09-13T17:37:45.135 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-13T17:37:45.135 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-09-13T17:37:45.135 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lkkbd.ko 2024-09-13T17:37:45.135 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8323.ko 2024-09-13T17:37:45.135 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8333.ko 2024-09-13T17:37:45.135 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-09-13T17:37:45.135 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-09-13T17:37:45.135 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-09-13T17:37:45.135 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-09-13T17:37:45.136 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/newtonkbd.ko 2024-09-13T17:37:45.136 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-09-13T17:37:45.136 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt1070.ko 2024-09-13T17:37:45.136 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt2160.ko 2024-09-13T17:37:45.136 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-09-13T17:37:45.136 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/stowaway.ko 2024-09-13T17:37:45.136 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/sunkbd.ko 2024-09-13T17:37:45.136 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-09-13T17:37:45.136 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-09-13T17:37:45.136 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-09-13T17:37:45.136 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/xtkbd.ko 2024-09-13T17:37:45.136 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/matrix-keymap.ko 2024-09-13T17:37:45.136 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/ 2024-09-13T17:37:45.136 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-13T17:37:45.137 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-13T17:37:45.137 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 160569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-13T17:37:45.137 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 114801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-13T17:37:45.137 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/gpio_mouse.ko 2024-09-13T17:37:45.137 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 430033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/psmouse.ko 2024-09-13T17:37:45.137 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-13T17:37:45.137 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-13T17:37:45.137 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-13T17:37:45.137 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-13T17:37:45.137 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/ 2024-09-13T17:37:45.137 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 139497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-13T17:37:45.137 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ 2024-09-13T17:37:45.137 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-13T17:37:45.138 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-13T17:37:45.138 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ct82c710.ko 2024-09-13T17:37:45.138 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-13T17:37:45.138 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/parkbd.ko 2024-09-13T17:37:45.138 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/pcips2.ko 2024-09-13T17:37:45.138 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ps2mult.ko 2024-09-13T17:37:45.138 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-13T17:37:45.138 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serport.ko 2024-09-13T17:37:45.138 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-13T17:37:45.138 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/ 2024-09-13T17:37:45.138 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-88pm860x.ko 2024-09-13T17:37:45.138 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-adp5520.ko 2024-09-13T17:37:45.138 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 77345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-bd2802.ko 2024-09-13T17:37:45.138 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-13T17:37:45.139 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da903x.ko 2024-09-13T17:37:45.139 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da9052.ko 2024-09-13T17:37:45.139 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-gpio.ko 2024-09-13T17:37:45.139 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-13T17:37:45.139 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3533.ko 2024-09-13T17:37:45.139 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm355x.ko 2024-09-13T17:37:45.139 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3642.ko 2024-09-13T17:37:45.139 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-13T17:37:45.139 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp8788.ko 2024-09-13T17:37:45.139 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-max8997.ko 2024-09-13T17:37:45.139 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-mc13783.ko 2024-09-13T17:37:45.139 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-menf21bmc.ko 2024-09-13T17:37:45.139 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca9532.ko 2024-09-13T17:37:45.140 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca955x.ko 2024-09-13T17:37:45.140 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca963x.ko 2024-09-13T17:37:45.140 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-13T17:37:45.140 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-tca6507.ko 2024-09-13T17:37:45.140 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm831x-status.ko 2024-09-13T17:37:45.140 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm8350.ko 2024-09-13T17:37:45.140 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ 2024-09-13T17:37:45.140 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-13T17:37:45.140 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-13T17:37:45.140 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-13T17:37:45.140 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-13T17:37:45.140 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-13T17:37:45.140 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-13T17:37:45.140 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-13T17:37:45.141 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-13T17:37:45.141 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/ 2024-09-13T17:37:45.141 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/ 2024-09-13T17:37:45.141 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 776777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-13T17:37:45.141 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-13T17:37:45.141 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 113977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bufio.ko 2024-09-13T17:37:45.141 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-13T17:37:45.141 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 197121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-13T17:37:45.141 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 137841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-13T17:37:45.141 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-13T17:37:45.141 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-era.ko 2024-09-13T17:37:45.141 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-13T17:37:45.141 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-13T17:37:45.142 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log.ko 2024-09-13T17:37:45.142 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-mirror.ko 2024-09-13T17:37:45.142 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 96937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-13T17:37:45.142 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-13T17:37:45.142 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 86937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-13T17:37:45.142 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-region-hash.ko 2024-09-13T17:37:45.142 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-13T17:37:45.142 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-13T17:37:45.142 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 139257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-snapshot.ko 2024-09-13T17:37:45.142 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-13T17:37:45.142 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 234353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-13T17:37:45.142 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 64945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-13T17:37:45.142 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-zero.ko 2024-09-13T17:37:45.142 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/ 2024-09-13T17:37:45.143 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 257025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-13T17:37:45.143 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-13T17:37:45.143 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 124833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-13T17:37:45.143 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 157401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-13T17:37:45.143 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 443385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-13T17:37:45.143 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/ 2024-09-13T17:37:45.143 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/ 2024-09-13T17:37:45.143 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 211273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-13T17:37:45.143 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-13T17:37:45.143 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-13T17:37:45.143 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-13T17:37:45.143 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 150977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-13T17:37:45.143 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 94401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-13T17:37:45.143 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 64033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-13T17:37:45.144 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/ 2024-09-13T17:37:45.144 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm800.ko 2024-09-13T17:37:45.144 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm805.ko 2024-09-13T17:37:45.144 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm80x.ko 2024-09-13T17:37:45.144 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona-i2c.ko 2024-09-13T17:37:45.144 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 146569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona.ko 2024-09-13T17:37:45.144 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/bcm590xx.ko 2024-09-13T17:37:45.144 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/cros_ec_dev.ko 2024-09-13T17:37:45.144 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/dln2.ko 2024-09-13T17:37:45.144 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/janz-cmodio.ko 2024-09-13T17:37:45.144 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/kempld-core.ko 2024-09-13T17:37:45.144 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-core.ko 2024-09-13T17:37:45.145 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-09-13T17:37:45.145 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lp3943.ko 2024-09-13T17:37:45.145 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-13T17:37:45.145 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-13T17:37:45.145 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/max8907.ko 2024-09-13T17:37:45.145 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-core.ko 2024-09-13T17:37:45.145 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-09-13T17:37:45.145 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/menf21bmc.ko 2024-09-13T17:37:45.145 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-adc.ko 2024-09-13T17:37:45.145 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-gpio.ko 2024-09-13T17:37:45.145 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633.ko 2024-09-13T17:37:45.145 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-09-13T17:37:45.145 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/retu-mfd.ko 2024-09-13T17:37:45.145 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 95625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/si476x-core.ko 2024-09-13T17:37:45.146 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-13T17:37:45.146 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps65010.ko 2024-09-13T17:37:45.146 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps6507x.ko 2024-09-13T17:37:45.146 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-13T17:37:45.146 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-13T17:37:45.146 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-13T17:37:45.146 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wm8994.ko 2024-09-13T17:37:45.146 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ 2024-09-13T17:37:45.146 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-09-13T17:37:45.146 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 63993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot.ko 2024-09-13T17:37:45.146 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/ 2024-09-13T17:37:45.146 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-13T17:37:45.146 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-13T17:37:45.146 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-13T17:37:45.147 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-13T17:37:45.147 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/ 2024-09-13T17:37:45.147 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-09-13T17:37:45.147 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/core.ko 2024-09-13T17:37:45.147 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/ 2024-09-13T17:37:45.147 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-13T17:37:45.147 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ds1682.ko 2024-09-13T17:37:45.147 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/dummy-irq.ko 2024-09-13T17:37:45.147 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/ 2024-09-13T17:37:45.147 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/echo.ko 2024-09-13T17:37:45.147 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/ 2024-09-13T17:37:45.147 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-13T17:37:45.147 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-13T17:37:45.148 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-13T17:37:45.148 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-13T17:37:45.148 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/ 2024-09-13T17:37:45.148 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 191761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-09-13T17:37:45.148 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hmc6352.ko 2024-09-13T17:37:45.148 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-13T17:37:45.148 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ 2024-09-13T17:37:45.148 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 92489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-09-13T17:37:45.148 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ics932s401.ko 2024-09-13T17:37:45.148 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-13T17:37:45.148 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-13T17:37:45.148 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/ 2024-09-13T17:37:45.148 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-13T17:37:45.149 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-13T17:37:45.149 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/ 2024-09-13T17:37:45.149 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 153777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-13T17:37:45.149 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-13T17:37:45.149 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 381905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-13T17:37:45.149 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/phantom.ko 2024-09-13T17:37:45.149 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/ 2024-09-13T17:37:45.149 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 90881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/st_drv.ko 2024-09-13T17:37:45.149 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-13T17:37:45.149 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-13T17:37:45.149 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-13T17:37:45.149 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 56809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-13T17:37:45.149 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/ 2024-09-13T17:37:45.149 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 232257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-13T17:37:45.150 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ 2024-09-13T17:37:45.150 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/ 2024-09-13T17:37:45.150 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 623361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-13T17:37:45.150 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/ 2024-09-13T17:37:45.150 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/ 2024-09-13T17:37:45.150 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 133161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-13T17:37:45.150 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-13T17:37:45.150 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-13T17:37:45.150 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/ 2024-09-13T17:37:45.150 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 592833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-13T17:37:45.150 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-13T17:37:45.150 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-13T17:37:45.150 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ 2024-09-13T17:37:45.151 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/ 2024-09-13T17:37:45.151 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-13T17:37:45.151 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-13T17:37:45.151 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 158537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-13T17:37:45.151 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 86233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-13T17:37:45.151 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ 2024-09-13T17:37:45.151 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-13T17:37:45.151 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 73953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-13T17:37:45.151 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-13T17:37:45.151 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 109673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-13T17:37:45.151 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/ 2024-09-13T17:37:45.151 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 64817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-13T17:37:45.151 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/ 2024-09-13T17:37:45.152 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 84433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-13T17:37:45.152 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/ 2024-09-13T17:37:45.152 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-13T17:37:45.152 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/ 2024-09-13T17:37:45.152 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-13T17:37:45.152 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/ 2024-09-13T17:37:45.152 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 65945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-13T17:37:45.152 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 56145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-13T17:37:45.152 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 116105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-13T17:37:45.152 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/ 2024-09-13T17:37:45.152 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/ 2024-09-13T17:37:45.152 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 124721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-13T17:37:45.152 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-09-13T17:37:45.153 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 128625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-13T17:37:45.153 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-09-13T17:37:45.153 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 110505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-13T17:37:45.153 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/ 2024-09-13T17:37:45.153 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 102017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-13T17:37:45.153 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 89121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-13T17:37:45.153 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/ 2024-09-13T17:37:45.153 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 106593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-13T17:37:45.153 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 229409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-13T17:37:45.153 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-09-13T17:37:45.153 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1734265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-13T17:37:45.153 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 166913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-13T17:37:45.153 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/ 2024-09-13T17:37:45.154 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 164665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-13T17:37:45.154 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 439633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-13T17:37:45.154 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/ 2024-09-13T17:37:45.154 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/ 2024-09-13T17:37:45.154 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 432417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-13T17:37:45.154 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/ 2024-09-13T17:37:45.154 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-09-13T17:37:45.154 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 257433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-13T17:37:45.154 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-09-13T17:37:45.154 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 444721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-13T17:37:45.154 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-09-13T17:37:45.154 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1309441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-13T17:37:45.154 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-09-13T17:37:45.155 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 207073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-13T17:37:45.155 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-09-13T17:37:45.155 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-13T17:37:45.155 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/ 2024-09-13T17:37:45.155 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/ 2024-09-13T17:37:45.155 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 269777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-13T17:37:45.155 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/ 2024-09-13T17:37:45.155 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/ 2024-09-13T17:37:45.155 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-13T17:37:45.155 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 77601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-13T17:37:45.155 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 169313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-13T17:37:45.155 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-13T17:37:45.155 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 76361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-13T17:37:45.156 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-13T17:37:45.156 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/ 2024-09-13T17:37:45.156 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 76161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-13T17:37:45.156 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-13T17:37:45.156 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-13T17:37:45.156 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ec_bhf.ko 2024-09-13T17:37:45.156 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/ 2024-09-13T17:37:45.156 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/ 2024-09-13T17:37:45.156 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 356153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-13T17:37:45.156 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-13T17:37:45.156 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 63345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-13T17:37:45.156 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/ 2024-09-13T17:37:45.156 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-09-13T17:37:45.156 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ 2024-09-13T17:37:45.157 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 115697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-13T17:37:45.157 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/ 2024-09-13T17:37:45.157 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 366465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-13T17:37:45.157 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/ 2024-09-13T17:37:45.157 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 755425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-13T17:37:45.157 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/ 2024-09-13T17:37:45.157 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 324721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-13T17:37:45.157 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/ 2024-09-13T17:37:45.157 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1193705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-13T17:37:45.157 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/ 2024-09-13T17:37:45.157 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 356609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-13T17:37:45.157 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/ 2024-09-13T17:37:45.157 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 672177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-13T17:37:45.158 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/ 2024-09-13T17:37:45.158 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 121609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-13T17:37:45.158 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-09-13T17:37:45.158 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 966193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-13T17:37:45.158 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-09-13T17:37:45.158 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 193889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-13T17:37:45.158 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/ 2024-09-13T17:37:45.158 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-13T17:37:45.158 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/ 2024-09-13T17:37:45.158 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 5969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-13T17:37:45.158 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 109353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-13T17:37:45.158 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/ 2024-09-13T17:37:45.158 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-13T17:37:45.159 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 127057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-13T17:37:45.159 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 151049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-13T17:37:45.159 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/ 2024-09-13T17:37:45.159 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-09-13T17:37:45.159 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 888945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-13T17:37:45.159 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 346977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-13T17:37:45.159 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-09-13T17:37:45.159 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-09-13T17:37:45.159 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1408481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-13T17:37:45.159 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ 2024-09-13T17:37:45.159 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-09-13T17:37:45.159 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-09-13T17:37:45.159 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-09-13T17:37:45.159 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 117585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-13T17:37:45.160 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/ 2024-09-13T17:37:45.160 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-09-13T17:37:45.160 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 131601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-13T17:37:45.160 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ 2024-09-13T17:37:45.160 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 91689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-13T17:37:45.160 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 56777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-13T17:37:45.160 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/ 2024-09-13T17:37:45.160 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 181409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-13T17:37:45.160 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/ 2024-09-13T17:37:45.160 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 171649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-13T17:37:45.160 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/ 2024-09-13T17:37:45.160 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-13T17:37:45.161 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-13T17:37:45.161 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/ 2024-09-13T17:37:45.161 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-09-13T17:37:45.161 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 301017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-13T17:37:45.161 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 105857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-13T17:37:45.161 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-09-13T17:37:45.161 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 885465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-13T17:37:45.161 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/ 2024-09-13T17:37:45.161 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-13T17:37:45.161 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/ 2024-09-13T17:37:45.161 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 81785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-13T17:37:45.161 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 100833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-13T17:37:45.161 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-13T17:37:45.162 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 264393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-13T17:37:45.162 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/ 2024-09-13T17:37:45.162 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-09-13T17:37:45.162 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 142481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-09-13T17:37:45.162 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/ 2024-09-13T17:37:45.162 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1346017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-13T17:37:45.162 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/ 2024-09-13T17:37:45.162 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-13T17:37:45.162 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/ 2024-09-13T17:37:45.162 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-13T17:37:45.162 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 80233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-13T17:37:45.162 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/ 2024-09-13T17:37:45.162 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 74529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-13T17:37:45.162 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 79601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-13T17:37:45.163 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 100937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-13T17:37:45.163 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 83593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-13T17:37:45.163 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/ 2024-09-13T17:37:45.163 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-09-13T17:37:45.163 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-09-13T17:37:45.163 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-13T17:37:45.163 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-09-13T17:37:45.163 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 644913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-13T17:37:45.163 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/ 2024-09-13T17:37:45.163 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 129089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-13T17:37:45.163 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 208177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-13T17:37:45.163 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 82033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-13T17:37:45.163 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 91641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-13T17:37:45.164 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/ 2024-09-13T17:37:45.164 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-13T17:37:45.164 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/ 2024-09-13T17:37:45.164 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 110881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-13T17:37:45.164 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/ 2024-09-13T17:37:45.164 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 98993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-13T17:37:45.164 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 102745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-13T17:37:45.164 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/ 2024-09-13T17:37:45.164 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-13T17:37:45.164 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-13T17:37:45.164 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/ 2024-09-13T17:37:45.164 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-13T17:37:45.164 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/ 2024-09-13T17:37:45.165 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/defxx.ko 2024-09-13T17:37:45.165 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/ 2024-09-13T17:37:45.165 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 275889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/skfp.ko 2024-09-13T17:37:45.165 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 91785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-13T17:37:45.165 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/ 2024-09-13T17:37:45.165 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 290697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-13T17:37:45.165 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/ 2024-09-13T17:37:45.165 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-13T17:37:45.165 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-13T17:37:45.165 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ 2024-09-13T17:37:45.168 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 107849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-13T17:37:45.168 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 77585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-13T17:37:45.169 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-13T17:37:45.169 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/ 2024-09-13T17:37:45.169 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-13T17:37:45.169 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-13T17:37:45.169 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-gpio.ko 2024-09-13T17:37:45.169 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-13T17:37:45.169 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-13T17:37:45.169 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-13T17:37:45.169 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-13T17:37:45.169 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-13T17:37:45.169 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/ 2024-09-13T17:37:45.169 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-13T17:37:45.169 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 72969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-13T17:37:45.170 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ 2024-09-13T17:37:45.170 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-13T17:37:45.170 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-13T17:37:45.170 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-13T17:37:45.170 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-13T17:37:45.170 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-13T17:37:45.170 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-13T17:37:45.170 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-13T17:37:45.170 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-13T17:37:45.170 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-13T17:37:45.170 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-13T17:37:45.170 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 113681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-13T17:37:45.170 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 108257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-13T17:37:45.171 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-13T17:37:45.171 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 118505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-13T17:37:45.171 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-13T17:37:45.171 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 76177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-13T17:37:45.171 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-13T17:37:45.171 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-13T17:37:45.171 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-13T17:37:45.171 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/ 2024-09-13T17:37:45.171 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/plip.ko 2024-09-13T17:37:45.171 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ 2024-09-13T17:37:45.171 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-13T17:37:45.171 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-13T17:37:45.171 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-13T17:37:45.171 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-13T17:37:45.172 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-13T17:37:45.172 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-13T17:37:45.172 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-13T17:37:45.172 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-13T17:37:45.172 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/ 2024-09-13T17:37:45.172 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-13T17:37:45.172 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-13T17:37:45.172 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 79233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-13T17:37:45.172 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/ 2024-09-13T17:37:45.172 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 136729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-13T17:37:45.172 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-13T17:37:45.172 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-13T17:37:45.172 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-13T17:37:45.173 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-13T17:37:45.173 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-13T17:37:45.173 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 108409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-13T17:37:45.173 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/ 2024-09-13T17:37:45.173 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 179329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-13T17:37:45.173 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/ 2024-09-13T17:37:45.173 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 384193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-13T17:37:45.173 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/ 2024-09-13T17:37:45.173 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 175857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-13T17:37:45.173 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ 2024-09-13T17:37:45.173 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-13T17:37:45.173 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/ 2024-09-13T17:37:45.173 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/ 2024-09-13T17:37:45.173 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 337697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-13T17:37:45.174 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 128353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-13T17:37:45.174 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/ 2024-09-13T17:37:45.174 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 164153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-13T17:37:45.174 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-13T17:37:45.174 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 103657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-13T17:37:45.174 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-13T17:37:45.174 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/ 2024-09-13T17:37:45.174 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/ 2024-09-13T17:37:45.174 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-13T17:37:45.174 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-09-13T17:37:45.174 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-09-13T17:37:45.174 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pci-stub.ko 2024-09-13T17:37:45.174 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-13T17:37:45.174 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/ 2024-09-13T17:37:45.175 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-13T17:37:45.175 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 177817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia.ko 2024-09-13T17:37:45.175 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 76785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_core.ko 2024-09-13T17:37:45.175 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-09-13T17:37:45.175 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-13T17:37:45.175 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 133969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-13T17:37:45.175 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/ 2024-09-13T17:37:45.175 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/ 2024-09-13T17:37:45.175 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-09-13T17:37:45.175 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/ 2024-09-13T17:37:45.175 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-09-13T17:37:45.175 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/ 2024-09-13T17:37:45.175 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/ 2024-09-13T17:37:45.176 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-13T17:37:45.176 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/ 2024-09-13T17:37:45.176 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/ 2024-09-13T17:37:45.176 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-09-13T17:37:45.176 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec.ko 2024-09-13T17:37:45.176 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-09-13T17:37:45.176 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-09-13T17:37:45.176 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-09-13T17:37:45.176 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-09-13T17:37:45.176 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-09-13T17:37:45.176 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ 2024-09-13T17:37:45.176 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 88017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-13T17:37:45.176 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-13T17:37:45.177 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-13T17:37:45.177 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 74033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-13T17:37:45.177 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-13T17:37:45.177 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 172313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-13T17:37:45.177 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-13T17:37:45.177 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-13T17:37:45.177 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-13T17:37:45.177 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-13T17:37:45.177 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-13T17:37:45.177 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-13T17:37:45.177 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ibm_rtl.ko 2024-09-13T17:37:45.177 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/ 2024-09-13T17:37:45.177 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-13T17:37:45.178 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-09-13T17:37:45.178 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-13T17:37:45.178 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-13T17:37:45.178 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-13T17:37:45.178 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-13T17:37:45.178 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-13T17:37:45.178 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-13T17:37:45.178 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-13T17:37:45.178 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-13T17:37:45.178 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-13T17:37:45.178 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-13T17:37:45.178 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-13T17:37:45.178 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/ 2024-09-13T17:37:45.178 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ 2024-09-13T17:37:45.179 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_battery.ko 2024-09-13T17:37:45.179 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_charger.ko 2024-09-13T17:37:45.179 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 68921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq2415x_charger.ko 2024-09-13T17:37:45.179 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 73161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24190_charger.ko 2024-09-13T17:37:45.179 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24735-charger.ko 2024-09-13T17:37:45.179 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_charge-control.ko 2024-09-13T17:37:45.179 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-09-13T17:37:45.179 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9030_battery.ko 2024-09-13T17:37:45.179 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9052-battery.ko 2024-09-13T17:37:45.179 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2760_battery.ko 2024-09-13T17:37:45.179 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2780_battery.ko 2024-09-13T17:37:45.179 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2781_battery.ko 2024-09-13T17:37:45.179 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2782_battery.ko 2024-09-13T17:37:45.179 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/gpio-charger.ko 2024-09-13T17:37:45.180 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/isp1704_charger.ko 2024-09-13T17:37:45.180 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/lp8727_charger.ko 2024-09-13T17:37:45.180 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max14577_charger.ko 2024-09-13T17:37:45.180 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max17042_battery.ko 2024-09-13T17:37:45.180 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8903_charger.ko 2024-09-13T17:37:45.180 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8925_power.ko 2024-09-13T17:37:45.180 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/pcf50633-charger.ko 2024-09-13T17:37:45.180 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/sbs-battery.ko 2024-09-13T17:37:45.180 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/test_power.ko 2024-09-13T17:37:45.180 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/tps65090-charger.ko 2024-09-13T17:37:45.180 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_backup.ko 2024-09-13T17:37:45.180 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_power.ko 2024-09-13T17:37:45.180 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm8350_power.ko 2024-09-13T17:37:45.181 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/ 2024-09-13T17:37:45.181 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 98737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-13T17:37:45.181 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-13T17:37:45.181 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/ 2024-09-13T17:37:45.181 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/ 2024-09-13T17:37:45.181 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-13T17:37:45.181 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-13T17:37:45.181 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-13T17:37:45.181 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-13T17:37:45.181 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ 2024-09-13T17:37:45.181 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 90617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-13T17:37:45.181 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-13T17:37:45.181 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/ 2024-09-13T17:37:45.182 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/ 2024-09-13T17:37:45.182 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/ 2024-09-13T17:37:45.182 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 89769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-13T17:37:45.182 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-13T17:37:45.182 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/ 2024-09-13T17:37:45.182 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm80x.ko 2024-09-13T17:37:45.182 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm860x.ko 2024-09-13T17:37:45.182 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-13T17:37:45.182 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9052.ko 2024-09-13T17:37:45.182 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9055.ko 2024-09-13T17:37:45.182 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9063.ko 2024-09-13T17:37:45.182 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-13T17:37:45.182 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 82585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-13T17:37:45.182 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-13T17:37:45.183 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-13T17:37:45.183 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-13T17:37:45.183 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-13T17:37:45.183 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-13T17:37:45.183 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-13T17:37:45.183 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-13T17:37:45.183 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-13T17:37:45.183 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-13T17:37:45.183 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-13T17:37:45.183 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-13T17:37:45.183 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-lp8788.ko 2024-09-13T17:37:45.183 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-13T17:37:45.183 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-13T17:37:45.184 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-13T17:37:45.184 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t86.ko 2024-09-13T17:37:45.184 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-13T17:37:45.184 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8907.ko 2024-09-13T17:37:45.184 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8925.ko 2024-09-13T17:37:45.184 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8997.ko 2024-09-13T17:37:45.184 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8998.ko 2024-09-13T17:37:45.184 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-09-13T17:37:45.184 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-13T17:37:45.184 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-palmas.ko 2024-09-13T17:37:45.184 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 56873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-13T17:37:45.184 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf50633.ko 2024-09-13T17:37:45.184 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-13T17:37:45.184 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-13T17:37:45.185 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-13T17:37:45.185 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-13T17:37:45.185 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rc5t583.ko 2024-09-13T17:37:45.185 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-13T17:37:45.185 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-13T17:37:45.185 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-13T17:37:45.185 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-13T17:37:45.185 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-13T17:37:45.185 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-s35390a.ko 2024-09-13T17:37:45.185 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-13T17:37:45.185 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps6586x.ko 2024-09-13T17:37:45.185 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps65910.ko 2024-09-13T17:37:45.185 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm831x.ko 2024-09-13T17:37:45.186 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm8350.ko 2024-09-13T17:37:45.186 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-13T17:37:45.186 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ 2024-09-13T17:37:45.186 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 90537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-13T17:37:45.186 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-13T17:37:45.186 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-13T17:37:45.186 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 164753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-13T17:37:45.186 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-13T17:37:45.186 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/ 2024-09-13T17:37:45.186 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 341105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-13T17:37:45.186 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 120833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-13T17:37:45.186 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/ 2024-09-13T17:37:45.186 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 468305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-13T17:37:45.186 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 380857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-13T17:37:45.187 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/ 2024-09-13T17:37:45.187 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 244049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-09-13T17:37:45.187 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-13T17:37:45.187 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/ 2024-09-13T17:37:45.187 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 135801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-13T17:37:45.187 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-13T17:37:45.187 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/ 2024-09-13T17:37:45.187 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 305161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-13T17:37:45.187 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/ 2024-09-13T17:37:45.187 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1526289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-13T17:37:45.187 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/ 2024-09-13T17:37:45.187 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 298321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-13T17:37:45.187 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/ 2024-09-13T17:37:45.187 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 144553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-13T17:37:45.188 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-13T17:37:45.188 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/ 2024-09-13T17:37:45.188 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 390817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-13T17:37:45.188 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/ 2024-09-13T17:37:45.188 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-09-13T17:37:45.188 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 89041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-13T17:37:45.188 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-09-13T17:37:45.188 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 117561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-13T17:37:45.188 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 168361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-13T17:37:45.188 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 91777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-13T17:37:45.188 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-13T17:37:45.188 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/ 2024-09-13T17:37:45.188 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 267737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-13T17:37:45.189 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-13T17:37:45.189 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/ 2024-09-13T17:37:45.189 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 95553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-13T17:37:45.189 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 191041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-13T17:37:45.189 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fdomain.ko 2024-09-13T17:37:45.189 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/ 2024-09-13T17:37:45.189 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 366737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-13T17:37:45.189 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 251641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-13T17:37:45.189 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 65529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-13T17:37:45.189 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-13T17:37:45.189 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/imm.ko 2024-09-13T17:37:45.189 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-13T17:37:45.189 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 327841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-13T17:37:45.189 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 129881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-13T17:37:45.190 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/ 2024-09-13T17:37:45.190 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 398505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-13T17:37:45.190 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-13T17:37:45.190 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-13T17:37:45.190 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/ 2024-09-13T17:37:45.190 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 380649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-13T17:37:45.190 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 172833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-13T17:37:45.190 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 63097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-13T17:37:45.190 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/ 2024-09-13T17:37:45.190 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 274913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-13T17:37:45.190 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/ 2024-09-13T17:37:45.190 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 2737441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-13T17:37:45.190 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/ 2024-09-13T17:37:45.191 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 88625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-13T17:37:45.191 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-13T17:37:45.191 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 388737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-13T17:37:45.191 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 105177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-13T17:37:45.191 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/ 2024-09-13T17:37:45.191 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 833969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-13T17:37:45.191 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/ 2024-09-13T17:37:45.191 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 158857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-13T17:37:45.191 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 96697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-13T17:37:45.191 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/ 2024-09-13T17:37:45.191 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 102113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-09-13T17:37:45.192 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-09-13T17:37:45.192 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-09-13T17:37:45.192 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-09-13T17:37:45.192 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/ 2024-09-13T17:37:45.192 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 444273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-13T17:37:45.192 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 152097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-13T17:37:45.192 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ppa.ko 2024-09-13T17:37:45.192 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-13T17:37:45.192 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/ 2024-09-13T17:37:45.192 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 2323537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-13T17:37:45.192 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 103793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-13T17:37:45.192 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/ 2024-09-13T17:37:45.192 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 697393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-13T17:37:45.193 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qlogicfas408.ko 2024-09-13T17:37:45.193 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-13T17:37:45.193 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 331577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-13T17:37:45.193 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 219497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-13T17:37:45.193 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 349593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-13T17:37:45.193 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 121777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-13T17:37:45.193 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 92385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-13T17:37:45.193 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-13T17:37:45.193 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-13T17:37:45.193 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 138265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-13T17:37:45.193 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-13T17:37:45.193 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/ 2024-09-13T17:37:45.193 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 205137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-13T17:37:45.194 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-13T17:37:45.194 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-13T17:37:45.194 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-13T17:37:45.194 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/xen-scsifront.ko 2024-09-13T17:37:45.194 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ 2024-09-13T17:37:45.194 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 172697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-13T17:37:45.194 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/ 2024-09-13T17:37:45.194 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/ 2024-09-13T17:37:45.194 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 915121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-13T17:37:45.194 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/ 2024-09-13T17:37:45.194 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-13T17:37:45.194 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-13T17:37:45.194 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-13T17:37:45.194 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1161521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-13T17:37:45.195 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-13T17:37:45.195 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 149801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-13T17:37:45.195 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/ 2024-09-13T17:37:45.195 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 90217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-13T17:37:45.195 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/ 2024-09-13T17:37:45.195 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/ 2024-09-13T17:37:45.195 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/ 2024-09-13T17:37:45.195 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-13T17:37:45.195 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-13T17:37:45.195 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-13T17:37:45.195 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-13T17:37:45.195 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-13T17:37:45.195 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-13T17:37:45.196 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-13T17:37:45.196 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-13T17:37:45.196 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-13T17:37:45.196 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-13T17:37:45.196 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-13T17:37:45.196 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-13T17:37:45.196 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-13T17:37:45.196 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-13T17:37:45.196 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-13T17:37:45.196 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-09-13T17:37:45.196 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-13T17:37:45.196 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-13T17:37:45.196 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-13T17:37:45.197 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ 2024-09-13T17:37:45.197 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ 2024-09-13T17:37:45.197 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 99417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-13T17:37:45.197 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/moxa.ko 2024-09-13T17:37:45.197 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/mxser.ko 2024-09-13T17:37:45.197 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 134633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-13T17:37:45.197 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-13T17:37:45.197 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 79057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-13T17:37:45.197 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/ 2024-09-13T17:37:45.197 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/ 2024-09-13T17:37:45.197 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-09-13T17:37:45.197 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 65273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-13T17:37:45.197 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-09-13T17:37:45.197 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_uart.ko 2024-09-13T17:37:45.198 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-13T17:37:45.198 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 90697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-09-13T17:37:45.198 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/ 2024-09-13T17:37:45.198 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 121249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-13T17:37:45.198 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/rp2.ko 2024-09-13T17:37:45.198 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 68009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx.ko 2024-09-13T17:37:45.198 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-09-13T17:37:45.198 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/ 2024-09-13T17:37:45.198 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ 2024-09-13T17:37:45.198 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 689289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-13T17:37:45.198 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ 2024-09-13T17:37:45.198 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-13T17:37:45.198 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-09-13T17:37:45.198 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/ 2024-09-13T17:37:45.199 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-13T17:37:45.199 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-13T17:37:45.199 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-13T17:37:45.199 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_dmem_genirq.ko 2024-09-13T17:37:45.199 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_mf624.ko 2024-09-13T17:37:45.199 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_netx.ko 2024-09-13T17:37:45.199 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-13T17:37:45.199 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-09-13T17:37:45.199 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-13T17:37:45.199 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/ 2024-09-13T17:37:45.199 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/ 2024-09-13T17:37:45.199 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 90417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/c67x00.ko 2024-09-13T17:37:45.199 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ 2024-09-13T17:37:45.199 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 187689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-09-13T17:37:45.200 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-09-13T17:37:45.200 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-09-13T17:37:45.200 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-09-13T17:37:45.200 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-09-13T17:37:45.200 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/ 2024-09-13T17:37:45.200 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 101657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-13T17:37:45.200 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 63545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-13T17:37:45.200 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 56841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-13T17:37:45.200 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 107633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-13T17:37:45.200 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ 2024-09-13T17:37:45.200 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ulpi.ko 2024-09-13T17:37:45.200 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/ 2024-09-13T17:37:45.200 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-09-13T17:37:45.201 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/ 2024-09-13T17:37:45.201 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-09-13T17:37:45.201 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-09-13T17:37:45.201 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 576329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3.ko 2024-09-13T17:37:45.201 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/ 2024-09-13T17:37:45.201 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/ 2024-09-13T17:37:45.201 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_ether.ko 2024-09-13T17:37:45.201 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_serial.ko 2024-09-13T17:37:45.201 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-09-13T17:37:45.201 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-09-13T17:37:45.201 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-09-13T17:37:45.201 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-09-13T17:37:45.201 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 132897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-09-13T17:37:45.202 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-09-13T17:37:45.202 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 142801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-09-13T17:37:45.202 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-09-13T17:37:45.202 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-09-13T17:37:45.202 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-09-13T17:37:45.202 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-09-13T17:37:45.202 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 99913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-09-13T17:37:45.202 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-09-13T17:37:45.202 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 71577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-09-13T17:37:45.202 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-09-13T17:37:45.202 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/ 2024-09-13T17:37:45.202 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-09-13T17:37:45.202 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-09-13T17:37:45.203 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-09-13T17:37:45.203 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-09-13T17:37:45.203 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-09-13T17:37:45.203 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-09-13T17:37:45.203 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-09-13T17:37:45.203 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-09-13T17:37:45.203 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-09-13T17:37:45.203 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-09-13T17:37:45.203 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-09-13T17:37:45.203 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-09-13T17:37:45.203 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-09-13T17:37:45.203 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-09-13T17:37:45.203 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 200137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/libcomposite.ko 2024-09-13T17:37:45.203 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/ 2024-09-13T17:37:45.204 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-09-13T17:37:45.204 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/ 2024-09-13T17:37:45.204 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 182665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-09-13T17:37:45.204 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-09-13T17:37:45.204 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-09-13T17:37:45.204 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-09-13T17:37:45.204 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-09-13T17:37:45.204 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 90409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2272.ko 2024-09-13T17:37:45.204 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 90457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2280.ko 2024-09-13T17:37:45.204 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 94929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-09-13T17:37:45.204 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 80617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-09-13T17:37:45.204 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 87561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-09-13T17:37:45.204 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 94385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-09-13T17:37:45.205 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 191281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-09-13T17:37:45.205 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ 2024-09-13T17:37:45.205 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/bcma-hcd.ko 2024-09-13T17:37:45.205 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 108417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/isp116x-hcd.ko 2024-09-13T17:37:45.205 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 104817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-09-13T17:37:45.205 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 102361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-09-13T17:37:45.205 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-13T17:37:45.205 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811_cs.ko 2024-09-13T17:37:45.205 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ssb-hcd.ko 2024-09-13T17:37:45.205 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-09-13T17:37:45.205 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/ 2024-09-13T17:37:45.205 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-13T17:37:45.205 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-13T17:37:45.205 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ 2024-09-13T17:37:45.206 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-13T17:37:45.206 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-13T17:37:45.206 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-09-13T17:37:45.206 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cytherm.ko 2024-09-13T17:37:45.206 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ehset.ko 2024-09-13T17:37:45.206 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-13T17:37:45.206 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-13T17:37:45.206 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-13T17:37:45.206 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-13T17:37:45.206 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-13T17:37:45.206 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-13T17:37:45.206 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-13T17:37:45.206 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-13T17:37:45.207 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/lvstest.ko 2024-09-13T17:37:45.207 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/ 2024-09-13T17:37:45.207 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-13T17:37:45.207 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-13T17:37:45.207 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-13T17:37:45.207 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-13T17:37:45.207 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-13T17:37:45.207 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 84369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbtest.ko 2024-09-13T17:37:45.207 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-13T17:37:45.207 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-13T17:37:45.207 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/ 2024-09-13T17:37:45.207 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 91561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/usbmon.ko 2024-09-13T17:37:45.207 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/ 2024-09-13T17:37:45.207 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 391209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/musb_hdrc.ko 2024-09-13T17:37:45.208 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/ 2024-09-13T17:37:45.208 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-13T17:37:45.208 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-09-13T17:37:45.208 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-isp1301.ko 2024-09-13T17:37:45.208 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-tahvo.ko 2024-09-13T17:37:45.208 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ 2024-09-13T17:37:45.208 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-13T17:37:45.208 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-13T17:37:45.208 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-13T17:37:45.209 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-13T17:37:45.209 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 79769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-13T17:37:45.209 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-13T17:37:45.209 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-13T17:37:45.209 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-13T17:37:45.209 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-13T17:37:45.209 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/f81232.ko 2024-09-13T17:37:45.209 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 188729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-13T17:37:45.209 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-13T17:37:45.209 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 152409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-13T17:37:45.209 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 142937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-13T17:37:45.209 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-13T17:37:45.209 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-13T17:37:45.209 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-13T17:37:45.210 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-13T17:37:45.210 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 122425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-13T17:37:45.210 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-13T17:37:45.210 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-13T17:37:45.210 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-13T17:37:45.210 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-13T17:37:45.210 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/metro-usb.ko 2024-09-13T17:37:45.210 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 79801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-13T17:37:45.210 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 91625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-13T17:37:45.210 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 65281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mxuport.ko 2024-09-13T17:37:45.210 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-13T17:37:45.210 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-13T17:37:45.210 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-13T17:37:45.211 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 201257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-13T17:37:45.211 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-13T17:37:45.211 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-13T17:37:45.211 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-13T17:37:45.211 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-13T17:37:45.211 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-13T17:37:45.211 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-13T17:37:45.211 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-13T17:37:45.211 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-13T17:37:45.211 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-13T17:37:45.211 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-13T17:37:45.211 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-13T17:37:45.211 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-13T17:37:45.211 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-13T17:37:45.212 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-13T17:37:45.212 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 148729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usbserial.ko 2024-09-13T17:37:45.212 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-13T17:37:45.212 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-13T17:37:45.212 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/wishbone-serial.ko 2024-09-13T17:37:45.212 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-13T17:37:45.212 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ 2024-09-13T17:37:45.212 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 63361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-13T17:37:45.212 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-13T17:37:45.212 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-13T17:37:45.212 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-13T17:37:45.212 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-13T17:37:45.212 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-13T17:37:45.213 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-13T17:37:45.213 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-13T17:37:45.213 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-13T17:37:45.213 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-13T17:37:45.213 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-13T17:37:45.213 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-13T17:37:45.213 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-13T17:37:45.213 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-13T17:37:45.213 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 201057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-13T17:37:45.213 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/ 2024-09-13T17:37:45.213 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 74449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-13T17:37:45.213 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-13T17:37:45.213 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 122537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-13T17:37:45.214 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/ 2024-09-13T17:37:45.214 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/ 2024-09-13T17:37:45.214 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 196977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-13T17:37:45.214 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-13T17:37:45.214 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 134401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-13T17:37:45.214 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 93481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-13T17:37:45.214 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/ 2024-09-13T17:37:45.214 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 135241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-13T17:37:45.214 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-13T17:37:45.214 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 71553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-13T17:37:45.214 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 110185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-13T17:37:45.214 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/ 2024-09-13T17:37:45.214 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/ 2024-09-13T17:37:45.214 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-09-13T17:37:45.215 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/aat2870_bl.ko 2024-09-13T17:37:45.215 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp5520_bl.ko 2024-09-13T17:37:45.215 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8860_bl.ko 2024-09-13T17:37:45.215 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8870_bl.ko 2024-09-13T17:37:45.215 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-13T17:37:45.215 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/as3711_bl.ko 2024-09-13T17:37:45.215 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/bd6107.ko 2024-09-13T17:37:45.215 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da903x_bl.ko 2024-09-13T17:37:45.215 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da9052_bl.ko 2024-09-13T17:37:45.215 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/gpio_backlight.ko 2024-09-13T17:37:45.215 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/kb3886_bl.ko 2024-09-13T17:37:45.215 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-13T17:37:45.215 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3533_bl.ko 2024-09-13T17:37:45.216 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3639_bl.ko 2024-09-13T17:37:45.216 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lv5207lp.ko 2024-09-13T17:37:45.216 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/max8925_bl.ko 2024-09-13T17:37:45.216 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pandora_bl.ko 2024-09-13T17:37:45.216 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-09-13T17:37:45.216 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-13T17:37:45.216 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/wm831x_bl.ko 2024-09-13T17:37:45.216 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/ 2024-09-13T17:37:45.216 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ 2024-09-13T17:37:45.216 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-13T17:37:45.216 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-13T17:37:45.216 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/matrox_w1.ko 2024-09-13T17:37:45.216 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/w1-gpio.ko 2024-09-13T17:37:45.217 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/ 2024-09-13T17:37:45.217 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-13T17:37:45.217 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-13T17:37:45.217 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-13T17:37:45.217 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-13T17:37:45.217 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-13T17:37:45.217 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-13T17:37:45.217 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-13T17:37:45.217 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-13T17:37:45.217 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-13T17:37:45.217 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-13T17:37:45.217 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-13T17:37:45.217 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 127601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-13T17:37:45.217 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ 2024-09-13T17:37:45.218 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/acquirewdt.ko 2024-09-13T17:37:45.218 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/advantechwdt.ko 2024-09-13T17:37:45.218 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-13T17:37:45.218 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-13T17:37:45.218 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/cpu5wdt.ko 2024-09-13T17:37:45.218 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9052_wdt.ko 2024-09-13T17:37:45.218 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9055_wdt.ko 2024-09-13T17:37:45.218 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9063_wdt.ko 2024-09-13T17:37:45.218 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/dw_wdt.ko 2024-09-13T17:37:45.218 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/eurotechwdt.ko 2024-09-13T17:37:45.218 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-13T17:37:45.218 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-13T17:37:45.218 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-13T17:37:45.219 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-13T17:37:45.219 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-13T17:37:45.219 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-13T17:37:45.219 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-13T17:37:45.219 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-13T17:37:45.219 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-13T17:37:45.219 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-13T17:37:45.219 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/kempld_wdt.ko 2024-09-13T17:37:45.219 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-13T17:37:45.219 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/mena21_wdt.ko 2024-09-13T17:37:45.219 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-09-13T17:37:45.219 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-13T17:37:45.219 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-09-13T17:37:45.219 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pc87413_wdt.ko 2024-09-13T17:37:45.220 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-13T17:37:45.220 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-13T17:37:45.220 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/retu_wdt.ko 2024-09-13T17:37:45.220 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-09-13T17:37:45.220 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-09-13T17:37:45.220 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-13T17:37:45.220 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sc1200wdt.ko 2024-09-13T17:37:45.220 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-13T17:37:45.220 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-09-13T17:37:45.220 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-13T17:37:45.220 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-13T17:37:45.220 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/twl4030_wdt.ko 2024-09-13T17:37:45.220 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-13T17:37:45.221 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-13T17:37:45.221 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-13T17:37:45.221 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-13T17:37:45.221 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wafer5823wdt.ko 2024-09-13T17:37:45.221 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-13T17:37:45.221 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm831x_wdt.ko 2024-09-13T17:37:45.221 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm8350_wdt.ko 2024-09-13T17:37:45.221 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-13T17:37:45.221 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/ 2024-09-13T17:37:45.221 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-13T17:37:45.221 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-13T17:37:45.221 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-13T17:37:45.221 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/ 2024-09-13T17:37:45.221 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 214065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-13T17:37:45.222 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-13T17:37:45.222 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-scsiback.ko 2024-09-13T17:37:45.222 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/ 2024-09-13T17:37:45.222 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-13T17:37:45.222 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ 2024-09-13T17:37:45.222 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/ 2024-09-13T17:37:45.222 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 195161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-13T17:37:45.222 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/ 2024-09-13T17:37:45.222 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/adfs.ko 2024-09-13T17:37:45.222 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/ 2024-09-13T17:37:45.222 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 197849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-13T17:37:45.222 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/ 2024-09-13T17:37:45.222 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1259073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/kafs.ko 2024-09-13T17:37:45.222 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/ 2024-09-13T17:37:45.223 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 127665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/autofs4.ko 2024-09-13T17:37:45.223 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/ 2024-09-13T17:37:45.223 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 80561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-13T17:37:45.223 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/ 2024-09-13T17:37:45.223 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/bfs.ko 2024-09-13T17:37:45.223 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-13T17:37:45.223 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/ 2024-09-13T17:37:45.223 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 4575041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-13T17:37:45.223 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/ 2024-09-13T17:37:45.223 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 384329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-13T17:37:45.223 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ 2024-09-13T17:37:45.223 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1591681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-13T17:37:45.223 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/ 2024-09-13T17:37:45.223 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 130593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-13T17:37:45.224 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/ 2024-09-13T17:37:45.224 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 137313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/configfs.ko 2024-09-13T17:37:45.224 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/ 2024-09-13T17:37:45.224 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-13T17:37:45.224 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/ 2024-09-13T17:37:45.224 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 841817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-13T17:37:45.224 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/ 2024-09-13T17:37:45.224 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/efs.ko 2024-09-13T17:37:45.224 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/ 2024-09-13T17:37:45.224 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1901633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-13T17:37:45.224 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/ 2024-09-13T17:37:45.224 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-13T17:37:45.224 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/ 2024-09-13T17:37:45.224 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/freevxfs.ko 2024-09-13T17:37:45.225 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/ 2024-09-13T17:37:45.225 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-13T17:37:45.225 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/ 2024-09-13T17:37:45.225 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1488329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-13T17:37:45.225 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/ 2024-09-13T17:37:45.225 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 183553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-13T17:37:45.225 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/ 2024-09-13T17:37:45.225 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 282177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-13T17:37:45.225 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/ 2024-09-13T17:37:45.225 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 248625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/hpfs.ko 2024-09-13T17:37:45.225 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/ 2024-09-13T17:37:45.225 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 93513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-13T17:37:45.225 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/ 2024-09-13T17:37:45.226 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 529833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-13T17:37:45.226 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/ 2024-09-13T17:37:45.226 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 359969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-13T17:37:45.226 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/ 2024-09-13T17:37:45.226 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-13T17:37:45.226 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/ 2024-09-13T17:37:45.226 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 646793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-13T17:37:45.226 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/ 2024-09-13T17:37:45.226 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/ 2024-09-13T17:37:45.226 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 111585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-13T17:37:45.226 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/ 2024-09-13T17:37:45.226 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 74345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-13T17:37:45.226 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/ 2024-09-13T17:37:45.226 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 147553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-13T17:37:45.227 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1291361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-13T17:37:45.227 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 83001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv2.ko 2024-09-13T17:37:45.227 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 152537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-13T17:37:45.227 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 2526953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-13T17:37:45.227 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/ 2024-09-13T17:37:45.227 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-13T17:37:45.227 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-13T17:37:45.227 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/ 2024-09-13T17:37:45.227 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 2119673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-13T17:37:45.227 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/ 2024-09-13T17:37:45.227 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 734385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-13T17:37:45.227 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/ 2024-09-13T17:37:45.227 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-13T17:37:45.228 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-13T17:37:45.228 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-13T17:37:45.228 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-13T17:37:45.228 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-13T17:37:45.228 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-13T17:37:45.228 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-13T17:37:45.228 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-13T17:37:45.228 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-13T17:37:45.228 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-13T17:37:45.228 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-13T17:37:45.228 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ascii.ko 2024-09-13T17:37:45.228 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-13T17:37:45.228 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-13T17:37:45.229 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-13T17:37:45.229 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-13T17:37:45.229 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-13T17:37:45.229 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-13T17:37:45.229 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-13T17:37:45.229 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-13T17:37:45.229 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-13T17:37:45.229 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-13T17:37:45.229 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-13T17:37:45.229 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-13T17:37:45.229 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-13T17:37:45.229 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-13T17:37:45.229 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-13T17:37:45.229 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-13T17:37:45.230 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-13T17:37:45.230 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-13T17:37:45.230 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 95761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-13T17:37:45.230 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 144409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-13T17:37:45.230 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 167273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-13T17:37:45.230 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 119649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-13T17:37:45.230 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-13T17:37:45.230 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-13T17:37:45.230 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-13T17:37:45.230 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-13T17:37:45.230 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-13T17:37:45.230 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-13T17:37:45.230 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-13T17:37:45.230 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-13T17:37:45.231 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-13T17:37:45.231 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-13T17:37:45.231 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-13T17:37:45.231 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-13T17:37:45.231 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-13T17:37:45.231 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-13T17:37:45.231 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-13T17:37:45.231 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-13T17:37:45.231 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-13T17:37:45.231 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ 2024-09-13T17:37:45.231 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 632217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ntfs3.ko 2024-09-13T17:37:45.231 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ 2024-09-13T17:37:45.231 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ 2024-09-13T17:37:45.232 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 299761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-13T17:37:45.232 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ 2024-09-13T17:37:45.232 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 547233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-13T17:37:45.232 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ 2024-09-13T17:37:45.232 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-13T17:37:45.232 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 3255305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-13T17:37:45.232 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-13T17:37:45.232 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-13T17:37:45.232 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-13T17:37:45.232 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/ 2024-09-13T17:37:45.232 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/omfs.ko 2024-09-13T17:37:45.232 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/ 2024-09-13T17:37:45.232 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 468161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-13T17:37:45.233 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ 2024-09-13T17:37:45.233 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-13T17:37:45.233 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/ 2024-09-13T17:37:45.233 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/qnx4.ko 2024-09-13T17:37:45.233 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/ 2024-09-13T17:37:45.233 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/qnx6.ko 2024-09-13T17:37:45.233 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/ 2024-09-13T17:37:45.233 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_tree.ko 2024-09-13T17:37:45.233 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v1.ko 2024-09-13T17:37:45.233 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v2.ko 2024-09-13T17:37:45.233 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/ 2024-09-13T17:37:45.233 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 684489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-13T17:37:45.233 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/ 2024-09-13T17:37:45.233 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-13T17:37:45.234 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/ 2024-09-13T17:37:45.234 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/ 2024-09-13T17:37:45.234 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 3333977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-13T17:37:45.234 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/ 2024-09-13T17:37:45.234 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-13T17:37:45.234 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-13T17:37:45.234 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/ 2024-09-13T17:37:45.234 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 163081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-13T17:37:45.234 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/ 2024-09-13T17:37:45.234 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 116065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-13T17:37:45.234 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/ 2024-09-13T17:37:45.234 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 309513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-13T17:37:45.234 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ 2024-09-13T17:37:45.235 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 198129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-13T17:37:45.235 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/ 2024-09-13T17:37:45.235 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 5454809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-13T17:37:45.235 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/ 2024-09-13T17:37:45.235 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/ 2024-09-13T17:37:45.235 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 97945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/locktorture.ko 2024-09-13T17:37:45.235 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/ 2024-09-13T17:37:45.235 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/test_udelay.ko 2024-09-13T17:37:45.235 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-13T17:37:45.235 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ 2024-09-13T17:37:45.235 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-13T17:37:45.235 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 6793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc7.ko 2024-09-13T17:37:45.235 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-13T17:37:45.235 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/ 2024-09-13T17:37:45.236 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-13T17:37:45.236 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-13T17:37:45.236 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/interval_tree_test.ko 2024-09-13T17:37:45.236 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-13T17:37:45.236 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-13T17:37:45.236 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/ 2024-09-13T17:37:45.236 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-13T17:37:45.236 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-13T17:37:45.236 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/ 2024-09-13T17:37:45.236 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-13T17:37:45.236 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/memory-notifier-error-inject.ko 2024-09-13T17:37:45.236 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/notifier-error-inject.ko 2024-09-13T17:37:45.236 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/percpu_test.ko 2024-09-13T17:37:45.237 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/pm-notifier-error-inject.ko 2024-09-13T17:37:45.237 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/ 2024-09-13T17:37:45.237 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 151073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-13T17:37:45.237 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/rbtree_test.ko 2024-09-13T17:37:45.237 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/ 2024-09-13T17:37:45.237 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-13T17:37:45.237 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test-kstrtox.ko 2024-09-13T17:37:45.237 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 4912673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_bpf.ko 2024-09-13T17:37:45.237 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_firmware.ko 2024-09-13T17:37:45.237 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_module.ko 2024-09-13T17:37:45.237 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-13T17:37:45.237 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-13T17:37:45.237 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-13T17:37:45.237 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/ 2024-09-13T17:37:45.238 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/xz_dec_test.ko 2024-09-13T17:37:45.238 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/ 2024-09-13T17:37:45.238 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-13T17:37:45.238 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ 2024-09-13T17:37:45.238 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/ 2024-09-13T17:37:45.238 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-13T17:37:45.238 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-13T17:37:45.238 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-13T17:37:45.238 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-13T17:37:45.238 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-13T17:37:45.238 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-13T17:37:45.238 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-13T17:37:45.238 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-13T17:37:45.238 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/ 2024-09-13T17:37:45.239 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-13T17:37:45.239 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-13T17:37:45.239 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-13T17:37:45.239 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-13T17:37:45.239 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-13T17:37:45.239 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/ 2024-09-13T17:37:45.239 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 106841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-13T17:37:45.239 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/ 2024-09-13T17:37:45.239 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 234745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-13T17:37:45.239 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-13T17:37:45.239 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-13T17:37:45.239 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-13T17:37:45.239 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/ 2024-09-13T17:37:45.239 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 875441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-13T17:37:45.240 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/ 2024-09-13T17:37:45.240 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 88073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-13T17:37:45.240 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1026825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-13T17:37:45.240 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ 2024-09-13T17:37:45.240 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-13T17:37:45.240 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-13T17:37:45.240 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-13T17:37:45.240 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-13T17:37:45.240 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-13T17:37:45.240 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-13T17:37:45.240 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-13T17:37:45.240 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-13T17:37:45.240 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-13T17:37:45.240 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-13T17:37:45.241 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-13T17:37:45.241 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-13T17:37:45.241 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-13T17:37:45.241 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-13T17:37:45.241 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-13T17:37:45.241 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-13T17:37:45.241 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-13T17:37:45.241 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-13T17:37:45.241 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-13T17:37:45.241 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-13T17:37:45.241 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-13T17:37:45.241 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-13T17:37:45.241 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-13T17:37:45.242 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/ 2024-09-13T17:37:45.242 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1229873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-13T17:37:45.242 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/ 2024-09-13T17:37:45.242 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 154121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-13T17:37:45.242 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/ 2024-09-13T17:37:45.242 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 239393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-13T17:37:45.242 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-13T17:37:45.242 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-13T17:37:45.242 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 74433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-13T17:37:45.242 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/ 2024-09-13T17:37:45.242 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 498249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-13T17:37:45.242 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-13T17:37:45.242 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-13T17:37:45.242 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-13T17:37:45.243 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-13T17:37:45.243 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/ 2024-09-13T17:37:45.243 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 137945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/hsr.ko 2024-09-13T17:37:45.243 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ 2024-09-13T17:37:45.243 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ 2024-09-13T17:37:45.243 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-13T17:37:45.243 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 356385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-13T17:37:45.243 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-13T17:37:45.243 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ 2024-09-13T17:37:45.243 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-13T17:37:45.243 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-13T17:37:45.243 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-13T17:37:45.243 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-13T17:37:45.243 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 64777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-13T17:37:45.244 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 77777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-13T17:37:45.244 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-13T17:37:45.244 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-13T17:37:45.244 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-13T17:37:45.244 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-13T17:37:45.244 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ 2024-09-13T17:37:45.244 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-13T17:37:45.244 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-13T17:37:45.244 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-13T17:37:45.244 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ip_tables.ko 2024-09-13T17:37:45.244 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-13T17:37:45.244 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-09-13T17:37:45.244 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-13T17:37:45.245 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-13T17:37:45.245 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-13T17:37:45.245 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-09-13T17:37:45.245 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-13T17:37:45.245 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-13T17:37:45.245 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-13T17:37:45.245 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-13T17:37:45.245 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-13T17:37:45.245 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-13T17:37:45.245 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-13T17:37:45.245 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-13T17:37:45.245 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-13T17:37:45.245 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-09-13T17:37:45.245 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-13T17:37:45.246 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-13T17:37:45.246 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-13T17:37:45.246 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-13T17:37:45.246 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-13T17:37:45.246 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-13T17:37:45.246 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-13T17:37:45.246 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-13T17:37:45.246 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-13T17:37:45.246 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-13T17:37:45.246 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-13T17:37:45.246 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-13T17:37:45.246 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-13T17:37:45.246 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-13T17:37:45.247 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-13T17:37:45.247 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-13T17:37:45.247 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-13T17:37:45.247 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-13T17:37:45.247 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-13T17:37:45.247 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-13T17:37:45.247 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-13T17:37:45.247 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-13T17:37:45.247 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ 2024-09-13T17:37:45.247 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-13T17:37:45.247 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-13T17:37:45.247 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-13T17:37:45.247 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 102889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_gre.ko 2024-09-13T17:37:45.247 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 117649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-13T17:37:45.248 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-13T17:37:45.248 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-13T17:37:45.248 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-13T17:37:45.248 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/mip6.ko 2024-09-13T17:37:45.248 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ 2024-09-13T17:37:45.248 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-13T17:37:45.248 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-09-13T17:37:45.248 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-13T17:37:45.248 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-13T17:37:45.248 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-13T17:37:45.248 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-13T17:37:45.248 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-13T17:37:45.248 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-13T17:37:45.248 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-13T17:37:45.249 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-13T17:37:45.249 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-13T17:37:45.249 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-13T17:37:45.249 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-13T17:37:45.249 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-13T17:37:45.249 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-13T17:37:45.249 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-13T17:37:45.249 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-13T17:37:45.249 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-13T17:37:45.249 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-13T17:37:45.249 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-13T17:37:45.249 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-13T17:37:45.249 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-13T17:37:45.250 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-13T17:37:45.250 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-13T17:37:45.250 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-13T17:37:45.250 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 94433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-13T17:37:45.250 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-13T17:37:45.250 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-13T17:37:45.250 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/ 2024-09-13T17:37:45.250 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 106217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-13T17:37:45.250 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/ 2024-09-13T17:37:45.250 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 155593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-13T17:37:45.250 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-13T17:37:45.250 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-13T17:37:45.250 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-13T17:37:45.250 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-13T17:37:45.251 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-13T17:37:45.251 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-13T17:37:45.251 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/ 2024-09-13T17:37:45.251 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/lapb.ko 2024-09-13T17:37:45.251 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/ 2024-09-13T17:37:45.251 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-13T17:37:45.251 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 333641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc2.ko 2024-09-13T17:37:45.251 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/ 2024-09-13T17:37:45.251 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 388577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-13T17:37:45.251 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/ 2024-09-13T17:37:45.251 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-13T17:37:45.251 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ 2024-09-13T17:37:45.251 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ 2024-09-13T17:37:45.251 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 144881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-13T17:37:45.252 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-13T17:37:45.252 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-13T17:37:45.252 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-13T17:37:45.252 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 124137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-13T17:37:45.252 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 124449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-13T17:37:45.252 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 126777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-13T17:37:45.252 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 126577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-13T17:37:45.252 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 137937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-13T17:37:45.252 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 72457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-13T17:37:45.252 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 133785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-13T17:37:45.252 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 139177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-13T17:37:45.252 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 138369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-13T17:37:45.252 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 136281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-13T17:37:45.253 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 140001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-13T17:37:45.253 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-13T17:37:45.253 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ 2024-09-13T17:37:45.253 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 532393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-13T17:37:45.253 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-13T17:37:45.253 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-13T17:37:45.253 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-13T17:37:45.253 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-13T17:37:45.253 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-13T17:37:45.253 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-13T17:37:45.253 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-13T17:37:45.253 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-13T17:37:45.253 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-13T17:37:45.253 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-13T17:37:45.254 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-13T17:37:45.254 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-13T17:37:45.254 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-13T17:37:45.254 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-13T17:37:45.254 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 485769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-13T17:37:45.254 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-13T17:37:45.254 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-13T17:37:45.254 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-13T17:37:45.254 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 134177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-13T17:37:45.254 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-13T17:37:45.254 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-13T17:37:45.254 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 140921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-13T17:37:45.254 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-13T17:37:45.254 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-13T17:37:45.255 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 79081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-13T17:37:45.255 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-13T17:37:45.255 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-13T17:37:45.255 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-13T17:37:45.255 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 119745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-13T17:37:45.255 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-13T17:37:45.255 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-13T17:37:45.255 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 115817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-13T17:37:45.255 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-13T17:37:45.255 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-13T17:37:45.255 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-13T17:37:45.255 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-13T17:37:45.255 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-13T17:37:45.256 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-13T17:37:45.256 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 813705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-13T17:37:45.256 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-13T17:37:45.256 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-13T17:37:45.256 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-09-13T17:37:45.256 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-13T17:37:45.256 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-13T17:37:45.256 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-13T17:37:45.256 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-13T17:37:45.256 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-13T17:37:45.256 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-13T17:37:45.256 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-13T17:37:45.256 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-13T17:37:45.257 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-13T17:37:45.257 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-13T17:37:45.257 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-13T17:37:45.257 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-13T17:37:45.257 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-13T17:37:45.257 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-13T17:37:45.257 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-13T17:37:45.257 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_osf.ko 2024-09-13T17:37:45.257 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-13T17:37:45.257 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-13T17:37:45.257 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-13T17:37:45.257 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-13T17:37:45.257 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-13T17:37:45.257 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_synproxy.ko 2024-09-13T17:37:45.258 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tproxy.ko 2024-09-13T17:37:45.258 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 104257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/x_tables.ko 2024-09-13T17:37:45.258 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-13T17:37:45.258 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-13T17:37:45.258 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-13T17:37:45.258 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-13T17:37:45.258 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-13T17:37:45.258 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-13T17:37:45.258 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-13T17:37:45.258 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-13T17:37:45.258 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-13T17:37:45.258 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-13T17:37:45.258 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-13T17:37:45.258 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-13T17:37:45.259 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-13T17:37:45.259 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-13T17:37:45.259 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-13T17:37:45.259 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-13T17:37:45.259 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-13T17:37:45.259 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-13T17:37:45.259 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-13T17:37:45.259 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-13T17:37:45.259 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-13T17:37:45.259 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-13T17:37:45.259 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-13T17:37:45.259 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-13T17:37:45.259 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-13T17:37:45.260 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-13T17:37:45.260 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-13T17:37:45.260 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-13T17:37:45.260 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-13T17:37:45.260 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-13T17:37:45.260 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-13T17:37:45.260 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-13T17:37:45.260 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-13T17:37:45.260 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-13T17:37:45.260 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-13T17:37:45.260 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-13T17:37:45.260 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-13T17:37:45.260 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-13T17:37:45.260 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-13T17:37:45.261 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-13T17:37:45.261 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-13T17:37:45.261 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-13T17:37:45.261 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-13T17:37:45.261 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-13T17:37:45.261 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-13T17:37:45.261 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-13T17:37:45.261 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-13T17:37:45.261 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-13T17:37:45.261 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-13T17:37:45.261 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-13T17:37:45.261 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-13T17:37:45.261 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-13T17:37:45.262 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-13T17:37:45.262 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-13T17:37:45.262 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-13T17:37:45.262 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-13T17:37:45.262 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-13T17:37:45.262 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-13T17:37:45.262 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-13T17:37:45.262 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-13T17:37:45.262 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-13T17:37:45.262 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-13T17:37:45.262 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-13T17:37:45.262 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-13T17:37:45.262 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-13T17:37:45.263 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-13T17:37:45.263 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-13T17:37:45.263 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-13T17:37:45.263 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-13T17:37:45.263 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpudp.ko 2024-09-13T17:37:45.263 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-13T17:37:45.263 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-13T17:37:45.263 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/ 2024-09-13T17:37:45.263 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-13T17:37:45.263 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/ 2024-09-13T17:37:45.263 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-13T17:37:45.263 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/ 2024-09-13T17:37:45.263 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 485961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-13T17:37:45.263 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-13T17:37:45.264 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-13T17:37:45.264 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-13T17:37:45.264 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/ 2024-09-13T17:37:45.264 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-13T17:37:45.264 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/ 2024-09-13T17:37:45.264 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 141545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/phonet.ko 2024-09-13T17:37:45.264 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/pn_pep.ko 2024-09-13T17:37:45.264 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/ 2024-09-13T17:37:45.264 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 314473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-13T17:37:45.264 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 202161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-13T17:37:45.264 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-13T17:37:45.264 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/ 2024-09-13T17:37:45.264 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1024009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/rxrpc.ko 2024-09-13T17:37:45.265 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/ 2024-09-13T17:37:45.265 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-13T17:37:45.265 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-13T17:37:45.265 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-13T17:37:45.265 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-13T17:37:45.265 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-13T17:37:45.265 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-13T17:37:45.265 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-13T17:37:45.265 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-13T17:37:45.265 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-13T17:37:45.265 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-13T17:37:45.265 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-13T17:37:45.265 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_cgroup.ko 2024-09-13T17:37:45.265 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-13T17:37:45.266 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-13T17:37:45.266 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-13T17:37:45.266 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 79257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-13T17:37:45.266 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-13T17:37:45.266 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-13T17:37:45.266 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-13T17:37:45.266 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-13T17:37:45.266 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-13T17:37:45.266 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-13T17:37:45.266 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-13T17:37:45.266 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-13T17:37:45.266 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-13T17:37:45.266 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-13T17:37:45.267 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq_codel.ko 2024-09-13T17:37:45.267 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-13T17:37:45.267 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-13T17:37:45.267 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-13T17:37:45.267 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 81065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-13T17:37:45.267 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-13T17:37:45.267 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-13T17:37:45.267 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-13T17:37:45.267 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-13T17:37:45.267 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-13T17:37:45.267 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-13T17:37:45.267 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-13T17:37:45.267 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-13T17:37:45.267 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-13T17:37:45.268 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-13T17:37:45.268 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-13T17:37:45.268 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-13T17:37:45.268 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-13T17:37:45.268 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-13T17:37:45.268 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/ 2024-09-13T17:37:45.268 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1184689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-13T17:37:45.268 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-13T17:37:45.268 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/ 2024-09-13T17:37:45.268 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/ 2024-09-13T17:37:45.268 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 426969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-13T17:37:45.268 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-13T17:37:45.268 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1895553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-13T17:37:45.269 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/ 2024-09-13T17:37:45.269 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 925089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-13T17:37:45.269 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/ 2024-09-13T17:37:45.269 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1122601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-13T17:37:45.269 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-13T17:37:45.269 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/ 2024-09-13T17:37:45.269 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-13T17:37:45.269 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/ 2024-09-13T17:37:45.269 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 101161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-13T17:37:45.269 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 90369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-13T17:37:45.269 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 120625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-13T17:37:45.269 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-13T17:37:45.269 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-13T17:37:45.270 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/ 2024-09-13T17:37:45.270 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 165529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/x25.ko 2024-09-13T17:37:45.270 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/ 2024-09-13T17:37:45.270 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_algo.ko 2024-09-13T17:37:45.270 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-13T17:37:45.270 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 135873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_user.ko 2024-09-13T17:37:45.270 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 649700 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-13T17:37:45.270 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 633853 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-13T17:37:45.270 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7850 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-13T17:37:45.270 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23959 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-13T17:37:45.270 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10056 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-13T17:37:45.270 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 74053 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-13T17:37:45.270 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 147543 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-13T17:37:45.270 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 233297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-13T17:37:45.271 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 210 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-13T17:37:45.271 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 72756 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-13T17:37:45.271 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 879 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-13T17:37:45.271 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 261535 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-13T17:37:45.271 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 316586 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-13T17:37:45.271 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/ 2024-09-13T17:37:45.271 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/ 2024-09-13T17:37:45.271 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/ 2024-09-13T17:37:45.271 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T17:37:45.271 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 176 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/changelog.Debian.gz 2024-09-13T17:37:45.271 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 691 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/copyright 2024-09-13T17:37:45.276 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:37:45.276 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:37:45.276 DEBUG:teuthology.orchestra.run.smithi114:> egrep '(submenu|menuentry.*6.11.0-rc5-g2ca44a2f35ca).*{' /boot/grub/grub.cfg 2024-09-13T17:37:45.278 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi134.front.sepia.ceph.com to complete... 2024-09-13T17:37:45.283 INFO:teuthology.orchestra.run.smithi114.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-13T17:37:45.283 INFO:teuthology.orchestra.run.smithi114.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-13T17:37:45.283 INFO:teuthology.orchestra.run.smithi114.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-13T17:37:45.284 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-09-13T17:37:45.284 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:37:45.284 DEBUG:teuthology.orchestra.run.smithi114:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-09-13T17:37:45.328 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi114.front.sepia.ceph.com to complete... 2024-09-13T17:37:45.667 INFO:teuthology.orchestra.run.smithi134.stderr:Sourcing file `/etc/default/grub' 2024-09-13T17:37:45.668 INFO:teuthology.orchestra.run.smithi134.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T17:37:45.694 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2024-09-13T17:37:45.723 INFO:teuthology.orchestra.run.smithi114.stderr:Sourcing file `/etc/default/grub' 2024-09-13T17:37:45.724 INFO:teuthology.orchestra.run.smithi114.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T17:37:45.730 INFO:teuthology.orchestra.run.smithi114.stderr:Generating grub configuration file ... 2024-09-13T17:37:45.895 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:37:45.902 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:37:45.913 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:37:45.918 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:37:46.154 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T17:37:46.159 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T17:37:46.182 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T17:37:46.187 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T17:37:46.198 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T17:37:46.204 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T17:37:46.231 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T17:37:46.236 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T17:37:46.337 INFO:teuthology.orchestra.run.smithi114.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T17:37:46.337 INFO:teuthology.orchestra.run.smithi114.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T17:37:46.337 INFO:teuthology.orchestra.run.smithi114.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T17:37:46.347 INFO:teuthology.orchestra.run.smithi114.stderr:done 2024-09-13T17:37:46.358 INFO:teuthology.orchestra.run.smithi134.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T17:37:46.358 INFO:teuthology.orchestra.run.smithi134.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T17:37:46.358 INFO:teuthology.orchestra.run.smithi134.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T17:37:46.373 INFO:teuthology.orchestra.run.smithi134.stderr:done 2024-09-13T17:37:47.483 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-09-13T17:38:17.513 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-13T17:38:17.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-13T17:38:17.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:38:17.525 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-13T17:38:17.525 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-13T17:38:17.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:38:35.965 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-09-13T17:38:35.966 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-09-13T17:38:44.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-13T17:38:44.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:38:44.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-13T17:38:44.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:38:48.061 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-09-13T17:38:48.061 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-09-13T17:39:00.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-13T17:39:00.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:39:00.083 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-13T17:39:00.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:39:18.461 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-09-13T17:39:31.522 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-09-13T17:39:33.464 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-13T17:39:33.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:39:33.808 DEBUG:teuthology.orchestra.run.smithi114:> true 2024-09-13T17:39:34.583 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-13T17:39:34.583 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-13T17:39:34.584 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2024-09-13T17:39:34.633 INFO:teuthology.orchestra.run.smithi114.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:39:34.633 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:39:34.633 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T17:39:34.633 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T17:39:35.636 DEBUG:teuthology.parallel:result is None 2024-09-13T17:39:46.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-13T17:39:46.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:39:46.820 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-09-13T17:39:47.434 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-13T17:39:47.435 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-13T17:39:47.435 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-09-13T17:39:47.486 INFO:teuthology.orchestra.run.smithi134.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:39:47.486 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:39:47.486 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T17:39:47.486 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T17:39:48.489 DEBUG:teuthology.parallel:result is None 2024-09-13T17:39:48.489 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T17:39:48.499 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T17:39:48.499 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T17:39:48.504 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T17:39:48.513 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T17:39:48.519 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T17:39:48.527 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T17:39:48.527 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T17:39:48.556 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T17:39:48.808 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T17:39:48.815 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T17:39:48.815 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T17:39:48.819 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T17:39:48.894 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:39:48.915 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:39:48.917 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:39:48.937 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:39:48.940 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T17:39:48.947 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T17:39:48.947 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T17:39:48.950 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T17:39:48.972 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T17:39:48.981 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T17:39:48.981 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T17:39:49.013 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T17:39:49.025 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T17:39:49.069 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T17:39:49.125 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:39:49.125 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T17:39:49.193 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T17:39:49.202 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T17:39:49.252 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:39:49.253 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T17:39:49.329 DEBUG:teuthology.orchestra.run.smithi114:> sudo service rsyslog restart 2024-09-13T17:39:49.332 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-09-13T17:39:49.450 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T17:39:49.457 INFO:teuthology.task.internal:Starting timer... 2024-09-13T17:39:49.458 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T17:39:49.468 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T17:39:49.477 DEBUG:teuthology.task.selinux:Excluding smithi114: OS 'ubuntu' does not support SELinux 2024-09-13T17:39:49.477 DEBUG:teuthology.task.selinux:Excluding smithi134: OS 'ubuntu' does not support SELinux 2024-09-13T17:39:49.477 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T17:39:49.477 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-13T17:39:49.477 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T17:39:49.478 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T17:39:49.485 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T17:39:49.501 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T17:39:49.502 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi114.front.sepia.ceph.com,smithi134.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T17:48:02.633 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi114.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com')] 2024-09-13T17:48:02.634 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-13T17:48:02.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:48:02.725 DEBUG:teuthology.orchestra.run.smithi114:> true 2024-09-13T17:48:02.867 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-13T17:48:02.868 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-13T17:48:02.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:48:02.971 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-09-13T17:48:03.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-13T17:48:03.100 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T17:48:03.111 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T17:48:03.111 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T17:48:03.112 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:48:03.115 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T17:48:03.115 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:48:03.151 INFO:teuthology.orchestra.run.smithi114.stdout:13 Sep 17:48:03 ntpd[18472]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-13T17:48:03.151 INFO:teuthology.orchestra.run.smithi114.stdout:13 Sep 17:48:03 ntpd[18472]: Command line: ntpd -gq 2024-09-13T17:48:03.151 INFO:teuthology.orchestra.run.smithi114.stdout:13 Sep 17:48:03 ntpd[18472]: ---------------------------------------------------- 2024-09-13T17:48:03.151 INFO:teuthology.orchestra.run.smithi114.stdout:13 Sep 17:48:03 ntpd[18472]: ntp-4 is maintained by Network Time Foundation, 2024-09-13T17:48:03.151 INFO:teuthology.orchestra.run.smithi114.stdout:13 Sep 17:48:03 ntpd[18472]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-13T17:48:03.151 INFO:teuthology.orchestra.run.smithi114.stdout:13 Sep 17:48:03 ntpd[18472]: corporation. Support and training for ntp-4 are 2024-09-13T17:48:03.151 INFO:teuthology.orchestra.run.smithi114.stdout:13 Sep 17:48:03 ntpd[18472]: available at https://www.nwtime.org/support 2024-09-13T17:48:03.151 INFO:teuthology.orchestra.run.smithi114.stdout:13 Sep 17:48:03 ntpd[18472]: ---------------------------------------------------- 2024-09-13T17:48:03.152 INFO:teuthology.orchestra.run.smithi114.stdout:13 Sep 17:48:03 ntpd[18472]: proto: precision = 0.042 usec (-24) 2024-09-13T17:48:03.152 INFO:teuthology.orchestra.run.smithi114.stdout:13 Sep 17:48:03 ntpd[18472]: basedate set to 2022-02-04 2024-09-13T17:48:03.152 INFO:teuthology.orchestra.run.smithi114.stdout:13 Sep 17:48:03 ntpd[18472]: gps base set to 2022-02-06 (week 2196) 2024-09-13T17:48:03.152 INFO:teuthology.orchestra.run.smithi114.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T17:48:03.153 INFO:teuthology.orchestra.run.smithi114.stdout:13 Sep 17:48:03 ntpd[18472]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T17:48:03.153 INFO:teuthology.orchestra.run.smithi114.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T17:48:03.153 INFO:teuthology.orchestra.run.smithi114.stdout:13 Sep 17:48:03 ntpd[18472]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T17:48:03.154 INFO:teuthology.orchestra.run.smithi114.stdout:13 Sep 17:48:03 ntpd[18472]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T17:48:03.154 INFO:teuthology.orchestra.run.smithi114.stdout:13 Sep 17:48:03 ntpd[18472]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T17:48:03.154 INFO:teuthology.orchestra.run.smithi114.stdout:13 Sep 17:48:03 ntpd[18472]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T17:48:03.154 INFO:teuthology.orchestra.run.smithi114.stdout:13 Sep 17:48:03 ntpd[18472]: Listen normally on 3 enp3s0f1 172.21.15.114:123 2024-09-13T17:48:03.155 INFO:teuthology.orchestra.run.smithi114.stdout:13 Sep 17:48:03 ntpd[18472]: Listen normally on 4 lo [::1]:123 2024-09-13T17:48:03.155 INFO:teuthology.orchestra.run.smithi114.stdout:13 Sep 17:48:03 ntpd[18472]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cb63%5]:123 2024-09-13T17:48:03.155 INFO:teuthology.orchestra.run.smithi114.stdout:13 Sep 17:48:03 ntpd[18472]: Listening on routing socket on fd #22 for interface updates 2024-09-13T17:48:03.179 INFO:teuthology.orchestra.run.smithi134.stdout:13 Sep 17:48:03 ntpd[18479]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-13T17:48:03.179 INFO:teuthology.orchestra.run.smithi134.stdout:13 Sep 17:48:03 ntpd[18479]: Command line: ntpd -gq 2024-09-13T17:48:03.179 INFO:teuthology.orchestra.run.smithi134.stdout:13 Sep 17:48:03 ntpd[18479]: ---------------------------------------------------- 2024-09-13T17:48:03.179 INFO:teuthology.orchestra.run.smithi134.stdout:13 Sep 17:48:03 ntpd[18479]: ntp-4 is maintained by Network Time Foundation, 2024-09-13T17:48:03.179 INFO:teuthology.orchestra.run.smithi134.stdout:13 Sep 17:48:03 ntpd[18479]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-13T17:48:03.179 INFO:teuthology.orchestra.run.smithi134.stdout:13 Sep 17:48:03 ntpd[18479]: corporation. Support and training for ntp-4 are 2024-09-13T17:48:03.179 INFO:teuthology.orchestra.run.smithi134.stdout:13 Sep 17:48:03 ntpd[18479]: available at https://www.nwtime.org/support 2024-09-13T17:48:03.179 INFO:teuthology.orchestra.run.smithi134.stdout:13 Sep 17:48:03 ntpd[18479]: ---------------------------------------------------- 2024-09-13T17:48:03.180 INFO:teuthology.orchestra.run.smithi134.stdout:13 Sep 17:48:03 ntpd[18479]: proto: precision = 0.042 usec (-24) 2024-09-13T17:48:03.180 INFO:teuthology.orchestra.run.smithi134.stdout:13 Sep 17:48:03 ntpd[18479]: basedate set to 2022-02-04 2024-09-13T17:48:03.180 INFO:teuthology.orchestra.run.smithi134.stdout:13 Sep 17:48:03 ntpd[18479]: gps base set to 2022-02-06 (week 2196) 2024-09-13T17:48:03.180 INFO:teuthology.orchestra.run.smithi134.stdout:13 Sep 17:48:03 ntpd[18479]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T17:48:03.180 INFO:teuthology.orchestra.run.smithi134.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T17:48:03.181 INFO:teuthology.orchestra.run.smithi134.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T17:48:03.181 INFO:teuthology.orchestra.run.smithi134.stdout:13 Sep 17:48:03 ntpd[18479]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T17:48:03.182 INFO:teuthology.orchestra.run.smithi134.stdout:13 Sep 17:48:03 ntpd[18479]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T17:48:03.182 INFO:teuthology.orchestra.run.smithi134.stdout:13 Sep 17:48:03 ntpd[18479]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T17:48:03.182 INFO:teuthology.orchestra.run.smithi134.stdout:13 Sep 17:48:03 ntpd[18479]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T17:48:03.182 INFO:teuthology.orchestra.run.smithi134.stdout:13 Sep 17:48:03 ntpd[18479]: Listen normally on 3 enp3s0f1 172.21.15.134:123 2024-09-13T17:48:03.182 INFO:teuthology.orchestra.run.smithi134.stdout:13 Sep 17:48:03 ntpd[18479]: Listen normally on 4 lo [::1]:123 2024-09-13T17:48:03.182 INFO:teuthology.orchestra.run.smithi134.stdout:13 Sep 17:48:03 ntpd[18479]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6de9%5]:123 2024-09-13T17:48:03.182 INFO:teuthology.orchestra.run.smithi134.stdout:13 Sep 17:48:03 ntpd[18479]: Listening on routing socket on fd #22 for interface updates 2024-09-13T17:48:04.152 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:04 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:04.152 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:04 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:04.152 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:04 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:04.152 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:04 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:04.152 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:04 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:04.152 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:04 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:04.152 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:04 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:48:04.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:04 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:48:04.179 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:04 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:04.179 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:04 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:04.180 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:04 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:04.180 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:04 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:04.180 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:04 ntpd[18479]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:48:04.180 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:04 ntpd[18479]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:48:05.179 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:05 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:05.179 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:05 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:06.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:06 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:06.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:06 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:06.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:06 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:06.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:06 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:06.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:06 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:06.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:06 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:06.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:06 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:06.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:06 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:06.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:06 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:48:06.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:06 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:48:06.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:06 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:06.154 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:06 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:06.154 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:06 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:48:06.154 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:06 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:48:06.154 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:06 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:06.154 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:06 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:06.154 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:06 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:48:06.154 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:06 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:48:06.179 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:06 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:06.180 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:06 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:06.180 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:06 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:06.180 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:06 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:06.180 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:06 ntpd[18479]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:48:06.180 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:06 ntpd[18479]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:48:08.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:08 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:08.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:08 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:08.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:08 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:08.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:08 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:08.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:08 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:08.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:08 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:08.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:08 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:08.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:08 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:08.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:08 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:48:08.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:08 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:48:08.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:08 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:08.154 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:08 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:08.154 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:08 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:48:08.154 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:08 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:48:08.154 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:08 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:08.154 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:08 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:08.154 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:08 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:48:08.154 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:08 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:48:08.180 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:08 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:08.181 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:08 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:08.181 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:08 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:08.181 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:08 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:08.181 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:08 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:08.181 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:08 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:08.181 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:08 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:08.181 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:08 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:08.181 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:08 ntpd[18479]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:48:08.181 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:08 ntpd[18479]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:48:08.181 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:08 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:08.181 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:08 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:08.182 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:08 ntpd[18479]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:48:08.182 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:08 ntpd[18479]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:48:08.182 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:08 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:08.182 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:08 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:08.182 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:08 ntpd[18479]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:48:08.182 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:08 ntpd[18479]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:48:10.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:10 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:10.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:10 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:10.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:10 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:10.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:10 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:10.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:10 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:10.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:10 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:10.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:10 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:10.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:10 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:10.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:10 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:48:10.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:10 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:48:10.153 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:10 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:10.154 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:10 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:10.154 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:10 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:48:10.154 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:10 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:48:10.154 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:10 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:10.154 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:10 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:10.154 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:10 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:48:10.154 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:10 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:48:10.154 INFO:teuthology.orchestra.run.smithi114.stdout:13 Sep 17:48:10 ntpd[18472]: ntpd: time slew -0.000868 s 2024-09-13T17:48:10.154 INFO:teuthology.orchestra.run.smithi114.stdout:ntpd: time slew -0.000868s 2024-09-13T17:48:10.155 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:10 ntpd[18472]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T17:48:10.155 INFO:teuthology.orchestra.run.smithi114.stderr:13 Sep 17:48:10 ntpd[18472]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T17:48:10.180 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:10 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:10.181 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:10 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:10.181 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:10 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:10.181 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:10 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:10.181 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:10 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:10.181 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:10 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:10.181 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:10 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:10.181 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:10 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:10.181 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:10 ntpd[18479]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:48:10.181 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:10 ntpd[18479]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:48:10.181 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:10 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:10.181 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:10 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:10.181 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:10 ntpd[18479]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:48:10.181 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:10 ntpd[18479]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:48:10.182 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:10 ntpd[18479]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T17:48:10.182 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:10 ntpd[18479]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T17:48:10.182 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:10 ntpd[18479]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T17:48:10.182 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:10 ntpd[18479]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T17:48:10.182 INFO:teuthology.orchestra.run.smithi134.stdout:13 Sep 17:48:10 ntpd[18479]: ntpd: time slew -0.000482 s 2024-09-13T17:48:10.182 INFO:teuthology.orchestra.run.smithi134.stdout:ntpd: time slew -0.000482s 2024-09-13T17:48:10.183 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:10 ntpd[18479]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T17:48:10.183 INFO:teuthology.orchestra.run.smithi134.stderr:13 Sep 17:48:10 ntpd[18479]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T17:48:10.244 INFO:teuthology.orchestra.run.smithi114.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T17:48:10.244 INFO:teuthology.orchestra.run.smithi114.stdout:============================================================================== 2024-09-13T17:48:10.244 INFO:teuthology.orchestra.run.smithi114.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T17:48:10.244 INFO:teuthology.orchestra.run.smithi114.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T17:48:10.244 INFO:teuthology.orchestra.run.smithi114.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T17:48:10.244 INFO:teuthology.orchestra.run.smithi114.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T17:48:10.288 INFO:teuthology.orchestra.run.smithi134.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T17:48:10.289 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================== 2024-09-13T17:48:10.289 INFO:teuthology.orchestra.run.smithi134.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T17:48:10.289 INFO:teuthology.orchestra.run.smithi134.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T17:48:10.289 INFO:teuthology.orchestra.run.smithi134.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T17:48:10.289 INFO:teuthology.orchestra.run.smithi134.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T17:48:10.290 INFO:teuthology.run_tasks:Running task install... 2024-09-13T17:48:10.297 DEBUG:teuthology.task.install:project ceph 2024-09-13T17:48:10.298 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}} 2024-09-13T17:48:10.298 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'} 2024-09-13T17:48:10.298 INFO:teuthology.task.install:Using flavor: default 2024-09-13T17:48:10.306 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T17:48:10.306 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-09-13T17:48:10.307 DEBUG:teuthology.orchestra.run.smithi114:> sudo apt-key list | grep Ceph 2024-09-13T17:48:10.307 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-key list | grep Ceph 2024-09-13T17:48:10.408 INFO:teuthology.orchestra.run.smithi114.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-13T17:48:10.438 INFO:teuthology.orchestra.run.smithi134.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-13T17:48:10.459 INFO:teuthology.orchestra.run.smithi114.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T17:48:10.459 INFO:teuthology.orchestra.run.smithi114.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T17:48:10.460 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-13T17:48:10.460 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-13T17:48:10.461 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:48:10.488 INFO:teuthology.orchestra.run.smithi134.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T17:48:10.488 INFO:teuthology.orchestra.run.smithi134.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T17:48:10.489 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-13T17:48:10.489 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-13T17:48:10.490 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:48:10.624 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default/ 2024-09-13T17:48:10.624 INFO:teuthology.task.install.deb:Package version is 18.2.4-860-g6c6b083f-1jammy 2024-09-13T17:48:10.640 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default/ 2024-09-13T17:48:10.640 INFO:teuthology.task.install.deb:Package version is 18.2.4-860-g6c6b083f-1jammy 2024-09-13T17:48:10.743 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:48:10.743 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T17:48:10.755 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:48:10.755 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T17:48:10.762 DEBUG:teuthology.orchestra.run.smithi114:> sudo apt-get update 2024-09-13T17:48:10.774 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get update 2024-09-13T17:48:10.944 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T17:48:10.944 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T17:48:10.953 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T17:48:10.958 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T17:48:10.971 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T17:48:10.996 INFO:teuthology.orchestra.run.smithi114.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy InRelease 2024-09-13T17:48:11.006 INFO:teuthology.orchestra.run.smithi134.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy InRelease 2024-09-13T17:48:11.017 INFO:teuthology.orchestra.run.smithi114.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-13T17:48:11.027 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-13T17:48:11.040 INFO:teuthology.orchestra.run.smithi114.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-13T17:48:11.049 INFO:teuthology.orchestra.run.smithi134.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-13T17:48:11.061 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-09-13T17:48:11.070 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,428 B] 2024-09-13T17:48:11.083 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T17:48:11.098 INFO:teuthology.orchestra.run.smithi114.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,428 B] 2024-09-13T17:48:11.104 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-09-13T17:48:11.156 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T17:48:11.237 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T17:48:11.544 INFO:teuthology.orchestra.run.smithi114.stdout:Fetched 28.8 kB in 1s (51.8 kB/s) 2024-09-13T17:48:11.562 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 28.8 kB in 1s (51.4 kB/s) 2024-09-13T17:48:12.577 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2024-09-13T17:48:12.592 DEBUG:teuthology.orchestra.run.smithi114:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-860-g6c6b083f-1jammy cephadm=18.2.4-860-g6c6b083f-1jammy ceph-mds=18.2.4-860-g6c6b083f-1jammy ceph-mgr=18.2.4-860-g6c6b083f-1jammy ceph-common=18.2.4-860-g6c6b083f-1jammy ceph-fuse=18.2.4-860-g6c6b083f-1jammy ceph-test=18.2.4-860-g6c6b083f-1jammy ceph-volume=18.2.4-860-g6c6b083f-1jammy radosgw=18.2.4-860-g6c6b083f-1jammy python3-rados=18.2.4-860-g6c6b083f-1jammy python3-rgw=18.2.4-860-g6c6b083f-1jammy python3-cephfs=18.2.4-860-g6c6b083f-1jammy python3-rbd=18.2.4-860-g6c6b083f-1jammy libcephfs2=18.2.4-860-g6c6b083f-1jammy libcephfs-dev=18.2.4-860-g6c6b083f-1jammy librados2=18.2.4-860-g6c6b083f-1jammy librbd1=18.2.4-860-g6c6b083f-1jammy rbd-fuse=18.2.4-860-g6c6b083f-1jammy python3-cephfs=18.2.4-860-g6c6b083f-1jammy cephfs-shell=18.2.4-860-g6c6b083f-1jammy cephfs-top=18.2.4-860-g6c6b083f-1jammy cephfs-mirror=18.2.4-860-g6c6b083f-1jammy 2024-09-13T17:48:12.604 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-09-13T17:48:12.619 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-860-g6c6b083f-1jammy cephadm=18.2.4-860-g6c6b083f-1jammy ceph-mds=18.2.4-860-g6c6b083f-1jammy ceph-mgr=18.2.4-860-g6c6b083f-1jammy ceph-common=18.2.4-860-g6c6b083f-1jammy ceph-fuse=18.2.4-860-g6c6b083f-1jammy ceph-test=18.2.4-860-g6c6b083f-1jammy ceph-volume=18.2.4-860-g6c6b083f-1jammy radosgw=18.2.4-860-g6c6b083f-1jammy python3-rados=18.2.4-860-g6c6b083f-1jammy python3-rgw=18.2.4-860-g6c6b083f-1jammy python3-cephfs=18.2.4-860-g6c6b083f-1jammy python3-rbd=18.2.4-860-g6c6b083f-1jammy libcephfs2=18.2.4-860-g6c6b083f-1jammy libcephfs-dev=18.2.4-860-g6c6b083f-1jammy librados2=18.2.4-860-g6c6b083f-1jammy librbd1=18.2.4-860-g6c6b083f-1jammy rbd-fuse=18.2.4-860-g6c6b083f-1jammy python3-cephfs=18.2.4-860-g6c6b083f-1jammy cephfs-shell=18.2.4-860-g6c6b083f-1jammy cephfs-top=18.2.4-860-g6c6b083f-1jammy cephfs-mirror=18.2.4-860-g6c6b083f-1jammy 2024-09-13T17:48:12.669 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2024-09-13T17:48:12.696 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-09-13T17:48:12.852 INFO:teuthology.orchestra.run.smithi114.stdout:Building dependency tree... 2024-09-13T17:48:12.853 INFO:teuthology.orchestra.run.smithi114.stdout:Reading state information... 2024-09-13T17:48:12.887 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2024-09-13T17:48:12.888 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2024-09-13T17:48:13.040 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T17:48:13.040 INFO:teuthology.orchestra.run.smithi114.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T17:48:13.040 INFO:teuthology.orchestra.run.smithi114.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T17:48:13.040 INFO:teuthology.orchestra.run.smithi114.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T17:48:13.041 INFO:teuthology.orchestra.run.smithi114.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T17:48:13.041 INFO:teuthology.orchestra.run.smithi114.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T17:48:13.041 INFO:teuthology.orchestra.run.smithi114.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T17:48:13.041 INFO:teuthology.orchestra.run.smithi114.stdout:The following additional packages will be installed: 2024-09-13T17:48:13.041 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T17:48:13.042 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-13T17:48:13.042 INFO:teuthology.orchestra.run.smithi114.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-13T17:48:13.042 INFO:teuthology.orchestra.run.smithi114.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-13T17:48:13.043 INFO:teuthology.orchestra.run.smithi114.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-09-13T17:48:13.043 INFO:teuthology.orchestra.run.smithi114.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-13T17:48:13.043 INFO:teuthology.orchestra.run.smithi114.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-13T17:48:13.043 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-13T17:48:13.043 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-13T17:48:13.044 INFO:teuthology.orchestra.run.smithi114.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-13T17:48:13.044 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-13T17:48:13.044 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-13T17:48:13.044 INFO:teuthology.orchestra.run.smithi114.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-13T17:48:13.044 INFO:teuthology.orchestra.run.smithi114.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-13T17:48:13.044 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-13T17:48:13.044 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-13T17:48:13.044 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-13T17:48:13.044 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-13T17:48:13.044 INFO:teuthology.orchestra.run.smithi114.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-13T17:48:13.044 INFO:teuthology.orchestra.run.smithi114.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-13T17:48:13.044 INFO:teuthology.orchestra.run.smithi114.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-13T17:48:13.044 INFO:teuthology.orchestra.run.smithi114.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-13T17:48:13.044 INFO:teuthology.orchestra.run.smithi114.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-13T17:48:13.045 INFO:teuthology.orchestra.run.smithi114.stdout:Suggested packages: 2024-09-13T17:48:13.045 INFO:teuthology.orchestra.run.smithi114.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-09-13T17:48:13.045 INFO:teuthology.orchestra.run.smithi114.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-09-13T17:48:13.045 INFO:teuthology.orchestra.run.smithi114.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-09-13T17:48:13.045 INFO:teuthology.orchestra.run.smithi114.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-09-13T17:48:13.045 INFO:teuthology.orchestra.run.smithi114.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-09-13T17:48:13.045 INFO:teuthology.orchestra.run.smithi114.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-09-13T17:48:13.045 INFO:teuthology.orchestra.run.smithi114.stdout: python3-watchdog 2024-09-13T17:48:13.045 INFO:teuthology.orchestra.run.smithi114.stdout:Recommended packages: 2024-09-13T17:48:13.046 INFO:teuthology.orchestra.run.smithi114.stdout: btrfs-tools 2024-09-13T17:48:13.081 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T17:48:13.082 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T17:48:13.082 INFO:teuthology.orchestra.run.smithi134.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T17:48:13.082 INFO:teuthology.orchestra.run.smithi134.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T17:48:13.082 INFO:teuthology.orchestra.run.smithi134.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T17:48:13.082 INFO:teuthology.orchestra.run.smithi134.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T17:48:13.082 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T17:48:13.083 INFO:teuthology.orchestra.run.smithi134.stdout:The following additional packages will be installed: 2024-09-13T17:48:13.083 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T17:48:13.084 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-13T17:48:13.084 INFO:teuthology.orchestra.run.smithi134.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-13T17:48:13.084 INFO:teuthology.orchestra.run.smithi134.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-13T17:48:13.085 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-09-13T17:48:13.085 INFO:teuthology.orchestra.run.smithi134.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-13T17:48:13.085 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-13T17:48:13.085 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-13T17:48:13.085 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-13T17:48:13.085 INFO:teuthology.orchestra.run.smithi134.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-13T17:48:13.085 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-13T17:48:13.085 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-13T17:48:13.085 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-13T17:48:13.086 INFO:teuthology.orchestra.run.smithi134.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-13T17:48:13.086 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-13T17:48:13.086 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-13T17:48:13.086 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-13T17:48:13.086 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-13T17:48:13.086 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-13T17:48:13.086 INFO:teuthology.orchestra.run.smithi134.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-13T17:48:13.086 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-13T17:48:13.086 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-13T17:48:13.086 INFO:teuthology.orchestra.run.smithi134.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-13T17:48:13.086 INFO:teuthology.orchestra.run.smithi134.stdout:Suggested packages: 2024-09-13T17:48:13.087 INFO:teuthology.orchestra.run.smithi134.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-09-13T17:48:13.087 INFO:teuthology.orchestra.run.smithi134.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-09-13T17:48:13.087 INFO:teuthology.orchestra.run.smithi134.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-09-13T17:48:13.087 INFO:teuthology.orchestra.run.smithi134.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-09-13T17:48:13.087 INFO:teuthology.orchestra.run.smithi134.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-09-13T17:48:13.087 INFO:teuthology.orchestra.run.smithi134.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-09-13T17:48:13.087 INFO:teuthology.orchestra.run.smithi134.stdout: python3-watchdog 2024-09-13T17:48:13.087 INFO:teuthology.orchestra.run.smithi134.stdout:Recommended packages: 2024-09-13T17:48:13.087 INFO:teuthology.orchestra.run.smithi134.stdout: btrfs-tools 2024-09-13T17:48:13.196 INFO:teuthology.orchestra.run.smithi114.stdout:The following NEW packages will be installed: 2024-09-13T17:48:13.196 INFO:teuthology.orchestra.run.smithi114.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T17:48:13.196 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T17:48:13.196 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-13T17:48:13.198 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-13T17:48:13.198 INFO:teuthology.orchestra.run.smithi114.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-13T17:48:13.198 INFO:teuthology.orchestra.run.smithi114.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-13T17:48:13.198 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-09-13T17:48:13.198 INFO:teuthology.orchestra.run.smithi114.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-09-13T17:48:13.198 INFO:teuthology.orchestra.run.smithi114.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-13T17:48:13.198 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-13T17:48:13.198 INFO:teuthology.orchestra.run.smithi114.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-13T17:48:13.199 INFO:teuthology.orchestra.run.smithi114.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-13T17:48:13.199 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T17:48:13.199 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T17:48:13.199 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T17:48:13.199 INFO:teuthology.orchestra.run.smithi114.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T17:48:13.199 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T17:48:13.199 INFO:teuthology.orchestra.run.smithi114.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T17:48:13.199 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-13T17:48:13.199 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-13T17:48:13.199 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-13T17:48:13.199 INFO:teuthology.orchestra.run.smithi114.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-13T17:48:13.199 INFO:teuthology.orchestra.run.smithi114.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-13T17:48:13.199 INFO:teuthology.orchestra.run.smithi114.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-13T17:48:13.199 INFO:teuthology.orchestra.run.smithi114.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-13T17:48:13.200 INFO:teuthology.orchestra.run.smithi114.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-13T17:48:13.200 INFO:teuthology.orchestra.run.smithi114.stdout: socat xmlstarlet 2024-09-13T17:48:13.241 INFO:teuthology.orchestra.run.smithi134.stdout:The following NEW packages will be installed: 2024-09-13T17:48:13.242 INFO:teuthology.orchestra.run.smithi134.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T17:48:13.242 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T17:48:13.242 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-13T17:48:13.242 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-13T17:48:13.242 INFO:teuthology.orchestra.run.smithi134.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-13T17:48:13.242 INFO:teuthology.orchestra.run.smithi134.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-13T17:48:13.242 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-09-13T17:48:13.243 INFO:teuthology.orchestra.run.smithi134.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-09-13T17:48:13.243 INFO:teuthology.orchestra.run.smithi134.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-13T17:48:13.243 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-13T17:48:13.243 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-13T17:48:13.243 INFO:teuthology.orchestra.run.smithi134.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-13T17:48:13.243 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T17:48:13.243 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T17:48:13.243 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T17:48:13.244 INFO:teuthology.orchestra.run.smithi134.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T17:48:13.244 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T17:48:13.244 INFO:teuthology.orchestra.run.smithi134.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T17:48:13.244 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-13T17:48:13.244 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-13T17:48:13.244 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-13T17:48:13.244 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-13T17:48:13.244 INFO:teuthology.orchestra.run.smithi134.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-13T17:48:13.244 INFO:teuthology.orchestra.run.smithi134.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-13T17:48:13.244 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-13T17:48:13.244 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-13T17:48:13.244 INFO:teuthology.orchestra.run.smithi134.stdout: socat xmlstarlet 2024-09-13T17:48:13.311 INFO:teuthology.orchestra.run.smithi134.stdout:0 upgraded, 115 newly installed, 0 to remove and 334 not upgraded. 2024-09-13T17:48:13.311 INFO:teuthology.orchestra.run.smithi134.stdout:Need to get 163 MB of archives. 2024-09-13T17:48:13.311 INFO:teuthology.orchestra.run.smithi134.stdout:After this operation, 748 MB of additional disk space will be used. 2024-09-13T17:48:13.311 INFO:teuthology.orchestra.run.smithi134.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-13T17:48:13.329 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-13T17:48:13.338 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-13T17:48:13.350 INFO:teuthology.orchestra.run.smithi114.stdout:0 upgraded, 115 newly installed, 0 to remove and 334 not upgraded. 2024-09-13T17:48:13.351 INFO:teuthology.orchestra.run.smithi114.stdout:Need to get 163 MB of archives. 2024-09-13T17:48:13.351 INFO:teuthology.orchestra.run.smithi114.stdout:After this operation, 748 MB of additional disk space will be used. 2024-09-13T17:48:13.351 INFO:teuthology.orchestra.run.smithi114.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.4-860-g6c6b083f-1jammy [3,453 kB] 2024-09-13T17:48:13.380 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-09-13T17:48:13.389 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-13T17:48:13.394 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.4-860-g6c6b083f-1jammy [3,453 kB] 2024-09-13T17:48:13.395 INFO:teuthology.orchestra.run.smithi114.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-13T17:48:13.405 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-13T17:48:13.407 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-13T17:48:13.417 INFO:teuthology.orchestra.run.smithi134.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-13T17:48:13.454 INFO:teuthology.orchestra.run.smithi134.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-13T17:48:13.456 INFO:teuthology.orchestra.run.smithi134.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-13T17:48:13.464 INFO:teuthology.orchestra.run.smithi134.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-13T17:48:13.466 INFO:teuthology.orchestra.run.smithi134.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-13T17:48:13.467 INFO:teuthology.orchestra.run.smithi134.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-13T17:48:13.472 INFO:teuthology.orchestra.run.smithi134.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-13T17:48:13.473 INFO:teuthology.orchestra.run.smithi134.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-13T17:48:13.473 INFO:teuthology.orchestra.run.smithi134.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-13T17:48:13.474 INFO:teuthology.orchestra.run.smithi134.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-13T17:48:13.475 INFO:teuthology.orchestra.run.smithi134.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-13T17:48:13.478 INFO:teuthology.orchestra.run.smithi114.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-13T17:48:13.491 INFO:teuthology.orchestra.run.smithi134.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-13T17:48:13.491 INFO:teuthology.orchestra.run.smithi134.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-13T17:48:13.491 INFO:teuthology.orchestra.run.smithi134.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-13T17:48:13.492 INFO:teuthology.orchestra.run.smithi134.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-13T17:48:13.507 INFO:teuthology.orchestra.run.smithi134.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-13T17:48:13.510 INFO:teuthology.orchestra.run.smithi134.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-13T17:48:13.510 INFO:teuthology.orchestra.run.smithi134.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-13T17:48:13.511 INFO:teuthology.orchestra.run.smithi134.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-13T17:48:13.511 INFO:teuthology.orchestra.run.smithi134.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-13T17:48:13.512 INFO:teuthology.orchestra.run.smithi134.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T17:48:13.524 INFO:teuthology.orchestra.run.smithi114.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-13T17:48:13.524 INFO:teuthology.orchestra.run.smithi134.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-13T17:48:13.525 INFO:teuthology.orchestra.run.smithi134.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-13T17:48:13.526 INFO:teuthology.orchestra.run.smithi134.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-13T17:48:13.526 INFO:teuthology.orchestra.run.smithi134.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-13T17:48:13.527 INFO:teuthology.orchestra.run.smithi114.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.4-860-g6c6b083f-1jammy [3,108 kB] 2024-09-13T17:48:13.542 INFO:teuthology.orchestra.run.smithi134.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-13T17:48:13.546 INFO:teuthology.orchestra.run.smithi134.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-13T17:48:13.547 INFO:teuthology.orchestra.run.smithi134.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-13T17:48:13.547 INFO:teuthology.orchestra.run.smithi134.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-13T17:48:13.548 INFO:teuthology.orchestra.run.smithi134.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-13T17:48:13.549 INFO:teuthology.orchestra.run.smithi134.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-13T17:48:13.559 INFO:teuthology.orchestra.run.smithi134.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-13T17:48:13.560 INFO:teuthology.orchestra.run.smithi134.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-13T17:48:13.561 INFO:teuthology.orchestra.run.smithi134.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-13T17:48:13.562 INFO:teuthology.orchestra.run.smithi134.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-13T17:48:13.576 INFO:teuthology.orchestra.run.smithi134.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-13T17:48:13.577 INFO:teuthology.orchestra.run.smithi134.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-13T17:48:13.578 INFO:teuthology.orchestra.run.smithi134.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-13T17:48:13.580 INFO:teuthology.orchestra.run.smithi134.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-13T17:48:13.588 INFO:teuthology.orchestra.run.smithi114.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.4-860-g6c6b083f-1jammy [684 kB] 2024-09-13T17:48:13.599 INFO:teuthology.orchestra.run.smithi114.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.4-860-g6c6b083f-1jammy [357 kB] 2024-09-13T17:48:13.613 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.4-860-g6c6b083f-1jammy [32.8 kB] 2024-09-13T17:48:13.613 INFO:teuthology.orchestra.run.smithi114.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.4-860-g6c6b083f-1jammy [180 kB] 2024-09-13T17:48:13.616 INFO:teuthology.orchestra.run.smithi114.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.4-860-g6c6b083f-1jammy [63.7 kB] 2024-09-13T17:48:13.617 INFO:teuthology.orchestra.run.smithi114.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.4-860-g6c6b083f-1jammy [334 kB] 2024-09-13T17:48:13.622 INFO:teuthology.orchestra.run.smithi114.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.4-860-g6c6b083f-1jammy [5,933 kB] 2024-09-13T17:48:13.626 INFO:teuthology.orchestra.run.smithi134.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-13T17:48:13.627 INFO:teuthology.orchestra.run.smithi134.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-13T17:48:13.629 INFO:teuthology.orchestra.run.smithi134.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-13T17:48:13.629 INFO:teuthology.orchestra.run.smithi134.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-13T17:48:13.630 INFO:teuthology.orchestra.run.smithi134.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-13T17:48:13.631 INFO:teuthology.orchestra.run.smithi134.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-13T17:48:13.631 INFO:teuthology.orchestra.run.smithi134.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-13T17:48:13.633 INFO:teuthology.orchestra.run.smithi134.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T17:48:13.634 INFO:teuthology.orchestra.run.smithi134.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-13T17:48:13.645 INFO:teuthology.orchestra.run.smithi134.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-13T17:48:13.665 INFO:teuthology.orchestra.run.smithi134.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-13T17:48:13.666 INFO:teuthology.orchestra.run.smithi134.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.4-860-g6c6b083f-1jammy [3,108 kB] 2024-09-13T17:48:13.668 INFO:teuthology.orchestra.run.smithi134.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-13T17:48:13.668 INFO:teuthology.orchestra.run.smithi134.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-13T17:48:13.685 INFO:teuthology.orchestra.run.smithi134.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-13T17:48:13.685 INFO:teuthology.orchestra.run.smithi134.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-13T17:48:13.686 INFO:teuthology.orchestra.run.smithi134.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-13T17:48:13.686 INFO:teuthology.orchestra.run.smithi134.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-13T17:48:13.687 INFO:teuthology.orchestra.run.smithi134.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-13T17:48:13.687 INFO:teuthology.orchestra.run.smithi134.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-13T17:48:13.689 INFO:teuthology.orchestra.run.smithi134.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-13T17:48:13.705 INFO:teuthology.orchestra.run.smithi134.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-13T17:48:13.709 INFO:teuthology.orchestra.run.smithi134.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-13T17:48:13.711 INFO:teuthology.orchestra.run.smithi134.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-13T17:48:13.712 INFO:teuthology.orchestra.run.smithi134.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-13T17:48:13.713 INFO:teuthology.orchestra.run.smithi134.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-13T17:48:13.717 INFO:teuthology.orchestra.run.smithi134.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-13T17:48:13.719 INFO:teuthology.orchestra.run.smithi134.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-13T17:48:13.720 INFO:teuthology.orchestra.run.smithi134.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-13T17:48:13.721 INFO:teuthology.orchestra.run.smithi114.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-09-13T17:48:13.724 INFO:teuthology.orchestra.run.smithi134.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-13T17:48:13.727 INFO:teuthology.orchestra.run.smithi134.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T17:48:13.742 INFO:teuthology.orchestra.run.smithi134.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-13T17:48:13.744 INFO:teuthology.orchestra.run.smithi134.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-13T17:48:13.752 INFO:teuthology.orchestra.run.smithi134.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-13T17:48:13.753 INFO:teuthology.orchestra.run.smithi134.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-13T17:48:13.753 INFO:teuthology.orchestra.run.smithi134.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-13T17:48:13.757 INFO:teuthology.orchestra.run.smithi114.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-13T17:48:13.760 INFO:teuthology.orchestra.run.smithi114.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.4-860-g6c6b083f-1jammy [112 kB] 2024-09-13T17:48:13.762 INFO:teuthology.orchestra.run.smithi114.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.4-860-g6c6b083f-1jammy [445 kB] 2024-09-13T17:48:13.768 INFO:teuthology.orchestra.run.smithi114.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.4-860-g6c6b083f-1jammy [22.1 MB] 2024-09-13T17:48:13.832 INFO:teuthology.orchestra.run.smithi114.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-13T17:48:13.832 INFO:teuthology.orchestra.run.smithi134.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.4-860-g6c6b083f-1jammy [684 kB] 2024-09-13T17:48:13.843 INFO:teuthology.orchestra.run.smithi114.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-13T17:48:13.874 INFO:teuthology.orchestra.run.smithi134.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.4-860-g6c6b083f-1jammy [357 kB] 2024-09-13T17:48:13.886 INFO:teuthology.orchestra.run.smithi114.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-13T17:48:13.911 INFO:teuthology.orchestra.run.smithi134.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.4-860-g6c6b083f-1jammy [32.8 kB] 2024-09-13T17:48:13.912 INFO:teuthology.orchestra.run.smithi134.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.4-860-g6c6b083f-1jammy [180 kB] 2024-09-13T17:48:13.917 INFO:teuthology.orchestra.run.smithi134.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.4-860-g6c6b083f-1jammy [63.7 kB] 2024-09-13T17:48:13.918 INFO:teuthology.orchestra.run.smithi134.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.4-860-g6c6b083f-1jammy [334 kB] 2024-09-13T17:48:13.923 INFO:teuthology.orchestra.run.smithi134.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.4-860-g6c6b083f-1jammy [5,933 kB] 2024-09-13T17:48:14.054 INFO:teuthology.orchestra.run.smithi114.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-13T17:48:14.062 INFO:teuthology.orchestra.run.smithi114.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-13T17:48:14.087 INFO:teuthology.orchestra.run.smithi114.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-13T17:48:14.095 INFO:teuthology.orchestra.run.smithi114.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-13T17:48:14.096 INFO:teuthology.orchestra.run.smithi114.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-13T17:48:14.117 INFO:teuthology.orchestra.run.smithi114.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-13T17:48:14.118 INFO:teuthology.orchestra.run.smithi114.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-13T17:48:14.118 INFO:teuthology.orchestra.run.smithi114.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-13T17:48:14.120 INFO:teuthology.orchestra.run.smithi114.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-13T17:48:14.136 INFO:teuthology.orchestra.run.smithi114.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-13T17:48:14.202 INFO:teuthology.orchestra.run.smithi114.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-13T17:48:14.202 INFO:teuthology.orchestra.run.smithi114.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-13T17:48:14.203 INFO:teuthology.orchestra.run.smithi114.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-13T17:48:14.203 INFO:teuthology.orchestra.run.smithi114.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-13T17:48:14.204 INFO:teuthology.orchestra.run.smithi114.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-13T17:48:14.206 INFO:teuthology.orchestra.run.smithi114.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-13T17:48:14.207 INFO:teuthology.orchestra.run.smithi114.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-13T17:48:14.218 INFO:teuthology.orchestra.run.smithi114.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-13T17:48:14.218 INFO:teuthology.orchestra.run.smithi114.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-13T17:48:14.278 INFO:teuthology.orchestra.run.smithi114.stdout:Get:40 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.4-860-g6c6b083f-1jammy [5,006 kB] 2024-09-13T17:48:14.299 INFO:teuthology.orchestra.run.smithi114.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T17:48:14.299 INFO:teuthology.orchestra.run.smithi114.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-13T17:48:14.299 INFO:teuthology.orchestra.run.smithi114.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-13T17:48:14.301 INFO:teuthology.orchestra.run.smithi114.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-13T17:48:14.301 INFO:teuthology.orchestra.run.smithi114.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-13T17:48:14.302 INFO:teuthology.orchestra.run.smithi114.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-13T17:48:14.304 INFO:teuthology.orchestra.run.smithi134.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.4-860-g6c6b083f-1jammy [112 kB] 2024-09-13T17:48:14.305 INFO:teuthology.orchestra.run.smithi134.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.4-860-g6c6b083f-1jammy [445 kB] 2024-09-13T17:48:14.306 INFO:teuthology.orchestra.run.smithi114.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-13T17:48:14.312 INFO:teuthology.orchestra.run.smithi134.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.4-860-g6c6b083f-1jammy [22.1 MB] 2024-09-13T17:48:14.381 INFO:teuthology.orchestra.run.smithi114.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-13T17:48:14.381 INFO:teuthology.orchestra.run.smithi114.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-13T17:48:14.381 INFO:teuthology.orchestra.run.smithi114.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-13T17:48:14.392 INFO:teuthology.orchestra.run.smithi114.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.4-860-g6c6b083f-1jammy [242 kB] 2024-09-13T17:48:14.395 INFO:teuthology.orchestra.run.smithi114.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.4-860-g6c6b083f-1jammy [130 kB] 2024-09-13T17:48:14.397 INFO:teuthology.orchestra.run.smithi114.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.4-860-g6c6b083f-1jammy [1,496 kB] 2024-09-13T17:48:14.422 INFO:teuthology.orchestra.run.smithi114.stdout:Get:54 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.4-860-g6c6b083f-1jammy [6,085 kB] 2024-09-13T17:48:14.462 INFO:teuthology.orchestra.run.smithi114.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-13T17:48:14.464 INFO:teuthology.orchestra.run.smithi114.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-13T17:48:14.465 INFO:teuthology.orchestra.run.smithi114.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-13T17:48:14.466 INFO:teuthology.orchestra.run.smithi114.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-13T17:48:14.466 INFO:teuthology.orchestra.run.smithi114.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-13T17:48:14.469 INFO:teuthology.orchestra.run.smithi114.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-13T17:48:14.469 INFO:teuthology.orchestra.run.smithi114.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-13T17:48:14.543 INFO:teuthology.orchestra.run.smithi114.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-13T17:48:14.545 INFO:teuthology.orchestra.run.smithi114.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-13T17:48:14.565 INFO:teuthology.orchestra.run.smithi114.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.4-860-g6c6b083f-1jammy [22.4 MB] 2024-09-13T17:48:14.656 INFO:teuthology.orchestra.run.smithi114.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-13T17:48:14.657 INFO:teuthology.orchestra.run.smithi114.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-13T17:48:14.658 INFO:teuthology.orchestra.run.smithi114.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-13T17:48:14.658 INFO:teuthology.orchestra.run.smithi114.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-13T17:48:14.659 INFO:teuthology.orchestra.run.smithi114.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-13T17:48:14.660 INFO:teuthology.orchestra.run.smithi114.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-13T17:48:14.660 INFO:teuthology.orchestra.run.smithi114.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-13T17:48:14.708 INFO:teuthology.orchestra.run.smithi114.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T17:48:14.708 INFO:teuthology.orchestra.run.smithi114.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-13T17:48:14.788 INFO:teuthology.orchestra.run.smithi114.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-13T17:48:14.809 INFO:teuthology.orchestra.run.smithi114.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-13T17:48:14.811 INFO:teuthology.orchestra.run.smithi114.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-13T17:48:14.812 INFO:teuthology.orchestra.run.smithi114.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-13T17:48:14.884 INFO:teuthology.orchestra.run.smithi114.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-13T17:48:14.884 INFO:teuthology.orchestra.run.smithi114.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-13T17:48:14.885 INFO:teuthology.orchestra.run.smithi114.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-13T17:48:14.885 INFO:teuthology.orchestra.run.smithi114.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-13T17:48:14.886 INFO:teuthology.orchestra.run.smithi114.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-13T17:48:14.886 INFO:teuthology.orchestra.run.smithi114.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-13T17:48:14.953 INFO:teuthology.orchestra.run.smithi114.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-13T17:48:14.953 INFO:teuthology.orchestra.run.smithi114.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-13T17:48:14.957 INFO:teuthology.orchestra.run.smithi114.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-13T17:48:15.035 INFO:teuthology.orchestra.run.smithi114.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-13T17:48:15.037 INFO:teuthology.orchestra.run.smithi114.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-13T17:48:15.037 INFO:teuthology.orchestra.run.smithi114.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-13T17:48:15.042 INFO:teuthology.orchestra.run.smithi114.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-13T17:48:15.044 INFO:teuthology.orchestra.run.smithi114.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-13T17:48:15.045 INFO:teuthology.orchestra.run.smithi114.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-13T17:48:15.050 INFO:teuthology.orchestra.run.smithi114.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-13T17:48:15.117 INFO:teuthology.orchestra.run.smithi114.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T17:48:15.117 INFO:teuthology.orchestra.run.smithi114.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-13T17:48:15.119 INFO:teuthology.orchestra.run.smithi114.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-13T17:48:15.148 INFO:teuthology.orchestra.run.smithi114.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.4-860-g6c6b083f-1jammy [14.2 kB] 2024-09-13T17:48:15.149 INFO:teuthology.orchestra.run.smithi114.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.4-860-g6c6b083f-1jammy [835 kB] 2024-09-13T17:48:15.188 INFO:teuthology.orchestra.run.smithi114.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.4-860-g6c6b083f-1jammy [2,159 kB] 2024-09-13T17:48:15.198 INFO:teuthology.orchestra.run.smithi114.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-13T17:48:15.199 INFO:teuthology.orchestra.run.smithi114.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-13T17:48:15.200 INFO:teuthology.orchestra.run.smithi114.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-13T17:48:15.289 INFO:teuthology.orchestra.run.smithi114.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.4-860-g6c6b083f-1jammy [240 kB] 2024-09-13T17:48:15.291 INFO:teuthology.orchestra.run.smithi114.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.4-860-g6c6b083f-1jammy [145 kB] 2024-09-13T17:48:15.293 INFO:teuthology.orchestra.run.smithi114.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.4-860-g6c6b083f-1jammy [2,233 kB] 2024-09-13T17:48:15.320 INFO:teuthology.orchestra.run.smithi134.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.4-860-g6c6b083f-1jammy [5,006 kB] 2024-09-13T17:48:15.332 INFO:teuthology.orchestra.run.smithi114.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.4-860-g6c6b083f-1jammy [8,625 kB] 2024-09-13T17:48:15.470 INFO:teuthology.orchestra.run.smithi134.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.4-860-g6c6b083f-1jammy [242 kB] 2024-09-13T17:48:15.472 INFO:teuthology.orchestra.run.smithi134.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.4-860-g6c6b083f-1jammy [130 kB] 2024-09-13T17:48:15.484 INFO:teuthology.orchestra.run.smithi134.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.4-860-g6c6b083f-1jammy [1,496 kB] 2024-09-13T17:48:15.534 INFO:teuthology.orchestra.run.smithi134.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.4-860-g6c6b083f-1jammy [6,085 kB] 2024-09-13T17:48:15.599 INFO:teuthology.orchestra.run.smithi114.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.4-860-g6c6b083f-1jammy [14.3 kB] 2024-09-13T17:48:15.599 INFO:teuthology.orchestra.run.smithi114.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.4-860-g6c6b083f-1jammy [42.9 MB] 2024-09-13T17:48:15.750 INFO:teuthology.orchestra.run.smithi134.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.4-860-g6c6b083f-1jammy [22.4 MB] 2024-09-13T17:48:16.515 INFO:teuthology.orchestra.run.smithi134.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.4-860-g6c6b083f-1jammy [14.2 kB] 2024-09-13T17:48:16.516 INFO:teuthology.orchestra.run.smithi134.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.4-860-g6c6b083f-1jammy [835 kB] 2024-09-13T17:48:16.522 INFO:teuthology.orchestra.run.smithi134.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.4-860-g6c6b083f-1jammy [2,159 kB] 2024-09-13T17:48:16.617 INFO:teuthology.orchestra.run.smithi134.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.4-860-g6c6b083f-1jammy [240 kB] 2024-09-13T17:48:16.622 INFO:teuthology.orchestra.run.smithi134.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.4-860-g6c6b083f-1jammy [145 kB] 2024-09-13T17:48:16.624 INFO:teuthology.orchestra.run.smithi134.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.4-860-g6c6b083f-1jammy [2,233 kB] 2024-09-13T17:48:16.692 INFO:teuthology.orchestra.run.smithi134.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.4-860-g6c6b083f-1jammy [8,625 kB] 2024-09-13T17:48:16.968 INFO:teuthology.orchestra.run.smithi114.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.4-860-g6c6b083f-1jammy [122 kB] 2024-09-13T17:48:16.969 INFO:teuthology.orchestra.run.smithi114.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.4-860-g6c6b083f-1jammy [233 kB] 2024-09-13T17:48:16.971 INFO:teuthology.orchestra.run.smithi114.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.4-860-g6c6b083f-1jammy [34.0 kB] 2024-09-13T17:48:16.971 INFO:teuthology.orchestra.run.smithi114.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.4-860-g6c6b083f-1jammy [23.5 kB] 2024-09-13T17:48:16.972 INFO:teuthology.orchestra.run.smithi114.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.4-860-g6c6b083f-1jammy [38.3 kB] 2024-09-13T17:48:16.972 INFO:teuthology.orchestra.run.smithi114.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.4-860-g6c6b083f-1jammy [11.7 MB] 2024-09-13T17:48:16.991 INFO:teuthology.orchestra.run.smithi134.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.4-860-g6c6b083f-1jammy [14.3 kB] 2024-09-13T17:48:16.991 INFO:teuthology.orchestra.run.smithi134.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.4-860-g6c6b083f-1jammy [42.9 MB] 2024-09-13T17:48:17.330 INFO:teuthology.orchestra.run.smithi114.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.4-860-g6c6b083f-1jammy [93.0 kB] 2024-09-13T17:48:17.893 INFO:teuthology.orchestra.run.smithi134.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.4-860-g6c6b083f-1jammy [122 kB] 2024-09-13T17:48:17.894 INFO:teuthology.orchestra.run.smithi134.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.4-860-g6c6b083f-1jammy [233 kB] 2024-09-13T17:48:17.896 INFO:teuthology.orchestra.run.smithi134.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.4-860-g6c6b083f-1jammy [34.0 kB] 2024-09-13T17:48:17.896 INFO:teuthology.orchestra.run.smithi134.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.4-860-g6c6b083f-1jammy [23.5 kB] 2024-09-13T17:48:17.897 INFO:teuthology.orchestra.run.smithi134.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.4-860-g6c6b083f-1jammy [38.3 kB] 2024-09-13T17:48:17.897 INFO:teuthology.orchestra.run.smithi134.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.4-860-g6c6b083f-1jammy [11.7 MB] 2024-09-13T17:48:17.908 INFO:teuthology.orchestra.run.smithi114.stdout:Fetched 163 MB in 4s (39.6 MB/s) 2024-09-13T17:48:18.051 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-13T17:48:18.083 INFO:teuthology.orchestra.run.smithi134.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.4-860-g6c6b083f-1jammy [93.0 kB] 2024-09-13T17:48:18.118 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132928 files and directories currently installed.) 2024-09-13T17:48:18.121 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-13T17:48:18.175 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-13T17:48:18.503 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T17:48:18.517 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-13T17:48:18.561 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T17:48:18.663 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 163 MB in 5s (33.8 MB/s) 2024-09-13T17:48:18.807 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-13T17:48:18.872 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cmd2. 2024-09-13T17:48:18.873 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132928 files and directories currently installed.) 2024-09-13T17:48:18.876 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-13T17:48:18.886 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-13T17:48:18.914 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-13T17:48:18.930 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-13T17:48:19.217 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T17:48:19.231 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-13T17:48:19.233 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libfmt8:amd64. 2024-09-13T17:48:19.248 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-09-13T17:48:19.276 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T17:48:19.325 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-13T17:48:19.612 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cmd2. 2024-09-13T17:48:19.626 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-13T17:48:19.661 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-13T17:48:19.670 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-13T17:48:19.676 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-13T17:48:19.719 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T17:48:20.022 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libfmt8:amd64. 2024-09-13T17:48:20.038 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-09-13T17:48:20.056 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T17:48:20.071 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-13T17:48:20.114 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T17:48:20.139 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-13T17:48:20.459 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T17:48:20.474 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-13T17:48:20.517 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T17:48:20.684 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-13T17:48:20.699 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-13T17:48:20.743 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T17:48:20.921 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T17:48:20.936 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T17:48:20.979 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T17:48:21.079 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T17:48:21.094 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-13T17:48:21.137 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T17:48:21.374 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T17:48:21.388 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T17:48:21.432 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T17:48:21.457 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T17:48:21.472 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-13T17:48:21.515 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T17:48:21.768 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T17:48:21.783 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T17:48:21.826 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T17:48:21.961 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T17:48:21.976 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T17:48:22.027 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T17:48:22.188 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-13T17:48:22.202 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-13T17:48:22.238 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T17:48:22.413 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T17:48:22.428 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T17:48:22.496 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T17:48:22.541 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package librados2. 2024-09-13T17:48:22.555 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../011-librados2_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:22.599 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librados2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:22.791 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T17:48:22.806 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T17:48:22.841 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T17:48:22.968 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package librbd1. 2024-09-13T17:48:22.982 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../012-librbd1_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:23.027 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librbd1 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:23.178 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-13T17:48:23.193 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-13T17:48:23.236 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T17:48:23.471 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T17:48:23.485 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../013-libcephfs2_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:23.529 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libcephfs2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:23.564 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librados2. 2024-09-13T17:48:23.578 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../011-librados2_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:23.622 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librados2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:23.798 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-rados. 2024-09-13T17:48:23.813 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../014-python3-rados_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:23.857 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-rados (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:24.058 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librbd1. 2024-09-13T17:48:24.073 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../012-librbd1_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:24.116 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librbd1 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:24.151 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T17:48:24.166 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:48:24.201 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-ceph-argparse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:24.428 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T17:48:24.443 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../016-python3-cephfs_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:24.487 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cephfs (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:24.536 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T17:48:24.566 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../013-libcephfs2_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:24.777 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libcephfs2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:24.814 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T17:48:24.830 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:48:24.872 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-ceph-common (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:25.055 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rados. 2024-09-13T17:48:25.070 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../014-python3-rados_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:25.105 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rados (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:25.200 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T17:48:25.216 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-09-13T17:48:25.259 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-13T17:48:25.415 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T17:48:25.431 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:48:25.483 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-ceph-argparse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:25.511 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T17:48:25.526 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../019-python3-rbd_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:25.570 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-rbd (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:25.760 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T17:48:25.775 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../016-python3-cephfs_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:25.818 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cephfs (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:26.071 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T17:48:26.086 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:48:26.120 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-ceph-common (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:26.139 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T17:48:26.154 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-13T17:48:26.189 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T17:48:26.423 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T17:48:26.439 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-09-13T17:48:26.482 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-13T17:48:26.483 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package librgw2. 2024-09-13T17:48:26.498 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../021-librgw2_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:26.542 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librgw2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:26.718 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T17:48:26.733 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../019-python3-rbd_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:26.776 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rbd (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:26.994 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T17:48:27.009 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../022-python3-rgw_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:27.052 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-rgw (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:27.137 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T17:48:27.151 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-13T17:48:27.195 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T17:48:27.397 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-13T17:48:27.412 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-13T17:48:27.455 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T17:48:27.498 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librgw2. 2024-09-13T17:48:27.512 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../021-librgw2_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:27.548 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librgw2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:27.724 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T17:48:27.740 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../024-libradosstriper1_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:27.782 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libradosstriper1 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:28.059 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T17:48:28.073 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../022-python3-rgw_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:28.117 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rgw (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:28.227 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-common. 2024-09-13T17:48:28.242 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../025-ceph-common_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:28.286 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-common (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:28.453 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-13T17:48:28.468 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-13T17:48:28.511 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T17:48:28.822 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T17:48:28.837 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../024-libradosstriper1_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:28.873 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libradosstriper1 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:29.316 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-base. 2024-09-13T17:48:29.326 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-common. 2024-09-13T17:48:29.330 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../026-ceph-base_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:29.341 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../025-ceph-common_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:29.384 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-common (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:29.409 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-base (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:29.979 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-13T17:48:29.993 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-13T17:48:30.037 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-13T17:48:30.298 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cheroot. 2024-09-13T17:48:30.314 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-13T17:48:30.348 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T17:48:30.456 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-base. 2024-09-13T17:48:30.470 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../026-ceph-base_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:30.524 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-base (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:30.651 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-13T17:48:30.665 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-13T17:48:30.701 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-13T17:48:31.094 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-13T17:48:31.109 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-13T17:48:31.152 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-13T17:48:31.188 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-13T17:48:31.205 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-13T17:48:31.246 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-13T17:48:31.438 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cheroot. 2024-09-13T17:48:31.452 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-13T17:48:31.488 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T17:48:31.507 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-13T17:48:31.522 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-13T17:48:31.557 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-13T17:48:31.766 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-13T17:48:31.780 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-13T17:48:31.833 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-13T17:48:31.851 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-tempora. 2024-09-13T17:48:31.866 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2024-09-13T17:48:31.910 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-13T17:48:32.144 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-13T17:48:32.158 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-13T17:48:32.196 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-portend. 2024-09-13T17:48:32.202 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-13T17:48:32.210 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2024-09-13T17:48:32.254 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-13T17:48:32.530 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-13T17:48:32.540 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-13T17:48:32.544 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-13T17:48:32.555 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-13T17:48:32.588 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-13T17:48:32.598 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-13T17:48:32.849 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-tempora. 2024-09-13T17:48:32.863 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2024-09-13T17:48:32.893 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T17:48:32.908 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-13T17:48:32.908 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-13T17:48:32.943 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-13T17:48:33.221 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-portend. 2024-09-13T17:48:33.235 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2024-09-13T17:48:33.277 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-13T17:48:33.313 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T17:48:33.328 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2024-09-13T17:48:33.371 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-13T17:48:33.530 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-13T17:48:33.544 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-13T17:48:33.580 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-13T17:48:33.682 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T17:48:33.697 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2024-09-13T17:48:33.740 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-13T17:48:33.899 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T17:48:33.913 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-13T17:48:33.957 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-13T17:48:34.018 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T17:48:34.033 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-13T17:48:34.068 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-13T17:48:34.278 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T17:48:34.291 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2024-09-13T17:48:34.336 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-13T17:48:34.373 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-mako. 2024-09-13T17:48:34.388 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-13T17:48:34.431 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T17:48:34.664 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T17:48:34.678 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2024-09-13T17:48:34.722 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-13T17:48:34.759 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T17:48:34.774 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T17:48:34.818 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T17:48:35.050 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T17:48:35.064 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-13T17:48:35.087 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T17:48:35.102 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-13T17:48:35.116 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-13T17:48:35.137 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-13T17:48:35.386 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-mako. 2024-09-13T17:48:35.400 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-13T17:48:35.406 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-webob. 2024-09-13T17:48:35.421 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-13T17:48:35.436 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T17:48:35.464 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T17:48:35.747 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T17:48:35.762 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T17:48:35.801 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T17:48:35.805 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T17:48:35.816 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-13T17:48:35.862 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T17:48:36.091 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T17:48:36.105 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-13T17:48:36.150 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-13T17:48:36.287 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T17:48:36.302 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-13T17:48:36.337 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T17:48:36.477 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-webob. 2024-09-13T17:48:36.491 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-13T17:48:36.536 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T17:48:36.631 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-paste. 2024-09-13T17:48:36.646 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-13T17:48:36.709 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T17:48:36.905 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T17:48:36.919 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-13T17:48:36.966 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T17:48:37.017 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T17:48:37.032 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-13T17:48:37.075 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T17:48:37.266 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T17:48:37.281 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-13T17:48:37.325 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T17:48:37.370 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T17:48:37.385 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-13T17:48:37.428 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-13T17:48:37.586 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-paste. 2024-09-13T17:48:37.600 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-13T17:48:37.644 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T17:48:37.740 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T17:48:37.755 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2024-09-13T17:48:37.814 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-13T17:48:37.930 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T17:48:37.943 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-13T17:48:37.989 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T17:48:38.142 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T17:48:38.158 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-13T17:48:38.201 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T17:48:38.317 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T17:48:38.336 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-13T17:48:38.375 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-13T17:48:38.555 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-certifi. 2024-09-13T17:48:38.570 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2024-09-13T17:48:38.613 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-13T17:48:38.686 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T17:48:38.701 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2024-09-13T17:48:38.761 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-13T17:48:38.891 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-idna. 2024-09-13T17:48:38.905 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../051-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-13T17:48:38.941 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T17:48:39.055 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T17:48:39.069 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-13T17:48:39.113 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T17:48:39.260 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-urllib3. 2024-09-13T17:48:39.274 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-13T17:48:39.319 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T17:48:39.510 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-certifi. 2024-09-13T17:48:39.517 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2024-09-13T17:48:39.559 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-13T17:48:39.655 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-requests. 2024-09-13T17:48:39.668 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-13T17:48:39.714 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T17:48:39.846 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-idna. 2024-09-13T17:48:39.857 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../051-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-13T17:48:39.888 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T17:48:40.033 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T17:48:40.046 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-13T17:48:40.091 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T17:48:40.332 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-urllib3. 2024-09-13T17:48:40.340 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-13T17:48:40.377 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T17:48:40.381 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T17:48:40.391 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:48:40.461 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:40.685 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-requests. 2024-09-13T17:48:40.694 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-13T17:48:40.726 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T17:48:40.832 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T17:48:40.845 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:40.882 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:40.988 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T17:48:40.996 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-13T17:48:41.038 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T17:48:41.160 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T17:48:41.174 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../057-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-13T17:48:41.218 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-13T17:48:41.332 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T17:48:41.341 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:48:41.373 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:41.504 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T17:48:41.517 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../058-python3-openssl_21.0.0-1_all.deb ... 2024-09-13T17:48:41.562 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-13T17:48:41.745 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T17:48:41.753 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:41.830 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:41.940 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T17:48:41.954 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../059-ceph-mgr_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:41.998 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:42.139 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T17:48:42.148 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../057-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-13T17:48:42.189 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-13T17:48:42.326 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T17:48:42.340 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../060-ceph-mon_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:42.377 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mon (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:42.517 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T17:48:42.526 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../058-python3-openssl_21.0.0-1_all.deb ... 2024-09-13T17:48:42.575 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-13T17:48:42.853 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T17:48:42.862 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../059-ceph-mgr_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:42.895 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:42.955 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T17:48:42.969 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../061-ceph-osd_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:43.013 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-osd (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:43.290 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T17:48:43.299 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../060-ceph-mon_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:43.339 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mon (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:43.741 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph. 2024-09-13T17:48:43.755 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../062-ceph_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:43.800 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:43.876 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T17:48:43.885 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../061-ceph-osd_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:43.926 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-osd (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:44.077 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T17:48:44.092 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../063-ceph-fuse_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:44.144 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-fuse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:44.530 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T17:48:44.545 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../064-ceph-mds_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:44.588 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mds (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:44.704 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph. 2024-09-13T17:48:44.712 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../062-ceph_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:44.754 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:44.950 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package cephadm. 2024-09-13T17:48:44.964 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../065-cephadm_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:45.008 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking cephadm (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:45.040 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T17:48:45.049 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../063-ceph-fuse_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:45.081 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-fuse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:45.286 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T17:48:45.301 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../066-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-13T17:48:45.361 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-13T17:48:45.427 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T17:48:45.435 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../064-ceph-mds_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:45.477 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mds (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:45.672 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-13T17:48:45.685 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../067-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T17:48:45.730 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T17:48:45.846 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package cephadm. 2024-09-13T17:48:45.855 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../065-cephadm_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:48:45.896 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking cephadm (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:46.858 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T17:48:46.867 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../066-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-13T17:48:46.907 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-13T17:48:47.227 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-13T17:48:47.236 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../067-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T17:48:47.277 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T17:48:47.544 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-babel. 2024-09-13T17:48:47.557 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../068-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T17:48:47.602 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T17:48:47.930 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T17:48:47.943 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../069-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-13T17:48:47.988 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T17:48:48.307 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-babel. 2024-09-13T17:48:48.317 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../068-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T17:48:48.356 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T17:48:48.358 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T17:48:48.372 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../070-ceph-mgr-cephadm_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:48:48.416 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:48.652 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T17:48:48.660 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../069-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-13T17:48:48.693 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T17:48:48.744 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T17:48:48.758 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-13T17:48:48.802 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-13T17:48:48.988 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T17:48:48.997 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../070-ceph-mgr-cephadm_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:48:49.029 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:49.114 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-py. 2024-09-13T17:48:49.129 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2024-09-13T17:48:49.172 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-13T17:48:49.341 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T17:48:49.350 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-13T17:48:49.382 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-13T17:48:49.534 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-13T17:48:49.549 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-13T17:48:49.592 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-13T17:48:49.696 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-py. 2024-09-13T17:48:49.706 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2024-09-13T17:48:49.771 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-13T17:48:49.845 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-toml. 2024-09-13T17:48:49.859 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2024-09-13T17:48:49.895 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-13T17:48:50.183 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-13T17:48:50.192 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-13T17:48:50.198 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T17:48:50.211 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-13T17:48:50.241 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-13T17:48:50.264 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T17:48:50.569 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-toml. 2024-09-13T17:48:50.579 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2024-09-13T17:48:50.601 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T17:48:50.615 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T17:48:50.627 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-13T17:48:50.659 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T17:48:50.962 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-routes. 2024-09-13T17:48:50.977 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-13T17:48:50.997 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T17:48:51.007 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-13T17:48:51.020 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T17:48:51.047 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T17:48:51.324 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T17:48:51.338 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:48:51.374 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:51.375 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T17:48:51.385 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T17:48:51.434 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T17:48:51.762 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-routes. 2024-09-13T17:48:51.772 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-13T17:48:51.812 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T17:48:52.157 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T17:48:52.165 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:48:52.199 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:52.579 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-13T17:48:52.591 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-13T17:48:52.629 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T17:48:53.149 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T17:48:53.162 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-13T17:48:53.198 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T17:48:53.354 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-13T17:48:53.363 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-13T17:48:53.404 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T17:48:53.502 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-13T17:48:53.515 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-13T17:48:53.543 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-13T17:48:53.846 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T17:48:53.859 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-13T17:48:53.896 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T17:48:53.924 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T17:48:53.933 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-13T17:48:53.973 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T17:48:54.335 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-13T17:48:54.344 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-13T17:48:54.385 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-13T17:48:54.631 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T17:48:54.644 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:48:54.663 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T17:48:54.672 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-13T17:48:54.681 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:54.713 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T17:48:55.618 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T17:48:55.632 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-13T17:48:55.676 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-13T17:48:55.732 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T17:48:55.741 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:48:55.782 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:55.979 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T17:48:55.993 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-13T17:48:56.037 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-13T17:48:56.382 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T17:48:56.397 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-13T17:48:56.432 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T17:48:56.751 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T17:48:56.766 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-13T17:48:56.801 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-13T17:48:56.809 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T17:48:56.822 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-13T17:48:56.869 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-13T17:48:57.097 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T17:48:57.112 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-13T17:48:57.155 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-13T17:48:57.238 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T17:48:57.249 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-13T17:48:57.296 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-13T17:48:57.475 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T17:48:57.492 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-13T17:48:57.533 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T17:48:57.717 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T17:48:57.728 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-13T17:48:57.775 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T17:48:58.061 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T17:48:58.077 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-13T17:48:58.119 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-13T17:48:58.137 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T17:48:58.147 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-13T17:48:58.187 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-13T17:48:58.439 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T17:48:58.454 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-13T17:48:58.497 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T17:48:58.515 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T17:48:58.526 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-13T17:48:58.565 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-13T17:48:58.918 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T17:48:58.930 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-13T17:48:58.968 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T17:48:59.111 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T17:48:59.125 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:48:59.177 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:48:59.246 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T17:48:59.258 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-13T17:48:59.313 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-13T17:48:59.497 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T17:48:59.510 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-13T17:48:59.555 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T17:48:59.625 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T17:48:59.636 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-13T17:48:59.674 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T17:48:59.900 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T17:48:59.914 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T17:48:59.958 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T17:49:00.194 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package jq. 2024-09-13T17:49:00.208 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T17:49:00.244 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-13T17:49:00.322 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T17:49:00.332 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:49:00.371 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:00.496 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package socat. 2024-09-13T17:49:00.511 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-13T17:49:00.554 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-13T17:49:00.716 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T17:49:00.726 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-13T17:49:00.757 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T17:49:00.850 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T17:49:00.864 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-13T17:49:00.908 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-13T17:49:01.077 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T17:49:01.087 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T17:49:01.152 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T17:49:01.229 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-test. 2024-09-13T17:49:01.242 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../098-ceph-test_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:49:01.278 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-test (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:01.421 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package jq. 2024-09-13T17:49:01.432 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T17:49:01.471 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-13T17:49:01.724 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package socat. 2024-09-13T17:49:01.735 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-13T17:49:01.799 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-13T17:49:02.153 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T17:49:02.163 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-13T17:49:02.210 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-13T17:49:02.582 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-test. 2024-09-13T17:49:02.592 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../098-ceph-test_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:49:02.632 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-test (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:02.875 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T17:49:02.891 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../099-ceph-volume_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:49:02.933 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-volume (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:03.304 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-13T17:49:03.319 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:49:03.362 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking cephfs-mirror (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:03.698 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-colorama. 2024-09-13T17:49:03.714 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2024-09-13T17:49:03.756 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-13T17:49:04.040 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package cephfs-shell. 2024-09-13T17:49:04.178 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T17:49:04.178 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../102-cephfs-shell_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:49:04.178 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking cephfs-shell (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:04.180 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../099-ceph-volume_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:49:04.219 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-volume (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:04.345 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package cephfs-top. 2024-09-13T17:49:04.360 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../103-cephfs-top_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:49:04.403 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking cephfs-top (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:04.607 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-13T17:49:04.618 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:49:04.631 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T17:49:04.646 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:49:04.656 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking cephfs-mirror (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:04.680 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libcephfs-dev (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:04.910 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-colorama. 2024-09-13T17:49:04.920 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2024-09-13T17:49:04.960 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-13T17:49:05.025 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T17:49:05.040 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-13T17:49:05.083 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T17:49:05.263 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package cephfs-shell. 2024-09-13T17:49:05.274 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../102-cephfs-shell_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:49:05.312 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking cephfs-shell (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:05.438 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T17:49:05.453 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-13T17:49:05.496 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-13T17:49:05.565 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package cephfs-top. 2024-09-13T17:49:05.576 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../103-cephfs-top_18.2.4-860-g6c6b083f-1jammy_all.deb ... 2024-09-13T17:49:05.606 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking cephfs-top (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:05.868 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T17:49:05.878 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:49:05.916 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T17:49:05.917 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libcephfs-dev (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:05.931 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T17:49:05.982 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T17:49:06.288 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T17:49:06.299 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-13T17:49:06.311 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T17:49:06.326 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-13T17:49:06.369 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-13T17:49:06.374 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T17:49:06.709 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T17:49:06.720 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-13T17:49:06.730 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pygments. 2024-09-13T17:49:06.745 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-13T17:49:06.758 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-13T17:49:06.788 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T17:49:07.204 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T17:49:07.215 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T17:49:07.225 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T17:49:07.240 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-13T17:49:07.262 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T17:49:07.283 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-13T17:49:07.586 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T17:49:07.601 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-13T17:49:07.644 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-13T17:49:07.707 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T17:49:07.721 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-13T17:49:07.757 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-13T17:49:07.947 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T17:49:07.962 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-13T17:49:08.005 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-13T17:49:08.110 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pygments. 2024-09-13T17:49:08.122 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-13T17:49:08.191 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T17:49:08.651 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package radosgw. 2024-09-13T17:49:08.665 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../113-radosgw_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:49:08.672 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T17:49:08.683 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-13T17:49:08.709 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking radosgw (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:08.722 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-13T17:49:09.050 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T17:49:09.062 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-13T17:49:09.101 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-13T17:49:09.287 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T17:49:09.301 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../114-rbd-fuse_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:49:09.336 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking rbd-fuse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:09.352 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T17:49:09.365 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-13T17:49:09.452 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-13T17:49:09.588 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-13T17:49:09.850 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T17:49:09.959 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T17:49:10.206 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package radosgw. 2024-09-13T17:49:10.215 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-13T17:49:10.217 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../113-radosgw_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:49:10.256 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking radosgw (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:10.625 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-13T17:49:11.059 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T17:49:11.070 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../114-rbd-fuse_18.2.4-860-g6c6b083f-1jammy_amd64.deb ... 2024-09-13T17:49:11.100 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking rbd-fuse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:11.245 INFO:teuthology.orchestra.run.smithi114.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-13T17:49:11.299 INFO:teuthology.orchestra.run.smithi114.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-09-13T17:49:11.425 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-13T17:49:11.436 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up cephadm (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:11.697 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T17:49:11.823 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T17:49:11.963 INFO:teuthology.orchestra.run.smithi114.stdout:Adding system user cephadm....done 2024-09-13T17:49:12.108 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-13T17:49:12.109 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T17:49:12.369 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-13T17:49:12.525 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-13T17:49:12.653 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-13T17:49:12.779 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-13T17:49:13.038 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T17:49:13.217 INFO:teuthology.orchestra.run.smithi134.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-13T17:49:13.230 INFO:teuthology.orchestra.run.smithi134.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-09-13T17:49:13.275 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up cephadm (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:13.423 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T17:49:13.551 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-13T17:49:13.827 INFO:teuthology.orchestra.run.smithi134.stdout:Adding system user cephadm....done 2024-09-13T17:49:13.903 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T17:49:13.981 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T17:49:14.258 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-13T17:49:14.271 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-13T17:49:14.525 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-13T17:49:14.547 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-13T17:49:14.635 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-13T17:49:14.807 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-13T17:49:14.878 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T17:49:15.091 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-13T17:49:15.146 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T17:49:15.272 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-13T17:49:15.342 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-13T17:49:15.582 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T17:49:15.610 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-13T17:49:15.886 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-ceph-argparse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:15.967 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-13T17:49:16.154 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T17:49:16.262 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-13T17:49:16.280 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-13T17:49:16.519 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-13T17:49:16.564 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-13T17:49:16.804 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-13T17:49:16.815 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T17:49:16.916 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-13T17:49:17.089 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-13T17:49:17.276 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T17:49:17.402 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-13T17:49:17.481 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-13T17:49:17.678 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T17:49:17.741 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-ceph-argparse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:17.954 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-13T17:49:18.009 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T17:49:18.168 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-13T17:49:18.272 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T17:49:18.411 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-13T17:49:18.688 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T17:49:18.821 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-13T17:49:18.949 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T17:49:19.181 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T17:49:19.208 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T17:49:19.324 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-13T17:49:19.344 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-13T17:49:19.469 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T17:49:19.591 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T17:49:19.859 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-13T17:49:19.937 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-13T17:49:20.177 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T17:49:20.363 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-13T17:49:20.623 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T17:49:20.854 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T17:49:20.999 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T17:49:21.155 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T17:49:21.275 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-13T17:49:21.281 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-13T17:49:21.391 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T17:49:21.585 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T17:49:21.692 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-13T17:49:21.936 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-13T17:49:22.102 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-13T17:49:22.195 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-13T17:49:22.321 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-ceph-common (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:22.402 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T17:49:22.623 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T17:49:22.796 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T17:49:22.957 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T17:49:23.114 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-13T17:49:23.432 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T17:49:23.767 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-13T17:49:24.026 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-13T17:49:24.152 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-ceph-common (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:24.154 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T17:49:24.289 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-13T17:49:24.478 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T17:49:24.565 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T17:49:24.674 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-13T17:49:24.775 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T17:49:24.821 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T17:49:25.077 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-13T17:49:25.344 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-13T17:49:25.604 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T17:49:25.730 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-13T17:49:25.856 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-13T17:49:26.060 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T17:49:26.165 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-13T17:49:26.236 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-13T17:49:26.408 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-13T17:49:26.512 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T17:49:26.639 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-13T17:49:26.668 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-13T17:49:26.806 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T17:49:26.936 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T17:49:27.099 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-13T17:49:27.203 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-13T17:49:27.384 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-13T17:49:27.479 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T17:49:27.605 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-13T17:49:27.635 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T17:49:27.736 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-13T17:49:27.862 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-13T17:49:27.881 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T17:49:27.982 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T17:49:28.197 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-13T17:49:28.258 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T17:49:28.456 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-13T17:49:28.716 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-13T17:49:28.735 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-13T17:49:28.966 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T17:49:28.994 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T17:49:29.234 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-13T17:49:29.429 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-13T17:49:29.502 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T17:49:29.628 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-13T17:49:29.681 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T17:49:29.831 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T17:49:29.913 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T17:49:30.039 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T17:49:30.208 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-13T17:49:30.332 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T17:49:30.459 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-13T17:49:30.624 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-13T17:49:30.727 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T17:49:30.853 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T17:49:30.875 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T17:49:31.179 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T17:49:31.289 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-13T17:49:31.480 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T17:49:31.554 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T17:49:31.713 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T17:49:31.748 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-13T17:49:31.865 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-13T17:49:32.114 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-13T17:49:32.150 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-13T17:49:32.382 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-13T17:49:32.459 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T17:49:32.650 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T17:49:32.727 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-13T17:49:32.776 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T17:49:33.102 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T17:49:33.112 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T17:49:33.413 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T17:49:33.420 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T17:49:33.746 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-13T17:49:33.807 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T17:49:33.872 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-13T17:49:33.933 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librados2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:34.059 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librgw2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:34.173 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-13T17:49:34.270 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:34.396 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libcephfs2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:34.433 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T17:49:34.505 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libradosstriper1 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:34.607 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-13T17:49:34.684 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-13T17:49:34.917 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librbd1 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:35.051 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:35.094 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T17:49:35.177 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-fuse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:35.386 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T17:49:35.387 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T17:49:35.403 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T17:49:35.756 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T17:49:35.882 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librados2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:36.029 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libcephfs-dev (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:36.033 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librgw2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:36.155 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-rados (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:36.236 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:36.264 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up cephfs-top (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:36.365 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T17:49:36.370 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libcephfs2 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:36.497 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libradosstriper1 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:36.656 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-13T17:49:36.958 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librbd1 (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:37.084 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:37.193 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-fuse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:37.431 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T17:49:37.431 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T17:49:37.603 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-rbd (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:37.729 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up rbd-fuse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:37.855 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-rgw (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:37.956 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cephfs (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:38.057 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up cephfs-shell (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:38.064 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libcephfs-dev (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:38.166 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-common (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:38.173 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rados (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:38.274 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up cephfs-top (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:38.391 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T17:49:38.736 INFO:teuthology.orchestra.run.smithi114.stdout:Adding group ceph....done 2024-09-13T17:49:39.104 INFO:teuthology.orchestra.run.smithi114.stdout:Adding system user ceph....done 2024-09-13T17:49:39.281 INFO:teuthology.orchestra.run.smithi114.stdout:Setting system user ceph properties....done 2024-09-13T17:49:39.302 INFO:teuthology.orchestra.run.smithi114.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T17:49:39.440 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T17:49:39.729 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rbd (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:39.849 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T17:49:39.863 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up rbd-fuse (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:39.989 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rgw (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:40.115 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cephfs (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:40.241 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up cephfs-shell (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:40.384 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-common (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:40.535 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up cephfs-mirror (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:40.859 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:49:40.860 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:49:40.879 INFO:teuthology.orchestra.run.smithi134.stdout:Adding group ceph....done 2024-09-13T17:49:41.271 INFO:teuthology.orchestra.run.smithi134.stdout:Adding system user ceph....done 2024-09-13T17:49:41.495 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-test (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:41.621 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up radosgw (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:41.716 INFO:teuthology.orchestra.run.smithi134.stdout:Setting system user ceph properties....done 2024-09-13T17:49:41.732 INFO:teuthology.orchestra.run.smithi134.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T17:49:41.877 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T17:49:42.170 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:49:42.171 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:49:42.279 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T17:49:42.839 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-base (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:42.976 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up cephfs-mirror (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:43.180 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:49:43.180 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:49:43.206 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T17:49:43.837 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-test (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:43.849 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mds (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:44.039 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up radosgw (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:44.308 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T17:49:44.308 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T17:49:44.740 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:49:44.740 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:49:45.012 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:45.310 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T17:49:45.310 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T17:49:45.423 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-base (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:45.781 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T17:49:45.929 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-osd (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:46.244 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T17:49:46.244 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T17:49:46.416 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mds (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:46.640 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T17:49:46.640 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T17:49:46.889 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:47.065 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:47.224 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mon (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:47.277 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:47.433 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T17:49:47.433 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T17:49:47.489 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T17:49:47.489 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T17:49:48.034 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:48.153 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-osd (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:48.177 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:48.336 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:48.484 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T17:49:48.484 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T17:49:48.496 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-volume (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:48.873 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T17:49:49.129 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:49.255 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:49.373 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mon (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:49.573 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T17:49:49.574 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T17:49:49.741 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T17:49:50.199 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:50.223 INFO:teuthology.orchestra.run.smithi114.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T17:49:50.232 DEBUG:teuthology.orchestra.run.smithi114:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-13T17:49:50.309 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2024-09-13T17:49:50.375 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:50.499 INFO:teuthology.orchestra.run.smithi114.stdout:Building dependency tree... 2024-09-13T17:49:50.500 INFO:teuthology.orchestra.run.smithi114.stdout:Reading state information... 2024-09-13T17:49:50.501 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:50.645 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-volume (18.2.4-860-g6c6b083f-1jammy) ... 2024-09-13T17:49:50.685 INFO:teuthology.orchestra.run.smithi114.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-13T17:49:50.685 INFO:teuthology.orchestra.run.smithi114.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-13T17:49:50.685 INFO:teuthology.orchestra.run.smithi114.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-13T17:49:50.685 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T17:49:50.685 INFO:teuthology.orchestra.run.smithi114.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T17:49:50.685 INFO:teuthology.orchestra.run.smithi114.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T17:49:50.685 INFO:teuthology.orchestra.run.smithi114.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T17:49:50.686 INFO:teuthology.orchestra.run.smithi114.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T17:49:50.686 INFO:teuthology.orchestra.run.smithi114.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T17:49:50.686 INFO:teuthology.orchestra.run.smithi114.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T17:49:50.687 INFO:teuthology.orchestra.run.smithi114.stdout:The following additional packages will be installed: 2024-09-13T17:49:50.687 INFO:teuthology.orchestra.run.smithi114.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-13T17:49:50.687 INFO:teuthology.orchestra.run.smithi114.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-13T17:49:50.688 INFO:teuthology.orchestra.run.smithi114.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-13T17:49:50.688 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-13T17:49:50.688 INFO:teuthology.orchestra.run.smithi114.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T17:49:50.689 INFO:teuthology.orchestra.run.smithi114.stdout:Suggested packages: 2024-09-13T17:49:50.689 INFO:teuthology.orchestra.run.smithi114.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-13T17:49:50.689 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-13T17:49:50.689 INFO:teuthology.orchestra.run.smithi114.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-13T17:49:50.745 INFO:teuthology.orchestra.run.smithi114.stdout:The following NEW packages will be installed: 2024-09-13T17:49:50.745 INFO:teuthology.orchestra.run.smithi114.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-13T17:49:50.746 INFO:teuthology.orchestra.run.smithi114.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-13T17:49:50.746 INFO:teuthology.orchestra.run.smithi114.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-13T17:49:50.746 INFO:teuthology.orchestra.run.smithi114.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-13T17:49:50.747 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-13T17:49:50.747 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-13T17:49:50.747 INFO:teuthology.orchestra.run.smithi114.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T17:49:50.748 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages will be upgraded: 2024-09-13T17:49:50.748 INFO:teuthology.orchestra.run.smithi114.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-13T17:49:50.804 INFO:teuthology.orchestra.run.smithi114.stdout:4 upgraded, 39 newly installed, 0 to remove and 330 not upgraded. 2024-09-13T17:49:50.805 INFO:teuthology.orchestra.run.smithi114.stdout:Need to get 55.8 MB of archives. 2024-09-13T17:49:50.805 INFO:teuthology.orchestra.run.smithi114.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-13T17:49:50.805 INFO:teuthology.orchestra.run.smithi114.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-13T17:49:50.943 INFO:teuthology.orchestra.run.smithi114.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-13T17:49:50.946 INFO:teuthology.orchestra.run.smithi114.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-13T17:49:50.974 INFO:teuthology.orchestra.run.smithi114.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-13T17:49:50.974 INFO:teuthology.orchestra.run.smithi114.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-13T17:49:50.975 INFO:teuthology.orchestra.run.smithi114.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-13T17:49:50.982 INFO:teuthology.orchestra.run.smithi114.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-13T17:49:50.983 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-13T17:49:50.985 INFO:teuthology.orchestra.run.smithi114.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-13T17:49:50.986 INFO:teuthology.orchestra.run.smithi114.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-13T17:49:50.986 INFO:teuthology.orchestra.run.smithi114.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-13T17:49:50.987 INFO:teuthology.orchestra.run.smithi114.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-13T17:49:50.995 INFO:teuthology.orchestra.run.smithi114.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-13T17:49:50.996 INFO:teuthology.orchestra.run.smithi114.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-13T17:49:50.996 INFO:teuthology.orchestra.run.smithi114.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-13T17:49:51.005 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T17:49:51.013 INFO:teuthology.orchestra.run.smithi114.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-13T17:49:51.222 INFO:teuthology.orchestra.run.smithi114.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-13T17:49:51.223 INFO:teuthology.orchestra.run.smithi114.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-13T17:49:51.224 INFO:teuthology.orchestra.run.smithi114.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-13T17:49:51.227 INFO:teuthology.orchestra.run.smithi114.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-13T17:49:51.227 INFO:teuthology.orchestra.run.smithi114.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-13T17:49:51.232 INFO:teuthology.orchestra.run.smithi114.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-13T17:49:51.233 INFO:teuthology.orchestra.run.smithi114.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-13T17:49:51.241 INFO:teuthology.orchestra.run.smithi114.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-13T17:49:51.241 INFO:teuthology.orchestra.run.smithi114.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-13T17:49:51.261 INFO:teuthology.orchestra.run.smithi114.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-13T17:49:51.262 INFO:teuthology.orchestra.run.smithi114.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-13T17:49:51.271 INFO:teuthology.orchestra.run.smithi114.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-13T17:49:51.291 INFO:teuthology.orchestra.run.smithi114.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-13T17:49:51.294 INFO:teuthology.orchestra.run.smithi114.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-13T17:49:51.295 INFO:teuthology.orchestra.run.smithi114.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-13T17:49:51.296 INFO:teuthology.orchestra.run.smithi114.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-13T17:49:51.296 INFO:teuthology.orchestra.run.smithi114.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-13T17:49:51.308 INFO:teuthology.orchestra.run.smithi114.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-13T17:49:51.310 INFO:teuthology.orchestra.run.smithi114.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-13T17:49:51.454 INFO:teuthology.orchestra.run.smithi114.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-13T17:49:51.454 INFO:teuthology.orchestra.run.smithi114.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-13T17:49:51.454 INFO:teuthology.orchestra.run.smithi114.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-13T17:49:51.454 INFO:teuthology.orchestra.run.smithi114.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-13T17:49:51.454 INFO:teuthology.orchestra.run.smithi114.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-13T17:49:51.455 INFO:teuthology.orchestra.run.smithi114.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-13T17:49:51.467 INFO:teuthology.orchestra.run.smithi114.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-13T17:49:51.468 INFO:teuthology.orchestra.run.smithi114.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-13T17:49:51.804 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T17:49:51.852 INFO:teuthology.orchestra.run.smithi114.stdout:Preconfiguring packages ... 2024-09-13T17:49:52.000 INFO:teuthology.orchestra.run.smithi114.stdout:Fetched 55.8 MB in 1s (78.4 MB/s) 2024-09-13T17:49:52.343 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140170 files and directories currently installed.) 2024-09-13T17:49:52.346 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-13T17:49:52.358 INFO:teuthology.orchestra.run.smithi134.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T17:49:52.363 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-13T17:49:52.439 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-09-13T17:49:52.523 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-13T17:49:52.623 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2024-09-13T17:49:52.624 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2024-09-13T17:49:52.806 INFO:teuthology.orchestra.run.smithi134.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-13T17:49:52.806 INFO:teuthology.orchestra.run.smithi134.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-13T17:49:52.806 INFO:teuthology.orchestra.run.smithi134.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-13T17:49:52.806 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T17:49:52.806 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T17:49:52.806 INFO:teuthology.orchestra.run.smithi134.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T17:49:52.806 INFO:teuthology.orchestra.run.smithi134.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T17:49:52.807 INFO:teuthology.orchestra.run.smithi134.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T17:49:52.807 INFO:teuthology.orchestra.run.smithi134.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T17:49:52.807 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T17:49:52.807 INFO:teuthology.orchestra.run.smithi134.stdout:The following additional packages will be installed: 2024-09-13T17:49:52.807 INFO:teuthology.orchestra.run.smithi134.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-13T17:49:52.808 INFO:teuthology.orchestra.run.smithi134.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-13T17:49:52.808 INFO:teuthology.orchestra.run.smithi134.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-13T17:49:52.808 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-13T17:49:52.808 INFO:teuthology.orchestra.run.smithi134.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T17:49:52.810 INFO:teuthology.orchestra.run.smithi134.stdout:Suggested packages: 2024-09-13T17:49:52.810 INFO:teuthology.orchestra.run.smithi134.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-13T17:49:52.810 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-13T17:49:52.811 INFO:teuthology.orchestra.run.smithi134.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-13T17:49:52.866 INFO:teuthology.orchestra.run.smithi134.stdout:The following NEW packages will be installed: 2024-09-13T17:49:52.866 INFO:teuthology.orchestra.run.smithi134.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-13T17:49:52.866 INFO:teuthology.orchestra.run.smithi134.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-13T17:49:52.867 INFO:teuthology.orchestra.run.smithi134.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-13T17:49:52.867 INFO:teuthology.orchestra.run.smithi134.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-13T17:49:52.867 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-13T17:49:52.867 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-13T17:49:52.867 INFO:teuthology.orchestra.run.smithi134.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T17:49:52.868 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages will be upgraded: 2024-09-13T17:49:52.869 INFO:teuthology.orchestra.run.smithi134.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-13T17:49:53.054 INFO:teuthology.orchestra.run.smithi134.stdout:4 upgraded, 39 newly installed, 0 to remove and 330 not upgraded. 2024-09-13T17:49:53.054 INFO:teuthology.orchestra.run.smithi134.stdout:Need to get 55.8 MB of archives. 2024-09-13T17:49:53.054 INFO:teuthology.orchestra.run.smithi134.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-13T17:49:53.054 INFO:teuthology.orchestra.run.smithi134.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-13T17:49:53.155 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-13T17:49:53.676 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-13T17:49:53.691 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-13T17:49:53.816 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-13T17:49:53.817 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-13T17:49:53.818 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-13T17:49:53.846 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-13T17:49:53.848 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-13T17:49:53.851 INFO:teuthology.orchestra.run.smithi134.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-13T17:49:53.854 INFO:teuthology.orchestra.run.smithi134.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-13T17:49:53.855 INFO:teuthology.orchestra.run.smithi134.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-13T17:49:53.856 INFO:teuthology.orchestra.run.smithi134.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-13T17:49:53.924 INFO:teuthology.orchestra.run.smithi134.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-13T17:49:53.925 INFO:teuthology.orchestra.run.smithi134.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-13T17:49:53.925 INFO:teuthology.orchestra.run.smithi134.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-13T17:49:54.006 INFO:teuthology.orchestra.run.smithi134.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-13T17:49:54.252 INFO:teuthology.orchestra.run.smithi114.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-13T17:49:54.530 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package flex. 2024-09-13T17:49:54.597 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140170 files and directories currently installed.) 2024-09-13T17:49:54.600 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-13T17:49:54.654 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-13T17:49:54.687 INFO:teuthology.orchestra.run.smithi134.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-13T17:49:54.689 INFO:teuthology.orchestra.run.smithi134.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-13T17:49:54.689 INFO:teuthology.orchestra.run.smithi134.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-13T17:49:54.692 INFO:teuthology.orchestra.run.smithi134.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-13T17:49:54.692 INFO:teuthology.orchestra.run.smithi134.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-13T17:49:54.696 INFO:teuthology.orchestra.run.smithi134.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-13T17:49:54.698 INFO:teuthology.orchestra.run.smithi134.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-13T17:49:54.747 INFO:teuthology.orchestra.run.smithi134.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-13T17:49:54.747 INFO:teuthology.orchestra.run.smithi134.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-13T17:49:54.824 INFO:teuthology.orchestra.run.smithi134.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-13T17:49:54.829 INFO:teuthology.orchestra.run.smithi134.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-13T17:49:54.839 INFO:teuthology.orchestra.run.smithi134.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-13T17:49:54.916 INFO:teuthology.orchestra.run.smithi134.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-13T17:49:54.920 INFO:teuthology.orchestra.run.smithi134.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-13T17:49:54.920 INFO:teuthology.orchestra.run.smithi134.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-13T17:49:54.921 INFO:teuthology.orchestra.run.smithi134.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-13T17:49:54.921 INFO:teuthology.orchestra.run.smithi134.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-13T17:49:54.939 INFO:teuthology.orchestra.run.smithi134.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-13T17:49:54.941 INFO:teuthology.orchestra.run.smithi134.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-13T17:49:55.181 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-13T17:49:55.359 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-13T17:49:55.423 INFO:teuthology.orchestra.run.smithi134.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-13T17:49:55.423 INFO:teuthology.orchestra.run.smithi134.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-13T17:49:55.423 INFO:teuthology.orchestra.run.smithi134.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-13T17:49:55.423 INFO:teuthology.orchestra.run.smithi134.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-13T17:49:55.424 INFO:teuthology.orchestra.run.smithi134.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-13T17:49:55.424 INFO:teuthology.orchestra.run.smithi134.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-13T17:49:55.439 INFO:teuthology.orchestra.run.smithi134.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-13T17:49:55.439 INFO:teuthology.orchestra.run.smithi134.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-13T17:49:55.764 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-13T17:49:55.822 INFO:teuthology.orchestra.run.smithi134.stdout:Preconfiguring packages ... 2024-09-13T17:49:55.964 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 55.8 MB in 3s (21.8 MB/s) 2024-09-13T17:49:56.257 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140170 files and directories currently installed.) 2024-09-13T17:49:56.261 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-13T17:49:56.303 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140243 files and directories currently installed.) 2024-09-13T17:49:56.306 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-13T17:49:56.411 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-13T17:49:56.433 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-13T17:49:56.812 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-13T17:49:56.932 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-13T17:49:57.237 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-13T17:49:57.244 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-13T17:49:57.582 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package bison. 2024-09-13T17:49:57.650 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140243 files and directories currently installed.) 2024-09-13T17:49:57.653 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-13T17:49:57.693 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-13T17:49:58.193 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-13T17:49:58.208 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-13T17:49:58.269 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-13T17:49:58.342 INFO:teuthology.orchestra.run.smithi134.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-13T17:49:58.634 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package flex. 2024-09-13T17:49:58.680 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package dump. 2024-09-13T17:49:58.694 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-13T17:49:58.701 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140170 files and directories currently installed.) 2024-09-13T17:49:58.704 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-13T17:49:58.746 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking dump (0.4b47-3) ... 2024-09-13T17:49:58.757 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-13T17:49:59.042 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package indent. 2024-09-13T17:49:59.056 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-13T17:49:59.108 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-13T17:49:59.285 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-13T17:49:59.454 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-13T17:49:59.804 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-13T17:49:59.819 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-13T17:49:59.870 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-13T17:49:59.894 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-13T17:50:00.274 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-13T17:50:00.318 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-13T17:50:00.340 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-13T17:50:00.440 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140243 files and directories currently installed.) 2024-09-13T17:50:00.443 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-13T17:50:00.561 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-13T17:50:00.618 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-13T17:50:00.634 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-13T17:50:00.677 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-13T17:50:00.989 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-13T17:50:00.990 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-13T17:50:01.005 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-13T17:50:01.047 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-13T17:50:01.126 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-13T17:50:01.299 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-13T17:50:01.315 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-13T17:50:01.357 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-13T17:50:01.430 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-13T17:50:01.610 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libjson-perl. 2024-09-13T17:50:01.626 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-13T17:50:01.668 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-13T17:50:01.859 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package bison. 2024-09-13T17:50:01.933 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140243 files and directories currently installed.) 2024-09-13T17:50:01.938 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-13T17:50:01.987 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-13T17:50:01.989 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-13T17:50:02.004 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-13T17:50:02.038 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-13T17:50:02.446 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-13T17:50:02.461 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-13T17:50:02.496 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-13T17:50:02.857 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package dump. 2024-09-13T17:50:02.872 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-13T17:50:02.916 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking dump (0.4b47-3) ... 2024-09-13T17:50:03.194 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package indent. 2024-09-13T17:50:03.209 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-13T17:50:03.252 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-13T17:50:03.366 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-13T17:50:03.382 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:50:03.425 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T17:50:03.522 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-13T17:50:03.537 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-13T17:50:03.588 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-13T17:50:03.685 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-13T17:50:03.701 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:50:03.744 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T17:50:03.900 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-13T17:50:03.916 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-13T17:50:03.959 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-13T17:50:04.055 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-13T17:50:04.070 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-13T17:50:04.113 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T17:50:04.278 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-13T17:50:04.294 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-13T17:50:04.336 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-13T17:50:04.416 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-13T17:50:04.431 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-13T17:50:04.466 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-13T17:50:04.698 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-13T17:50:04.714 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-13T17:50:04.756 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-13T17:50:04.828 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-13T17:50:04.844 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-13T17:50:04.886 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-13T17:50:04.992 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-13T17:50:05.008 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-13T17:50:05.042 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-13T17:50:05.206 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-13T17:50:05.222 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-13T17:50:05.264 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T17:50:05.320 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libjson-perl. 2024-09-13T17:50:05.336 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-13T17:50:05.378 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-13T17:50:05.625 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-13T17:50:05.641 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-13T17:50:05.681 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-13T17:50:05.684 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T17:50:05.697 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-13T17:50:05.739 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-13T17:50:05.973 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-13T17:50:05.988 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-13T17:50:06.022 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T17:50:06.283 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-13T17:50:06.298 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-13T17:50:06.341 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-13T17:50:06.886 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-13T17:50:06.901 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-13T17:50:06.944 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-13T17:50:07.101 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-13T17:50:07.116 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:50:07.159 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T17:50:07.306 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package modemmanager. 2024-09-13T17:50:07.322 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-13T17:50:07.364 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T17:50:07.462 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-13T17:50:07.478 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T17:50:07.520 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T17:50:07.839 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-13T17:50:07.855 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-13T17:50:07.898 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T17:50:07.996 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package network-manager. 2024-09-13T17:50:08.012 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-13T17:50:08.063 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-13T17:50:08.251 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-13T17:50:08.266 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-13T17:50:08.309 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-13T17:50:08.628 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-13T17:50:08.644 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-13T17:50:08.678 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ppp. 2024-09-13T17:50:08.678 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-13T17:50:08.693 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-13T17:50:09.014 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-13T17:50:09.030 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-13T17:50:09.062 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-13T17:50:09.073 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T17:50:09.375 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package pptp-linux. 2024-09-13T17:50:09.389 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-13T17:50:09.433 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-13T17:50:09.434 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-13T17:50:09.450 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-13T17:50:09.492 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T17:50:09.686 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-13T17:50:09.700 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-13T17:50:09.820 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-13T17:50:09.827 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-13T17:50:09.836 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-13T17:50:09.878 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T17:50:10.138 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-13T17:50:10.154 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-13T17:50:10.190 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-13T17:50:10.197 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-13T17:50:10.205 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-13T17:50:10.241 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-client-common (238) ... 2024-09-13T17:50:10.561 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-13T17:50:10.575 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-13T17:50:10.619 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T17:50:10.659 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-13T17:50:10.674 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-13T17:50:10.709 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-13T17:50:11.070 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package modemmanager. 2024-09-13T17:50:11.086 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-13T17:50:11.128 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T17:50:11.140 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-common. 2024-09-13T17:50:11.155 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-13T17:50:11.208 INFO:teuthology.orchestra.run.smithi114.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-13T17:50:11.238 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-common (238) ... 2024-09-13T17:50:11.793 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package network-manager. 2024-09-13T17:50:11.803 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-13T17:50:11.851 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-13T17:50:11.864 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-14. 2024-09-13T17:50:11.879 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-13T17:50:11.917 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T17:50:12.983 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql. 2024-09-13T17:50:12.998 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-13T17:50:13.042 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql (14+238) ... 2024-09-13T17:50:13.052 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ppp. 2024-09-13T17:50:13.062 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-13T17:50:13.285 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-client. 2024-09-13T17:50:13.300 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-13T17:50:13.344 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-client (14+238) ... 2024-09-13T17:50:13.405 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-13T17:50:13.596 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-13T17:50:13.611 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-13T17:50:13.654 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-13T17:50:13.756 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package pptp-linux. 2024-09-13T17:50:13.765 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-13T17:50:13.798 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-13T17:50:13.974 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package tcl8.6. 2024-09-13T17:50:13.988 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-13T17:50:14.024 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-13T17:50:14.034 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-13T17:50:14.043 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-13T17:50:14.084 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-13T17:50:14.301 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package tcl. 2024-09-13T17:50:14.316 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-13T17:50:14.364 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-13T17:50:14.395 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-13T17:50:14.404 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-13T17:50:14.445 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking postgresql-client-common (238) ... 2024-09-13T17:50:14.712 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package wpasupplicant. 2024-09-13T17:50:14.723 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-13T17:50:14.727 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-13T17:50:14.736 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-13T17:50:14.770 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-13T17:50:14.807 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T17:50:15.100 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-13T17:50:15.115 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-13T17:50:15.166 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-13T17:50:15.294 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package postgresql-common. 2024-09-13T17:50:15.308 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-13T17:50:15.371 INFO:teuthology.orchestra.run.smithi134.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-13T17:50:15.418 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking postgresql-common (238) ... 2024-09-13T17:50:15.536 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-13T17:50:15.550 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-13T17:50:15.594 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-13T17:50:15.885 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package postgresql-14. 2024-09-13T17:50:15.885 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-client-common (238) ... 2024-09-13T17:50:15.897 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-13T17:50:15.938 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T17:50:16.067 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-13T17:50:16.193 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-13T17:50:16.319 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T17:50:16.445 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-13T17:50:16.571 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-13T17:50:16.739 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T17:50:17.029 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package postgresql. 2024-09-13T17:50:17.040 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-13T17:50:17.078 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking postgresql (14+238) ... 2024-09-13T17:50:17.339 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package postgresql-client. 2024-09-13T17:50:17.350 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-13T17:50:17.397 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking postgresql-client (14+238) ... 2024-09-13T17:50:17.616 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-13T17:50:17.627 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-13T17:50:17.666 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-13T17:50:17.668 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-13T17:50:17.769 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-13T17:50:18.010 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package tcl8.6. 2024-09-13T17:50:18.022 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-13T17:50:18.060 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-13T17:50:18.171 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T17:50:18.171 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T17:50:18.346 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package tcl. 2024-09-13T17:50:18.358 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-13T17:50:18.401 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-13T17:50:18.872 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-13T17:50:18.890 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package wpasupplicant. 2024-09-13T17:50:18.903 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-13T17:50:18.932 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-13T17:50:18.998 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-13T17:50:19.141 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-13T17:50:19.259 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-13T17:50:19.319 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-13T17:50:19.331 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-13T17:50:19.369 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-13T17:50:19.384 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-13T17:50:19.510 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-13T17:50:19.636 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-13T17:50:19.762 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-13T17:50:19.780 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-13T17:50:19.792 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-13T17:50:19.839 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-13T17:50:20.112 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up postgresql-client-common (238) ... 2024-09-13T17:50:20.336 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-13T17:50:20.462 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-13T17:50:20.588 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T17:50:20.714 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-13T17:50:20.777 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-13T17:50:20.834 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-13T17:50:20.902 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up dump (0.4b47-3) ... 2024-09-13T17:50:20.976 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T17:50:20.997 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-13T17:50:21.062 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T17:50:21.188 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-13T17:50:21.323 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-13T17:50:21.440 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-13T17:50:21.542 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-13T17:50:21.614 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-13T17:50:21.710 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-13T17:50:21.916 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-13T17:50:22.015 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-13T17:50:22.019 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-13T17:50:22.195 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-13T17:50:22.321 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T17:50:22.444 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T17:50:22.444 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T17:50:22.447 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-13T17:50:22.615 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-client (14+238) ... 2024-09-13T17:50:22.733 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-13T17:50:23.185 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-13T17:50:23.285 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-13T17:50:23.321 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:23.321 INFO:teuthology.orchestra.run.smithi114.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-13T17:50:23.321 INFO:teuthology.orchestra.run.smithi114.stdout:which means they are currently configured by ifupdown: 2024-09-13T17:50:23.321 INFO:teuthology.orchestra.run.smithi114.stdout:- enp3s0f1 2024-09-13T17:50:23.321 INFO:teuthology.orchestra.run.smithi114.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-13T17:50:23.321 INFO:teuthology.orchestra.run.smithi114.stdout:remove their configuration from /etc/network/interfaces. 2024-09-13T17:50:23.321 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:23.445 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-13T17:50:23.453 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-13T17:50:23.571 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-13T17:50:23.772 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-13T17:50:23.877 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-13T17:50:23.898 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-13T17:50:24.024 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-13T17:50:24.175 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-13T17:50:24.310 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-13T17:50:24.838 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-13T17:50:24.964 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up dump (0.4b47-3) ... 2024-09-13T17:50:25.010 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T17:50:25.059 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-13T17:50:25.123 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T17:50:25.162 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-13T17:50:25.285 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-13T17:50:25.287 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-13T17:50:25.417 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-13T17:50:25.439 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-common (238) ... 2024-09-13T17:50:25.543 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-13T17:50:25.652 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-13T17:50:25.734 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-13T17:50:25.804 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-13T17:50:25.955 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-13T17:50:26.131 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-13T17:50:26.257 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T17:50:26.333 INFO:teuthology.orchestra.run.smithi114.stdout:Adding user postgres to group ssl-cert 2024-09-13T17:50:26.391 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-13T17:50:26.585 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up postgresql-client (14+238) ... 2024-09-13T17:50:26.587 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:26.587 INFO:teuthology.orchestra.run.smithi114.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-13T17:50:26.710 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-13T17:50:26.847 INFO:teuthology.orchestra.run.smithi114.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-13T17:50:26.848 INFO:teuthology.orchestra.run.smithi114.stdout:Removing obsolete dictionary files: 2024-09-13T17:50:27.249 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:27.249 INFO:teuthology.orchestra.run.smithi134.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-13T17:50:27.249 INFO:teuthology.orchestra.run.smithi134.stdout:which means they are currently configured by ifupdown: 2024-09-13T17:50:27.249 INFO:teuthology.orchestra.run.smithi134.stdout:- enp3s0f1 2024-09-13T17:50:27.249 INFO:teuthology.orchestra.run.smithi134.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-13T17:50:27.249 INFO:teuthology.orchestra.run.smithi134.stdout:remove their configuration from /etc/network/interfaces. 2024-09-13T17:50:27.250 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:27.381 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-13T17:50:27.587 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-13T17:50:27.780 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-13T17:50:28.065 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T17:50:28.181 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-13T17:50:28.401 INFO:teuthology.orchestra.run.smithi114.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-13T17:50:28.418 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-13T17:50:28.474 INFO:teuthology.orchestra.run.smithi114.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-13T17:50:28.474 INFO:teuthology.orchestra.run.smithi114.stdout:This user must also own the server process. 2024-09-13T17:50:28.474 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:28.474 INFO:teuthology.orchestra.run.smithi114.stdout:The database cluster will be initialized with locale "en_US". 2024-09-13T17:50:28.474 INFO:teuthology.orchestra.run.smithi114.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-13T17:50:28.474 INFO:teuthology.orchestra.run.smithi114.stdout:The default text search configuration will be set to "english". 2024-09-13T17:50:28.474 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:28.475 INFO:teuthology.orchestra.run.smithi114.stdout:Data page checksums are disabled. 2024-09-13T17:50:28.475 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:28.475 INFO:teuthology.orchestra.run.smithi114.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-13T17:50:28.475 INFO:teuthology.orchestra.run.smithi114.stdout:creating subdirectories ... ok 2024-09-13T17:50:28.475 INFO:teuthology.orchestra.run.smithi114.stdout:selecting dynamic shared memory implementation ... posix 2024-09-13T17:50:28.499 INFO:teuthology.orchestra.run.smithi114.stdout:selecting default max_connections ... 100 2024-09-13T17:50:28.533 INFO:teuthology.orchestra.run.smithi114.stdout:selecting default shared_buffers ... 128MB 2024-09-13T17:50:28.547 INFO:teuthology.orchestra.run.smithi114.stdout:selecting default time zone ... Etc/UTC 2024-09-13T17:50:28.547 INFO:teuthology.orchestra.run.smithi114.stdout:creating configuration files ... ok 2024-09-13T17:50:28.707 INFO:teuthology.orchestra.run.smithi114.stdout:running bootstrap script ... ok 2024-09-13T17:50:28.871 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T17:50:29.047 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-13T17:50:29.173 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-13T17:50:29.308 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up postgresql-common (238) ... 2024-09-13T17:50:29.323 INFO:teuthology.orchestra.run.smithi114.stdout:performing post-bootstrap initialization ... ok 2024-09-13T17:50:29.856 INFO:teuthology.orchestra.run.smithi114.stdout:syncing data to disk ... ok 2024-09-13T17:50:30.171 INFO:teuthology.orchestra.run.smithi134.stdout:Adding user postgres to group ssl-cert 2024-09-13T17:50:30.382 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-13T17:50:30.420 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:30.421 INFO:teuthology.orchestra.run.smithi134.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-13T17:50:30.667 INFO:teuthology.orchestra.run.smithi134.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-13T17:50:30.667 INFO:teuthology.orchestra.run.smithi134.stdout:Removing obsolete dictionary files: 2024-09-13T17:50:31.409 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-13T17:50:31.867 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T17:50:32.206 INFO:teuthology.orchestra.run.smithi134.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-13T17:50:32.229 INFO:teuthology.orchestra.run.smithi134.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-13T17:50:32.275 INFO:teuthology.orchestra.run.smithi134.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-13T17:50:32.275 INFO:teuthology.orchestra.run.smithi134.stdout:This user must also own the server process. 2024-09-13T17:50:32.275 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:32.275 INFO:teuthology.orchestra.run.smithi134.stdout:The database cluster will be initialized with locale "en_US". 2024-09-13T17:50:32.275 INFO:teuthology.orchestra.run.smithi134.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-13T17:50:32.276 INFO:teuthology.orchestra.run.smithi134.stdout:The default text search configuration will be set to "english". 2024-09-13T17:50:32.276 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:32.276 INFO:teuthology.orchestra.run.smithi134.stdout:Data page checksums are disabled. 2024-09-13T17:50:32.276 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:32.276 INFO:teuthology.orchestra.run.smithi134.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-13T17:50:32.276 INFO:teuthology.orchestra.run.smithi134.stdout:creating subdirectories ... ok 2024-09-13T17:50:32.277 INFO:teuthology.orchestra.run.smithi134.stdout:selecting dynamic shared memory implementation ... posix 2024-09-13T17:50:32.300 INFO:teuthology.orchestra.run.smithi134.stdout:selecting default max_connections ... 100 2024-09-13T17:50:32.334 INFO:teuthology.orchestra.run.smithi134.stdout:selecting default shared_buffers ... 128MB 2024-09-13T17:50:32.348 INFO:teuthology.orchestra.run.smithi134.stdout:selecting default time zone ... Etc/UTC 2024-09-13T17:50:32.349 INFO:teuthology.orchestra.run.smithi134.stdout:creating configuration files ... ok 2024-09-13T17:50:32.510 INFO:teuthology.orchestra.run.smithi134.stdout:running bootstrap script ... ok 2024-09-13T17:50:33.121 INFO:teuthology.orchestra.run.smithi134.stdout:performing post-bootstrap initialization ... ok 2024-09-13T17:50:33.664 INFO:teuthology.orchestra.run.smithi134.stdout:syncing data to disk ... ok 2024-09-13T17:50:33.748 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T17:50:33.873 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-13T17:50:34.016 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql (14+238) ... 2024-09-13T17:50:34.133 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T17:50:34.182 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-13T17:50:34.234 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T17:50:34.486 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T17:50:34.486 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T17:50:35.262 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-13T17:50:35.463 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-13T17:50:35.815 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T17:50:35.958 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T17:50:37.274 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T17:50:37.319 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-13T17:50:37.400 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-13T17:50:37.419 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-13T17:50:37.526 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up postgresql (14+238) ... 2024-09-13T17:50:37.652 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T17:50:37.795 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T17:50:38.030 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T17:50:38.030 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T17:50:38.131 INFO:teuthology.orchestra.run.smithi114.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T17:50:38.140 DEBUG:teuthology.parallel:result is None 2024-09-13T17:50:38.813 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-13T17:50:39.056 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-13T17:50:39.392 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T17:50:39.543 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T17:50:40.995 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-13T17:50:41.087 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-13T17:50:41.786 INFO:teuthology.orchestra.run.smithi134.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T17:50:41.793 DEBUG:teuthology.parallel:result is None 2024-09-13T17:50:41.794 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:50:41.957 DEBUG:teuthology.orchestra.run.smithi114:> dpkg-query -W -f '${Version}' ceph 2024-09-13T17:50:41.981 INFO:teuthology.orchestra.run.smithi114.stdout:18.2.4-860-g6c6b083f-1jammy 2024-09-13T17:50:41.981 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860-g6c6b083f-1jammy 2024-09-13T17:50:41.982 INFO:teuthology.task.install:The correct ceph version 18.2.4-860-g6c6b083f-1jammy is installed. 2024-09-13T17:50:41.984 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:50:42.132 DEBUG:teuthology.orchestra.run.smithi134:> dpkg-query -W -f '${Version}' ceph 2024-09-13T17:50:42.154 INFO:teuthology.orchestra.run.smithi134.stdout:18.2.4-860-g6c6b083f-1jammy 2024-09-13T17:50:42.154 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860-g6c6b083f-1jammy 2024-09-13T17:50:42.154 INFO:teuthology.task.install:The correct ceph version 18.2.4-860-g6c6b083f-1jammy is installed. 2024-09-13T17:50:42.156 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T17:50:42.156 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:50:42.157 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T17:50:42.179 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:50:42.179 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T17:50:42.214 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T17:50:42.214 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:50:42.214 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T17:50:42.240 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T17:50:42.308 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:50:42.308 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T17:50:42.327 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T17:50:42.385 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T17:50:42.385 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:50:42.385 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T17:50:42.406 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T17:50:42.467 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:50:42.467 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T17:50:42.486 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T17:50:42.545 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T17:50:42.545 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:50:42.545 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T17:50:42.566 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T17:50:42.627 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:50:42.627 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T17:50:42.646 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T17:50:42.705 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T17:50:42.781 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T17:50:42.782 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 777 /var/log/ceph 2024-09-13T17:50:42.785 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /var/log/ceph 2024-09-13T17:50:42.803 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T17:50:42.803 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T17:50:42.847 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T17:50:42.864 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T17:50:42.865 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T17:50:42.906 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T17:50:42.931 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-13T17:50:42.931 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-13T17:50:42.931 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-13T17:50:42.931 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:50:42.932 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T17:50:42.980 DEBUG:teuthology.orchestra.run.smithi114:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T17:50:43.072 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:50:43.073 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T17:50:43.081 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T17:50:43.172 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T17:50:43.172 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'MDS_FAILED', 'MDS_DAMAGE'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T17:50:43.172 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903930', 'branch': 'wip-rishabh-testing-20240910.100730-reef', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/alternate-pool}', 'email': None, 'first_in_suite': False, 'job_id': '7903930', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240910.100730-reef'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'MDS_FAILED', 'MDS_DAMAGE'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'kclient': {'syntax': 'v2'}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240910.100730-reef', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6439, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'sleep_before_teardown': 0, 'subset': '964/1024', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240910.100730-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi114.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKI0Xnox+oCbcfaHzuLiDjccyf34nuO7QIgkICRj5b+G1KG8Pq+y3e345kanLbta2Izg0ACfmd//PvsPpnmPmdM=', 'smithi134.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM55KBtgPRbtb3PXAzxDqzlbL0MzM0vVza8jdk0CbaxFrFLCGkcjQybDh38lQ3L1V6bmYwKb318lqQ4OcJeDPuc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'MDS_FAILED', 'MDS_DAMAGE'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_recovery_pool']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_14:42:16', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T17:50:43.173 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T17:50:43.176 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T17:50:43.219 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T17:50:43.226 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T17:50:43.278 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:50:43.278 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T17:50:43.291 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T17:50:43.292 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_1 2024-09-13T17:50:43.344 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T17:50:43.344 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:50:43.344 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 6h/6d Inode: 885 Links: 1 2024-09-13T17:50:43.344 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:50:43.344 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-09-13 17:44:16.925835191 +0000 2024-09-13T17:50:43.344 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-09-13 17:44:16.681837372 +0000 2024-09-13T17:50:43.344 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-09-13 17:44:16.681837372 +0000 2024-09-13T17:50:43.344 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-09-13 17:44:16.681837372 +0000 2024-09-13T17:50:43.344 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T17:50:43.404 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-09-13T17:50:43.405 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-09-13T17:50:43.405 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000369476 s, 1.4 MB/s 2024-09-13T17:50:43.407 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T17:50:43.457 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_2 2024-09-13T17:50:43.512 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T17:50:43.512 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:50:43.512 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 6h/6d Inode: 900 Links: 1 2024-09-13T17:50:43.512 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:50:43.512 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-09-13 17:44:17.493830117 +0000 2024-09-13T17:50:43.512 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-09-13 17:44:17.221832549 +0000 2024-09-13T17:50:43.512 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-09-13 17:44:17.221832549 +0000 2024-09-13T17:50:43.513 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-09-13 17:44:17.221832549 +0000 2024-09-13T17:50:43.513 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T17:50:43.577 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-09-13T17:50:43.577 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-09-13T17:50:43.577 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.00036624 s, 1.4 MB/s 2024-09-13T17:50:43.579 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T17:50:43.633 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_3 2024-09-13T17:50:43.684 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T17:50:43.684 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:50:43.684 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 6h/6d Inode: 920 Links: 1 2024-09-13T17:50:43.684 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:50:43.684 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-09-13 17:44:18.029825331 +0000 2024-09-13T17:50:43.684 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-09-13 17:44:17.773827617 +0000 2024-09-13T17:50:43.684 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-09-13 17:44:17.773827617 +0000 2024-09-13T17:50:43.684 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-09-13 17:44:17.773827617 +0000 2024-09-13T17:50:43.685 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T17:50:43.749 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-09-13T17:50:43.749 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-09-13T17:50:43.750 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000361593 s, 1.4 MB/s 2024-09-13T17:50:43.751 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T17:50:43.801 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_4 2024-09-13T17:50:43.852 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T17:50:43.852 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:50:43.852 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 6h/6d Inode: 934 Links: 1 2024-09-13T17:50:43.852 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:50:43.853 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-09-13 17:44:18.637819899 +0000 2024-09-13T17:50:43.853 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-09-13 17:44:18.349822473 +0000 2024-09-13T17:50:43.853 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-09-13 17:44:18.349822473 +0000 2024-09-13T17:50:43.853 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-09-13 17:44:18.349822473 +0000 2024-09-13T17:50:43.853 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T17:50:43.913 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-09-13T17:50:43.914 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-09-13T17:50:43.914 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000370979 s, 1.4 MB/s 2024-09-13T17:50:43.915 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T17:50:43.965 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T17:50:43.965 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:50:43.966 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T17:50:43.974 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T17:50:43.974 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2024-09-13T17:50:44.023 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T17:50:44.024 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:50:44.024 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 884 Links: 1 2024-09-13T17:50:44.024 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:50:44.024 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-13 17:44:19.565001086 +0000 2024-09-13T17:50:44.024 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-13 17:44:19.293003515 +0000 2024-09-13T17:50:44.024 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-13 17:44:19.293003515 +0000 2024-09-13T17:50:44.024 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-13 17:44:19.293003515 +0000 2024-09-13T17:50:44.024 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T17:50:44.085 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-13T17:50:44.085 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-13T17:50:44.085 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000396541 s, 1.3 MB/s 2024-09-13T17:50:44.087 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T17:50:44.141 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2024-09-13T17:50:44.191 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T17:50:44.191 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:50:44.191 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 902 Links: 1 2024-09-13T17:50:44.192 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:50:44.192 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-13 17:44:20.152995833 +0000 2024-09-13T17:50:44.192 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-13 17:44:19.892998155 +0000 2024-09-13T17:50:44.192 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-13 17:44:19.892998155 +0000 2024-09-13T17:50:44.192 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-13 17:44:19.892998155 +0000 2024-09-13T17:50:44.192 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T17:50:44.253 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-13T17:50:44.254 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-13T17:50:44.254 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000382138 s, 1.3 MB/s 2024-09-13T17:50:44.256 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T17:50:44.314 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2024-09-13T17:50:44.364 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T17:50:44.364 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:50:44.364 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 921 Links: 1 2024-09-13T17:50:44.364 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:50:44.364 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-13 17:44:20.728990689 +0000 2024-09-13T17:50:44.364 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-13 17:44:20.448993190 +0000 2024-09-13T17:50:44.364 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-13 17:44:20.448993190 +0000 2024-09-13T17:50:44.364 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-13 17:44:20.448993190 +0000 2024-09-13T17:50:44.365 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T17:50:44.426 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-13T17:50:44.426 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-13T17:50:44.426 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000637841 s, 803 kB/s 2024-09-13T17:50:44.428 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T17:50:44.486 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2024-09-13T17:50:44.535 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T17:50:44.536 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:50:44.536 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 937 Links: 1 2024-09-13T17:50:44.536 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:50:44.536 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-13 17:44:21.304985544 +0000 2024-09-13T17:50:44.536 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-13 17:44:21.024988044 +0000 2024-09-13T17:50:44.536 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-13 17:44:21.024988044 +0000 2024-09-13T17:50:44.536 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-13 17:44:21.024988044 +0000 2024-09-13T17:50:44.536 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T17:50:44.597 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-13T17:50:44.597 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-13T17:50:44.598 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.00040417 s, 1.3 MB/s 2024-09-13T17:50:44.599 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T17:50:44.653 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T17:50:44.654 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi114.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T17:50:44.654 INFO:tasks.ceph:Generating config... 2024-09-13T17:50:44.655 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-13T17:50:44.655 INFO:tasks.ceph:[client] debug client = 20 2024-09-13T17:50:44.655 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T17:50:44.655 INFO:tasks.ceph:[client] pid file = 2024-09-13T17:50:44.655 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-13T17:50:44.655 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-13T17:50:44.655 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-13T17:50:44.656 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-13T17:50:44.656 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-13T17:50:44.656 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-13T17:50:44.656 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-13T17:50:44.656 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-13T17:50:44.656 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-13T17:50:44.656 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-13T17:50:44.656 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-13T17:50:44.656 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-13T17:50:44.656 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-13T17:50:44.656 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-13T17:50:44.656 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T17:50:44.656 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T17:50:44.656 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T17:50:44.657 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T17:50:44.657 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T17:50:44.657 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-13T17:50:44.657 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-13T17:50:44.657 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T17:50:44.657 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T17:50:44.657 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-13T17:50:44.657 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-13T17:50:44.657 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T17:50:44.657 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T17:50:44.657 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-13T17:50:44.657 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T17:50:44.657 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T17:50:44.657 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T17:50:44.658 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T17:50:44.658 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T17:50:44.658 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-13T17:50:44.658 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T17:50:44.658 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T17:50:44.702 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T17:50:44.719 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T17:50:44.806 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T17:50:44.867 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.114'), ('mon.b', '172.21.15.134'), ('mon.c', '[v2:172.21.15.134:3301,v1:172.21.15.134:6790]')] 2024-09-13T17:50:44.868 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.114,172.21.15.134,[v2:172.21.15.134:3301,v1:172.21.15.134:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-13T17:50:44.868 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:50:44.868 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T17:50:44.920 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.114 --add b 172.21.15.134 --addv c '[v2:172.21.15.134:3301,v1:172.21.15.134:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:50:45.010 INFO:teuthology.orchestra.run.smithi114.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:50:45.010 INFO:teuthology.orchestra.run.smithi114.stdout:monmaptool: generated fsid d730423f-882d-4061-b746-f6a7dc2544e0 2024-09-13T17:50:45.010 INFO:teuthology.orchestra.run.smithi114.stdout:setting min_mon_release = pacific 2024-09-13T17:50:45.010 INFO:teuthology.orchestra.run.smithi114.stdout:epoch 0 2024-09-13T17:50:45.010 INFO:teuthology.orchestra.run.smithi114.stdout:fsid d730423f-882d-4061-b746-f6a7dc2544e0 2024-09-13T17:50:45.010 INFO:teuthology.orchestra.run.smithi114.stdout:last_changed 2024-09-13T17:50:45.011395+0000 2024-09-13T17:50:45.010 INFO:teuthology.orchestra.run.smithi114.stdout:created 2024-09-13T17:50:45.011395+0000 2024-09-13T17:50:45.010 INFO:teuthology.orchestra.run.smithi114.stdout:min_mon_release 16 (pacific) 2024-09-13T17:50:45.010 INFO:teuthology.orchestra.run.smithi114.stdout:election_strategy: 1 2024-09-13T17:50:45.010 INFO:teuthology.orchestra.run.smithi114.stdout:0: [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] mon.a 2024-09-13T17:50:45.010 INFO:teuthology.orchestra.run.smithi114.stdout:1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.b 2024-09-13T17:50:45.011 INFO:teuthology.orchestra.run.smithi114.stdout:2: [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] mon.c 2024-09-13T17:50:45.011 INFO:teuthology.orchestra.run.smithi114.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-13T17:50:45.013 DEBUG:teuthology.orchestra.run.smithi114:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T17:50:45.021 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d730423f-882d-4061-b746-f6a7dc2544e0... 2024-09-13T17:50:45.021 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T17:50:45.066 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T17:50:45.105 INFO:teuthology.orchestra.run.smithi114.stdout:[global] 2024-09-13T17:50:45.105 INFO:teuthology.orchestra.run.smithi114.stdout: chdir = "" 2024-09-13T17:50:45.105 INFO:teuthology.orchestra.run.smithi114.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T17:50:45.105 INFO:teuthology.orchestra.run.smithi114.stdout: auth supported = cephx 2024-09-13T17:50:45.105 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.105 INFO:teuthology.orchestra.run.smithi114.stdout: filestore xattr use omap = true 2024-09-13T17:50:45.106 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.106 INFO:teuthology.orchestra.run.smithi114.stdout: mon clock drift allowed = 1.000 2024-09-13T17:50:45.106 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.106 INFO:teuthology.orchestra.run.smithi114.stdout: osd crush chooseleaf type = 0 2024-09-13T17:50:45.106 INFO:teuthology.orchestra.run.smithi114.stdout: auth debug = true 2024-09-13T17:50:45.106 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.106 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on old message = true 2024-09-13T17:50:45.106 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on bug = true 2024-09-13T17:50:45.106 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.106 INFO:teuthology.orchestra.run.smithi114.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T17:50:45.106 INFO:teuthology.orchestra.run.smithi114.stdout: mon pg warn max object skew = 0 2024-09-13T17:50:45.106 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.106 INFO:teuthology.orchestra.run.smithi114.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T17:50:45.106 INFO:teuthology.orchestra.run.smithi114.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T17:50:45.106 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.107 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default size = 2 2024-09-13T17:50:45.107 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.107 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow primary affinity = true 2024-09-13T17:50:45.107 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow pg remap = true 2024-09-13T17:50:45.107 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on legacy crush tunables = false 2024-09-13T17:50:45.107 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on crush straw calc version zero = false 2024-09-13T17:50:45.107 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on no sortbitwise = false 2024-09-13T17:50:45.107 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on osd down out interval zero = false 2024-09-13T17:50:45.107 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on too few osds = false 2024-09-13T17:50:45.107 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T17:50:45.107 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T17:50:45.107 INFO:teuthology.orchestra.run.smithi114.stdout: mon_allow_pool_size_one = true 2024-09-13T17:50:45.107 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.107 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T17:50:45.108 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.108 INFO:teuthology.orchestra.run.smithi114.stdout: osd default data pool replay window = 5 2024-09-13T17:50:45.108 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.108 INFO:teuthology.orchestra.run.smithi114.stdout: mon allow pool delete = true 2024-09-13T17:50:45.108 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.108 INFO:teuthology.orchestra.run.smithi114.stdout: mon cluster log file level = debug 2024-09-13T17:50:45.108 INFO:teuthology.orchestra.run.smithi114.stdout: debug asserts on shutdown = true 2024-09-13T17:50:45.108 INFO:teuthology.orchestra.run.smithi114.stdout: mon health detail to clog = false 2024-09-13T17:50:45.108 INFO:teuthology.orchestra.run.smithi114.stdout: mon host = "172.21.15.114,172.21.15.134,[v2:172.21.15.134:3301,v1:172.21.15.134:6790]" 2024-09-13T17:50:45.108 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on skipped message = False 2024-09-13T17:50:45.108 INFO:teuthology.orchestra.run.smithi114.stdout: fsid = d730423f-882d-4061-b746-f6a7dc2544e0 2024-09-13T17:50:45.108 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.108 INFO:teuthology.orchestra.run.smithi114.stdout:[osd] 2024-09-13T17:50:45.108 INFO:teuthology.orchestra.run.smithi114.stdout: osd journal size = 100 2024-09-13T17:50:45.109 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.109 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub load threshold = 5.0 2024-09-13T17:50:45.109 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub max interval = 600 2024-09-13T17:50:45.109 INFO:teuthology.orchestra.run.smithi114.stdout: osd mclock profile = high_recovery_ops 2024-09-13T17:50:45.109 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.109 INFO:teuthology.orchestra.run.smithi114.stdout: osd recover clone overlap = true 2024-09-13T17:50:45.109 INFO:teuthology.orchestra.run.smithi114.stdout: osd recovery max chunk = 1048576 2024-09-13T17:50:45.109 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.109 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug shutdown = true 2024-09-13T17:50:45.109 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug op order = true 2024-09-13T17:50:45.109 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug verify stray on activate = true 2024-09-13T17:50:45.109 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.109 INFO:teuthology.orchestra.run.smithi114.stdout: osd open classes on start = true 2024-09-13T17:50:45.109 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug pg log writeout = true 2024-09-13T17:50:45.110 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.110 INFO:teuthology.orchestra.run.smithi114.stdout: osd deep scrub update digest min age = 30 2024-09-13T17:50:45.110 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.110 INFO:teuthology.orchestra.run.smithi114.stdout: osd map max advance = 10 2024-09-13T17:50:45.110 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.110 INFO:teuthology.orchestra.run.smithi114.stdout: journal zero on create = true 2024-09-13T17:50:45.110 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.110 INFO:teuthology.orchestra.run.smithi114.stdout: filestore ondisk finisher threads = 3 2024-09-13T17:50:45.110 INFO:teuthology.orchestra.run.smithi114.stdout: filestore apply finisher threads = 3 2024-09-13T17:50:45.110 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.110 INFO:teuthology.orchestra.run.smithi114.stdout: bdev debug aio = true 2024-09-13T17:50:45.110 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug misdirected ops = true 2024-09-13T17:50:45.110 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore block size = 96636764160 2024-09-13T17:50:45.110 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore fsck on mount = True 2024-09-13T17:50:45.111 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluefs = 20 2024-09-13T17:50:45.111 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluestore = 20 2024-09-13T17:50:45.111 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-09-13T17:50:45.111 INFO:teuthology.orchestra.run.smithi114.stdout: debug osd = 20 2024-09-13T17:50:45.111 INFO:teuthology.orchestra.run.smithi114.stdout: debug rocksdb = 10 2024-09-13T17:50:45.111 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T17:50:45.111 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd full ratio = 0.9 2024-09-13T17:50:45.111 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd nearfull ratio = 0.8 2024-09-13T17:50:45.111 INFO:teuthology.orchestra.run.smithi114.stdout: osd failsafe full ratio = 0.95 2024-09-13T17:50:45.111 INFO:teuthology.orchestra.run.smithi114.stdout: osd objectstore = bluestore 2024-09-13T17:50:45.111 INFO:teuthology.orchestra.run.smithi114.stdout: osd op complaint time = 180 2024-09-13T17:50:45.111 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.111 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr] 2024-09-13T17:50:45.111 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-09-13T17:50:45.112 INFO:teuthology.orchestra.run.smithi114.stdout: debug mgr = 20 2024-09-13T17:50:45.112 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2024-09-13T17:50:45.112 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2024-09-13T17:50:45.112 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:50:45.112 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:50:45.112 INFO:teuthology.orchestra.run.smithi114.stdout: mgr/telemetry/nag = false 2024-09-13T17:50:45.112 INFO:teuthology.orchestra.run.smithi114.stdout: debug client = 20 2024-09-13T17:50:45.112 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.112 INFO:teuthology.orchestra.run.smithi114.stdout:[mon] 2024-09-13T17:50:45.112 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-09-13T17:50:45.112 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2024-09-13T17:50:45.112 INFO:teuthology.orchestra.run.smithi114.stdout: debug paxos = 20 2024-09-13T17:50:45.112 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2024-09-13T17:50:45.112 INFO:teuthology.orchestra.run.smithi114.stdout: mon data avail warn = 5 2024-09-13T17:50:45.113 INFO:teuthology.orchestra.run.smithi114.stdout: mon mgr mkfs grace = 240 2024-09-13T17:50:45.113 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:50:45.113 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd reporter subtree level = osd 2024-09-13T17:50:45.113 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd prime pg temp = true 2024-09-13T17:50:45.113 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:50:45.113 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.113 INFO:teuthology.orchestra.run.smithi114.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T17:50:45.113 INFO:teuthology.orchestra.run.smithi114.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T17:50:45.113 INFO:teuthology.orchestra.run.smithi114.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T17:50:45.113 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.113 INFO:teuthology.orchestra.run.smithi114.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T17:50:45.113 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T17:50:45.113 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T17:50:45.114 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.114 INFO:teuthology.orchestra.run.smithi114.stdout: # 1m isn't quite enough 2024-09-13T17:50:45.114 INFO:teuthology.orchestra.run.smithi114.stdout: mon_down_mkfs_grace = 2m 2024-09-13T17:50:45.114 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.114 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_filestore_osds = false 2024-09-13T17:50:45.114 INFO:teuthology.orchestra.run.smithi114.stdout: mon op complaint time = 120 2024-09-13T17:50:45.114 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on pool no app = False 2024-09-13T17:50:45.114 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:50:45.114 INFO:teuthology.orchestra.run.smithi114.stdout:[client] 2024-09-13T17:50:45.114 INFO:teuthology.orchestra.run.smithi114.stdout: rgw cache enabled = true 2024-09-13T17:50:45.114 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable ops log = true 2024-09-13T17:50:45.114 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable usage log = true 2024-09-13T17:50:45.114 INFO:teuthology.orchestra.run.smithi114.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T17:50:45.114 INFO:teuthology.orchestra.run.smithi114.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T17:50:45.114 INFO:teuthology.orchestra.run.smithi114.stdout: client mount timeout = 600 2024-09-13T17:50:45.114 INFO:teuthology.orchestra.run.smithi114.stdout: debug client = 20 2024-09-13T17:50:45.115 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-09-13T17:50:45.115 INFO:teuthology.orchestra.run.smithi114.stdout: pid file = "" 2024-09-13T17:50:45.115 INFO:teuthology.orchestra.run.smithi114.stdout: rados mon op timeout = 900 2024-09-13T17:50:45.115 INFO:teuthology.orchestra.run.smithi114.stdout: rados osd op timeout = 900 2024-09-13T17:50:45.115 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.a] 2024-09-13T17:50:45.115 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.b] 2024-09-13T17:50:45.115 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.c] 2024-09-13T17:50:45.115 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.a] 2024-09-13T17:50:45.115 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.c] 2024-09-13T17:50:45.115 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.b] 2024-09-13T17:50:45.115 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.d] 2024-09-13T17:50:45.115 INFO:teuthology.orchestra.run.smithi114.stdout:[mds] 2024-09-13T17:50:45.115 INFO:teuthology.orchestra.run.smithi114.stdout: debug mds = 20 2024-09-13T17:50:45.115 INFO:teuthology.orchestra.run.smithi114.stdout: debug mds balancer = 20 2024-09-13T17:50:45.116 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-09-13T17:50:45.116 INFO:teuthology.orchestra.run.smithi114.stdout: mds debug frag = True 2024-09-13T17:50:45.116 INFO:teuthology.orchestra.run.smithi114.stdout: mds debug scatterstat = True 2024-09-13T17:50:45.116 INFO:teuthology.orchestra.run.smithi114.stdout: mds op complaint time = 180 2024-09-13T17:50:45.116 INFO:teuthology.orchestra.run.smithi114.stdout: mds verify scatter = True 2024-09-13T17:50:45.116 INFO:teuthology.orchestra.run.smithi114.stdout: osd op complaint time = 180 2024-09-13T17:50:45.116 INFO:teuthology.orchestra.run.smithi114.stdout: rados mon op timeout = 900 2024-09-13T17:50:45.116 INFO:teuthology.orchestra.run.smithi114.stdout: rados osd op timeout = 900 2024-09-13T17:50:45.116 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2024-09-13T17:50:45.116 INFO:teuthology.orchestra.run.smithi134.stdout: chdir = "" 2024-09-13T17:50:45.116 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T17:50:45.117 INFO:teuthology.orchestra.run.smithi134.stdout: auth supported = cephx 2024-09-13T17:50:45.117 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.117 INFO:teuthology.orchestra.run.smithi134.stdout: filestore xattr use omap = true 2024-09-13T17:50:45.117 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.117 INFO:teuthology.orchestra.run.smithi134.stdout: mon clock drift allowed = 1.000 2024-09-13T17:50:45.117 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.117 INFO:teuthology.orchestra.run.smithi134.stdout: osd crush chooseleaf type = 0 2024-09-13T17:50:45.117 INFO:teuthology.orchestra.run.smithi134.stdout: auth debug = true 2024-09-13T17:50:45.117 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.117 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on old message = true 2024-09-13T17:50:45.117 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on bug = true 2024-09-13T17:50:45.117 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.117 INFO:teuthology.orchestra.run.smithi134.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T17:50:45.117 INFO:teuthology.orchestra.run.smithi134.stdout: mon pg warn max object skew = 0 2024-09-13T17:50:45.117 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.118 INFO:teuthology.orchestra.run.smithi134.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T17:50:45.118 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T17:50:45.118 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.118 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default size = 2 2024-09-13T17:50:45.118 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.118 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow primary affinity = true 2024-09-13T17:50:45.118 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow pg remap = true 2024-09-13T17:50:45.118 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on legacy crush tunables = false 2024-09-13T17:50:45.118 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on crush straw calc version zero = false 2024-09-13T17:50:45.118 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on no sortbitwise = false 2024-09-13T17:50:45.118 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on osd down out interval zero = false 2024-09-13T17:50:45.118 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on too few osds = false 2024-09-13T17:50:45.118 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T17:50:45.118 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T17:50:45.119 INFO:teuthology.orchestra.run.smithi134.stdout: mon_allow_pool_size_one = true 2024-09-13T17:50:45.119 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.119 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T17:50:45.119 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.119 INFO:teuthology.orchestra.run.smithi134.stdout: osd default data pool replay window = 5 2024-09-13T17:50:45.119 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.119 INFO:teuthology.orchestra.run.smithi134.stdout: mon allow pool delete = true 2024-09-13T17:50:45.119 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.119 INFO:teuthology.orchestra.run.smithi134.stdout: mon cluster log file level = debug 2024-09-13T17:50:45.119 INFO:teuthology.orchestra.run.smithi134.stdout: debug asserts on shutdown = true 2024-09-13T17:50:45.119 INFO:teuthology.orchestra.run.smithi134.stdout: mon health detail to clog = false 2024-09-13T17:50:45.119 INFO:teuthology.orchestra.run.smithi134.stdout: mon host = "172.21.15.114,172.21.15.134,[v2:172.21.15.134:3301,v1:172.21.15.134:6790]" 2024-09-13T17:50:45.119 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on skipped message = False 2024-09-13T17:50:45.120 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = d730423f-882d-4061-b746-f6a7dc2544e0 2024-09-13T17:50:45.120 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.120 INFO:teuthology.orchestra.run.smithi134.stdout:[osd] 2024-09-13T17:50:45.120 INFO:teuthology.orchestra.run.smithi134.stdout: osd journal size = 100 2024-09-13T17:50:45.120 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.120 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub load threshold = 5.0 2024-09-13T17:50:45.120 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub max interval = 600 2024-09-13T17:50:45.120 INFO:teuthology.orchestra.run.smithi134.stdout: osd mclock profile = high_recovery_ops 2024-09-13T17:50:45.120 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.120 INFO:teuthology.orchestra.run.smithi134.stdout: osd recover clone overlap = true 2024-09-13T17:50:45.120 INFO:teuthology.orchestra.run.smithi134.stdout: osd recovery max chunk = 1048576 2024-09-13T17:50:45.120 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.120 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug shutdown = true 2024-09-13T17:50:45.120 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug op order = true 2024-09-13T17:50:45.120 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify stray on activate = true 2024-09-13T17:50:45.121 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.121 INFO:teuthology.orchestra.run.smithi134.stdout: osd open classes on start = true 2024-09-13T17:50:45.121 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug pg log writeout = true 2024-09-13T17:50:45.121 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.121 INFO:teuthology.orchestra.run.smithi134.stdout: osd deep scrub update digest min age = 30 2024-09-13T17:50:45.121 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.121 INFO:teuthology.orchestra.run.smithi134.stdout: osd map max advance = 10 2024-09-13T17:50:45.121 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.121 INFO:teuthology.orchestra.run.smithi134.stdout: journal zero on create = true 2024-09-13T17:50:45.121 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.121 INFO:teuthology.orchestra.run.smithi134.stdout: filestore ondisk finisher threads = 3 2024-09-13T17:50:45.121 INFO:teuthology.orchestra.run.smithi134.stdout: filestore apply finisher threads = 3 2024-09-13T17:50:45.121 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.121 INFO:teuthology.orchestra.run.smithi134.stdout: bdev debug aio = true 2024-09-13T17:50:45.122 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug misdirected ops = true 2024-09-13T17:50:45.122 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore block size = 96636764160 2024-09-13T17:50:45.122 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore fsck on mount = True 2024-09-13T17:50:45.122 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluefs = 20 2024-09-13T17:50:45.122 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluestore = 20 2024-09-13T17:50:45.122 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-13T17:50:45.122 INFO:teuthology.orchestra.run.smithi134.stdout: debug osd = 20 2024-09-13T17:50:45.122 INFO:teuthology.orchestra.run.smithi134.stdout: debug rocksdb = 10 2024-09-13T17:50:45.122 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T17:50:45.122 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd full ratio = 0.9 2024-09-13T17:50:45.122 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd nearfull ratio = 0.8 2024-09-13T17:50:45.122 INFO:teuthology.orchestra.run.smithi134.stdout: osd failsafe full ratio = 0.95 2024-09-13T17:50:45.122 INFO:teuthology.orchestra.run.smithi134.stdout: osd objectstore = bluestore 2024-09-13T17:50:45.122 INFO:teuthology.orchestra.run.smithi134.stdout: osd op complaint time = 180 2024-09-13T17:50:45.123 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.123 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr] 2024-09-13T17:50:45.123 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-13T17:50:45.123 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgr = 20 2024-09-13T17:50:45.123 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-09-13T17:50:45.123 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-09-13T17:50:45.123 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:50:45.123 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:50:45.123 INFO:teuthology.orchestra.run.smithi134.stdout: mgr/telemetry/nag = false 2024-09-13T17:50:45.123 INFO:teuthology.orchestra.run.smithi134.stdout: debug client = 20 2024-09-13T17:50:45.123 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.123 INFO:teuthology.orchestra.run.smithi134.stdout:[mon] 2024-09-13T17:50:45.123 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-13T17:50:45.123 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-09-13T17:50:45.124 INFO:teuthology.orchestra.run.smithi134.stdout: debug paxos = 20 2024-09-13T17:50:45.124 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-09-13T17:50:45.124 INFO:teuthology.orchestra.run.smithi134.stdout: mon data avail warn = 5 2024-09-13T17:50:45.124 INFO:teuthology.orchestra.run.smithi134.stdout: mon mgr mkfs grace = 240 2024-09-13T17:50:45.124 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:50:45.124 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd reporter subtree level = osd 2024-09-13T17:50:45.124 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd prime pg temp = true 2024-09-13T17:50:45.124 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:50:45.124 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.124 INFO:teuthology.orchestra.run.smithi134.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T17:50:45.124 INFO:teuthology.orchestra.run.smithi134.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T17:50:45.124 INFO:teuthology.orchestra.run.smithi134.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T17:50:45.124 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.125 INFO:teuthology.orchestra.run.smithi134.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T17:50:45.125 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T17:50:45.125 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T17:50:45.125 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.125 INFO:teuthology.orchestra.run.smithi134.stdout: # 1m isn't quite enough 2024-09-13T17:50:45.125 INFO:teuthology.orchestra.run.smithi134.stdout: mon_down_mkfs_grace = 2m 2024-09-13T17:50:45.125 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.125 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_filestore_osds = false 2024-09-13T17:50:45.125 INFO:teuthology.orchestra.run.smithi134.stdout: mon op complaint time = 120 2024-09-13T17:50:45.125 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on pool no app = False 2024-09-13T17:50:45.125 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:50:45.125 INFO:teuthology.orchestra.run.smithi134.stdout:[client] 2024-09-13T17:50:45.125 INFO:teuthology.orchestra.run.smithi134.stdout: rgw cache enabled = true 2024-09-13T17:50:45.125 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable ops log = true 2024-09-13T17:50:45.125 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable usage log = true 2024-09-13T17:50:45.126 INFO:teuthology.orchestra.run.smithi134.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T17:50:45.126 INFO:teuthology.orchestra.run.smithi134.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T17:50:45.126 INFO:teuthology.orchestra.run.smithi134.stdout: client mount timeout = 600 2024-09-13T17:50:45.126 INFO:teuthology.orchestra.run.smithi134.stdout: debug client = 20 2024-09-13T17:50:45.126 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-13T17:50:45.126 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = "" 2024-09-13T17:50:45.126 INFO:teuthology.orchestra.run.smithi134.stdout: rados mon op timeout = 900 2024-09-13T17:50:45.126 INFO:teuthology.orchestra.run.smithi134.stdout: rados osd op timeout = 900 2024-09-13T17:50:45.126 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.a] 2024-09-13T17:50:45.126 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.b] 2024-09-13T17:50:45.126 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.c] 2024-09-13T17:50:45.126 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2024-09-13T17:50:45.127 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.c] 2024-09-13T17:50:45.127 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.b] 2024-09-13T17:50:45.127 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.d] 2024-09-13T17:50:45.127 INFO:teuthology.orchestra.run.smithi134.stdout:[mds] 2024-09-13T17:50:45.127 INFO:teuthology.orchestra.run.smithi134.stdout: debug mds = 20 2024-09-13T17:50:45.127 INFO:teuthology.orchestra.run.smithi134.stdout: debug mds balancer = 20 2024-09-13T17:50:45.127 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-13T17:50:45.127 INFO:teuthology.orchestra.run.smithi134.stdout: mds debug frag = True 2024-09-13T17:50:45.127 INFO:teuthology.orchestra.run.smithi134.stdout: mds debug scatterstat = True 2024-09-13T17:50:45.127 INFO:teuthology.orchestra.run.smithi134.stdout: mds op complaint time = 180 2024-09-13T17:50:45.127 INFO:teuthology.orchestra.run.smithi134.stdout: mds verify scatter = True 2024-09-13T17:50:45.127 INFO:teuthology.orchestra.run.smithi134.stdout: osd op complaint time = 180 2024-09-13T17:50:45.127 INFO:teuthology.orchestra.run.smithi134.stdout: rados mon op timeout = 900 2024-09-13T17:50:45.127 INFO:teuthology.orchestra.run.smithi134.stdout: rados osd op timeout = 900 2024-09-13T17:50:45.129 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T17:50:45.129 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T17:50:45.226 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T17:50:45.226 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:50:45.226 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T17:50:45.235 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:50:45.235 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T17:50:45.283 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi114.front.sepia.ceph.com 2024-09-13T17:50:45.283 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:50:45.283 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T17:50:45.283 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T17:50:45.354 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:50:45.354 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:50:45.404 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi134.front.sepia.ceph.com 2024-09-13T17:50:45.404 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:50:45.404 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T17:50:45.404 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T17:50:45.438 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:50:45.438 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:50:45.487 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T17:50:45.487 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T17:50:45.488 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T17:50:45.541 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T17:50:45.546 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T17:50:45.603 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T17:50:45.619 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T17:50:45.620 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T17:50:45.676 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T17:50:45.678 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-13T17:50:45.698 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T17:50:45.793 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T17:50:45.797 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-13T17:50:45.816 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T17:50:45.874 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T17:50:45.881 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-13T17:50:45.902 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T17:50:45.997 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T17:50:46.001 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-13T17:50:46.021 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T17:50:46.021 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T17:50:46.063 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T17:50:46.079 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-13T17:50:46.164 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-13T17:50:46.180 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-13T17:50:46.221 INFO:teuthology.orchestra.run.smithi134.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-13T17:50:46.238 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-13T17:50:46.319 INFO:teuthology.orchestra.run.smithi134.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-13T17:50:46.335 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T17:50:46.336 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi114.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T17:50:46.336 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T17:50:46.354 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T17:50:46.355 INFO:tasks.ceph:role: osd.0 2024-09-13T17:50:46.355 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi114.front.sepia.ceph.com 2024-09-13T17:50:46.355 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T17:50:46.421 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:50:46.421 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:50:46.421 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:50:46.421 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T17:50:46.421 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:50:46.421 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:50:46.421 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:50:46.421 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:50:46.422 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:50:46.422 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:50:46.828 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-09-13T17:50:46.831 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-09-13T17:50:46.831 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T17:50:46.970 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T17:50:46.985 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:50:46.986 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:50:46.987 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T17:50:47.050 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T17:50:47.050 INFO:tasks.ceph:role: osd.1 2024-09-13T17:50:47.050 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi114.front.sepia.ceph.com 2024-09-13T17:50:47.050 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T17:50:47.122 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:50:47.122 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:50:47.122 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:50:47.122 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T17:50:47.122 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:50:47.122 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:50:47.122 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:50:47.122 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:50:47.122 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:50:47.122 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:50:47.480 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-09-13T17:50:47.482 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-09-13T17:50:47.482 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-13T17:50:47.557 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T17:50:47.614 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:50:47.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:50:47.616 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T17:50:47.678 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T17:50:47.678 INFO:tasks.ceph:role: osd.2 2024-09-13T17:50:47.678 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi114.front.sepia.ceph.com 2024-09-13T17:50:47.678 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T17:50:47.749 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:50:47.749 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:50:47.749 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:50:47.749 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T17:50:47.749 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:50:47.750 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:50:47.750 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:50:47.750 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:50:47.750 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:50:47.750 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:50:48.138 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-09-13T17:50:48.141 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-09-13T17:50:48.141 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-13T17:50:48.239 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T17:50:48.255 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:50:48.255 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:50:48.256 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T17:50:48.318 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T17:50:48.319 INFO:tasks.ceph:role: osd.3 2024-09-13T17:50:48.319 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi114.front.sepia.ceph.com 2024-09-13T17:50:48.319 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T17:50:48.391 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:50:48.391 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:50:48.391 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:50:48.391 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T17:50:48.392 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:50:48.392 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:50:48.392 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:50:48.392 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:50:48.392 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:50:48.392 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:50:48.786 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-09-13T17:50:48.789 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-09-13T17:50:48.789 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-13T17:50:48.921 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T17:50:48.936 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:50:48.936 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:50:48.937 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:50:49.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:50:49.051+0000 7f4d571947c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T17:50:49.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:50:49.059+0000 7f4d571947c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T17:50:49.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:50:49.059+0000 7f4d571947c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T17:50:49.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:50:49.059+0000 7f4d571947c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T17:50:49.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:50:49.059+0000 7f4d571947c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T17:50:49.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:50:49.067+0000 7f4d571947c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T17:50:52.126 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T17:50:52.145 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:50:52.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:50:52.239+0000 7f6e682ac7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T17:50:52.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:50:52.239+0000 7f6e682ac7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T17:50:52.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:50:52.239+0000 7f6e682ac7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T17:50:52.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:50:52.239+0000 7f6e682ac7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T17:50:52.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:50:52.239+0000 7f6e682ac7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T17:50:52.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:50:52.243+0000 7f6e682ac7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T17:50:55.305 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T17:50:55.326 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:50:55.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:50:55.415+0000 7f7739b6e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T17:50:55.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:50:55.415+0000 7f7739b6e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T17:50:55.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:50:55.415+0000 7f7739b6e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T17:50:55.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:50:55.415+0000 7f7739b6e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T17:50:55.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:50:55.415+0000 7f7739b6e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T17:50:55.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:50:55.419+0000 7f7739b6e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T17:50:58.465 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T17:50:58.485 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:50:58.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:50:58.579+0000 7f91812807c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T17:50:58.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:50:58.579+0000 7f91812807c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T17:50:58.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:50:58.579+0000 7f91812807c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T17:50:58.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:50:58.579+0000 7f91812807c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T17:50:58.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:50:58.579+0000 7f91812807c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T17:50:58.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:50:58.583+0000 7f91812807c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T17:51:01.613 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T17:51:01.633 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-13T17:51:01.655 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T17:51:01.655 INFO:tasks.ceph:role: osd.4 2024-09-13T17:51:01.655 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-13T17:51:01.655 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T17:51:01.727 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:51:01.728 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:51:01.728 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:51:01.728 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T17:51:01.728 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:51:01.728 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:51:01.728 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:51:01.728 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:51:01.728 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:51:01.728 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:51:02.124 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-09-13T17:51:02.127 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-09-13T17:51:02.127 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-13T17:51:02.213 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-13T17:51:02.275 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:51:02.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:51:02.277 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-13T17:51:02.343 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T17:51:02.343 INFO:tasks.ceph:role: osd.5 2024-09-13T17:51:02.343 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-13T17:51:02.343 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T17:51:02.415 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:51:02.416 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:51:02.416 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:51:02.416 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T17:51:02.416 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:51:02.416 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:51:02.416 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:51:02.416 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:51:02.416 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:51:02.416 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:51:02.806 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-09-13T17:51:02.809 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-09-13T17:51:02.809 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-13T17:51:02.932 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-13T17:51:02.949 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:51:02.949 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:51:02.950 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-13T17:51:03.015 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T17:51:03.015 INFO:tasks.ceph:role: osd.6 2024-09-13T17:51:03.015 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-13T17:51:03.015 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T17:51:03.090 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:51:03.090 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:51:03.090 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:51:03.090 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T17:51:03.090 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:51:03.090 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:51:03.090 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:51:03.090 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:51:03.090 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:51:03.090 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:51:03.508 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-09-13T17:51:03.511 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-09-13T17:51:03.511 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-13T17:51:03.654 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-13T17:51:03.671 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:51:03.672 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:51:03.673 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-13T17:51:03.736 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T17:51:03.736 INFO:tasks.ceph:role: osd.7 2024-09-13T17:51:03.736 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-13T17:51:03.736 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T17:51:03.807 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T17:51:03.807 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T17:51:03.807 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T17:51:03.807 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T17:51:03.807 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T17:51:03.807 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-09-13T17:51:03.807 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T17:51:03.807 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T17:51:03.807 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T17:51:03.807 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T17:51:04.163 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-09-13T17:51:04.166 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-09-13T17:51:04.166 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-13T17:51:04.250 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-13T17:51:04.311 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T17:51:04.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:51:04.312 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:51:04.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:04.440+0000 7f5946aff7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-13T17:51:04.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:04.444+0000 7f5946aff7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-13T17:51:04.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:04.444+0000 7f5946aff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T17:51:04.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:04.444+0000 7f5946aff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T17:51:04.446 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:04.444+0000 7f5946aff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T17:51:04.448 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:04.448+0000 7f5946aff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-13T17:51:07.479 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T17:51:07.500 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:51:07.595 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:07.592+0000 7fa802e397c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-13T17:51:07.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:07.596+0000 7fa802e397c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-13T17:51:07.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:07.596+0000 7fa802e397c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T17:51:07.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:07.596+0000 7fa802e397c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T17:51:07.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:07.596+0000 7fa802e397c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T17:51:07.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:07.596+0000 7fa802e397c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-13T17:51:10.658 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T17:51:10.679 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:51:10.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:10.776+0000 7f364d0ae7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-13T17:51:10.776 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:10.776+0000 7f364d0ae7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-13T17:51:10.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:10.776+0000 7f364d0ae7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T17:51:10.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:10.776+0000 7f364d0ae7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T17:51:10.777 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:10.776+0000 7f364d0ae7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T17:51:10.778 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:10.776+0000 7f364d0ae7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-13T17:51:13.174 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:51:13.178 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:51:13.836 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-13T17:51:13.855 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:51:13.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:13.948+0000 7fc44f5637c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-13T17:51:13.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:13.948+0000 7fc44f5637c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-13T17:51:13.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:13.948+0000 7fc44f5637c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T17:51:13.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:13.948+0000 7fc44f5637c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T17:51:13.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:13.948+0000 7fc44f5637c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T17:51:13.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:13.948+0000 7fc44f5637c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-13T17:51:16.964 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-13T17:51:16.985 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T17:51:16.985 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:51:16.985 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-13T17:51:17.007 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:51:17.007 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-13T17:51:17.072 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:51:17.072 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-13T17:51:17.135 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:51:17.135 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T17:51:17.203 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:51:17.203 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T17:51:17.267 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:51:17.267 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T17:51:17.331 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:51:17.331 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T17:51:17.399 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:51:17.399 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T17:51:17.420 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:51:17.420 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-13T17:51:17.483 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:51:17.483 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-13T17:51:17.547 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:51:17.547 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-13T17:51:17.611 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:51:17.611 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-13T17:51:17.675 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:51:17.675 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-13T17:51:17.743 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:51:17.743 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-13T17:51:17.806 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:51:17.807 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T17:51:17.815 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:51:17.815 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-13T17:51:17.867 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:51:17.867 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-13T17:51:17.876 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:51:17.876 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-13T17:51:17.931 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T17:51:17.931 DEBUG:teuthology.orchestra.run.smithi114:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T17:51:17.934 DEBUG:teuthology.orchestra.run.smithi134:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T17:51:17.980 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr.y] 2024-09-13T17:51:17.981 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQB1e+RmdnRgIBAAyfLnbvtc4IqebPiB4b+HJg== 2024-09-13T17:51:17.981 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.a] 2024-09-13T17:51:17.981 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQB1e+RmncdJKBAAysIDwMafxT5K6gz/kxoQdg== 2024-09-13T17:51:17.981 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.c] 2024-09-13T17:51:17.981 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQB1e+RmGFldLxAAZsrNqxkMzrDXtsH73AXikQ== 2024-09-13T17:51:17.981 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.0] 2024-09-13T17:51:17.981 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQB5e+Rmu+NxAxAAPYsqcyZoGuDNhPdJ9uzj1Q== 2024-09-13T17:51:17.981 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.1] 2024-09-13T17:51:17.981 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQB8e+RmRe6QDhAAODh2OqKFo4wPbpJIHR7iWQ== 2024-09-13T17:51:17.981 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.2] 2024-09-13T17:51:17.982 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQB/e+RmBjIGGRAAijx9//aNbfFpnBAjid5W5Q== 2024-09-13T17:51:17.982 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.3] 2024-09-13T17:51:17.982 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQCCe+Rm5nW9IhAAPJkQnS0rRmxyys3HHNOcDg== 2024-09-13T17:51:17.982 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr.x] 2024-09-13T17:51:17.982 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQB1e+RmGl8bJBAAhiq/mLUuZha/RGjFM+b0IA== 2024-09-13T17:51:17.982 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.b] 2024-09-13T17:51:17.982 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQB1e+Rm8wQ7NBAA5l/7OWAIaHNNP1Ht0VwbNw== 2024-09-13T17:51:17.982 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.d] 2024-09-13T17:51:17.982 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQB1e+RmaJOOOxAAikhRbRTATgtGIl9Xe0XG1w== 2024-09-13T17:51:17.982 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.4] 2024-09-13T17:51:17.982 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQCIe+RmGRx7GhAALoXgz2B5bs08BoLt0MWR/g== 2024-09-13T17:51:17.983 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.5] 2024-09-13T17:51:17.983 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQCLe+RmvWucIxAAC/sqikj+O41H0FBFVBxQvg== 2024-09-13T17:51:17.983 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.6] 2024-09-13T17:51:17.983 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQCOe+RmCchjLhAAJ6WL+TvYqahpsEWVDPbR8g== 2024-09-13T17:51:17.983 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.7] 2024-09-13T17:51:17.983 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQCRe+RmZXSmOBAAorSzbtW3hRIcoGipUhf0Fg== 2024-09-13T17:51:17.983 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2024-09-13T17:51:17.983 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQB2e+Rmlv/dAxAA02imgVgOpA5coMMyhIxX0A== 2024-09-13T17:51:17.983 INFO:teuthology.orchestra.run.smithi114.stdout:[client.2] 2024-09-13T17:51:17.983 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQB2e+RmdZjmCRAA2rB0NwPaLvTjntGn1pBIrg== 2024-09-13T17:51:17.983 INFO:teuthology.orchestra.run.smithi114.stdout:[client.1] 2024-09-13T17:51:17.983 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQB2e+RmYBlVDRAAfJTruk3uULAudbWy40lusg== 2024-09-13T17:51:17.983 INFO:teuthology.orchestra.run.smithi114.stdout:[client.3] 2024-09-13T17:51:17.984 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQB2e+Rm8h0tExAAdz5gW3cy/T7xsC2rvvxuWg== 2024-09-13T17:51:17.993 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.y] 2024-09-13T17:51:17.993 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQB1e+RmdnRgIBAAyfLnbvtc4IqebPiB4b+HJg== 2024-09-13T17:51:17.993 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2024-09-13T17:51:17.993 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQB1e+RmncdJKBAAysIDwMafxT5K6gz/kxoQdg== 2024-09-13T17:51:17.993 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.c] 2024-09-13T17:51:17.993 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQB1e+RmGFldLxAAZsrNqxkMzrDXtsH73AXikQ== 2024-09-13T17:51:17.993 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.0] 2024-09-13T17:51:17.993 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQB5e+Rmu+NxAxAAPYsqcyZoGuDNhPdJ9uzj1Q== 2024-09-13T17:51:17.993 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.1] 2024-09-13T17:51:17.993 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQB8e+RmRe6QDhAAODh2OqKFo4wPbpJIHR7iWQ== 2024-09-13T17:51:17.993 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.2] 2024-09-13T17:51:17.994 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQB/e+RmBjIGGRAAijx9//aNbfFpnBAjid5W5Q== 2024-09-13T17:51:17.994 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.3] 2024-09-13T17:51:17.994 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCCe+Rm5nW9IhAAPJkQnS0rRmxyys3HHNOcDg== 2024-09-13T17:51:17.994 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.x] 2024-09-13T17:51:17.994 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQB1e+RmGl8bJBAAhiq/mLUuZha/RGjFM+b0IA== 2024-09-13T17:51:17.994 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.b] 2024-09-13T17:51:17.994 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQB1e+Rm8wQ7NBAA5l/7OWAIaHNNP1Ht0VwbNw== 2024-09-13T17:51:17.994 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.d] 2024-09-13T17:51:17.994 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQB1e+RmaJOOOxAAikhRbRTATgtGIl9Xe0XG1w== 2024-09-13T17:51:17.994 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.4] 2024-09-13T17:51:17.994 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCIe+RmGRx7GhAALoXgz2B5bs08BoLt0MWR/g== 2024-09-13T17:51:17.994 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.5] 2024-09-13T17:51:17.994 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCLe+RmvWucIxAAC/sqikj+O41H0FBFVBxQvg== 2024-09-13T17:51:17.994 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.6] 2024-09-13T17:51:17.995 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCOe+RmCchjLhAAJ6WL+TvYqahpsEWVDPbR8g== 2024-09-13T17:51:17.995 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.7] 2024-09-13T17:51:17.995 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCRe+RmZXSmOBAAorSzbtW3hRIcoGipUhf0Fg== 2024-09-13T17:51:17.995 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2024-09-13T17:51:17.995 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQB2e+Rmlv/dAxAA02imgVgOpA5coMMyhIxX0A== 2024-09-13T17:51:17.995 INFO:teuthology.orchestra.run.smithi134.stdout:[client.2] 2024-09-13T17:51:17.995 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQB2e+RmdZjmCRAA2rB0NwPaLvTjntGn1pBIrg== 2024-09-13T17:51:17.995 INFO:teuthology.orchestra.run.smithi134.stdout:[client.1] 2024-09-13T17:51:17.995 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQB2e+RmYBlVDRAAfJTruk3uULAudbWy40lusg== 2024-09-13T17:51:17.995 INFO:teuthology.orchestra.run.smithi134.stdout:[client.3] 2024-09-13T17:51:17.995 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQB2e+Rm8h0tExAAdz5gW3cy/T7xsC2rvvxuWg== 2024-09-13T17:51:17.996 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T17:51:18.030 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T17:51:18.096 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:51:18.099 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:51:18.156 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:51:18.160 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:51:18.216 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:51:18.219 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:51:18.272 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:51:18.276 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:51:18.328 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:51:18.331 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:51:18.384 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:51:18.390 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:51:18.444 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T17:51:18.447 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T17:51:18.499 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:51:18.503 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:51:18.557 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:51:18.560 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T17:51:18.615 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:51:18.618 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:51:18.670 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:51:18.674 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:51:18.727 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:51:18.730 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:51:18.784 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:51:18.787 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T17:51:18.839 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:51:18.843 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:51:18.898 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:51:18.901 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:51:18.956 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:51:18.959 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:51:19.014 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:51:19.018 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T17:51:19.073 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T17:51:19.073 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T17:51:19.092 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T17:51:19.205 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T17:51:19.224 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-13T17:51:19.244 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T17:51:19.351 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-13T17:51:19.370 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-13T17:51:19.429 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T17:51:19.537 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-13T17:51:19.558 DEBUG:teuthology.orchestra.run.smithi114:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:51:19.561 DEBUG:teuthology.orchestra.run.smithi134:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T17:51:19.606 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T17:51:19.606 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T17:51:19.606 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T17:51:19.609 INFO:tasks.ceph.mon.a:Started 2024-09-13T17:51:19.610 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-13T17:51:19.610 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-13T17:51:19.649 INFO:tasks.ceph.mon.b:Started 2024-09-13T17:51:19.649 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-13T17:51:19.649 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-13T17:51:19.652 INFO:tasks.ceph.mon.c:Started 2024-09-13T17:51:19.652 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T17:51:19.652 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-13T17:51:19.652 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-13T17:51:19.655 INFO:tasks.ceph.mgr.y:Started 2024-09-13T17:51:19.656 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T17:51:19.656 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T17:51:19.659 INFO:tasks.ceph.mgr.x:Started 2024-09-13T17:51:19.659 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T17:51:19.659 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T17:51:19.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.795+0000 7fc021200640 1 Processor -- start 2024-09-13T17:51:19.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.795+0000 7fc021200640 1 -- start start 2024-09-13T17:51:19.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.795+0000 7fc021200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc01c15a650 0x7fc01c099480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:19.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.795+0000 7fc021200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc01c15e7c0 0x7fc01c0cb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:19.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.795+0000 7fc021200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01c0ce540 con 0x7fc01c0ce0b0 2024-09-13T17:51:19.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.795+0000 7fc021200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc01c15ba40 con 0x7fc01c15e7c0 2024-09-13T17:51:19.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.795+0000 7fc021200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c0ce820 con 0x7fc01c15a650 2024-09-13T17:51:19.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.795+0000 7fc019e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc01c15a650 0x7fc01c099480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:19.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.795+0000 7fc01a800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc01c15e7c0 0x7fc01c0cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:19.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.795+0000 7fc019e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc01c15a650 0x7fc01c099480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:55272/0 (socket says 172.21.15.114:55272) 2024-09-13T17:51:19.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.795+0000 7fc019e00640 1 -- 172.21.15.114:0/3262287572 learned_addr learned my addr 172.21.15.114:0/3262287572 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:19.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.795+0000 7fc019e00640 1 -- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc01c15a650 msgr2=0x7fc01c099480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T17:51:19.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.795+0000 7fc019e00640 1 -- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc01c15a650 msgr2=0x7fc01c099480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:51:19.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.795+0000 7fc019e00640 1 --2- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc01c15a650 0x7fc01c099480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:51:19.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.795+0000 7fc019e00640 1 --2- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc01c15a650 0x7fc01c099480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:51:19.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.795+0000 7fc01a800640 1 -- 172.21.15.114:0/3262287572 >> v2:172.21.15.134:3300/0 conn(0x7fc01c15e7c0 msgr2=0x7fc01c0cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T17:51:19.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.795+0000 7fc01a800640 1 -- 172.21.15.114:0/3262287572 >> v2:172.21.15.134:3300/0 conn(0x7fc01c15e7c0 msgr2=0x7fc01c0cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:51:19.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.795+0000 7fc01a800640 1 --2- 172.21.15.114:0/3262287572 >> v2:172.21.15.134:3300/0 conn(0x7fc01c15e7c0 0x7fc01c0cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:51:19.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.795+0000 7fc01a800640 1 --2- 172.21.15.114:0/3262287572 >> v2:172.21.15.134:3300/0 conn(0x7fc01c15e7c0 0x7fc01c0cb180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:51:20.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.999+0000 7fc019e00640 1 --2- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc01c15a650 0x7fc01c099480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:20.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.999+0000 7fc01a800640 1 --2- 172.21.15.114:0/3262287572 >> v2:172.21.15.134:3300/0 conn(0x7fc01c15e7c0 0x7fc01c0cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:20.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.999+0000 7fc019e00640 1 -- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc01c15a650 msgr2=0x7fc01c099480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T17:51:20.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.999+0000 7fc019e00640 1 -- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc01c15a650 msgr2=0x7fc01c099480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:51:20.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.999+0000 7fc019e00640 1 --2- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc01c15a650 0x7fc01c099480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:51:20.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.999+0000 7fc019e00640 1 --2- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc01c15a650 0x7fc01c099480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T17:51:20.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.999+0000 7fc01a800640 1 -- 172.21.15.114:0/3262287572 >> v2:172.21.15.134:3300/0 conn(0x7fc01c15e7c0 msgr2=0x7fc01c0cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T17:51:20.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.999+0000 7fc01a800640 1 -- 172.21.15.114:0/3262287572 >> v2:172.21.15.134:3300/0 conn(0x7fc01c15e7c0 msgr2=0x7fc01c0cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:51:20.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.999+0000 7fc01a800640 1 --2- 172.21.15.114:0/3262287572 >> v2:172.21.15.134:3300/0 conn(0x7fc01c15e7c0 0x7fc01c0cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:51:20.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:19.999+0000 7fc01a800640 1 --2- 172.21.15.114:0/3262287572 >> v2:172.21.15.134:3300/0 conn(0x7fc01c15e7c0 0x7fc01c0cb180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T17:51:20.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:20.403+0000 7fc019e00640 1 --2- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc01c15a650 0x7fc01c099480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:20.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:20.403+0000 7fc01a800640 1 --2- 172.21.15.114:0/3262287572 >> v2:172.21.15.134:3300/0 conn(0x7fc01c15e7c0 0x7fc01c0cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:20.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:20.403+0000 7fc019e00640 1 -- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc01c15a650 msgr2=0x7fc01c099480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T17:51:20.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:20.403+0000 7fc019e00640 1 -- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc01c15a650 msgr2=0x7fc01c099480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:51:20.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:20.403+0000 7fc019e00640 1 --2- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc01c15a650 0x7fc01c099480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:51:20.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:20.403+0000 7fc01a800640 1 -- 172.21.15.114:0/3262287572 >> v2:172.21.15.134:3300/0 conn(0x7fc01c15e7c0 msgr2=0x7fc01c0cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T17:51:20.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:20.403+0000 7fc01a800640 1 -- 172.21.15.114:0/3262287572 >> v2:172.21.15.134:3300/0 conn(0x7fc01c15e7c0 msgr2=0x7fc01c0cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:51:20.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:20.403+0000 7fc01a800640 1 --2- 172.21.15.114:0/3262287572 >> v2:172.21.15.134:3300/0 conn(0x7fc01c15e7c0 0x7fc01c0cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:51:20.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:20.403+0000 7fc019e00640 1 --2- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc01c15a650 0x7fc01c099480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T17:51:20.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:20.403+0000 7fc01a800640 1 --2- 172.21.15.114:0/3262287572 >> v2:172.21.15.134:3300/0 conn(0x7fc01c15e7c0 0x7fc01c0cb180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T17:51:21.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:21.207+0000 7fc019e00640 1 --2- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc01c15a650 0x7fc01c099480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:21.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:21.207+0000 7fc01a800640 1 --2- 172.21.15.114:0/3262287572 >> v2:172.21.15.134:3300/0 conn(0x7fc01c15e7c0 0x7fc01c0cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:21.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:21.207+0000 7fc019e00640 1 -- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc01c15a650 msgr2=0x7fc01c099480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T17:51:21.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:21.207+0000 7fc019e00640 1 -- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc01c15a650 msgr2=0x7fc01c099480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:51:21.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:21.207+0000 7fc019e00640 1 --2- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc01c15a650 0x7fc01c099480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:51:21.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:21.207+0000 7fc01a800640 1 -- 172.21.15.114:0/3262287572 >> v2:172.21.15.134:3300/0 conn(0x7fc01c15e7c0 msgr2=0x7fc01c0cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T17:51:21.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:21.207+0000 7fc01a800640 1 -- 172.21.15.114:0/3262287572 >> v2:172.21.15.134:3300/0 conn(0x7fc01c15e7c0 msgr2=0x7fc01c0cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:51:21.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:21.207+0000 7fc01a800640 1 --2- 172.21.15.114:0/3262287572 >> v2:172.21.15.134:3300/0 conn(0x7fc01c15e7c0 0x7fc01c0cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:51:21.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:21.207+0000 7fc019e00640 1 --2- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc01c15a650 0x7fc01c099480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T17:51:21.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:21.207+0000 7fc01a800640 1 --2- 172.21.15.114:0/3262287572 >> v2:172.21.15.134:3300/0 conn(0x7fc01c15e7c0 0x7fc01c0cb180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T17:51:22.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:22.795+0000 7fc013400640 1 -- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc01c15a650 msgr2=0x7fc01c099480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T17:51:22.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:22.795+0000 7fc013400640 1 --2- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc01c15a650 0x7fc01c099480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:22.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:22.795+0000 7fc013400640 1 -- 172.21.15.114:0/3262287572 >> v2:172.21.15.134:3300/0 conn(0x7fc01c15e7c0 msgr2=0x7fc01c0cb180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T17:51:22.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:22.795+0000 7fc013400640 1 --2- 172.21.15.114:0/3262287572 >> v2:172.21.15.134:3300/0 conn(0x7fc01c15e7c0 0x7fc01c0cb180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:22.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:22.795+0000 7fc013400640 1 -- 172.21.15.114:0/3262287572 >> v1:172.21.15.134:6789/0 conn(0x7fc01c0ce0b0 legacy=0x7fc01c15e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:22.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:22.795+0000 7fc013400640 1 --2- 172.21.15.114:0/3262287572 >> v2:172.21.15.114:3300/0 conn(0x7fbff80036d0 0x7fbff8005b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:22.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:22.795+0000 7fc013400640 1 -- 172.21.15.114:0/3262287572 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01c0ceb00 con 0x7fbff8006180 2024-09-13T17:51:22.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:22.795+0000 7fc013400640 1 -- 172.21.15.114:0/3262287572 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc01c15ba40 con 0x7fbff80036d0 2024-09-13T17:51:22.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:22.795+0000 7fc019e00640 1 --2- 172.21.15.114:0/3262287572 >> v2:172.21.15.114:3300/0 conn(0x7fbff80036d0 0x7fbff8005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:22.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:22.795+0000 7fc019e00640 1 -- 172.21.15.114:0/3262287572 >> v2:172.21.15.114:3300/0 conn(0x7fbff80036d0 msgr2=0x7fbff8005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T17:51:22.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:22.795+0000 7fc019e00640 1 -- 172.21.15.114:0/3262287572 >> v2:172.21.15.114:3300/0 conn(0x7fbff80036d0 msgr2=0x7fbff8005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:51:22.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:22.795+0000 7fc019e00640 1 --2- 172.21.15.114:0/3262287572 >> v2:172.21.15.114:3300/0 conn(0x7fbff80036d0 0x7fbff8005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:51:22.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:22.795+0000 7fc019e00640 1 --2- 172.21.15.114:0/3262287572 >> v2:172.21.15.114:3300/0 conn(0x7fbff80036d0 0x7fbff8005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:51:23.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:22.999+0000 7fc019e00640 1 --2- 172.21.15.114:0/3262287572 >> v2:172.21.15.114:3300/0 conn(0x7fbff80036d0 0x7fbff8005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:23.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:22.999+0000 7fc019e00640 1 -- 172.21.15.114:0/3262287572 >> v2:172.21.15.114:3300/0 conn(0x7fbff80036d0 msgr2=0x7fbff8005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T17:51:23.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:22.999+0000 7fc019e00640 1 -- 172.21.15.114:0/3262287572 >> v2:172.21.15.114:3300/0 conn(0x7fbff80036d0 msgr2=0x7fbff8005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:51:23.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:22.999+0000 7fc019e00640 1 --2- 172.21.15.114:0/3262287572 >> v2:172.21.15.114:3300/0 conn(0x7fbff80036d0 0x7fbff8005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:51:23.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:22.999+0000 7fc019e00640 1 --2- 172.21.15.114:0/3262287572 >> v2:172.21.15.114:3300/0 conn(0x7fbff80036d0 0x7fbff8005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T17:51:23.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:23.403+0000 7fc019e00640 1 --2- 172.21.15.114:0/3262287572 >> v2:172.21.15.114:3300/0 conn(0x7fbff80036d0 0x7fbff8005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:23.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:23.403+0000 7fc019e00640 1 -- 172.21.15.114:0/3262287572 >> v2:172.21.15.114:3300/0 conn(0x7fbff80036d0 msgr2=0x7fbff8005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T17:51:23.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:23.403+0000 7fc019e00640 1 -- 172.21.15.114:0/3262287572 >> v2:172.21.15.114:3300/0 conn(0x7fbff80036d0 msgr2=0x7fbff8005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:51:23.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:23.403+0000 7fc019e00640 1 --2- 172.21.15.114:0/3262287572 >> v2:172.21.15.114:3300/0 conn(0x7fbff80036d0 0x7fbff8005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:51:23.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:23.403+0000 7fc019e00640 1 --2- 172.21.15.114:0/3262287572 >> v2:172.21.15.114:3300/0 conn(0x7fbff80036d0 0x7fbff8005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T17:51:24.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.207+0000 7fc019e00640 1 --2- 172.21.15.114:0/3262287572 >> v2:172.21.15.114:3300/0 conn(0x7fbff80036d0 0x7fbff8005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:24.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.207+0000 7fc019e00640 1 -- 172.21.15.114:0/3262287572 >> v2:172.21.15.114:3300/0 conn(0x7fbff80036d0 msgr2=0x7fbff8005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T17:51:24.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.207+0000 7fc019e00640 1 -- 172.21.15.114:0/3262287572 >> v2:172.21.15.114:3300/0 conn(0x7fbff80036d0 msgr2=0x7fbff8005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T17:51:24.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.207+0000 7fc019e00640 1 --2- 172.21.15.114:0/3262287572 >> v2:172.21.15.114:3300/0 conn(0x7fbff80036d0 0x7fbff8005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:51:24.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.207+0000 7fc019e00640 1 --2- 172.21.15.114:0/3262287572 >> v2:172.21.15.114:3300/0 conn(0x7fbff80036d0 0x7fbff8005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T17:51:24.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.959+0000 7fc019400640 1 -- 172.21.15.114:0/3262287572 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1146233535 0 0) 0x7fc01c0ceb00 con 0x7fbff8006180 2024-09-13T17:51:24.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.959+0000 7fc019400640 1 -- 172.21.15.114:0/3262287572 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc000003530 con 0x7fbff8006180 2024-09-13T17:51:24.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.959+0000 7fc019400640 1 -- 172.21.15.114:0/3262287572 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 170441373 0 0) 0x7fc000003530 con 0x7fbff8006180 2024-09-13T17:51:24.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.959+0000 7fc019400640 1 -- 172.21.15.114:0/3262287572 >> v2:172.21.15.114:3300/0 conn(0x7fbff80036d0 msgr2=0x7fbff8005b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T17:51:24.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.959+0000 7fc019400640 1 --2- 172.21.15.114:0/3262287572 >> v2:172.21.15.114:3300/0 conn(0x7fbff80036d0 0x7fbff8005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:24.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.959+0000 7fc019400640 1 -- 172.21.15.114:0/3262287572 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff800af20 con 0x7fbff8006180 2024-09-13T17:51:24.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.959+0000 7fc019400640 1 -- 172.21.15.114:0/3262287572 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7fc004001700 con 0x7fbff8006180 2024-09-13T17:51:24.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.959+0000 7fc019400640 1 -- 172.21.15.114:0/3262287572 >> v1:172.21.15.114:6789/0 conn(0x7fbff8006180 legacy=0x7fbff8008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:24.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.959+0000 7fc01a800640 1 -- 172.21.15.114:0/3262287572 reap_dead start 2024-09-13T17:51:24.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.959+0000 7fc019400640 1 --2- 172.21.15.114:0/3262287572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc000003980 0x7fc000003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:24.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.959+0000 7fc019400640 1 --2- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0000047d0 0x7fc000004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:24.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.959+0000 7fc019400640 1 --2- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0000052b0 0x7fc00000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:24.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.959+0000 7fc019400640 1 -- 172.21.15.114:0/3262287572 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c15ba40 con 0x7fc000003980 2024-09-13T17:51:24.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.959+0000 7fc019400640 1 -- 172.21.15.114:0/3262287572 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00000c200 con 0x7fc0000047d0 2024-09-13T17:51:24.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.959+0000 7fc019400640 1 -- 172.21.15.114:0/3262287572 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00000c3c0 con 0x7fc0000052b0 2024-09-13T17:51:24.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.959+0000 7fc019e00640 1 --2- 172.21.15.114:0/3262287572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc000003980 0x7fc000003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:24.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.959+0000 7fc013e00640 1 --2- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0000047d0 0x7fc000004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:24.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.959+0000 7fc01a800640 1 --2- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0000052b0 0x7fc00000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:24.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.959+0000 7fc019e00640 1 -- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0000052b0 msgr2=0x7fc00000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:24.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.959+0000 7fc019e00640 1 --2- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0000052b0 0x7fc00000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:24.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.959+0000 7fc019e00640 1 -- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0000047d0 msgr2=0x7fc000004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:24.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.959+0000 7fc019e00640 1 --2- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0000047d0 0x7fc000004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:24.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.959+0000 7fc019e00640 1 -- 172.21.15.114:0/3262287572 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc000003530 con 0x7fc000003980 2024-09-13T17:51:24.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.959+0000 7fc01a800640 1 --2- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0000052b0 0x7fc00000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:51:24.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.963+0000 7fc019e00640 1 --2- 172.21.15.114:0/3262287572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc000003980 0x7fc000003d80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc00c009100 tx=0x7fc00c01dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d4904043462b41 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:24.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.967+0000 7fc019400640 1 -- 172.21.15.114:0/3262287572 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c0a6ce0 con 0x7fc000003980 2024-09-13T17:51:24.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.967+0000 7fc019400640 1 -- 172.21.15.114:0/3262287572 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00c00c040 con 0x7fc000003980 2024-09-13T17:51:24.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.967+0000 7fc019400640 1 -- 172.21.15.114:0/3262287572 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c0ae680 con 0x7fc000003980 2024-09-13T17:51:24.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.967+0000 7fc021200640 1 -- 172.21.15.114:0/3262287572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc000003980 msgr2=0x7fc000003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:24.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.967+0000 7fc021200640 1 --2- 172.21.15.114:0/3262287572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc000003980 0x7fc000003d80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc00c009100 tx=0x7fc00c01dde0 comp rx=0 tx=0).stop 2024-09-13T17:51:24.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.967+0000 7fc021200640 1 -- 172.21.15.114:0/3262287572 shutdown_connections 2024-09-13T17:51:24.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.967+0000 7fc021200640 1 --2- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0000052b0 0x7fc00000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:24.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.967+0000 7fc021200640 1 --2- 172.21.15.114:0/3262287572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0000047d0 0x7fc000004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:24.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.967+0000 7fc021200640 1 --2- 172.21.15.114:0/3262287572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc000003980 0x7fc000003d80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:24.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.967+0000 7fc021200640 1 -- 172.21.15.114:0/3262287572 >> 172.21.15.114:0/3262287572 conn(0x7fc01c0d04e0 msgr2=0x7fc01c0d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:24.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.967+0000 7fc021200640 1 -- 172.21.15.114:0/3262287572 shutdown_connections 2024-09-13T17:51:24.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.967+0000 7fc021200640 1 -- 172.21.15.114:0/3262287572 wait complete. 2024-09-13T17:51:24.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.967+0000 7fc021200640 1 Processor -- start 2024-09-13T17:51:24.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.967+0000 7fc021200640 1 -- start start 2024-09-13T17:51:24.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.971+0000 7fc021200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc000003980 0x7fc01c1f2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:24.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.971+0000 7fc021200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0000047d0 0x7fc01c0b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:24.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.971+0000 7fc021200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0000052b0 0x7fc01c15ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:24.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.971+0000 7fc021200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c1f2c60 con 0x7fc0000047d0 2024-09-13T17:51:24.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.971+0000 7fc021200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c0cbd80 con 0x7fc0000052b0 2024-09-13T17:51:24.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.971+0000 7fc021200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c0cb170 con 0x7fc000003980 2024-09-13T17:51:24.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.971+0000 7fc019e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc000003980 0x7fc01c1f2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:24.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.971+0000 7fc013e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0000047d0 0x7fc01c0b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:24.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.971+0000 7fc019e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc000003980 0x7fc01c1f2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:60538/0 (socket says 172.21.15.114:60538) 2024-09-13T17:51:24.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.971+0000 7fc019e00640 1 -- 172.21.15.114:0/4008597768 learned_addr learned my addr 172.21.15.114:0/4008597768 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:24.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.971+0000 7fc013e00640 1 --2- 172.21.15.114:0/4008597768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0000047d0 0x7fc01c0b4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53980/0 (socket says 172.21.15.114:53980) 2024-09-13T17:51:24.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.971+0000 7fc01a800640 1 --2- 172.21.15.114:0/4008597768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0000052b0 0x7fc01c15ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:24.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.971+0000 7fc013e00640 1 -- 172.21.15.114:0/4008597768 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc000003980 msgr2=0x7fc01c1f2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:24.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.971+0000 7fc013e00640 1 --2- 172.21.15.114:0/4008597768 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc000003980 0x7fc01c1f2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:24.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.971+0000 7fc013e00640 1 -- 172.21.15.114:0/4008597768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0000052b0 msgr2=0x7fc01c15ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:24.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.971+0000 7fc013e00640 1 --2- 172.21.15.114:0/4008597768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0000052b0 0x7fc01c15ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:24.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.971+0000 7fc013e00640 1 -- 172.21.15.114:0/4008597768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c0cb450 con 0x7fc0000047d0 2024-09-13T17:51:24.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.971+0000 7fc019e00640 1 --2- 172.21.15.114:0/4008597768 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc000003980 0x7fc01c1f2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:51:24.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.971+0000 7fc013e00640 1 --2- 172.21.15.114:0/4008597768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0000047d0 0x7fc01c0b4de0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc01c0b30d0 tx=0x7fc00400fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:24.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.971+0000 7fc012000640 1 -- 172.21.15.114:0/4008597768 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00400fee0 con 0x7fc0000047d0 2024-09-13T17:51:24.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.971+0000 7fc012000640 1 -- 172.21.15.114:0/4008597768 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0040052e0 con 0x7fc0000047d0 2024-09-13T17:51:24.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.971+0000 7fc012000640 1 -- 172.21.15.114:0/4008597768 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00400d8d0 con 0x7fc0000047d0 2024-09-13T17:51:24.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.971+0000 7fc021200640 1 -- 172.21.15.114:0/4008597768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc01c0cb730 con 0x7fc0000047d0 2024-09-13T17:51:24.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.971+0000 7fc021200640 1 -- 172.21.15.114:0/4008597768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01c0b5320 con 0x7fc0000047d0 2024-09-13T17:51:24.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.971+0000 7fc012000640 1 -- 172.21.15.114:0/4008597768 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fc00400dd30 con 0x7fc0000047d0 2024-09-13T17:51:24.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.971+0000 7fc012000640 1 -- 172.21.15.114:0/4008597768 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc00401d460 con 0x7fc0000047d0 2024-09-13T17:51:24.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.975+0000 7fc021200640 1 -- 172.21.15.114:0/4008597768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc01c0ceb00 con 0x7fc0000047d0 2024-09-13T17:51:24.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:24.995+0000 7fc012000640 1 -- 172.21.15.114:0/4008597768 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fc004003600 con 0x7fc0000047d0 2024-09-13T17:51:25.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:25.059+0000 7fc021200640 1 -- 172.21.15.114:0/4008597768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc01c0d1380 con 0x7fc0000047d0 2024-09-13T17:51:25.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:25.067+0000 7fc012000640 1 -- 172.21.15.114:0/4008597768 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc0040037a0 con 0x7fc0000047d0 2024-09-13T17:51:25.069 INFO:teuthology.orchestra.run.smithi114.stderr:adjusted tunables profile to default 2024-09-13T17:51:25.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:25.067+0000 7fc021200640 1 -- 172.21.15.114:0/4008597768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0000047d0 msgr2=0x7fc01c0b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:25.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:25.067+0000 7fc021200640 1 --2- 172.21.15.114:0/4008597768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0000047d0 0x7fc01c0b4de0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc01c0b30d0 tx=0x7fc00400fc90 comp rx=0 tx=0).stop 2024-09-13T17:51:25.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:25.067+0000 7fc021200640 1 -- 172.21.15.114:0/4008597768 shutdown_connections 2024-09-13T17:51:25.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:25.067+0000 7fc021200640 1 --2- 172.21.15.114:0/4008597768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0000052b0 0x7fc01c15ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:25.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:25.067+0000 7fc021200640 1 --2- 172.21.15.114:0/4008597768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0000047d0 0x7fc01c0b4de0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:25.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:25.067+0000 7fc021200640 1 --2- 172.21.15.114:0/4008597768 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc000003980 0x7fc01c1f2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:25.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:25.067+0000 7fc021200640 1 -- 172.21.15.114:0/4008597768 >> 172.21.15.114:0/4008597768 conn(0x7fc01c0d04e0 msgr2=0x7fc01c06f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:25.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:25.067+0000 7fc021200640 1 -- 172.21.15.114:0/4008597768 shutdown_connections 2024-09-13T17:51:25.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:25.067+0000 7fc021200640 1 -- 172.21.15.114:0/4008597768 wait complete. 2024-09-13T17:51:25.090 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T17:51:25.090 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T17:51:25.090 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:51:25.090 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T17:51:25.110 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:51:25.110 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T17:51:25.170 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-13T17:51:25.168+0000 7f139c64b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T17:51:25.175 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:51:25.175 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T17:51:25.212 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-13T17:51:25.211+0000 7fb60c24b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T17:51:25.231 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:51:25.231 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T17:51:25.295 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:51:25.295 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-13T17:51:25.315 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:51:25.315 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-13T17:51:25.377 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:51:25.378 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-13T17:51:25.438 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:51:25.438 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-13T17:51:25.497 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new f6e4c049-a8f5-471c-940e-fe0ab8337a45 0 2024-09-13T17:51:25.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.672+0000 7f868f800640 1 Processor -- start 2024-09-13T17:51:25.674 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.672+0000 7f868f800640 1 -- start start 2024-09-13T17:51:25.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.676+0000 7f868f800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f86880ce650 0x7f8688099480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:25.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.676+0000 7f868f800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86880cebe0 con 0x7f86881602e0 2024-09-13T17:51:25.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.676+0000 7f868f800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86880ceec0 con 0x7f868806e680 2024-09-13T17:51:25.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.676+0000 7f868f800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86880cf1a0 con 0x7f86880ce650 2024-09-13T17:51:25.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.676+0000 7f868d800640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f868806e680 0x7f868806eb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:60664/0 (socket says 172.21.15.134:60664) 2024-09-13T17:51:25.675 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.676+0000 7f868d800640 1 -- 172.21.15.134:0/452267662 learned_addr learned my addr 172.21.15.134:0/452267662 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-13T17:51:25.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.676+0000 7f8687e00640 1 --2- 172.21.15.134:0/452267662 >> v2:172.21.15.114:3300/0 conn(0x7f86880ce650 0x7f8688099480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:25.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.676+0000 7f8687400640 1 -- 172.21.15.134:0/452267662 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3386841854 0 0) 0x7f86880ceec0 con 0x7f868806e680 2024-09-13T17:51:25.676 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.676+0000 7f8687400640 1 -- 172.21.15.134:0/452267662 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8670003530 con 0x7f868806e680 2024-09-13T17:51:25.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.676+0000 7f8687e00640 1 -- 172.21.15.134:0/452267662 >> v1:172.21.15.134:6789/0 conn(0x7f868806e680 legacy=0x7f868806eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:25.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.676+0000 7f8687e00640 1 -- 172.21.15.134:0/452267662 >> v1:172.21.15.114:6789/0 conn(0x7f86881602e0 legacy=0x7f86881606c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:25.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.676+0000 7f8687400640 1 -- 172.21.15.134:0/452267662 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3216620762 0 0) 0x7f86880cebe0 con 0x7f86881602e0 2024-09-13T17:51:25.677 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.676+0000 7f8687e00640 1 -- 172.21.15.134:0/452267662 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86880cf480 con 0x7f86880ce650 2024-09-13T17:51:25.677 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-13T17:51:25.676+0000 7f139c64b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T17:51:25.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.680+0000 7f8687e00640 1 --2- 172.21.15.134:0/452267662 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86880ce650 0x7f8688099480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f86740097c0 tx=0x7f867401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25954c5ec33d18aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:25.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.680+0000 7f8687400640 1 -- 172.21.15.134:0/452267662 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86740ab600 con 0x7f86880ce650 2024-09-13T17:51:25.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.680+0000 7f8687400640 1 -- 172.21.15.134:0/452267662 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86740ab760 con 0x7f86880ce650 2024-09-13T17:51:25.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.680+0000 7f8687400640 1 -- 172.21.15.134:0/452267662 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86740abaf0 con 0x7f86880ce650 2024-09-13T17:51:25.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.680+0000 7f868f800640 1 -- 172.21.15.134:0/452267662 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86880ce650 msgr2=0x7f8688099480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:25.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.680+0000 7f868f800640 1 --2- 172.21.15.134:0/452267662 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86880ce650 0x7f8688099480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f86740097c0 tx=0x7f867401c3e0 comp rx=0 tx=0).stop 2024-09-13T17:51:25.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.680+0000 7f868f800640 1 -- 172.21.15.134:0/452267662 shutdown_connections 2024-09-13T17:51:25.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.680+0000 7f868f800640 1 --2- 172.21.15.134:0/452267662 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86880ce650 0x7f8688099480 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:25.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.680+0000 7f868f800640 1 -- 172.21.15.134:0/452267662 >> 172.21.15.134:0/452267662 conn(0x7f86880d04e0 msgr2=0x7f86880d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:25.680 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.680+0000 7f868f800640 1 -- 172.21.15.134:0/452267662 shutdown_connections 2024-09-13T17:51:25.681 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.680+0000 7f868f800640 1 -- 172.21.15.134:0/452267662 wait complete. 2024-09-13T17:51:25.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.680+0000 7f868f800640 1 Processor -- start 2024-09-13T17:51:25.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.680+0000 7f868f800640 1 -- start start 2024-09-13T17:51:25.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.680+0000 7f868f800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f868806e680 0x7f868815b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:25.683 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.680+0000 7f868f800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86880ce650 0x7f86880b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:25.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.680+0000 7f868f800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86881602e0 0x7f86880cd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:25.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.680+0000 7f868f800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86880c6250 con 0x7f86881602e0 2024-09-13T17:51:25.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.680+0000 7f868f800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86880b6190 con 0x7f86880ce650 2024-09-13T17:51:25.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.680+0000 7f868f800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86880c5920 con 0x7f868806e680 2024-09-13T17:51:25.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.684+0000 7f8687e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86880ce650 0x7f86880b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:25.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.684+0000 7f868ce00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f868806e680 0x7f868815b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:25.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.684+0000 7f8687e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86880ce650 0x7f86880b56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37580/0 (socket says 172.21.15.134:37580) 2024-09-13T17:51:25.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.684+0000 7f868ce00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f868806e680 0x7f868815b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:60354/0 (socket says 172.21.15.134:60354) 2024-09-13T17:51:25.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.684+0000 7f8687e00640 1 -- 172.21.15.134:0/1424761967 learned_addr learned my addr 172.21.15.134:0/1424761967 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-13T17:51:25.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.684+0000 7f868d800640 1 --2- 172.21.15.134:0/1424761967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86881602e0 0x7f86880cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:25.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.684+0000 7f8687e00640 1 -- 172.21.15.134:0/1424761967 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f868806e680 msgr2=0x7f868815b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:25.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.684+0000 7f8687e00640 1 --2- 172.21.15.134:0/1424761967 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f868806e680 0x7f868815b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:25.684 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.684+0000 7f8687e00640 1 -- 172.21.15.134:0/1424761967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86881602e0 msgr2=0x7f86880cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:25.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.684+0000 7f8687e00640 1 --2- 172.21.15.134:0/1424761967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86881602e0 0x7f86880cd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:25.685 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.684+0000 7f8687e00640 1 -- 172.21.15.134:0/1424761967 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8674009420 con 0x7f86880ce650 2024-09-13T17:51:25.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.684+0000 7f8687e00640 1 --2- 172.21.15.134:0/1424761967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86880ce650 0x7f86880b56f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f86740ad040 tx=0x7f867401ac20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:25.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.684+0000 7f8684c00640 1 -- 172.21.15.134:0/1424761967 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86740b5600 con 0x7f86880ce650 2024-09-13T17:51:25.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.684+0000 7f8684c00640 1 -- 172.21.15.134:0/1424761967 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86740b5760 con 0x7f86880ce650 2024-09-13T17:51:25.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.684+0000 7f8684c00640 1 -- 172.21.15.134:0/1424761967 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86740b5af0 con 0x7f86880ce650 2024-09-13T17:51:25.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.684+0000 7f868f800640 1 -- 172.21.15.134:0/1424761967 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86880c5c00 con 0x7f86880ce650 2024-09-13T17:51:25.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.684+0000 7f868f800640 1 -- 172.21.15.134:0/1424761967 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86880b51e0 con 0x7f86880ce650 2024-09-13T17:51:25.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.684+0000 7f8684c00640 1 -- 172.21.15.134:0/1424761967 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f86740bf450 con 0x7f86880ce650 2024-09-13T17:51:25.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.684+0000 7f8684c00640 1 -- 172.21.15.134:0/1424761967 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f86740b3390 con 0x7f86880ce650 2024-09-13T17:51:25.686 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.684+0000 7f868f800640 1 -- 172.21.15.134:0/1424761967 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86880c63c0 con 0x7f86880ce650 2024-09-13T17:51:25.698 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.696+0000 7f8684c00640 1 -- 172.21.15.134:0/1424761967 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f86740c4060 con 0x7f86880ce650 2024-09-13T17:51:25.710 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-13T17:51:25.707+0000 7fb60c24b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T17:51:25.764 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.764+0000 7f868f800640 1 -- 172.21.15.134:0/1424761967 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f6e4c049-a8f5-471c-940e-fe0ab8337a45", "id": 0} v 0) v1 -- 0x7f86880d1380 con 0x7f86880ce650 2024-09-13T17:51:25.770 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.768+0000 7f8684c00640 1 -- 172.21.15.134:0/1424761967 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f6e4c049-a8f5-471c-940e-fe0ab8337a45", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f868806fa30 con 0x7f86880ce650 2024-09-13T17:51:25.771 INFO:teuthology.orchestra.run.smithi134.stdout:0 2024-09-13T17:51:25.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.772+0000 7f868f800640 1 -- 172.21.15.134:0/1424761967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86880ce650 msgr2=0x7f86880b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:25.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.772+0000 7f868f800640 1 --2- 172.21.15.134:0/1424761967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86880ce650 0x7f86880b56f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f86740ad040 tx=0x7f867401ac20 comp rx=0 tx=0).stop 2024-09-13T17:51:25.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.772+0000 7f868f800640 1 -- 172.21.15.134:0/1424761967 shutdown_connections 2024-09-13T17:51:25.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.772+0000 7f868f800640 1 --2- 172.21.15.134:0/1424761967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86881602e0 0x7f86880cd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:25.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.772+0000 7f868f800640 1 --2- 172.21.15.134:0/1424761967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86880ce650 0x7f86880b56f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:25.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.772+0000 7f868f800640 1 --2- 172.21.15.134:0/1424761967 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f868806e680 0x7f868815b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:25.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.772+0000 7f868f800640 1 -- 172.21.15.134:0/1424761967 >> 172.21.15.134:0/1424761967 conn(0x7f86880d04e0 msgr2=0x7f868806b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:25.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.772+0000 7f868f800640 1 -- 172.21.15.134:0/1424761967 shutdown_connections 2024-09-13T17:51:25.773 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.772+0000 7f868f800640 1 -- 172.21.15.134:0/1424761967 wait complete. 2024-09-13T17:51:25.790 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 3ff3fff7-0060-40f3-bec0-4c6d44ce2703 1 2024-09-13T17:51:25.892 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-13T17:51:25.892+0000 7f139c64b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T17:51:25.924 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.924+0000 7fa5f3600640 1 Processor -- start 2024-09-13T17:51:25.925 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.924+0000 7fa5f3600640 1 -- start start 2024-09-13T17:51:25.926 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.924+0000 7fa5f3600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5ec15a650 0x7fa5ec099480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:25.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.924+0000 7fa5f3600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa5ec0ce0b0 0x7fa5ec15e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:25.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.924+0000 7fa5f3600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5ec15ea40 con 0x7fa5ec15e5f0 2024-09-13T17:51:25.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.924+0000 7fa5f3600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5ec0ce540 con 0x7fa5ec0ce0b0 2024-09-13T17:51:25.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.924+0000 7fa5f3600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec0ce820 con 0x7fa5ec15a650 2024-09-13T17:51:25.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.924+0000 7fa5f0c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5ec15a650 0x7fa5ec099480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:25.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.924+0000 7fa5ebe00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa5ec0ce0b0 0x7fa5ec15e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:25.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.924+0000 7fa5f0c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5ec15a650 0x7fa5ec099480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:60362/0 (socket says 172.21.15.134:60362) 2024-09-13T17:51:25.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.924+0000 7fa5f0c00640 1 -- 172.21.15.134:0/3155873242 learned_addr learned my addr 172.21.15.134:0/3155873242 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-13T17:51:25.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.924+0000 7fa5ebe00640 1 -- 172.21.15.134:0/3155873242 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5ec15a650 msgr2=0x7fa5ec099480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:25.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.924+0000 7fa5ebe00640 1 --2- 172.21.15.134:0/3155873242 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5ec15a650 0x7fa5ec099480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:25.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.924+0000 7fa5ebe00640 1 -- 172.21.15.134:0/3155873242 >> v1:172.21.15.114:6789/0 conn(0x7fa5ec15e5f0 legacy=0x7fa5ec15aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:25.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.924+0000 7fa5ebe00640 1 -- 172.21.15.134:0/3155873242 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ec0ceb00 con 0x7fa5ec0ce0b0 2024-09-13T17:51:25.927 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.924+0000 7fa5f0c00640 1 --2- 172.21.15.134:0/3155873242 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5ec15a650 0x7fa5ec099480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:51:25.929 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-13T17:51:25.927+0000 7fb60c24b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T17:51:25.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.928+0000 7fa5ebe00640 1 --2- 172.21.15.134:0/3155873242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5ec0ce0b0 0x7fa5ec15e0b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80097c0 tx=0x7fa5d801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9909960824c791c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:25.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.928+0000 7fa5eb400640 1 -- 172.21.15.134:0/3155873242 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d80ab670 con 0x7fa5ec0ce0b0 2024-09-13T17:51:25.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.928+0000 7fa5eb400640 1 -- 172.21.15.134:0/3155873242 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d80ab7d0 con 0x7fa5ec0ce0b0 2024-09-13T17:51:25.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.928+0000 7fa5eb400640 1 -- 172.21.15.134:0/3155873242 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d80abb60 con 0x7fa5ec0ce0b0 2024-09-13T17:51:25.930 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.928+0000 7fa5f3600640 1 -- 172.21.15.134:0/3155873242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5ec0ce0b0 msgr2=0x7fa5ec15e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:25.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.928+0000 7fa5f3600640 1 --2- 172.21.15.134:0/3155873242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5ec0ce0b0 0x7fa5ec15e0b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80097c0 tx=0x7fa5d801c470 comp rx=0 tx=0).stop 2024-09-13T17:51:25.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.928+0000 7fa5f3600640 1 -- 172.21.15.134:0/3155873242 shutdown_connections 2024-09-13T17:51:25.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.928+0000 7fa5f3600640 1 --2- 172.21.15.134:0/3155873242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5ec0ce0b0 0x7fa5ec15e0b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:25.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.928+0000 7fa5f3600640 1 --2- 172.21.15.134:0/3155873242 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5ec15a650 0x7fa5ec099480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:25.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.928+0000 7fa5f3600640 1 -- 172.21.15.134:0/3155873242 >> 172.21.15.134:0/3155873242 conn(0x7fa5ec0d04e0 msgr2=0x7fa5ec0d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:25.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.928+0000 7fa5f3600640 1 -- 172.21.15.134:0/3155873242 shutdown_connections 2024-09-13T17:51:25.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.928+0000 7fa5f3600640 1 -- 172.21.15.134:0/3155873242 wait complete. 2024-09-13T17:51:25.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.932+0000 7fa5f3600640 1 Processor -- start 2024-09-13T17:51:25.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.932+0000 7fa5f3600640 1 -- start start 2024-09-13T17:51:25.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.932+0000 7fa5f3600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5ec15a650 0x7fa5ec157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:25.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.932+0000 7fa5f3600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5ec15e5f0 0x7fa5ec1578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:25.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.932+0000 7fa5f3600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5ec0b3330 0x7fa5ec0b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:25.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.932+0000 7fa5f3600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec157df0 con 0x7fa5ec15e5f0 2024-09-13T17:51:25.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.932+0000 7fa5f3600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec0b62e0 con 0x7fa5ec0b3330 2024-09-13T17:51:25.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.932+0000 7fa5f3600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec0b5910 con 0x7fa5ec15a650 2024-09-13T17:51:25.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.932+0000 7fa5f0c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5ec15a650 0x7fa5ec157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:25.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.932+0000 7fa5f0c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5ec15a650 0x7fa5ec157f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:60366/0 (socket says 172.21.15.134:60366) 2024-09-13T17:51:25.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.932+0000 7fa5f0c00640 1 -- 172.21.15.134:0/1157186200 learned_addr learned my addr 172.21.15.134:0/1157186200 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-13T17:51:25.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.932+0000 7fa5f1600640 1 --2- 172.21.15.134:0/1157186200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5ec0b3330 0x7fa5ec0b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:25.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.932+0000 7fa5ebe00640 1 --2- 172.21.15.134:0/1157186200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5ec15e5f0 0x7fa5ec1578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:25.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.932+0000 7fa5f0c00640 1 -- 172.21.15.134:0/1157186200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5ec0b3330 msgr2=0x7fa5ec0b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:25.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.932+0000 7fa5f0c00640 1 --2- 172.21.15.134:0/1157186200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5ec0b3330 0x7fa5ec0b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:25.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.932+0000 7fa5f0c00640 1 -- 172.21.15.134:0/1157186200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5ec15e5f0 msgr2=0x7fa5ec1578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:25.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.932+0000 7fa5f0c00640 1 --2- 172.21.15.134:0/1157186200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5ec15e5f0 0x7fa5ec1578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:25.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.932+0000 7fa5f0c00640 1 -- 172.21.15.134:0/1157186200 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e00094d0 con 0x7fa5ec15a650 2024-09-13T17:51:25.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.932+0000 7fa5f1600640 1 --2- 172.21.15.134:0/1157186200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5ec0b3330 0x7fa5ec0b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:51:25.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.932+0000 7fa5f0c00640 1 --2- 172.21.15.134:0/1157186200 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5ec15a650 0x7fa5ec157f60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000ea00 tx=0x7fa5e000eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:25.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.932+0000 7fa5e8c00640 1 -- 172.21.15.134:0/1157186200 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e000ca60 con 0x7fa5ec15a650 2024-09-13T17:51:25.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.932+0000 7fa5e8c00640 1 -- 172.21.15.134:0/1157186200 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e000cbc0 con 0x7fa5ec15a650 2024-09-13T17:51:25.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.932+0000 7fa5e8c00640 1 -- 172.21.15.134:0/1157186200 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0013470 con 0x7fa5ec15a650 2024-09-13T17:51:25.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.936+0000 7fa5f3600640 1 -- 172.21.15.134:0/1157186200 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d8009420 con 0x7fa5ec15a650 2024-09-13T17:51:25.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.936+0000 7fa5f3600640 1 -- 172.21.15.134:0/1157186200 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ec0b38d0 con 0x7fa5ec15a650 2024-09-13T17:51:25.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.936+0000 7fa5e8c00640 1 -- 172.21.15.134:0/1157186200 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fa5e0005ca0 con 0x7fa5ec15a650 2024-09-13T17:51:25.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.936+0000 7fa5e8c00640 1 -- 172.21.15.134:0/1157186200 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fa5e00063d0 con 0x7fa5ec15a650 2024-09-13T17:51:25.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.936+0000 7fa5f3600640 1 -- 172.21.15.134:0/1157186200 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5ec0d1380 con 0x7fa5ec15a650 2024-09-13T17:51:25.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:25.936+0000 7fa5e8c00640 1 -- 172.21.15.134:0/1157186200 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fa5e0021060 con 0x7fa5ec15a650 2024-09-13T17:51:26.006 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.004+0000 7fa5f3600640 1 -- 172.21.15.134:0/1157186200 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3ff3fff7-0060-40f3-bec0-4c6d44ce2703", "id": 1} v 0) v1 -- 0x7fa5ec070610 con 0x7fa5ec15a650 2024-09-13T17:51:26.014 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.012+0000 7fa5e8c00640 1 -- 172.21.15.134:0/1157186200 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3ff3fff7-0060-40f3-bec0-4c6d44ce2703", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa5e0017070 con 0x7fa5ec15a650 2024-09-13T17:51:26.014 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-09-13T17:51:26.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.016+0000 7fa5f3600640 1 -- 172.21.15.134:0/1157186200 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5ec15a650 msgr2=0x7fa5ec157f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:26.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.016+0000 7fa5f3600640 1 --2- 172.21.15.134:0/1157186200 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5ec15a650 0x7fa5ec157f60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000ea00 tx=0x7fa5e000eec0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.015 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.016+0000 7fa5f3600640 1 -- 172.21.15.134:0/1157186200 shutdown_connections 2024-09-13T17:51:26.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.016+0000 7fa5f3600640 1 --2- 172.21.15.134:0/1157186200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5ec0b3330 0x7fa5ec0b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.016+0000 7fa5f3600640 1 --2- 172.21.15.134:0/1157186200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5ec15e5f0 0x7fa5ec1578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.016+0000 7fa5f3600640 1 --2- 172.21.15.134:0/1157186200 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5ec15a650 0x7fa5ec157f60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.016+0000 7fa5f3600640 1 -- 172.21.15.134:0/1157186200 >> 172.21.15.134:0/1157186200 conn(0x7fa5ec0d04e0 msgr2=0x7fa5ec164a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:26.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.016+0000 7fa5f3600640 1 -- 172.21.15.134:0/1157186200 shutdown_connections 2024-09-13T17:51:26.016 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.016+0000 7fa5f3600640 1 -- 172.21.15.134:0/1157186200 wait complete. 2024-09-13T17:51:26.034 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 9074d3c3-6f52-4075-b824-908a03d48a70 2 2024-09-13T17:51:26.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.168+0000 7f3989000640 1 Processor -- start 2024-09-13T17:51:26.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.168+0000 7f3989000640 1 -- start start 2024-09-13T17:51:26.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.168+0000 7f3989000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f398415a650 0x7f3984099480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:26.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.168+0000 7f3989000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f39840ce0b0 0x7f398415e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:26.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.168+0000 7f3989000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398415ea40 con 0x7f398415e5f0 2024-09-13T17:51:26.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.168+0000 7f3989000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39840ce540 con 0x7f39840ce0b0 2024-09-13T17:51:26.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.168+0000 7f3989000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39840ce820 con 0x7f398415a650 2024-09-13T17:51:26.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.168+0000 7f397be00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f39840ce0b0 0x7f398415e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:26.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.168+0000 7f397be00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f39840ce0b0 0x7f398415e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37614/0 (socket says 172.21.15.134:37614) 2024-09-13T17:51:26.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.168+0000 7f397be00640 1 -- 172.21.15.134:0/858819341 learned_addr learned my addr 172.21.15.134:0/858819341 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-13T17:51:26.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.168+0000 7f3981e00640 1 --2- 172.21.15.134:0/858819341 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f398415a650 0x7f3984099480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:26.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.168+0000 7f397be00640 1 -- 172.21.15.134:0/858819341 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f398415a650 msgr2=0x7f3984099480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:26.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.168+0000 7f397be00640 1 --2- 172.21.15.134:0/858819341 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f398415a650 0x7f3984099480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.168+0000 7f397be00640 1 -- 172.21.15.134:0/858819341 >> v1:172.21.15.114:6789/0 conn(0x7f398415e5f0 legacy=0x7f398415aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:26.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.168+0000 7f397be00640 1 -- 172.21.15.134:0/858819341 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39840ceb00 con 0x7f39840ce0b0 2024-09-13T17:51:26.170 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.168+0000 7f3981e00640 1 --2- 172.21.15.134:0/858819341 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f398415a650 0x7f3984099480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:51:26.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.172+0000 7f397be00640 1 --2- 172.21.15.134:0/858819341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39840ce0b0 0x7f398415e0b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f396c009870 tx=0x7f396c01c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d768ddaf6dc450ad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:26.172 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.172+0000 7f3981400640 1 -- 172.21.15.134:0/858819341 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396c0aa610 con 0x7f39840ce0b0 2024-09-13T17:51:26.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.172+0000 7f3981400640 1 -- 172.21.15.134:0/858819341 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f396c0a6040 con 0x7f39840ce0b0 2024-09-13T17:51:26.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.172+0000 7f3981400640 1 -- 172.21.15.134:0/858819341 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396c0aa990 con 0x7f39840ce0b0 2024-09-13T17:51:26.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.172+0000 7f3989000640 1 -- 172.21.15.134:0/858819341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39840ce0b0 msgr2=0x7f398415e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:26.173 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.172+0000 7f3989000640 1 --2- 172.21.15.134:0/858819341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39840ce0b0 0x7f398415e0b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f396c009870 tx=0x7f396c01c4f0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.172+0000 7f3989000640 1 -- 172.21.15.134:0/858819341 shutdown_connections 2024-09-13T17:51:26.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.172+0000 7f3989000640 1 --2- 172.21.15.134:0/858819341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39840ce0b0 0x7f398415e0b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.172+0000 7f3989000640 1 --2- 172.21.15.134:0/858819341 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f398415a650 0x7f3984099480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.172+0000 7f3989000640 1 -- 172.21.15.134:0/858819341 >> 172.21.15.134:0/858819341 conn(0x7f39840d04e0 msgr2=0x7f39840d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:26.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.172+0000 7f3989000640 1 -- 172.21.15.134:0/858819341 shutdown_connections 2024-09-13T17:51:26.174 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.172+0000 7f3989000640 1 -- 172.21.15.134:0/858819341 wait complete. 2024-09-13T17:51:26.178 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.176+0000 7f3989000640 1 Processor -- start 2024-09-13T17:51:26.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.176+0000 7f3989000640 1 -- start start 2024-09-13T17:51:26.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.176+0000 7f3989000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f398415a650 0x7f3984156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:26.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.176+0000 7f3989000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f398415e5f0 0x7f3984158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:26.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.176+0000 7f3989000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f398415c6b0 0x7f3984158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:26.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.176+0000 7f3989000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39841651c0 con 0x7f398415e5f0 2024-09-13T17:51:26.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.176+0000 7f3989000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398415cbb0 con 0x7f398415a650 2024-09-13T17:51:26.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.176+0000 7f3989000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398415ce90 con 0x7f398415c6b0 2024-09-13T17:51:26.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.176+0000 7f3981e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f398415a650 0x7f3984156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:26.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.176+0000 7f3982800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f398415c6b0 0x7f3984158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:26.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.176+0000 7f3982800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f398415c6b0 0x7f3984158cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:60388/0 (socket says 172.21.15.134:60388) 2024-09-13T17:51:26.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.176+0000 7f3982800640 1 -- 172.21.15.134:0/3315943019 learned_addr learned my addr 172.21.15.134:0/3315943019 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-13T17:51:26.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.176+0000 7f3981e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f398415a650 0x7f3984156710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37630/0 (socket says 172.21.15.134:37630) 2024-09-13T17:51:26.179 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.176+0000 7f397be00640 1 --2- 172.21.15.134:0/3315943019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f398415e5f0 0x7f3984158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:26.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.176+0000 7f3982800640 1 -- 172.21.15.134:0/3315943019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f398415a650 msgr2=0x7f3984156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:26.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.176+0000 7f3982800640 1 --2- 172.21.15.134:0/3315943019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f398415a650 0x7f3984156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.176+0000 7f3982800640 1 -- 172.21.15.134:0/3315943019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f398415e5f0 msgr2=0x7f3984158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:26.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.176+0000 7f3982800640 1 --2- 172.21.15.134:0/3315943019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f398415e5f0 0x7f3984158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.176+0000 7f3982800640 1 -- 172.21.15.134:0/3315943019 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396c0094d0 con 0x7f398415c6b0 2024-09-13T17:51:26.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.176+0000 7f3982800640 1 --2- 172.21.15.134:0/3315943019 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f398415c6b0 0x7f3984158cc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f397c00b990 tx=0x7f397c00be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:26.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.176+0000 7f397a000640 1 -- 172.21.15.134:0/3315943019 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c00cba0 con 0x7f398415c6b0 2024-09-13T17:51:26.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.176+0000 7f397a000640 1 -- 172.21.15.134:0/3315943019 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c00cd00 con 0x7f398415c6b0 2024-09-13T17:51:26.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.176+0000 7f397a000640 1 -- 172.21.15.134:0/3315943019 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c014680 con 0x7f398415c6b0 2024-09-13T17:51:26.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.176+0000 7f3989000640 1 -- 172.21.15.134:0/3315943019 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398415d170 con 0x7f398415c6b0 2024-09-13T17:51:26.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.176+0000 7f3989000640 1 -- 172.21.15.134:0/3315943019 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f398415d730 con 0x7f398415c6b0 2024-09-13T17:51:26.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.176+0000 7f397a000640 1 -- 172.21.15.134:0/3315943019 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f397c014ae0 con 0x7f398415c6b0 2024-09-13T17:51:26.180 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.176+0000 7f397a000640 1 -- 172.21.15.134:0/3315943019 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f397c014d90 con 0x7f398415c6b0 2024-09-13T17:51:26.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.176+0000 7f3989000640 1 -- 172.21.15.134:0/3315943019 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39840c82d0 con 0x7f398415c6b0 2024-09-13T17:51:26.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.180+0000 7f397a000640 1 -- 172.21.15.134:0/3315943019 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f397c019070 con 0x7f398415c6b0 2024-09-13T17:51:26.247 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.248+0000 7f3989000640 1 -- 172.21.15.134:0/3315943019 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9074d3c3-6f52-4075-b824-908a03d48a70", "id": 2} v 0) v1 -- 0x7f398415e0b0 con 0x7f398415c6b0 2024-09-13T17:51:26.252 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.252+0000 7f397a000640 1 -- 172.21.15.134:0/3315943019 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9074d3c3-6f52-4075-b824-908a03d48a70", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f397c01e440 con 0x7f398415c6b0 2024-09-13T17:51:26.252 INFO:teuthology.orchestra.run.smithi134.stdout:2 2024-09-13T17:51:26.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.252+0000 7f3989000640 1 -- 172.21.15.134:0/3315943019 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f398415c6b0 msgr2=0x7f3984158cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:26.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.252+0000 7f3989000640 1 --2- 172.21.15.134:0/3315943019 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f398415c6b0 0x7f3984158cc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f397c00b990 tx=0x7f397c00be50 comp rx=0 tx=0).stop 2024-09-13T17:51:26.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.252+0000 7f3989000640 1 -- 172.21.15.134:0/3315943019 shutdown_connections 2024-09-13T17:51:26.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.252+0000 7f3989000640 1 --2- 172.21.15.134:0/3315943019 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f398415c6b0 0x7f3984158cc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.252+0000 7f3989000640 1 --2- 172.21.15.134:0/3315943019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f398415e5f0 0x7f3984158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.252+0000 7f3989000640 1 --2- 172.21.15.134:0/3315943019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f398415a650 0x7f3984156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.252+0000 7f3989000640 1 -- 172.21.15.134:0/3315943019 >> 172.21.15.134:0/3315943019 conn(0x7f39840d04e0 msgr2=0x7f398406ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:26.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.252+0000 7f3989000640 1 -- 172.21.15.134:0/3315943019 shutdown_connections 2024-09-13T17:51:26.253 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.252+0000 7f3989000640 1 -- 172.21.15.134:0/3315943019 wait complete. 2024-09-13T17:51:26.270 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 6fd45617-bfa7-4357-9e25-7d0ad6c493cd 3 2024-09-13T17:51:26.405 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.404+0000 7f1164400640 1 Processor -- start 2024-09-13T17:51:26.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.404+0000 7f1164400640 1 -- start start 2024-09-13T17:51:26.406 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.404+0000 7f1164400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f115c15e4b0 0x7f115c0ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:26.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.404+0000 7f1164400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f115c0ccd40 con 0x7f115c06e6f0 2024-09-13T17:51:26.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.404+0000 7f1164400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f115c070260 con 0x7f115c15d640 2024-09-13T17:51:26.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.404+0000 7f1164400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f115c070540 con 0x7f115c15e4b0 2024-09-13T17:51:26.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.408+0000 7f1162400640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f115c15d640 0x7f115c15da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:60672/0 (socket says 172.21.15.134:60672) 2024-09-13T17:51:26.407 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.408+0000 7f1162400640 1 -- 172.21.15.134:0/1916345505 learned_addr learned my addr 172.21.15.134:0/1916345505 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-13T17:51:26.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.408+0000 7f1161a00640 1 --2- 172.21.15.134:0/1916345505 >> v2:172.21.15.114:3300/0 conn(0x7f115c15e4b0 0x7f115c0ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:26.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.408+0000 7f115be00640 1 -- 172.21.15.134:0/1916345505 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4015819428 0 0) 0x7f115c070260 con 0x7f115c15d640 2024-09-13T17:51:26.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.408+0000 7f115be00640 1 -- 172.21.15.134:0/1916345505 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1144003530 con 0x7f115c15d640 2024-09-13T17:51:26.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.408+0000 7f1161a00640 1 -- 172.21.15.134:0/1916345505 >> v1:172.21.15.134:6789/0 conn(0x7f115c15d640 legacy=0x7f115c15da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:26.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.408+0000 7f1161a00640 1 -- 172.21.15.134:0/1916345505 >> v1:172.21.15.114:6789/0 conn(0x7f115c06e6f0 legacy=0x7f115c15e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:26.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.408+0000 7f115be00640 1 -- 172.21.15.134:0/1916345505 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305272946 0 0) 0x7f115c0ccd40 con 0x7f115c06e6f0 2024-09-13T17:51:26.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.408+0000 7f1161a00640 1 -- 172.21.15.134:0/1916345505 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115c0cec60 con 0x7f115c15e4b0 2024-09-13T17:51:26.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.408+0000 7f1161a00640 1 --2- 172.21.15.134:0/1916345505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f115c15e4b0 0x7f115c0ce0b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f11500097c0 tx=0x7f115001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54cdec4be39fb1b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:26.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.412+0000 7f115be00640 1 -- 172.21.15.134:0/1916345505 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11500a8990 con 0x7f115c15e4b0 2024-09-13T17:51:26.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.412+0000 7f115be00640 1 -- 172.21.15.134:0/1916345505 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11500a8af0 con 0x7f115c15e4b0 2024-09-13T17:51:26.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.412+0000 7f115be00640 1 -- 172.21.15.134:0/1916345505 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11500a8e80 con 0x7f115c15e4b0 2024-09-13T17:51:26.411 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.412+0000 7f1164400640 1 -- 172.21.15.134:0/1916345505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f115c15e4b0 msgr2=0x7f115c0ce0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:26.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.412+0000 7f1164400640 1 --2- 172.21.15.134:0/1916345505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f115c15e4b0 0x7f115c0ce0b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f11500097c0 tx=0x7f115001ec90 comp rx=0 tx=0).stop 2024-09-13T17:51:26.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.412+0000 7f1164400640 1 -- 172.21.15.134:0/1916345505 shutdown_connections 2024-09-13T17:51:26.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.412+0000 7f1164400640 1 --2- 172.21.15.134:0/1916345505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f115c15e4b0 0x7f115c0ce0b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.412+0000 7f1164400640 1 -- 172.21.15.134:0/1916345505 >> 172.21.15.134:0/1916345505 conn(0x7f115c0d04e0 msgr2=0x7f115c0d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:26.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.412+0000 7f1164400640 1 -- 172.21.15.134:0/1916345505 shutdown_connections 2024-09-13T17:51:26.412 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.412+0000 7f1164400640 1 -- 172.21.15.134:0/1916345505 wait complete. 2024-09-13T17:51:26.413 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.412+0000 7f1164400640 1 Processor -- start 2024-09-13T17:51:26.414 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.412+0000 7f1164400640 1 -- start start 2024-09-13T17:51:26.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.412+0000 7f1164400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f115c06e6f0 0x7f115c14ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:26.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.412+0000 7f1164400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f115c15d640 0x7f115c0ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:26.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.412+0000 7f1164400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f115c15e4b0 0x7f115c099380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:26.416 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.412+0000 7f1164400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115c0ca630 con 0x7f115c15e4b0 2024-09-13T17:51:26.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.412+0000 7f1164400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115c0b1850 con 0x7f115c06e6f0 2024-09-13T17:51:26.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.412+0000 7f1164400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f115c152160 con 0x7f115c15d640 2024-09-13T17:51:26.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.412+0000 7f1161a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f115c06e6f0 0x7f115c14ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:26.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.412+0000 7f1161a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f115c06e6f0 0x7f115c14ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37646/0 (socket says 172.21.15.134:37646) 2024-09-13T17:51:26.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.412+0000 7f1161a00640 1 -- 172.21.15.134:0/496751665 learned_addr learned my addr 172.21.15.134:0/496751665 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-13T17:51:26.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.412+0000 7f1161000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f115c15d640 0x7f115c0ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:26.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.416+0000 7f1162400640 1 --2- 172.21.15.134:0/496751665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f115c15e4b0 0x7f115c099380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:26.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.416+0000 7f1161a00640 1 -- 172.21.15.134:0/496751665 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f115c15d640 msgr2=0x7f115c0ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:26.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.416+0000 7f1161a00640 1 --2- 172.21.15.134:0/496751665 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f115c15d640 0x7f115c0ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.416+0000 7f1161a00640 1 -- 172.21.15.134:0/496751665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f115c15e4b0 msgr2=0x7f115c099380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:26.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.416+0000 7f1161a00640 1 --2- 172.21.15.134:0/496751665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f115c15e4b0 0x7f115c099380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.417 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.416+0000 7f1161a00640 1 -- 172.21.15.134:0/496751665 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1150009420 con 0x7f115c06e6f0 2024-09-13T17:51:26.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.416+0000 7f1161a00640 1 --2- 172.21.15.134:0/496751665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f115c06e6f0 0x7f115c14ec00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f11500b3040 tx=0x7f115001ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:26.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.416+0000 7f1159600640 1 -- 172.21.15.134:0/496751665 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11500bf070 con 0x7f115c06e6f0 2024-09-13T17:51:26.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.416+0000 7f1159600640 1 -- 172.21.15.134:0/496751665 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11500b0bf0 con 0x7f115c06e6f0 2024-09-13T17:51:26.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.416+0000 7f1159600640 1 -- 172.21.15.134:0/496751665 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11500b9410 con 0x7f115c06e6f0 2024-09-13T17:51:26.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.416+0000 7f1164400640 1 -- 172.21.15.134:0/496751665 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f115c152440 con 0x7f115c06e6f0 2024-09-13T17:51:26.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.416+0000 7f1164400640 1 -- 172.21.15.134:0/496751665 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f115c0c98f0 con 0x7f115c06e6f0 2024-09-13T17:51:26.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.416+0000 7f1159600640 1 -- 172.21.15.134:0/496751665 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f11500b7040 con 0x7f115c06e6f0 2024-09-13T17:51:26.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.416+0000 7f1159600640 1 -- 172.21.15.134:0/496751665 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f11500b9d00 con 0x7f115c06e6f0 2024-09-13T17:51:26.418 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.416+0000 7f1164400640 1 -- 172.21.15.134:0/496751665 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f115c0ce0b0 con 0x7f115c06e6f0 2024-09-13T17:51:26.419 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.420+0000 7f1159600640 1 -- 172.21.15.134:0/496751665 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f11500b5070 con 0x7f115c06e6f0 2024-09-13T17:51:26.485 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.484+0000 7f1164400640 1 -- 172.21.15.134:0/496751665 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6fd45617-bfa7-4357-9e25-7d0ad6c493cd", "id": 3} v 0) v1 -- 0x7f115c0d1330 con 0x7f115c06e6f0 2024-09-13T17:51:26.489 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.488+0000 7f1159600640 1 -- 172.21.15.134:0/496751665 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6fd45617-bfa7-4357-9e25-7d0ad6c493cd", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f11500b9870 con 0x7f115c06e6f0 2024-09-13T17:51:26.490 INFO:teuthology.orchestra.run.smithi134.stdout:3 2024-09-13T17:51:26.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.488+0000 7f1164400640 1 -- 172.21.15.134:0/496751665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f115c06e6f0 msgr2=0x7f115c14ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:26.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.488+0000 7f1164400640 1 --2- 172.21.15.134:0/496751665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f115c06e6f0 0x7f115c14ec00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f11500b3040 tx=0x7f115001ba30 comp rx=0 tx=0).stop 2024-09-13T17:51:26.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.488+0000 7f1164400640 1 -- 172.21.15.134:0/496751665 shutdown_connections 2024-09-13T17:51:26.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.488+0000 7f1164400640 1 --2- 172.21.15.134:0/496751665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f115c15e4b0 0x7f115c099380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.488+0000 7f1164400640 1 --2- 172.21.15.134:0/496751665 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f115c15d640 0x7f115c0ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.488+0000 7f1164400640 1 --2- 172.21.15.134:0/496751665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f115c06e6f0 0x7f115c14ec00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.488+0000 7f1164400640 1 -- 172.21.15.134:0/496751665 >> 172.21.15.134:0/496751665 conn(0x7f115c0d04e0 msgr2=0x7f115c15da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:26.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.492+0000 7f1164400640 1 -- 172.21.15.134:0/496751665 shutdown_connections 2024-09-13T17:51:26.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.492+0000 7f1164400640 1 -- 172.21.15.134:0/496751665 wait complete. 2024-09-13T17:51:26.509 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new c9c2c366-0235-4d84-9bbc-a4c0c84fb156 4 2024-09-13T17:51:26.522 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-13T17:51:26.520+0000 7f139c64b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T17:51:26.542 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-13T17:51:26.539+0000 7fb60c24b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T17:51:26.586 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-13T17:51:26.584+0000 7f139c64b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T17:51:26.604 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-13T17:51:26.603+0000 7fb60c24b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T17:51:26.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.644+0000 7f5a64400640 1 Processor -- start 2024-09-13T17:51:26.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.644+0000 7f5a64400640 1 -- start start 2024-09-13T17:51:26.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.644+0000 7f5a64400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5a5c15b3d0 0x7f5a5c06d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:26.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.644+0000 7f5a64400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a5c06e7b0 con 0x7f5a5c15a8e0 2024-09-13T17:51:26.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.644+0000 7f5a64400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a5c06dba0 con 0x7f5a5c15ca40 2024-09-13T17:51:26.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.644+0000 7f5a64400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a5c06de80 con 0x7f5a5c15b3d0 2024-09-13T17:51:26.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.644+0000 7f5a61000640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f5a5c15ca40 0x7f5a5c06ce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:60676/0 (socket says 172.21.15.134:60676) 2024-09-13T17:51:26.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.644+0000 7f5a61000640 1 -- 172.21.15.134:0/2022522632 learned_addr learned my addr 172.21.15.134:0/2022522632 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-13T17:51:26.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.644+0000 7f5a62400640 1 --2- 172.21.15.134:0/2022522632 >> v2:172.21.15.114:3300/0 conn(0x7f5a5c15b3d0 0x7f5a5c06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:26.647 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.644+0000 7f5a5be00640 1 -- 172.21.15.134:0/2022522632 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3857309191 0 0) 0x7f5a5c06dba0 con 0x7f5a5c15ca40 2024-09-13T17:51:26.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.648+0000 7f5a5be00640 1 -- 172.21.15.134:0/2022522632 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a44003530 con 0x7f5a5c15ca40 2024-09-13T17:51:26.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.648+0000 7f5a62400640 1 -- 172.21.15.134:0/2022522632 >> v1:172.21.15.134:6789/0 conn(0x7f5a5c15ca40 legacy=0x7f5a5c06ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:26.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.648+0000 7f5a5be00640 1 -- 172.21.15.134:0/2022522632 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2248710880 0 0) 0x7f5a5c06e7b0 con 0x7f5a5c15a8e0 2024-09-13T17:51:26.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.648+0000 7f5a62400640 1 -- 172.21.15.134:0/2022522632 >> v1:172.21.15.114:6789/0 conn(0x7f5a5c15a8e0 legacy=0x7f5a5c15acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:26.648 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.648+0000 7f5a62400640 1 -- 172.21.15.134:0/2022522632 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5c06e160 con 0x7f5a5c15b3d0 2024-09-13T17:51:26.648 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-13T17:51:26.648+0000 7f139c64b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T17:51:26.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.648+0000 7f5a62400640 1 --2- 172.21.15.134:0/2022522632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a5c15b3d0 0x7f5a5c06d540 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5a54009d90 tx=0x7f5a5401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8e445e821f832e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:26.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.648+0000 7f5a5be00640 1 -- 172.21.15.134:0/2022522632 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a540a5880 con 0x7f5a5c15b3d0 2024-09-13T17:51:26.650 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.648+0000 7f5a5be00640 1 -- 172.21.15.134:0/2022522632 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a540a59e0 con 0x7f5a5c15b3d0 2024-09-13T17:51:26.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.648+0000 7f5a5be00640 1 -- 172.21.15.134:0/2022522632 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a540a5d70 con 0x7f5a5c15b3d0 2024-09-13T17:51:26.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.652+0000 7f5a64400640 1 -- 172.21.15.134:0/2022522632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a5c15b3d0 msgr2=0x7f5a5c06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:26.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.652+0000 7f5a64400640 1 --2- 172.21.15.134:0/2022522632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a5c15b3d0 0x7f5a5c06d540 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5a54009d90 tx=0x7f5a5401c8b0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.651 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.652+0000 7f5a64400640 1 -- 172.21.15.134:0/2022522632 shutdown_connections 2024-09-13T17:51:26.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.652+0000 7f5a64400640 1 --2- 172.21.15.134:0/2022522632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a5c15b3d0 0x7f5a5c06d540 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.652+0000 7f5a64400640 1 -- 172.21.15.134:0/2022522632 >> 172.21.15.134:0/2022522632 conn(0x7f5a5c071ba0 msgr2=0x7f5a5c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:26.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.652+0000 7f5a64400640 1 -- 172.21.15.134:0/2022522632 shutdown_connections 2024-09-13T17:51:26.652 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.652+0000 7f5a64400640 1 -- 172.21.15.134:0/2022522632 wait complete. 2024-09-13T17:51:26.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.652+0000 7f5a64400640 1 Processor -- start 2024-09-13T17:51:26.653 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.652+0000 7f5a64400640 1 -- start start 2024-09-13T17:51:26.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.652+0000 7f5a64400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5c15a8e0 0x7f5a5c15a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:26.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.652+0000 7f5a64400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a5c15b3d0 0x7f5a5c159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:26.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.652+0000 7f5a64400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a5c15ca40 0x7f5a5c149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:26.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.652+0000 7f5a64400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c14a750 con 0x7f5a5c15b3d0 2024-09-13T17:51:26.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.652+0000 7f5a64400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c15a6b0 con 0x7f5a5c15a8e0 2024-09-13T17:51:26.654 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.652+0000 7f5a64400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c0ccc50 con 0x7f5a5c15ca40 2024-09-13T17:51:26.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.652+0000 7f5a61a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5c15a8e0 0x7f5a5c15a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:26.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.652+0000 7f5a62400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a5c15ca40 0x7f5a5c149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:26.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.652+0000 7f5a62400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a5c15ca40 0x7f5a5c149430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:60404/0 (socket says 172.21.15.134:60404) 2024-09-13T17:51:26.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.652+0000 7f5a62400640 1 -- 172.21.15.134:0/1047748643 learned_addr learned my addr 172.21.15.134:0/1047748643 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-13T17:51:26.655 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.652+0000 7f5a61000640 1 --2- 172.21.15.134:0/1047748643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a5c15b3d0 0x7f5a5c159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:26.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.652+0000 7f5a62400640 1 -- 172.21.15.134:0/1047748643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5c15a8e0 msgr2=0x7f5a5c15a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:26.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.652+0000 7f5a62400640 1 --2- 172.21.15.134:0/1047748643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5c15a8e0 0x7f5a5c15a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.652+0000 7f5a62400640 1 -- 172.21.15.134:0/1047748643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a5c15b3d0 msgr2=0x7f5a5c159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:26.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.652+0000 7f5a62400640 1 --2- 172.21.15.134:0/1047748643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a5c15b3d0 0x7f5a5c159740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.652+0000 7f5a62400640 1 -- 172.21.15.134:0/1047748643 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a54009a70 con 0x7f5a5c15ca40 2024-09-13T17:51:26.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.652+0000 7f5a61a00640 1 --2- 172.21.15.134:0/1047748643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5c15a8e0 0x7f5a5c15a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:51:26.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.656+0000 7f5a62400640 1 --2- 172.21.15.134:0/1047748643 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a5c15ca40 0x7f5a5c149430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5a540b0040 tx=0x7f5a54019650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:26.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.656+0000 7f5a59600640 1 -- 172.21.15.134:0/1047748643 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a540039a0 con 0x7f5a5c15ca40 2024-09-13T17:51:26.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.656+0000 7f5a59600640 1 -- 172.21.15.134:0/1047748643 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a54003b00 con 0x7f5a5c15ca40 2024-09-13T17:51:26.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.656+0000 7f5a59600640 1 -- 172.21.15.134:0/1047748643 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a54003e70 con 0x7f5a5c15ca40 2024-09-13T17:51:26.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.656+0000 7f5a64400640 1 -- 172.21.15.134:0/1047748643 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a5c0cc920 con 0x7f5a5c15ca40 2024-09-13T17:51:26.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.656+0000 7f5a64400640 1 -- 172.21.15.134:0/1047748643 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a5c14fbe0 con 0x7f5a5c15ca40 2024-09-13T17:51:26.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.656+0000 7f5a59600640 1 -- 172.21.15.134:0/1047748643 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f5a54004320 con 0x7f5a5c15ca40 2024-09-13T17:51:26.657 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.656+0000 7f5a59600640 1 -- 172.21.15.134:0/1047748643 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f5a540045d0 con 0x7f5a5c15ca40 2024-09-13T17:51:26.658 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.656+0000 7f5a64400640 1 -- 172.21.15.134:0/1047748643 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a5c15acc0 con 0x7f5a5c15ca40 2024-09-13T17:51:26.659 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.660+0000 7f5a59600640 1 -- 172.21.15.134:0/1047748643 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f5a540bd030 con 0x7f5a5c15ca40 2024-09-13T17:51:26.665 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-13T17:51:26.663+0000 7fb60c24b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T17:51:26.725 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.724+0000 7f5a64400640 1 -- 172.21.15.134:0/1047748643 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c9c2c366-0235-4d84-9bbc-a4c0c84fb156", "id": 4} v 0) v1 -- 0x7f5a5c0ccd90 con 0x7f5a5c15ca40 2024-09-13T17:51:26.729 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.728+0000 7f5a59600640 1 -- 172.21.15.134:0/1047748643 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c9c2c366-0235-4d84-9bbc-a4c0c84fb156", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5a540b2070 con 0x7f5a5c15ca40 2024-09-13T17:51:26.730 INFO:teuthology.orchestra.run.smithi134.stdout:4 2024-09-13T17:51:26.731 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.732+0000 7f5a64400640 1 -- 172.21.15.134:0/1047748643 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a5c15ca40 msgr2=0x7f5a5c149430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:26.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.732+0000 7f5a64400640 1 --2- 172.21.15.134:0/1047748643 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a5c15ca40 0x7f5a5c149430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5a540b0040 tx=0x7f5a54019650 comp rx=0 tx=0).stop 2024-09-13T17:51:26.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.732+0000 7f5a64400640 1 -- 172.21.15.134:0/1047748643 shutdown_connections 2024-09-13T17:51:26.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.732+0000 7f5a64400640 1 --2- 172.21.15.134:0/1047748643 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5a5c15ca40 0x7f5a5c149430 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.732+0000 7f5a64400640 1 --2- 172.21.15.134:0/1047748643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a5c15b3d0 0x7f5a5c159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.732+0000 7f5a64400640 1 --2- 172.21.15.134:0/1047748643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a5c15a8e0 0x7f5a5c15a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.732+0000 7f5a64400640 1 -- 172.21.15.134:0/1047748643 >> 172.21.15.134:0/1047748643 conn(0x7f5a5c071ba0 msgr2=0x7f5a5c0aead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:26.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.732+0000 7f5a64400640 1 -- 172.21.15.134:0/1047748643 shutdown_connections 2024-09-13T17:51:26.732 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.732+0000 7f5a64400640 1 -- 172.21.15.134:0/1047748643 wait complete. 2024-09-13T17:51:26.749 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-13T17:51:26.748+0000 7f139c64b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T17:51:26.754 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-13T17:51:26.751+0000 7fb60c24b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T17:51:26.757 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new b00a9566-768b-4761-9c1d-140e3a7491d8 5 2024-09-13T17:51:26.812 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-13T17:51:26.812+0000 7f139c64b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T17:51:26.813 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-13T17:51:26.811+0000 7fb60c24b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T17:51:26.901 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-13T17:51:26.899+0000 7fb60c24b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T17:51:26.902 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-13T17:51:26.900+0000 7f139c64b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T17:51:26.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.932+0000 7f28ce200640 1 Processor -- start 2024-09-13T17:51:26.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.932+0000 7f28ce200640 1 -- start start 2024-09-13T17:51:26.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.932+0000 7f28ce200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f28c815a650 0x7f28c8099480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:26.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.932+0000 7f28ce200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f28c80ce0b0 0x7f28c815e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:26.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.932+0000 7f28ce200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28c815e5f0 0x7f28c815aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:26.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.932+0000 7f28ce200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c815ea40 con 0x7f28c80ce0b0 2024-09-13T17:51:26.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.932+0000 7f28ce200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c80ce540 con 0x7f28c815a650 2024-09-13T17:51:26.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.932+0000 7f28ce200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c80ce820 con 0x7f28c815e5f0 2024-09-13T17:51:26.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.932+0000 7f28c7400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f28c815a650 0x7f28c8099480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:26.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.932+0000 7f28c7e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28c815e5f0 0x7f28c815aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:26.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.932+0000 7f28c7400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f28c815a650 0x7f28c8099480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37654/0 (socket says 172.21.15.134:37654) 2024-09-13T17:51:26.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.932+0000 7f28bea00640 1 --2- 172.21.15.134:0/2941234854 >> v2:172.21.15.114:3300/0 conn(0x7f28c80ce0b0 0x7f28c815e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:26.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.932+0000 7f28c7400640 1 -- 172.21.15.134:0/2941234854 learned_addr learned my addr 172.21.15.134:0/2941234854 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-13T17:51:26.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.936+0000 7f28c7e00640 1 -- 172.21.15.134:0/2941234854 >> v2:172.21.15.134:3300/0 conn(0x7f28c815a650 msgr2=0x7f28c8099480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:26.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.936+0000 7f28c7e00640 1 --2- 172.21.15.134:0/2941234854 >> v2:172.21.15.134:3300/0 conn(0x7f28c815a650 0x7f28c8099480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.936+0000 7f28c7e00640 1 -- 172.21.15.134:0/2941234854 >> v2:172.21.15.114:3300/0 conn(0x7f28c80ce0b0 msgr2=0x7f28c815e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:26.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.936+0000 7f28c7e00640 1 --2- 172.21.15.134:0/2941234854 >> v2:172.21.15.114:3300/0 conn(0x7f28c80ce0b0 0x7f28c815e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.936+0000 7f28c7e00640 1 -- 172.21.15.134:0/2941234854 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c80ceb00 con 0x7f28c815e5f0 2024-09-13T17:51:26.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.936+0000 7f28bea00640 1 --2- 172.21.15.134:0/2941234854 >> v2:172.21.15.114:3300/0 conn(0x7f28c80ce0b0 0x7f28c815e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:51:26.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.936+0000 7f28c7400640 1 --2- 172.21.15.134:0/2941234854 >> v2:172.21.15.134:3300/0 conn(0x7f28c815a650 0x7f28c8099480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:51:26.939 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.940+0000 7f28c7e00640 1 --2- 172.21.15.134:0/2941234854 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28c815e5f0 0x7f28c815aa30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f28c8071c10 tx=0x7f28c001c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a44a35b4f6f1db08 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:26.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.940+0000 7f28c6a00640 1 -- 172.21.15.134:0/2941234854 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c00a5980 con 0x7f28c815e5f0 2024-09-13T17:51:26.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.940+0000 7f28c6a00640 1 -- 172.21.15.134:0/2941234854 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c00a5ae0 con 0x7f28c815e5f0 2024-09-13T17:51:26.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.940+0000 7f28c6a00640 1 -- 172.21.15.134:0/2941234854 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c00a5e70 con 0x7f28c815e5f0 2024-09-13T17:51:26.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.940+0000 7f28ce200640 1 -- 172.21.15.134:0/2941234854 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28c815e5f0 msgr2=0x7f28c815aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:26.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.940+0000 7f28ce200640 1 --2- 172.21.15.134:0/2941234854 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28c815e5f0 0x7f28c815aa30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f28c8071c10 tx=0x7f28c001c900 comp rx=0 tx=0).stop 2024-09-13T17:51:26.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.940+0000 7f28ce200640 1 -- 172.21.15.134:0/2941234854 shutdown_connections 2024-09-13T17:51:26.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.940+0000 7f28ce200640 1 --2- 172.21.15.134:0/2941234854 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28c815e5f0 0x7f28c815aa30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.940+0000 7f28ce200640 1 --2- 172.21.15.134:0/2941234854 >> v2:172.21.15.114:3300/0 conn(0x7f28c80ce0b0 0x7f28c815e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.940+0000 7f28ce200640 1 --2- 172.21.15.134:0/2941234854 >> v2:172.21.15.134:3300/0 conn(0x7f28c815a650 0x7f28c8099480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.940+0000 7f28ce200640 1 -- 172.21.15.134:0/2941234854 >> 172.21.15.134:0/2941234854 conn(0x7f28c80d04e0 msgr2=0x7f28c80d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:26.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.940+0000 7f28ce200640 1 -- 172.21.15.134:0/2941234854 shutdown_connections 2024-09-13T17:51:26.941 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.940+0000 7f28ce200640 1 -- 172.21.15.134:0/2941234854 wait complete. 2024-09-13T17:51:26.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.944+0000 7f28ce200640 1 Processor -- start 2024-09-13T17:51:26.943 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.944+0000 7f28ce200640 1 -- start start 2024-09-13T17:51:26.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.944+0000 7f28ce200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28c815a650 0x7f28c8150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:26.945 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.944+0000 7f28ce200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28c815e5f0 0x7f28c8159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:26.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.944+0000 7f28ce200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28c8159c80 0x7f28c806b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:26.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.944+0000 7f28ce200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c80ad3e0 con 0x7f28c8159c80 2024-09-13T17:51:26.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.944+0000 7f28ce200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c80ad6c0 con 0x7f28c815a650 2024-09-13T17:51:26.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.944+0000 7f28ce200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c80ad9a0 con 0x7f28c815e5f0 2024-09-13T17:51:26.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.944+0000 7f28c7400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28c815a650 0x7f28c8150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:26.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.944+0000 7f28bea00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28c815e5f0 0x7f28c8159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:26.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.944+0000 7f28c7400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28c815a650 0x7f28c8150500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37664/0 (socket says 172.21.15.134:37664) 2024-09-13T17:51:26.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.944+0000 7f28c7400640 1 -- 172.21.15.134:0/517791707 learned_addr learned my addr 172.21.15.134:0/517791707 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-13T17:51:26.946 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.944+0000 7f28c7e00640 1 --2- 172.21.15.134:0/517791707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28c8159c80 0x7f28c806b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:26.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.944+0000 7f28c7400640 1 -- 172.21.15.134:0/517791707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28c815e5f0 msgr2=0x7f28c8159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:26.947 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.944+0000 7f28c7400640 1 --2- 172.21.15.134:0/517791707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28c815e5f0 0x7f28c8159740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.944+0000 7f28c7400640 1 -- 172.21.15.134:0/517791707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28c8159c80 msgr2=0x7f28c806b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:26.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.944+0000 7f28c7400640 1 --2- 172.21.15.134:0/517791707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28c8159c80 0x7f28c806b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:26.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.944+0000 7f28c7400640 1 -- 172.21.15.134:0/517791707 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b0009420 con 0x7f28c815a650 2024-09-13T17:51:26.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.944+0000 7f28bea00640 1 --2- 172.21.15.134:0/517791707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28c815e5f0 0x7f28c8159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:51:26.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.944+0000 7f28c7400640 1 --2- 172.21.15.134:0/517791707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28c815a650 0x7f28c8150500 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f28b800e9d0 tx=0x7f28b800ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:26.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.944+0000 7f28bfe00640 1 -- 172.21.15.134:0/517791707 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b800ca60 con 0x7f28c815a650 2024-09-13T17:51:26.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.944+0000 7f28bfe00640 1 -- 172.21.15.134:0/517791707 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b800cbc0 con 0x7f28c815a650 2024-09-13T17:51:26.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.944+0000 7f28bfe00640 1 -- 172.21.15.134:0/517791707 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b8013470 con 0x7f28c815a650 2024-09-13T17:51:26.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.944+0000 7f28ce200640 1 -- 172.21.15.134:0/517791707 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b80094d0 con 0x7f28c815a650 2024-09-13T17:51:26.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.944+0000 7f28ce200640 1 -- 172.21.15.134:0/517791707 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c0009a70 con 0x7f28c815a650 2024-09-13T17:51:26.948 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.948+0000 7f28bfe00640 1 -- 172.21.15.134:0/517791707 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f28b80138d0 con 0x7f28c815a650 2024-09-13T17:51:26.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.948+0000 7f28bfe00640 1 -- 172.21.15.134:0/517791707 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f28b801c450 con 0x7f28c815a650 2024-09-13T17:51:26.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.948+0000 7f28ce200640 1 -- 172.21.15.134:0/517791707 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c8099480 con 0x7f28c815a650 2024-09-13T17:51:26.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:26.948+0000 7f28bfe00640 1 -- 172.21.15.134:0/517791707 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f28b8021060 con 0x7f28c815a650 2024-09-13T17:51:26.963 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-13T17:51:26.959+0000 7fb60c24b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T17:51:26.971 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-13T17:51:26.972+0000 7f139c64b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T17:51:27.018 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.016+0000 7f28ce200640 1 -- 172.21.15.134:0/517791707 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b00a9566-768b-4761-9c1d-140e3a7491d8", "id": 5} v 0) v1 -- 0x7f28c80d1380 con 0x7f28c815a650 2024-09-13T17:51:27.022 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.020+0000 7f28bfe00640 1 -- 172.21.15.134:0/517791707 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b00a9566-768b-4761-9c1d-140e3a7491d8", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f28b802a020 con 0x7f28c815a650 2024-09-13T17:51:27.023 INFO:teuthology.orchestra.run.smithi134.stdout:5 2024-09-13T17:51:27.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.024+0000 7f28ce200640 1 -- 172.21.15.134:0/517791707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28c815a650 msgr2=0x7f28c8150500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:27.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.024+0000 7f28ce200640 1 --2- 172.21.15.134:0/517791707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28c815a650 0x7f28c8150500 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f28b800e9d0 tx=0x7f28b800ee90 comp rx=0 tx=0).stop 2024-09-13T17:51:27.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.024+0000 7f28ce200640 1 -- 172.21.15.134:0/517791707 shutdown_connections 2024-09-13T17:51:27.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.024+0000 7f28ce200640 1 --2- 172.21.15.134:0/517791707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28c8159c80 0x7f28c806b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.024+0000 7f28ce200640 1 --2- 172.21.15.134:0/517791707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f28c815e5f0 0x7f28c8159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.024+0000 7f28ce200640 1 --2- 172.21.15.134:0/517791707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28c815a650 0x7f28c8150500 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.024+0000 7f28ce200640 1 -- 172.21.15.134:0/517791707 >> 172.21.15.134:0/517791707 conn(0x7f28c80d04e0 msgr2=0x7f28c806feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:27.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.024+0000 7f28ce200640 1 -- 172.21.15.134:0/517791707 shutdown_connections 2024-09-13T17:51:27.024 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.024+0000 7f28ce200640 1 -- 172.21.15.134:0/517791707 wait complete. 2024-09-13T17:51:27.042 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 59df820f-8786-4389-b433-86c97e2fea8c 6 2024-09-13T17:51:27.130 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-13T17:51:27.127+0000 7fb60c24b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T17:51:27.144 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-13T17:51:27.144+0000 7f139c64b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T17:51:27.199 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-13T17:51:27.195+0000 7fb60c24b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T17:51:27.214 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-13T17:51:27.212+0000 7f139c64b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T17:51:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.220+0000 7fc603800640 1 Processor -- start 2024-09-13T17:51:27.222 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.220+0000 7fc603800640 1 -- start start 2024-09-13T17:51:27.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.224+0000 7fc603800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc5fc1602e0 0x7fc5fc1606c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:27.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.224+0000 7fc603800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc5fc0ce650 0x7fc5fc099480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:27.224 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.224+0000 7fc603800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5fc160c00 con 0x7fc5fc15cb30 2024-09-13T17:51:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.224+0000 7fc603800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5fc0cebe0 con 0x7fc5fc0ce650 2024-09-13T17:51:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.224+0000 7fc603800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc0ceec0 con 0x7fc5fc1602e0 2024-09-13T17:51:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.224+0000 7fc600e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc5fc1602e0 0x7fc5fc1606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.224+0000 7fc601800640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fc5fc15cb30 0x7fc5fc15cfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:60678/0 (socket says 172.21.15.134:60678) 2024-09-13T17:51:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.224+0000 7fc601800640 1 -- 172.21.15.134:0/3751653303 learned_addr learned my addr 172.21.15.134:0/3751653303 (peer_addr_for_me v1:172.21.15.134:0/0) 2024-09-13T17:51:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.224+0000 7fc600e00640 1 --2- 172.21.15.134:0/3751653303 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc5fc1602e0 0x7fc5fc1606c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:60422/0 (socket says 172.21.15.134:60422) 2024-09-13T17:51:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.224+0000 7fc5f3e00640 1 --2- 172.21.15.134:0/3751653303 >> v2:172.21.15.114:3300/0 conn(0x7fc5fc0ce650 0x7fc5fc099480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.224+0000 7fc600e00640 1 -- 172.21.15.134:0/3751653303 >> v2:172.21.15.114:3300/0 conn(0x7fc5fc0ce650 msgr2=0x7fc5fc099480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.224+0000 7fc600e00640 1 --2- 172.21.15.134:0/3751653303 >> v2:172.21.15.114:3300/0 conn(0x7fc5fc0ce650 0x7fc5fc099480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.225 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.224+0000 7fc600e00640 1 -- 172.21.15.134:0/3751653303 >> v1:172.21.15.134:6789/0 conn(0x7fc5fc15cb30 legacy=0x7fc5fc15cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:27.226 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.224+0000 7fc600e00640 1 -- 172.21.15.134:0/3751653303 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5fc0cf1a0 con 0x7fc5fc1602e0 2024-09-13T17:51:27.227 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.228+0000 7fc600e00640 1 --2- 172.21.15.134:0/3751653303 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc5fc1602e0 0x7fc5fc1606c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec0097c0 tx=0x7fc5ec01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7605eccea5e5e07f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:27.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.228+0000 7fc5fbe00640 1 -- 172.21.15.134:0/3751653303 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec0ab600 con 0x7fc5fc1602e0 2024-09-13T17:51:27.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.228+0000 7fc5fbe00640 1 -- 172.21.15.134:0/3751653303 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ec0a7050 con 0x7fc5fc1602e0 2024-09-13T17:51:27.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.228+0000 7fc5fbe00640 1 -- 172.21.15.134:0/3751653303 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec0ab980 con 0x7fc5fc1602e0 2024-09-13T17:51:27.228 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.228+0000 7fc603800640 1 -- 172.21.15.134:0/3751653303 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc5fc1602e0 msgr2=0x7fc5fc1606c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:27.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.228+0000 7fc603800640 1 --2- 172.21.15.134:0/3751653303 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc5fc1602e0 0x7fc5fc1606c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec0097c0 tx=0x7fc5ec01c3e0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.228+0000 7fc603800640 1 -- 172.21.15.134:0/3751653303 shutdown_connections 2024-09-13T17:51:27.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.228+0000 7fc603800640 1 --2- 172.21.15.134:0/3751653303 >> v2:172.21.15.114:3300/0 conn(0x7fc5fc0ce650 0x7fc5fc099480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.228+0000 7fc603800640 1 --2- 172.21.15.134:0/3751653303 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc5fc1602e0 0x7fc5fc1606c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.228+0000 7fc603800640 1 -- 172.21.15.134:0/3751653303 >> 172.21.15.134:0/3751653303 conn(0x7fc5fc0d04e0 msgr2=0x7fc5fc0d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:27.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.228+0000 7fc603800640 1 -- 172.21.15.134:0/3751653303 shutdown_connections 2024-09-13T17:51:27.229 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.228+0000 7fc603800640 1 -- 172.21.15.134:0/3751653303 wait complete. 2024-09-13T17:51:27.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.232+0000 7fc603800640 1 Processor -- start 2024-09-13T17:51:27.231 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.232+0000 7fc603800640 1 -- start start 2024-09-13T17:51:27.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.232+0000 7fc603800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5fc0ce650 0x7fc5fc0cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:27.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.232+0000 7fc603800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5fc15cb30 0x7fc5fc09d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:27.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.232+0000 7fc603800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc5fc1602e0 0x7fc5fc09d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:27.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.232+0000 7fc603800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc15e5b0 con 0x7fc5fc15cb30 2024-09-13T17:51:27.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.232+0000 7fc603800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc15be50 con 0x7fc5fc0ce650 2024-09-13T17:51:27.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.232+0000 7fc603800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc09c3d0 con 0x7fc5fc1602e0 2024-09-13T17:51:27.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.232+0000 7fc600e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5fc0ce650 0x7fc5fc0cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:27.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.232+0000 7fc601800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc5fc1602e0 0x7fc5fc09d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:27.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.232+0000 7fc600e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5fc0ce650 0x7fc5fc0cd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:37670/0 (socket says 172.21.15.134:37670) 2024-09-13T17:51:27.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.232+0000 7fc600e00640 1 -- 172.21.15.134:0/1621252080 learned_addr learned my addr 172.21.15.134:0/1621252080 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-13T17:51:27.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.232+0000 7fc5f3e00640 1 --2- 172.21.15.134:0/1621252080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5fc15cb30 0x7fc5fc09d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:27.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.232+0000 7fc600e00640 1 -- 172.21.15.134:0/1621252080 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc5fc1602e0 msgr2=0x7fc5fc09d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:27.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.232+0000 7fc600e00640 1 --2- 172.21.15.134:0/1621252080 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc5fc1602e0 0x7fc5fc09d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.232+0000 7fc600e00640 1 -- 172.21.15.134:0/1621252080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5fc15cb30 msgr2=0x7fc5fc09d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:27.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.232+0000 7fc600e00640 1 --2- 172.21.15.134:0/1621252080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5fc15cb30 0x7fc5fc09d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.232+0000 7fc600e00640 1 -- 172.21.15.134:0/1621252080 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ec009420 con 0x7fc5fc0ce650 2024-09-13T17:51:27.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.232+0000 7fc601800640 1 --2- 172.21.15.134:0/1621252080 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc5fc1602e0 0x7fc5fc09d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:51:27.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.232+0000 7fc600e00640 1 --2- 172.21.15.134:0/1621252080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5fc0ce650 0x7fc5fc0cd1c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec01aa90 tx=0x7fc5ec019180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:27.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.232+0000 7fc5f9600640 1 -- 172.21.15.134:0/1621252080 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec0b5670 con 0x7fc5fc0ce650 2024-09-13T17:51:27.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.232+0000 7fc5f9600640 1 -- 172.21.15.134:0/1621252080 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ec0abe90 con 0x7fc5fc0ce650 2024-09-13T17:51:27.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.232+0000 7fc5f9600640 1 -- 172.21.15.134:0/1621252080 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec0b5a30 con 0x7fc5fc0ce650 2024-09-13T17:51:27.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.232+0000 7fc603800640 1 -- 172.21.15.134:0/1621252080 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5fc09c6b0 con 0x7fc5fc0ce650 2024-09-13T17:51:27.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.232+0000 7fc603800640 1 -- 172.21.15.134:0/1621252080 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5fc09cc70 con 0x7fc5fc0ce650 2024-09-13T17:51:27.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.232+0000 7fc5f9600640 1 -- 172.21.15.134:0/1621252080 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fc5ec0b2040 con 0x7fc5fc0ce650 2024-09-13T17:51:27.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.232+0000 7fc5f9600640 1 -- 172.21.15.134:0/1621252080 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fc5ec0c1400 con 0x7fc5fc0ce650 2024-09-13T17:51:27.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.236+0000 7fc603800640 1 -- 172.21.15.134:0/1621252080 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5fc099480 con 0x7fc5fc0ce650 2024-09-13T17:51:27.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.236+0000 7fc5f9600640 1 -- 172.21.15.134:0/1621252080 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fc5ec0bc020 con 0x7fc5fc0ce650 2024-09-13T17:51:27.304 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.304+0000 7fc603800640 1 -- 172.21.15.134:0/1621252080 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "59df820f-8786-4389-b433-86c97e2fea8c", "id": 6} v 0) v1 -- 0x7fc5fc15f9c0 con 0x7fc5fc0ce650 2024-09-13T17:51:27.312 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.312+0000 7fc5f9600640 1 -- 172.21.15.134:0/1621252080 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "59df820f-8786-4389-b433-86c97e2fea8c", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc5ec0b0070 con 0x7fc5fc0ce650 2024-09-13T17:51:27.313 INFO:teuthology.orchestra.run.smithi134.stdout:6 2024-09-13T17:51:27.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.312+0000 7fc603800640 1 -- 172.21.15.134:0/1621252080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5fc0ce650 msgr2=0x7fc5fc0cd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:27.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.312+0000 7fc603800640 1 --2- 172.21.15.134:0/1621252080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5fc0ce650 0x7fc5fc0cd1c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec01aa90 tx=0x7fc5ec019180 comp rx=0 tx=0).stop 2024-09-13T17:51:27.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.312+0000 7fc603800640 1 -- 172.21.15.134:0/1621252080 shutdown_connections 2024-09-13T17:51:27.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.312+0000 7fc603800640 1 --2- 172.21.15.134:0/1621252080 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc5fc1602e0 0x7fc5fc09d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.312+0000 7fc603800640 1 --2- 172.21.15.134:0/1621252080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5fc15cb30 0x7fc5fc09d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.312+0000 7fc603800640 1 --2- 172.21.15.134:0/1621252080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5fc0ce650 0x7fc5fc0cd1c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.314 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.312+0000 7fc603800640 1 -- 172.21.15.134:0/1621252080 >> 172.21.15.134:0/1621252080 conn(0x7fc5fc0d04e0 msgr2=0x7fc5fc0b1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:27.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.312+0000 7fc603800640 1 -- 172.21.15.134:0/1621252080 shutdown_connections 2024-09-13T17:51:27.315 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.312+0000 7fc603800640 1 -- 172.21.15.134:0/1621252080 wait complete. 2024-09-13T17:51:27.332 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new e436364c-8a68-4325-96c9-47adeaffc343 7 2024-09-13T17:51:27.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.464+0000 7f69e7200640 1 Processor -- start 2024-09-13T17:51:27.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.464+0000 7f69e7200640 1 -- start start 2024-09-13T17:51:27.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.468+0000 7f69e7200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69e015a650 0x7f69e0099480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:27.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.468+0000 7f69e7200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f69e015e7c0 0x7f69e00cb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:27.468 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.468+0000 7f69e7200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e00ce540 con 0x7f69e00ce0b0 2024-09-13T17:51:27.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.468+0000 7f69e7200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e015ba40 con 0x7f69e015e7c0 2024-09-13T17:51:27.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.468+0000 7f69e7200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e00ce820 con 0x7f69e015a650 2024-09-13T17:51:27.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.468+0000 7f69dfe00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69e015a650 0x7f69e0099480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:27.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.468+0000 7f69dfe00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69e015a650 0x7f69e0099480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:60454/0 (socket says 172.21.15.134:60454) 2024-09-13T17:51:27.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.468+0000 7f69dfe00640 1 -- 172.21.15.134:0/415909927 learned_addr learned my addr 172.21.15.134:0/415909927 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-13T17:51:27.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.468+0000 7f69e5200640 1 --2- 172.21.15.134:0/415909927 >> v2:172.21.15.114:3300/0 conn(0x7f69e015e7c0 0x7f69e00cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:27.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.468+0000 7f69dfe00640 1 -- 172.21.15.134:0/415909927 >> v2:172.21.15.114:3300/0 conn(0x7f69e015e7c0 msgr2=0x7f69e00cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:27.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.468+0000 7f69dfe00640 1 --2- 172.21.15.134:0/415909927 >> v2:172.21.15.114:3300/0 conn(0x7f69e015e7c0 0x7f69e00cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.468+0000 7f69dfe00640 1 -- 172.21.15.134:0/415909927 >> v1:172.21.15.114:6789/0 conn(0x7f69e00ce0b0 legacy=0x7f69e015e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:27.469 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.468+0000 7f69dfe00640 1 -- 172.21.15.134:0/415909927 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e00ceb00 con 0x7f69e015a650 2024-09-13T17:51:27.471 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.472+0000 7f69dfe00640 1 --2- 172.21.15.134:0/415909927 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69e015a650 0x7f69e0099480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f69d0009870 tx=0x7f69d001c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6624c5025774753 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:27.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.472+0000 7f69dea00640 1 -- 172.21.15.134:0/415909927 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d00a95f0 con 0x7f69e015a650 2024-09-13T17:51:27.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.472+0000 7f69dea00640 1 -- 172.21.15.134:0/415909927 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d00a9750 con 0x7f69e015a650 2024-09-13T17:51:27.472 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.472+0000 7f69dea00640 1 -- 172.21.15.134:0/415909927 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d00a9ae0 con 0x7f69e015a650 2024-09-13T17:51:27.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.472+0000 7f69e7200640 1 -- 172.21.15.134:0/415909927 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69e015a650 msgr2=0x7f69e0099480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:27.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.472+0000 7f69e7200640 1 --2- 172.21.15.134:0/415909927 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69e015a650 0x7f69e0099480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f69d0009870 tx=0x7f69d001c530 comp rx=0 tx=0).stop 2024-09-13T17:51:27.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.472+0000 7f69e7200640 1 -- 172.21.15.134:0/415909927 shutdown_connections 2024-09-13T17:51:27.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.472+0000 7f69e7200640 1 --2- 172.21.15.134:0/415909927 >> v2:172.21.15.114:3300/0 conn(0x7f69e015e7c0 0x7f69e00cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.472+0000 7f69e7200640 1 --2- 172.21.15.134:0/415909927 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69e015a650 0x7f69e0099480 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.472+0000 7f69e7200640 1 -- 172.21.15.134:0/415909927 >> 172.21.15.134:0/415909927 conn(0x7f69e00d04e0 msgr2=0x7f69e00d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:27.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.472+0000 7f69e7200640 1 -- 172.21.15.134:0/415909927 shutdown_connections 2024-09-13T17:51:27.473 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.472+0000 7f69e7200640 1 -- 172.21.15.134:0/415909927 wait complete. 2024-09-13T17:51:27.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.472+0000 7f69e7200640 1 Processor -- start 2024-09-13T17:51:27.474 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.472+0000 7f69e7200640 1 -- start start 2024-09-13T17:51:27.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.476+0000 7f69e7200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69e015a650 0x7f69e0159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:27.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.476+0000 7f69e7200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69e015e7c0 0x7f69e00b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:27.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.476+0000 7f69e7200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69e00ca5b0 0x7f69e006f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:27.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.476+0000 7f69e7200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e00b3de0 con 0x7f69e015e7c0 2024-09-13T17:51:27.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.476+0000 7f69e7200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e00b40c0 con 0x7f69e00ca5b0 2024-09-13T17:51:27.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.476+0000 7f69e7200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e00b43a0 con 0x7f69e015a650 2024-09-13T17:51:27.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.476+0000 7f69dfe00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69e015a650 0x7f69e0159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:27.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.476+0000 7f69e5200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69e00ca5b0 0x7f69e006f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:27.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.476+0000 7f69dfe00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69e015a650 0x7f69e0159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.134:60460/0 (socket says 172.21.15.134:60460) 2024-09-13T17:51:27.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.476+0000 7f69dfe00640 1 -- 172.21.15.134:0/1849661632 learned_addr learned my addr 172.21.15.134:0/1849661632 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-13T17:51:27.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.476+0000 7f69df400640 1 --2- 172.21.15.134:0/1849661632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69e015e7c0 0x7f69e00b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:27.477 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.476+0000 7f69dfe00640 1 -- 172.21.15.134:0/1849661632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69e00ca5b0 msgr2=0x7f69e006f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:27.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.476+0000 7f69dfe00640 1 --2- 172.21.15.134:0/1849661632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69e00ca5b0 0x7f69e006f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.476+0000 7f69dfe00640 1 -- 172.21.15.134:0/1849661632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69e015e7c0 msgr2=0x7f69e00b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:27.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.476+0000 7f69dfe00640 1 --2- 172.21.15.134:0/1849661632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69e015e7c0 0x7f69e00b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.476+0000 7f69dfe00640 1 -- 172.21.15.134:0/1849661632 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d00094d0 con 0x7f69e015a650 2024-09-13T17:51:27.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.476+0000 7f69dfe00640 1 --2- 172.21.15.134:0/1849661632 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69e015a650 0x7f69e0159b90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f69d00ab040 tx=0x7f69d001ad70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:27.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.476+0000 7f69d7e00640 1 -- 172.21.15.134:0/1849661632 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d00b1800 con 0x7f69e015a650 2024-09-13T17:51:27.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.476+0000 7f69d7e00640 1 -- 172.21.15.134:0/1849661632 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d00b1980 con 0x7f69e015a650 2024-09-13T17:51:27.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.476+0000 7f69e7200640 1 -- 172.21.15.134:0/1849661632 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e00b4680 con 0x7f69e015a650 2024-09-13T17:51:27.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.476+0000 7f69d7e00640 1 -- 172.21.15.134:0/1849661632 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d00b1d30 con 0x7f69e015a650 2024-09-13T17:51:27.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.476+0000 7f69e7200640 1 -- 172.21.15.134:0/1849661632 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e00b53c0 con 0x7f69e015a650 2024-09-13T17:51:27.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.476+0000 7f69d7e00640 1 -- 172.21.15.134:0/1849661632 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f69d00bc450 con 0x7f69e015a650 2024-09-13T17:51:27.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.476+0000 7f69d7e00640 1 -- 172.21.15.134:0/1849661632 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f69d00a9570 con 0x7f69e015a650 2024-09-13T17:51:27.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.476+0000 7f69e7200640 1 -- 172.21.15.134:0/1849661632 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e00b4200 con 0x7f69e015a650 2024-09-13T17:51:27.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.480+0000 7f69d7e00640 1 -- 172.21.15.134:0/1849661632 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f69e00b4200 con 0x7f69e015a650 2024-09-13T17:51:27.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.588+0000 7f69e7200640 1 -- 172.21.15.134:0/1849661632 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e436364c-8a68-4325-96c9-47adeaffc343", "id": 7} v 0) v1 -- 0x7f69e00b44e0 con 0x7f69e015a650 2024-09-13T17:51:27.596 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.596+0000 7f69d7e00640 1 -- 172.21.15.134:0/1849661632 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e436364c-8a68-4325-96c9-47adeaffc343", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f69e00b44e0 con 0x7f69e015a650 2024-09-13T17:51:27.597 INFO:teuthology.orchestra.run.smithi134.stdout:7 2024-09-13T17:51:27.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.596+0000 7f69e7200640 1 -- 172.21.15.134:0/1849661632 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69e015a650 msgr2=0x7f69e0159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:27.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.596+0000 7f69e7200640 1 --2- 172.21.15.134:0/1849661632 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69e015a650 0x7f69e0159b90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f69d00ab040 tx=0x7f69d001ad70 comp rx=0 tx=0).stop 2024-09-13T17:51:27.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.596+0000 7f69e7200640 1 -- 172.21.15.134:0/1849661632 shutdown_connections 2024-09-13T17:51:27.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.596+0000 7f69e7200640 1 --2- 172.21.15.134:0/1849661632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69e00ca5b0 0x7f69e006f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.596+0000 7f69e7200640 1 --2- 172.21.15.134:0/1849661632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69e015e7c0 0x7f69e00b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.596+0000 7f69e7200640 1 --2- 172.21.15.134:0/1849661632 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69e015a650 0x7f69e0159b90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.596+0000 7f69e7200640 1 -- 172.21.15.134:0/1849661632 >> 172.21.15.134:0/1849661632 conn(0x7f69e00d04e0 msgr2=0x7f69e00aff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:27.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.596+0000 7f69e7200640 1 -- 172.21.15.134:0/1849661632 shutdown_connections 2024-09-13T17:51:27.598 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-13T17:51:27.596+0000 7f69e7200640 1 -- 172.21.15.134:0/1849661632 wait complete. 2024-09-13T17:51:27.615 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T17:51:27.615 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T17:51:27.619 INFO:tasks.ceph.osd.0:Started 2024-09-13T17:51:27.619 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T17:51:27.619 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T17:51:27.623 INFO:tasks.ceph.osd.1:Started 2024-09-13T17:51:27.623 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T17:51:27.623 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T17:51:27.627 INFO:tasks.ceph.osd.2:Started 2024-09-13T17:51:27.627 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T17:51:27.627 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T17:51:27.630 INFO:tasks.ceph.osd.3:Started 2024-09-13T17:51:27.630 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-13T17:51:27.631 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-13T17:51:27.634 INFO:tasks.ceph.osd.4:Started 2024-09-13T17:51:27.634 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-13T17:51:27.634 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-13T17:51:27.637 INFO:tasks.ceph.osd.5:Started 2024-09-13T17:51:27.637 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-13T17:51:27.637 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-13T17:51:27.640 INFO:tasks.ceph.osd.6:Started 2024-09-13T17:51:27.640 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-13T17:51:27.640 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-13T17:51:27.643 INFO:tasks.ceph.osd.7:Started 2024-09-13T17:51:27.644 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:51:27.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.819+0000 7feb2b800640 1 Processor -- start 2024-09-13T17:51:27.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.819+0000 7feb2b800640 1 -- start start 2024-09-13T17:51:27.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.819+0000 7feb2b800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7feb24159520 0x7feb240c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:27.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.819+0000 7feb2b800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feb240b1a40 0x7feb240cc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:27.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.819+0000 7feb2b800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb240ac5a0 con 0x7feb240cddb0 2024-09-13T17:51:27.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.819+0000 7feb2b800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb240ce270 con 0x7feb240b1a40 2024-09-13T17:51:27.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.819+0000 7feb2b800640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb240ac7f0 con 0x7feb24159520 2024-09-13T17:51:27.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.819+0000 7feb1be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feb240b1a40 0x7feb240cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:27.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.819+0000 7feb1be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feb240b1a40 0x7feb240cc000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53998/0 (socket says 172.21.15.114:53998) 2024-09-13T17:51:27.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.819+0000 7feb1be00640 1 -- 172.21.15.114:0/2700776519 learned_addr learned my addr 172.21.15.114:0/2700776519 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:27.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.819+0000 7feb29800640 1 --1- 172.21.15.114:0/2700776519 >> v1:172.21.15.114:6789/0 conn(0x7feb240cddb0 0x7feb240ad5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:36994/0 (socket says 172.21.15.114:36994) 2024-09-13T17:51:27.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.819+0000 7feb28e00640 1 --2- 172.21.15.114:0/2700776519 >> v2:172.21.15.134:3300/0 conn(0x7feb24159520 0x7feb240c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:27.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.819+0000 7feb23e00640 1 -- 172.21.15.114:0/2700776519 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534030768 0 0) 0x7feb240ac5a0 con 0x7feb240cddb0 2024-09-13T17:51:27.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.819+0000 7feb1be00640 1 -- 172.21.15.114:0/2700776519 >> v2:172.21.15.134:3300/0 conn(0x7feb24159520 msgr2=0x7feb240c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:27.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.819+0000 7feb1be00640 1 --2- 172.21.15.114:0/2700776519 >> v2:172.21.15.134:3300/0 conn(0x7feb24159520 0x7feb240c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.819+0000 7feb1be00640 1 -- 172.21.15.114:0/2700776519 >> v1:172.21.15.114:6789/0 conn(0x7feb240cddb0 legacy=0x7feb240ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:27.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.819+0000 7feb1be00640 1 -- 172.21.15.114:0/2700776519 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb240acad0 con 0x7feb240b1a40 2024-09-13T17:51:27.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.823+0000 7feb1be00640 1 --2- 172.21.15.114:0/2700776519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb240b1a40 0x7feb240cc000 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7feb240d06b0 tx=0x7feb0c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db35b075d6d86c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:27.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.823+0000 7feb23e00640 1 -- 172.21.15.114:0/2700776519 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c0aa650 con 0x7feb240b1a40 2024-09-13T17:51:27.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.823+0000 7feb23e00640 1 -- 172.21.15.114:0/2700776519 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0c0aa7b0 con 0x7feb240b1a40 2024-09-13T17:51:27.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.823+0000 7feb23e00640 1 -- 172.21.15.114:0/2700776519 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c0aab40 con 0x7feb240b1a40 2024-09-13T17:51:27.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.823+0000 7feb2b800640 1 -- 172.21.15.114:0/2700776519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb240b1a40 msgr2=0x7feb240cc000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:27.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.823+0000 7feb2b800640 1 --2- 172.21.15.114:0/2700776519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb240b1a40 0x7feb240cc000 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7feb240d06b0 tx=0x7feb0c01c4f0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.823+0000 7feb2b800640 1 -- 172.21.15.114:0/2700776519 shutdown_connections 2024-09-13T17:51:27.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.823+0000 7feb2b800640 1 --2- 172.21.15.114:0/2700776519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb240b1a40 0x7feb240cc000 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.823+0000 7feb2b800640 1 --2- 172.21.15.114:0/2700776519 >> v2:172.21.15.134:3300/0 conn(0x7feb24159520 0x7feb240c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.823+0000 7feb2b800640 1 -- 172.21.15.114:0/2700776519 >> 172.21.15.114:0/2700776519 conn(0x7feb24098a70 msgr2=0x7feb240b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:27.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.823+0000 7feb2b800640 1 -- 172.21.15.114:0/2700776519 shutdown_connections 2024-09-13T17:51:27.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.823+0000 7feb2b800640 1 -- 172.21.15.114:0/2700776519 wait complete. 2024-09-13T17:51:27.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.827+0000 7feb2b800640 1 Processor -- start 2024-09-13T17:51:27.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.827+0000 7feb2b800640 1 -- start start 2024-09-13T17:51:27.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.827+0000 7feb2b800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb240b1a40 0x7feb240b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:27.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.827+0000 7feb2b800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb240cddb0 0x7feb2414f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:27.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.827+0000 7feb2b800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb24159520 0x7feb2414e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:27.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.827+0000 7feb2b800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb240b5500 con 0x7feb24159520 2024-09-13T17:51:27.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.827+0000 7feb2b800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb240b2760 con 0x7feb240b1a40 2024-09-13T17:51:27.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.827+0000 7feb2b800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb240b5220 con 0x7feb240cddb0 2024-09-13T17:51:27.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.827+0000 7feb29800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb24159520 0x7feb2414e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:27.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.827+0000 7feb28e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb240b1a40 0x7feb240b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:27.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.827+0000 7feb29800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb24159520 0x7feb2414e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54014/0 (socket says 172.21.15.114:54014) 2024-09-13T17:51:27.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.827+0000 7feb29800640 1 -- 172.21.15.114:0/1082582445 learned_addr learned my addr 172.21.15.114:0/1082582445 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:27.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.827+0000 7feb1be00640 1 --2- 172.21.15.114:0/1082582445 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb240cddb0 0x7feb2414f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:27.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.827+0000 7feb28e00640 1 -- 172.21.15.114:0/1082582445 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb240cddb0 msgr2=0x7feb2414f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:27.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.827+0000 7feb28e00640 1 --2- 172.21.15.114:0/1082582445 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb240cddb0 0x7feb2414f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.827+0000 7feb28e00640 1 -- 172.21.15.114:0/1082582445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb24159520 msgr2=0x7feb2414e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:27.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.827+0000 7feb28e00640 1 --2- 172.21.15.114:0/1082582445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb24159520 0x7feb2414e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.827+0000 7feb28e00640 1 -- 172.21.15.114:0/1082582445 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0c0094d0 con 0x7feb240b1a40 2024-09-13T17:51:27.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.827+0000 7feb29800640 1 --2- 172.21.15.114:0/1082582445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb24159520 0x7feb2414e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:51:27.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.827+0000 7feb28e00640 1 --2- 172.21.15.114:0/1082582445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb240b1a40 0x7feb240b4c30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feb1400e8a0 tx=0x7feb1400ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:27.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.827+0000 7feb21600640 1 -- 172.21.15.114:0/1082582445 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb14009e80 con 0x7feb240b1a40 2024-09-13T17:51:27.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.827+0000 7feb21600640 1 -- 172.21.15.114:0/1082582445 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1400c940 con 0x7feb240b1a40 2024-09-13T17:51:27.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.827+0000 7feb21600640 1 -- 172.21.15.114:0/1082582445 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1400ccb0 con 0x7feb240b1a40 2024-09-13T17:51:27.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.827+0000 7feb2b800640 1 -- 172.21.15.114:0/1082582445 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb240b2a00 con 0x7feb240b1a40 2024-09-13T17:51:27.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.827+0000 7feb2b800640 1 -- 172.21.15.114:0/1082582445 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb2414ca60 con 0x7feb240b1a40 2024-09-13T17:51:27.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.827+0000 7feb21600640 1 -- 172.21.15.114:0/1082582445 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7feb14005ca0 con 0x7feb240b1a40 2024-09-13T17:51:27.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.827+0000 7feb21600640 1 -- 172.21.15.114:0/1082582445 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7feb1400ce10 con 0x7feb240b1a40 2024-09-13T17:51:27.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.831+0000 7feb2b800640 1 -- 172.21.15.114:0/1082582445 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb240b25c0 con 0x7feb240b1a40 2024-09-13T17:51:27.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.831+0000 7feb21600640 1 -- 172.21.15.114:0/1082582445 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7feb240b25c0 con 0x7feb240b1a40 2024-09-13T17:51:27.854 INFO:tasks.ceph.mgr.x.smithi134.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-13T17:51:27.854 INFO:tasks.ceph.mgr.x.smithi134.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-13T17:51:27.854 INFO:tasks.ceph.mgr.x.smithi134.stderr: from numpy import show_config as show_numpy_config 2024-09-13T17:51:27.859 INFO:tasks.ceph.mgr.y.smithi114.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-13T17:51:27.859 INFO:tasks.ceph.mgr.y.smithi114.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-13T17:51:27.859 INFO:tasks.ceph.mgr.y.smithi114.stderr: from numpy import show_config as show_numpy_config 2024-09-13T17:51:27.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.887+0000 7feb2b800640 1 -- 172.21.15.114:0/1082582445 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb240cbc80 con 0x7feb240b1a40 2024-09-13T17:51:27.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.887+0000 7feb21600640 1 -- 172.21.15.114:0/1082582445 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7feb14029020 con 0x7feb240b1a40 2024-09-13T17:51:27.891 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:51:27.891 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":10,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:51:27.591755+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:51:27.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.891+0000 7feb2b800640 1 -- 172.21.15.114:0/1082582445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb240b1a40 msgr2=0x7feb240b4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:27.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.891+0000 7feb2b800640 1 --2- 172.21.15.114:0/1082582445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb240b1a40 0x7feb240b4c30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feb1400e8a0 tx=0x7feb1400ed60 comp rx=0 tx=0).stop 2024-09-13T17:51:27.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.891+0000 7feb2b800640 1 -- 172.21.15.114:0/1082582445 shutdown_connections 2024-09-13T17:51:27.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.891+0000 7feb2b800640 1 --2- 172.21.15.114:0/1082582445 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb24159520 0x7feb2414e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.891+0000 7feb2b800640 1 --2- 172.21.15.114:0/1082582445 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb240cddb0 0x7feb2414f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.891+0000 7feb2b800640 1 --2- 172.21.15.114:0/1082582445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb240b1a40 0x7feb240b4c30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:27.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.891+0000 7feb2b800640 1 -- 172.21.15.114:0/1082582445 >> 172.21.15.114:0/1082582445 conn(0x7feb24098a70 msgr2=0x7feb240cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:27.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.891+0000 7feb2b800640 1 -- 172.21.15.114:0/1082582445 shutdown_connections 2024-09-13T17:51:27.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:27.891+0000 7feb2b800640 1 -- 172.21.15.114:0/1082582445 wait complete. 2024-09-13T17:51:27.902 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-13T17:51:27.899+0000 7fb60c24b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T17:51:27.909 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-13T17:51:27.908+0000 7f139c64b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T17:51:27.912 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T17:51:27.912 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T17:51:28.053 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-13T17:51:28.051+0000 7fb60c24b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:51:28.056 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-13T17:51:28.056+0000 7f139c64b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:51:28.226 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-13T17:51:28.223+0000 7fb60c24b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T17:51:28.240 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-13T17:51:28.240+0000 7f139c64b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T17:51:28.272 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-13T17:51:28.272+0000 7fef6682c7c0 -1 Falling back to public interface 2024-09-13T17:51:28.272 INFO:tasks.ceph.osd.2.smithi114.stderr:2024-09-13T17:51:28.271+0000 7f15673967c0 -1 Falling back to public interface 2024-09-13T17:51:28.277 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-13T17:51:28.275+0000 7f869f9967c0 -1 Falling back to public interface 2024-09-13T17:51:28.288 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-13T17:51:28.288+0000 7f3271e5b7c0 -1 Falling back to public interface 2024-09-13T17:51:28.288 INFO:tasks.ceph.osd.1.smithi114.stderr:2024-09-13T17:51:28.287+0000 7fa58b7ef7c0 -1 Falling back to public interface 2024-09-13T17:51:28.303 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-13T17:51:28.299+0000 7fb60c24b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T17:51:28.312 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-13T17:51:28.312+0000 7f9a89cde7c0 -1 Falling back to public interface 2024-09-13T17:51:28.315 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-13T17:51:28.312+0000 7f139c64b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T17:51:28.320 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-13T17:51:28.320+0000 7f48bd3677c0 -1 Falling back to public interface 2024-09-13T17:51:28.332 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-09-13T17:51:28.331+0000 7f782e76c7c0 -1 Falling back to public interface 2024-09-13T17:51:28.452 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-13T17:51:28.451+0000 7fb60c24b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:51:28.465 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-13T17:51:28.464+0000 7f139c64b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:51:28.718 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T17:51:28.843 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.839+0000 7f3fd0e00640 1 Processor -- start 2024-09-13T17:51:28.844 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.839+0000 7f3fd0e00640 1 -- start start 2024-09-13T17:51:28.845 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.843+0000 7f3fd0e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3fcc0cefc0 0x7f3fcc0994c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:28.845 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.843+0000 7f3fd0e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fcc098a70 con 0x7f3fcc06e520 2024-09-13T17:51:28.845 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.843+0000 7f3fd0e00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fcc099030 con 0x7f3fcc15a5e0 2024-09-13T17:51:28.845 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.843+0000 7f3fd0e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc0ce750 con 0x7f3fcc0cefc0 2024-09-13T17:51:28.845 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.843+0000 7f3fc9400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3fcc06e520 0x7f3fcc0ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:37008/0 (socket says 172.21.15.114:37008) 2024-09-13T17:51:28.845 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.843+0000 7f3fc9400640 1 -- 172.21.15.114:0/3552683263 learned_addr learned my addr 172.21.15.114:0/3552683263 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:51:28.845 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.843+0000 7f3fca800640 1 --2- 172.21.15.114:0/3552683263 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3fcc0cefc0 0x7f3fcc0994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:28.846 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.843+0000 7f3fc8a00640 1 -- 172.21.15.114:0/3552683263 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 322356704 0 0) 0x7f3fcc098a70 con 0x7f3fcc06e520 2024-09-13T17:51:28.846 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.843+0000 7f3fc8a00640 1 -- 172.21.15.114:0/3552683263 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fb0003530 con 0x7f3fcc06e520 2024-09-13T17:51:28.846 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.843+0000 7f3fc8a00640 1 -- 172.21.15.114:0/3552683263 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2366165194 0 0) 0x7f3fcc099030 con 0x7f3fcc15a5e0 2024-09-13T17:51:28.846 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.843+0000 7f3fc8a00640 1 -- 172.21.15.114:0/3552683263 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fcc098a70 con 0x7f3fcc15a5e0 2024-09-13T17:51:28.846 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.843+0000 7f3fca800640 1 -- 172.21.15.114:0/3552683263 >> v1:172.21.15.134:6789/0 conn(0x7f3fcc15a5e0 legacy=0x7f3fcc0ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:28.846 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.843+0000 7f3fc8a00640 1 -- 172.21.15.114:0/3552683263 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1963514908 0 0) 0x7f3fb0003530 con 0x7f3fcc06e520 2024-09-13T17:51:28.846 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.843+0000 7f3fca800640 1 -- 172.21.15.114:0/3552683263 >> v1:172.21.15.114:6789/0 conn(0x7f3fcc06e520 legacy=0x7f3fcc0ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:28.846 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.843+0000 7f3fca800640 1 -- 172.21.15.114:0/3552683263 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fcc15a9c0 con 0x7f3fcc0cefc0 2024-09-13T17:51:28.848 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.847+0000 7f3fca800640 1 --2- 172.21.15.114:0/3552683263 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3fcc0cefc0 0x7f3fcc0994c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4009dc0 tx=0x7f3fc401c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6c9f76b100104cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:28.849 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.847+0000 7f3fc8a00640 1 -- 172.21.15.114:0/3552683263 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc40a58d0 con 0x7f3fcc0cefc0 2024-09-13T17:51:28.849 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.847+0000 7f3fc8a00640 1 -- 172.21.15.114:0/3552683263 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc40a5a30 con 0x7f3fcc0cefc0 2024-09-13T17:51:28.849 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.847+0000 7f3fc8a00640 1 -- 172.21.15.114:0/3552683263 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc40a5dc0 con 0x7f3fcc0cefc0 2024-09-13T17:51:28.850 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.847+0000 7f3fd0e00640 1 -- 172.21.15.114:0/3552683263 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3fcc0cefc0 msgr2=0x7f3fcc0994c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:28.850 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.847+0000 7f3fd0e00640 1 --2- 172.21.15.114:0/3552683263 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3fcc0cefc0 0x7f3fcc0994c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4009dc0 tx=0x7f3fc401c900 comp rx=0 tx=0).stop 2024-09-13T17:51:28.850 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.847+0000 7f3fd0e00640 1 -- 172.21.15.114:0/3552683263 shutdown_connections 2024-09-13T17:51:28.850 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.847+0000 7f3fd0e00640 1 --2- 172.21.15.114:0/3552683263 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3fcc0cefc0 0x7f3fcc0994c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:28.850 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.847+0000 7f3fd0e00640 1 -- 172.21.15.114:0/3552683263 >> 172.21.15.114:0/3552683263 conn(0x7f3fcc0b1f60 msgr2=0x7f3fcc0b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:28.850 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.847+0000 7f3fd0e00640 1 -- 172.21.15.114:0/3552683263 shutdown_connections 2024-09-13T17:51:28.850 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.847+0000 7f3fd0e00640 1 -- 172.21.15.114:0/3552683263 wait complete. 2024-09-13T17:51:28.851 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.851+0000 7f3fd0e00640 1 Processor -- start 2024-09-13T17:51:28.851 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.851+0000 7f3fd0e00640 1 -- start start 2024-09-13T17:51:28.853 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.851+0000 7f3fd0e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3fcc06e520 0x7f3fcc150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:28.853 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.851+0000 7f3fd0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3fcc0cefc0 0x7f3fcc06bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:28.853 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.851+0000 7f3fd0e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fcc15a5e0 0x7f3fcc06c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:28.853 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.851+0000 7f3fd0e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc156c10 con 0x7f3fcc0cefc0 2024-09-13T17:51:28.853 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.851+0000 7f3fd0e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc06b090 con 0x7f3fcc15a5e0 2024-09-13T17:51:28.853 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.851+0000 7f3fd0e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc06c020 con 0x7f3fcc06e520 2024-09-13T17:51:28.854 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.851+0000 7f3fc9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3fcc0cefc0 0x7f3fcc06bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:28.854 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.851+0000 7f3fc9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3fcc0cefc0 0x7f3fcc06bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54028/0 (socket says 172.21.15.114:54028) 2024-09-13T17:51:28.854 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.851+0000 7f3fc9400640 1 -- 172.21.15.114:0/562505716 learned_addr learned my addr 172.21.15.114:0/562505716 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:28.854 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.851+0000 7f3fc9e00640 1 --2- 172.21.15.114:0/562505716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3fcc06e520 0x7f3fcc150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:28.854 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.851+0000 7f3fca800640 1 --2- 172.21.15.114:0/562505716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fcc15a5e0 0x7f3fcc06c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:28.854 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.851+0000 7f3fc9400640 1 -- 172.21.15.114:0/562505716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3fcc06e520 msgr2=0x7f3fcc150ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:28.854 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.851+0000 7f3fc9400640 1 --2- 172.21.15.114:0/562505716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3fcc06e520 0x7f3fcc150ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:28.854 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.851+0000 7f3fc9400640 1 -- 172.21.15.114:0/562505716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fcc15a5e0 msgr2=0x7f3fcc06c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:28.854 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.851+0000 7f3fc9400640 1 --2- 172.21.15.114:0/562505716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fcc15a5e0 0x7f3fcc06c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:28.854 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.851+0000 7f3fc9400640 1 -- 172.21.15.114:0/562505716 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc4009a70 con 0x7f3fcc0cefc0 2024-09-13T17:51:28.855 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.851+0000 7f3fc9400640 1 --2- 172.21.15.114:0/562505716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3fcc0cefc0 0x7f3fcc06bae0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800c450 tx=0x7f3fb800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:28.855 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.851+0000 7f3fc2000640 1 -- 172.21.15.114:0/562505716 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8005cf0 con 0x7f3fcc0cefc0 2024-09-13T17:51:28.855 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.851+0000 7f3fc2000640 1 -- 172.21.15.114:0/562505716 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb8005e50 con 0x7f3fcc0cefc0 2024-09-13T17:51:28.855 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.851+0000 7f3fc2000640 1 -- 172.21.15.114:0/562505716 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8007290 con 0x7f3fcc0cefc0 2024-09-13T17:51:28.856 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.851+0000 7f3fd0e00640 1 -- 172.21.15.114:0/562505716 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fcc154e00 con 0x7f3fcc0cefc0 2024-09-13T17:51:28.856 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.851+0000 7f3fd0e00640 1 -- 172.21.15.114:0/562505716 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fcc06b2e0 con 0x7f3fcc0cefc0 2024-09-13T17:51:28.856 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.851+0000 7f3fc2000640 1 -- 172.21.15.114:0/562505716 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f3fb8012400 con 0x7f3fcc0cefc0 2024-09-13T17:51:28.856 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.851+0000 7f3fc2000640 1 -- 172.21.15.114:0/562505716 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f3fb8012d80 con 0x7f3fcc0cefc0 2024-09-13T17:51:28.856 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.851+0000 7f3fd0e00640 1 -- 172.21.15.114:0/562505716 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fcc0994c0 con 0x7f3fcc0cefc0 2024-09-13T17:51:28.859 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.859+0000 7f3fc2000640 1 -- 172.21.15.114:0/562505716 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f3fb8017070 con 0x7f3fcc0cefc0 2024-09-13T17:51:28.916 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.915+0000 7f3fd0e00640 1 -- 172.21.15.114:0/562505716 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fcc0cc650 con 0x7f3fcc0cefc0 2024-09-13T17:51:28.916 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.915+0000 7f3fc2000640 1 -- 172.21.15.114:0/562505716 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3fb8012710 con 0x7f3fcc0cefc0 2024-09-13T17:51:28.917 INFO:teuthology.misc.health.smithi114.stdout: 2024-09-13T17:51:28.917 INFO:teuthology.misc.health.smithi114.stdout:{"epoch":10,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:51:27.591755+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:51:28.918 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.915+0000 7f3fd0e00640 1 -- 172.21.15.114:0/562505716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3fcc0cefc0 msgr2=0x7f3fcc06bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:28.918 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.915+0000 7f3fd0e00640 1 --2- 172.21.15.114:0/562505716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3fcc0cefc0 0x7f3fcc06bae0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800c450 tx=0x7f3fb800c910 comp rx=0 tx=0).stop 2024-09-13T17:51:28.918 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.915+0000 7f3fd0e00640 1 -- 172.21.15.114:0/562505716 shutdown_connections 2024-09-13T17:51:28.918 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.915+0000 7f3fd0e00640 1 --2- 172.21.15.114:0/562505716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fcc15a5e0 0x7f3fcc06c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:28.918 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.915+0000 7f3fd0e00640 1 --2- 172.21.15.114:0/562505716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3fcc0cefc0 0x7f3fcc06bae0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:28.918 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.915+0000 7f3fd0e00640 1 --2- 172.21.15.114:0/562505716 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3fcc06e520 0x7f3fcc150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:28.918 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.915+0000 7f3fd0e00640 1 -- 172.21.15.114:0/562505716 >> 172.21.15.114:0/562505716 conn(0x7f3fcc0b1f60 msgr2=0x7f3fcc0ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:28.918 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.915+0000 7f3fd0e00640 1 -- 172.21.15.114:0/562505716 shutdown_connections 2024-09-13T17:51:28.918 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:28.915+0000 7f3fd0e00640 1 -- 172.21.15.114:0/562505716 wait complete. 2024-09-13T17:51:28.933 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T17:51:29.149 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-13T17:51:29.147+0000 7fb60c24b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T17:51:29.162 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-13T17:51:29.160+0000 7f139c64b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T17:51:29.236 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-13T17:51:29.235+0000 7fb60c24b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T17:51:29.249 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-13T17:51:29.248+0000 7f139c64b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T17:51:29.435 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-13T17:51:29.431+0000 7fb60c24b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T17:51:29.448 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-13T17:51:29.448+0000 7f139c64b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T17:51:29.519 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-13T17:51:29.515+0000 7fb60c24b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T17:51:29.532 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-13T17:51:29.532+0000 7f139c64b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T17:51:29.845 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-13T17:51:29.843+0000 7fb60c24b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T17:51:29.858 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-13T17:51:29.856+0000 7f139c64b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T17:51:29.915 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-13T17:51:29.911+0000 7fb60c24b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T17:51:29.931 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-13T17:51:29.928+0000 7f139c64b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T17:51:30.936 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-13T17:51:30.935+0000 7fb5b1800640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-13T17:51:30.937 INFO:tasks.ceph.mgr.y.smithi114.stderr:2024-09-13T17:51:30.935+0000 7fb5b1800640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-13T17:51:31.986 INFO:tasks.ceph.osd.1.smithi114.stderr:2024-09-13T17:51:31.983+0000 7fa58b7ef7c0 -1 osd.1 0 log_to_monitors true 2024-09-13T17:51:32.137 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-13T17:51:32.135+0000 7fef6682c7c0 -1 osd.5 0 log_to_monitors true 2024-09-13T17:51:32.236 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-13T17:51:32.235+0000 7f869f9967c0 -1 osd.0 0 log_to_monitors true 2024-09-13T17:51:32.270 INFO:tasks.ceph.osd.2.smithi114.stderr:2024-09-13T17:51:32.267+0000 7f15673967c0 -1 osd.2 0 log_to_monitors true 2024-09-13T17:51:32.299 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-13T17:51:32.295+0000 7f9a89cde7c0 -1 osd.7 0 log_to_monitors true 2024-09-13T17:51:32.320 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-13T17:51:32.319+0000 7f48bd3677c0 -1 osd.6 0 log_to_monitors true 2024-09-13T17:51:32.321 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-13T17:51:32.319+0000 7f3271e5b7c0 -1 osd.4 0 log_to_monitors true 2024-09-13T17:51:32.338 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-09-13T17:51:32.335+0000 7f782e76c7c0 -1 osd.3 0 log_to_monitors true 2024-09-13T17:51:35.741 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T17:51:35.941 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.939+0000 7febc3200640 1 Processor -- start 2024-09-13T17:51:35.942 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.939+0000 7febc3200640 1 -- start start 2024-09-13T17:51:35.943 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.939+0000 7febc3200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febc4145e80 0x7febc406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:35.943 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.939+0000 7febc3200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7febc40b21a0 0x7febc4069f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:35.944 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.939+0000 7febc3200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc40b4510 con 0x7febc406a4c0 2024-09-13T17:51:35.944 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.939+0000 7febc3200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc406a950 con 0x7febc40b21a0 2024-09-13T17:51:35.944 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.939+0000 7febc3200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc4146260 con 0x7febc4145e80 2024-09-13T17:51:35.944 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.943+0000 7febbbe00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7febc40b21a0 0x7febc4069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:35.944 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.943+0000 7febbbe00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7febc40b21a0 0x7febc4069f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:55118/0 (socket says 172.21.15.114:55118) 2024-09-13T17:51:35.945 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.943+0000 7febbbe00640 1 -- 172.21.15.114:0/2230567160 learned_addr learned my addr 172.21.15.114:0/2230567160 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:35.945 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.943+0000 7febc1e00640 1 --2- 172.21.15.114:0/2230567160 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febc4145e80 0x7febc406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:35.945 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.943+0000 7febbbe00640 1 -- 172.21.15.114:0/2230567160 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febc4145e80 msgr2=0x7febc406dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:35.945 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.943+0000 7febbbe00640 1 --2- 172.21.15.114:0/2230567160 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febc4145e80 0x7febc406dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:35.945 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.943+0000 7febbbe00640 1 -- 172.21.15.114:0/2230567160 >> v1:172.21.15.134:6789/0 conn(0x7febc406a4c0 legacy=0x7febc4160060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:35.945 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.943+0000 7febbbe00640 1 -- 172.21.15.114:0/2230567160 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc40ad190 con 0x7febc40b21a0 2024-09-13T17:51:35.951 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.947+0000 7febbbe00640 1 --2- 172.21.15.114:0/2230567160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febc40b21a0 0x7febc4069f80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7febac009870 tx=0x7febac01c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bae761ab6ddfcafb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:35.951 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.947+0000 7febc1400640 1 -- 172.21.15.114:0/2230567160 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac0ab600 con 0x7febc40b21a0 2024-09-13T17:51:35.951 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.947+0000 7febc1400640 1 -- 172.21.15.114:0/2230567160 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febac0a7050 con 0x7febc40b21a0 2024-09-13T17:51:35.951 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.947+0000 7febc1400640 1 -- 172.21.15.114:0/2230567160 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac0ab980 con 0x7febc40b21a0 2024-09-13T17:51:35.952 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.951+0000 7febc3200640 1 -- 172.21.15.114:0/2230567160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febc40b21a0 msgr2=0x7febc4069f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:35.952 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.951+0000 7febc3200640 1 --2- 172.21.15.114:0/2230567160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febc40b21a0 0x7febc4069f80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7febac009870 tx=0x7febac01c3d0 comp rx=0 tx=0).stop 2024-09-13T17:51:35.952 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.951+0000 7febc3200640 1 -- 172.21.15.114:0/2230567160 shutdown_connections 2024-09-13T17:51:35.953 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.951+0000 7febc3200640 1 --2- 172.21.15.114:0/2230567160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febc40b21a0 0x7febc4069f80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:35.953 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.951+0000 7febc3200640 1 --2- 172.21.15.114:0/2230567160 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febc4145e80 0x7febc406dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:35.953 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.951+0000 7febc3200640 1 -- 172.21.15.114:0/2230567160 >> 172.21.15.114:0/2230567160 conn(0x7febc4098a70 msgr2=0x7febc40b46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:35.953 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.951+0000 7febc3200640 1 -- 172.21.15.114:0/2230567160 shutdown_connections 2024-09-13T17:51:35.956 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.951+0000 7febc3200640 1 -- 172.21.15.114:0/2230567160 wait complete. 2024-09-13T17:51:35.958 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.955+0000 7febc3200640 1 Processor -- start 2024-09-13T17:51:35.958 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.955+0000 7febc3200640 1 -- start start 2024-09-13T17:51:35.960 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.955+0000 7febc3200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc406a4c0 0x7febc413b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:35.960 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.955+0000 7febc3200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febc40b21a0 0x7febc413c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:35.960 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.955+0000 7febc3200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febc4145e80 0x7febc40b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:35.960 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.955+0000 7febc3200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc413dbd0 con 0x7febc406a4c0 2024-09-13T17:51:35.960 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.955+0000 7febc3200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc413b5a0 con 0x7febc4145e80 2024-09-13T17:51:35.960 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.955+0000 7febc3200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc415cb30 con 0x7febc40b21a0 2024-09-13T17:51:35.961 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.959+0000 7febbbe00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febc40b21a0 0x7febc413c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:35.961 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.959+0000 7febbbe00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febc40b21a0 0x7febc413c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:41304/0 (socket says 172.21.15.114:41304) 2024-09-13T17:51:35.961 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.959+0000 7febbbe00640 1 -- 172.21.15.114:0/114690694 learned_addr learned my addr 172.21.15.114:0/114690694 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:35.961 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.959+0000 7febc2800640 1 --2- 172.21.15.114:0/114690694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febc4145e80 0x7febc40b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:35.962 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.959+0000 7febc1e00640 1 --2- 172.21.15.114:0/114690694 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc406a4c0 0x7febc413b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:35.962 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.959+0000 7febbbe00640 1 -- 172.21.15.114:0/114690694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febc4145e80 msgr2=0x7febc40b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:35.962 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.959+0000 7febbbe00640 1 --2- 172.21.15.114:0/114690694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febc4145e80 0x7febc40b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:35.962 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.959+0000 7febbbe00640 1 -- 172.21.15.114:0/114690694 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc406a4c0 msgr2=0x7febc413b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:35.962 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.959+0000 7febbbe00640 1 --2- 172.21.15.114:0/114690694 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc406a4c0 0x7febc413b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:35.962 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.959+0000 7febbbe00640 1 -- 172.21.15.114:0/114690694 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac0094d0 con 0x7febc40b21a0 2024-09-13T17:51:35.962 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.959+0000 7febc1e00640 1 --2- 172.21.15.114:0/114690694 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc406a4c0 0x7febc413b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:51:35.962 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.959+0000 7febbbe00640 1 --2- 172.21.15.114:0/114690694 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febc40b21a0 0x7febc413c980 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7febac0ae040 tx=0x7febac019170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:35.963 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.959+0000 7febba000640 1 -- 172.21.15.114:0/114690694 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac0b4420 con 0x7febc40b21a0 2024-09-13T17:51:35.963 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.959+0000 7febba000640 1 -- 172.21.15.114:0/114690694 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febac0b4580 con 0x7febc40b21a0 2024-09-13T17:51:35.963 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.959+0000 7febba000640 1 -- 172.21.15.114:0/114690694 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac0b4930 con 0x7febc40b21a0 2024-09-13T17:51:35.964 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.963+0000 7febc3200640 1 -- 172.21.15.114:0/114690694 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc415ce10 con 0x7febc40b21a0 2024-09-13T17:51:35.964 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.963+0000 7febc3200640 1 -- 172.21.15.114:0/114690694 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc415d3d0 con 0x7febc40b21a0 2024-09-13T17:51:35.965 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.963+0000 7febc3200640 1 -- 172.21.15.114:0/114690694 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc4069f80 con 0x7febc40b21a0 2024-09-13T17:51:35.967 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.963+0000 7febba000640 1 -- 172.21.15.114:0/114690694 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7febac0b2070 con 0x7febc40b21a0 2024-09-13T17:51:35.968 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.967+0000 7febba000640 1 --2- 172.21.15.114:0/114690694 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7feba0066600 0x7feba0068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:35.968 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.967+0000 7febba000640 1 -- 172.21.15.114:0/114690694 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7febac11d8d0 con 0x7febc40b21a0 2024-09-13T17:51:35.969 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.967+0000 7febc1e00640 1 --2- 172.21.15.114:0/114690694 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7feba0066600 0x7feba0068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:35.972 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.967+0000 7febc1e00640 1 --2- 172.21.15.114:0/114690694 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7feba0066600 0x7feba0068ac0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7febb4009b10 tx=0x7febb4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:35.977 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:35.971+0000 7febba000640 1 -- 172.21.15.114:0/114690694 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7febac0eba90 con 0x7febc40b21a0 2024-09-13T17:51:36.294 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:36.291+0000 7febc3200640 1 -- 172.21.15.114:0/114690694 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febc406ae70 con 0x7febc40b21a0 2024-09-13T17:51:36.298 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:36.291+0000 7febba000640 1 -- 172.21.15.114:0/114690694 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7febac0b0090 con 0x7febc40b21a0 2024-09-13T17:51:36.298 INFO:teuthology.misc.health.smithi114.stdout: 2024-09-13T17:51:36.298 INFO:teuthology.misc.health.smithi114.stdout:{"epoch":12,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:51:33.970336+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:51:36.302 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:36.299+0000 7febc3200640 1 -- 172.21.15.114:0/114690694 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7feba0066600 msgr2=0x7feba0068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:36.303 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:36.299+0000 7febc3200640 1 --2- 172.21.15.114:0/114690694 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7feba0066600 0x7feba0068ac0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7febb4009b10 tx=0x7febb4008040 comp rx=0 tx=0).stop 2024-09-13T17:51:36.303 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:36.299+0000 7febc3200640 1 -- 172.21.15.114:0/114690694 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febc40b21a0 msgr2=0x7febc413c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:36.303 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:36.299+0000 7febc3200640 1 --2- 172.21.15.114:0/114690694 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febc40b21a0 0x7febc413c980 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7febac0ae040 tx=0x7febac019170 comp rx=0 tx=0).stop 2024-09-13T17:51:36.303 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:36.299+0000 7febc3200640 1 -- 172.21.15.114:0/114690694 shutdown_connections 2024-09-13T17:51:36.303 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:36.299+0000 7febc3200640 1 --2- 172.21.15.114:0/114690694 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7feba0066600 0x7feba0068ac0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:36.303 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:36.299+0000 7febc3200640 1 --2- 172.21.15.114:0/114690694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7febc4145e80 0x7febc40b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:36.303 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:36.299+0000 7febc3200640 1 --2- 172.21.15.114:0/114690694 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7febc40b21a0 0x7febc413c980 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:36.303 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:36.299+0000 7febc3200640 1 --2- 172.21.15.114:0/114690694 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc406a4c0 0x7febc413b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:36.303 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:36.299+0000 7febc3200640 1 -- 172.21.15.114:0/114690694 >> 172.21.15.114:0/114690694 conn(0x7febc4098a70 msgr2=0x7febc40af230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:36.303 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:36.299+0000 7febc3200640 1 -- 172.21.15.114:0/114690694 shutdown_connections 2024-09-13T17:51:36.303 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:36.299+0000 7febc3200640 1 -- 172.21.15.114:0/114690694 wait complete. 2024-09-13T17:51:36.311 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-13T17:51:36.307+0000 7f326ce00640 -1 osd.4 0 waiting for initial osdmap 2024-09-13T17:51:36.318 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-13T17:51:36.315+0000 7fef61600640 -1 osd.5 0 waiting for initial osdmap 2024-09-13T17:51:36.334 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T17:51:36.345 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-13T17:51:36.343+0000 7f3262e00640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:51:36.346 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-13T17:51:36.343+0000 7fef56c00640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:51:36.361 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-13T17:51:36.359+0000 7f9a85600640 -1 osd.7 0 waiting for initial osdmap 2024-09-13T17:51:36.361 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-13T17:51:36.359+0000 7f48b8200640 -1 osd.6 0 waiting for initial osdmap 2024-09-13T17:51:36.385 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-13T17:51:36.383+0000 7f48ae200640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:51:36.386 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-13T17:51:36.383+0000 7f9a7ac00640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:51:36.408 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-13T17:51:36.407+0000 7f869a800640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T17:51:36.450 INFO:tasks.ceph.osd.0.smithi114.stderr:2024-09-13T17:51:36.447+0000 7f8690800640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:51:36.452 INFO:tasks.ceph.osd.1.smithi114.stderr:2024-09-13T17:51:36.451+0000 7fa586600640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T17:51:36.458 INFO:tasks.ceph.osd.2.smithi114.stderr:2024-09-13T17:51:36.455+0000 7f1562200640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T17:51:36.477 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-09-13T17:51:36.475+0000 7f782a000640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T17:51:36.493 INFO:tasks.ceph.osd.1.smithi114.stderr:2024-09-13T17:51:36.491+0000 7fa57c600640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:51:36.509 INFO:tasks.ceph.osd.2.smithi114.stderr:2024-09-13T17:51:36.507+0000 7f1558200640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:51:36.517 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-09-13T17:51:36.515+0000 7f781f600640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:51:43.142 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T17:51:43.250 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:51:43.253 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:51:43.278 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.274+0000 7fe005e00640 1 Processor -- start 2024-09-13T17:51:43.278 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.274+0000 7fe005e00640 1 -- start start 2024-09-13T17:51:43.279 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.274+0000 7fe005e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe00015ff30 0x7fe0000b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:43.280 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.274+0000 7fe005e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0000ce2b0 0x7fe0000cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:43.280 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.274+0000 7fe005e00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0000d09e0 con 0x7fe0000cf060 2024-09-13T17:51:43.280 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.274+0000 7fe005e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0000cf9e0 con 0x7fe00015ff30 2024-09-13T17:51:43.280 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.274+0000 7fe005e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00008a730 con 0x7fe0000ce2b0 2024-09-13T17:51:43.280 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.274+0000 7fdffea00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe00015ff30 0x7fe0000b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:43.280 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.274+0000 7fdffea00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe00015ff30 0x7fe0000b14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60432/0 (socket says 172.21.15.114:60432) 2024-09-13T17:51:43.280 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.274+0000 7fdffea00640 1 -- 172.21.15.114:0/4085159493 learned_addr learned my addr 172.21.15.114:0/4085159493 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:43.280 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.274+0000 7fdfff400640 1 --2- 172.21.15.114:0/4085159493 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0000ce2b0 0x7fe0000cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:43.282 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.274+0000 7fdffea00640 1 -- 172.21.15.114:0/4085159493 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0000ce2b0 msgr2=0x7fe0000cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:43.282 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.274+0000 7fdffea00640 1 --2- 172.21.15.114:0/4085159493 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0000ce2b0 0x7fe0000cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:43.282 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.274+0000 7fdffea00640 1 -- 172.21.15.114:0/4085159493 >> v1:172.21.15.134:6789/0 conn(0x7fe0000cf060 legacy=0x7fe0000b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:43.282 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.274+0000 7fdffea00640 1 -- 172.21.15.114:0/4085159493 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0000d0c30 con 0x7fe00015ff30 2024-09-13T17:51:43.283 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.278+0000 7fdffea00640 1 --2- 172.21.15.114:0/4085159493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe00015ff30 0x7fe0000b14e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdff0009e50 tx=0x7fdff001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d110badffe7a0bb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:43.283 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.278+0000 7fdffd600640 1 -- 172.21.15.114:0/4085159493 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff00a58d0 con 0x7fe00015ff30 2024-09-13T17:51:43.283 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.278+0000 7fdffd600640 1 -- 172.21.15.114:0/4085159493 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff00a5a30 con 0x7fe00015ff30 2024-09-13T17:51:43.283 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.278+0000 7fdffd600640 1 -- 172.21.15.114:0/4085159493 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff00a5dc0 con 0x7fe00015ff30 2024-09-13T17:51:43.284 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.278+0000 7fe005e00640 1 -- 172.21.15.114:0/4085159493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe00015ff30 msgr2=0x7fe0000b14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:43.284 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.278+0000 7fe005e00640 1 --2- 172.21.15.114:0/4085159493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe00015ff30 0x7fe0000b14e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdff0009e50 tx=0x7fdff001ca00 comp rx=0 tx=0).stop 2024-09-13T17:51:43.284 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.278+0000 7fe005e00640 1 -- 172.21.15.114:0/4085159493 shutdown_connections 2024-09-13T17:51:43.285 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.278+0000 7fe005e00640 1 --2- 172.21.15.114:0/4085159493 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0000ce2b0 0x7fe0000cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:43.285 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.278+0000 7fe005e00640 1 --2- 172.21.15.114:0/4085159493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe00015ff30 0x7fe0000b14e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:43.285 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.278+0000 7fe005e00640 1 -- 172.21.15.114:0/4085159493 >> 172.21.15.114:0/4085159493 conn(0x7fe00008a000 msgr2=0x7fe0000d26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:43.285 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.278+0000 7fe005e00640 1 -- 172.21.15.114:0/4085159493 shutdown_connections 2024-09-13T17:51:43.285 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.278+0000 7fe005e00640 1 -- 172.21.15.114:0/4085159493 wait complete. 2024-09-13T17:51:43.285 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.282+0000 7fe005e00640 1 Processor -- start 2024-09-13T17:51:43.286 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.282+0000 7fe005e00640 1 -- start start 2024-09-13T17:51:43.288 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.282+0000 7fe005e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0000ce2b0 0x7fe0000b7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:43.288 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.282+0000 7fe005e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0000cf060 0x7fe00014fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:43.288 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.282+0000 7fe005e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe00015ff30 0x7fe000155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:43.288 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.282+0000 7fe005e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00015bed0 con 0x7fe00015ff30 2024-09-13T17:51:43.288 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.282+0000 7fe005e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0000b6c50 con 0x7fe0000cf060 2024-09-13T17:51:43.289 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.282+0000 7fe005e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0000b6f30 con 0x7fe0000ce2b0 2024-09-13T17:51:43.289 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.282+0000 7fdfff400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe00015ff30 0x7fe000155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:43.289 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.282+0000 7fdfff400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe00015ff30 0x7fe000155930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60442/0 (socket says 172.21.15.114:60442) 2024-09-13T17:51:43.289 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.282+0000 7fdfff400640 1 -- 172.21.15.114:0/1879920362 learned_addr learned my addr 172.21.15.114:0/1879920362 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:43.289 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.282+0000 7fdffea00640 1 --2- 172.21.15.114:0/1879920362 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0000ce2b0 0x7fe0000b7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:43.289 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.282+0000 7fdffe000640 1 --2- 172.21.15.114:0/1879920362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0000cf060 0x7fe00014fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:43.289 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.282+0000 7fdfff400640 1 -- 172.21.15.114:0/1879920362 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0000ce2b0 msgr2=0x7fe0000b7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:43.289 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.282+0000 7fdfff400640 1 --2- 172.21.15.114:0/1879920362 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0000ce2b0 0x7fe0000b7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:43.289 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.282+0000 7fdfff400640 1 -- 172.21.15.114:0/1879920362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0000cf060 msgr2=0x7fe00014fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:43.289 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.282+0000 7fdfff400640 1 --2- 172.21.15.114:0/1879920362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0000cf060 0x7fe00014fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:43.289 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.282+0000 7fdfff400640 1 -- 172.21.15.114:0/1879920362 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff0009b30 con 0x7fe00015ff30 2024-09-13T17:51:43.289 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.282+0000 7fdffe000640 1 --2- 172.21.15.114:0/1879920362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0000cf060 0x7fe00014fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:51:43.289 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.282+0000 7fdfff400640 1 --2- 172.21.15.114:0/1879920362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe00015ff30 0x7fe000155930 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdff800e7f0 tx=0x7fdff800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:43.290 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.282+0000 7fdff7400640 1 -- 172.21.15.114:0/1879920362 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff8009480 con 0x7fe00015ff30 2024-09-13T17:51:43.290 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.282+0000 7fdff7400640 1 -- 172.21.15.114:0/1879920362 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff800c730 con 0x7fe00015ff30 2024-09-13T17:51:43.290 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.282+0000 7fdff7400640 1 -- 172.21.15.114:0/1879920362 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff800cb00 con 0x7fe00015ff30 2024-09-13T17:51:43.290 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.282+0000 7fe005e00640 1 -- 172.21.15.114:0/1879920362 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0000b7210 con 0x7fe00015ff30 2024-09-13T17:51:43.290 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.282+0000 7fe005e00640 1 -- 172.21.15.114:0/1879920362 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0000b7f50 con 0x7fe00015ff30 2024-09-13T17:51:43.291 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.286+0000 7fe005e00640 1 -- 172.21.15.114:0/1879920362 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe000067370 con 0x7fe00015ff30 2024-09-13T17:51:43.291 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.286+0000 7fdff7400640 1 -- 172.21.15.114:0/1879920362 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdff800cc60 con 0x7fe00015ff30 2024-09-13T17:51:43.291 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.286+0000 7fdff7400640 1 --2- 172.21.15.114:0/1879920362 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdfe0066690 0x7fdfe0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:43.291 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.286+0000 7fdff7400640 1 -- 172.21.15.114:0/1879920362 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdff8083dd0 con 0x7fe00015ff30 2024-09-13T17:51:43.291 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.286+0000 7fdffea00640 1 --2- 172.21.15.114:0/1879920362 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdfe0066690 0x7fdfe0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:43.291 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.286+0000 7fdffea00640 1 --2- 172.21.15.114:0/1879920362 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdfe0066690 0x7fdfe0068b50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdff00ae000 tx=0x7fdff00a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:43.296 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.290+0000 7fdff7400640 1 -- 172.21.15.114:0/1879920362 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdff8051540 con 0x7fe00015ff30 2024-09-13T17:51:43.453 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.450+0000 7fe005e00640 1 -- 172.21.15.114:0/1879920362 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0000cf4a0 con 0x7fe00015ff30 2024-09-13T17:51:43.454 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.450+0000 7fdff7400640 1 -- 172.21.15.114:0/1879920362 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12898 (secure 0 0 0) 0x7fdff8054b60 con 0x7fe00015ff30 2024-09-13T17:51:43.454 INFO:teuthology.misc.health.smithi114.stdout: 2024-09-13T17:51:43.454 INFO:teuthology.misc.health.smithi114.stdout:{"epoch":16,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:51:40.355472+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:51:43.456 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.450+0000 7fe005e00640 1 -- 172.21.15.114:0/1879920362 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdfe0066690 msgr2=0x7fdfe0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:43.456 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.450+0000 7fe005e00640 1 --2- 172.21.15.114:0/1879920362 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdfe0066690 0x7fdfe0068b50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdff00ae000 tx=0x7fdff00a7070 comp rx=0 tx=0).stop 2024-09-13T17:51:43.456 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.450+0000 7fe005e00640 1 -- 172.21.15.114:0/1879920362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe00015ff30 msgr2=0x7fe000155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:43.456 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.450+0000 7fe005e00640 1 --2- 172.21.15.114:0/1879920362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe00015ff30 0x7fe000155930 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdff800e7f0 tx=0x7fdff800ecb0 comp rx=0 tx=0).stop 2024-09-13T17:51:43.457 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.450+0000 7fe005e00640 1 -- 172.21.15.114:0/1879920362 shutdown_connections 2024-09-13T17:51:43.457 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.450+0000 7fe005e00640 1 --2- 172.21.15.114:0/1879920362 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdfe0066690 0x7fdfe0068b50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:43.457 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.450+0000 7fe005e00640 1 --2- 172.21.15.114:0/1879920362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe00015ff30 0x7fe000155930 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:43.457 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.450+0000 7fe005e00640 1 --2- 172.21.15.114:0/1879920362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0000cf060 0x7fe00014fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:43.457 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.450+0000 7fe005e00640 1 --2- 172.21.15.114:0/1879920362 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0000ce2b0 0x7fe0000b7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:43.457 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.450+0000 7fe005e00640 1 -- 172.21.15.114:0/1879920362 >> 172.21.15.114:0/1879920362 conn(0x7fe00008a000 msgr2=0x7fe00006c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:43.457 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.450+0000 7fe005e00640 1 -- 172.21.15.114:0/1879920362 shutdown_connections 2024-09-13T17:51:43.457 INFO:teuthology.misc.health.smithi114.stderr:2024-09-13T17:51:43.450+0000 7fe005e00640 1 -- 172.21.15.114:0/1879920362 wait complete. 2024-09-13T17:51:43.473 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-13T17:51:43.473 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T17:51:43.473 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T17:51:43.473 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T17:51:43.477 INFO:tasks.ceph.mds.a:Started 2024-09-13T17:51:43.477 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T17:51:43.477 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T17:51:43.480 INFO:tasks.ceph.mds.c:Started 2024-09-13T17:51:43.480 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T17:51:43.480 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T17:51:43.483 INFO:tasks.ceph.mds.b:Started 2024-09-13T17:51:43.483 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T17:51:43.483 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T17:51:43.486 INFO:tasks.ceph.mds.d:Started 2024-09-13T17:51:43.487 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-13T17:51:43.487 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:51:43.575 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-09-13T17:51:43.576 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-09-13T17:51:43.585 INFO:tasks.ceph.mds.d.smithi134.stdout:starting mds.d at 2024-09-13T17:51:43.585 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2024-09-13T17:51:43.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.626+0000 7f20aa600640 1 Processor -- start 2024-09-13T17:51:43.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.626+0000 7f20aa600640 1 -- start start 2024-09-13T17:51:43.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.626+0000 7f20aa600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f20a40ce650 0x7f20a4099480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:43.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.626+0000 7f20aa600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a40cebe0 con 0x7f20a41602e0 2024-09-13T17:51:43.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.626+0000 7f20aa600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a40ceec0 con 0x7f20a406e680 2024-09-13T17:51:43.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.630+0000 7f20aa600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a40cf1a0 con 0x7f20a40ce650 2024-09-13T17:51:43.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.630+0000 7f20a3400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f20a41602e0 0x7f20a41606c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33252/0 (socket says 172.21.15.114:33252) 2024-09-13T17:51:43.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.630+0000 7f20a3400640 1 -- 172.21.15.114:0/3653714010 learned_addr learned my addr 172.21.15.114:0/3653714010 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:51:43.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.630+0000 7f209be00640 1 --2- 172.21.15.114:0/3653714010 >> v2:172.21.15.114:3300/0 conn(0x7f20a40ce650 0x7f20a4099480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:43.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.630+0000 7f209be00640 1 -- 172.21.15.114:0/3653714010 >> v1:172.21.15.134:6789/0 conn(0x7f20a406e680 legacy=0x7f20a406eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:43.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.630+0000 7f209be00640 1 -- 172.21.15.114:0/3653714010 >> v1:172.21.15.114:6789/0 conn(0x7f20a41602e0 legacy=0x7f20a41606c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:43.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.630+0000 7f209be00640 1 -- 172.21.15.114:0/3653714010 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a40cf480 con 0x7f20a40ce650 2024-09-13T17:51:43.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.630+0000 7f209be00640 1 --2- 172.21.15.114:0/3653714010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20a40ce650 0x7f20a4099480 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f208c0097c0 tx=0x7f208c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1edce635f9416f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:43.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.630+0000 7f20a2a00640 1 -- 172.21.15.114:0/3653714010 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208c0ab600 con 0x7f20a40ce650 2024-09-13T17:51:43.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.630+0000 7f20a2a00640 1 -- 172.21.15.114:0/3653714010 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208c0ab760 con 0x7f20a40ce650 2024-09-13T17:51:43.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.630+0000 7f20a2a00640 1 -- 172.21.15.114:0/3653714010 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208c0abaf0 con 0x7f20a40ce650 2024-09-13T17:51:43.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.634+0000 7f20aa600640 1 -- 172.21.15.114:0/3653714010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20a40ce650 msgr2=0x7f20a4099480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:43.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.634+0000 7f20aa600640 1 --2- 172.21.15.114:0/3653714010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20a40ce650 0x7f20a4099480 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f208c0097c0 tx=0x7f208c01c3e0 comp rx=0 tx=0).stop 2024-09-13T17:51:43.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.634+0000 7f20aa600640 1 -- 172.21.15.114:0/3653714010 shutdown_connections 2024-09-13T17:51:43.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.634+0000 7f20aa600640 1 --2- 172.21.15.114:0/3653714010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20a40ce650 0x7f20a4099480 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:43.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.634+0000 7f20aa600640 1 -- 172.21.15.114:0/3653714010 >> 172.21.15.114:0/3653714010 conn(0x7f20a40d04e0 msgr2=0x7f20a40d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:43.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.634+0000 7f20aa600640 1 -- 172.21.15.114:0/3653714010 shutdown_connections 2024-09-13T17:51:43.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.634+0000 7f20aa600640 1 -- 172.21.15.114:0/3653714010 wait complete. 2024-09-13T17:51:43.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.634+0000 7f20aa600640 1 Processor -- start 2024-09-13T17:51:43.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.634+0000 7f20aa600640 1 -- start start 2024-09-13T17:51:43.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.634+0000 7f20aa600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20a406e680 0x7f20a40c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:43.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.634+0000 7f20aa600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20a40ce650 0x7f20a4167930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:43.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.634+0000 7f20aa600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20a41602e0 0x7f20a40c3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:43.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.634+0000 7f20aa600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a40c5e00 con 0x7f20a40ce650 2024-09-13T17:51:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.634+0000 7f20aa600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a40c60e0 con 0x7f20a406e680 2024-09-13T17:51:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.634+0000 7f20aa600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a40c63c0 con 0x7f20a41602e0 2024-09-13T17:51:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.634+0000 7f209be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20a40ce650 0x7f20a4167930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.634+0000 7f209be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20a40ce650 0x7f20a4167930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60484/0 (socket says 172.21.15.114:60484) 2024-09-13T17:51:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.634+0000 7f209be00640 1 -- 172.21.15.114:0/3055650860 learned_addr learned my addr 172.21.15.114:0/3055650860 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.634+0000 7f20a3400640 1 --2- 172.21.15.114:0/3055650860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20a406e680 0x7f20a40c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.634+0000 7f20a3e00640 1 --2- 172.21.15.114:0/3055650860 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20a41602e0 0x7f20a40c3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.634+0000 7f209be00640 1 -- 172.21.15.114:0/3055650860 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20a41602e0 msgr2=0x7f20a40c3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.634+0000 7f209be00640 1 --2- 172.21.15.114:0/3055650860 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20a41602e0 0x7f20a40c3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.634+0000 7f209be00640 1 -- 172.21.15.114:0/3055650860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20a406e680 msgr2=0x7f20a40c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.634+0000 7f209be00640 1 --2- 172.21.15.114:0/3055650860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20a406e680 0x7f20a40c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.634+0000 7f209be00640 1 -- 172.21.15.114:0/3055650860 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208c009420 con 0x7f20a40ce650 2024-09-13T17:51:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.638+0000 7f209be00640 1 --2- 172.21.15.114:0/3055650860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20a40ce650 0x7f20a4167930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f208c0ad040 tx=0x7f208c01ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:43.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.638+0000 7f209b400640 1 -- 172.21.15.114:0/3055650860 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208c0b5810 con 0x7f20a40ce650 2024-09-13T17:51:43.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.638+0000 7f209b400640 1 -- 172.21.15.114:0/3055650860 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208c0b59b0 con 0x7f20a40ce650 2024-09-13T17:51:43.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.638+0000 7f20aa600640 1 -- 172.21.15.114:0/3055650860 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a40c66a0 con 0x7f20a40ce650 2024-09-13T17:51:43.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.638+0000 7f209b400640 1 -- 172.21.15.114:0/3055650860 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208c0b5d60 con 0x7f20a40ce650 2024-09-13T17:51:43.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.638+0000 7f20aa600640 1 -- 172.21.15.114:0/3055650860 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a4167e70 con 0x7f20a40ce650 2024-09-13T17:51:43.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.638+0000 7f20aa600640 1 -- 172.21.15.114:0/3055650860 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a4168060 con 0x7f20a40ce650 2024-09-13T17:51:43.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.638+0000 7f209b400640 1 -- 172.21.15.114:0/3055650860 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f208c0b4390 con 0x7f20a40ce650 2024-09-13T17:51:43.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.638+0000 7f209b400640 1 --2- 172.21.15.114:0/3055650860 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2080066690 0x7f2080068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:43.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.638+0000 7f209b400640 1 -- 172.21.15.114:0/3055650860 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f208c11e5e0 con 0x7f20a40ce650 2024-09-13T17:51:43.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.638+0000 7f20a3400640 1 --2- 172.21.15.114:0/3055650860 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2080066690 0x7f2080068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:43.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.638+0000 7f20a3400640 1 --2- 172.21.15.114:0/3055650860 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2080066690 0x7f2080068b50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2094005890 tx=0x7f2094009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:43.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.642+0000 7f209b400640 1 -- 172.21.15.114:0/3055650860 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f20a4168060 con 0x7f20a40ce650 2024-09-13T17:51:43.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.798+0000 7f20aa600640 1 -- 172.21.15.114:0/3055650860 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20a406fa30 con 0x7f20a40ce650 2024-09-13T17:51:43.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.802+0000 7f209b400640 1 -- 172.21.15.114:0/3055650860 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12898 (secure 0 0 0) 0x7f20a406fa30 con 0x7f20a40ce650 2024-09-13T17:51:43.804 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:51:43.805 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":16,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:51:40.355472+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:51:43.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.802+0000 7f20aa600640 1 -- 172.21.15.114:0/3055650860 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2080066690 msgr2=0x7f2080068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:43.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.802+0000 7f20aa600640 1 --2- 172.21.15.114:0/3055650860 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2080066690 0x7f2080068b50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2094005890 tx=0x7f2094009040 comp rx=0 tx=0).stop 2024-09-13T17:51:43.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.802+0000 7f20aa600640 1 -- 172.21.15.114:0/3055650860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20a40ce650 msgr2=0x7f20a4167930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:43.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.802+0000 7f20aa600640 1 --2- 172.21.15.114:0/3055650860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20a40ce650 0x7f20a4167930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f208c0ad040 tx=0x7f208c01ac20 comp rx=0 tx=0).stop 2024-09-13T17:51:43.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.802+0000 7f20aa600640 1 -- 172.21.15.114:0/3055650860 shutdown_connections 2024-09-13T17:51:43.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.802+0000 7f20aa600640 1 --2- 172.21.15.114:0/3055650860 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2080066690 0x7f2080068b50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:43.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.802+0000 7f20aa600640 1 --2- 172.21.15.114:0/3055650860 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f20a41602e0 0x7f20a40c3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:43.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.802+0000 7f20aa600640 1 --2- 172.21.15.114:0/3055650860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f20a40ce650 0x7f20a4167930 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:43.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.802+0000 7f20aa600640 1 --2- 172.21.15.114:0/3055650860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20a406e680 0x7f20a40c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:43.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.802+0000 7f20aa600640 1 -- 172.21.15.114:0/3055650860 >> 172.21.15.114:0/3055650860 conn(0x7f20a40d04e0 msgr2=0x7f20a406b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:43.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.802+0000 7f20aa600640 1 -- 172.21.15.114:0/3055650860 shutdown_connections 2024-09-13T17:51:43.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.802+0000 7f20aa600640 1 -- 172.21.15.114:0/3055650860 wait complete. 2024-09-13T17:51:43.824 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:51:37.996254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:51:43.825 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:51:43.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.962+0000 7f7aebe00640 1 Processor -- start 2024-09-13T17:51:43.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.962+0000 7f7aebe00640 1 -- start start 2024-09-13T17:51:43.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.962+0000 7f7aebe00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7aec15a4a0 0x7f7aec0ce230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:43.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.962+0000 7f7aebe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7aec0ce770 0x7f7aec0cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:43.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.962+0000 7f7aebe00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7aec0b3aa0 0x7f7aec0b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:43.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.962+0000 7f7aebe00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aec099d70 con 0x7f7aec0ce770 2024-09-13T17:51:43.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.962+0000 7f7aebe00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aec0997b0 con 0x7f7aec15a4a0 2024-09-13T17:51:43.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.962+0000 7f7aebe00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec099a90 con 0x7f7aec0b3aa0 2024-09-13T17:51:43.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.962+0000 7f7aea000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7aec0ce770 0x7f7aec0cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:43.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.962+0000 7f7aea000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7aec0ce770 0x7f7aec0cebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60486/0 (socket says 172.21.15.114:60486) 2024-09-13T17:51:43.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.962+0000 7f7aea000640 1 -- 172.21.15.114:0/2495758307 learned_addr learned my addr 172.21.15.114:0/2495758307 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:43.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.962+0000 7f7aeaa00640 1 --2- 172.21.15.114:0/2495758307 >> v2:172.21.15.134:3300/0 conn(0x7f7aec15a4a0 0x7f7aec0ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:43.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.962+0000 7f7aeb400640 1 --2- 172.21.15.114:0/2495758307 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7aec0b3aa0 0x7f7aec0b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:43.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.962+0000 7f7aea000640 1 -- 172.21.15.114:0/2495758307 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7aec0b3aa0 msgr2=0x7f7aec0b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:43.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.962+0000 7f7aea000640 1 --2- 172.21.15.114:0/2495758307 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7aec0b3aa0 0x7f7aec0b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:43.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.962+0000 7f7aea000640 1 -- 172.21.15.114:0/2495758307 >> v2:172.21.15.134:3300/0 conn(0x7f7aec15a4a0 msgr2=0x7f7aec0ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:43.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.962+0000 7f7aea000640 1 --2- 172.21.15.114:0/2495758307 >> v2:172.21.15.134:3300/0 conn(0x7f7aec15a4a0 0x7f7aec0ce230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:43.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.962+0000 7f7aea000640 1 -- 172.21.15.114:0/2495758307 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aec0b32a0 con 0x7f7aec0ce770 2024-09-13T17:51:43.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.962+0000 7f7aeb400640 1 --2- 172.21.15.114:0/2495758307 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7aec0b3aa0 0x7f7aec0b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:51:43.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.966+0000 7f7aea000640 1 --2- 172.21.15.114:0/2495758307 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aec0ce770 0x7f7aec0cebd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7aec0719d0 tx=0x7f7ad801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521a2be32007336e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:43.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.966+0000 7f7ae9600640 1 -- 172.21.15.114:0/2495758307 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad80ab600 con 0x7f7aec0ce770 2024-09-13T17:51:43.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.966+0000 7f7ae9600640 1 -- 172.21.15.114:0/2495758307 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad80a7050 con 0x7f7aec0ce770 2024-09-13T17:51:43.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.966+0000 7f7ae9600640 1 -- 172.21.15.114:0/2495758307 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad80ab980 con 0x7f7aec0ce770 2024-09-13T17:51:43.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.966+0000 7f7aebe00640 1 -- 172.21.15.114:0/2495758307 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aec0ce770 msgr2=0x7f7aec0cebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:43.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.966+0000 7f7aebe00640 1 --2- 172.21.15.114:0/2495758307 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aec0ce770 0x7f7aec0cebd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7aec0719d0 tx=0x7f7ad801c520 comp rx=0 tx=0).stop 2024-09-13T17:51:43.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.966+0000 7f7aebe00640 1 -- 172.21.15.114:0/2495758307 shutdown_connections 2024-09-13T17:51:43.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.966+0000 7f7aebe00640 1 --2- 172.21.15.114:0/2495758307 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7aec0b3aa0 0x7f7aec0b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:43.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.966+0000 7f7aebe00640 1 --2- 172.21.15.114:0/2495758307 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aec0ce770 0x7f7aec0cebd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:43.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.966+0000 7f7aebe00640 1 --2- 172.21.15.114:0/2495758307 >> v2:172.21.15.134:3300/0 conn(0x7f7aec15a4a0 0x7f7aec0ce230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:43.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.966+0000 7f7aebe00640 1 -- 172.21.15.114:0/2495758307 >> 172.21.15.114:0/2495758307 conn(0x7f7aec0d0330 msgr2=0x7f7aec0d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:43.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.966+0000 7f7aebe00640 1 -- 172.21.15.114:0/2495758307 shutdown_connections 2024-09-13T17:51:43.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.966+0000 7f7aebe00640 1 -- 172.21.15.114:0/2495758307 wait complete. 2024-09-13T17:51:43.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.970+0000 7f7aebe00640 1 Processor -- start 2024-09-13T17:51:43.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.970+0000 7f7aebe00640 1 -- start start 2024-09-13T17:51:43.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.970+0000 7f7aebe00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7aec0b3aa0 0x7f7aec14f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:43.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.970+0000 7f7aebe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aec0ce770 0x7f7aec152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:43.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.970+0000 7f7aebe00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7aec15a4a0 0x7f7aec1529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:43.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.970+0000 7f7aebe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec155680 con 0x7f7aec0ce770 2024-09-13T17:51:43.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.970+0000 7f7aebe00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec155920 con 0x7f7aec15a4a0 2024-09-13T17:51:43.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.970+0000 7f7aebe00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec155c00 con 0x7f7aec0b3aa0 2024-09-13T17:51:43.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.970+0000 7f7aea000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aec0ce770 0x7f7aec152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:43.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.970+0000 7f7aea000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aec0ce770 0x7f7aec152490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60490/0 (socket says 172.21.15.114:60490) 2024-09-13T17:51:43.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.970+0000 7f7aea000640 1 -- 172.21.15.114:0/794584213 learned_addr learned my addr 172.21.15.114:0/794584213 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:43.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.970+0000 7f7aeaa00640 1 --2- 172.21.15.114:0/794584213 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7aec0b3aa0 0x7f7aec14f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:43.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.970+0000 7f7aeb400640 1 --2- 172.21.15.114:0/794584213 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7aec15a4a0 0x7f7aec1529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:43.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.970+0000 7f7aea000640 1 -- 172.21.15.114:0/794584213 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7aec0b3aa0 msgr2=0x7f7aec14f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:43.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.970+0000 7f7aea000640 1 --2- 172.21.15.114:0/794584213 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7aec0b3aa0 0x7f7aec14f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:43.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.970+0000 7f7aea000640 1 -- 172.21.15.114:0/794584213 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7aec15a4a0 msgr2=0x7f7aec1529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:43.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.970+0000 7f7aea000640 1 --2- 172.21.15.114:0/794584213 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7aec15a4a0 0x7f7aec1529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:43.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.970+0000 7f7aea000640 1 -- 172.21.15.114:0/794584213 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad80094d0 con 0x7f7aec0ce770 2024-09-13T17:51:43.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.970+0000 7f7aea000640 1 --2- 172.21.15.114:0/794584213 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aec0ce770 0x7f7aec152490 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7ad801abd0 tx=0x7f7ad80192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:43.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.970+0000 7f7ae2a00640 1 -- 172.21.15.114:0/794584213 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad80b4420 con 0x7f7aec0ce770 2024-09-13T17:51:43.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.970+0000 7f7ae2a00640 1 -- 172.21.15.114:0/794584213 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad80b4580 con 0x7f7aec0ce770 2024-09-13T17:51:43.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.970+0000 7f7ae2a00640 1 -- 172.21.15.114:0/794584213 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad80b48f0 con 0x7f7aec0ce770 2024-09-13T17:51:43.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.970+0000 7f7aebe00640 1 -- 172.21.15.114:0/794584213 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aec155ee0 con 0x7f7aec0ce770 2024-09-13T17:51:43.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.970+0000 7f7aebe00640 1 -- 172.21.15.114:0/794584213 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aec1530a0 con 0x7f7aec0ce770 2024-09-13T17:51:43.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.970+0000 7f7aebe00640 1 -- 172.21.15.114:0/794584213 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aec153290 con 0x7f7aec0ce770 2024-09-13T17:51:43.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.974+0000 7f7ae2a00640 1 -- 172.21.15.114:0/794584213 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7ad80b2070 con 0x7f7aec0ce770 2024-09-13T17:51:43.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.974+0000 7f7ae2a00640 1 --2- 172.21.15.114:0/794584213 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7acc066690 0x7f7acc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:43.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.974+0000 7f7ae2a00640 1 -- 172.21.15.114:0/794584213 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7ad811cff0 con 0x7f7aec0ce770 2024-09-13T17:51:43.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.974+0000 7f7aeaa00640 1 --2- 172.21.15.114:0/794584213 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7acc066690 0x7f7acc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:43.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.974+0000 7f7aeaa00640 1 --2- 172.21.15.114:0/794584213 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7acc066690 0x7f7acc068b50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7aec0b41d0 tx=0x7f7adc009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:43.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:43.978+0000 7f7ae2a00640 1 -- 172.21.15.114:0/794584213 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7ad80ea7b0 con 0x7f7aec0ce770 2024-09-13T17:51:44.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.130+0000 7f7aebe00640 1 -- 172.21.15.114:0/794584213 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7aec0cebd0 con 0x7f7aec0ce770 2024-09-13T17:51:44.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.130+0000 7f7ae2a00640 1 -- 172.21.15.114:0/794584213 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7ad80eddd0 con 0x7f7aec0ce770 2024-09-13T17:51:44.138 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-13T17:51:44.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.130+0000 7f7aebe00640 1 -- 172.21.15.114:0/794584213 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7acc066690 msgr2=0x7f7acc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:44.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.130+0000 7f7aebe00640 1 --2- 172.21.15.114:0/794584213 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7acc066690 0x7f7acc068b50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7aec0b41d0 tx=0x7f7adc009190 comp rx=0 tx=0).stop 2024-09-13T17:51:44.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.130+0000 7f7aebe00640 1 -- 172.21.15.114:0/794584213 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aec0ce770 msgr2=0x7f7aec152490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:44.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.130+0000 7f7aebe00640 1 --2- 172.21.15.114:0/794584213 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aec0ce770 0x7f7aec152490 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7ad801abd0 tx=0x7f7ad80192c0 comp rx=0 tx=0).stop 2024-09-13T17:51:44.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.130+0000 7f7aebe00640 1 -- 172.21.15.114:0/794584213 shutdown_connections 2024-09-13T17:51:44.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.130+0000 7f7aebe00640 1 --2- 172.21.15.114:0/794584213 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7acc066690 0x7f7acc068b50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:44.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.130+0000 7f7aebe00640 1 --2- 172.21.15.114:0/794584213 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7aec15a4a0 0x7f7aec1529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:44.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.130+0000 7f7aebe00640 1 --2- 172.21.15.114:0/794584213 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7aec0ce770 0x7f7aec152490 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:44.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.130+0000 7f7aebe00640 1 --2- 172.21.15.114:0/794584213 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7aec0b3aa0 0x7f7aec14f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:44.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.130+0000 7f7aebe00640 1 -- 172.21.15.114:0/794584213 >> 172.21.15.114:0/794584213 conn(0x7f7aec0d0330 msgr2=0x7f7aec157630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:44.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.134+0000 7f7aebe00640 1 -- 172.21.15.114:0/794584213 shutdown_connections 2024-09-13T17:51:44.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.134+0000 7f7aebe00640 1 -- 172.21.15.114:0/794584213 wait complete. 2024-09-13T17:51:44.156 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:51:44.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.286+0000 7fbcb5800640 1 Processor -- start 2024-09-13T17:51:44.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.286+0000 7fbcb5800640 1 -- start start 2024-09-13T17:51:44.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.286+0000 7fbcb5800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbcb013c240 0x7fbcb013f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:44.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.286+0000 7fbcb5800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcb013c980 0x7fbcb006d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:44.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.286+0000 7fbcb5800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbcb006da90 0x7fbcb00cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:44.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.286+0000 7fbcb5800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb00cd220 con 0x7fbcb006da90 2024-09-13T17:51:44.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.286+0000 7fbcb5800640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb013f960 con 0x7fbcb013c240 2024-09-13T17:51:44.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.286+0000 7fbcb5800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb006ded0 con 0x7fbcb013c980 2024-09-13T17:51:44.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.286+0000 7fbcaf400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbcb006da90 0x7fbcb00cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:44.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.286+0000 7fbcaf400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbcb006da90 0x7fbcb00cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60498/0 (socket says 172.21.15.114:60498) 2024-09-13T17:51:44.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.286+0000 7fbcaf400640 1 -- 172.21.15.114:0/581834126 learned_addr learned my addr 172.21.15.114:0/581834126 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:44.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.286+0000 7fbcae000640 1 --2- 172.21.15.114:0/581834126 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcb013c980 0x7fbcb006d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:44.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.286+0000 7fbcaea00640 1 --2- 172.21.15.114:0/581834126 >> v2:172.21.15.134:3300/0 conn(0x7fbcb013c240 0x7fbcb013f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:44.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.286+0000 7fbcaf400640 1 -- 172.21.15.114:0/581834126 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcb013c980 msgr2=0x7fbcb006d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:44.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.286+0000 7fbcaf400640 1 --2- 172.21.15.114:0/581834126 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcb013c980 0x7fbcb006d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:44.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.286+0000 7fbcaf400640 1 -- 172.21.15.114:0/581834126 >> v2:172.21.15.134:3300/0 conn(0x7fbcb013c240 msgr2=0x7fbcb013f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:44.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.286+0000 7fbcaf400640 1 --2- 172.21.15.114:0/581834126 >> v2:172.21.15.134:3300/0 conn(0x7fbcb013c240 0x7fbcb013f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:44.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.286+0000 7fbcaf400640 1 -- 172.21.15.114:0/581834126 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb015a740 con 0x7fbcb006da90 2024-09-13T17:51:44.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.286+0000 7fbcaea00640 1 --2- 172.21.15.114:0/581834126 >> v2:172.21.15.134:3300/0 conn(0x7fbcb013c240 0x7fbcb013f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:51:44.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.290+0000 7fbcaf400640 1 --2- 172.21.15.114:0/581834126 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcb006da90 0x7fbcb00cd650 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbcb006e720 tx=0x7fbca801e700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc9f26b07708b9e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:44.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.290+0000 7fbcad600640 1 -- 172.21.15.114:0/581834126 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca80a8690 con 0x7fbcb006da90 2024-09-13T17:51:44.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.290+0000 7fbcad600640 1 -- 172.21.15.114:0/581834126 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca80a87f0 con 0x7fbcb006da90 2024-09-13T17:51:44.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.290+0000 7fbcad600640 1 -- 172.21.15.114:0/581834126 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca80a8b80 con 0x7fbcb006da90 2024-09-13T17:51:44.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.290+0000 7fbcb5800640 1 -- 172.21.15.114:0/581834126 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcb006da90 msgr2=0x7fbcb00cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:44.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.290+0000 7fbcb5800640 1 --2- 172.21.15.114:0/581834126 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcb006da90 0x7fbcb00cd650 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbcb006e720 tx=0x7fbca801e700 comp rx=0 tx=0).stop 2024-09-13T17:51:44.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.290+0000 7fbcb5800640 1 -- 172.21.15.114:0/581834126 shutdown_connections 2024-09-13T17:51:44.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.290+0000 7fbcb5800640 1 --2- 172.21.15.114:0/581834126 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcb006da90 0x7fbcb00cd650 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:44.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.290+0000 7fbcb5800640 1 --2- 172.21.15.114:0/581834126 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcb013c980 0x7fbcb006d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:44.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.290+0000 7fbcb5800640 1 --2- 172.21.15.114:0/581834126 >> v2:172.21.15.134:3300/0 conn(0x7fbcb013c240 0x7fbcb013f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:44.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.290+0000 7fbcb5800640 1 -- 172.21.15.114:0/581834126 >> 172.21.15.114:0/581834126 conn(0x7fbcb00660b0 msgr2=0x7fbcb0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:44.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.290+0000 7fbcb5800640 1 -- 172.21.15.114:0/581834126 shutdown_connections 2024-09-13T17:51:44.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.290+0000 7fbcb5800640 1 -- 172.21.15.114:0/581834126 wait complete. 2024-09-13T17:51:44.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.294+0000 7fbcb5800640 1 Processor -- start 2024-09-13T17:51:44.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.294+0000 7fbcb5800640 1 -- start start 2024-09-13T17:51:44.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.294+0000 7fbcb5800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcb006da90 0x7fbcb00b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:44.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.294+0000 7fbcb5800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcb013c240 0x7fbcb0153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:44.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.294+0000 7fbcb5800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcb013c980 0x7fbcb01543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:44.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.294+0000 7fbcb5800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb01336e0 con 0x7fbcb013c240 2024-09-13T17:51:44.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.294+0000 7fbcb5800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb013de30 con 0x7fbcb013c980 2024-09-13T17:51:44.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.294+0000 7fbcb5800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb013e110 con 0x7fbcb006da90 2024-09-13T17:51:44.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.294+0000 7fbcae000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcb013c240 0x7fbcb0153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:44.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.294+0000 7fbcae000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcb013c240 0x7fbcb0153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60506/0 (socket says 172.21.15.114:60506) 2024-09-13T17:51:44.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.294+0000 7fbcae000640 1 -- 172.21.15.114:0/595513960 learned_addr learned my addr 172.21.15.114:0/595513960 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:44.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.294+0000 7fbcaea00640 1 --2- 172.21.15.114:0/595513960 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcb006da90 0x7fbcb00b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:44.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.294+0000 7fbcaf400640 1 --2- 172.21.15.114:0/595513960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcb013c980 0x7fbcb01543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:44.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.294+0000 7fbcae000640 1 -- 172.21.15.114:0/595513960 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcb006da90 msgr2=0x7fbcb00b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:44.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.294+0000 7fbcae000640 1 --2- 172.21.15.114:0/595513960 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcb006da90 0x7fbcb00b0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:44.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.294+0000 7fbcae000640 1 -- 172.21.15.114:0/595513960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcb013c980 msgr2=0x7fbcb01543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:44.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.294+0000 7fbcae000640 1 --2- 172.21.15.114:0/595513960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcb013c980 0x7fbcb01543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:44.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.294+0000 7fbcae000640 1 -- 172.21.15.114:0/595513960 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca80094d0 con 0x7fbcb013c240 2024-09-13T17:51:44.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.294+0000 7fbcaea00640 1 --2- 172.21.15.114:0/595513960 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcb006da90 0x7fbcb00b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:51:44.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.294+0000 7fbcae000640 1 --2- 172.21.15.114:0/595513960 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcb013c240 0x7fbcb0153e90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c00d5f0 tx=0x7fbc9c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:44.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.294+0000 7fbca6a00640 1 -- 172.21.15.114:0/595513960 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c0125f0 con 0x7fbcb013c240 2024-09-13T17:51:44.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.294+0000 7fbca6a00640 1 -- 172.21.15.114:0/595513960 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9c012750 con 0x7fbcb013c240 2024-09-13T17:51:44.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.294+0000 7fbca6a00640 1 -- 172.21.15.114:0/595513960 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c012ae0 con 0x7fbcb013c240 2024-09-13T17:51:44.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.294+0000 7fbcb5800640 1 -- 172.21.15.114:0/595513960 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb013e3f0 con 0x7fbcb013c240 2024-09-13T17:51:44.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.294+0000 7fbcb5800640 1 -- 172.21.15.114:0/595513960 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb00b1070 con 0x7fbcb013c240 2024-09-13T17:51:44.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.298+0000 7fbcb5800640 1 -- 172.21.15.114:0/595513960 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb0159790 con 0x7fbcb013c240 2024-09-13T17:51:44.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.298+0000 7fbca6a00640 1 -- 172.21.15.114:0/595513960 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbc9c012c40 con 0x7fbcb013c240 2024-09-13T17:51:44.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.298+0000 7fbca6a00640 1 --2- 172.21.15.114:0/595513960 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbc900666c0 0x7fbc90068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:44.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.298+0000 7fbca6a00640 1 -- 172.21.15.114:0/595513960 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbc9c084310 con 0x7fbcb013c240 2024-09-13T17:51:44.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.298+0000 7fbcaea00640 1 --2- 172.21.15.114:0/595513960 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbc900666c0 0x7fbc90068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:44.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.298+0000 7fbcaea00640 1 --2- 172.21.15.114:0/595513960 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbc900666c0 0x7fbc90068b80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009ac0 tx=0x7fbca00039c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:44.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.302+0000 7fbca6a00640 1 -- 172.21.15.114:0/595513960 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbc9c051930 con 0x7fbcb013c240 2024-09-13T17:51:44.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.490+0000 7fbcb5800640 1 -- 172.21.15.114:0/595513960 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbcb015a210 con 0x7fbcb013c240 2024-09-13T17:51:44.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.490+0000 7fbca6a00640 1 -- 172.21.15.114:0/595513960 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1259 (secure 0 0 0) 0x7fbc9c004650 con 0x7fbcb013c240 2024-09-13T17:51:44.494 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:51:44.494 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4122490085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":4122490085},{"type":"v1","addr":"172.21.15.114:6837","nonce":4122490085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T17:51:44.494 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 2 2024-09-13T17:51:44.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.490+0000 7fbcb5800640 1 -- 172.21.15.114:0/595513960 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbc900666c0 msgr2=0x7fbc90068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:44.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.490+0000 7fbcb5800640 1 --2- 172.21.15.114:0/595513960 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbc900666c0 0x7fbc90068b80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009ac0 tx=0x7fbca00039c0 comp rx=0 tx=0).stop 2024-09-13T17:51:44.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.490+0000 7fbcb5800640 1 -- 172.21.15.114:0/595513960 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcb013c240 msgr2=0x7fbcb0153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:44.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.490+0000 7fbcb5800640 1 --2- 172.21.15.114:0/595513960 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcb013c240 0x7fbcb0153e90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c00d5f0 tx=0x7fbc9c00dab0 comp rx=0 tx=0).stop 2024-09-13T17:51:44.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.490+0000 7fbcb5800640 1 -- 172.21.15.114:0/595513960 shutdown_connections 2024-09-13T17:51:44.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.490+0000 7fbcb5800640 1 --2- 172.21.15.114:0/595513960 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbc900666c0 0x7fbc90068b80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:44.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.490+0000 7fbcb5800640 1 --2- 172.21.15.114:0/595513960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbcb013c980 0x7fbcb01543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:44.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.490+0000 7fbcb5800640 1 --2- 172.21.15.114:0/595513960 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcb013c240 0x7fbcb0153e90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:44.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.490+0000 7fbcb5800640 1 --2- 172.21.15.114:0/595513960 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbcb006da90 0x7fbcb00b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:44.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.490+0000 7fbcb5800640 1 -- 172.21.15.114:0/595513960 >> 172.21.15.114:0/595513960 conn(0x7fbcb00660b0 msgr2=0x7fbcb013a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:44.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.490+0000 7fbcb5800640 1 -- 172.21.15.114:0/595513960 shutdown_connections 2024-09-13T17:51:44.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:44.490+0000 7fbcb5800640 1 -- 172.21.15.114:0/595513960 wait complete. 2024-09-13T17:51:46.514 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:51:46.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.654+0000 7fe6a2a00640 1 Processor -- start 2024-09-13T17:51:46.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.654+0000 7fe6a2a00640 1 -- start start 2024-09-13T17:51:46.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.654+0000 7fe6a2a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe69c151420 0x7fe69c0cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:46.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.654+0000 7fe6a2a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe69c0ccba0 0x7fe69c070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:46.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.654+0000 7fe6a2a00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69c070db0 con 0x7fe69c070960 2024-09-13T17:51:46.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.654+0000 7fe6a2a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe69c0cbc30 con 0x7fe69c0ccba0 2024-09-13T17:51:46.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.654+0000 7fe6a2a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c151800 con 0x7fe69c151420 2024-09-13T17:51:46.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.654+0000 7fe693400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe69c0ccba0 0x7fe69c070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:46.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.658+0000 7fe693400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe69c0ccba0 0x7fe69c070420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60520/0 (socket says 172.21.15.114:60520) 2024-09-13T17:51:46.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.658+0000 7fe693400640 1 -- 172.21.15.114:0/661718479 learned_addr learned my addr 172.21.15.114:0/661718479 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:46.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.658+0000 7fe69be00640 1 --2- 172.21.15.114:0/661718479 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe69c151420 0x7fe69c0cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:46.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.658+0000 7fe693400640 1 -- 172.21.15.114:0/661718479 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe69c151420 msgr2=0x7fe69c0cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:46.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.658+0000 7fe693400640 1 --2- 172.21.15.114:0/661718479 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe69c151420 0x7fe69c0cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:46.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.658+0000 7fe693400640 1 -- 172.21.15.114:0/661718479 >> v1:172.21.15.134:6789/0 conn(0x7fe69c070960 legacy=0x7fe69c15df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:46.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.658+0000 7fe693400640 1 -- 172.21.15.114:0/661718479 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69c0cafb0 con 0x7fe69c0ccba0 2024-09-13T17:51:46.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.658+0000 7fe69be00640 1 --2- 172.21.15.114:0/661718479 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe69c151420 0x7fe69c0cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:51:46.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.658+0000 7fe693400640 1 --2- 172.21.15.114:0/661718479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe69c0ccba0 0x7fe69c070420 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe684009870 tx=0x7fe68401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd54ffedb98c9aca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:46.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.658+0000 7fe69b400640 1 -- 172.21.15.114:0/661718479 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6840ab610 con 0x7fe69c0ccba0 2024-09-13T17:51:46.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.658+0000 7fe69b400640 1 -- 172.21.15.114:0/661718479 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6840ab770 con 0x7fe69c0ccba0 2024-09-13T17:51:46.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.658+0000 7fe69b400640 1 -- 172.21.15.114:0/661718479 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6840abb00 con 0x7fe69c0ccba0 2024-09-13T17:51:46.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.662+0000 7fe6a2a00640 1 -- 172.21.15.114:0/661718479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe69c0ccba0 msgr2=0x7fe69c070420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:46.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.662+0000 7fe6a2a00640 1 --2- 172.21.15.114:0/661718479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe69c0ccba0 0x7fe69c070420 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe684009870 tx=0x7fe68401c410 comp rx=0 tx=0).stop 2024-09-13T17:51:46.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.662+0000 7fe6a2a00640 1 -- 172.21.15.114:0/661718479 shutdown_connections 2024-09-13T17:51:46.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.662+0000 7fe6a2a00640 1 --2- 172.21.15.114:0/661718479 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe69c0ccba0 0x7fe69c070420 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:46.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.662+0000 7fe6a2a00640 1 --2- 172.21.15.114:0/661718479 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe69c151420 0x7fe69c0cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:46.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.662+0000 7fe6a2a00640 1 -- 172.21.15.114:0/661718479 >> 172.21.15.114:0/661718479 conn(0x7fe69c0660b0 msgr2=0x7fe69c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:46.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.662+0000 7fe6a2a00640 1 -- 172.21.15.114:0/661718479 shutdown_connections 2024-09-13T17:51:46.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.662+0000 7fe6a2a00640 1 -- 172.21.15.114:0/661718479 wait complete. 2024-09-13T17:51:46.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.662+0000 7fe6a2a00640 1 Processor -- start 2024-09-13T17:51:46.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.662+0000 7fe6a2a00640 1 -- start start 2024-09-13T17:51:46.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.662+0000 7fe6a2a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe69c070960 0x7fe69c143970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:46.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.662+0000 7fe6a2a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe69c0ccba0 0x7fe69c1636a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:46.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.662+0000 7fe6a2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe69c151420 0x7fe69c0b1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:46.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.662+0000 7fe6a2a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c14b360 con 0x7fe69c151420 2024-09-13T17:51:46.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.662+0000 7fe6a2a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c14a470 con 0x7fe69c0ccba0 2024-09-13T17:51:46.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.662+0000 7fe6a2a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c14a750 con 0x7fe69c070960 2024-09-13T17:51:46.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.662+0000 7fe6a0a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe69c151420 0x7fe69c0b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:46.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.662+0000 7fe693400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe69c0ccba0 0x7fe69c1636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:46.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.662+0000 7fe6a0a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe69c151420 0x7fe69c0b1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60522/0 (socket says 172.21.15.114:60522) 2024-09-13T17:51:46.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.662+0000 7fe69be00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe69c070960 0x7fe69c143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:46.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.662+0000 7fe6a0a00640 1 -- 172.21.15.114:0/3756326260 learned_addr learned my addr 172.21.15.114:0/3756326260 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:46.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.662+0000 7fe693400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe69c0ccba0 0x7fe69c1636a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:51788/0 (socket says 172.21.15.114:51788) 2024-09-13T17:51:46.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.662+0000 7fe6a0a00640 1 -- 172.21.15.114:0/3756326260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe69c070960 msgr2=0x7fe69c143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:46.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.662+0000 7fe6a0a00640 1 --2- 172.21.15.114:0/3756326260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe69c070960 0x7fe69c143970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:46.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.662+0000 7fe6a0a00640 1 -- 172.21.15.114:0/3756326260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe69c0ccba0 msgr2=0x7fe69c1636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:46.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.662+0000 7fe6a0a00640 1 --2- 172.21.15.114:0/3756326260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe69c0ccba0 0x7fe69c1636a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:46.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.662+0000 7fe6a0a00640 1 -- 172.21.15.114:0/3756326260 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6840094d0 con 0x7fe69c151420 2024-09-13T17:51:46.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.666+0000 7fe6a0a00640 1 --2- 172.21.15.114:0/3756326260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe69c151420 0x7fe69c0b1610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe69400c770 tx=0x7fe69400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:46.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.666+0000 7fe698c00640 1 -- 172.21.15.114:0/3756326260 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe694003b80 con 0x7fe69c151420 2024-09-13T17:51:46.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.666+0000 7fe6a2a00640 1 -- 172.21.15.114:0/3756326260 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe69c14aa30 con 0x7fe69c151420 2024-09-13T17:51:46.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.666+0000 7fe698c00640 1 -- 172.21.15.114:0/3756326260 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe694003ce0 con 0x7fe69c151420 2024-09-13T17:51:46.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.666+0000 7fe698c00640 1 -- 172.21.15.114:0/3756326260 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69400aa90 con 0x7fe69c151420 2024-09-13T17:51:46.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.666+0000 7fe6a2a00640 1 -- 172.21.15.114:0/3756326260 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe69c14aff0 con 0x7fe69c151420 2024-09-13T17:51:46.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.666+0000 7fe6a2a00640 1 -- 172.21.15.114:0/3756326260 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe69c14b4d0 con 0x7fe69c151420 2024-09-13T17:51:46.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.666+0000 7fe698c00640 1 -- 172.21.15.114:0/3756326260 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe69400abf0 con 0x7fe69c151420 2024-09-13T17:51:46.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.666+0000 7fe698c00640 1 --2- 172.21.15.114:0/3756326260 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe678066690 0x7fe678068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:46.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.666+0000 7fe698c00640 1 -- 172.21.15.114:0/3756326260 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe694083a30 con 0x7fe69c151420 2024-09-13T17:51:46.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.666+0000 7fe69be00640 1 --2- 172.21.15.114:0/3756326260 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe678066690 0x7fe678068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:46.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.666+0000 7fe69be00640 1 --2- 172.21.15.114:0/3756326260 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe678066690 0x7fe678068b50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe68c0045f0 tx=0x7fe68c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:46.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.670+0000 7fe698c00640 1 -- 172.21.15.114:0/3756326260 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe694051100 con 0x7fe69c151420 2024-09-13T17:51:46.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.910+0000 7fe6a2a00640 1 -- 172.21.15.114:0/3756326260 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe69c070db0 con 0x7fe69c151420 2024-09-13T17:51:46.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.910+0000 7fe698c00640 1 -- 172.21.15.114:0/3756326260 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3533 (secure 0 0 0) 0x7fe69c070db0 con 0x7fe69c151420 2024-09-13T17:51:46.915 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:51:46.915 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/534634081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":534634081},{"type":"v1","addr":"172.21.15.134:6835","nonce":534634081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1773366615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1773366615},{"type":"v1","addr":"172.21.15.114:6836","nonce":1773366615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4122490085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":4122490085},{"type":"v1","addr":"172.21.15.114:6837","nonce":4122490085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/1863104078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1863104078},{"type":"v1","addr":"172.21.15.134:6834","nonce":1863104078}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-09-13T17:51:46.915 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 3 2024-09-13T17:51:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.910+0000 7fe6a2a00640 1 -- 172.21.15.114:0/3756326260 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe678066690 msgr2=0x7fe678068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.910+0000 7fe6a2a00640 1 --2- 172.21.15.114:0/3756326260 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe678066690 0x7fe678068b50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe68c0045f0 tx=0x7fe68c008040 comp rx=0 tx=0).stop 2024-09-13T17:51:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.914+0000 7fe6a2a00640 1 -- 172.21.15.114:0/3756326260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe69c151420 msgr2=0x7fe69c0b1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.914+0000 7fe6a2a00640 1 --2- 172.21.15.114:0/3756326260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe69c151420 0x7fe69c0b1610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe69400c770 tx=0x7fe69400cc30 comp rx=0 tx=0).stop 2024-09-13T17:51:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.914+0000 7fe6a2a00640 1 -- 172.21.15.114:0/3756326260 shutdown_connections 2024-09-13T17:51:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.914+0000 7fe6a2a00640 1 --2- 172.21.15.114:0/3756326260 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe678066690 0x7fe678068b50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.914+0000 7fe6a2a00640 1 --2- 172.21.15.114:0/3756326260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe69c151420 0x7fe69c0b1610 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.914+0000 7fe6a2a00640 1 --2- 172.21.15.114:0/3756326260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe69c0ccba0 0x7fe69c1636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.914+0000 7fe6a2a00640 1 --2- 172.21.15.114:0/3756326260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe69c070960 0x7fe69c143970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.914+0000 7fe6a2a00640 1 -- 172.21.15.114:0/3756326260 >> 172.21.15.114:0/3756326260 conn(0x7fe69c0660b0 msgr2=0x7fe69c15a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:46.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.914+0000 7fe6a2a00640 1 -- 172.21.15.114:0/3756326260 shutdown_connections 2024-09-13T17:51:46.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:46.914+0000 7fe6a2a00640 1 -- 172.21.15.114:0/3756326260 wait complete. 2024-09-13T17:51:46.936 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:51:47.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.066+0000 7fdcea800640 1 Processor -- start 2024-09-13T17:51:47.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.066+0000 7fdcea800640 1 -- start start 2024-09-13T17:51:47.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.066+0000 7fdcea800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdce4156db0 0x7fdce406d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:47.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.066+0000 7fdcea800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdce415a320 0x7fdce415a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:47.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.066+0000 7fdcea800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce406dd50 con 0x7fdce415aef0 2024-09-13T17:51:47.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.066+0000 7fdcea800640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce406e030 con 0x7fdce415a320 2024-09-13T17:51:47.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.066+0000 7fdcea800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce406e310 con 0x7fdce4156db0 2024-09-13T17:51:47.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.070+0000 7fdce3e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fdce415aef0 0x7fdce406edf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33260/0 (socket says 172.21.15.114:33260) 2024-09-13T17:51:47.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.070+0000 7fdce3e00640 1 -- 172.21.15.114:0/302357564 learned_addr learned my addr 172.21.15.114:0/302357564 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:51:47.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.070+0000 7fdce3400640 1 --2- 172.21.15.114:0/302357564 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdce4156db0 0x7fdce406d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:47.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.070+0000 7fdce2a00640 1 --2- 172.21.15.114:0/302357564 >> v2:172.21.15.134:3300/0 conn(0x7fdce415a320 0x7fdce415a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:47.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.070+0000 7fdce2000640 1 -- 172.21.15.114:0/302357564 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497846248 0 0) 0x7fdce406dd50 con 0x7fdce415aef0 2024-09-13T17:51:47.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.070+0000 7fdce2000640 1 -- 172.21.15.114:0/302357564 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcc8003530 con 0x7fdce415aef0 2024-09-13T17:51:47.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.070+0000 7fdce2000640 1 -- 172.21.15.114:0/302357564 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2199931106 0 0) 0x7fdcc8003530 con 0x7fdce415aef0 2024-09-13T17:51:47.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.070+0000 7fdce2000640 1 -- 172.21.15.114:0/302357564 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdce4156db0 msgr2=0x7fdce406d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:47.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.070+0000 7fdce2000640 1 --2- 172.21.15.114:0/302357564 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdce4156db0 0x7fdce406d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:47.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.070+0000 7fdce2000640 1 -- 172.21.15.114:0/302357564 >> v2:172.21.15.134:3300/0 conn(0x7fdce415a320 msgr2=0x7fdce415a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:47.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.070+0000 7fdce2000640 1 --2- 172.21.15.114:0/302357564 >> v2:172.21.15.134:3300/0 conn(0x7fdce415a320 0x7fdce415a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:47.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.070+0000 7fdce2000640 1 -- 172.21.15.114:0/302357564 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce406e5f0 con 0x7fdce415aef0 2024-09-13T17:51:47.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.070+0000 7fdce2000640 1 -- 172.21.15.114:0/302357564 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7fdcdc001680 con 0x7fdce415aef0 2024-09-13T17:51:47.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.070+0000 7fdce2000640 1 -- 172.21.15.114:0/302357564 >> v1:172.21.15.114:6789/0 conn(0x7fdce415aef0 legacy=0x7fdce406edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:47.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.070+0000 7fdce2000640 1 --2- 172.21.15.114:0/302357564 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdcc8003980 0x7fdcc8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:47.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.070+0000 7fdce2000640 1 --2- 172.21.15.114:0/302357564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcc8004370 0x7fdcc8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:47.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.070+0000 7fdce2000640 1 --2- 172.21.15.114:0/302357564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcc8004ec0 0x7fdcc800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:47.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.070+0000 7fdce2000640 1 -- 172.21.15.114:0/302357564 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce406e030 con 0x7fdcc8004370 2024-09-13T17:51:47.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.070+0000 7fdce2000640 1 -- 172.21.15.114:0/302357564 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce406e310 con 0x7fdcc8004ec0 2024-09-13T17:51:47.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.070+0000 7fdce2000640 1 -- 172.21.15.114:0/302357564 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc800bed0 con 0x7fdcc8003980 2024-09-13T17:51:47.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.070+0000 7fdce2a00640 1 --2- 172.21.15.114:0/302357564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcc8004370 0x7fdcc8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:47.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.070+0000 7fdce3400640 1 --2- 172.21.15.114:0/302357564 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdcc8003980 0x7fdcc8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:47.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.070+0000 7fdce3e00640 1 --2- 172.21.15.114:0/302357564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcc8004ec0 0x7fdcc800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:47.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.070+0000 7fdce2a00640 1 -- 172.21.15.114:0/302357564 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdcc8003980 msgr2=0x7fdcc8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:47.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.070+0000 7fdce2a00640 1 --2- 172.21.15.114:0/302357564 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdcc8003980 0x7fdcc8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:47.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.070+0000 7fdce2a00640 1 -- 172.21.15.114:0/302357564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcc8004ec0 msgr2=0x7fdcc800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:47.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.070+0000 7fdce2a00640 1 --2- 172.21.15.114:0/302357564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcc8004ec0 0x7fdcc800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:47.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.070+0000 7fdce2a00640 1 -- 172.21.15.114:0/302357564 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc8003530 con 0x7fdcc8004370 2024-09-13T17:51:47.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.074+0000 7fdce2a00640 1 --2- 172.21.15.114:0/302357564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcc8004370 0x7fdcc8004850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0009ab0 tx=0x7fdcd001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a71eb22c840efefa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:47.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.074+0000 7fdce2000640 1 -- 172.21.15.114:0/302357564 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd00a5680 con 0x7fdcc8004370 2024-09-13T17:51:47.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.074+0000 7fdce2000640 1 -- 172.21.15.114:0/302357564 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd00a57e0 con 0x7fdcc8004370 2024-09-13T17:51:47.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.074+0000 7fdce2000640 1 -- 172.21.15.114:0/302357564 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd00a5b90 con 0x7fdcc8004370 2024-09-13T17:51:47.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.074+0000 7fdcea800640 1 -- 172.21.15.114:0/302357564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcc8004370 msgr2=0x7fdcc8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:47.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.074+0000 7fdcea800640 1 --2- 172.21.15.114:0/302357564 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcc8004370 0x7fdcc8004850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0009ab0 tx=0x7fdcd001ca90 comp rx=0 tx=0).stop 2024-09-13T17:51:47.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.074+0000 7fdce3e00640 1 -- 172.21.15.114:0/302357564 reap_dead start 2024-09-13T17:51:47.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.074+0000 7fdcea800640 1 -- 172.21.15.114:0/302357564 shutdown_connections 2024-09-13T17:51:47.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.074+0000 7fdcea800640 1 -- 172.21.15.114:0/302357564 >> 172.21.15.114:0/302357564 conn(0x7fdce4098a70 msgr2=0x7fdce40b4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:47.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.074+0000 7fdcea800640 1 -- 172.21.15.114:0/302357564 shutdown_connections 2024-09-13T17:51:47.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.074+0000 7fdcea800640 1 -- 172.21.15.114:0/302357564 wait complete. 2024-09-13T17:51:47.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.074+0000 7fdcea800640 1 Processor -- start 2024-09-13T17:51:47.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.074+0000 7fdcea800640 1 -- start start 2024-09-13T17:51:47.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.078+0000 7fdcea800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcc8004370 0x7fdce413e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:47.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.078+0000 7fdcea800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdce41551a0 0x7fdce4155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:47.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.078+0000 7fdcea800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdce414e750 0x7fdce414ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:47.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.078+0000 7fdcea800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce4155b60 con 0x7fdce414e750 2024-09-13T17:51:47.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.078+0000 7fdcea800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce413e540 con 0x7fdcc8004370 2024-09-13T17:51:47.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.078+0000 7fdcea800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce414f4f0 con 0x7fdce41551a0 2024-09-13T17:51:47.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.078+0000 7fdce3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdce414e750 0x7fdce414ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:47.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.078+0000 7fdce3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdce414e750 0x7fdce414ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60544/0 (socket says 172.21.15.114:60544) 2024-09-13T17:51:47.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.078+0000 7fdce3e00640 1 -- 172.21.15.114:0/3769436769 learned_addr learned my addr 172.21.15.114:0/3769436769 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:47.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.078+0000 7fdce3400640 1 --2- 172.21.15.114:0/3769436769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcc8004370 0x7fdce413e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:47.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.078+0000 7fdce2a00640 1 --2- 172.21.15.114:0/3769436769 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdce41551a0 0x7fdce4155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:47.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.078+0000 7fdce3e00640 1 -- 172.21.15.114:0/3769436769 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdce41551a0 msgr2=0x7fdce4155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:47.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.078+0000 7fdce3e00640 1 --2- 172.21.15.114:0/3769436769 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdce41551a0 0x7fdce4155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:47.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.078+0000 7fdce3e00640 1 -- 172.21.15.114:0/3769436769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcc8004370 msgr2=0x7fdce413e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:47.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.078+0000 7fdce3e00640 1 --2- 172.21.15.114:0/3769436769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcc8004370 0x7fdce413e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:47.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.078+0000 7fdce3e00640 1 -- 172.21.15.114:0/3769436769 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce414f7d0 con 0x7fdce414e750 2024-09-13T17:51:47.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.078+0000 7fdce3e00640 1 --2- 172.21.15.114:0/3769436769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdce414e750 0x7fdce414ebd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdce40b26e0 tx=0x7fdcdc012920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:47.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.078+0000 7fdcdb400640 1 -- 172.21.15.114:0/3769436769 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc014750 con 0x7fdce414e750 2024-09-13T17:51:47.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.078+0000 7fdcdb400640 1 -- 172.21.15.114:0/3769436769 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcdc0148f0 con 0x7fdce414e750 2024-09-13T17:51:47.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.078+0000 7fdcdb400640 1 -- 172.21.15.114:0/3769436769 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc014ca0 con 0x7fdce414e750 2024-09-13T17:51:47.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.078+0000 7fdcea800640 1 -- 172.21.15.114:0/3769436769 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce414fab0 con 0x7fdce414e750 2024-09-13T17:51:47.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.078+0000 7fdcea800640 1 -- 172.21.15.114:0/3769436769 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce4150070 con 0x7fdce414e750 2024-09-13T17:51:47.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.078+0000 7fdcea800640 1 -- 172.21.15.114:0/3769436769 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce4150260 con 0x7fdce414e750 2024-09-13T17:51:47.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.078+0000 7fdcdb400640 1 -- 172.21.15.114:0/3769436769 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdcdc0153e0 con 0x7fdce414e750 2024-09-13T17:51:47.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.082+0000 7fdcdb400640 1 --2- 172.21.15.114:0/3769436769 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdcc4066690 0x7fdcc4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:47.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.082+0000 7fdcdb400640 1 -- 172.21.15.114:0/3769436769 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdcdc086760 con 0x7fdce414e750 2024-09-13T17:51:47.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.082+0000 7fdce3400640 1 --2- 172.21.15.114:0/3769436769 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdcc4066690 0x7fdcc4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:47.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.082+0000 7fdce3400640 1 --2- 172.21.15.114:0/3769436769 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdcc4066690 0x7fdcc4068b50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdce4070cd0 tx=0x7fdcd400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:47.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.086+0000 7fdcdb400640 1 -- 172.21.15.114:0/3769436769 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdcdc053d80 con 0x7fdce414e750 2024-09-13T17:51:47.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.238+0000 7fdcea800640 1 -- 172.21.15.114:0/3769436769 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdce415a9b0 con 0x7fdce414e750 2024-09-13T17:51:47.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.238+0000 7fdcdb400640 1 -- 172.21.15.114:0/3769436769 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12898 (secure 0 0 0) 0x7fdcdc01c090 con 0x7fdce414e750 2024-09-13T17:51:47.244 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:51:47.244 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":16,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:51:40.355472+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:51:47.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.242+0000 7fdcea800640 1 -- 172.21.15.114:0/3769436769 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdcc4066690 msgr2=0x7fdcc4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:47.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.242+0000 7fdcea800640 1 --2- 172.21.15.114:0/3769436769 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdcc4066690 0x7fdcc4068b50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdce4070cd0 tx=0x7fdcd400b040 comp rx=0 tx=0).stop 2024-09-13T17:51:47.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.242+0000 7fdcea800640 1 -- 172.21.15.114:0/3769436769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdce414e750 msgr2=0x7fdce414ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:47.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.242+0000 7fdcea800640 1 --2- 172.21.15.114:0/3769436769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdce414e750 0x7fdce414ebd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdce40b26e0 tx=0x7fdcdc012920 comp rx=0 tx=0).stop 2024-09-13T17:51:47.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.242+0000 7fdcea800640 1 -- 172.21.15.114:0/3769436769 shutdown_connections 2024-09-13T17:51:47.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.242+0000 7fdcea800640 1 --2- 172.21.15.114:0/3769436769 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdcc4066690 0x7fdcc4068b50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:47.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.242+0000 7fdcea800640 1 --2- 172.21.15.114:0/3769436769 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdce414e750 0x7fdce414ebd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:47.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.242+0000 7fdcea800640 1 --2- 172.21.15.114:0/3769436769 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdce41551a0 0x7fdce4155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:47.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.242+0000 7fdcea800640 1 --2- 172.21.15.114:0/3769436769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdcc8004370 0x7fdce413e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:47.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.242+0000 7fdcea800640 1 -- 172.21.15.114:0/3769436769 >> 172.21.15.114:0/3769436769 conn(0x7fdce4098a70 msgr2=0x7fdce40b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:47.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.242+0000 7fdcea800640 1 -- 172.21.15.114:0/3769436769 shutdown_connections 2024-09-13T17:51:47.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.242+0000 7fdcea800640 1 -- 172.21.15.114:0/3769436769 wait complete. 2024-09-13T17:51:47.265 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:51:37.996254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:51:47.265 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:51:47.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.398+0000 7f96b1c00640 1 Processor -- start 2024-09-13T17:51:47.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.398+0000 7f96b1c00640 1 -- start start 2024-09-13T17:51:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.398+0000 7f96b1c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f96ac070420 0x7f96ac070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.398+0000 7f96b1c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96ac151800 con 0x7f96ac151420 2024-09-13T17:51:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.398+0000 7f96b1c00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96ac0cafb0 con 0x7f96ac06c540 2024-09-13T17:51:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.398+0000 7f96b1c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96ac0cbc30 con 0x7f96ac070420 2024-09-13T17:51:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.398+0000 7f96aaa00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f96ac151420 0x7f96ac0cc660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33268/0 (socket says 172.21.15.114:33268) 2024-09-13T17:51:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.398+0000 7f96aaa00640 1 -- 172.21.15.114:0/1446070921 learned_addr learned my addr 172.21.15.114:0/1446070921 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:51:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.398+0000 7f96a3e00640 1 --2- 172.21.15.114:0/1446070921 >> v2:172.21.15.114:3300/0 conn(0x7f96ac070420 0x7f96ac070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:47.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.398+0000 7f96a3e00640 1 -- 172.21.15.114:0/1446070921 >> v1:172.21.15.134:6789/0 conn(0x7f96ac06c540 legacy=0x7f96ac06c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:47.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.398+0000 7f96a3e00640 1 -- 172.21.15.114:0/1446070921 >> v1:172.21.15.114:6789/0 conn(0x7f96ac151420 legacy=0x7f96ac0cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:47.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.402+0000 7f96a3e00640 1 -- 172.21.15.114:0/1446070921 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ac0cb290 con 0x7f96ac070420 2024-09-13T17:51:47.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.402+0000 7f96a3e00640 1 --2- 172.21.15.114:0/1446070921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96ac070420 0x7f96ac070890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f96940097c0 tx=0x7f969401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ce6a88c630411d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:47.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.402+0000 7f96aa000640 1 -- 172.21.15.114:0/1446070921 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96940ab600 con 0x7f96ac070420 2024-09-13T17:51:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.402+0000 7f96aa000640 1 -- 172.21.15.114:0/1446070921 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96940a7050 con 0x7f96ac070420 2024-09-13T17:51:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.402+0000 7f96aa000640 1 -- 172.21.15.114:0/1446070921 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96940ab980 con 0x7f96ac070420 2024-09-13T17:51:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.402+0000 7f96b1c00640 1 -- 172.21.15.114:0/1446070921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96ac070420 msgr2=0x7f96ac070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.402+0000 7f96b1c00640 1 --2- 172.21.15.114:0/1446070921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96ac070420 0x7f96ac070890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f96940097c0 tx=0x7f969401c380 comp rx=0 tx=0).stop 2024-09-13T17:51:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.402+0000 7f96b1c00640 1 -- 172.21.15.114:0/1446070921 shutdown_connections 2024-09-13T17:51:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.402+0000 7f96b1c00640 1 --2- 172.21.15.114:0/1446070921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96ac070420 0x7f96ac070890 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.402+0000 7f96b1c00640 1 -- 172.21.15.114:0/1446070921 >> 172.21.15.114:0/1446070921 conn(0x7f96ac0660b0 msgr2=0x7f96ac069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.402+0000 7f96b1c00640 1 -- 172.21.15.114:0/1446070921 shutdown_connections 2024-09-13T17:51:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.402+0000 7f96b1c00640 1 -- 172.21.15.114:0/1446070921 wait complete. 2024-09-13T17:51:47.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.406+0000 7f96b1c00640 1 Processor -- start 2024-09-13T17:51:47.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.406+0000 7f96b1c00640 1 -- start start 2024-09-13T17:51:47.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.406+0000 7f96b1c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96ac06c540 0x7f96ac14dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:47.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.406+0000 7f96b1c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96ac070420 0x7f96ac165610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:47.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.406+0000 7f96b1c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96ac151420 0x7f96ac1f8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:47.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.406+0000 7f96b1c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ac154cd0 con 0x7f96ac151420 2024-09-13T17:51:47.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.406+0000 7f96b1c00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ac0ae190 con 0x7f96ac070420 2024-09-13T17:51:47.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.406+0000 7f96b1c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96ac0ad0a0 con 0x7f96ac06c540 2024-09-13T17:51:47.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.406+0000 7f96ab400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96ac151420 0x7f96ac1f8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:47.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.406+0000 7f96ab400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96ac151420 0x7f96ac1f8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60564/0 (socket says 172.21.15.114:60564) 2024-09-13T17:51:47.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.406+0000 7f96ab400640 1 -- 172.21.15.114:0/764942811 learned_addr learned my addr 172.21.15.114:0/764942811 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:47.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.406+0000 7f96a3e00640 1 --2- 172.21.15.114:0/764942811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96ac070420 0x7f96ac165610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:47.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.406+0000 7f96aaa00640 1 --2- 172.21.15.114:0/764942811 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96ac06c540 0x7f96ac14dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:47.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.406+0000 7f96ab400640 1 -- 172.21.15.114:0/764942811 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96ac06c540 msgr2=0x7f96ac14dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:47.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.406+0000 7f96ab400640 1 --2- 172.21.15.114:0/764942811 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96ac06c540 0x7f96ac14dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:47.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.406+0000 7f96ab400640 1 -- 172.21.15.114:0/764942811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96ac070420 msgr2=0x7f96ac165610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:47.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.406+0000 7f96ab400640 1 --2- 172.21.15.114:0/764942811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96ac070420 0x7f96ac165610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:47.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.406+0000 7f96ab400640 1 -- 172.21.15.114:0/764942811 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9694009420 con 0x7f96ac151420 2024-09-13T17:51:47.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.406+0000 7f96ab400640 1 --2- 172.21.15.114:0/764942811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96ac151420 0x7f96ac1f8880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f96a400c760 tx=0x7f96a400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:47.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.406+0000 7f96a2a00640 1 -- 172.21.15.114:0/764942811 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a4003b80 con 0x7f96ac151420 2024-09-13T17:51:47.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.406+0000 7f96a2a00640 1 -- 172.21.15.114:0/764942811 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a4003ce0 con 0x7f96ac151420 2024-09-13T17:51:47.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.406+0000 7f96a2a00640 1 -- 172.21.15.114:0/764942811 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a400aa30 con 0x7f96ac151420 2024-09-13T17:51:47.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.406+0000 7f96b1c00640 1 -- 172.21.15.114:0/764942811 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96ac0ae400 con 0x7f96ac151420 2024-09-13T17:51:47.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.406+0000 7f96b1c00640 1 -- 172.21.15.114:0/764942811 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96ac0ad380 con 0x7f96ac151420 2024-09-13T17:51:47.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.410+0000 7f96b1c00640 1 -- 172.21.15.114:0/764942811 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96ac0ae920 con 0x7f96ac151420 2024-09-13T17:51:47.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.410+0000 7f96a2a00640 1 -- 172.21.15.114:0/764942811 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f96a400ab90 con 0x7f96ac151420 2024-09-13T17:51:47.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.410+0000 7f96a2a00640 1 --2- 172.21.15.114:0/764942811 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9688066690 0x7f9688068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:47.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.410+0000 7f96a2a00640 1 -- 172.21.15.114:0/764942811 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f96a4083ba0 con 0x7f96ac151420 2024-09-13T17:51:47.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.410+0000 7f96aaa00640 1 --2- 172.21.15.114:0/764942811 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9688066690 0x7f9688068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:47.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.410+0000 7f96aaa00640 1 --2- 172.21.15.114:0/764942811 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9688066690 0x7f9688068b50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f969c007fd0 tx=0x7f969c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:47.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.414+0000 7f96a2a00640 1 -- 172.21.15.114:0/764942811 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f96ac0ae920 con 0x7f96ac151420 2024-09-13T17:51:47.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.570+0000 7f96b1c00640 1 -- 172.21.15.114:0/764942811 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f96ac0ae920 con 0x7f96ac151420 2024-09-13T17:51:47.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.570+0000 7f96a2a00640 1 -- 172.21.15.114:0/764942811 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f96ac0ae920 con 0x7f96ac151420 2024-09-13T17:51:47.574 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-13T17:51:47.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.570+0000 7f96b1c00640 1 -- 172.21.15.114:0/764942811 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9688066690 msgr2=0x7f9688068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:47.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.570+0000 7f96b1c00640 1 --2- 172.21.15.114:0/764942811 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9688066690 0x7f9688068b50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f969c007fd0 tx=0x7f969c009040 comp rx=0 tx=0).stop 2024-09-13T17:51:47.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.570+0000 7f96b1c00640 1 -- 172.21.15.114:0/764942811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96ac151420 msgr2=0x7f96ac1f8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:47.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.570+0000 7f96b1c00640 1 --2- 172.21.15.114:0/764942811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96ac151420 0x7f96ac1f8880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f96a400c760 tx=0x7f96a400cc20 comp rx=0 tx=0).stop 2024-09-13T17:51:47.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.570+0000 7f96b1c00640 1 -- 172.21.15.114:0/764942811 shutdown_connections 2024-09-13T17:51:47.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.570+0000 7f96b1c00640 1 --2- 172.21.15.114:0/764942811 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9688066690 0x7f9688068b50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:47.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.570+0000 7f96b1c00640 1 --2- 172.21.15.114:0/764942811 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96ac151420 0x7f96ac1f8880 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:47.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.570+0000 7f96b1c00640 1 --2- 172.21.15.114:0/764942811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96ac070420 0x7f96ac165610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:47.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.570+0000 7f96b1c00640 1 --2- 172.21.15.114:0/764942811 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96ac06c540 0x7f96ac14dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:47.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.570+0000 7f96b1c00640 1 -- 172.21.15.114:0/764942811 >> 172.21.15.114:0/764942811 conn(0x7f96ac0660b0 msgr2=0x7f96ac069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:47.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.570+0000 7f96b1c00640 1 -- 172.21.15.114:0/764942811 shutdown_connections 2024-09-13T17:51:47.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.570+0000 7f96b1c00640 1 -- 172.21.15.114:0/764942811 wait complete. 2024-09-13T17:51:47.595 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T17:51:47.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.722+0000 7ff76a600640 1 Processor -- start 2024-09-13T17:51:47.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.726+0000 7ff76a600640 1 -- start start 2024-09-13T17:51:47.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.726+0000 7ff76a600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7640b4ab0 0x7ff7640ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:47.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.726+0000 7ff76a600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff7640cada0 0x7ff7640cb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:47.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.726+0000 7ff76a600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff764099d70 con 0x7ff76415a4a0 2024-09-13T17:51:47.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.726+0000 7ff76a600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7640997b0 con 0x7ff7640cada0 2024-09-13T17:51:47.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.726+0000 7ff76a600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff764099a90 con 0x7ff7640b4ab0 2024-09-13T17:51:47.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.726+0000 7ff769c00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff7640cada0 0x7ff7640cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:47.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.726+0000 7ff75be00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7640b4ab0 0x7ff7640ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:47.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.726+0000 7ff769c00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff7640cada0 0x7ff7640cb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:51856/0 (socket says 172.21.15.114:51856) 2024-09-13T17:51:47.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.726+0000 7ff769200640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ff76415a4a0 0x7ff7640ce230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:51820/0 (socket says 172.21.15.114:51820) 2024-09-13T17:51:47.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.726+0000 7ff769c00640 1 -- 172.21.15.114:0/788105250 learned_addr learned my addr 172.21.15.114:0/788105250 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:47.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.726+0000 7ff75be00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7640b4ab0 0x7ff7640ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:40976/0 (socket says 172.21.15.114:40976) 2024-09-13T17:51:47.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.726+0000 7ff75be00640 1 -- 172.21.15.114:0/788105250 >> v2:172.21.15.134:3300/0 conn(0x7ff7640cada0 msgr2=0x7ff7640cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:47.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.726+0000 7ff75be00640 1 --2- 172.21.15.114:0/788105250 >> v2:172.21.15.134:3300/0 conn(0x7ff7640cada0 0x7ff7640cb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:47.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.726+0000 7ff75be00640 1 -- 172.21.15.114:0/788105250 >> v1:172.21.15.134:6789/0 conn(0x7ff76415a4a0 legacy=0x7ff7640ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:47.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.726+0000 7ff75be00640 1 -- 172.21.15.114:0/788105250 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7640b32a0 con 0x7ff7640b4ab0 2024-09-13T17:51:47.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.730+0000 7ff75be00640 1 --2- 172.21.15.114:0/788105250 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7640b4ab0 0x7ff7640ce940 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff74c0097c0 tx=0x7ff74c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71f5f239cc0f3b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:47.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.730+0000 7ff763e00640 1 -- 172.21.15.114:0/788105250 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c0ab600 con 0x7ff7640b4ab0 2024-09-13T17:51:47.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.730+0000 7ff763e00640 1 -- 172.21.15.114:0/788105250 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff74c0a7050 con 0x7ff7640b4ab0 2024-09-13T17:51:47.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.730+0000 7ff763e00640 1 -- 172.21.15.114:0/788105250 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c0ab980 con 0x7ff7640b4ab0 2024-09-13T17:51:47.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.730+0000 7ff76a600640 1 -- 172.21.15.114:0/788105250 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7640b4ab0 msgr2=0x7ff7640ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:47.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.730+0000 7ff76a600640 1 --2- 172.21.15.114:0/788105250 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7640b4ab0 0x7ff7640ce940 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff74c0097c0 tx=0x7ff74c01c470 comp rx=0 tx=0).stop 2024-09-13T17:51:47.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.730+0000 7ff76a600640 1 -- 172.21.15.114:0/788105250 shutdown_connections 2024-09-13T17:51:47.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.730+0000 7ff76a600640 1 --2- 172.21.15.114:0/788105250 >> v2:172.21.15.134:3300/0 conn(0x7ff7640cada0 0x7ff7640cb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:47.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.730+0000 7ff76a600640 1 --2- 172.21.15.114:0/788105250 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7640b4ab0 0x7ff7640ce940 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:47.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.730+0000 7ff76a600640 1 -- 172.21.15.114:0/788105250 >> 172.21.15.114:0/788105250 conn(0x7ff7640d0330 msgr2=0x7ff7640d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:47.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.730+0000 7ff76a600640 1 -- 172.21.15.114:0/788105250 shutdown_connections 2024-09-13T17:51:47.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.730+0000 7ff76a600640 1 -- 172.21.15.114:0/788105250 wait complete. 2024-09-13T17:51:47.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.730+0000 7ff76a600640 1 Processor -- start 2024-09-13T17:51:47.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.730+0000 7ff76a600640 1 -- start start 2024-09-13T17:51:47.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.734+0000 7ff76a600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7640b4ab0 0x7ff7641492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:47.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.734+0000 7ff76a600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7640cada0 0x7ff7640c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:47.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.734+0000 7ff76a600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff76415a4a0 0x7ff7641590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:47.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.734+0000 7ff76a600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76406c730 con 0x7ff7640b4ab0 2024-09-13T17:51:47.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.734+0000 7ff76a600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76406ca10 con 0x7ff76415a4a0 2024-09-13T17:51:47.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.734+0000 7ff76a600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76406ccf0 con 0x7ff7640cada0 2024-09-13T17:51:47.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.734+0000 7ff769200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7640b4ab0 0x7ff7641492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:47.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.734+0000 7ff769200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7640b4ab0 0x7ff7641492e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60566/0 (socket says 172.21.15.114:60566) 2024-09-13T17:51:47.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.734+0000 7ff769200640 1 -- 172.21.15.114:0/1656510268 learned_addr learned my addr 172.21.15.114:0/1656510268 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:47.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.734+0000 7ff75be00640 1 --2- 172.21.15.114:0/1656510268 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7640cada0 0x7ff7640c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:47.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.734+0000 7ff769c00640 1 --2- 172.21.15.114:0/1656510268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff76415a4a0 0x7ff7641590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:47.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.734+0000 7ff769200640 1 -- 172.21.15.114:0/1656510268 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7640cada0 msgr2=0x7ff7640c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:47.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.734+0000 7ff769200640 1 --2- 172.21.15.114:0/1656510268 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7640cada0 0x7ff7640c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:47.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.734+0000 7ff769200640 1 -- 172.21.15.114:0/1656510268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff76415a4a0 msgr2=0x7ff7641590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:47.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.734+0000 7ff769200640 1 --2- 172.21.15.114:0/1656510268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff76415a4a0 0x7ff7641590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:47.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.734+0000 7ff769200640 1 -- 172.21.15.114:0/1656510268 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74c009420 con 0x7ff7640b4ab0 2024-09-13T17:51:47.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.734+0000 7ff769200640 1 --2- 172.21.15.114:0/1656510268 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7640b4ab0 0x7ff7641492e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff75400c490 tx=0x7ff75400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:47.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.734+0000 7ff761600640 1 -- 172.21.15.114:0/1656510268 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff754007480 con 0x7ff7640b4ab0 2024-09-13T17:51:47.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.734+0000 7ff761600640 1 -- 172.21.15.114:0/1656510268 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7540075e0 con 0x7ff7640b4ab0 2024-09-13T17:51:47.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.734+0000 7ff761600640 1 -- 172.21.15.114:0/1656510268 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff754004a10 con 0x7ff7640b4ab0 2024-09-13T17:51:47.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.734+0000 7ff76a600640 1 -- 172.21.15.114:0/1656510268 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7641513b0 con 0x7ff7640b4ab0 2024-09-13T17:51:47.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.734+0000 7ff76a600640 1 -- 172.21.15.114:0/1656510268 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff764149820 con 0x7ff7640b4ab0 2024-09-13T17:51:47.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.734+0000 7ff76a600640 1 -- 172.21.15.114:0/1656510268 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7640cb250 con 0x7ff7640b4ab0 2024-09-13T17:51:47.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.734+0000 7ff761600640 1 -- 172.21.15.114:0/1656510268 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff754004b70 con 0x7ff7640b4ab0 2024-09-13T17:51:47.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.738+0000 7ff761600640 1 --2- 172.21.15.114:0/1656510268 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff740066690 0x7ff740068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:47.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.738+0000 7ff761600640 1 -- 172.21.15.114:0/1656510268 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff754082ff0 con 0x7ff7640b4ab0 2024-09-13T17:51:47.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.738+0000 7ff75be00640 1 --2- 172.21.15.114:0/1656510268 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff740066690 0x7ff740068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:47.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.738+0000 7ff75be00640 1 --2- 172.21.15.114:0/1656510268 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff740066690 0x7ff740068b50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff74c0ad000 tx=0x7ff74c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:47.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.742+0000 7ff761600640 1 -- 172.21.15.114:0/1656510268 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff7540506c0 con 0x7ff7640b4ab0 2024-09-13T17:51:47.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.898+0000 7ff76a600640 1 -- 172.21.15.114:0/1656510268 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff7640cdb30 con 0x7ff7640b4ab0 2024-09-13T17:51:47.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.898+0000 7ff761600640 1 -- 172.21.15.114:0/1656510268 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff754018020 con 0x7ff7640b4ab0 2024-09-13T17:51:47.903 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:51:47.903 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-13T17:51:47.903 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-13T17:51:47.903 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2024-09-13T17:51:47.903 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2024-09-13T17:51:47.903 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:51:47.903 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-13T17:51:47.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.902+0000 7ff76a600640 1 -- 172.21.15.114:0/1656510268 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff740066690 msgr2=0x7ff740068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:47.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.902+0000 7ff76a600640 1 --2- 172.21.15.114:0/1656510268 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff740066690 0x7ff740068b50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff74c0ad000 tx=0x7ff74c008040 comp rx=0 tx=0).stop 2024-09-13T17:51:47.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.902+0000 7ff76a600640 1 -- 172.21.15.114:0/1656510268 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7640b4ab0 msgr2=0x7ff7641492e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:47.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.902+0000 7ff76a600640 1 --2- 172.21.15.114:0/1656510268 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7640b4ab0 0x7ff7641492e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff75400c490 tx=0x7ff75400c950 comp rx=0 tx=0).stop 2024-09-13T17:51:47.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.902+0000 7ff76a600640 1 -- 172.21.15.114:0/1656510268 shutdown_connections 2024-09-13T17:51:47.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.902+0000 7ff76a600640 1 --2- 172.21.15.114:0/1656510268 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff740066690 0x7ff740068b50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:47.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.902+0000 7ff76a600640 1 --2- 172.21.15.114:0/1656510268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff76415a4a0 0x7ff7641590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:47.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.902+0000 7ff76a600640 1 --2- 172.21.15.114:0/1656510268 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff7640cada0 0x7ff7640c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:47.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.902+0000 7ff76a600640 1 --2- 172.21.15.114:0/1656510268 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7640b4ab0 0x7ff7641492e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:47.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.902+0000 7ff76a600640 1 -- 172.21.15.114:0/1656510268 >> 172.21.15.114:0/1656510268 conn(0x7ff7640d0330 msgr2=0x7ff7640b5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:47.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.902+0000 7ff76a600640 1 -- 172.21.15.114:0/1656510268 shutdown_connections 2024-09-13T17:51:47.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:47.902+0000 7ff76a600640 1 -- 172.21.15.114:0/1656510268 wait complete. 2024-09-13T17:51:47.924 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T17:51:47.924 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T17:51:48.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.058+0000 7f3616600640 1 Processor -- start 2024-09-13T17:51:48.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.058+0000 7f3616600640 1 -- start start 2024-09-13T17:51:48.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.062+0000 7f3616600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3610151420 0x7f36100cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:48.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.062+0000 7f3616600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36100ccba0 0x7f3610070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:48.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.062+0000 7f3616600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3610151800 con 0x7f3610070960 2024-09-13T17:51:48.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.062+0000 7f3616600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36100cbc30 con 0x7f3610151420 2024-09-13T17:51:48.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.062+0000 7f3616600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3610070d90 con 0x7f36100ccba0 2024-09-13T17:51:48.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.062+0000 7f360f400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3610151420 0x7f36100cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:48.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.062+0000 7f360f400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3610151420 0x7f36100cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60580/0 (socket says 172.21.15.114:60580) 2024-09-13T17:51:48.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.062+0000 7f360f400640 1 -- 172.21.15.114:0/2481037101 learned_addr learned my addr 172.21.15.114:0/2481037101 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:48.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.062+0000 7f3606a00640 1 --2- 172.21.15.114:0/2481037101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36100ccba0 0x7f3610070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:48.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.062+0000 7f360f400640 1 -- 172.21.15.114:0/2481037101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36100ccba0 msgr2=0x7f3610070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:48.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.062+0000 7f360f400640 1 --2- 172.21.15.114:0/2481037101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36100ccba0 0x7f3610070420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:48.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.062+0000 7f360f400640 1 -- 172.21.15.114:0/2481037101 >> v1:172.21.15.114:6789/0 conn(0x7f3610070960 legacy=0x7f361015df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:48.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.062+0000 7f360f400640 1 -- 172.21.15.114:0/2481037101 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36100cafb0 con 0x7f3610151420 2024-09-13T17:51:48.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.062+0000 7f3606a00640 1 --2- 172.21.15.114:0/2481037101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36100ccba0 0x7f3610070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:51:48.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.066+0000 7f360f400640 1 --2- 172.21.15.114:0/2481037101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3610151420 0x7f36100cc660 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3600009e50 tx=0x7f360001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b4726fd0b857c3c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:48.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.066+0000 7f360ea00640 1 -- 172.21.15.114:0/2481037101 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36000a57a0 con 0x7f3610151420 2024-09-13T17:51:48.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.066+0000 7f360ea00640 1 -- 172.21.15.114:0/2481037101 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36000a5900 con 0x7f3610151420 2024-09-13T17:51:48.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.066+0000 7f360ea00640 1 -- 172.21.15.114:0/2481037101 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36000a5c90 con 0x7f3610151420 2024-09-13T17:51:48.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.066+0000 7f3616600640 1 -- 172.21.15.114:0/2481037101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3610151420 msgr2=0x7f36100cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:48.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.066+0000 7f3616600640 1 --2- 172.21.15.114:0/2481037101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3610151420 0x7f36100cc660 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3600009e50 tx=0x7f360001c8e0 comp rx=0 tx=0).stop 2024-09-13T17:51:48.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.066+0000 7f3616600640 1 -- 172.21.15.114:0/2481037101 shutdown_connections 2024-09-13T17:51:48.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.066+0000 7f3616600640 1 --2- 172.21.15.114:0/2481037101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36100ccba0 0x7f3610070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:48.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.066+0000 7f3616600640 1 --2- 172.21.15.114:0/2481037101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3610151420 0x7f36100cc660 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:48.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.066+0000 7f3616600640 1 -- 172.21.15.114:0/2481037101 >> 172.21.15.114:0/2481037101 conn(0x7f36100660b0 msgr2=0x7f3610069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:48.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.066+0000 7f3616600640 1 -- 172.21.15.114:0/2481037101 shutdown_connections 2024-09-13T17:51:48.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.066+0000 7f3616600640 1 -- 172.21.15.114:0/2481037101 wait complete. 2024-09-13T17:51:48.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.066+0000 7f3616600640 1 Processor -- start 2024-09-13T17:51:48.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.066+0000 7f3616600640 1 -- start start 2024-09-13T17:51:48.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.066+0000 7f3616600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3610070960 0x7f3610157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:48.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.066+0000 7f3616600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36100ccba0 0x7f361014a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:48.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.066+0000 7f3616600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3610151420 0x7f36100af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:48.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.066+0000 7f3616600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361014ab90 con 0x7f3610070960 2024-09-13T17:51:48.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.066+0000 7f3616600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3610162b10 con 0x7f3610151420 2024-09-13T17:51:48.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.066+0000 7f3616600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36101621b0 con 0x7f36100ccba0 2024-09-13T17:51:48.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.066+0000 7f360f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3610070960 0x7f3610157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:48.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.066+0000 7f360f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3610070960 0x7f3610157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60590/0 (socket says 172.21.15.114:60590) 2024-09-13T17:51:48.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.066+0000 7f360f400640 1 -- 172.21.15.114:0/2190999495 learned_addr learned my addr 172.21.15.114:0/2190999495 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:48.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.070+0000 7f3606a00640 1 --2- 172.21.15.114:0/2190999495 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36100ccba0 0x7f361014a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:48.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.070+0000 7f360f400640 1 -- 172.21.15.114:0/2190999495 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36100ccba0 msgr2=0x7f361014a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:48.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.070+0000 7f360f400640 1 --2- 172.21.15.114:0/2190999495 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36100ccba0 0x7f361014a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:48.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.070+0000 7f360f400640 1 -- 172.21.15.114:0/2190999495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3610151420 msgr2=0x7f36100af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:48.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.070+0000 7f360f400640 1 --2- 172.21.15.114:0/2190999495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3610151420 0x7f36100af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:48.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.070+0000 7f360f400640 1 -- 172.21.15.114:0/2190999495 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3600009b30 con 0x7f3610070960 2024-09-13T17:51:48.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.070+0000 7f3606a00640 1 --2- 172.21.15.114:0/2190999495 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36100ccba0 0x7f361014a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:51:48.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.070+0000 7f360f400640 1 --2- 172.21.15.114:0/2190999495 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3610070960 0x7f3610157ee0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f36000af040 tx=0x7f3600019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:48.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.070+0000 7f3607e00640 1 -- 172.21.15.114:0/2190999495 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36000b8670 con 0x7f3610070960 2024-09-13T17:51:48.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.070+0000 7f3607e00640 1 -- 172.21.15.114:0/2190999495 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36000b87f0 con 0x7f3610070960 2024-09-13T17:51:48.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.070+0000 7f3616600640 1 -- 172.21.15.114:0/2190999495 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f361014a8b0 con 0x7f3610070960 2024-09-13T17:51:48.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.070+0000 7f3607e00640 1 -- 172.21.15.114:0/2190999495 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36000b8ba0 con 0x7f3610070960 2024-09-13T17:51:48.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.070+0000 7f3616600640 1 -- 172.21.15.114:0/2190999495 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3610162730 con 0x7f3610070960 2024-09-13T17:51:48.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.070+0000 7f3616600640 1 -- 172.21.15.114:0/2190999495 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36100cc410 con 0x7f3610070960 2024-09-13T17:51:48.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.070+0000 7f3607e00640 1 -- 172.21.15.114:0/2190999495 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f36000b8d00 con 0x7f3610070960 2024-09-13T17:51:48.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.070+0000 7f3607e00640 1 --2- 172.21.15.114:0/2190999495 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f35ec066690 0x7f35ec068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:48.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.070+0000 7f3607e00640 1 -- 172.21.15.114:0/2190999495 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f360011f520 con 0x7f3610070960 2024-09-13T17:51:48.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.070+0000 7f3606a00640 1 --2- 172.21.15.114:0/2190999495 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f35ec066690 0x7f35ec068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:48.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.074+0000 7f3606a00640 1 --2- 172.21.15.114:0/2190999495 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f35ec066690 0x7f35ec068b50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3610159540 tx=0x7f35f8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:48.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.074+0000 7f3607e00640 1 -- 172.21.15.114:0/2190999495 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f36000eccf0 con 0x7f3610070960 2024-09-13T17:51:48.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.230+0000 7f3616600640 1 -- 172.21.15.114:0/2190999495 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f36100caa70 con 0x7f3610070960 2024-09-13T17:51:48.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.386+0000 7f3607e00640 1 -- 172.21.15.114:0/2190999495 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f36000f0310 con 0x7f3610070960 2024-09-13T17:51:48.390 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2024-09-13T17:51:48.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.390+0000 7f3616600640 1 -- 172.21.15.114:0/2190999495 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f35ec066690 msgr2=0x7f35ec068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:48.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.390+0000 7f3616600640 1 --2- 172.21.15.114:0/2190999495 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f35ec066690 0x7f35ec068b50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3610159540 tx=0x7f35f8008040 comp rx=0 tx=0).stop 2024-09-13T17:51:48.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.390+0000 7f3616600640 1 -- 172.21.15.114:0/2190999495 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3610070960 msgr2=0x7f3610157ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:48.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.390+0000 7f3616600640 1 --2- 172.21.15.114:0/2190999495 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3610070960 0x7f3610157ee0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f36000af040 tx=0x7f3600019680 comp rx=0 tx=0).stop 2024-09-13T17:51:48.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.390+0000 7f3616600640 1 -- 172.21.15.114:0/2190999495 shutdown_connections 2024-09-13T17:51:48.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.390+0000 7f3616600640 1 --2- 172.21.15.114:0/2190999495 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f35ec066690 0x7f35ec068b50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:48.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.390+0000 7f3616600640 1 --2- 172.21.15.114:0/2190999495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3610151420 0x7f36100af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:48.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.390+0000 7f3616600640 1 --2- 172.21.15.114:0/2190999495 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36100ccba0 0x7f361014a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:48.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.390+0000 7f3616600640 1 --2- 172.21.15.114:0/2190999495 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3610070960 0x7f3610157ee0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:48.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.390+0000 7f3616600640 1 -- 172.21.15.114:0/2190999495 >> 172.21.15.114:0/2190999495 conn(0x7f36100660b0 msgr2=0x7f361014fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:48.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.390+0000 7f3616600640 1 -- 172.21.15.114:0/2190999495 shutdown_connections 2024-09-13T17:51:48.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.390+0000 7f3616600640 1 -- 172.21.15.114:0/2190999495 wait complete. 2024-09-13T17:51:48.417 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-13T17:51:48.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.554+0000 7fc9de600640 1 Processor -- start 2024-09-13T17:51:48.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.554+0000 7fc9de600640 1 -- start start 2024-09-13T17:51:48.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.554+0000 7fc9de600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc9d8070420 0x7fc9d8070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:48.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.554+0000 7fc9de600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9d806c540 0x7fc9d806c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:48.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.554+0000 7fc9de600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d8151800 con 0x7fc9d8151420 2024-09-13T17:51:48.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.554+0000 7fc9de600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d80cbc30 con 0x7fc9d8070420 2024-09-13T17:51:48.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.554+0000 7fc9de600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d8070dd0 con 0x7fc9d806c540 2024-09-13T17:51:48.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.554+0000 7fc9d7400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc9d8151420 0x7fc9d80cc660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33280/0 (socket says 172.21.15.114:33280) 2024-09-13T17:51:48.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.554+0000 7fc9d7400640 1 -- 172.21.15.114:0/3105595196 learned_addr learned my addr 172.21.15.114:0/3105595196 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:51:48.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.554+0000 7fc9cea00640 1 --2- 172.21.15.114:0/3105595196 >> v2:172.21.15.114:3300/0 conn(0x7fc9d8070420 0x7fc9d8070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:48.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.554+0000 7fc9d7e00640 1 --2- 172.21.15.114:0/3105595196 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9d806c540 0x7fc9d806c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:48.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.554+0000 7fc9cea00640 1 -- 172.21.15.114:0/3105595196 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9d806c540 msgr2=0x7fc9d806c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:48.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.554+0000 7fc9cea00640 1 --2- 172.21.15.114:0/3105595196 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9d806c540 0x7fc9d806c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:48.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.554+0000 7fc9cea00640 1 -- 172.21.15.114:0/3105595196 >> v1:172.21.15.114:6789/0 conn(0x7fc9d8151420 legacy=0x7fc9d80cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:48.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.554+0000 7fc9cea00640 1 -- 172.21.15.114:0/3105595196 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d80cafb0 con 0x7fc9d8070420 2024-09-13T17:51:48.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.558+0000 7fc9cea00640 1 --2- 172.21.15.114:0/3105595196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9d8070420 0x7fc9d8070890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00097c0 tx=0x7fc9c001c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac4af340282f033 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:48.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.558+0000 7fc9d6a00640 1 -- 172.21.15.114:0/3105595196 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0004230 con 0x7fc9d8070420 2024-09-13T17:51:48.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.558+0000 7fc9d6a00640 1 -- 172.21.15.114:0/3105595196 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c00a7050 con 0x7fc9d8070420 2024-09-13T17:51:48.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.558+0000 7fc9d6a00640 1 -- 172.21.15.114:0/3105595196 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0003620 con 0x7fc9d8070420 2024-09-13T17:51:48.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.558+0000 7fc9de600640 1 -- 172.21.15.114:0/3105595196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9d8070420 msgr2=0x7fc9d8070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:48.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.558+0000 7fc9de600640 1 --2- 172.21.15.114:0/3105595196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9d8070420 0x7fc9d8070890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00097c0 tx=0x7fc9c001c350 comp rx=0 tx=0).stop 2024-09-13T17:51:48.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.558+0000 7fc9de600640 1 -- 172.21.15.114:0/3105595196 shutdown_connections 2024-09-13T17:51:48.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.558+0000 7fc9de600640 1 --2- 172.21.15.114:0/3105595196 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9d806c540 0x7fc9d806c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:48.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.558+0000 7fc9de600640 1 --2- 172.21.15.114:0/3105595196 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9d8070420 0x7fc9d8070890 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:48.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.558+0000 7fc9de600640 1 -- 172.21.15.114:0/3105595196 >> 172.21.15.114:0/3105595196 conn(0x7fc9d80660b0 msgr2=0x7fc9d8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:48.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.558+0000 7fc9de600640 1 -- 172.21.15.114:0/3105595196 shutdown_connections 2024-09-13T17:51:48.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.558+0000 7fc9de600640 1 -- 172.21.15.114:0/3105595196 wait complete. 2024-09-13T17:51:48.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.562+0000 7fc9de600640 1 Processor -- start 2024-09-13T17:51:48.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.562+0000 7fc9de600640 1 -- start start 2024-09-13T17:51:48.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.562+0000 7fc9de600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9d806c540 0x7fc9d80b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:48.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.562+0000 7fc9de600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9d8070420 0x7fc9d814cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:48.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.562+0000 7fc9de600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9d8151420 0x7fc9d815a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:48.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.562+0000 7fc9de600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d80b05e0 con 0x7fc9d806c540 2024-09-13T17:51:48.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.562+0000 7fc9de600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d80b0f40 con 0x7fc9d8070420 2024-09-13T17:51:48.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.562+0000 7fc9de600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d80af960 con 0x7fc9d8151420 2024-09-13T17:51:48.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.562+0000 7fc9d7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9d806c540 0x7fc9d80b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:48.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.562+0000 7fc9d7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9d806c540 0x7fc9d80b0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60620/0 (socket says 172.21.15.114:60620) 2024-09-13T17:51:48.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.562+0000 7fc9d7400640 1 -- 172.21.15.114:0/2415648834 learned_addr learned my addr 172.21.15.114:0/2415648834 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:48.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.562+0000 7fc9d7e00640 1 --2- 172.21.15.114:0/2415648834 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9d8151420 0x7fc9d815a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:48.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.562+0000 7fc9cea00640 1 --2- 172.21.15.114:0/2415648834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9d8070420 0x7fc9d814cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:48.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.562+0000 7fc9d7400640 1 -- 172.21.15.114:0/2415648834 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9d8151420 msgr2=0x7fc9d815a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:48.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.562+0000 7fc9d7400640 1 --2- 172.21.15.114:0/2415648834 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9d8151420 0x7fc9d815a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:48.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.562+0000 7fc9d7400640 1 -- 172.21.15.114:0/2415648834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9d8070420 msgr2=0x7fc9d814cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:48.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.562+0000 7fc9d7400640 1 --2- 172.21.15.114:0/2415648834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9d8070420 0x7fc9d814cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:48.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.562+0000 7fc9d7400640 1 -- 172.21.15.114:0/2415648834 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c0009420 con 0x7fc9d806c540 2024-09-13T17:51:48.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.562+0000 7fc9d7400640 1 --2- 172.21.15.114:0/2415648834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9d806c540 0x7fc9d80b0a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8007fd0 tx=0x7fc9c800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:48.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.562+0000 7fc9cfe00640 1 -- 172.21.15.114:0/2415648834 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c8005cf0 con 0x7fc9d806c540 2024-09-13T17:51:48.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.562+0000 7fc9cfe00640 1 -- 172.21.15.114:0/2415648834 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c8005e70 con 0x7fc9d806c540 2024-09-13T17:51:48.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.562+0000 7fc9cfe00640 1 -- 172.21.15.114:0/2415648834 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c80072f0 con 0x7fc9d806c540 2024-09-13T17:51:48.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.562+0000 7fc9de600640 1 -- 172.21.15.114:0/2415648834 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d80afc40 con 0x7fc9d806c540 2024-09-13T17:51:48.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.562+0000 7fc9de600640 1 -- 172.21.15.114:0/2415648834 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d80b0200 con 0x7fc9d806c540 2024-09-13T17:51:48.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.566+0000 7fc9de600640 1 -- 172.21.15.114:0/2415648834 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d80b0850 con 0x7fc9d806c540 2024-09-13T17:51:48.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.566+0000 7fc9cfe00640 1 -- 172.21.15.114:0/2415648834 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc9c8007450 con 0x7fc9d806c540 2024-09-13T17:51:48.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.566+0000 7fc9cfe00640 1 --2- 172.21.15.114:0/2415648834 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc9b4066690 0x7fc9b4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:48.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.566+0000 7fc9cfe00640 1 -- 172.21.15.114:0/2415648834 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fc9c8083620 con 0x7fc9d806c540 2024-09-13T17:51:48.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.566+0000 7fc9cea00640 1 --2- 172.21.15.114:0/2415648834 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc9b4066690 0x7fc9b4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:48.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.566+0000 7fc9cea00640 1 --2- 172.21.15.114:0/2415648834 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc9b4066690 0x7fc9b4068b50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00ad000 tx=0x7fc9c00a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:48.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.570+0000 7fc9cfe00640 1 -- 172.21.15.114:0/2415648834 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc9c8050ad0 con 0x7fc9d806c540 2024-09-13T17:51:48.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:48.726+0000 7fc9de600640 1 -- 172.21.15.114:0/2415648834 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fc9d806c970 con 0x7fc9d806c540 2024-09-13T17:51:49.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.398+0000 7fc9cfe00640 1 -- 172.21.15.114:0/2415648834 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7fc9c80540f0 con 0x7fc9d806c540 2024-09-13T17:51:49.404 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2024-09-13T17:51:49.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.406+0000 7fc9de600640 1 -- 172.21.15.114:0/2415648834 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc9b4066690 msgr2=0x7fc9b4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:49.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.406+0000 7fc9de600640 1 --2- 172.21.15.114:0/2415648834 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc9b4066690 0x7fc9b4068b50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00ad000 tx=0x7fc9c00a6000 comp rx=0 tx=0).stop 2024-09-13T17:51:49.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.406+0000 7fc9de600640 1 -- 172.21.15.114:0/2415648834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9d806c540 msgr2=0x7fc9d80b0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:49.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.406+0000 7fc9de600640 1 --2- 172.21.15.114:0/2415648834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9d806c540 0x7fc9d80b0a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8007fd0 tx=0x7fc9c800c890 comp rx=0 tx=0).stop 2024-09-13T17:51:49.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.406+0000 7fc9de600640 1 -- 172.21.15.114:0/2415648834 shutdown_connections 2024-09-13T17:51:49.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.406+0000 7fc9de600640 1 --2- 172.21.15.114:0/2415648834 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc9b4066690 0x7fc9b4068b50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:49.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.406+0000 7fc9de600640 1 --2- 172.21.15.114:0/2415648834 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc9d8151420 0x7fc9d815a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:49.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.406+0000 7fc9de600640 1 --2- 172.21.15.114:0/2415648834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9d8070420 0x7fc9d814cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:49.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.406+0000 7fc9de600640 1 --2- 172.21.15.114:0/2415648834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9d806c540 0x7fc9d80b0a00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:49.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.406+0000 7fc9de600640 1 -- 172.21.15.114:0/2415648834 >> 172.21.15.114:0/2415648834 conn(0x7fc9d80660b0 msgr2=0x7fc9d80cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:49.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.410+0000 7fc9de600640 1 -- 172.21.15.114:0/2415648834 shutdown_connections 2024-09-13T17:51:49.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.410+0000 7fc9de600640 1 -- 172.21.15.114:0/2415648834 wait complete. 2024-09-13T17:51:49.445 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T17:51:49.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.578+0000 7f8adba00640 1 Processor -- start 2024-09-13T17:51:49.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.578+0000 7f8adba00640 1 -- start start 2024-09-13T17:51:49.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.582+0000 7f8adba00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ad413c240 0x7f8ad413f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:49.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.582+0000 7f8adba00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8ad406dc60 0x7f8ad40cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:49.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.582+0000 7f8adba00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad40cd220 con 0x7f8ad413c980 2024-09-13T17:51:49.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.582+0000 7f8adba00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad413f960 con 0x7f8ad406dc60 2024-09-13T17:51:49.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.582+0000 7f8adba00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad415a740 con 0x7f8ad413c240 2024-09-13T17:51:49.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.582+0000 7f8ad9a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8ad406dc60 0x7f8ad40cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:49.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.582+0000 7f8ad9a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8ad406dc60 0x7f8ad40cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60636/0 (socket says 172.21.15.114:60636) 2024-09-13T17:51:49.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.582+0000 7f8ad9a00640 1 -- 172.21.15.114:0/973133165 learned_addr learned my addr 172.21.15.114:0/973133165 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:49.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.582+0000 7f8ad9000640 1 --2- 172.21.15.114:0/973133165 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ad413c240 0x7f8ad413f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:49.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.582+0000 7f8ad9a00640 1 -- 172.21.15.114:0/973133165 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ad413c240 msgr2=0x7f8ad413f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:49.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.582+0000 7f8ad9a00640 1 --2- 172.21.15.114:0/973133165 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ad413c240 0x7f8ad413f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:49.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.582+0000 7f8ad9a00640 1 -- 172.21.15.114:0/973133165 >> v1:172.21.15.114:6789/0 conn(0x7f8ad413c980 legacy=0x7f8ad406d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:49.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.582+0000 7f8ad9a00640 1 -- 172.21.15.114:0/973133165 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad4159bc0 con 0x7f8ad406dc60 2024-09-13T17:51:49.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.586+0000 7f8ad9a00640 1 --2- 172.21.15.114:0/973133165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ad406dc60 0x7f8ad40cd650 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8acc009e50 tx=0x7f8acc01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9483a7384cdd1b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:49.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.586+0000 7f8ad3e00640 1 -- 172.21.15.114:0/973133165 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8acc0a58d0 con 0x7f8ad406dc60 2024-09-13T17:51:49.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.586+0000 7f8ad3e00640 1 -- 172.21.15.114:0/973133165 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8acc0a5a30 con 0x7f8ad406dc60 2024-09-13T17:51:49.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.586+0000 7f8ad3e00640 1 -- 172.21.15.114:0/973133165 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8acc0a5dc0 con 0x7f8ad406dc60 2024-09-13T17:51:49.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.586+0000 7f8adba00640 1 -- 172.21.15.114:0/973133165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ad406dc60 msgr2=0x7f8ad40cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:49.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.586+0000 7f8adba00640 1 --2- 172.21.15.114:0/973133165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ad406dc60 0x7f8ad40cd650 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8acc009e50 tx=0x7f8acc01ca00 comp rx=0 tx=0).stop 2024-09-13T17:51:49.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.586+0000 7f8adba00640 1 -- 172.21.15.114:0/973133165 shutdown_connections 2024-09-13T17:51:49.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.586+0000 7f8adba00640 1 --2- 172.21.15.114:0/973133165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ad406dc60 0x7f8ad40cd650 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:49.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.586+0000 7f8adba00640 1 --2- 172.21.15.114:0/973133165 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ad413c240 0x7f8ad413f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:49.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.586+0000 7f8adba00640 1 -- 172.21.15.114:0/973133165 >> 172.21.15.114:0/973133165 conn(0x7f8ad40660b0 msgr2=0x7f8ad4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:49.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.586+0000 7f8adba00640 1 -- 172.21.15.114:0/973133165 shutdown_connections 2024-09-13T17:51:49.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.586+0000 7f8adba00640 1 -- 172.21.15.114:0/973133165 wait complete. 2024-09-13T17:51:49.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.586+0000 7f8adba00640 1 Processor -- start 2024-09-13T17:51:49.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.586+0000 7f8adba00640 1 -- start start 2024-09-13T17:51:49.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.590+0000 7f8adba00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ad406dc60 0x7f8ad4139e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:49.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.590+0000 7f8adba00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ad413c240 0x7f8ad40a9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:49.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.590+0000 7f8adba00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ad413c980 0x7f8ad40aa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:49.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.590+0000 7f8adba00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad41573b0 con 0x7f8ad413c980 2024-09-13T17:51:49.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.590+0000 7f8adba00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad41581d0 con 0x7f8ad413c240 2024-09-13T17:51:49.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.590+0000 7f8adba00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad413a350 con 0x7f8ad406dc60 2024-09-13T17:51:49.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.590+0000 7f8ad9a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ad413c980 0x7f8ad40aa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:49.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.590+0000 7f8ad9a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ad413c980 0x7f8ad40aa4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60642/0 (socket says 172.21.15.114:60642) 2024-09-13T17:51:49.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.590+0000 7f8ad9a00640 1 -- 172.21.15.114:0/884079227 learned_addr learned my addr 172.21.15.114:0/884079227 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:49.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.590+0000 7f8ad9000640 1 --2- 172.21.15.114:0/884079227 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ad406dc60 0x7f8ad4139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:49.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.590+0000 7f8acbe00640 1 --2- 172.21.15.114:0/884079227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ad413c240 0x7f8ad40a9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:49.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.590+0000 7f8ad9a00640 1 -- 172.21.15.114:0/884079227 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ad406dc60 msgr2=0x7f8ad4139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:49.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.590+0000 7f8ad9a00640 1 --2- 172.21.15.114:0/884079227 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ad406dc60 0x7f8ad4139e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:49.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.590+0000 7f8ad9a00640 1 -- 172.21.15.114:0/884079227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ad413c240 msgr2=0x7f8ad40a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:49.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.590+0000 7f8ad9a00640 1 --2- 172.21.15.114:0/884079227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ad413c240 0x7f8ad40a9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:49.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.590+0000 7f8ad9a00640 1 -- 172.21.15.114:0/884079227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8acc009b30 con 0x7f8ad413c980 2024-09-13T17:51:49.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.590+0000 7f8acbe00640 1 --2- 172.21.15.114:0/884079227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ad413c240 0x7f8ad40a9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:51:49.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.590+0000 7f8ad9a00640 1 --2- 172.21.15.114:0/884079227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ad413c980 0x7f8ad40aa4b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8acc0af040 tx=0x7f8ad40ce3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:49.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.590+0000 7f8ad1600640 1 -- 172.21.15.114:0/884079227 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8acc0b8670 con 0x7f8ad413c980 2024-09-13T17:51:49.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.590+0000 7f8ad1600640 1 -- 172.21.15.114:0/884079227 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8acc0b8810 con 0x7f8ad413c980 2024-09-13T17:51:49.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.590+0000 7f8ad1600640 1 -- 172.21.15.114:0/884079227 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8acc0b8bc0 con 0x7f8ad413c980 2024-09-13T17:51:49.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.590+0000 7f8adba00640 1 -- 172.21.15.114:0/884079227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad41575c0 con 0x7f8ad413c980 2024-09-13T17:51:49.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.590+0000 7f8adba00640 1 -- 172.21.15.114:0/884079227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad4157b80 con 0x7f8ad413c980 2024-09-13T17:51:49.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.590+0000 7f8adba00640 1 -- 172.21.15.114:0/884079227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad4159790 con 0x7f8ad413c980 2024-09-13T17:51:49.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.590+0000 7f8ad1600640 1 -- 172.21.15.114:0/884079227 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8acc0b8d20 con 0x7f8ad413c980 2024-09-13T17:51:49.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.594+0000 7f8ad1600640 1 --2- 172.21.15.114:0/884079227 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8ab00666c0 0x7f8ab0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:49.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.594+0000 7f8ad1600640 1 -- 172.21.15.114:0/884079227 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f8acc11f6b0 con 0x7f8ad413c980 2024-09-13T17:51:49.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.594+0000 7f8ad9000640 1 --2- 172.21.15.114:0/884079227 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8ab00666c0 0x7f8ab0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:49.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.594+0000 7f8ad9000640 1 --2- 172.21.15.114:0/884079227 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8ab00666c0 0x7f8ab0068b80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4007a60 tx=0x7f8ac4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:49.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.598+0000 7f8ad1600640 1 -- 172.21.15.114:0/884079227 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8acc0ec9e0 con 0x7f8ad413c980 2024-09-13T17:51:49.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.782+0000 7f8adba00640 1 -- 172.21.15.114:0/884079227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8ad40714d0 con 0x7f8ad413c980 2024-09-13T17:51:49.797 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 2 and data pool 3 2024-09-13T17:51:49.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.790+0000 7f8ad1600640 1 -- 172.21.15.114:0/884079227 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8acc0f0000 con 0x7f8ad413c980 2024-09-13T17:51:49.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.794+0000 7f8adba00640 1 -- 172.21.15.114:0/884079227 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8ab00666c0 msgr2=0x7f8ab0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:49.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.794+0000 7f8adba00640 1 --2- 172.21.15.114:0/884079227 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8ab00666c0 0x7f8ab0068b80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4007a60 tx=0x7f8ac4008040 comp rx=0 tx=0).stop 2024-09-13T17:51:49.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.794+0000 7f8adba00640 1 -- 172.21.15.114:0/884079227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ad413c980 msgr2=0x7f8ad40aa4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:49.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.794+0000 7f8adba00640 1 --2- 172.21.15.114:0/884079227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ad413c980 0x7f8ad40aa4b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8acc0af040 tx=0x7f8ad40ce3a0 comp rx=0 tx=0).stop 2024-09-13T17:51:49.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.794+0000 7f8adba00640 1 -- 172.21.15.114:0/884079227 shutdown_connections 2024-09-13T17:51:49.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.794+0000 7f8adba00640 1 --2- 172.21.15.114:0/884079227 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8ab00666c0 0x7f8ab0068b80 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4007a60 tx=0x7f8ac4008040 comp rx=0 tx=0).stop 2024-09-13T17:51:49.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.794+0000 7f8adba00640 1 --2- 172.21.15.114:0/884079227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ad413c980 0x7f8ad40aa4b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:49.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.794+0000 7f8adba00640 1 --2- 172.21.15.114:0/884079227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ad413c240 0x7f8ad40a9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:49.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.794+0000 7f8adba00640 1 --2- 172.21.15.114:0/884079227 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ad406dc60 0x7f8ad4139e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:49.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.794+0000 7f8adba00640 1 -- 172.21.15.114:0/884079227 >> 172.21.15.114:0/884079227 conn(0x7f8ad40660b0 msgr2=0x7f8ad40b18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:49.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.794+0000 7f8adba00640 1 -- 172.21.15.114:0/884079227 shutdown_connections 2024-09-13T17:51:49.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.794+0000 7f8adba00640 1 -- 172.21.15.114:0/884079227 wait complete. 2024-09-13T17:51:49.836 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-13T17:51:49.836 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-13T17:51:49.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.974+0000 7f422b000640 1 Processor -- start 2024-09-13T17:51:49.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.974+0000 7f422b000640 1 -- start start 2024-09-13T17:51:49.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.974+0000 7f422b000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f42240ce0b0 0x7f422415e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:49.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.974+0000 7f422b000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f422415e5f0 0x7f42240cb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:49.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.974+0000 7f422b000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f422415ea40 con 0x7f422415a650 2024-09-13T17:51:49.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.974+0000 7f422b000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f422415ba40 con 0x7f42240ce0b0 2024-09-13T17:51:49.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.974+0000 7f422b000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42240ce540 con 0x7f422415e5f0 2024-09-13T17:51:49.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.974+0000 7f4223400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f42240ce0b0 0x7f422415e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:49.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.974+0000 7f4223400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f42240ce0b0 0x7f422415e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60646/0 (socket says 172.21.15.114:60646) 2024-09-13T17:51:49.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.974+0000 7f4223400640 1 -- 172.21.15.114:0/643446740 learned_addr learned my addr 172.21.15.114:0/643446740 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:49.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.974+0000 7f4229000640 1 --2- 172.21.15.114:0/643446740 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f422415e5f0 0x7f42240cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:49.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.974+0000 7f4223400640 1 -- 172.21.15.114:0/643446740 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f422415e5f0 msgr2=0x7f42240cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:49.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.974+0000 7f4223400640 1 --2- 172.21.15.114:0/643446740 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f422415e5f0 0x7f42240cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:49.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.974+0000 7f4223400640 1 -- 172.21.15.114:0/643446740 >> v1:172.21.15.134:6789/0 conn(0x7f422415a650 legacy=0x7f4224099480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:49.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.974+0000 7f4223400640 1 -- 172.21.15.114:0/643446740 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42240ce820 con 0x7f42240ce0b0 2024-09-13T17:51:49.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.978+0000 7f4223400640 1 --2- 172.21.15.114:0/643446740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42240ce0b0 0x7f422415e0b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4210009870 tx=0x7f421001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28698c0231282b54 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:49.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.978+0000 7f4222a00640 1 -- 172.21.15.114:0/643446740 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42100a9620 con 0x7f42240ce0b0 2024-09-13T17:51:49.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.978+0000 7f4222a00640 1 -- 172.21.15.114:0/643446740 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42100a9780 con 0x7f42240ce0b0 2024-09-13T17:51:49.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.978+0000 7f4222a00640 1 -- 172.21.15.114:0/643446740 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42100a9b10 con 0x7f42240ce0b0 2024-09-13T17:51:49.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.978+0000 7f422b000640 1 -- 172.21.15.114:0/643446740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42240ce0b0 msgr2=0x7f422415e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:49.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.978+0000 7f422b000640 1 --2- 172.21.15.114:0/643446740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42240ce0b0 0x7f422415e0b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4210009870 tx=0x7f421001c560 comp rx=0 tx=0).stop 2024-09-13T17:51:49.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.978+0000 7f422b000640 1 -- 172.21.15.114:0/643446740 shutdown_connections 2024-09-13T17:51:49.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.978+0000 7f422b000640 1 --2- 172.21.15.114:0/643446740 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f422415e5f0 0x7f42240cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:49.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.978+0000 7f422b000640 1 --2- 172.21.15.114:0/643446740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42240ce0b0 0x7f422415e0b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:49.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.978+0000 7f422b000640 1 -- 172.21.15.114:0/643446740 >> 172.21.15.114:0/643446740 conn(0x7f42240d04e0 msgr2=0x7f42240d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:49.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.978+0000 7f422b000640 1 -- 172.21.15.114:0/643446740 shutdown_connections 2024-09-13T17:51:49.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.978+0000 7f422b000640 1 -- 172.21.15.114:0/643446740 wait complete. 2024-09-13T17:51:49.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.982+0000 7f422b000640 1 Processor -- start 2024-09-13T17:51:49.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.982+0000 7f422b000640 1 -- start start 2024-09-13T17:51:49.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.982+0000 7f422b000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f422415a650 0x7f42241506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:49.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.982+0000 7f422b000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f422415e5f0 0x7f422406c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:49.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.982+0000 7f422b000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4224164030 0x7f42241644e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:49.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.982+0000 7f422b000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4224164a20 con 0x7f4224164030 2024-09-13T17:51:49.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.982+0000 7f422b000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422406c9b0 con 0x7f422415e5f0 2024-09-13T17:51:49.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.982+0000 7f422b000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422406b3d0 con 0x7f422415a650 2024-09-13T17:51:49.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.982+0000 7f4229000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4224164030 0x7f42241644e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:49.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.982+0000 7f4229000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4224164030 0x7f42241644e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:60652/0 (socket says 172.21.15.114:60652) 2024-09-13T17:51:49.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.982+0000 7f4229000640 1 -- 172.21.15.114:0/3682009462 learned_addr learned my addr 172.21.15.114:0/3682009462 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:49.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.982+0000 7f4223e00640 1 --2- 172.21.15.114:0/3682009462 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f422415a650 0x7f42241506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:49.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.982+0000 7f4223400640 1 --2- 172.21.15.114:0/3682009462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f422415e5f0 0x7f422406c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:49.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.982+0000 7f4229000640 1 -- 172.21.15.114:0/3682009462 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f422415a650 msgr2=0x7f42241506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:49.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.982+0000 7f4229000640 1 --2- 172.21.15.114:0/3682009462 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f422415a650 0x7f42241506d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:49.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.982+0000 7f4229000640 1 -- 172.21.15.114:0/3682009462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f422415e5f0 msgr2=0x7f422406c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:49.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.982+0000 7f4229000640 1 --2- 172.21.15.114:0/3682009462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f422415e5f0 0x7f422406c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:49.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.982+0000 7f4229000640 1 -- 172.21.15.114:0/3682009462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42100094d0 con 0x7f4224164030 2024-09-13T17:51:49.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.982+0000 7f4223400640 1 --2- 172.21.15.114:0/3682009462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f422415e5f0 0x7f422406c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:51:49.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.982+0000 7f4229000640 1 --2- 172.21.15.114:0/3682009462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4224164030 0x7f42241644e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f421c00d560 tx=0x7f421c00da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:49.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.982+0000 7f421be00640 1 -- 172.21.15.114:0/3682009462 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c0125f0 con 0x7f4224164030 2024-09-13T17:51:49.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.982+0000 7f421be00640 1 -- 172.21.15.114:0/3682009462 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421c012770 con 0x7f4224164030 2024-09-13T17:51:49.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.982+0000 7f421be00640 1 -- 172.21.15.114:0/3682009462 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c012b20 con 0x7f4224164030 2024-09-13T17:51:49.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.982+0000 7f422b000640 1 -- 172.21.15.114:0/3682009462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f422406b6b0 con 0x7f4224164030 2024-09-13T17:51:49.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.982+0000 7f422b000640 1 -- 172.21.15.114:0/3682009462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f422406bc70 con 0x7f4224164030 2024-09-13T17:51:49.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.986+0000 7f422b000640 1 -- 172.21.15.114:0/3682009462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f422415e0b0 con 0x7f4224164030 2024-09-13T17:51:49.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.986+0000 7f421be00640 1 -- 172.21.15.114:0/3682009462 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f421c012c80 con 0x7f4224164030 2024-09-13T17:51:49.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.986+0000 7f421be00640 1 --2- 172.21.15.114:0/3682009462 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f42040666c0 0x7f4204068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:49.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.986+0000 7f421be00640 1 -- 172.21.15.114:0/3682009462 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f421c084560 con 0x7f4224164030 2024-09-13T17:51:49.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.986+0000 7f4223e00640 1 --2- 172.21.15.114:0/3682009462 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f42040666c0 0x7f4204068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:49.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.986+0000 7f4223e00640 1 --2- 172.21.15.114:0/3682009462 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f42040666c0 0x7f4204068b80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f42140012f0 tx=0x7f4214009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:49.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:49.990+0000 7f421be00640 1 -- 172.21.15.114:0/3682009462 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f421c0518c0 con 0x7f4224164030 2024-09-13T17:51:50.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.153+0000 7f422b000640 1 -- 172.21.15.114:0/3682009462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f42240b1dd0 con 0x7f4224164030 2024-09-13T17:51:50.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.793+0000 7f421be00640 1 -- 172.21.15.114:0/3682009462 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7f421c054ee0 con 0x7f4224164030 2024-09-13T17:51:50.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.797+0000 7f422b000640 1 -- 172.21.15.114:0/3682009462 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f42040666c0 msgr2=0x7f4204068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:50.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.797+0000 7f422b000640 1 --2- 172.21.15.114:0/3682009462 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f42040666c0 0x7f4204068b80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f42140012f0 tx=0x7f4214009040 comp rx=0 tx=0).stop 2024-09-13T17:51:50.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.797+0000 7f422b000640 1 -- 172.21.15.114:0/3682009462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4224164030 msgr2=0x7f42241644e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:50.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.797+0000 7f422b000640 1 --2- 172.21.15.114:0/3682009462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4224164030 0x7f42241644e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f421c00d560 tx=0x7f421c00da20 comp rx=0 tx=0).stop 2024-09-13T17:51:50.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.797+0000 7f422b000640 1 -- 172.21.15.114:0/3682009462 shutdown_connections 2024-09-13T17:51:50.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.797+0000 7f422b000640 1 --2- 172.21.15.114:0/3682009462 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f42040666c0 0x7f4204068b80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:50.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.797+0000 7f422b000640 1 --2- 172.21.15.114:0/3682009462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4224164030 0x7f42241644e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:50.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.797+0000 7f422b000640 1 --2- 172.21.15.114:0/3682009462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f422415e5f0 0x7f422406c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:50.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.797+0000 7f422b000640 1 --2- 172.21.15.114:0/3682009462 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f422415a650 0x7f42241506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:50.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.797+0000 7f422b000640 1 -- 172.21.15.114:0/3682009462 >> 172.21.15.114:0/3682009462 conn(0x7f42240d04e0 msgr2=0x7f422406e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:50.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.797+0000 7f422b000640 1 -- 172.21.15.114:0/3682009462 shutdown_connections 2024-09-13T17:51:50.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.797+0000 7f422b000640 1 -- 172.21.15.114:0/3682009462 wait complete. 2024-09-13T17:51:50.822 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T17:51:50.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.961+0000 7f3eb8e00640 1 Processor -- start 2024-09-13T17:51:50.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.961+0000 7f3eb8e00640 1 -- start start 2024-09-13T17:51:50.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.965+0000 7f3eb8e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3eb40b2890 0x7f3eb40b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:50.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.965+0000 7f3eb8e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3eb4070470 0x7f3eb4070900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:50.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.965+0000 7f3eb8e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb40b3210 con 0x7f3eb41593e0 2024-09-13T17:51:50.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.965+0000 7f3eb8e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eb4071480 con 0x7f3eb4070470 2024-09-13T17:51:50.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.965+0000 7f3eb8e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb40711a0 con 0x7f3eb40b2890 2024-09-13T17:51:50.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.965+0000 7f3eb1e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3eb41593e0 0x7f3eb406d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49144/0 (socket says 172.21.15.114:49144) 2024-09-13T17:51:50.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.965+0000 7f3eb1e00640 1 -- 172.21.15.114:0/3809625191 learned_addr learned my addr 172.21.15.114:0/3809625191 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:51:50.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.965+0000 7f3eb2800640 1 --2- 172.21.15.114:0/3809625191 >> v2:172.21.15.114:3300/0 conn(0x7f3eb4070470 0x7f3eb4070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:50.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.965+0000 7f3ea9400640 1 --2- 172.21.15.114:0/3809625191 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3eb40b2890 0x7f3eb40b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:50.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.965+0000 7f3eb2800640 1 -- 172.21.15.114:0/3809625191 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3eb40b2890 msgr2=0x7f3eb40b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:50.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.965+0000 7f3eb2800640 1 --2- 172.21.15.114:0/3809625191 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3eb40b2890 0x7f3eb40b2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:50.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.965+0000 7f3eb2800640 1 -- 172.21.15.114:0/3809625191 >> v1:172.21.15.114:6789/0 conn(0x7f3eb41593e0 legacy=0x7f3eb406d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:50.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.965+0000 7f3eb2800640 1 -- 172.21.15.114:0/3809625191 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb406cc30 con 0x7f3eb4070470 2024-09-13T17:51:50.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.965+0000 7f3eb2800640 1 --2- 172.21.15.114:0/3809625191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3eb4070470 0x7f3eb4070900 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3eac0097c0 tx=0x7f3eac01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68749c0c5d90f2db server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:50.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.969+0000 7f3eb1400640 1 -- 172.21.15.114:0/3809625191 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac0ac640 con 0x7f3eb4070470 2024-09-13T17:51:50.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.969+0000 7f3eb1400640 1 -- 172.21.15.114:0/3809625191 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eac0ac7a0 con 0x7f3eb4070470 2024-09-13T17:51:50.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.969+0000 7f3eb1400640 1 -- 172.21.15.114:0/3809625191 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac0acb30 con 0x7f3eb4070470 2024-09-13T17:51:50.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.969+0000 7f3eb8e00640 1 -- 172.21.15.114:0/3809625191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3eb4070470 msgr2=0x7f3eb4070900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:50.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.969+0000 7f3eb8e00640 1 --2- 172.21.15.114:0/3809625191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3eb4070470 0x7f3eb4070900 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3eac0097c0 tx=0x7f3eac01c3e0 comp rx=0 tx=0).stop 2024-09-13T17:51:50.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.969+0000 7f3eb8e00640 1 -- 172.21.15.114:0/3809625191 shutdown_connections 2024-09-13T17:51:50.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.969+0000 7f3eb8e00640 1 --2- 172.21.15.114:0/3809625191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3eb4070470 0x7f3eb4070900 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:50.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.969+0000 7f3eb8e00640 1 --2- 172.21.15.114:0/3809625191 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3eb40b2890 0x7f3eb40b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:50.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.969+0000 7f3eb8e00640 1 -- 172.21.15.114:0/3809625191 >> 172.21.15.114:0/3809625191 conn(0x7f3eb40b0380 msgr2=0x7f3eb40b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:50.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.969+0000 7f3eb8e00640 1 -- 172.21.15.114:0/3809625191 shutdown_connections 2024-09-13T17:51:50.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.969+0000 7f3eb8e00640 1 -- 172.21.15.114:0/3809625191 wait complete. 2024-09-13T17:51:50.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.969+0000 7f3eb8e00640 1 Processor -- start 2024-09-13T17:51:50.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.969+0000 7f3eb8e00640 1 -- start start 2024-09-13T17:51:50.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.969+0000 7f3eb8e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3eb4070470 0x7f3eb41495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:50.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.969+0000 7f3eb8e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3eb40b2890 0x7f3eb4149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:50.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.969+0000 7f3eb8e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3eb41593e0 0x7f3eb414ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:50.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.969+0000 7f3eb8e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb414af80 con 0x7f3eb40b2890 2024-09-13T17:51:50.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.969+0000 7f3eb8e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb414a6e0 con 0x7f3eb4070470 2024-09-13T17:51:50.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.969+0000 7f3eb8e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb414a9c0 con 0x7f3eb41593e0 2024-09-13T17:51:50.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.969+0000 7f3ea9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3eb40b2890 0x7f3eb4149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:50.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.969+0000 7f3ea9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3eb40b2890 0x7f3eb4149c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52736/0 (socket says 172.21.15.114:52736) 2024-09-13T17:51:50.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.969+0000 7f3ea9400640 1 -- 172.21.15.114:0/4006020608 learned_addr learned my addr 172.21.15.114:0/4006020608 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:50.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.973+0000 7f3eb1e00640 1 --2- 172.21.15.114:0/4006020608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3eb4070470 0x7f3eb41495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:50.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.973+0000 7f3ea9400640 1 -- 172.21.15.114:0/4006020608 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3eb41593e0 msgr2=0x7f3eb414ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:50.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.973+0000 7f3ea9400640 1 --2- 172.21.15.114:0/4006020608 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3eb41593e0 0x7f3eb414ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:50.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.973+0000 7f3ea9400640 1 -- 172.21.15.114:0/4006020608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3eb4070470 msgr2=0x7f3eb41495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:50.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.973+0000 7f3ea9400640 1 --2- 172.21.15.114:0/4006020608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3eb4070470 0x7f3eb41495a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:50.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.973+0000 7f3ea9400640 1 -- 172.21.15.114:0/4006020608 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac009420 con 0x7f3eb40b2890 2024-09-13T17:51:50.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.973+0000 7f3eb1e00640 1 --2- 172.21.15.114:0/4006020608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3eb4070470 0x7f3eb41495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:51:50.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.973+0000 7f3ea9400640 1 --2- 172.21.15.114:0/4006020608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3eb40b2890 0x7f3eb4149c20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00d800 tx=0x7f3e9c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:50.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.973+0000 7f3eaaa00640 1 -- 172.21.15.114:0/4006020608 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c00b6c0 con 0x7f3eb40b2890 2024-09-13T17:51:50.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.973+0000 7f3eaaa00640 1 -- 172.21.15.114:0/4006020608 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9c00b820 con 0x7f3eb40b2890 2024-09-13T17:51:50.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.973+0000 7f3eb8e00640 1 -- 172.21.15.114:0/4006020608 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb414aca0 con 0x7f3eb40b2890 2024-09-13T17:51:50.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.973+0000 7f3eaaa00640 1 -- 172.21.15.114:0/4006020608 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c00bb90 con 0x7f3eb40b2890 2024-09-13T17:51:50.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.973+0000 7f3eb8e00640 1 -- 172.21.15.114:0/4006020608 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb414b380 con 0x7f3eb40b2890 2024-09-13T17:51:50.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.973+0000 7f3eb8e00640 1 -- 172.21.15.114:0/4006020608 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb4070900 con 0x7f3eb40b2890 2024-09-13T17:51:50.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.973+0000 7f3eaaa00640 1 -- 172.21.15.114:0/4006020608 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3e9c00bcf0 con 0x7f3eb40b2890 2024-09-13T17:51:50.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.973+0000 7f3eaaa00640 1 --2- 172.21.15.114:0/4006020608 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3e90066690 0x7f3e90068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:50.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.973+0000 7f3eaaa00640 1 -- 172.21.15.114:0/4006020608 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f3e9c084820 con 0x7f3eb40b2890 2024-09-13T17:51:50.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.973+0000 7f3eb1e00640 1 --2- 172.21.15.114:0/4006020608 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3e90066690 0x7f3e90068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:50.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.977+0000 7f3eb1e00640 1 --2- 172.21.15.114:0/4006020608 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3e90066690 0x7f3e90068b50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4005c10 tx=0x7f3ea4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:50.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:50.977+0000 7f3eaaa00640 1 -- 172.21.15.114:0/4006020608 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3e9c051aa0 con 0x7f3eb40b2890 2024-09-13T17:51:51.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:51.133+0000 7f3eb8e00640 1 -- 172.21.15.114:0/4006020608 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3eb40b2670 con 0x7f3eb40b2890 2024-09-13T17:51:52.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.813+0000 7f3eaaa00640 1 -- 172.21.15.114:0/4006020608 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7f3e9c0550c0 con 0x7f3eb40b2890 2024-09-13T17:51:52.819 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data_ec' created 2024-09-13T17:51:52.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.821+0000 7f3eb8e00640 1 -- 172.21.15.114:0/4006020608 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3e90066690 msgr2=0x7f3e90068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:52.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.821+0000 7f3eb8e00640 1 --2- 172.21.15.114:0/4006020608 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3e90066690 0x7f3e90068b50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4005c10 tx=0x7f3ea4009040 comp rx=0 tx=0).stop 2024-09-13T17:51:52.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.821+0000 7f3eb8e00640 1 -- 172.21.15.114:0/4006020608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3eb40b2890 msgr2=0x7f3eb4149c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:52.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.821+0000 7f3eb8e00640 1 --2- 172.21.15.114:0/4006020608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3eb40b2890 0x7f3eb4149c20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00d800 tx=0x7f3e9c00dcc0 comp rx=0 tx=0).stop 2024-09-13T17:51:52.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.821+0000 7f3eb8e00640 1 -- 172.21.15.114:0/4006020608 shutdown_connections 2024-09-13T17:51:52.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.821+0000 7f3eb8e00640 1 --2- 172.21.15.114:0/4006020608 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3e90066690 0x7f3e90068b50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:52.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.821+0000 7f3eb8e00640 1 --2- 172.21.15.114:0/4006020608 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3eb41593e0 0x7f3eb414ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:52.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.821+0000 7f3eb8e00640 1 --2- 172.21.15.114:0/4006020608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3eb40b2890 0x7f3eb4149c20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:52.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.821+0000 7f3eb8e00640 1 --2- 172.21.15.114:0/4006020608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3eb4070470 0x7f3eb41495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:52.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.821+0000 7f3eb8e00640 1 -- 172.21.15.114:0/4006020608 >> 172.21.15.114:0/4006020608 conn(0x7f3eb40b0380 msgr2=0x7f3eb414d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:52.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.825+0000 7f3eb8e00640 1 -- 172.21.15.114:0/4006020608 shutdown_connections 2024-09-13T17:51:52.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.825+0000 7f3eb8e00640 1 -- 172.21.15.114:0/4006020608 wait complete. 2024-09-13T17:51:52.852 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-13T17:51:52.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.993+0000 7f2afb000640 1 Processor -- start 2024-09-13T17:51:52.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.993+0000 7f2afb000640 1 -- start start 2024-09-13T17:51:52.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.993+0000 7f2afb000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2af40b2370 0x7f2af415d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:52.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.993+0000 7f2afb000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2af40cf2c0 0x7f2af4069f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:52.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.993+0000 7f2afb000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af406d8a0 con 0x7f2af40ae480 2024-09-13T17:51:52.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.993+0000 7f2afb000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af4157200 con 0x7f2af40b2370 2024-09-13T17:51:52.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.993+0000 7f2afb000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af406cd60 con 0x7f2af40cf2c0 2024-09-13T17:51:52.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.993+0000 7f2af9000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2af40cf2c0 0x7f2af4069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:52.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.993+0000 7f2aeb400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2af40b2370 0x7f2af415d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:52.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.993+0000 7f2af3e00640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f2af40ae480 0x7f2af40b1c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:42826/0 (socket says 172.21.15.114:42826) 2024-09-13T17:51:52.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.993+0000 7f2af3e00640 1 -- 172.21.15.114:0/269497708 learned_addr learned my addr 172.21.15.114:0/269497708 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:51:52.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.993+0000 7f2af3400640 1 -- 172.21.15.114:0/269497708 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2533508472 0 0) 0x7f2af406d8a0 con 0x7f2af40ae480 2024-09-13T17:51:52.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.993+0000 7f2af3400640 1 -- 172.21.15.114:0/269497708 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ad8003530 con 0x7f2af40ae480 2024-09-13T17:51:52.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.993+0000 7f2af9000640 1 -- 172.21.15.114:0/269497708 >> v2:172.21.15.134:3300/0 conn(0x7f2af40b2370 msgr2=0x7f2af415d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:52.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.993+0000 7f2af9000640 1 --2- 172.21.15.114:0/269497708 >> v2:172.21.15.134:3300/0 conn(0x7f2af40b2370 0x7f2af415d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:52.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.993+0000 7f2af9000640 1 -- 172.21.15.114:0/269497708 >> v1:172.21.15.134:6789/0 conn(0x7f2af40ae480 legacy=0x7f2af40b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:52.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.993+0000 7f2af9000640 1 -- 172.21.15.114:0/269497708 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af406cf70 con 0x7f2af40cf2c0 2024-09-13T17:51:53.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.993+0000 7f2af9000640 1 --2- 172.21.15.114:0/269497708 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2af40cf2c0 0x7f2af4069f80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2aec0097c0 tx=0x7f2aec01c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd95d5cc99bad5fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:53.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.993+0000 7f2af3400640 1 -- 172.21.15.114:0/269497708 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec004230 con 0x7f2af40cf2c0 2024-09-13T17:51:53.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.993+0000 7f2af3400640 1 -- 172.21.15.114:0/269497708 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aec0a7050 con 0x7f2af40cf2c0 2024-09-13T17:51:53.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.993+0000 7f2af3400640 1 -- 172.21.15.114:0/269497708 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec003620 con 0x7f2af40cf2c0 2024-09-13T17:51:53.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.997+0000 7f2afb000640 1 -- 172.21.15.114:0/269497708 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2af40cf2c0 msgr2=0x7f2af4069f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:53.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.997+0000 7f2afb000640 1 --2- 172.21.15.114:0/269497708 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2af40cf2c0 0x7f2af4069f80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2aec0097c0 tx=0x7f2aec01c350 comp rx=0 tx=0).stop 2024-09-13T17:51:53.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.997+0000 7f2afb000640 1 -- 172.21.15.114:0/269497708 shutdown_connections 2024-09-13T17:51:53.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.997+0000 7f2afb000640 1 --2- 172.21.15.114:0/269497708 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2af40cf2c0 0x7f2af4069f80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:53.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.997+0000 7f2afb000640 1 --2- 172.21.15.114:0/269497708 >> v2:172.21.15.134:3300/0 conn(0x7f2af40b2370 0x7f2af415d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:53.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.997+0000 7f2afb000640 1 -- 172.21.15.114:0/269497708 >> 172.21.15.114:0/269497708 conn(0x7f2af40b0f60 msgr2=0x7f2af40cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:53.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.997+0000 7f2afb000640 1 -- 172.21.15.114:0/269497708 shutdown_connections 2024-09-13T17:51:53.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.997+0000 7f2afb000640 1 -- 172.21.15.114:0/269497708 wait complete. 2024-09-13T17:51:53.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.997+0000 7f2afb000640 1 Processor -- start 2024-09-13T17:51:53.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.997+0000 7f2afb000640 1 -- start start 2024-09-13T17:51:53.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.997+0000 7f2afb000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2af40ae480 0x7f2af413b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:53.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.997+0000 7f2afb000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2af40b2370 0x7f2af413a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:53.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.997+0000 7f2afb000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2af40cf2c0 0x7f2af413db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:53.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.997+0000 7f2afb000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af4159580 con 0x7f2af40ae480 2024-09-13T17:51:53.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.997+0000 7f2afb000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af4158f70 con 0x7f2af40b2370 2024-09-13T17:51:53.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.997+0000 7f2afb000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af4150ec0 con 0x7f2af40cf2c0 2024-09-13T17:51:53.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.997+0000 7f2af3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2af40ae480 0x7f2af413b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:53.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.997+0000 7f2af3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2af40ae480 0x7f2af413b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52738/0 (socket says 172.21.15.114:52738) 2024-09-13T17:51:53.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.997+0000 7f2af3e00640 1 -- 172.21.15.114:0/4188733549 learned_addr learned my addr 172.21.15.114:0/4188733549 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:53.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.997+0000 7f2aeb400640 1 --2- 172.21.15.114:0/4188733549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2af40b2370 0x7f2af413a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:53.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.997+0000 7f2af9000640 1 --2- 172.21.15.114:0/4188733549 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2af40cf2c0 0x7f2af413db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:53.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.997+0000 7f2af3e00640 1 -- 172.21.15.114:0/4188733549 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2af40cf2c0 msgr2=0x7f2af413db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:53.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.997+0000 7f2af3e00640 1 --2- 172.21.15.114:0/4188733549 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2af40cf2c0 0x7f2af413db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:53.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.997+0000 7f2af3e00640 1 -- 172.21.15.114:0/4188733549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2af40b2370 msgr2=0x7f2af413a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:53.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.997+0000 7f2af3e00640 1 --2- 172.21.15.114:0/4188733549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2af40b2370 0x7f2af413a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:53.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:52.997+0000 7f2af3e00640 1 -- 172.21.15.114:0/4188733549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec009420 con 0x7f2af40ae480 2024-09-13T17:51:53.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:53.001+0000 7f2af3e00640 1 --2- 172.21.15.114:0/4188733549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2af40ae480 0x7f2af413b0d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2ae400cbf0 tx=0x7f2ae400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:53.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:53.001+0000 7f2af0c00640 1 -- 172.21.15.114:0/4188733549 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae400ad50 con 0x7f2af40ae480 2024-09-13T17:51:53.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:53.001+0000 7f2af0c00640 1 -- 172.21.15.114:0/4188733549 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae4012400 con 0x7f2af40ae480 2024-09-13T17:51:53.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:53.001+0000 7f2af0c00640 1 -- 172.21.15.114:0/4188733549 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4012790 con 0x7f2af40ae480 2024-09-13T17:51:53.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:53.001+0000 7f2afb000640 1 -- 172.21.15.114:0/4188733549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af4150900 con 0x7f2af40ae480 2024-09-13T17:51:53.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:53.001+0000 7f2afb000640 1 -- 172.21.15.114:0/4188733549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af41591a0 con 0x7f2af40ae480 2024-09-13T17:51:53.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:53.001+0000 7f2afb000640 1 -- 172.21.15.114:0/4188733549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2af415d730 con 0x7f2af40ae480 2024-09-13T17:51:53.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:53.001+0000 7f2af0c00640 1 -- 172.21.15.114:0/4188733549 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2ae4007070 con 0x7f2af40ae480 2024-09-13T17:51:53.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:53.001+0000 7f2af0c00640 1 --2- 172.21.15.114:0/4188733549 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2ad0066690 0x7f2ad0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:53.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:53.001+0000 7f2af0c00640 1 -- 172.21.15.114:0/4188733549 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f2ae4084820 con 0x7f2af40ae480 2024-09-13T17:51:53.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:53.001+0000 7f2aeb400640 1 --2- 172.21.15.114:0/4188733549 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2ad0066690 0x7f2ad0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:53.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:53.005+0000 7f2aeb400640 1 --2- 172.21.15.114:0/4188733549 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2ad0066690 0x7f2ad0068b50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2af4156e80 tx=0x7f2adc009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:53.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:53.005+0000 7f2af0c00640 1 -- 172.21.15.114:0/4188733549 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2ae40519e0 con 0x7f2af40ae480 2024-09-13T17:51:53.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:53.161+0000 7f2afb000640 1 -- 172.21.15.114:0/4188733549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f2af406a2a0 con 0x7f2af40ae480 2024-09-13T17:51:53.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:53.821+0000 7f2af0c00640 1 -- 172.21.15.114:0/4188733549 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2ae4055000 con 0x7f2af40ae480 2024-09-13T17:51:53.825 INFO:teuthology.orchestra.run.smithi114.stderr:set pool 4 allow_ec_overwrites to true 2024-09-13T17:51:53.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:53.829+0000 7f2afb000640 1 -- 172.21.15.114:0/4188733549 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2ad0066690 msgr2=0x7f2ad0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:53.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:53.829+0000 7f2afb000640 1 --2- 172.21.15.114:0/4188733549 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2ad0066690 0x7f2ad0068b50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2af4156e80 tx=0x7f2adc009190 comp rx=0 tx=0).stop 2024-09-13T17:51:53.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:53.829+0000 7f2afb000640 1 -- 172.21.15.114:0/4188733549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2af40ae480 msgr2=0x7f2af413b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:53.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:53.829+0000 7f2afb000640 1 --2- 172.21.15.114:0/4188733549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2af40ae480 0x7f2af413b0d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2ae400cbf0 tx=0x7f2ae400a430 comp rx=0 tx=0).stop 2024-09-13T17:51:53.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:53.829+0000 7f2afb000640 1 -- 172.21.15.114:0/4188733549 shutdown_connections 2024-09-13T17:51:53.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:53.829+0000 7f2afb000640 1 --2- 172.21.15.114:0/4188733549 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2ad0066690 0x7f2ad0068b50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:53.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:53.829+0000 7f2afb000640 1 --2- 172.21.15.114:0/4188733549 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2af40cf2c0 0x7f2af413db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:53.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:53.829+0000 7f2afb000640 1 --2- 172.21.15.114:0/4188733549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2af40b2370 0x7f2af413a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:53.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:53.829+0000 7f2afb000640 1 --2- 172.21.15.114:0/4188733549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2af40ae480 0x7f2af413b0d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:53.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:53.829+0000 7f2afb000640 1 -- 172.21.15.114:0/4188733549 >> 172.21.15.114:0/4188733549 conn(0x7f2af40b0f60 msgr2=0x7f2af40b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:53.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:53.829+0000 7f2afb000640 1 -- 172.21.15.114:0/4188733549 shutdown_connections 2024-09-13T17:51:53.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:53.829+0000 7f2afb000640 1 -- 172.21.15.114:0/4188733549 wait complete. 2024-09-13T17:51:53.867 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-13T17:51:54.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.009+0000 7f22b6e00640 1 Processor -- start 2024-09-13T17:51:54.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.009+0000 7f22b6e00640 1 -- start start 2024-09-13T17:51:54.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.009+0000 7f22b6e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f22b013c240 0x7f22b013f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:54.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.009+0000 7f22b6e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22b013c980 0x7f22b006d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:54.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.009+0000 7f22b6e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b00cd220 con 0x7f22b006da90 2024-09-13T17:51:54.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.009+0000 7f22b6e00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b013f960 con 0x7f22b013c240 2024-09-13T17:51:54.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.009+0000 7f22b6e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b006ded0 con 0x7f22b013c980 2024-09-13T17:51:54.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.009+0000 7f22b4e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f22b006da90 0x7f22b00cd650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49148/0 (socket says 172.21.15.114:49148) 2024-09-13T17:51:54.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.009+0000 7f22b4e00640 1 -- 172.21.15.114:0/3500290140 learned_addr learned my addr 172.21.15.114:0/3500290140 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:51:54.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.009+0000 7f22afe00640 1 --2- 172.21.15.114:0/3500290140 >> v2:172.21.15.134:3300/0 conn(0x7f22b013c240 0x7f22b013f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:54.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.009+0000 7f22a7400640 1 --2- 172.21.15.114:0/3500290140 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22b013c980 0x7f22b006d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:54.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.009+0000 7f22af400640 1 -- 172.21.15.114:0/3500290140 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3814730770 0 0) 0x7f22b00cd220 con 0x7f22b006da90 2024-09-13T17:51:54.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.009+0000 7f22af400640 1 -- 172.21.15.114:0/3500290140 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2294003530 con 0x7f22b006da90 2024-09-13T17:51:54.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.009+0000 7f22afe00640 1 -- 172.21.15.114:0/3500290140 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22b013c980 msgr2=0x7f22b006d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:54.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.009+0000 7f22afe00640 1 --2- 172.21.15.114:0/3500290140 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22b013c980 0x7f22b006d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:54.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.009+0000 7f22afe00640 1 -- 172.21.15.114:0/3500290140 >> v1:172.21.15.114:6789/0 conn(0x7f22b006da90 legacy=0x7f22b00cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:54.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.009+0000 7f22afe00640 1 -- 172.21.15.114:0/3500290140 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b015a740 con 0x7f22b013c240 2024-09-13T17:51:54.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.013+0000 7f22afe00640 1 --2- 172.21.15.114:0/3500290140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22b013c240 0x7f22b013f420 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f22a00097c0 tx=0x7f22a001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d124bb81c0952099 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:54.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.013+0000 7f22af400640 1 -- 172.21.15.114:0/3500290140 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a00ab670 con 0x7f22b013c240 2024-09-13T17:51:54.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.013+0000 7f22af400640 1 -- 172.21.15.114:0/3500290140 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a00ab7d0 con 0x7f22b013c240 2024-09-13T17:51:54.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.013+0000 7f22af400640 1 -- 172.21.15.114:0/3500290140 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a00abb60 con 0x7f22b013c240 2024-09-13T17:51:54.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.013+0000 7f22b6e00640 1 -- 172.21.15.114:0/3500290140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22b013c240 msgr2=0x7f22b013f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:54.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.013+0000 7f22b6e00640 1 --2- 172.21.15.114:0/3500290140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22b013c240 0x7f22b013f420 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f22a00097c0 tx=0x7f22a001c470 comp rx=0 tx=0).stop 2024-09-13T17:51:54.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.013+0000 7f22b6e00640 1 -- 172.21.15.114:0/3500290140 shutdown_connections 2024-09-13T17:51:54.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.013+0000 7f22b6e00640 1 --2- 172.21.15.114:0/3500290140 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22b013c980 0x7f22b006d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:54.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.013+0000 7f22b6e00640 1 --2- 172.21.15.114:0/3500290140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22b013c240 0x7f22b013f420 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:54.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.013+0000 7f22b6e00640 1 -- 172.21.15.114:0/3500290140 >> 172.21.15.114:0/3500290140 conn(0x7f22b00660b0 msgr2=0x7f22b0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:54.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.013+0000 7f22b6e00640 1 -- 172.21.15.114:0/3500290140 shutdown_connections 2024-09-13T17:51:54.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.013+0000 7f22b6e00640 1 -- 172.21.15.114:0/3500290140 wait complete. 2024-09-13T17:51:54.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.017+0000 7f22b6e00640 1 Processor -- start 2024-09-13T17:51:54.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.017+0000 7f22b6e00640 1 -- start start 2024-09-13T17:51:54.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.017+0000 7f22b6e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22b006da90 0x7f22b0155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:54.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.017+0000 7f22b6e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22b013c240 0x7f22b00af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:54.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.017+0000 7f22b6e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22b013c980 0x7f22b00afac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:54.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.017+0000 7f22b6e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b015cdb0 con 0x7f22b013c240 2024-09-13T17:51:54.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.017+0000 7f22b6e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b00aee30 con 0x7f22b013c980 2024-09-13T17:51:54.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.017+0000 7f22b6e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b0155b70 con 0x7f22b006da90 2024-09-13T17:51:54.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.017+0000 7f22a7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22b013c240 0x7f22b00af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:54.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.017+0000 7f22a7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22b013c240 0x7f22b00af580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52748/0 (socket says 172.21.15.114:52748) 2024-09-13T17:51:54.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.017+0000 7f22a7400640 1 -- 172.21.15.114:0/3075891192 learned_addr learned my addr 172.21.15.114:0/3075891192 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:54.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.017+0000 7f22b4e00640 1 --2- 172.21.15.114:0/3075891192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22b013c980 0x7f22b00afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:54.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.017+0000 7f22afe00640 1 --2- 172.21.15.114:0/3075891192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22b006da90 0x7f22b0155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:54.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.017+0000 7f22a7400640 1 -- 172.21.15.114:0/3075891192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22b006da90 msgr2=0x7f22b0155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:54.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.017+0000 7f22a7400640 1 --2- 172.21.15.114:0/3075891192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22b006da90 0x7f22b0155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:54.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.017+0000 7f22a7400640 1 -- 172.21.15.114:0/3075891192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22b013c980 msgr2=0x7f22b00afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:54.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.017+0000 7f22a7400640 1 --2- 172.21.15.114:0/3075891192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22b013c980 0x7f22b00afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:54.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.017+0000 7f22a7400640 1 -- 172.21.15.114:0/3075891192 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a0009420 con 0x7f22b013c240 2024-09-13T17:51:54.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.017+0000 7f22a7400640 1 --2- 172.21.15.114:0/3075891192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22b013c240 0x7f22b00af580 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f229800e8a0 tx=0x7f229800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:54.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.017+0000 7f22acc00640 1 -- 172.21.15.114:0/3075891192 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2298009510 con 0x7f22b013c240 2024-09-13T17:51:54.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.017+0000 7f22acc00640 1 -- 172.21.15.114:0/3075891192 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229800c940 con 0x7f22b013c240 2024-09-13T17:51:54.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.017+0000 7f22acc00640 1 -- 172.21.15.114:0/3075891192 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229800ccb0 con 0x7f22b013c240 2024-09-13T17:51:54.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.017+0000 7f22b6e00640 1 -- 172.21.15.114:0/3075891192 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b00ae220 con 0x7f22b013c240 2024-09-13T17:51:54.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.017+0000 7f22b6e00640 1 -- 172.21.15.114:0/3075891192 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b00ae7e0 con 0x7f22b013c240 2024-09-13T17:51:54.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.021+0000 7f22b6e00640 1 -- 172.21.15.114:0/3075891192 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b00667b0 con 0x7f22b013c240 2024-09-13T17:51:54.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.021+0000 7f22acc00640 1 -- 172.21.15.114:0/3075891192 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2298013470 con 0x7f22b013c240 2024-09-13T17:51:54.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.021+0000 7f22acc00640 1 --2- 172.21.15.114:0/3075891192 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f228c0666c0 0x7f228c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:54.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.021+0000 7f22acc00640 1 -- 172.21.15.114:0/3075891192 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f2298084470 con 0x7f22b013c240 2024-09-13T17:51:54.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.021+0000 7f22afe00640 1 --2- 172.21.15.114:0/3075891192 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f228c0666c0 0x7f228c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:54.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.021+0000 7f22afe00640 1 --2- 172.21.15.114:0/3075891192 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f228c0666c0 0x7f228c068b80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f22a00af000 tx=0x7f22a00a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:54.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.025+0000 7f22acc00640 1 -- 172.21.15.114:0/3075891192 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f22980515c0 con 0x7f22b013c240 2024-09-13T17:51:54.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.209+0000 7f22b6e00640 1 -- 172.21.15.114:0/3075891192 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f22b00706b0 con 0x7f22b013c240 2024-09-13T17:51:54.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.217+0000 7f22acc00640 1 -- 172.21.15.114:0/3075891192 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f2298054be0 con 0x7f22b013c240 2024-09-13T17:51:54.217 INFO:teuthology.orchestra.run.smithi114.stderr:added data pool 4 to fsmap 2024-09-13T17:51:54.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.217+0000 7f22b6e00640 1 -- 172.21.15.114:0/3075891192 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f228c0666c0 msgr2=0x7f228c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:54.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.217+0000 7f22b6e00640 1 --2- 172.21.15.114:0/3075891192 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f228c0666c0 0x7f228c068b80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f22a00af000 tx=0x7f22a00a7000 comp rx=0 tx=0).stop 2024-09-13T17:51:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.217+0000 7f22b6e00640 1 -- 172.21.15.114:0/3075891192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22b013c240 msgr2=0x7f22b00af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.217+0000 7f22b6e00640 1 --2- 172.21.15.114:0/3075891192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22b013c240 0x7f22b00af580 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f229800e8a0 tx=0x7f229800eca0 comp rx=0 tx=0).stop 2024-09-13T17:51:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.217+0000 7f22b6e00640 1 -- 172.21.15.114:0/3075891192 shutdown_connections 2024-09-13T17:51:54.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.217+0000 7f22b6e00640 1 --2- 172.21.15.114:0/3075891192 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f228c0666c0 0x7f228c068b80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:54.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.217+0000 7f22b6e00640 1 --2- 172.21.15.114:0/3075891192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22b013c980 0x7f22b00afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:54.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.217+0000 7f22b6e00640 1 --2- 172.21.15.114:0/3075891192 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22b013c240 0x7f22b00af580 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:54.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.217+0000 7f22b6e00640 1 --2- 172.21.15.114:0/3075891192 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22b006da90 0x7f22b0155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:54.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.217+0000 7f22b6e00640 1 -- 172.21.15.114:0/3075891192 >> 172.21.15.114:0/3075891192 conn(0x7f22b00660b0 msgr2=0x7f22b006c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:54.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.217+0000 7f22b6e00640 1 -- 172.21.15.114:0/3075891192 shutdown_connections 2024-09-13T17:51:54.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.217+0000 7f22b6e00640 1 -- 172.21.15.114:0/3075891192 wait complete. 2024-09-13T17:51:54.240 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:51:54.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.373+0000 7f9e39000640 1 Processor -- start 2024-09-13T17:51:54.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.373+0000 7f9e39000640 1 -- start start 2024-09-13T17:51:54.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.377+0000 7f9e39000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9e3413c240 0x7f9e3413f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:54.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.377+0000 7f9e39000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9e3413c980 0x7f9e3406d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:54.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.377+0000 7f9e39000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e340cd220 con 0x7f9e3406da90 2024-09-13T17:51:54.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.377+0000 7f9e39000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3406df40 con 0x7f9e3413c240 2024-09-13T17:51:54.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.377+0000 7f9e39000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3413f960 con 0x7f9e3413c980 2024-09-13T17:51:54.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.377+0000 7f9e31e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9e3413c240 0x7f9e3413f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:54.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.377+0000 7f9e31e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9e3413c240 0x7f9e3413f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52764/0 (socket says 172.21.15.114:52764) 2024-09-13T17:51:54.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.377+0000 7f9e31e00640 1 -- 172.21.15.114:0/1715202825 learned_addr learned my addr 172.21.15.114:0/1715202825 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:54.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.377+0000 7f9e2be00640 1 --2- 172.21.15.114:0/1715202825 >> v2:172.21.15.134:3300/0 conn(0x7f9e3413c980 0x7f9e3406d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:54.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.377+0000 7f9e31e00640 1 -- 172.21.15.114:0/1715202825 >> v2:172.21.15.134:3300/0 conn(0x7f9e3413c980 msgr2=0x7f9e3406d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:54.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.377+0000 7f9e31e00640 1 --2- 172.21.15.114:0/1715202825 >> v2:172.21.15.134:3300/0 conn(0x7f9e3413c980 0x7f9e3406d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:54.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.377+0000 7f9e31e00640 1 -- 172.21.15.114:0/1715202825 >> v1:172.21.15.114:6789/0 conn(0x7f9e3406da90 legacy=0x7f9e340cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:54.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.377+0000 7f9e31e00640 1 -- 172.21.15.114:0/1715202825 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3415a740 con 0x7f9e3413c240 2024-09-13T17:51:54.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.377+0000 7f9e31e00640 1 --2- 172.21.15.114:0/1715202825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e3413c240 0x7f9e3413f420 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9e340ae130 tx=0x7f9e2401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ccec226c145c02 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:54.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.381+0000 7f9e31400640 1 -- 172.21.15.114:0/1715202825 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e240aa650 con 0x7f9e3413c240 2024-09-13T17:51:54.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.381+0000 7f9e31400640 1 -- 172.21.15.114:0/1715202825 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e240aa7b0 con 0x7f9e3413c240 2024-09-13T17:51:54.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.381+0000 7f9e31400640 1 -- 172.21.15.114:0/1715202825 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e240aab40 con 0x7f9e3413c240 2024-09-13T17:51:54.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.381+0000 7f9e39000640 1 -- 172.21.15.114:0/1715202825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e3413c240 msgr2=0x7f9e3413f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:54.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.381+0000 7f9e39000640 1 --2- 172.21.15.114:0/1715202825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e3413c240 0x7f9e3413f420 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9e340ae130 tx=0x7f9e2401c4f0 comp rx=0 tx=0).stop 2024-09-13T17:51:54.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.381+0000 7f9e39000640 1 -- 172.21.15.114:0/1715202825 shutdown_connections 2024-09-13T17:51:54.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.381+0000 7f9e39000640 1 --2- 172.21.15.114:0/1715202825 >> v2:172.21.15.134:3300/0 conn(0x7f9e3413c980 0x7f9e3406d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:54.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.381+0000 7f9e39000640 1 --2- 172.21.15.114:0/1715202825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e3413c240 0x7f9e3413f420 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:54.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.381+0000 7f9e39000640 1 -- 172.21.15.114:0/1715202825 >> 172.21.15.114:0/1715202825 conn(0x7f9e340660b0 msgr2=0x7f9e34069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:54.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.381+0000 7f9e39000640 1 -- 172.21.15.114:0/1715202825 shutdown_connections 2024-09-13T17:51:54.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.381+0000 7f9e39000640 1 -- 172.21.15.114:0/1715202825 wait complete. 2024-09-13T17:51:54.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.381+0000 7f9e39000640 1 Processor -- start 2024-09-13T17:51:54.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.381+0000 7f9e39000640 1 -- start start 2024-09-13T17:51:54.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.381+0000 7f9e39000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e3406da90 0x7f9e34156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:54.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.381+0000 7f9e39000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e3413c240 0x7f9e3413e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:54.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.381+0000 7f9e39000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9e3413c980 0x7f9e340b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:54.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.381+0000 7f9e39000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3413d3f0 con 0x7f9e3413c240 2024-09-13T17:51:54.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.381+0000 7f9e39000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e34139ba0 con 0x7f9e3406da90 2024-09-13T17:51:54.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.381+0000 7f9e39000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3413ce30 con 0x7f9e3413c980 2024-09-13T17:51:54.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.381+0000 7f9e2be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e3413c240 0x7f9e3413e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:54.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.381+0000 7f9e2be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e3413c240 0x7f9e3413e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52770/0 (socket says 172.21.15.114:52770) 2024-09-13T17:51:54.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.381+0000 7f9e2be00640 1 -- 172.21.15.114:0/4181451809 learned_addr learned my addr 172.21.15.114:0/4181451809 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:54.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.381+0000 7f9e31e00640 1 --2- 172.21.15.114:0/4181451809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e3406da90 0x7f9e34156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:54.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.385+0000 7f9e32800640 1 --2- 172.21.15.114:0/4181451809 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9e3413c980 0x7f9e340b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:54.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.385+0000 7f9e2be00640 1 -- 172.21.15.114:0/4181451809 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9e3413c980 msgr2=0x7f9e340b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:54.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.385+0000 7f9e2be00640 1 --2- 172.21.15.114:0/4181451809 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9e3413c980 0x7f9e340b2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:54.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.385+0000 7f9e2be00640 1 -- 172.21.15.114:0/4181451809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e3406da90 msgr2=0x7f9e34156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:54.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.385+0000 7f9e2be00640 1 --2- 172.21.15.114:0/4181451809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e3406da90 0x7f9e34156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:54.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.385+0000 7f9e2be00640 1 -- 172.21.15.114:0/4181451809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e240094d0 con 0x7f9e3413c240 2024-09-13T17:51:54.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.385+0000 7f9e31e00640 1 --2- 172.21.15.114:0/4181451809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e3406da90 0x7f9e34156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:51:54.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.385+0000 7f9e2be00640 1 --2- 172.21.15.114:0/4181451809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e3413c240 0x7f9e3413e4f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c00e870 tx=0x7f9e1c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:54.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.385+0000 7f9e2a000640 1 -- 172.21.15.114:0/4181451809 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c009510 con 0x7f9e3413c240 2024-09-13T17:51:54.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.385+0000 7f9e2a000640 1 -- 172.21.15.114:0/4181451809 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1c00eec0 con 0x7f9e3413c240 2024-09-13T17:51:54.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.385+0000 7f9e2a000640 1 -- 172.21.15.114:0/4181451809 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c00cb40 con 0x7f9e3413c240 2024-09-13T17:51:54.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.385+0000 7f9e39000640 1 -- 172.21.15.114:0/4181451809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e3413d110 con 0x7f9e3413c240 2024-09-13T17:51:54.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.385+0000 7f9e39000640 1 -- 172.21.15.114:0/4181451809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e34156730 con 0x7f9e3413c240 2024-09-13T17:51:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.385+0000 7f9e39000640 1 -- 172.21.15.114:0/4181451809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e34139ce0 con 0x7f9e3413c240 2024-09-13T17:51:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.385+0000 7f9e2a000640 1 -- 172.21.15.114:0/4181451809 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9e1c00cca0 con 0x7f9e3413c240 2024-09-13T17:51:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.385+0000 7f9e2a000640 1 --2- 172.21.15.114:0/4181451809 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9e10066690 0x7f9e10068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.389+0000 7f9e2a000640 1 -- 172.21.15.114:0/4181451809 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9e1c084620 con 0x7f9e3413c240 2024-09-13T17:51:54.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.389+0000 7f9e31e00640 1 --2- 172.21.15.114:0/4181451809 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9e10066690 0x7f9e10068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:54.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.389+0000 7f9e31e00640 1 --2- 172.21.15.114:0/4181451809 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9e10066690 0x7f9e10068b50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9e240ae000 tx=0x7f9e240a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:54.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.393+0000 7f9e2a000640 1 -- 172.21.15.114:0/4181451809 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9e34139ce0 con 0x7f9e3413c240 2024-09-13T17:51:54.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.577+0000 7f9e39000640 1 -- 172.21.15.114:0/4181451809 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e34139ce0 con 0x7f9e3413c240 2024-09-13T17:51:54.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.577+0000 7f9e2a000640 1 -- 172.21.15.114:0/4181451809 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4739 (secure 0 0 0) 0x7f9e34139ce0 con 0x7f9e3413c240 2024-09-13T17:51:54.580 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:51:54.580 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/534634081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":534634081},{"type":"v1","addr":"172.21.15.134:6835","nonce":534634081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1773366615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1773366615},{"type":"v1","addr":"172.21.15.114:6836","nonce":1773366615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4122490085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":4122490085},{"type":"v1","addr":"172.21.15.114:6837","nonce":4122490085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:51:49.789079+0000","modified":"2024-09-13T17:51:54.213650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/1863104078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1863104078},{"type":"v1","addr":"172.21.15.134:6834","nonce":1863104078}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:51:54.582 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 7 2024-09-13T17:51:54.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.581+0000 7f9e39000640 1 -- 172.21.15.114:0/4181451809 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9e10066690 msgr2=0x7f9e10068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:54.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.581+0000 7f9e39000640 1 --2- 172.21.15.114:0/4181451809 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9e10066690 0x7f9e10068b50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9e240ae000 tx=0x7f9e240a7000 comp rx=0 tx=0).stop 2024-09-13T17:51:54.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.581+0000 7f9e39000640 1 -- 172.21.15.114:0/4181451809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e3413c240 msgr2=0x7f9e3413e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:54.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.581+0000 7f9e39000640 1 --2- 172.21.15.114:0/4181451809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e3413c240 0x7f9e3413e4f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c00e870 tx=0x7f9e1c00ec70 comp rx=0 tx=0).stop 2024-09-13T17:51:54.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.581+0000 7f9e39000640 1 -- 172.21.15.114:0/4181451809 shutdown_connections 2024-09-13T17:51:54.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.581+0000 7f9e39000640 1 --2- 172.21.15.114:0/4181451809 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9e10066690 0x7f9e10068b50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:54.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.581+0000 7f9e39000640 1 --2- 172.21.15.114:0/4181451809 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9e3413c980 0x7f9e340b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:54.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.581+0000 7f9e39000640 1 --2- 172.21.15.114:0/4181451809 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e3413c240 0x7f9e3413e4f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:54.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.581+0000 7f9e39000640 1 --2- 172.21.15.114:0/4181451809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e3406da90 0x7f9e34156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:54.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.581+0000 7f9e39000640 1 -- 172.21.15.114:0/4181451809 >> 172.21.15.114:0/4181451809 conn(0x7f9e340660b0 msgr2=0x7f9e3406cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:54.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.581+0000 7f9e39000640 1 -- 172.21.15.114:0/4181451809 shutdown_connections 2024-09-13T17:51:54.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.581+0000 7f9e39000640 1 -- 172.21.15.114:0/4181451809 wait complete. 2024-09-13T17:51:54.598 INFO:tasks.ceph.mds.d.smithi134.stderr:2024-09-13T17:51:54.593+0000 7f00c4800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:51:54.603 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:51:54.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.737+0000 7f7194a00640 1 Processor -- start 2024-09-13T17:51:54.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.737+0000 7f7194a00640 1 -- start start 2024-09-13T17:51:54.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.737+0000 7f7194a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f719006f690 0x7f7190167610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:54.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.737+0000 7f7194a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71900cebe0 con 0x7f71900ce650 2024-09-13T17:51:54.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.737+0000 7f7194a00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71900ceec0 con 0x7f71901602e0 2024-09-13T17:51:54.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.737+0000 7f7194a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71900cf1a0 con 0x7f719006f690 2024-09-13T17:51:54.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.737+0000 7f718e800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f719006f690 0x7f7190167610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:54.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.737+0000 7f718e800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f719006f690 0x7f7190167610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52772/0 (socket says 172.21.15.114:52772) 2024-09-13T17:51:54.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.737+0000 7f718e800640 1 -- 172.21.15.114:0/764520563 learned_addr learned my addr 172.21.15.114:0/764520563 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:54.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.737+0000 7f718e800640 1 -- 172.21.15.114:0/764520563 >> v1:172.21.15.134:6789/0 conn(0x7f71901602e0 legacy=0x7f71901606c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:54.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.737+0000 7f718e800640 1 -- 172.21.15.114:0/764520563 >> v1:172.21.15.114:6789/0 conn(0x7f71900ce650 legacy=0x7f7190099480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:54.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.737+0000 7f718e800640 1 -- 172.21.15.114:0/764520563 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71900cf480 con 0x7f719006f690 2024-09-13T17:51:54.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.741+0000 7f718e800640 1 --2- 172.21.15.114:0/764520563 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f719006f690 0x7f7190167610 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7188009e50 tx=0x7f718801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367e8be4022ad71a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:54.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.741+0000 7f718ca00640 1 -- 172.21.15.114:0/764520563 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71880a5840 con 0x7f719006f690 2024-09-13T17:51:54.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.741+0000 7f718ca00640 1 -- 172.21.15.114:0/764520563 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71880a59a0 con 0x7f719006f690 2024-09-13T17:51:54.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.741+0000 7f718ca00640 1 -- 172.21.15.114:0/764520563 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71880a5d30 con 0x7f719006f690 2024-09-13T17:51:54.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.741+0000 7f7194a00640 1 -- 172.21.15.114:0/764520563 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f719006f690 msgr2=0x7f7190167610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:54.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.741+0000 7f7194a00640 1 --2- 172.21.15.114:0/764520563 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f719006f690 0x7f7190167610 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7188009e50 tx=0x7f718801c960 comp rx=0 tx=0).stop 2024-09-13T17:51:54.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.741+0000 7f7194a00640 1 -- 172.21.15.114:0/764520563 shutdown_connections 2024-09-13T17:51:54.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.741+0000 7f7194a00640 1 --2- 172.21.15.114:0/764520563 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f719006f690 0x7f7190167610 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:54.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.741+0000 7f7194a00640 1 -- 172.21.15.114:0/764520563 >> 172.21.15.114:0/764520563 conn(0x7f71900d04e0 msgr2=0x7f71900d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:54.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.741+0000 7f7194a00640 1 -- 172.21.15.114:0/764520563 shutdown_connections 2024-09-13T17:51:54.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.741+0000 7f7194a00640 1 -- 172.21.15.114:0/764520563 wait complete. 2024-09-13T17:51:54.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.741+0000 7f7194a00640 1 Processor -- start 2024-09-13T17:51:54.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.741+0000 7f7194a00640 1 -- start start 2024-09-13T17:51:54.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.745+0000 7f7194a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f719006f690 0x7f7190158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:54.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.745+0000 7f7194a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71900ce650 0x7f7190156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:54.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.745+0000 7f7194a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71901602e0 0x7f7190152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:54.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.745+0000 7f7194a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7190156fd0 con 0x7f719006f690 2024-09-13T17:51:54.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.745+0000 7f7194a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7190157200 con 0x7f71901602e0 2024-09-13T17:51:54.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.745+0000 7f7194a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71901574e0 con 0x7f71900ce650 2024-09-13T17:51:54.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.745+0000 7f718de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f719006f690 0x7f7190158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:54.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.745+0000 7f718de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f719006f690 0x7f7190158880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52782/0 (socket says 172.21.15.114:52782) 2024-09-13T17:51:54.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.745+0000 7f718de00640 1 -- 172.21.15.114:0/1614625723 learned_addr learned my addr 172.21.15.114:0/1614625723 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:54.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.745+0000 7f718e800640 1 --2- 172.21.15.114:0/1614625723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71901602e0 0x7f7190152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:54.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.745+0000 7f718d400640 1 --2- 172.21.15.114:0/1614625723 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71900ce650 0x7f7190156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:54.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.745+0000 7f718de00640 1 -- 172.21.15.114:0/1614625723 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71900ce650 msgr2=0x7f7190156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:54.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.745+0000 7f718de00640 1 --2- 172.21.15.114:0/1614625723 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71900ce650 0x7f7190156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:54.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.745+0000 7f718de00640 1 -- 172.21.15.114:0/1614625723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71901602e0 msgr2=0x7f7190152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:54.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.745+0000 7f718de00640 1 --2- 172.21.15.114:0/1614625723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71901602e0 0x7f7190152400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:54.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.745+0000 7f718de00640 1 -- 172.21.15.114:0/1614625723 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7188009b30 con 0x7f719006f690 2024-09-13T17:51:54.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.745+0000 7f718e800640 1 --2- 172.21.15.114:0/1614625723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71901602e0 0x7f7190152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:51:54.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.745+0000 7f718d400640 1 --2- 172.21.15.114:0/1614625723 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71900ce650 0x7f7190156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:51:54.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.745+0000 7f718de00640 1 --2- 172.21.15.114:0/1614625723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f719006f690 0x7f7190158880 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f718000c490 tx=0x7f7180001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:54.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.745+0000 7f7186000640 1 -- 172.21.15.114:0/1614625723 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7180003600 con 0x7f719006f690 2024-09-13T17:51:54.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.745+0000 7f7186000640 1 -- 172.21.15.114:0/1614625723 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7180003780 con 0x7f719006f690 2024-09-13T17:51:54.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.745+0000 7f7194a00640 1 -- 172.21.15.114:0/1614625723 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71901577c0 con 0x7f719006f690 2024-09-13T17:51:54.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.745+0000 7f7186000640 1 -- 172.21.15.114:0/1614625723 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7180003b70 con 0x7f719006f690 2024-09-13T17:51:54.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.745+0000 7f7194a00640 1 -- 172.21.15.114:0/1614625723 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7190157d80 con 0x7f719006f690 2024-09-13T17:51:54.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.745+0000 7f7194a00640 1 -- 172.21.15.114:0/1614625723 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7190157f70 con 0x7f719006f690 2024-09-13T17:51:54.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.745+0000 7f7186000640 1 -- 172.21.15.114:0/1614625723 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7180003cd0 con 0x7f719006f690 2024-09-13T17:51:54.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.749+0000 7f7186000640 1 --2- 172.21.15.114:0/1614625723 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f71700666c0 0x7f7170068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:54.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.749+0000 7f7186000640 1 -- 172.21.15.114:0/1614625723 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7180083bd0 con 0x7f719006f690 2024-09-13T17:51:54.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.749+0000 7f718d400640 1 --2- 172.21.15.114:0/1614625723 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f71700666c0 0x7f7170068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:54.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.749+0000 7f718d400640 1 --2- 172.21.15.114:0/1614625723 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f71700666c0 0x7f7170068b80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f71901f90c0 tx=0x7f717c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:54.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.753+0000 7f7186000640 1 -- 172.21.15.114:0/1614625723 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7180050b20 con 0x7f719006f690 2024-09-13T17:51:54.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.913+0000 7f7194a00640 1 -- 172.21.15.114:0/1614625723 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71900d1380 con 0x7f719006f690 2024-09-13T17:51:54.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.913+0000 7f7186000640 1 -- 172.21.15.114:0/1614625723 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18394 (secure 0 0 0) 0x7f7180017030 con 0x7f719006f690 2024-09-13T17:51:54.915 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:51:54.915 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:51:54.213439+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:51:48.278220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:51:48.773888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:51:51.856300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:51:54.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.913+0000 7f7194a00640 1 -- 172.21.15.114:0/1614625723 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f71700666c0 msgr2=0x7f7170068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:54.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.913+0000 7f7194a00640 1 --2- 172.21.15.114:0/1614625723 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f71700666c0 0x7f7170068b80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f71901f90c0 tx=0x7f717c009040 comp rx=0 tx=0).stop 2024-09-13T17:51:54.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.913+0000 7f7194a00640 1 -- 172.21.15.114:0/1614625723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f719006f690 msgr2=0x7f7190158880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:54.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.913+0000 7f7194a00640 1 --2- 172.21.15.114:0/1614625723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f719006f690 0x7f7190158880 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f718000c490 tx=0x7f7180001e80 comp rx=0 tx=0).stop 2024-09-13T17:51:54.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.913+0000 7f7194a00640 1 -- 172.21.15.114:0/1614625723 shutdown_connections 2024-09-13T17:51:54.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.913+0000 7f7194a00640 1 --2- 172.21.15.114:0/1614625723 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f71700666c0 0x7f7170068b80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:54.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.913+0000 7f7194a00640 1 --2- 172.21.15.114:0/1614625723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71901602e0 0x7f7190152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:54.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.913+0000 7f7194a00640 1 --2- 172.21.15.114:0/1614625723 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71900ce650 0x7f7190156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:54.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.913+0000 7f7194a00640 1 --2- 172.21.15.114:0/1614625723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f719006f690 0x7f7190158880 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:54.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.913+0000 7f7194a00640 1 -- 172.21.15.114:0/1614625723 >> 172.21.15.114:0/1614625723 conn(0x7f71900d04e0 msgr2=0x7f71900b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:54.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.917+0000 7f7194a00640 1 -- 172.21.15.114:0/1614625723 shutdown_connections 2024-09-13T17:51:54.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:54.917+0000 7f7194a00640 1 -- 172.21.15.114:0/1614625723 wait complete. 2024-09-13T17:51:54.936 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:51:55.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.069+0000 7effd4800640 1 Processor -- start 2024-09-13T17:51:55.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.069+0000 7effd4800640 1 -- start start 2024-09-13T17:51:55.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.069+0000 7effd4800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7effcc13c240 0x7effcc13f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:55.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.069+0000 7effd4800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7effcc06dc60 0x7effcc0cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:55.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.069+0000 7effd4800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effcc0cd220 con 0x7effcc13c980 2024-09-13T17:51:55.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.069+0000 7effd4800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effcc13f960 con 0x7effcc06dc60 2024-09-13T17:51:55.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.069+0000 7effd4800640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effcc15a740 con 0x7effcc13c240 2024-09-13T17:51:55.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.069+0000 7effd2800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7effcc06dc60 0x7effcc0cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:55.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.069+0000 7effd2800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7effcc06dc60 0x7effcc0cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52784/0 (socket says 172.21.15.114:52784) 2024-09-13T17:51:55.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.069+0000 7effd2800640 1 -- 172.21.15.114:0/2539244620 learned_addr learned my addr 172.21.15.114:0/2539244620 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:55.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.069+0000 7effd1e00640 1 --2- 172.21.15.114:0/2539244620 >> v2:172.21.15.134:3300/0 conn(0x7effcc13c240 0x7effcc13f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:55.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.073+0000 7effd2800640 1 -- 172.21.15.114:0/2539244620 >> v2:172.21.15.134:3300/0 conn(0x7effcc13c240 msgr2=0x7effcc13f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:55.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.073+0000 7effd2800640 1 --2- 172.21.15.114:0/2539244620 >> v2:172.21.15.134:3300/0 conn(0x7effcc13c240 0x7effcc13f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.073+0000 7effd2800640 1 -- 172.21.15.114:0/2539244620 >> v1:172.21.15.114:6789/0 conn(0x7effcc13c980 legacy=0x7effcc06d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:55.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.073+0000 7effd2800640 1 -- 172.21.15.114:0/2539244620 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effcc159bc0 con 0x7effcc06dc60 2024-09-13T17:51:55.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.073+0000 7effd2800640 1 --2- 172.21.15.114:0/2539244620 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effcc06dc60 0x7effcc0cd650 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7effcc06e720 tx=0x7effc801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1626f74a595e7c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:55.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.073+0000 7effd0a00640 1 -- 172.21.15.114:0/2539244620 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc80a57f0 con 0x7effcc06dc60 2024-09-13T17:51:55.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.073+0000 7effd0a00640 1 -- 172.21.15.114:0/2539244620 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc80a5950 con 0x7effcc06dc60 2024-09-13T17:51:55.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.073+0000 7effd0a00640 1 -- 172.21.15.114:0/2539244620 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc80a5ce0 con 0x7effcc06dc60 2024-09-13T17:51:55.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.073+0000 7effd4800640 1 -- 172.21.15.114:0/2539244620 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effcc06dc60 msgr2=0x7effcc0cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:55.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.073+0000 7effd4800640 1 --2- 172.21.15.114:0/2539244620 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effcc06dc60 0x7effcc0cd650 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7effcc06e720 tx=0x7effc801c930 comp rx=0 tx=0).stop 2024-09-13T17:51:55.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.073+0000 7effd4800640 1 -- 172.21.15.114:0/2539244620 shutdown_connections 2024-09-13T17:51:55.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.073+0000 7effd4800640 1 --2- 172.21.15.114:0/2539244620 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effcc06dc60 0x7effcc0cd650 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.073+0000 7effd4800640 1 --2- 172.21.15.114:0/2539244620 >> v2:172.21.15.134:3300/0 conn(0x7effcc13c240 0x7effcc13f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.073+0000 7effd4800640 1 -- 172.21.15.114:0/2539244620 >> 172.21.15.114:0/2539244620 conn(0x7effcc0660b0 msgr2=0x7effcc069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:55.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.073+0000 7effd4800640 1 -- 172.21.15.114:0/2539244620 shutdown_connections 2024-09-13T17:51:55.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.073+0000 7effd4800640 1 -- 172.21.15.114:0/2539244620 wait complete. 2024-09-13T17:51:55.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.077+0000 7effd4800640 1 Processor -- start 2024-09-13T17:51:55.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.077+0000 7effd4800640 1 -- start start 2024-09-13T17:51:55.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.077+0000 7effd4800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effcc06dc60 0x7effcc156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:55.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.077+0000 7effd4800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7effcc13c240 0x7effcc151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:55.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.077+0000 7effd4800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7effcc13c980 0x7effcc1376f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:55.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.077+0000 7effd4800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effcc1516f0 con 0x7effcc06dc60 2024-09-13T17:51:55.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.077+0000 7effd4800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effcc151070 con 0x7effcc13c980 2024-09-13T17:51:55.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.077+0000 7effd4800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effcc0a7670 con 0x7effcc13c240 2024-09-13T17:51:55.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.077+0000 7effd1e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effcc06dc60 0x7effcc156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:55.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.077+0000 7effd1e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effcc06dc60 0x7effcc156b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52796/0 (socket says 172.21.15.114:52796) 2024-09-13T17:51:55.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.077+0000 7effd1e00640 1 -- 172.21.15.114:0/4065239988 learned_addr learned my addr 172.21.15.114:0/4065239988 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:55.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.077+0000 7effd1400640 1 --2- 172.21.15.114:0/4065239988 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7effcc13c240 0x7effcc151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:55.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.077+0000 7effd2800640 1 --2- 172.21.15.114:0/4065239988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7effcc13c980 0x7effcc1376f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:55.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.077+0000 7effd1e00640 1 -- 172.21.15.114:0/4065239988 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7effcc13c240 msgr2=0x7effcc151b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:55.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.077+0000 7effd1e00640 1 --2- 172.21.15.114:0/4065239988 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7effcc13c240 0x7effcc151b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.077+0000 7effd1e00640 1 -- 172.21.15.114:0/4065239988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7effcc13c980 msgr2=0x7effcc1376f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:55.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.077+0000 7effd1e00640 1 --2- 172.21.15.114:0/4065239988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7effcc13c980 0x7effcc1376f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.077+0000 7effd1e00640 1 -- 172.21.15.114:0/4065239988 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc8009b30 con 0x7effcc06dc60 2024-09-13T17:51:55.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.077+0000 7effd2800640 1 --2- 172.21.15.114:0/4065239988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7effcc13c980 0x7effcc1376f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:51:55.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.077+0000 7effd1e00640 1 --2- 172.21.15.114:0/4065239988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effcc06dc60 0x7effcc156b90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7effc000e930 tx=0x7effc000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:55.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.077+0000 7effc6000640 1 -- 172.21.15.114:0/4065239988 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc0009690 con 0x7effcc06dc60 2024-09-13T17:51:55.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.077+0000 7effd4800640 1 -- 172.21.15.114:0/4065239988 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effcc151310 con 0x7effcc06dc60 2024-09-13T17:51:55.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.077+0000 7effc6000640 1 -- 172.21.15.114:0/4065239988 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc000ca00 con 0x7effcc06dc60 2024-09-13T17:51:55.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.077+0000 7effc6000640 1 -- 172.21.15.114:0/4065239988 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc000cd70 con 0x7effcc06dc60 2024-09-13T17:51:55.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.077+0000 7effd4800640 1 -- 172.21.15.114:0/4065239988 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effcc152050 con 0x7effcc06dc60 2024-09-13T17:51:55.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.081+0000 7effd4800640 1 -- 172.21.15.114:0/4065239988 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effcc159790 con 0x7effcc06dc60 2024-09-13T17:51:55.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.081+0000 7effc6000640 1 -- 172.21.15.114:0/4065239988 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7effc0013470 con 0x7effcc06dc60 2024-09-13T17:51:55.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.081+0000 7effc6000640 1 --2- 172.21.15.114:0/4065239988 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7effb0066690 0x7effb0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:55.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.081+0000 7effc6000640 1 -- 172.21.15.114:0/4065239988 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7effc0084a70 con 0x7effcc06dc60 2024-09-13T17:51:55.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.081+0000 7effd1400640 1 --2- 172.21.15.114:0/4065239988 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7effb0066690 0x7effb0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:55.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.081+0000 7effd1400640 1 --2- 172.21.15.114:0/4065239988 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7effb0066690 0x7effb0068b50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7effbc000f70 tx=0x7effbc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:55.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.085+0000 7effc6000640 1 -- 172.21.15.114:0/4065239988 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7effc0051ba0 con 0x7effcc06dc60 2024-09-13T17:51:55.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.241+0000 7effd4800640 1 -- 172.21.15.114:0/4065239988 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7effcc152330 con 0x7effcc06dc60 2024-09-13T17:51:55.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.245+0000 7effc6000640 1 -- 172.21.15.114:0/4065239988 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18394 (secure 0 0 0) 0x7effc0017090 con 0x7effcc06dc60 2024-09-13T17:51:55.246 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:51:55.246 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:51:54.213439+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:51:48.278220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:51:48.773888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:51:51.856300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:51:55.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.245+0000 7effd4800640 1 -- 172.21.15.114:0/4065239988 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7effb0066690 msgr2=0x7effb0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:55.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.245+0000 7effd4800640 1 --2- 172.21.15.114:0/4065239988 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7effb0066690 0x7effb0068b50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7effbc000f70 tx=0x7effbc009040 comp rx=0 tx=0).stop 2024-09-13T17:51:55.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.245+0000 7effd4800640 1 -- 172.21.15.114:0/4065239988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effcc06dc60 msgr2=0x7effcc156b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:55.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.245+0000 7effd4800640 1 --2- 172.21.15.114:0/4065239988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effcc06dc60 0x7effcc156b90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7effc000e930 tx=0x7effc000edf0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.245+0000 7effd4800640 1 -- 172.21.15.114:0/4065239988 shutdown_connections 2024-09-13T17:51:55.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.245+0000 7effd4800640 1 --2- 172.21.15.114:0/4065239988 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7effb0066690 0x7effb0068b50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.245+0000 7effd4800640 1 --2- 172.21.15.114:0/4065239988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7effcc13c980 0x7effcc1376f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.245+0000 7effd4800640 1 --2- 172.21.15.114:0/4065239988 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7effcc13c240 0x7effcc151b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.245+0000 7effd4800640 1 --2- 172.21.15.114:0/4065239988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effcc06dc60 0x7effcc156b90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.245+0000 7effd4800640 1 -- 172.21.15.114:0/4065239988 >> 172.21.15.114:0/4065239988 conn(0x7effcc0660b0 msgr2=0x7effcc1577c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:55.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.245+0000 7effd4800640 1 -- 172.21.15.114:0/4065239988 shutdown_connections 2024-09-13T17:51:55.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.245+0000 7effd4800640 1 -- 172.21.15.114:0/4065239988 wait complete. 2024-09-13T17:51:55.284 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:51:55.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.417+0000 7fba89c00640 1 Processor -- start 2024-09-13T17:51:55.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.417+0000 7fba89c00640 1 -- start start 2024-09-13T17:51:55.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.417+0000 7fba89c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba8415a650 0x7fba84099480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:55.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.417+0000 7fba89c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fba8415e7c0 0x7fba840cb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:55.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.417+0000 7fba89c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba840ce540 con 0x7fba840ce0b0 2024-09-13T17:51:55.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.417+0000 7fba89c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba8415ba40 con 0x7fba8415e7c0 2024-09-13T17:51:55.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.417+0000 7fba89c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba840ce820 con 0x7fba8415a650 2024-09-13T17:51:55.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.417+0000 7fba83400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fba8415e7c0 0x7fba840cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:55.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.417+0000 7fba83400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fba8415e7c0 0x7fba840cb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52812/0 (socket says 172.21.15.114:52812) 2024-09-13T17:51:55.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.417+0000 7fba83400640 1 -- 172.21.15.114:0/1971100712 learned_addr learned my addr 172.21.15.114:0/1971100712 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:55.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.417+0000 7fba82a00640 1 --2- 172.21.15.114:0/1971100712 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba8415a650 0x7fba84099480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:55.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.417+0000 7fba83400640 1 -- 172.21.15.114:0/1971100712 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba8415a650 msgr2=0x7fba84099480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:55.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.417+0000 7fba83400640 1 --2- 172.21.15.114:0/1971100712 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba8415a650 0x7fba84099480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.417+0000 7fba83400640 1 -- 172.21.15.114:0/1971100712 >> v1:172.21.15.114:6789/0 conn(0x7fba840ce0b0 legacy=0x7fba8415e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:55.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.417+0000 7fba83400640 1 -- 172.21.15.114:0/1971100712 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba840ceb00 con 0x7fba8415e7c0 2024-09-13T17:51:55.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.417+0000 7fba82a00640 1 --2- 172.21.15.114:0/1971100712 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba8415a650 0x7fba84099480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:51:55.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.421+0000 7fba83400640 1 --2- 172.21.15.114:0/1971100712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba8415e7c0 0x7fba840cb180 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fba7c009870 tx=0x7fba7c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2a03ba2e11593b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:55.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.421+0000 7fba81600640 1 -- 172.21.15.114:0/1971100712 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0a95f0 con 0x7fba8415e7c0 2024-09-13T17:51:55.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.421+0000 7fba81600640 1 -- 172.21.15.114:0/1971100712 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7c0a9750 con 0x7fba8415e7c0 2024-09-13T17:51:55.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.421+0000 7fba81600640 1 -- 172.21.15.114:0/1971100712 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0a9ae0 con 0x7fba8415e7c0 2024-09-13T17:51:55.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.421+0000 7fba89c00640 1 -- 172.21.15.114:0/1971100712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba8415e7c0 msgr2=0x7fba840cb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:55.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.421+0000 7fba89c00640 1 --2- 172.21.15.114:0/1971100712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba8415e7c0 0x7fba840cb180 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fba7c009870 tx=0x7fba7c01c530 comp rx=0 tx=0).stop 2024-09-13T17:51:55.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.421+0000 7fba89c00640 1 -- 172.21.15.114:0/1971100712 shutdown_connections 2024-09-13T17:51:55.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.421+0000 7fba89c00640 1 --2- 172.21.15.114:0/1971100712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba8415e7c0 0x7fba840cb180 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.421+0000 7fba89c00640 1 --2- 172.21.15.114:0/1971100712 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba8415a650 0x7fba84099480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.421+0000 7fba89c00640 1 -- 172.21.15.114:0/1971100712 >> 172.21.15.114:0/1971100712 conn(0x7fba840d04e0 msgr2=0x7fba840d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:55.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.421+0000 7fba89c00640 1 -- 172.21.15.114:0/1971100712 shutdown_connections 2024-09-13T17:51:55.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.421+0000 7fba89c00640 1 -- 172.21.15.114:0/1971100712 wait complete. 2024-09-13T17:51:55.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.425+0000 7fba89c00640 1 Processor -- start 2024-09-13T17:51:55.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.425+0000 7fba89c00640 1 -- start start 2024-09-13T17:51:55.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.425+0000 7fba89c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba8415a650 0x7fba8415da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:55.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.425+0000 7fba89c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba8415e7c0 0x7fba841590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:55.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.425+0000 7fba89c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba841599e0 0x7fba840c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:55.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.425+0000 7fba89c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8415d580 con 0x7fba8415e7c0 2024-09-13T17:51:55.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.425+0000 7fba89c00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8415c970 con 0x7fba841599e0 2024-09-13T17:51:55.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.425+0000 7fba89c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8415cc50 con 0x7fba8415a650 2024-09-13T17:51:55.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.425+0000 7fba82000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba8415e7c0 0x7fba841590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:55.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.425+0000 7fba82000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba8415e7c0 0x7fba841590d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52826/0 (socket says 172.21.15.114:52826) 2024-09-13T17:51:55.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.425+0000 7fba82000640 1 -- 172.21.15.114:0/77282504 learned_addr learned my addr 172.21.15.114:0/77282504 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:55.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.425+0000 7fba83400640 1 --2- 172.21.15.114:0/77282504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba841599e0 0x7fba840c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:55.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.425+0000 7fba82a00640 1 --2- 172.21.15.114:0/77282504 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba8415a650 0x7fba8415da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:55.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.425+0000 7fba82000640 1 -- 172.21.15.114:0/77282504 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba8415a650 msgr2=0x7fba8415da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:55.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.425+0000 7fba82000640 1 --2- 172.21.15.114:0/77282504 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba8415a650 0x7fba8415da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.425+0000 7fba82000640 1 -- 172.21.15.114:0/77282504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba841599e0 msgr2=0x7fba840c4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:55.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.425+0000 7fba82000640 1 --2- 172.21.15.114:0/77282504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba841599e0 0x7fba840c4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.425+0000 7fba82000640 1 -- 172.21.15.114:0/77282504 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c0094d0 con 0x7fba8415e7c0 2024-09-13T17:51:55.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.425+0000 7fba82a00640 1 --2- 172.21.15.114:0/77282504 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba8415a650 0x7fba8415da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:51:55.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.425+0000 7fba82000640 1 --2- 172.21.15.114:0/77282504 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba8415e7c0 0x7fba841590d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fba7000c4d0 tx=0x7fba7000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:55.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.425+0000 7fba7aa00640 1 -- 172.21.15.114:0/77282504 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba700052d0 con 0x7fba8415e7c0 2024-09-13T17:51:55.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.425+0000 7fba7aa00640 1 -- 172.21.15.114:0/77282504 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba70005430 con 0x7fba8415e7c0 2024-09-13T17:51:55.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.425+0000 7fba89c00640 1 -- 172.21.15.114:0/77282504 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8415cf30 con 0x7fba8415e7c0 2024-09-13T17:51:55.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.425+0000 7fba7aa00640 1 -- 172.21.15.114:0/77282504 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba70012830 con 0x7fba8415e7c0 2024-09-13T17:51:55.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.425+0000 7fba89c00640 1 -- 172.21.15.114:0/77282504 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba8415c590 con 0x7fba8415e7c0 2024-09-13T17:51:55.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.425+0000 7fba89c00640 1 -- 172.21.15.114:0/77282504 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba8415d6f0 con 0x7fba8415e7c0 2024-09-13T17:51:55.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.429+0000 7fba7aa00640 1 -- 172.21.15.114:0/77282504 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fba70012990 con 0x7fba8415e7c0 2024-09-13T17:51:55.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.429+0000 7fba7aa00640 1 --2- 172.21.15.114:0/77282504 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fba64066690 0x7fba64068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:55.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.429+0000 7fba7aa00640 1 -- 172.21.15.114:0/77282504 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fba70083ef0 con 0x7fba8415e7c0 2024-09-13T17:51:55.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.429+0000 7fba82a00640 1 --2- 172.21.15.114:0/77282504 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fba64066690 0x7fba64068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:55.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.429+0000 7fba82a00640 1 --2- 172.21.15.114:0/77282504 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fba64066690 0x7fba64068b50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fba7400e550 tx=0x7fba74007ab0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:55.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.433+0000 7fba7aa00640 1 -- 172.21.15.114:0/77282504 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fba70050f60 con 0x7fba8415e7c0 2024-09-13T17:51:55.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.617+0000 7fba89c00640 1 -- 172.21.15.114:0/77282504 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba84099480 con 0x7fba8415e7c0 2024-09-13T17:51:55.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.617+0000 7fba7aa00640 1 -- 172.21.15.114:0/77282504 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4739 (secure 0 0 0) 0x7fba70054580 con 0x7fba8415e7c0 2024-09-13T17:51:55.620 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:51:55.620 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/534634081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":534634081},{"type":"v1","addr":"172.21.15.134:6835","nonce":534634081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1773366615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1773366615},{"type":"v1","addr":"172.21.15.114:6836","nonce":1773366615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4122490085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":4122490085},{"type":"v1","addr":"172.21.15.114:6837","nonce":4122490085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:51:49.789079+0000","modified":"2024-09-13T17:51:54.213650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/1863104078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1863104078},{"type":"v1","addr":"172.21.15.134:6834","nonce":1863104078}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T17:51:55.620 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 7 2024-09-13T17:51:55.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.621+0000 7fba89c00640 1 -- 172.21.15.114:0/77282504 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fba64066690 msgr2=0x7fba64068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:55.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.621+0000 7fba89c00640 1 --2- 172.21.15.114:0/77282504 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fba64066690 0x7fba64068b50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fba7400e550 tx=0x7fba74007ab0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.621+0000 7fba89c00640 1 -- 172.21.15.114:0/77282504 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba8415e7c0 msgr2=0x7fba841590d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:55.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.621+0000 7fba89c00640 1 --2- 172.21.15.114:0/77282504 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba8415e7c0 0x7fba841590d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fba7000c4d0 tx=0x7fba7000c990 comp rx=0 tx=0).stop 2024-09-13T17:51:55.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.621+0000 7fba89c00640 1 -- 172.21.15.114:0/77282504 shutdown_connections 2024-09-13T17:51:55.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.621+0000 7fba89c00640 1 --2- 172.21.15.114:0/77282504 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fba64066690 0x7fba64068b50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.621+0000 7fba89c00640 1 --2- 172.21.15.114:0/77282504 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba841599e0 0x7fba840c4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.621+0000 7fba89c00640 1 --2- 172.21.15.114:0/77282504 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba8415e7c0 0x7fba841590d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.621+0000 7fba89c00640 1 --2- 172.21.15.114:0/77282504 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba8415a650 0x7fba8415da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.621+0000 7fba89c00640 1 -- 172.21.15.114:0/77282504 >> 172.21.15.114:0/77282504 conn(0x7fba840d04e0 msgr2=0x7fba840b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:55.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.621+0000 7fba89c00640 1 -- 172.21.15.114:0/77282504 shutdown_connections 2024-09-13T17:51:55.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.621+0000 7fba89c00640 1 -- 172.21.15.114:0/77282504 wait complete. 2024-09-13T17:51:55.641 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:51:55.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.773+0000 7fe3a3e00640 1 Processor -- start 2024-09-13T17:51:55.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.773+0000 7fe3a3e00640 1 -- start start 2024-09-13T17:51:55.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe3a3e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe39c158a70 0x7fe39c070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:55.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe3a3e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe39c0b2490 con 0x7fe39c159be0 2024-09-13T17:51:55.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe3a3e00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe39c158e50 con 0x7fe39c0b1c20 2024-09-13T17:51:55.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe3a3e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c0b21b0 con 0x7fe39c158a70 2024-09-13T17:51:55.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe3a0a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe39c159be0 0x7fe39c0b1510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49190/0 (socket says 172.21.15.114:49190) 2024-09-13T17:51:55.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe3a0a00640 1 -- 172.21.15.114:0/3384060998 learned_addr learned my addr 172.21.15.114:0/3384060998 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:51:55.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe3a1400640 1 --2- 172.21.15.114:0/3384060998 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe39c158a70 0x7fe39c070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:55.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe39be00640 1 -- 172.21.15.114:0/3384060998 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3453537955 0 0) 0x7fe39c0b2490 con 0x7fe39c159be0 2024-09-13T17:51:55.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe39be00640 1 -- 172.21.15.114:0/3384060998 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe384003530 con 0x7fe39c159be0 2024-09-13T17:51:55.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe39be00640 1 -- 172.21.15.114:0/3384060998 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4157370112 0 0) 0x7fe384003530 con 0x7fe39c159be0 2024-09-13T17:51:55.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe39be00640 1 -- 172.21.15.114:0/3384060998 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe39c158a70 msgr2=0x7fe39c070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:55.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe39be00640 1 --2- 172.21.15.114:0/3384060998 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe39c158a70 0x7fe39c070cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe39be00640 1 -- 172.21.15.114:0/3384060998 >> v1:172.21.15.134:6789/0 conn(0x7fe39c0b1c20 legacy=0x7fe39c0cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:55.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe39be00640 1 -- 172.21.15.114:0/3384060998 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c159100 con 0x7fe39c159be0 2024-09-13T17:51:55.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe39be00640 1 -- 172.21.15.114:0/3384060998 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7fe388001680 con 0x7fe39c159be0 2024-09-13T17:51:55.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe39be00640 1 -- 172.21.15.114:0/3384060998 >> v1:172.21.15.114:6789/0 conn(0x7fe39c159be0 legacy=0x7fe39c0b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:55.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe39be00640 1 --2- 172.21.15.114:0/3384060998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3840039b0 0x7fe384003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:55.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe39be00640 1 --2- 172.21.15.114:0/3384060998 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe39c158a70 0x7fe3840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:55.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe39be00640 1 --2- 172.21.15.114:0/3384060998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe384004d10 0x7fe384005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:55.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe39be00640 1 -- 172.21.15.114:0/3384060998 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c0b21b0 con 0x7fe3840039b0 2024-09-13T17:51:55.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe39be00640 1 -- 172.21.15.114:0/3384060998 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38400ba40 con 0x7fe384004d10 2024-09-13T17:51:55.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe39be00640 1 -- 172.21.15.114:0/3384060998 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe38400de10 con 0x7fe39c158a70 2024-09-13T17:51:55.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe3a1400640 1 --2- 172.21.15.114:0/3384060998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3840039b0 0x7fe384003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:55.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe3a0a00640 1 --2- 172.21.15.114:0/3384060998 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe39c158a70 0x7fe3840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:55.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe3a1e00640 1 --2- 172.21.15.114:0/3384060998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe384004d10 0x7fe384005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:55.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe3a1400640 1 -- 172.21.15.114:0/3384060998 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe39c158a70 msgr2=0x7fe3840047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:55.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe3a1400640 1 --2- 172.21.15.114:0/3384060998 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe39c158a70 0x7fe3840047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe3a1400640 1 -- 172.21.15.114:0/3384060998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe384004d10 msgr2=0x7fe384005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:55.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe3a1400640 1 --2- 172.21.15.114:0/3384060998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe384004d10 0x7fe384005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe3a1400640 1 -- 172.21.15.114:0/3384060998 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe384003530 con 0x7fe3840039b0 2024-09-13T17:51:55.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe3a1e00640 1 --2- 172.21.15.114:0/3384060998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe384004d10 0x7fe384005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:51:55.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.777+0000 7fe3a0a00640 1 --2- 172.21.15.114:0/3384060998 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe39c158a70 0x7fe3840047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:51:55.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.781+0000 7fe3a1400640 1 --2- 172.21.15.114:0/3384060998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3840039b0 0x7fe384003d90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe390009fc0 tx=0x7fe39001cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3008b014d49e59a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:55.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.781+0000 7fe39be00640 1 -- 172.21.15.114:0/3384060998 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3900a5a40 con 0x7fe3840039b0 2024-09-13T17:51:55.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.781+0000 7fe39be00640 1 -- 172.21.15.114:0/3384060998 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39000f040 con 0x7fe3840039b0 2024-09-13T17:51:55.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.781+0000 7fe39be00640 1 -- 172.21.15.114:0/3384060998 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3900a5de0 con 0x7fe3840039b0 2024-09-13T17:51:55.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.781+0000 7fe3a3e00640 1 -- 172.21.15.114:0/3384060998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3840039b0 msgr2=0x7fe384003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:55.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.781+0000 7fe3a3e00640 1 --2- 172.21.15.114:0/3384060998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3840039b0 0x7fe384003d90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe390009fc0 tx=0x7fe39001cc50 comp rx=0 tx=0).stop 2024-09-13T17:51:55.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.781+0000 7fe3a1e00640 1 -- 172.21.15.114:0/3384060998 reap_dead start 2024-09-13T17:51:55.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.781+0000 7fe3a3e00640 1 -- 172.21.15.114:0/3384060998 shutdown_connections 2024-09-13T17:51:55.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.781+0000 7fe3a3e00640 1 -- 172.21.15.114:0/3384060998 >> 172.21.15.114:0/3384060998 conn(0x7fe39c0660b0 msgr2=0x7fe39c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:55.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.781+0000 7fe3a3e00640 1 -- 172.21.15.114:0/3384060998 shutdown_connections 2024-09-13T17:51:55.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.781+0000 7fe3a3e00640 1 -- 172.21.15.114:0/3384060998 wait complete. 2024-09-13T17:51:55.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.781+0000 7fe3a3e00640 1 Processor -- start 2024-09-13T17:51:55.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.781+0000 7fe3a3e00640 1 -- start start 2024-09-13T17:51:55.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.785+0000 7fe3a3e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe3840039b0 0x7fe39c14e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:55.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.785+0000 7fe3a3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe39c1f5550 0x7fe39c1570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:55.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.785+0000 7fe3a3e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe39c15a850 0x7fe39c15ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:55.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.785+0000 7fe3a3e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c15a090 con 0x7fe39c1f5550 2024-09-13T17:51:55.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.785+0000 7fe3a3e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c1f5e10 con 0x7fe39c15a850 2024-09-13T17:51:55.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.785+0000 7fe3a3e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c1f60f0 con 0x7fe3840039b0 2024-09-13T17:51:55.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.785+0000 7fe3a0a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe39c1f5550 0x7fe39c1570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:55.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.785+0000 7fe3a0a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe39c1f5550 0x7fe39c1570b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52858/0 (socket says 172.21.15.114:52858) 2024-09-13T17:51:55.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.785+0000 7fe3a0a00640 1 -- 172.21.15.114:0/1404823315 learned_addr learned my addr 172.21.15.114:0/1404823315 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:55.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.785+0000 7fe3a1400640 1 --2- 172.21.15.114:0/1404823315 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe3840039b0 0x7fe39c14e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:55.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.785+0000 7fe3a0a00640 1 -- 172.21.15.114:0/1404823315 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe3840039b0 msgr2=0x7fe39c14e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:55.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.785+0000 7fe3a0a00640 1 --2- 172.21.15.114:0/1404823315 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe3840039b0 0x7fe39c14e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.785+0000 7fe3a0a00640 1 -- 172.21.15.114:0/1404823315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe39c15a850 msgr2=0x7fe39c15ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:55.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.785+0000 7fe3a1e00640 1 --2- 172.21.15.114:0/1404823315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe39c15a850 0x7fe39c15ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:55.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.785+0000 7fe3a0a00640 1 --2- 172.21.15.114:0/1404823315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe39c15a850 0x7fe39c15ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.785+0000 7fe3a0a00640 1 -- 172.21.15.114:0/1404823315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c1f63d0 con 0x7fe39c1f5550 2024-09-13T17:51:55.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.785+0000 7fe3a1e00640 1 --2- 172.21.15.114:0/1404823315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe39c15a850 0x7fe39c15ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:51:55.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.785+0000 7fe3a0a00640 1 --2- 172.21.15.114:0/1404823315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe39c1f5550 0x7fe39c1570b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe388000f70 tx=0x7fe38800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:55.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.785+0000 7fe399600640 1 -- 172.21.15.114:0/1404823315 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38800c840 con 0x7fe39c1f5550 2024-09-13T17:51:55.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.785+0000 7fe399600640 1 -- 172.21.15.114:0/1404823315 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38800c9a0 con 0x7fe39c1f5550 2024-09-13T17:51:55.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.785+0000 7fe399600640 1 -- 172.21.15.114:0/1404823315 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38800cd10 con 0x7fe39c1f5550 2024-09-13T17:51:55.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.785+0000 7fe3a3e00640 1 -- 172.21.15.114:0/1404823315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe39c15a330 con 0x7fe39c1f5550 2024-09-13T17:51:55.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.785+0000 7fe3a3e00640 1 -- 172.21.15.114:0/1404823315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39c1577c0 con 0x7fe39c1f5550 2024-09-13T17:51:55.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.785+0000 7fe3a3e00640 1 -- 172.21.15.114:0/1404823315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe39c15a520 con 0x7fe39c1f5550 2024-09-13T17:51:55.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.785+0000 7fe399600640 1 -- 172.21.15.114:0/1404823315 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe38801d460 con 0x7fe39c1f5550 2024-09-13T17:51:55.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.789+0000 7fe399600640 1 --2- 172.21.15.114:0/1404823315 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe37c0666c0 0x7fe37c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:55.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.789+0000 7fe399600640 1 -- 172.21.15.114:0/1404823315 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe388084450 con 0x7fe39c1f5550 2024-09-13T17:51:55.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.789+0000 7fe3a1400640 1 --2- 172.21.15.114:0/1404823315 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe37c0666c0 0x7fe37c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:55.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.789+0000 7fe3a1400640 1 --2- 172.21.15.114:0/1404823315 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe37c0666c0 0x7fe37c068b80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe3900af000 tx=0x7fe3900a7040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:55.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.793+0000 7fe399600640 1 -- 172.21.15.114:0/1404823315 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe3880514d0 con 0x7fe39c1f5550 2024-09-13T17:51:55.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.949+0000 7fe3a3e00640 1 -- 172.21.15.114:0/1404823315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe39c0cc910 con 0x7fe39c1f5550 2024-09-13T17:51:55.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.953+0000 7fe399600640 1 -- 172.21.15.114:0/1404823315 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18394 (secure 0 0 0) 0x7fe388054af0 con 0x7fe39c1f5550 2024-09-13T17:51:55.954 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:51:55.954 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:51:54.213439+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:51:48.278220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:51:48.773888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:51:51.856300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:51:55.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.953+0000 7fe3a3e00640 1 -- 172.21.15.114:0/1404823315 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe37c0666c0 msgr2=0x7fe37c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:55.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.953+0000 7fe3a3e00640 1 --2- 172.21.15.114:0/1404823315 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe37c0666c0 0x7fe37c068b80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe3900af000 tx=0x7fe3900a7040 comp rx=0 tx=0).stop 2024-09-13T17:51:55.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.953+0000 7fe3a3e00640 1 -- 172.21.15.114:0/1404823315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe39c1f5550 msgr2=0x7fe39c1570b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:55.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.953+0000 7fe3a3e00640 1 --2- 172.21.15.114:0/1404823315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe39c1f5550 0x7fe39c1570b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe388000f70 tx=0x7fe38800ec80 comp rx=0 tx=0).stop 2024-09-13T17:51:55.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.953+0000 7fe3a3e00640 1 -- 172.21.15.114:0/1404823315 shutdown_connections 2024-09-13T17:51:55.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.953+0000 7fe3a3e00640 1 --2- 172.21.15.114:0/1404823315 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe37c0666c0 0x7fe37c068b80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.953+0000 7fe3a3e00640 1 --2- 172.21.15.114:0/1404823315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe39c15a850 0x7fe39c15ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.953+0000 7fe3a3e00640 1 --2- 172.21.15.114:0/1404823315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe39c1f5550 0x7fe39c1570b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.953+0000 7fe3a3e00640 1 --2- 172.21.15.114:0/1404823315 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe3840039b0 0x7fe39c14e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:55.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.953+0000 7fe3a3e00640 1 -- 172.21.15.114:0/1404823315 >> 172.21.15.114:0/1404823315 conn(0x7fe39c0660b0 msgr2=0x7fe39c0af540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:55.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.953+0000 7fe3a3e00640 1 -- 172.21.15.114:0/1404823315 shutdown_connections 2024-09-13T17:51:55.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:55.953+0000 7fe3a3e00640 1 -- 172.21.15.114:0/1404823315 wait complete. 2024-09-13T17:51:56.380 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:51:49.789079+0000', 'modified': '2024-09-13T17:51:54.213650+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4273': {'gid': 4273, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.134:6834/1863104078', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6832', 'nonce': 1863104078}, {'type': 'v1', 'addr': '172.21.15.134:6834', 'nonce': 1863104078}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-09-13T17:51:56.380 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T17:51:56.380 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-13T17:51:56.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.513+0000 7ff51ac00640 1 Processor -- start 2024-09-13T17:51:56.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff51ac00640 1 -- start start 2024-09-13T17:51:56.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff51ac00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff514070420 0x7ff514070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff51ac00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff51406c540 0x7ff51406c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff51ac00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff514151800 con 0x7ff514151420 2024-09-13T17:51:56.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff51ac00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5140cbc30 con 0x7ff514070420 2024-09-13T17:51:56.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff51ac00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff514070dd0 con 0x7ff51406c540 2024-09-13T17:51:56.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff513e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff514151420 0x7ff5140cc660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49204/0 (socket says 172.21.15.114:49204) 2024-09-13T17:51:56.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff513e00640 1 -- 172.21.15.114:0/1824713476 learned_addr learned my addr 172.21.15.114:0/1824713476 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:51:56.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff518c00640 1 --2- 172.21.15.114:0/1824713476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff51406c540 0x7ff51406c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:56.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff512a00640 1 -- 172.21.15.114:0/1824713476 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2401062415 0 0) 0x7ff514151800 con 0x7ff514151420 2024-09-13T17:51:56.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff513400640 1 --2- 172.21.15.114:0/1824713476 >> v2:172.21.15.134:3300/0 conn(0x7ff514070420 0x7ff514070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:56.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff512a00640 1 -- 172.21.15.114:0/1824713476 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4f8003530 con 0x7ff514151420 2024-09-13T17:51:56.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff512a00640 1 -- 172.21.15.114:0/1824713476 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1873819209 0 0) 0x7ff4f8003530 con 0x7ff514151420 2024-09-13T17:51:56.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff512a00640 1 -- 172.21.15.114:0/1824713476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff51406c540 msgr2=0x7ff51406c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:56.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff512a00640 1 --2- 172.21.15.114:0/1824713476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff51406c540 0x7ff51406c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff512a00640 1 -- 172.21.15.114:0/1824713476 >> v2:172.21.15.134:3300/0 conn(0x7ff514070420 msgr2=0x7ff514070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:56.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff512a00640 1 --2- 172.21.15.114:0/1824713476 >> v2:172.21.15.134:3300/0 conn(0x7ff514070420 0x7ff514070890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff512a00640 1 -- 172.21.15.114:0/1824713476 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5140cafb0 con 0x7ff514151420 2024-09-13T17:51:56.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff512a00640 1 -- 172.21.15.114:0/1824713476 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7ff504001a20 con 0x7ff514151420 2024-09-13T17:51:56.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff512a00640 1 -- 172.21.15.114:0/1824713476 >> v1:172.21.15.114:6789/0 conn(0x7ff514151420 legacy=0x7ff5140cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:56.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff512a00640 1 --2- 172.21.15.114:0/1824713476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4f8003980 0x7ff4f8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff512a00640 1 --2- 172.21.15.114:0/1824713476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4f80047d0 0x7ff4f8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff512a00640 1 --2- 172.21.15.114:0/1824713476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff51406c540 0x7ff4f8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff512a00640 1 -- 172.21.15.114:0/1824713476 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5140cbc30 con 0x7ff4f80047d0 2024-09-13T17:51:56.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff512a00640 1 -- 172.21.15.114:0/1824713476 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff514070dd0 con 0x7ff4f8003980 2024-09-13T17:51:56.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff512a00640 1 -- 172.21.15.114:0/1824713476 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f800ba40 con 0x7ff51406c540 2024-09-13T17:51:56.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff513400640 1 --2- 172.21.15.114:0/1824713476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4f80047d0 0x7ff4f8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:56.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff513400640 1 -- 172.21.15.114:0/1824713476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff51406c540 msgr2=0x7ff4f8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:56.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff513400640 1 --2- 172.21.15.114:0/1824713476 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff51406c540 0x7ff4f8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff513400640 1 -- 172.21.15.114:0/1824713476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4f8003980 msgr2=0x7ff4f8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:56.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff513400640 1 --2- 172.21.15.114:0/1824713476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4f8003980 0x7ff4f8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.517+0000 7ff513400640 1 -- 172.21.15.114:0/1824713476 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f8003530 con 0x7ff4f80047d0 2024-09-13T17:51:56.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.521+0000 7ff513400640 1 --2- 172.21.15.114:0/1824713476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4f80047d0 0x7ff4f8004c50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff500009ae0 tx=0x7ff50001ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f170f2f898600c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:56.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.521+0000 7ff512a00640 1 -- 172.21.15.114:0/1824713476 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5000a5650 con 0x7ff4f80047d0 2024-09-13T17:51:56.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.521+0000 7ff512a00640 1 -- 172.21.15.114:0/1824713476 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5000a57b0 con 0x7ff4f80047d0 2024-09-13T17:51:56.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.521+0000 7ff512a00640 1 -- 172.21.15.114:0/1824713476 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5000a5b60 con 0x7ff4f80047d0 2024-09-13T17:51:56.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.521+0000 7ff51ac00640 1 -- 172.21.15.114:0/1824713476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4f80047d0 msgr2=0x7ff4f8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:56.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.521+0000 7ff51ac00640 1 --2- 172.21.15.114:0/1824713476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4f80047d0 0x7ff4f8004c50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff500009ae0 tx=0x7ff50001ca80 comp rx=0 tx=0).stop 2024-09-13T17:51:56.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.521+0000 7ff518c00640 1 -- 172.21.15.114:0/1824713476 reap_dead start 2024-09-13T17:51:56.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.521+0000 7ff51ac00640 1 -- 172.21.15.114:0/1824713476 shutdown_connections 2024-09-13T17:51:56.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.521+0000 7ff51ac00640 1 -- 172.21.15.114:0/1824713476 >> 172.21.15.114:0/1824713476 conn(0x7ff5140660b0 msgr2=0x7ff514069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:56.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.521+0000 7ff51ac00640 1 -- 172.21.15.114:0/1824713476 shutdown_connections 2024-09-13T17:51:56.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.521+0000 7ff51ac00640 1 -- 172.21.15.114:0/1824713476 wait complete. 2024-09-13T17:51:56.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.525+0000 7ff51ac00640 1 Processor -- start 2024-09-13T17:51:56.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.525+0000 7ff51ac00640 1 -- start start 2024-09-13T17:51:56.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.525+0000 7ff51ac00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4f80047d0 0x7ff51414ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.525+0000 7ff51ac00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5140accc0 0x7ff514145a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.525+0000 7ff51ac00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5140ad140 0x7ff514145f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.525+0000 7ff51ac00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5140ae760 con 0x7ff4f80047d0 2024-09-13T17:51:56.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.525+0000 7ff51ac00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51414b050 con 0x7ff5140ad140 2024-09-13T17:51:56.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.525+0000 7ff51ac00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51414b330 con 0x7ff5140accc0 2024-09-13T17:51:56.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.525+0000 7ff513e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4f80047d0 0x7ff51414ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:56.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.525+0000 7ff513e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4f80047d0 0x7ff51414ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52872/0 (socket says 172.21.15.114:52872) 2024-09-13T17:51:56.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.525+0000 7ff513e00640 1 -- 172.21.15.114:0/750769246 learned_addr learned my addr 172.21.15.114:0/750769246 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:56.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.525+0000 7ff518c00640 1 --2- 172.21.15.114:0/750769246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5140ad140 0x7ff514145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:56.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.525+0000 7ff513400640 1 --2- 172.21.15.114:0/750769246 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5140accc0 0x7ff514145a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:56.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.525+0000 7ff513e00640 1 -- 172.21.15.114:0/750769246 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5140accc0 msgr2=0x7ff514145a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:56.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.525+0000 7ff513e00640 1 --2- 172.21.15.114:0/750769246 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5140accc0 0x7ff514145a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.525+0000 7ff513e00640 1 -- 172.21.15.114:0/750769246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5140ad140 msgr2=0x7ff514145f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:56.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.525+0000 7ff513e00640 1 --2- 172.21.15.114:0/750769246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5140ad140 0x7ff514145f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.525+0000 7ff513e00640 1 -- 172.21.15.114:0/750769246 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51414b610 con 0x7ff4f80047d0 2024-09-13T17:51:56.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.525+0000 7ff513e00640 1 --2- 172.21.15.114:0/750769246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4f80047d0 0x7ff51414ec30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff50400ca50 tx=0x7ff50400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:56.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.525+0000 7ff50be00640 1 -- 172.21.15.114:0/750769246 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50400a6e0 con 0x7ff4f80047d0 2024-09-13T17:51:56.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.525+0000 7ff50be00640 1 -- 172.21.15.114:0/750769246 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50400a840 con 0x7ff4f80047d0 2024-09-13T17:51:56.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.525+0000 7ff50be00640 1 -- 172.21.15.114:0/750769246 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50400abf0 con 0x7ff4f80047d0 2024-09-13T17:51:56.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.525+0000 7ff51ac00640 1 -- 172.21.15.114:0/750769246 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff51414b8f0 con 0x7ff4f80047d0 2024-09-13T17:51:56.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.525+0000 7ff51ac00640 1 -- 172.21.15.114:0/750769246 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff514149af0 con 0x7ff4f80047d0 2024-09-13T17:51:56.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.529+0000 7ff50be00640 1 -- 172.21.15.114:0/750769246 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff50400ad50 con 0x7ff4f80047d0 2024-09-13T17:51:56.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.529+0000 7ff50be00640 1 --2- 172.21.15.114:0/750769246 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff4f4066690 0x7ff4f4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.529+0000 7ff50be00640 1 -- 172.21.15.114:0/750769246 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff504083b70 con 0x7ff4f80047d0 2024-09-13T17:51:56.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.529+0000 7ff513400640 1 --2- 172.21.15.114:0/750769246 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff4f4066690 0x7ff4f4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:56.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.529+0000 7ff51e12b000 1 Processor -- start 2024-09-13T17:51:56.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.529+0000 7ff51e12b000 1 -- start start 2024-09-13T17:51:56.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.529+0000 7ff513400640 1 --2- 172.21.15.114:0/750769246 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff4f4066690 0x7ff4f4068b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff5000af000 tx=0x7ff5000046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:56.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.529+0000 7ff51e12b000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a863c6f1f0 0x55a863c6f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.529+0000 7ff51e12b000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a863c6fb10 0x55a863c25200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.529+0000 7ff51e12b000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a863c25740 0x55a863c25b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.529+0000 7ff51e12b000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a863aede80 con 0x55a863c6fb10 2024-09-13T17:51:56.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.529+0000 7ff51e12b000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a863a7baf0 con 0x55a863c6f1f0 2024-09-13T17:51:56.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.529+0000 7ff51e12b000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a863a790c0 con 0x55a863c25740 2024-09-13T17:51:56.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.529+0000 7ff513400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a863c6fb10 0x55a863c25200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:56.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.529+0000 7ff513400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a863c6fb10 0x55a863c25200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52878/0 (socket says 172.21.15.114:52878) 2024-09-13T17:51:56.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.529+0000 7ff513400640 1 -- 172.21.15.114:0/496501667 learned_addr learned my addr 172.21.15.114:0/496501667 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:56.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff518c00640 1 --2- 172.21.15.114:0/496501667 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a863c25740 0x55a863c25b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:56.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff513e00640 1 --2- 172.21.15.114:0/496501667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a863c6f1f0 0x55a863c6f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:56.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff513400640 1 -- 172.21.15.114:0/496501667 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a863c25740 msgr2=0x55a863c25b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:56.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff513400640 1 --2- 172.21.15.114:0/496501667 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a863c25740 0x55a863c25b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff513400640 1 -- 172.21.15.114:0/496501667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a863c6f1f0 msgr2=0x55a863c6f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:56.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff513400640 1 --2- 172.21.15.114:0/496501667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a863c6f1f0 0x55a863c6f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff513400640 1 -- 172.21.15.114:0/496501667 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a863770890 con 0x55a863c6fb10 2024-09-13T17:51:56.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff513400640 1 --2- 172.21.15.114:0/496501667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a863c6fb10 0x55a863c25200 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff500098470 tx=0x7ff5000a7070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d067badf551038 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:56.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff508c00640 1 -- 172.21.15.114:0/496501667 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500004220 con 0x55a863c6fb10 2024-09-13T17:51:56.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff508c00640 1 -- 172.21.15.114:0/496501667 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5000be070 con 0x55a863c6fb10 2024-09-13T17:51:56.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff508c00640 1 -- 172.21.15.114:0/496501667 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500003620 con 0x55a863c6fb10 2024-09-13T17:51:56.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff51e12b000 1 -- 172.21.15.114:0/496501667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a863c6fb10 msgr2=0x55a863c25200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:56.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff51e12b000 1 --2- 172.21.15.114:0/496501667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a863c6fb10 0x55a863c25200 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff500098470 tx=0x7ff5000a7070 comp rx=0 tx=0).stop 2024-09-13T17:51:56.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff51e12b000 1 -- 172.21.15.114:0/496501667 shutdown_connections 2024-09-13T17:51:56.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff51e12b000 1 --2- 172.21.15.114:0/496501667 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a863c25740 0x55a863c25b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff51e12b000 1 --2- 172.21.15.114:0/496501667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a863c6fb10 0x55a863c25200 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff51e12b000 1 --2- 172.21.15.114:0/496501667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a863c6f1f0 0x55a863c6f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff51e12b000 1 -- 172.21.15.114:0/496501667 >> 172.21.15.114:0/496501667 conn(0x55a863c2bfb0 msgr2=0x55a863c2c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:56.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff51e12b000 1 -- 172.21.15.114:0/496501667 shutdown_connections 2024-09-13T17:51:56.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff51e12b000 1 -- 172.21.15.114:0/496501667 wait complete. 2024-09-13T17:51:56.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff51e12b000 1 -- start start 2024-09-13T17:51:56.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff51e12b000 1 Processor -- start 2024-09-13T17:51:56.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff51e12b000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a863c25740 0x55a863c30fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff51e12b000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a863c6f1f0 0x55a863c314f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff51e12b000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a863c6fb10 0x55a863c31a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff51e12b000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a863a749b0 con 0x55a863c6fb10 2024-09-13T17:51:56.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff51e12b000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a863a13c00 con 0x55a863c25740 2024-09-13T17:51:56.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff51e12b000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a863a32070 con 0x55a863c6f1f0 2024-09-13T17:51:56.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff51e12b000 10 client.0 _ll_register_callbacks cb 0x55a863c11ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:51:56.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff518c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a863c6fb10 0x55a863c31a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:56.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff513e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a863c25740 0x55a863c30fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:56.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff518c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a863c6fb10 0x55a863c31a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52888/0 (socket says 172.21.15.114:52888) 2024-09-13T17:51:56.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff518c00640 1 -- 172.21.15.114:0/2665106472 learned_addr learned my addr 172.21.15.114:0/2665106472 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:56.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.533+0000 7ff513400640 1 --2- 172.21.15.114:0/2665106472 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a863c6f1f0 0x55a863c314f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:56.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff518c00640 1 -- 172.21.15.114:0/2665106472 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a863c6f1f0 msgr2=0x55a863c314f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:56.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff518c00640 1 --2- 172.21.15.114:0/2665106472 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a863c6f1f0 0x55a863c314f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff518c00640 1 -- 172.21.15.114:0/2665106472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a863c25740 msgr2=0x55a863c30fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:56.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff518c00640 1 --2- 172.21.15.114:0/2665106472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a863c25740 0x55a863c30fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff518c00640 1 -- 172.21.15.114:0/2665106472 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f8003530 con 0x55a863c6fb10 2024-09-13T17:51:56.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff518c00640 1 --2- 172.21.15.114:0/2665106472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a863c6fb10 0x55a863c31a30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff5140cc630 tx=0x7ff50c009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990eaacbbfa62b83 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:56.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff4fd600640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-13T17:51:56.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff4fd600640 1 -- 172.21.15.114:0/2665106472 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c013c00 con 0x55a863c6fb10 2024-09-13T17:51:56.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff4fd600640 1 -- 172.21.15.114:0/2665106472 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff50c013d60 con 0x55a863c6fb10 2024-09-13T17:51:56.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff51e12b000 1 -- 172.21.15.114:0/2665106472 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a863a315f0 con 0x55a863c6fb10 2024-09-13T17:51:56.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff4fd600640 1 -- 172.21.15.114:0/2665106472 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff50c0059a0 con 0x55a863c6fb10 2024-09-13T17:51:56.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff51e12b000 10 client.4419 fetch_fsmap learned FSMap version 7 2024-09-13T17:51:56.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff51e12b000 1 -- 172.21.15.114:0/2665106472 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55a863a39ab0 con 0x55a863c6fb10 2024-09-13T17:51:56.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff4fd600640 1 -- 172.21.15.114:0/2665106472 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a863a315f0 con 0x55a863c6fb10 2024-09-13T17:51:56.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff4fd600640 1 -- 172.21.15.114:0/2665106472 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7ff50c005b00 con 0x55a863c6fb10 2024-09-13T17:51:56.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff51e12b000 10 client.4419 fetch_fsmap finished waiting for FSMap version 7 2024-09-13T17:51:56.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff51e12b000 10 client.4419 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T17:51:56.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff51e12b000 20 client.4419 populate_metadata read hostname 'smithi114' 2024-09-13T17:51:56.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff51e12b000 1 --2- 172.21.15.114:0/2665106472 >> [v2:172.21.15.134:6832/1863104078,v1:172.21.15.134:6834/1863104078] conn(0x55a863c32440 0x55a863c812a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff51e12b000 4 client.4419 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:51:56.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff51e12b000 1 -- 172.21.15.114:0/2665106472 --> [v2:172.21.15.134:6832/1863104078,v1:172.21.15.134:6834/1863104078] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a863a71790 con 0x55a863c32440 2024-09-13T17:51:56.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff513e00640 1 --2- 172.21.15.114:0/2665106472 >> [v2:172.21.15.134:6832/1863104078,v1:172.21.15.134:6834/1863104078] conn(0x55a863c32440 0x55a863c812a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:56.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff513e00640 1 --2- 172.21.15.114:0/2665106472 >> [v2:172.21.15.134:6832/1863104078,v1:172.21.15.134:6834/1863104078] conn(0x55a863c32440 0x55a863c812a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=427f1ccd447c8510 server_cookie=b2202391ef80c21b in_seq=0 out_seq=0 2024-09-13T17:51:56.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff4fd600640 10 client.4419 ms_handle_connect on v2:172.21.15.134:6832/1863104078 2024-09-13T17:51:56.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff4fd600640 1 -- 172.21.15.114:0/2665106472 <== mds.0 v2:172.21.15.134:6832/1863104078 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55a863a71790 con 0x55a863c32440 2024-09-13T17:51:56.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff4fd600640 10 client.4419 handle_command_reply: tid=0 2024-09-13T17:51:56.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff51e12b000 1 client.4419 shutdown 2024-09-13T17:51:56.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff51e12b000 1 -- 172.21.15.114:0/2665106472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a863c6fb10 msgr2=0x55a863c31a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:56.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff51e12b000 1 --2- 172.21.15.114:0/2665106472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a863c6fb10 0x55a863c31a30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff5140cc630 tx=0x7ff50c009f80 comp rx=0 tx=0).stop 2024-09-13T17:51:56.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff51e12b000 1 -- 172.21.15.114:0/2665106472 shutdown_connections 2024-09-13T17:51:56.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff51e12b000 1 --2- 172.21.15.114:0/2665106472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a863c6fb10 0x55a863c31a30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff51e12b000 1 --2- 172.21.15.114:0/2665106472 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a863c6f1f0 0x55a863c314f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff51e12b000 1 --2- 172.21.15.114:0/2665106472 >> [v2:172.21.15.134:6832/1863104078,v1:172.21.15.134:6834/1863104078] conn(0x55a863c32440 0x55a863c812a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff51e12b000 1 --2- 172.21.15.114:0/2665106472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a863c25740 0x55a863c30fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff4fd600640 0 client.4419 ms_handle_reset on v2:172.21.15.134:6832/1863104078 2024-09-13T17:51:56.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.537+0000 7ff51e12b000 1 -- 172.21.15.114:0/2665106472 >> 172.21.15.114:0/2665106472 conn(0x55a863c2bfb0 msgr2=0x55a863c241f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:56.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.541+0000 7ff51e12b000 1 -- 172.21.15.114:0/2665106472 shutdown_connections 2024-09-13T17:51:56.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.541+0000 7ff51e12b000 1 -- 172.21.15.114:0/2665106472 wait complete. 2024-09-13T17:51:56.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.541+0000 7ff51e12b000 20 client.4419 trim_cache size 0 max 16384 2024-09-13T17:51:56.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.553+0000 7ff51e12b000 1 Processor -- start 2024-09-13T17:51:56.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.553+0000 7ff51e12b000 1 -- start start 2024-09-13T17:51:56.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff51e12b000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a863c25740 0x55a863ccb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff51e12b000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a863c6f1f0 0x55a863ccb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff51e12b000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a863c6fb10 0x55a863ccbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff51e12b000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a863731940 con 0x55a863c6f1f0 2024-09-13T17:51:56.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff51e12b000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a863a73840 con 0x55a863c6fb10 2024-09-13T17:51:56.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff51e12b000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a863c28590 con 0x55a863c25740 2024-09-13T17:51:56.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff513400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a863c6f1f0 0x55a863ccb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:56.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff513400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a863c6f1f0 0x55a863ccb870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52896/0 (socket says 172.21.15.114:52896) 2024-09-13T17:51:56.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff513e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a863c25740 0x55a863ccb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:56.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff513400640 1 -- 172.21.15.114:0/365911984 learned_addr learned my addr 172.21.15.114:0/365911984 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:56.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff518c00640 1 --2- 172.21.15.114:0/365911984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a863c6fb10 0x55a863ccbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:56.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff513400640 1 -- 172.21.15.114:0/365911984 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a863c25740 msgr2=0x55a863ccb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:56.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff513400640 1 --2- 172.21.15.114:0/365911984 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a863c25740 0x55a863ccb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff513400640 1 -- 172.21.15.114:0/365911984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a863c6fb10 msgr2=0x55a863ccbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:56.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff513400640 1 --2- 172.21.15.114:0/365911984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a863c6fb10 0x55a863ccbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff513400640 1 -- 172.21.15.114:0/365911984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a863a1fc00 con 0x55a863c6f1f0 2024-09-13T17:51:56.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff513400640 1 --2- 172.21.15.114:0/365911984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a863c6f1f0 0x55a863ccb870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff500098470 tx=0x7ff500004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd37a424ab4c464 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:56.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff509600640 1 -- 172.21.15.114:0/365911984 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500004180 con 0x55a863c6f1f0 2024-09-13T17:51:56.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff509600640 1 -- 172.21.15.114:0/365911984 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5000be040 con 0x55a863c6f1f0 2024-09-13T17:51:56.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff509600640 1 -- 172.21.15.114:0/365911984 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500004520 con 0x55a863c6f1f0 2024-09-13T17:51:56.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff51e12b000 1 -- 172.21.15.114:0/365911984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a863c6f1f0 msgr2=0x55a863ccb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:56.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff51e12b000 1 --2- 172.21.15.114:0/365911984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a863c6f1f0 0x55a863ccb870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff500098470 tx=0x7ff500004740 comp rx=0 tx=0).stop 2024-09-13T17:51:56.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff51e12b000 1 -- 172.21.15.114:0/365911984 shutdown_connections 2024-09-13T17:51:56.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff51e12b000 1 --2- 172.21.15.114:0/365911984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a863c6fb10 0x55a863ccbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff51e12b000 1 --2- 172.21.15.114:0/365911984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a863c6f1f0 0x55a863ccb870 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff51e12b000 1 --2- 172.21.15.114:0/365911984 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a863c25740 0x55a863ccb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff51e12b000 1 -- 172.21.15.114:0/365911984 >> 172.21.15.114:0/365911984 conn(0x55a863c2bfb0 msgr2=0x55a863c239d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:56.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff51e12b000 1 -- 172.21.15.114:0/365911984 shutdown_connections 2024-09-13T17:51:56.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff51e12b000 1 -- 172.21.15.114:0/365911984 wait complete. 2024-09-13T17:51:56.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff51e12b000 1 -- start start 2024-09-13T17:51:56.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.557+0000 7ff51e12b000 1 Processor -- start 2024-09-13T17:51:56.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff51e12b000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a863c25740 0x55a863ccfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff51e12b000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a863c6f1f0 0x55a863c8ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff51e12b000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a863c6fb10 0x55a863c8b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff51e12b000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a863ab75f0 con 0x55a863c25740 2024-09-13T17:51:56.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff51e12b000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a863c311e0 con 0x55a863c6f1f0 2024-09-13T17:51:56.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff51e12b000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a863a694d0 con 0x55a863c6fb10 2024-09-13T17:51:56.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff51e12b000 10 client.0 _ll_register_callbacks cb 0x7ff5000b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:51:56.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff513e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a863c25740 0x55a863ccfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:56.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff513e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a863c25740 0x55a863ccfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52906/0 (socket says 172.21.15.114:52906) 2024-09-13T17:51:56.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff513e00640 1 -- 172.21.15.114:0/2263733820 learned_addr learned my addr 172.21.15.114:0/2263733820 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:56.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff513400640 1 --2- 172.21.15.114:0/2263733820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a863c6f1f0 0x55a863c8ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:56.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff518c00640 1 --2- 172.21.15.114:0/2263733820 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a863c6fb10 0x55a863c8b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:56.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff513e00640 1 -- 172.21.15.114:0/2263733820 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a863c6fb10 msgr2=0x55a863c8b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:56.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff513e00640 1 --2- 172.21.15.114:0/2263733820 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a863c6fb10 0x55a863c8b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff513e00640 1 -- 172.21.15.114:0/2263733820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a863c6f1f0 msgr2=0x55a863c8ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:56.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff513e00640 1 --2- 172.21.15.114:0/2263733820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a863c6f1f0 0x55a863c8ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff513e00640 1 -- 172.21.15.114:0/2263733820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5000c8040 con 0x55a863c25740 2024-09-13T17:51:56.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff513e00640 1 --2- 172.21.15.114:0/2263733820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a863c25740 0x55a863ccfa50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff504001310 tx=0x7ff504009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6de69070c0caff9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:56.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff4fd600640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-13T17:51:56.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff4fd600640 1 -- 172.21.15.114:0/2263733820 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff504083040 con 0x55a863c25740 2024-09-13T17:51:56.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff4fd600640 1 -- 172.21.15.114:0/2263733820 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff504050fb0 con 0x55a863c25740 2024-09-13T17:51:56.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff51e12b000 1 -- 172.21.15.114:0/2263733820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a863a44460 con 0x55a863c25740 2024-09-13T17:51:56.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff4fd600640 1 -- 172.21.15.114:0/2263733820 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff504051170 con 0x55a863c25740 2024-09-13T17:51:56.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff51e12b000 10 client.4425 fetch_fsmap learned FSMap version 7 2024-09-13T17:51:56.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff51e12b000 1 -- 172.21.15.114:0/2263733820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55a863770cc0 con 0x55a863c25740 2024-09-13T17:51:56.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff4fd600640 1 -- 172.21.15.114:0/2263733820 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a863a44460 con 0x55a863c25740 2024-09-13T17:51:56.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff4fd600640 1 -- 172.21.15.114:0/2263733820 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7ff50405c800 con 0x55a863c25740 2024-09-13T17:51:56.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff51e12b000 10 client.4425 fetch_fsmap finished waiting for FSMap version 7 2024-09-13T17:51:56.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff51e12b000 10 client.4425 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T17:51:56.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff51e12b000 20 client.4425 populate_metadata read hostname 'smithi114' 2024-09-13T17:51:56.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff51e12b000 1 --2- 172.21.15.114:0/2263733820 >> [v2:172.21.15.134:6832/1863104078,v1:172.21.15.134:6834/1863104078] conn(0x55a863ccff90 0x55a863c8b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff51e12b000 4 client.4425 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:51:56.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff51e12b000 1 -- 172.21.15.114:0/2263733820 --> [v2:172.21.15.134:6832/1863104078,v1:172.21.15.134:6834/1863104078] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a863a3d9c0 con 0x55a863ccff90 2024-09-13T17:51:56.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff513400640 1 --2- 172.21.15.114:0/2263733820 >> [v2:172.21.15.134:6832/1863104078,v1:172.21.15.134:6834/1863104078] conn(0x55a863ccff90 0x55a863c8b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:56.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff513400640 1 --2- 172.21.15.114:0/2263733820 >> [v2:172.21.15.134:6832/1863104078,v1:172.21.15.134:6834/1863104078] conn(0x55a863ccff90 0x55a863c8b7a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1086cebdc2c34f87 server_cookie=cbf8a74d338024f8 in_seq=0 out_seq=0 2024-09-13T17:51:56.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff4fd600640 10 client.4425 ms_handle_connect on v2:172.21.15.134:6832/1863104078 2024-09-13T17:51:56.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff4fd600640 1 -- 172.21.15.114:0/2263733820 <== mds.0 v2:172.21.15.134:6832/1863104078 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55a863a3d9c0 con 0x55a863ccff90 2024-09-13T17:51:56.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff4fd600640 10 client.4425 handle_command_reply: tid=0 2024-09-13T17:51:56.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff51e12b000 1 client.4425 shutdown 2024-09-13T17:51:56.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff51e12b000 1 -- 172.21.15.114:0/2263733820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a863c25740 msgr2=0x55a863ccfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:56.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff51e12b000 1 --2- 172.21.15.114:0/2263733820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a863c25740 0x55a863ccfa50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff504001310 tx=0x7ff504009040 comp rx=0 tx=0).stop 2024-09-13T17:51:56.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff51e12b000 1 -- 172.21.15.114:0/2263733820 shutdown_connections 2024-09-13T17:51:56.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff51e12b000 1 --2- 172.21.15.114:0/2263733820 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55a863c6fb10 0x55a863c8b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff51e12b000 1 --2- 172.21.15.114:0/2263733820 >> [v2:172.21.15.134:6832/1863104078,v1:172.21.15.134:6834/1863104078] conn(0x55a863ccff90 0x55a863c8b7a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff51e12b000 1 --2- 172.21.15.114:0/2263733820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a863c6f1f0 0x55a863c8ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff51e12b000 1 --2- 172.21.15.114:0/2263733820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55a863c25740 0x55a863ccfa50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff4fd600640 0 client.4425 ms_handle_reset on v2:172.21.15.134:6832/1863104078 2024-09-13T17:51:56.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff51e12b000 1 -- 172.21.15.114:0/2263733820 >> 172.21.15.114:0/2263733820 conn(0x55a863c2bfb0 msgr2=0x55a863c241f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:56.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff51e12b000 1 -- 172.21.15.114:0/2263733820 shutdown_connections 2024-09-13T17:51:56.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff51e12b000 1 -- 172.21.15.114:0/2263733820 wait complete. 2024-09-13T17:51:56.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.561+0000 7ff51e12b000 20 client.4425 trim_cache size 0 max 16384 2024-09-13T17:51:56.568 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-13T17:51:56.568 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d730423f-882d-4061-b746-f6a7dc2544e0", 2024-09-13T17:51:56.568 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2024-09-13T17:51:56.568 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4273, 2024-09-13T17:51:56.568 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2024-09-13T17:51:56.568 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2024-09-13T17:51:56.568 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2024-09-13T17:51:56.569 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 6.7718359159999997, 2024-09-13T17:51:56.569 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 7, 2024-09-13T17:51:56.569 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 24, 2024-09-13T17:51:56.569 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 23, 2024-09-13T17:51:56.569 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 12.974382173 2024-09-13T17:51:56.569 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-13T17:51:56.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.565+0000 7ff51ac00640 1 -- 172.21.15.114:0/750769246 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff4f4066690 msgr2=0x7ff4f4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:56.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.565+0000 7ff51ac00640 1 --2- 172.21.15.114:0/750769246 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff4f4066690 0x7ff4f4068b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff5000af000 tx=0x7ff5000046d0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.565+0000 7ff51ac00640 1 -- 172.21.15.114:0/750769246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4f80047d0 msgr2=0x7ff51414ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:56.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.565+0000 7ff51ac00640 1 --2- 172.21.15.114:0/750769246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4f80047d0 0x7ff51414ec30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff50400ca50 tx=0x7ff50400ce50 comp rx=0 tx=0).stop 2024-09-13T17:51:56.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.565+0000 7ff51ac00640 1 -- 172.21.15.114:0/750769246 shutdown_connections 2024-09-13T17:51:56.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.565+0000 7ff51ac00640 1 --2- 172.21.15.114:0/750769246 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff4f4066690 0x7ff4f4068b50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.565+0000 7ff51ac00640 1 --2- 172.21.15.114:0/750769246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5140ad140 0x7ff514145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.565+0000 7ff51ac00640 1 --2- 172.21.15.114:0/750769246 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5140accc0 0x7ff514145a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.565+0000 7ff51ac00640 1 --2- 172.21.15.114:0/750769246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4f80047d0 0x7ff51414ec30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.565+0000 7ff51ac00640 1 -- 172.21.15.114:0/750769246 >> 172.21.15.114:0/750769246 conn(0x7ff5140660b0 msgr2=0x7ff51415c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:56.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.565+0000 7ff51ac00640 1 -- 172.21.15.114:0/750769246 shutdown_connections 2024-09-13T17:51:56.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.565+0000 7ff51ac00640 1 -- 172.21.15.114:0/750769246 wait complete. 2024-09-13T17:51:56.584 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T17:51:56.584 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:51:56.584 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:51:56.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.717+0000 7f7667800640 1 Processor -- start 2024-09-13T17:51:56.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.717+0000 7f7667800640 1 -- start start 2024-09-13T17:51:56.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.717+0000 7f7667800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f766013c240 0x7f766013f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.717+0000 7f7667800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f766013c980 0x7f766006d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.717+0000 7f7667800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f766006da90 0x7f76600cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.717+0000 7f7667800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76600cd220 con 0x7f766013c240 2024-09-13T17:51:56.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.717+0000 7f7667800640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f766013f960 con 0x7f766006da90 2024-09-13T17:51:56.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.717+0000 7f7667800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766006ded0 con 0x7f766013c980 2024-09-13T17:51:56.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.717+0000 7f7664e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f766013c240 0x7f766013f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:56.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.717+0000 7f7664e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f766013c240 0x7f766013f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52914/0 (socket says 172.21.15.114:52914) 2024-09-13T17:51:56.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.717+0000 7f7664e00640 1 -- 172.21.15.114:0/3405347358 learned_addr learned my addr 172.21.15.114:0/3405347358 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:56.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.717+0000 7f7665800640 1 --2- 172.21.15.114:0/3405347358 >> v2:172.21.15.134:3300/0 conn(0x7f766006da90 0x7f76600cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:56.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.717+0000 7f7657e00640 1 --2- 172.21.15.114:0/3405347358 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f766013c980 0x7f766006d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:56.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.721+0000 7f7664e00640 1 -- 172.21.15.114:0/3405347358 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f766013c980 msgr2=0x7f766006d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:56.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.721+0000 7f7664e00640 1 --2- 172.21.15.114:0/3405347358 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f766013c980 0x7f766006d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.721+0000 7f7664e00640 1 -- 172.21.15.114:0/3405347358 >> v2:172.21.15.134:3300/0 conn(0x7f766006da90 msgr2=0x7f76600cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:51:56.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.721+0000 7f7664e00640 1 --2- 172.21.15.114:0/3405347358 >> v2:172.21.15.134:3300/0 conn(0x7f766006da90 0x7f76600cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.721+0000 7f7664e00640 1 -- 172.21.15.114:0/3405347358 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766015a740 con 0x7f766013c240 2024-09-13T17:51:56.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.721+0000 7f7664e00640 1 --2- 172.21.15.114:0/3405347358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f766013c240 0x7f766013f420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7660157350 tx=0x7f765001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=566d32ffdcab1d40 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:56.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.721+0000 7f765fe00640 1 -- 172.21.15.114:0/3405347358 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76500aa610 con 0x7f766013c240 2024-09-13T17:51:56.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.721+0000 7f765fe00640 1 -- 172.21.15.114:0/3405347358 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76500a6040 con 0x7f766013c240 2024-09-13T17:51:56.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.721+0000 7f765fe00640 1 -- 172.21.15.114:0/3405347358 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76500aa990 con 0x7f766013c240 2024-09-13T17:51:56.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.721+0000 7f7667800640 1 -- 172.21.15.114:0/3405347358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f766013c240 msgr2=0x7f766013f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:56.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.721+0000 7f7667800640 1 --2- 172.21.15.114:0/3405347358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f766013c240 0x7f766013f420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7660157350 tx=0x7f765001c4f0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.721+0000 7f7667800640 1 -- 172.21.15.114:0/3405347358 shutdown_connections 2024-09-13T17:51:56.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.721+0000 7f7667800640 1 --2- 172.21.15.114:0/3405347358 >> v2:172.21.15.134:3300/0 conn(0x7f766006da90 0x7f76600cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.721+0000 7f7667800640 1 --2- 172.21.15.114:0/3405347358 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f766013c980 0x7f766006d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.721+0000 7f7667800640 1 --2- 172.21.15.114:0/3405347358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f766013c240 0x7f766013f420 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.721+0000 7f7667800640 1 -- 172.21.15.114:0/3405347358 >> 172.21.15.114:0/3405347358 conn(0x7f76600660b0 msgr2=0x7f7660069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:56.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.725+0000 7f7667800640 1 -- 172.21.15.114:0/3405347358 shutdown_connections 2024-09-13T17:51:56.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.725+0000 7f7667800640 1 -- 172.21.15.114:0/3405347358 wait complete. 2024-09-13T17:51:56.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.725+0000 7f7667800640 1 Processor -- start 2024-09-13T17:51:56.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.725+0000 7f7667800640 1 -- start start 2024-09-13T17:51:56.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.725+0000 7f7667800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f766006da90 0x7f76600ace50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.725+0000 7f7667800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f766013c240 0x7f76600ae3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.725+0000 7f7667800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f766013c980 0x7f76600ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.725+0000 7f7667800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76600afa90 con 0x7f766006da90 2024-09-13T17:51:56.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.725+0000 7f7667800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76600affb0 con 0x7f766013c980 2024-09-13T17:51:56.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.725+0000 7f7667800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76600b0230 con 0x7f766013c240 2024-09-13T17:51:56.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.725+0000 7f7664e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f766006da90 0x7f76600ace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:56.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.725+0000 7f7664e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f766006da90 0x7f76600ace50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52924/0 (socket says 172.21.15.114:52924) 2024-09-13T17:51:56.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.725+0000 7f7664e00640 1 -- 172.21.15.114:0/2874101719 learned_addr learned my addr 172.21.15.114:0/2874101719 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:51:56.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.725+0000 7f7657e00640 1 --2- 172.21.15.114:0/2874101719 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f766013c240 0x7f76600ae3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:56.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.725+0000 7f7665800640 1 --2- 172.21.15.114:0/2874101719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f766013c980 0x7f76600ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:56.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.725+0000 7f7664e00640 1 -- 172.21.15.114:0/2874101719 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f766013c240 msgr2=0x7f76600ae3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:56.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.725+0000 7f7664e00640 1 --2- 172.21.15.114:0/2874101719 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f766013c240 0x7f76600ae3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.725+0000 7f7664e00640 1 -- 172.21.15.114:0/2874101719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f766013c980 msgr2=0x7f76600ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:56.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.725+0000 7f7664e00640 1 --2- 172.21.15.114:0/2874101719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f766013c980 0x7f76600ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.725+0000 7f7664e00640 1 -- 172.21.15.114:0/2874101719 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76500094d0 con 0x7f766006da90 2024-09-13T17:51:56.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.725+0000 7f7657e00640 1 --2- 172.21.15.114:0/2874101719 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f766013c240 0x7f76600ae3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:51:56.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.725+0000 7f7664e00640 1 --2- 172.21.15.114:0/2874101719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f766006da90 0x7f76600ace50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f765001cd90 tx=0x7f7650019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:56.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.725+0000 7f765d600640 1 -- 172.21.15.114:0/2874101719 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76500bd3f0 con 0x7f766006da90 2024-09-13T17:51:56.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.725+0000 7f765d600640 1 -- 172.21.15.114:0/2874101719 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76500bd550 con 0x7f766006da90 2024-09-13T17:51:56.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.725+0000 7f765d600640 1 -- 172.21.15.114:0/2874101719 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76500bd8e0 con 0x7f766006da90 2024-09-13T17:51:56.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.725+0000 7f7667800640 1 -- 172.21.15.114:0/2874101719 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f766015a230 con 0x7f766006da90 2024-09-13T17:51:56.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.729+0000 7f7667800640 1 -- 172.21.15.114:0/2874101719 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76600b0ad0 con 0x7f766006da90 2024-09-13T17:51:56.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.729+0000 7f7667800640 1 -- 172.21.15.114:0/2874101719 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76600b0620 con 0x7f766006da90 2024-09-13T17:51:56.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.729+0000 7f765d600640 1 -- 172.21.15.114:0/2874101719 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f76500b33f0 con 0x7f766006da90 2024-09-13T17:51:56.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.729+0000 7f765d600640 1 --2- 172.21.15.114:0/2874101719 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f763c066690 0x7f763c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:51:56.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.729+0000 7f765d600640 1 -- 172.21.15.114:0/2874101719 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f765011e920 con 0x7f766006da90 2024-09-13T17:51:56.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.729+0000 7f7657e00640 1 --2- 172.21.15.114:0/2874101719 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f763c066690 0x7f763c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:51:56.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.729+0000 7f7657e00640 1 --2- 172.21.15.114:0/2874101719 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f763c066690 0x7f763c068b50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7660071270 tx=0x7f7648008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:51:56.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.733+0000 7f765d600640 1 -- 172.21.15.114:0/2874101719 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f76500eba40 con 0x7f766006da90 2024-09-13T17:51:56.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.921+0000 7f7667800640 1 -- 172.21.15.114:0/2874101719 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f76600705d0 con 0x7f766006da90 2024-09-13T17:51:56.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.921+0000 7f765d600640 1 -- 172.21.15.114:0/2874101719 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f76500ef060 con 0x7f766006da90 2024-09-13T17:51:56.924 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T17:51:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.925+0000 7f7667800640 1 -- 172.21.15.114:0/2874101719 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f763c066690 msgr2=0x7f763c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.925+0000 7f7667800640 1 --2- 172.21.15.114:0/2874101719 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f763c066690 0x7f763c068b50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7660071270 tx=0x7f7648008040 comp rx=0 tx=0).stop 2024-09-13T17:51:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.925+0000 7f7667800640 1 -- 172.21.15.114:0/2874101719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f766006da90 msgr2=0x7f76600ace50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:51:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.925+0000 7f7667800640 1 --2- 172.21.15.114:0/2874101719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f766006da90 0x7f76600ace50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f765001cd90 tx=0x7f7650019290 comp rx=0 tx=0).stop 2024-09-13T17:51:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.925+0000 7f7667800640 1 -- 172.21.15.114:0/2874101719 shutdown_connections 2024-09-13T17:51:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.925+0000 7f7667800640 1 --2- 172.21.15.114:0/2874101719 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f763c066690 0x7f763c068b50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.925+0000 7f7667800640 1 --2- 172.21.15.114:0/2874101719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f766013c980 0x7f76600ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.925+0000 7f7667800640 1 --2- 172.21.15.114:0/2874101719 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f766013c240 0x7f76600ae3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.925+0000 7f7667800640 1 --2- 172.21.15.114:0/2874101719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f766006da90 0x7f76600ace50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:51:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.925+0000 7f7667800640 1 -- 172.21.15.114:0/2874101719 >> 172.21.15.114:0/2874101719 conn(0x7f76600660b0 msgr2=0x7f766006d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:51:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.925+0000 7f7667800640 1 -- 172.21.15.114:0/2874101719 shutdown_connections 2024-09-13T17:51:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:51:56.925+0000 7f7667800640 1 -- 172.21.15.114:0/2874101719 wait complete. 2024-09-13T17:51:56.946 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T17:51:56.946 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:51:56.947 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-09-13T17:51:56.947 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-13T17:51:56.947 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:51:56.947 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T17:51:56.947 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:51:56.947 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:51:56.947 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-13T17:51:56.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:51:56.947 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-09-13T17:51:56.956 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:51:56.956 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:51:56.956 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:51:56.956 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:51:56.956 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-09-13T17:51:56.956 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:51:56.956 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:51:56.956 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:51:56.957 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-09-13T17:51:56.957 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:51:56.957 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:51:56.957 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-09-13T17:51:56.957 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:51:56.957 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:51:56.957 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:51:56.957 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:51:56.957 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:51:56.957 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42454sec preferred_lft 42454sec 2024-09-13T17:51:56.957 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-09-13T17:51:56.957 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:51:56.958 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:51:56.958 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:0f:6c:f2:fc brd ff:ff:ff:ff:ff:ff 2024-09-13T17:51:56.958 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:51:56.958 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:51:56.959 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T17:51:56.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:51:56.959 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2024-09-13T17:51:56.959 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-13T17:51:56.960 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add name ceph-brx type bridge 2024-09-13T17:51:56.960 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr flush dev ceph-brx 2024-09-13T17:51:56.960 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set ceph-brx up 2024-09-13T17:51:56.960 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T17:51:56.960 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-13T17:51:57.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:51:57.067 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:51:57.085 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-09-13T17:51:57.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:51:57.088 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-09-13T17:51:57.161 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-09-13T17:51:57.161 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:51:57.161 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:51:57.161 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:51:57.161 INFO:teuthology.orchestra.run.smithi114.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-13T17:51:57.161 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:51:57.161 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T17:51:57.161 INFO:teuthology.orchestra.run.smithi114.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:51:57.161 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:51:57.161 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:51:57.161 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:51:57.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:51:57.162 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2024-09-13T17:51:57.162 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-13T17:51:57.162 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:51:57.162 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:51:57.162 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:51:57.162 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-13T17:51:57.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:51:57.252 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-13T17:51:57.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:51:57.262 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list-id 2024-09-13T17:51:57.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:51:57.313 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2024-09-13T17:51:57.313 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-13T17:51:57.313 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-13T17:51:57.313 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-13T17:51:57.313 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-13T17:51:57.395 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-13T17:51:57.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:51:57.395 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2024-09-13T17:51:57.395 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-13T17:51:57.395 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-13T17:51:57.396 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T17:51:57.396 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-13T17:51:57.396 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-13T17:51:57.396 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-13T17:51:57.396 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-13T17:51:57.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:51:57.549 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2024-09-13T17:51:57.549 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-13T17:51:57.549 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-09-13T17:51:57.549 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T17:51:57.549 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-13T17:51:57.588 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-13T17:51:57.588 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:51:57.588 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:51:57.636 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-13T17:51:57.637 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:51:57.637 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:51:57.692 DEBUG:teuthology.orchestra.run.smithi114:> sudo modprobe fuse 2024-09-13T17:51:57.756 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:51:57.756 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:51:57.816 INFO:teuthology.orchestra.run.smithi114.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:51:57.817 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:51:57.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:51:57.818 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2024-09-13T17:51:57.872 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T17:51:57.873 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-13T17:51:57.919 DEBUG:teuthology.orchestra.run.smithi114:> sudo modprobe fuse 2024-09-13T17:51:57.940 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:51:57.940 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:51:57.999 INFO:teuthology.orchestra.run.smithi114.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:51:58.001 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:51:58.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:51:58.001 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2024-09-13T17:51:58.015 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi114.stderr:2024-09-13T17:51:58.013+0000 7fd01b7f6580 -1 init, newargv = 0x55e9e30370b0 newargc=15 2024-09-13T17:51:58.016 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi114.stderr:ceph-fuse[34890]: starting ceph client 2024-09-13T17:51:58.026 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi114.stderr:ceph-fuse[34890]: starting fuse 2024-09-13T17:51:59.125 DEBUG:teuthology.orchestra.run.smithi114:> sudo modprobe fuse 2024-09-13T17:51:59.148 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T17:51:59.148 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T17:51:59.212 INFO:teuthology.orchestra.run.smithi114.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T17:51:59.214 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T17:51:59.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:51:59.214 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2024-09-13T17:51:59.266 INFO:teuthology.orchestra.run.smithi114.stdout:44 2024-09-13T17:51:59.267 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-13T17:51:59.267 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:51:59.267 DEBUG:teuthology.orchestra.run.smithi114:> import glob 2024-09-13T17:51:59.267 DEBUG:teuthology.orchestra.run.smithi114:> import re 2024-09-13T17:51:59.267 DEBUG:teuthology.orchestra.run.smithi114:> import os 2024-09-13T17:51:59.267 DEBUG:teuthology.orchestra.run.smithi114:> import subprocess 2024-09-13T17:51:59.267 DEBUG:teuthology.orchestra.run.smithi114:> 2024-09-13T17:51:59.267 DEBUG:teuthology.orchestra.run.smithi114:> def _find_admin_socket(client_name): 2024-09-13T17:51:59.267 DEBUG:teuthology.orchestra.run.smithi114:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-13T17:51:59.267 DEBUG:teuthology.orchestra.run.smithi114:> files = glob.glob(asok_path) 2024-09-13T17:51:59.267 DEBUG:teuthology.orchestra.run.smithi114:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-13T17:51:59.268 DEBUG:teuthology.orchestra.run.smithi114:> 2024-09-13T17:51:59.268 DEBUG:teuthology.orchestra.run.smithi114:> # Given a non-glob path, it better be there 2024-09-13T17:51:59.268 DEBUG:teuthology.orchestra.run.smithi114:> if "*" not in asok_path: 2024-09-13T17:51:59.268 DEBUG:teuthology.orchestra.run.smithi114:> assert(len(files) == 1) 2024-09-13T17:51:59.268 DEBUG:teuthology.orchestra.run.smithi114:> return files[0] 2024-09-13T17:51:59.268 DEBUG:teuthology.orchestra.run.smithi114:> 2024-09-13T17:51:59.268 DEBUG:teuthology.orchestra.run.smithi114:> for f in files: 2024-09-13T17:51:59.268 DEBUG:teuthology.orchestra.run.smithi114:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T17:51:59.268 DEBUG:teuthology.orchestra.run.smithi114:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T17:51:59.268 DEBUG:teuthology.orchestra.run.smithi114:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T17:51:59.268 DEBUG:teuthology.orchestra.run.smithi114:> contents = proc_f.read() 2024-09-13T17:51:59.268 DEBUG:teuthology.orchestra.run.smithi114:> if mountpoint in contents: 2024-09-13T17:51:59.268 DEBUG:teuthology.orchestra.run.smithi114:> return f 2024-09-13T17:51:59.268 DEBUG:teuthology.orchestra.run.smithi114:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T17:51:59.268 DEBUG:teuthology.orchestra.run.smithi114:> 2024-09-13T17:51:59.269 DEBUG:teuthology.orchestra.run.smithi114:> print(_find_admin_socket("client.admin")) 2024-09-13T17:51:59.269 DEBUG:teuthology.orchestra.run.smithi114:> ' 2024-09-13T17:51:59.399 INFO:teuthology.orchestra.run.smithi114.stdout:/var/run/ceph/ceph-client.admin.34890.asok 2024-09-13T17:51:59.583 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.34890.asok 2024-09-13T17:51:59.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:51:59.584 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.34890.asok status 2024-09-13T17:51:59.755 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-13T17:51:59.755 INFO:teuthology.orchestra.run.smithi114.stdout: "metadata": { 2024-09-13T17:51:59.755 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T17:51:59.755 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:51:59.755 INFO:teuthology.orchestra.run.smithi114.stdout: "entity_id": "admin", 2024-09-13T17:51:59.755 INFO:teuthology.orchestra.run.smithi114.stdout: "hostname": "smithi114", 2024-09-13T17:51:59.755 INFO:teuthology.orchestra.run.smithi114.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-13T17:51:59.755 INFO:teuthology.orchestra.run.smithi114.stdout: "pid": "34890", 2024-09-13T17:51:59.756 INFO:teuthology.orchestra.run.smithi114.stdout: "root": "/" 2024-09-13T17:51:59.756 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-13T17:51:59.756 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_count": 0, 2024-09-13T17:51:59.756 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_pinned_count": 0, 2024-09-13T17:51:59.756 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4440, 2024-09-13T17:51:59.756 INFO:teuthology.orchestra.run.smithi114.stdout: "inst": { 2024-09-13T17:51:59.756 INFO:teuthology.orchestra.run.smithi114.stdout: "name": { 2024-09-13T17:51:59.756 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "client", 2024-09-13T17:51:59.756 INFO:teuthology.orchestra.run.smithi114.stdout: "num": 4440 2024-09-13T17:51:59.756 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-13T17:51:59.756 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2024-09-13T17:51:59.756 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2024-09-13T17:51:59.756 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:51:59.757 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 3268201762 2024-09-13T17:51:59.757 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:51:59.757 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-13T17:51:59.757 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2024-09-13T17:51:59.757 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2024-09-13T17:51:59.757 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.1:0", 2024-09-13T17:51:59.757 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 3268201762 2024-09-13T17:51:59.757 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-13T17:51:59.757 INFO:teuthology.orchestra.run.smithi114.stdout: "inst_str": "client.4440 192.168.0.1:0/3268201762", 2024-09-13T17:51:59.757 INFO:teuthology.orchestra.run.smithi114.stdout: "addr_str": "192.168.0.1:0/3268201762", 2024-09-13T17:51:59.757 INFO:teuthology.orchestra.run.smithi114.stdout: "inode_count": 1, 2024-09-13T17:51:59.757 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_epoch": 7, 2024-09-13T17:51:59.757 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch": 24, 2024-09-13T17:51:59.758 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch_barrier": 0, 2024-09-13T17:51:59.758 INFO:teuthology.orchestra.run.smithi114.stdout: "blocklisted": false, 2024-09-13T17:51:59.758 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs" 2024-09-13T17:51:59.758 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-13T17:51:59.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:51:59.770 DEBUG:teuthology.orchestra.run.smithi114:> stat --file-system '--printf=%T 2024-09-13T17:51:59.770 DEBUG:teuthology.orchestra.run.smithi114:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:51:59.779 INFO:teuthology.orchestra.run.smithi114.stdout:fuseblk 2024-09-13T17:51:59.779 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:51:59.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:51:59.779 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:51:59.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:51:59.841 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-13T17:51:59.936 INFO:teuthology.orchestra.run.smithi114.stdout:# file: . 2024-09-13T17:51:59.936 INFO:teuthology.orchestra.run.smithi114.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-13T17:51:59.936 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:51:59.937 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:51:59.937 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:51:59.946 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:52:00.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.125+0000 7f3f0c400640 1 Processor -- start 2024-09-13T17:52:00.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.125+0000 7f3f0c400640 1 -- start start 2024-09-13T17:52:00.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.125+0000 7f3f0c400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3f0413c240 0x7f3f0413f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:00.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.125+0000 7f3f0c400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3f0413c980 0x7f3f0406d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:00.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.125+0000 7f3f0c400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f040cd220 con 0x7f3f0406da90 2024-09-13T17:52:00.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.125+0000 7f3f0c400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f0406df40 con 0x7f3f0413c240 2024-09-13T17:52:00.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.125+0000 7f3f0c400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f0413f960 con 0x7f3f0413c980 2024-09-13T17:52:00.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.129+0000 7f3f09a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3f0413c240 0x7f3f0413f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:00.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.129+0000 7f3f09a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3f0413c240 0x7f3f0413f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52930/0 (socket says 172.21.15.114:52930) 2024-09-13T17:52:00.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.129+0000 7f3f09a00640 1 -- 172.21.15.114:0/1692445968 learned_addr learned my addr 172.21.15.114:0/1692445968 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:00.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.129+0000 7f3f0a400640 1 --1- 172.21.15.114:0/1692445968 >> v1:172.21.15.114:6789/0 conn(0x7f3f0406da90 0x7f3f040cd650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49218/0 (socket says 172.21.15.114:49218) 2024-09-13T17:52:00.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.129+0000 7f3f09000640 1 --2- 172.21.15.114:0/1692445968 >> v2:172.21.15.134:3300/0 conn(0x7f3f0413c980 0x7f3f0406d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:00.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.129+0000 7f3f09a00640 1 -- 172.21.15.114:0/1692445968 >> v2:172.21.15.134:3300/0 conn(0x7f3f0413c980 msgr2=0x7f3f0406d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:00.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.129+0000 7f3f09a00640 1 --2- 172.21.15.114:0/1692445968 >> v2:172.21.15.134:3300/0 conn(0x7f3f0413c980 0x7f3f0406d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:00.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.129+0000 7f3f09a00640 1 -- 172.21.15.114:0/1692445968 >> v1:172.21.15.114:6789/0 conn(0x7f3f0406da90 legacy=0x7f3f040cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:00.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.129+0000 7f3f09a00640 1 -- 172.21.15.114:0/1692445968 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0415a740 con 0x7f3f0413c240 2024-09-13T17:52:00.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.129+0000 7f3f03e00640 1 -- 172.21.15.114:0/1692445968 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3366866375 0 0) 0x7f3f040cd220 con 0x7f3f0406da90 2024-09-13T17:52:00.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.129+0000 7f3f09a00640 1 --2- 172.21.15.114:0/1692445968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f0413c240 0x7f3f0413f420 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3f040ae130 tx=0x7f3ef801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8e1caf65c2761f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:00.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.129+0000 7f3f03e00640 1 -- 172.21.15.114:0/1692445968 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef80aa650 con 0x7f3f0413c240 2024-09-13T17:52:00.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.129+0000 7f3f03e00640 1 -- 172.21.15.114:0/1692445968 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef80aa7b0 con 0x7f3f0413c240 2024-09-13T17:52:00.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.129+0000 7f3f03e00640 1 -- 172.21.15.114:0/1692445968 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef80aab40 con 0x7f3f0413c240 2024-09-13T17:52:00.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.133+0000 7f3f0c400640 1 -- 172.21.15.114:0/1692445968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f0413c240 msgr2=0x7f3f0413f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:00.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.133+0000 7f3f0c400640 1 --2- 172.21.15.114:0/1692445968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f0413c240 0x7f3f0413f420 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3f040ae130 tx=0x7f3ef801c4f0 comp rx=0 tx=0).stop 2024-09-13T17:52:00.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.133+0000 7f3f0c400640 1 -- 172.21.15.114:0/1692445968 shutdown_connections 2024-09-13T17:52:00.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.133+0000 7f3f0c400640 1 --2- 172.21.15.114:0/1692445968 >> v2:172.21.15.134:3300/0 conn(0x7f3f0413c980 0x7f3f0406d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:00.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.133+0000 7f3f0c400640 1 --2- 172.21.15.114:0/1692445968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f0413c240 0x7f3f0413f420 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:00.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.133+0000 7f3f0c400640 1 -- 172.21.15.114:0/1692445968 >> 172.21.15.114:0/1692445968 conn(0x7f3f040660b0 msgr2=0x7f3f04069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:00.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.133+0000 7f3f0c400640 1 -- 172.21.15.114:0/1692445968 shutdown_connections 2024-09-13T17:52:00.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.133+0000 7f3f0c400640 1 -- 172.21.15.114:0/1692445968 wait complete. 2024-09-13T17:52:00.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.133+0000 7f3f0c400640 1 Processor -- start 2024-09-13T17:52:00.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.133+0000 7f3f0c400640 1 -- start start 2024-09-13T17:52:00.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.133+0000 7f3f0c400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f0406da90 0x7f3f0413af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:00.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.133+0000 7f3f0c400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3f0413c240 0x7f3f040c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:00.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.133+0000 7f3f0c400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f0413c980 0x7f3f040b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:00.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.133+0000 7f3f0c400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f04147390 con 0x7f3f0406da90 2024-09-13T17:52:00.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.133+0000 7f3f0c400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0413b4d0 con 0x7f3f0413c980 2024-09-13T17:52:00.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.133+0000 7f3f0c400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f04147630 con 0x7f3f0413c240 2024-09-13T17:52:00.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.133+0000 7f3f09a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f0406da90 0x7f3f0413af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:00.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.133+0000 7f3f09a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f0406da90 0x7f3f0413af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52944/0 (socket says 172.21.15.114:52944) 2024-09-13T17:52:00.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.133+0000 7f3f09a00640 1 -- 172.21.15.114:0/2941731315 learned_addr learned my addr 172.21.15.114:0/2941731315 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:00.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.133+0000 7f3f09a00640 1 -- 172.21.15.114:0/2941731315 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3f0413c240 msgr2=0x7f3f040c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:00.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.133+0000 7f3f09a00640 1 --2- 172.21.15.114:0/2941731315 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3f0413c240 0x7f3f040c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:00.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.133+0000 7f3f09a00640 1 -- 172.21.15.114:0/2941731315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f0413c980 msgr2=0x7f3f040b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:00.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.133+0000 7f3f09a00640 1 --2- 172.21.15.114:0/2941731315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f0413c980 0x7f3f040b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:00.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.133+0000 7f3f09a00640 1 -- 172.21.15.114:0/2941731315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef80094d0 con 0x7f3f0406da90 2024-09-13T17:52:00.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.133+0000 7f3f09a00640 1 --2- 172.21.15.114:0/2941731315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f0406da90 0x7f3f0413af90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8019100 tx=0x7f3ef801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:00.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.137+0000 7f3f01600640 1 -- 172.21.15.114:0/2941731315 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef80b3800 con 0x7f3f0406da90 2024-09-13T17:52:00.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.137+0000 7f3f01600640 1 -- 172.21.15.114:0/2941731315 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef80b3960 con 0x7f3f0406da90 2024-09-13T17:52:00.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.137+0000 7f3f01600640 1 -- 172.21.15.114:0/2941731315 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef80b3cf0 con 0x7f3f0406da90 2024-09-13T17:52:00.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.137+0000 7f3f0c400640 1 -- 172.21.15.114:0/2941731315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f04147910 con 0x7f3f0406da90 2024-09-13T17:52:00.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.137+0000 7f3f0c400640 1 -- 172.21.15.114:0/2941731315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f040c3710 con 0x7f3f0406da90 2024-09-13T17:52:00.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.137+0000 7f3f0c400640 1 -- 172.21.15.114:0/2941731315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f040667b0 con 0x7f3f0406da90 2024-09-13T17:52:00.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.137+0000 7f3f01600640 1 -- 172.21.15.114:0/2941731315 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3ef80b2380 con 0x7f3f0406da90 2024-09-13T17:52:00.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.137+0000 7f3f01600640 1 --2- 172.21.15.114:0/2941731315 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3ee4066690 0x7f3ee4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:00.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.137+0000 7f3f01600640 1 -- 172.21.15.114:0/2941731315 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3ef811ec30 con 0x7f3f0406da90 2024-09-13T17:52:00.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.137+0000 7f3f09000640 1 --2- 172.21.15.114:0/2941731315 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3ee4066690 0x7f3ee4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:00.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.137+0000 7f3f09000640 1 --2- 172.21.15.114:0/2941731315 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3ee4066690 0x7f3ee4068b50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0006aa0 tx=0x7f3ef0006a30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:00.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.141+0000 7f3f01600640 1 -- 172.21.15.114:0/2941731315 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3ef80ebdf0 con 0x7f3f0406da90 2024-09-13T17:52:00.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.297+0000 7f3f0c400640 1 -- 172.21.15.114:0/2941731315 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f04147770 con 0x7f3f0406da90 2024-09-13T17:52:00.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.297+0000 7f3f01600640 1 -- 172.21.15.114:0/2941731315 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18394 (secure 0 0 0) 0x7f3f04147770 con 0x7f3f0406da90 2024-09-13T17:52:00.300 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:00.300 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:51:54.213439+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:51:48.278220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:51:48.773888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:51:51.856300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:52:00.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.301+0000 7f3f0c400640 1 -- 172.21.15.114:0/2941731315 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3ee4066690 msgr2=0x7f3ee4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:00.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.301+0000 7f3f0c400640 1 --2- 172.21.15.114:0/2941731315 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3ee4066690 0x7f3ee4068b50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0006aa0 tx=0x7f3ef0006a30 comp rx=0 tx=0).stop 2024-09-13T17:52:00.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.301+0000 7f3f0c400640 1 -- 172.21.15.114:0/2941731315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f0406da90 msgr2=0x7f3f0413af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:00.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.301+0000 7f3f0c400640 1 --2- 172.21.15.114:0/2941731315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f0406da90 0x7f3f0413af90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8019100 tx=0x7f3ef801ad30 comp rx=0 tx=0).stop 2024-09-13T17:52:00.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.301+0000 7f3f0c400640 1 -- 172.21.15.114:0/2941731315 shutdown_connections 2024-09-13T17:52:00.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.301+0000 7f3f0c400640 1 --2- 172.21.15.114:0/2941731315 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3ee4066690 0x7f3ee4068b50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:00.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.301+0000 7f3f0c400640 1 --2- 172.21.15.114:0/2941731315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f0413c980 0x7f3f040b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:00.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.301+0000 7f3f0c400640 1 --2- 172.21.15.114:0/2941731315 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3f0413c240 0x7f3f040c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:00.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.301+0000 7f3f0c400640 1 --2- 172.21.15.114:0/2941731315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3f0406da90 0x7f3f0413af90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:00.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.301+0000 7f3f0c400640 1 -- 172.21.15.114:0/2941731315 >> 172.21.15.114:0/2941731315 conn(0x7f3f040660b0 msgr2=0x7f3f04158d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:00.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.301+0000 7f3f0c400640 1 -- 172.21.15.114:0/2941731315 shutdown_connections 2024-09-13T17:52:00.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.301+0000 7f3f0c400640 1 -- 172.21.15.114:0/2941731315 wait complete. 2024-09-13T17:52:00.322 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:51:37.996254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:51:48.278220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:51:48.773888+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:51:51.856300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:52:00.322 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:52:00.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.461+0000 7fc20a000640 1 Processor -- start 2024-09-13T17:52:00.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.461+0000 7fc20a000640 1 -- start start 2024-09-13T17:52:00.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.461+0000 7fc20a000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc20413f420 0x7fc20406d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:00.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.461+0000 7fc20a000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2040cd220 con 0x7fc20406da90 2024-09-13T17:52:00.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.461+0000 7fc20a000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20415a740 con 0x7fc20413c240 2024-09-13T17:52:00.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.461+0000 7fc20a000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20406df40 con 0x7fc20413f420 2024-09-13T17:52:00.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.461+0000 7fc202a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc20413f420 0x7fc20406d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:00.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.461+0000 7fc202a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc20413f420 0x7fc20406d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52948/0 (socket says 172.21.15.114:52948) 2024-09-13T17:52:00.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.461+0000 7fc202a00640 1 -- 172.21.15.114:0/739618337 learned_addr learned my addr 172.21.15.114:0/739618337 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:00.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.461+0000 7fc203e00640 1 --1- 172.21.15.114:0/739618337 >> v1:172.21.15.114:6789/0 conn(0x7fc20406da90 0x7fc2040cd650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49226/0 (socket says 172.21.15.114:49226) 2024-09-13T17:52:00.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.461+0000 7fc202a00640 1 -- 172.21.15.114:0/739618337 >> v1:172.21.15.134:6789/0 conn(0x7fc20413c240 legacy=0x7fc20413c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:00.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.461+0000 7fc202a00640 1 -- 172.21.15.114:0/739618337 >> v1:172.21.15.114:6789/0 conn(0x7fc20406da90 legacy=0x7fc2040cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:00.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.461+0000 7fc202a00640 1 -- 172.21.15.114:0/739618337 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc204159bc0 con 0x7fc20413f420 2024-09-13T17:52:00.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.465+0000 7fc202a00640 1 --2- 172.21.15.114:0/739618337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc20413f420 0x7fc20406d550 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0009870 tx=0x7fc1f001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235bcffcb3f8fc0e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:00.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.465+0000 7fc202000640 1 -- 172.21.15.114:0/739618337 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f00aa650 con 0x7fc20413f420 2024-09-13T17:52:00.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.465+0000 7fc202000640 1 -- 172.21.15.114:0/739618337 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f00aa7b0 con 0x7fc20413f420 2024-09-13T17:52:00.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.465+0000 7fc202000640 1 -- 172.21.15.114:0/739618337 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f00aab40 con 0x7fc20413f420 2024-09-13T17:52:00.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.465+0000 7fc20a000640 1 -- 172.21.15.114:0/739618337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc20413f420 msgr2=0x7fc20406d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:00.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.465+0000 7fc20a000640 1 --2- 172.21.15.114:0/739618337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc20413f420 0x7fc20406d550 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0009870 tx=0x7fc1f001c4f0 comp rx=0 tx=0).stop 2024-09-13T17:52:00.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.465+0000 7fc20a000640 1 -- 172.21.15.114:0/739618337 shutdown_connections 2024-09-13T17:52:00.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.465+0000 7fc20a000640 1 --2- 172.21.15.114:0/739618337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc20413f420 0x7fc20406d550 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:00.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.465+0000 7fc20a000640 1 -- 172.21.15.114:0/739618337 >> 172.21.15.114:0/739618337 conn(0x7fc2040660b0 msgr2=0x7fc204069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:00.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.465+0000 7fc20a000640 1 -- 172.21.15.114:0/739618337 shutdown_connections 2024-09-13T17:52:00.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.465+0000 7fc20a000640 1 -- 172.21.15.114:0/739618337 wait complete. 2024-09-13T17:52:00.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.465+0000 7fc20a000640 1 Processor -- start 2024-09-13T17:52:00.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.465+0000 7fc20a000640 1 -- start start 2024-09-13T17:52:00.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.469+0000 7fc20a000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc20406da90 0x7fc204152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:00.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.469+0000 7fc20a000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc20413c240 0x7fc2040ac160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:00.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.469+0000 7fc20a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc20413f420 0x7fc204138a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:00.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.469+0000 7fc20a000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2040ad380 con 0x7fc20413f420 2024-09-13T17:52:00.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.469+0000 7fc20a000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2040acdc0 con 0x7fc20406da90 2024-09-13T17:52:00.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.469+0000 7fc20a000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2040ad0a0 con 0x7fc20413c240 2024-09-13T17:52:00.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.469+0000 7fc203e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc20413f420 0x7fc204138a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:00.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.469+0000 7fc203e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc20413f420 0x7fc204138a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52960/0 (socket says 172.21.15.114:52960) 2024-09-13T17:52:00.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.469+0000 7fc203e00640 1 -- 172.21.15.114:0/112126694 learned_addr learned my addr 172.21.15.114:0/112126694 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:00.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.469+0000 7fc202a00640 1 --2- 172.21.15.114:0/112126694 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc20413c240 0x7fc2040ac160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:00.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.469+0000 7fc203400640 1 --2- 172.21.15.114:0/112126694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc20406da90 0x7fc204152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:00.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.469+0000 7fc203e00640 1 -- 172.21.15.114:0/112126694 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc20413c240 msgr2=0x7fc2040ac160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:00.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.469+0000 7fc203e00640 1 --2- 172.21.15.114:0/112126694 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc20413c240 0x7fc2040ac160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:00.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.469+0000 7fc203e00640 1 -- 172.21.15.114:0/112126694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc20406da90 msgr2=0x7fc204152e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:00.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.469+0000 7fc203e00640 1 --2- 172.21.15.114:0/112126694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc20406da90 0x7fc204152e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:00.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.469+0000 7fc203e00640 1 -- 172.21.15.114:0/112126694 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f00094d0 con 0x7fc20413f420 2024-09-13T17:52:00.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.469+0000 7fc203400640 1 --2- 172.21.15.114:0/112126694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc20406da90 0x7fc204152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:00.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.469+0000 7fc203e00640 1 --2- 172.21.15.114:0/112126694 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc20413f420 0x7fc204138a40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc00c3c0 tx=0x7fc1fc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:00.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.469+0000 7fc1fb400640 1 -- 172.21.15.114:0/112126694 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc0074e0 con 0x7fc20413f420 2024-09-13T17:52:00.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.469+0000 7fc1fb400640 1 -- 172.21.15.114:0/112126694 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1fc007640 con 0x7fc20413f420 2024-09-13T17:52:00.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.469+0000 7fc1fb400640 1 -- 172.21.15.114:0/112126694 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc004a10 con 0x7fc20413f420 2024-09-13T17:52:00.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.469+0000 7fc20a000640 1 -- 172.21.15.114:0/112126694 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2040ab980 con 0x7fc20413f420 2024-09-13T17:52:00.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.469+0000 7fc20a000640 1 -- 172.21.15.114:0/112126694 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc20413ae70 con 0x7fc20413f420 2024-09-13T17:52:00.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.469+0000 7fc20a000640 1 -- 172.21.15.114:0/112126694 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2040667b0 con 0x7fc20413f420 2024-09-13T17:52:00.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.469+0000 7fc1fb400640 1 -- 172.21.15.114:0/112126694 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc1fc004b70 con 0x7fc20413f420 2024-09-13T17:52:00.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.473+0000 7fc1fb400640 1 --2- 172.21.15.114:0/112126694 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc1e40666c0 0x7fc1e4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:00.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.473+0000 7fc1fb400640 1 -- 172.21.15.114:0/112126694 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc1fc083e60 con 0x7fc20413f420 2024-09-13T17:52:00.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.473+0000 7fc203400640 1 --2- 172.21.15.114:0/112126694 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc1e40666c0 0x7fc1e4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:00.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.473+0000 7fc203400640 1 --2- 172.21.15.114:0/112126694 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc1e40666c0 0x7fc1e4068b80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc1f40045c0 tx=0x7fc1f4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:00.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.477+0000 7fc1fb400640 1 -- 172.21.15.114:0/112126694 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc1fc050db0 con 0x7fc20413f420 2024-09-13T17:52:00.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.629+0000 7fc20a000640 1 -- 172.21.15.114:0/112126694 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc2040706b0 con 0x7fc20413f420 2024-09-13T17:52:00.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.629+0000 7fc1fb400640 1 -- 172.21.15.114:0/112126694 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc1fc0543d0 con 0x7fc20413f420 2024-09-13T17:52:00.631 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-13T17:52:00.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.629+0000 7fc20a000640 1 -- 172.21.15.114:0/112126694 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc1e40666c0 msgr2=0x7fc1e4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:00.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.629+0000 7fc20a000640 1 --2- 172.21.15.114:0/112126694 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc1e40666c0 0x7fc1e4068b80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc1f40045c0 tx=0x7fc1f4009040 comp rx=0 tx=0).stop 2024-09-13T17:52:00.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.629+0000 7fc20a000640 1 -- 172.21.15.114:0/112126694 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc20413f420 msgr2=0x7fc204138a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:00.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.629+0000 7fc20a000640 1 --2- 172.21.15.114:0/112126694 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc20413f420 0x7fc204138a40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc00c3c0 tx=0x7fc1fc00c880 comp rx=0 tx=0).stop 2024-09-13T17:52:00.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.629+0000 7fc20a000640 1 -- 172.21.15.114:0/112126694 shutdown_connections 2024-09-13T17:52:00.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.629+0000 7fc20a000640 1 --2- 172.21.15.114:0/112126694 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc1e40666c0 0x7fc1e4068b80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:00.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.629+0000 7fc20a000640 1 --2- 172.21.15.114:0/112126694 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc20413f420 0x7fc204138a40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:00.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.629+0000 7fc20a000640 1 --2- 172.21.15.114:0/112126694 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc20413c240 0x7fc2040ac160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:00.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.629+0000 7fc20a000640 1 --2- 172.21.15.114:0/112126694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc20406da90 0x7fc204152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:00.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.629+0000 7fc20a000640 1 -- 172.21.15.114:0/112126694 >> 172.21.15.114:0/112126694 conn(0x7fc2040660b0 msgr2=0x7fc2041578e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:00.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.629+0000 7fc20a000640 1 -- 172.21.15.114:0/112126694 shutdown_connections 2024-09-13T17:52:00.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.629+0000 7fc20a000640 1 -- 172.21.15.114:0/112126694 wait complete. 2024-09-13T17:52:00.651 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:52:00.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.785+0000 7f150d000640 1 Processor -- start 2024-09-13T17:52:00.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.785+0000 7f150d000640 1 -- start start 2024-09-13T17:52:00.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.789+0000 7f150d000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1508151420 0x7f15080cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:00.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.789+0000 7f150d000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1508070b30 0x7f150806c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:00.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.789+0000 7f150d000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1508151800 con 0x7f15080ccba0 2024-09-13T17:52:00.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.789+0000 7f150d000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15080cbc30 con 0x7f1508151420 2024-09-13T17:52:00.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.789+0000 7f150d000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15080cafb0 con 0x7f1508070b30 2024-09-13T17:52:00.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.789+0000 7f1505e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1508151420 0x7f15080cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:00.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.789+0000 7f1505e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1508151420 0x7f15080cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52976/0 (socket says 172.21.15.114:52976) 2024-09-13T17:52:00.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.789+0000 7f1505e00640 1 -- 172.21.15.114:0/1329073402 learned_addr learned my addr 172.21.15.114:0/1329073402 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:00.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.789+0000 7f1506800640 1 --2- 172.21.15.114:0/1329073402 >> v2:172.21.15.134:3300/0 conn(0x7f1508070b30 0x7f150806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:00.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.789+0000 7f1505e00640 1 -- 172.21.15.114:0/1329073402 >> v2:172.21.15.134:3300/0 conn(0x7f1508070b30 msgr2=0x7f150806c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:00.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.789+0000 7f1505e00640 1 --2- 172.21.15.114:0/1329073402 >> v2:172.21.15.134:3300/0 conn(0x7f1508070b30 0x7f150806c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:00.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.789+0000 7f1505e00640 1 -- 172.21.15.114:0/1329073402 >> v1:172.21.15.134:6789/0 conn(0x7f15080ccba0 legacy=0x7f1508070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:00.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.789+0000 7f1505e00640 1 -- 172.21.15.114:0/1329073402 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15080cb290 con 0x7f1508151420 2024-09-13T17:52:00.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.793+0000 7f1505e00640 1 --2- 172.21.15.114:0/1329073402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1508151420 0x7f15080cc660 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f15080b3980 tx=0x7f14f801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dab870e19b23840 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:00.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.793+0000 7f1505400640 1 -- 172.21.15.114:0/1329073402 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f80ab600 con 0x7f1508151420 2024-09-13T17:52:00.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.793+0000 7f1505400640 1 -- 172.21.15.114:0/1329073402 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f80a7050 con 0x7f1508151420 2024-09-13T17:52:00.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.793+0000 7f1505400640 1 -- 172.21.15.114:0/1329073402 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f80ab980 con 0x7f1508151420 2024-09-13T17:52:00.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.793+0000 7f150d000640 1 -- 172.21.15.114:0/1329073402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1508151420 msgr2=0x7f15080cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:00.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.793+0000 7f150d000640 1 --2- 172.21.15.114:0/1329073402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1508151420 0x7f15080cc660 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f15080b3980 tx=0x7f14f801c370 comp rx=0 tx=0).stop 2024-09-13T17:52:00.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.793+0000 7f150d000640 1 -- 172.21.15.114:0/1329073402 shutdown_connections 2024-09-13T17:52:00.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.793+0000 7f150d000640 1 --2- 172.21.15.114:0/1329073402 >> v2:172.21.15.134:3300/0 conn(0x7f1508070b30 0x7f150806c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:00.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.793+0000 7f150d000640 1 --2- 172.21.15.114:0/1329073402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1508151420 0x7f15080cc660 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:00.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.793+0000 7f150d000640 1 -- 172.21.15.114:0/1329073402 >> 172.21.15.114:0/1329073402 conn(0x7f15080660b0 msgr2=0x7f1508069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:00.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.793+0000 7f150d000640 1 -- 172.21.15.114:0/1329073402 shutdown_connections 2024-09-13T17:52:00.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.793+0000 7f150d000640 1 -- 172.21.15.114:0/1329073402 wait complete. 2024-09-13T17:52:00.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.793+0000 7f150d000640 1 Processor -- start 2024-09-13T17:52:00.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.793+0000 7f150d000640 1 -- start start 2024-09-13T17:52:00.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.797+0000 7f150d000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1508070b30 0x7f150814bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:00.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.797+0000 7f150d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15080ccba0 0x7f15080b2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:00.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.797+0000 7f150d000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1508151420 0x7f15080b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:00.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.797+0000 7f150d000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150814d6e0 con 0x7f15080ccba0 2024-09-13T17:52:00.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.797+0000 7f150d000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150814d9c0 con 0x7f1508070b30 2024-09-13T17:52:00.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.797+0000 7f150d000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150814dca0 con 0x7f1508151420 2024-09-13T17:52:00.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.797+0000 7f14fd400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15080ccba0 0x7f15080b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:00.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.797+0000 7f14fd400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15080ccba0 0x7f15080b2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:52984/0 (socket says 172.21.15.114:52984) 2024-09-13T17:52:00.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.797+0000 7f14fd400640 1 -- 172.21.15.114:0/2668875715 learned_addr learned my addr 172.21.15.114:0/2668875715 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:00.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.797+0000 7f1506800640 1 --2- 172.21.15.114:0/2668875715 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1508151420 0x7f15080b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:00.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.797+0000 7f1505e00640 1 --2- 172.21.15.114:0/2668875715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1508070b30 0x7f150814bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:00.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.797+0000 7f14fd400640 1 -- 172.21.15.114:0/2668875715 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1508151420 msgr2=0x7f15080b2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:00.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.797+0000 7f14fd400640 1 --2- 172.21.15.114:0/2668875715 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1508151420 0x7f15080b2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:00.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.797+0000 7f14fd400640 1 -- 172.21.15.114:0/2668875715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1508070b30 msgr2=0x7f150814bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:00.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.797+0000 7f14fd400640 1 --2- 172.21.15.114:0/2668875715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1508070b30 0x7f150814bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:00.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.797+0000 7f14fd400640 1 -- 172.21.15.114:0/2668875715 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f80094d0 con 0x7f15080ccba0 2024-09-13T17:52:00.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.797+0000 7f1505e00640 1 --2- 172.21.15.114:0/2668875715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1508070b30 0x7f150814bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:52:00.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.797+0000 7f14fd400640 1 --2- 172.21.15.114:0/2668875715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15080ccba0 0x7f15080b2850 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f14f000c450 tx=0x7f14f000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:00.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.797+0000 7f14fea00640 1 -- 172.21.15.114:0/2668875715 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f0012830 con 0x7f15080ccba0 2024-09-13T17:52:00.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.797+0000 7f14fea00640 1 -- 172.21.15.114:0/2668875715 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f00129b0 con 0x7f15080ccba0 2024-09-13T17:52:00.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.797+0000 7f14fea00640 1 -- 172.21.15.114:0/2668875715 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f0012d60 con 0x7f15080ccba0 2024-09-13T17:52:00.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.797+0000 7f150d000640 1 -- 172.21.15.114:0/2668875715 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150814df80 con 0x7f15080ccba0 2024-09-13T17:52:00.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.797+0000 7f150d000640 1 -- 172.21.15.114:0/2668875715 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150814bff0 con 0x7f15080ccba0 2024-09-13T17:52:00.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.797+0000 7f150d000640 1 -- 172.21.15.114:0/2668875715 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f150814e4a0 con 0x7f15080ccba0 2024-09-13T17:52:00.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.797+0000 7f14fea00640 1 -- 172.21.15.114:0/2668875715 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f14f001c460 con 0x7f15080ccba0 2024-09-13T17:52:00.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.801+0000 7f14fea00640 1 --2- 172.21.15.114:0/2668875715 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f14e4066690 0x7f14e4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:00.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.801+0000 7f14fea00640 1 -- 172.21.15.114:0/2668875715 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f14f0084280 con 0x7f15080ccba0 2024-09-13T17:52:00.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.801+0000 7f1505e00640 1 --2- 172.21.15.114:0/2668875715 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f14e4066690 0x7f14e4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:00.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.801+0000 7f1505e00640 1 --2- 172.21.15.114:0/2668875715 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f14e4066690 0x7f14e4068b50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f14f80ad000 tx=0x7f14f8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:00.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.801+0000 7f14fea00640 1 -- 172.21.15.114:0/2668875715 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f150814e4a0 con 0x7f15080ccba0 2024-09-13T17:52:00.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.957+0000 7f150d000640 1 -- 172.21.15.114:0/2668875715 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f150814e4a0 con 0x7f15080ccba0 2024-09-13T17:52:00.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.957+0000 7f14fea00640 1 -- 172.21.15.114:0/2668875715 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f150814e4a0 con 0x7f15080ccba0 2024-09-13T17:52:00.959 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:52:00.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.957+0000 7f150d000640 1 -- 172.21.15.114:0/2668875715 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f14e4066690 msgr2=0x7f14e4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:00.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.957+0000 7f150d000640 1 --2- 172.21.15.114:0/2668875715 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f14e4066690 0x7f14e4068b50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f14f80ad000 tx=0x7f14f8008040 comp rx=0 tx=0).stop 2024-09-13T17:52:00.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.957+0000 7f150d000640 1 -- 172.21.15.114:0/2668875715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15080ccba0 msgr2=0x7f15080b2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:00.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.957+0000 7f150d000640 1 --2- 172.21.15.114:0/2668875715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15080ccba0 0x7f15080b2850 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f14f000c450 tx=0x7f14f000c910 comp rx=0 tx=0).stop 2024-09-13T17:52:00.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.957+0000 7f150d000640 1 -- 172.21.15.114:0/2668875715 shutdown_connections 2024-09-13T17:52:00.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.961+0000 7f150d000640 1 --2- 172.21.15.114:0/2668875715 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f14e4066690 0x7f14e4068b50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:00.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.961+0000 7f150d000640 1 --2- 172.21.15.114:0/2668875715 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1508151420 0x7f15080b2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:00.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.961+0000 7f150d000640 1 --2- 172.21.15.114:0/2668875715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15080ccba0 0x7f15080b2850 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:00.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.961+0000 7f150d000640 1 --2- 172.21.15.114:0/2668875715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1508070b30 0x7f150814bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:00.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.961+0000 7f150d000640 1 -- 172.21.15.114:0/2668875715 >> 172.21.15.114:0/2668875715 conn(0x7f15080660b0 msgr2=0x7f150814a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:00.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.961+0000 7f150d000640 1 -- 172.21.15.114:0/2668875715 shutdown_connections 2024-09-13T17:52:00.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:00.961+0000 7f150d000640 1 -- 172.21.15.114:0/2668875715 wait complete. 2024-09-13T17:52:00.980 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:52:01.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.117+0000 7f1118e00640 1 Processor -- start 2024-09-13T17:52:01.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.117+0000 7f1118e00640 1 -- start start 2024-09-13T17:52:01.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.117+0000 7f1118e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1114070420 0x7f1114070800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:01.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.117+0000 7f1118e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1114160c30 0x7f111406c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:01.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.117+0000 7f1118e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1114070d40 con 0x7f11140cdfb0 2024-09-13T17:52:01.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.117+0000 7f1118e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f111406cd40 con 0x7f1114160c30 2024-09-13T17:52:01.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.117+0000 7f1118e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111406d020 con 0x7f1114070420 2024-09-13T17:52:01.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.117+0000 7f1109400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1114160c30 0x7f111406c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:01.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.117+0000 7f1109400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1114160c30 0x7f111406c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45766/0 (socket says 172.21.15.114:45766) 2024-09-13T17:52:01.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.117+0000 7f1109400640 1 -- 172.21.15.114:0/279333234 learned_addr learned my addr 172.21.15.114:0/279333234 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:01.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.117+0000 7f1111e00640 1 --2- 172.21.15.114:0/279333234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1114070420 0x7f1114070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:01.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.117+0000 7f1109400640 1 -- 172.21.15.114:0/279333234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1114070420 msgr2=0x7f1114070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:01.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.117+0000 7f1109400640 1 --2- 172.21.15.114:0/279333234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1114070420 0x7f1114070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.117+0000 7f1109400640 1 -- 172.21.15.114:0/279333234 >> v1:172.21.15.114:6789/0 conn(0x7f11140cdfb0 legacy=0x7f11140b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:01.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.117+0000 7f1109400640 1 -- 172.21.15.114:0/279333234 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11140b28d0 con 0x7f1114160c30 2024-09-13T17:52:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.121+0000 7f1109400640 1 --2- 172.21.15.114:0/279333234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1114160c30 0x7f111406c440 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f10fc009870 tx=0x7f10fc01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6800b8426eb9eba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.121+0000 7f1111400640 1 -- 172.21.15.114:0/279333234 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc0a9610 con 0x7f1114160c30 2024-09-13T17:52:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.121+0000 7f1111400640 1 -- 172.21.15.114:0/279333234 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10fc0a9770 con 0x7f1114160c30 2024-09-13T17:52:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.121+0000 7f1111400640 1 -- 172.21.15.114:0/279333234 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc0a9b00 con 0x7f1114160c30 2024-09-13T17:52:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.121+0000 7f1118e00640 1 -- 172.21.15.114:0/279333234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1114160c30 msgr2=0x7f111406c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.121+0000 7f1118e00640 1 --2- 172.21.15.114:0/279333234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1114160c30 0x7f111406c440 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f10fc009870 tx=0x7f10fc01c530 comp rx=0 tx=0).stop 2024-09-13T17:52:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.121+0000 7f1118e00640 1 -- 172.21.15.114:0/279333234 shutdown_connections 2024-09-13T17:52:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.121+0000 7f1118e00640 1 --2- 172.21.15.114:0/279333234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1114160c30 0x7f111406c440 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.121+0000 7f1118e00640 1 --2- 172.21.15.114:0/279333234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1114070420 0x7f1114070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.121+0000 7f1118e00640 1 -- 172.21.15.114:0/279333234 >> 172.21.15.114:0/279333234 conn(0x7f11140660b0 msgr2=0x7f1114069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.121+0000 7f1118e00640 1 -- 172.21.15.114:0/279333234 shutdown_connections 2024-09-13T17:52:01.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.121+0000 7f1118e00640 1 -- 172.21.15.114:0/279333234 wait complete. 2024-09-13T17:52:01.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.125+0000 7f1118e00640 1 Processor -- start 2024-09-13T17:52:01.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.125+0000 7f1118e00640 1 -- start start 2024-09-13T17:52:01.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.125+0000 7f1118e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1114070420 0x7f111414f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:01.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.125+0000 7f1118e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11140cdfb0 0x7f1114151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:01.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.125+0000 7f1118e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1114160c30 0x7f111415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:01.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.125+0000 7f1118e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11141592d0 con 0x7f11140cdfb0 2024-09-13T17:52:01.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.125+0000 7f1118e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11141594b0 con 0x7f1114070420 2024-09-13T17:52:01.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.125+0000 7f1118e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1114159790 con 0x7f1114160c30 2024-09-13T17:52:01.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.125+0000 7f1109400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11140cdfb0 0x7f1114151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:01.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.125+0000 7f1109400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11140cdfb0 0x7f1114151100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45774/0 (socket says 172.21.15.114:45774) 2024-09-13T17:52:01.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.125+0000 7f1109400640 1 -- 172.21.15.114:0/3790609227 learned_addr learned my addr 172.21.15.114:0/3790609227 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:01.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.125+0000 7f1111e00640 1 --2- 172.21.15.114:0/3790609227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1114070420 0x7f111414f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:01.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.125+0000 7f1112800640 1 --2- 172.21.15.114:0/3790609227 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1114160c30 0x7f111415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:01.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.125+0000 7f1109400640 1 -- 172.21.15.114:0/3790609227 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1114160c30 msgr2=0x7f111415c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:01.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.125+0000 7f1109400640 1 --2- 172.21.15.114:0/3790609227 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1114160c30 0x7f111415c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.125+0000 7f1109400640 1 -- 172.21.15.114:0/3790609227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1114070420 msgr2=0x7f111414f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:01.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.125+0000 7f1109400640 1 --2- 172.21.15.114:0/3790609227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1114070420 0x7f111414f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.125+0000 7f1109400640 1 -- 172.21.15.114:0/3790609227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10fc0094d0 con 0x7f11140cdfb0 2024-09-13T17:52:01.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.125+0000 7f1111e00640 1 --2- 172.21.15.114:0/3790609227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1114070420 0x7f111414f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:01.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.125+0000 7f1109400640 1 --2- 172.21.15.114:0/3790609227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11140cdfb0 0x7f1114151100 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f10fc01abe0 tx=0x7f10fc0192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:01.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.125+0000 7f110aa00640 1 -- 172.21.15.114:0/3790609227 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc0bb5f0 con 0x7f11140cdfb0 2024-09-13T17:52:01.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.125+0000 7f110aa00640 1 -- 172.21.15.114:0/3790609227 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10fc0bb770 con 0x7f11140cdfb0 2024-09-13T17:52:01.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.125+0000 7f110aa00640 1 -- 172.21.15.114:0/3790609227 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc0bbb20 con 0x7f11140cdfb0 2024-09-13T17:52:01.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.125+0000 7f1118e00640 1 -- 172.21.15.114:0/3790609227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1114159a70 con 0x7f11140cdfb0 2024-09-13T17:52:01.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.125+0000 7f1118e00640 1 -- 172.21.15.114:0/3790609227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f111415a030 con 0x7f11140cdfb0 2024-09-13T17:52:01.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.129+0000 7f1118e00640 1 -- 172.21.15.114:0/3790609227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f111415a220 con 0x7f11140cdfb0 2024-09-13T17:52:01.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.129+0000 7f110aa00640 1 -- 172.21.15.114:0/3790609227 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f10fc0bbc80 con 0x7f11140cdfb0 2024-09-13T17:52:01.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.129+0000 7f110aa00640 1 --2- 172.21.15.114:0/3790609227 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f10f0066690 0x7f10f0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:01.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.129+0000 7f110aa00640 1 -- 172.21.15.114:0/3790609227 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f10fc11e760 con 0x7f11140cdfb0 2024-09-13T17:52:01.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.129+0000 7f1111e00640 1 --2- 172.21.15.114:0/3790609227 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f10f0066690 0x7f10f0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:01.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.129+0000 7f1111e00640 1 --2- 172.21.15.114:0/3790609227 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f10f0066690 0x7f10f0068b50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1104009bb0 tx=0x7f1104008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:01.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.133+0000 7f110aa00640 1 -- 172.21.15.114:0/3790609227 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f10fc0eb870 con 0x7f11140cdfb0 2024-09-13T17:52:01.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.285+0000 7f1118e00640 1 -- 172.21.15.114:0/3790609227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1114070800 con 0x7f11140cdfb0 2024-09-13T17:52:01.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.285+0000 7f110aa00640 1 -- 172.21.15.114:0/3790609227 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f10fc0eee90 con 0x7f11140cdfb0 2024-09-13T17:52:01.289 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-09-13T17:52:01.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.289+0000 7f1118e00640 1 -- 172.21.15.114:0/3790609227 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f10f0066690 msgr2=0x7f10f0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:01.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.289+0000 7f1118e00640 1 --2- 172.21.15.114:0/3790609227 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f10f0066690 0x7f10f0068b50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1104009bb0 tx=0x7f1104008040 comp rx=0 tx=0).stop 2024-09-13T17:52:01.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.289+0000 7f1118e00640 1 -- 172.21.15.114:0/3790609227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11140cdfb0 msgr2=0x7f1114151100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:01.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.289+0000 7f1118e00640 1 --2- 172.21.15.114:0/3790609227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11140cdfb0 0x7f1114151100 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f10fc01abe0 tx=0x7f10fc0192d0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.289+0000 7f1118e00640 1 -- 172.21.15.114:0/3790609227 shutdown_connections 2024-09-13T17:52:01.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.289+0000 7f1118e00640 1 --2- 172.21.15.114:0/3790609227 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f10f0066690 0x7f10f0068b50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.289+0000 7f1118e00640 1 --2- 172.21.15.114:0/3790609227 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1114160c30 0x7f111415c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.289+0000 7f1118e00640 1 --2- 172.21.15.114:0/3790609227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11140cdfb0 0x7f1114151100 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.289+0000 7f1118e00640 1 --2- 172.21.15.114:0/3790609227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1114070420 0x7f111414f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.289+0000 7f1118e00640 1 -- 172.21.15.114:0/3790609227 >> 172.21.15.114:0/3790609227 conn(0x7f11140660b0 msgr2=0x7f11140ae8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:01.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.289+0000 7f1118e00640 1 -- 172.21.15.114:0/3790609227 shutdown_connections 2024-09-13T17:52:01.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.289+0000 7f1118e00640 1 -- 172.21.15.114:0/3790609227 wait complete. 2024-09-13T17:52:01.311 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:52:01.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.445+0000 7f0200400640 1 Processor -- start 2024-09-13T17:52:01.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.445+0000 7f0200400640 1 -- start start 2024-09-13T17:52:01.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.445+0000 7f0200400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f813c240 0x7f01f813f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:01.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.445+0000 7f0200400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f01f806dc60 0x7f01f80cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:01.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.445+0000 7f0200400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f80cd220 con 0x7f01f813c980 2024-09-13T17:52:01.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.445+0000 7f0200400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f813f960 con 0x7f01f806dc60 2024-09-13T17:52:01.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.445+0000 7f0200400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f815a740 con 0x7f01f813c240 2024-09-13T17:52:01.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.449+0000 7f01fda00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f813c240 0x7f01f813f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:01.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.449+0000 7f01fe400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f01f806dc60 0x7f01f80cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:01.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.449+0000 7f01fda00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f813c240 0x7f01f813f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:52436/0 (socket says 172.21.15.114:52436) 2024-09-13T17:52:01.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.449+0000 7f01fe400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f01f806dc60 0x7f01f80cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:46344/0 (socket says 172.21.15.114:46344) 2024-09-13T17:52:01.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.449+0000 7f01fda00640 1 -- 172.21.15.114:0/1626262305 learned_addr learned my addr 172.21.15.114:0/1626262305 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:01.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.449+0000 7f01fd000640 1 --1- 172.21.15.114:0/1626262305 >> v1:172.21.15.134:6789/0 conn(0x7f01f813c980 0x7f01f806d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:38430/0 (socket says 172.21.15.114:38430) 2024-09-13T17:52:01.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.449+0000 7f01f7e00640 1 -- 172.21.15.114:0/1626262305 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1619961603 0 0) 0x7f01f80cd220 con 0x7f01f813c980 2024-09-13T17:52:01.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.449+0000 7f01f7e00640 1 -- 172.21.15.114:0/1626262305 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01e0003530 con 0x7f01f813c980 2024-09-13T17:52:01.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.449+0000 7f01fda00640 1 -- 172.21.15.114:0/1626262305 >> v2:172.21.15.134:3300/0 conn(0x7f01f806dc60 msgr2=0x7f01f80cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:01.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.449+0000 7f01fda00640 1 --2- 172.21.15.114:0/1626262305 >> v2:172.21.15.134:3300/0 conn(0x7f01f806dc60 0x7f01f80cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.449+0000 7f01fda00640 1 -- 172.21.15.114:0/1626262305 >> v1:172.21.15.134:6789/0 conn(0x7f01f813c980 legacy=0x7f01f806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:01.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.449+0000 7f01fda00640 1 -- 172.21.15.114:0/1626262305 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f8159bc0 con 0x7f01f813c240 2024-09-13T17:52:01.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.449+0000 7f01fe400640 1 --2- 172.21.15.114:0/1626262305 >> v2:172.21.15.134:3300/0 conn(0x7f01f806dc60 0x7f01f80cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:52:01.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.449+0000 7f01fda00640 1 --2- 172.21.15.114:0/1626262305 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f813c240 0x7f01f813f420 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009870 tx=0x7f01ec01c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce229df3ccd8e877 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:01.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.453+0000 7f01f7e00640 1 -- 172.21.15.114:0/1626262305 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec0a95f0 con 0x7f01f813c240 2024-09-13T17:52:01.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.453+0000 7f01f7e00640 1 -- 172.21.15.114:0/1626262305 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ec0a9750 con 0x7f01f813c240 2024-09-13T17:52:01.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.453+0000 7f01f7e00640 1 -- 172.21.15.114:0/1626262305 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec0a9ae0 con 0x7f01f813c240 2024-09-13T17:52:01.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.453+0000 7f0200400640 1 -- 172.21.15.114:0/1626262305 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f813c240 msgr2=0x7f01f813f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:01.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.453+0000 7f0200400640 1 --2- 172.21.15.114:0/1626262305 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f813c240 0x7f01f813f420 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009870 tx=0x7f01ec01c530 comp rx=0 tx=0).stop 2024-09-13T17:52:01.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.453+0000 7f0200400640 1 -- 172.21.15.114:0/1626262305 shutdown_connections 2024-09-13T17:52:01.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.453+0000 7f0200400640 1 --2- 172.21.15.114:0/1626262305 >> v2:172.21.15.134:3300/0 conn(0x7f01f806dc60 0x7f01f80cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.453+0000 7f0200400640 1 --2- 172.21.15.114:0/1626262305 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f813c240 0x7f01f813f420 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.453+0000 7f0200400640 1 -- 172.21.15.114:0/1626262305 >> 172.21.15.114:0/1626262305 conn(0x7f01f80660b0 msgr2=0x7f01f8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:01.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.453+0000 7f0200400640 1 -- 172.21.15.114:0/1626262305 shutdown_connections 2024-09-13T17:52:01.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.453+0000 7f0200400640 1 -- 172.21.15.114:0/1626262305 wait complete. 2024-09-13T17:52:01.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.453+0000 7f0200400640 1 Processor -- start 2024-09-13T17:52:01.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.453+0000 7f0200400640 1 -- start start 2024-09-13T17:52:01.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.453+0000 7f0200400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01f806dc60 0x7f01f80c3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:01.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.453+0000 7f0200400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f813c240 0x7f01f813b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:01.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.453+0000 7f0200400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01f813c980 0x7f01f8141d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:01.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.453+0000 7f0200400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f813b970 con 0x7f01f806dc60 2024-09-13T17:52:01.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.453+0000 7f0200400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f80ae360 con 0x7f01f813c980 2024-09-13T17:52:01.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.453+0000 7f0200400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f80b0b90 con 0x7f01f813c240 2024-09-13T17:52:01.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.453+0000 7f01fda00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01f806dc60 0x7f01f80c3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:01.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.457+0000 7f01fda00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01f806dc60 0x7f01f80c3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45784/0 (socket says 172.21.15.114:45784) 2024-09-13T17:52:01.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.457+0000 7f01fda00640 1 -- 172.21.15.114:0/3026943632 learned_addr learned my addr 172.21.15.114:0/3026943632 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:01.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.457+0000 7f01fe400640 1 --2- 172.21.15.114:0/3026943632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01f813c980 0x7f01f8141d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:01.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.457+0000 7f01fd000640 1 --2- 172.21.15.114:0/3026943632 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f813c240 0x7f01f813b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:01.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.457+0000 7f01fda00640 1 -- 172.21.15.114:0/3026943632 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f813c240 msgr2=0x7f01f813b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:01.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.457+0000 7f01fda00640 1 --2- 172.21.15.114:0/3026943632 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f813c240 0x7f01f813b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.457+0000 7f01fda00640 1 -- 172.21.15.114:0/3026943632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01f813c980 msgr2=0x7f01f8141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:01.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.457+0000 7f01fda00640 1 --2- 172.21.15.114:0/3026943632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01f813c980 0x7f01f8141d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.457+0000 7f01fda00640 1 -- 172.21.15.114:0/3026943632 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f0009a70 con 0x7f01f806dc60 2024-09-13T17:52:01.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.457+0000 7f01fda00640 1 --2- 172.21.15.114:0/3026943632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01f806dc60 0x7f01f80c3480 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0ab040 tx=0x7f01ec0192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:01.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.457+0000 7f01f5600640 1 -- 172.21.15.114:0/3026943632 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec0bc650 con 0x7f01f806dc60 2024-09-13T17:52:01.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.457+0000 7f01f5600640 1 -- 172.21.15.114:0/3026943632 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ec0bc7d0 con 0x7f01f806dc60 2024-09-13T17:52:01.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.457+0000 7f01f5600640 1 -- 172.21.15.114:0/3026943632 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec0bcb80 con 0x7f01f806dc60 2024-09-13T17:52:01.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.457+0000 7f0200400640 1 -- 172.21.15.114:0/3026943632 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ec0094d0 con 0x7f01f806dc60 2024-09-13T17:52:01.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.457+0000 7f0200400640 1 -- 172.21.15.114:0/3026943632 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f8142a60 con 0x7f01f806dc60 2024-09-13T17:52:01.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.457+0000 7f0200400640 1 -- 172.21.15.114:0/3026943632 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f8159790 con 0x7f01f806dc60 2024-09-13T17:52:01.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.457+0000 7f01f5600640 1 -- 172.21.15.114:0/3026943632 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f01ec0b13f0 con 0x7f01f806dc60 2024-09-13T17:52:01.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.457+0000 7f01f5600640 1 --2- 172.21.15.114:0/3026943632 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f01d80666c0 0x7f01d8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:01.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.457+0000 7f01f5600640 1 -- 172.21.15.114:0/3026943632 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f01ec11eaa0 con 0x7f01f806dc60 2024-09-13T17:52:01.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.461+0000 7f01fd000640 1 --2- 172.21.15.114:0/3026943632 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f01d80666c0 0x7f01d8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:01.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.461+0000 7f01fd000640 1 --2- 172.21.15.114:0/3026943632 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f01d80666c0 0x7f01d8068b80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f01f81f8160 tx=0x7f01e4007d40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:01.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.461+0000 7f01f5600640 1 -- 172.21.15.114:0/3026943632 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f01ec0ebb40 con 0x7f01f806dc60 2024-09-13T17:52:01.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.617+0000 7f0200400640 1 -- 172.21.15.114:0/3026943632 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f01f80b2430 con 0x7f01f806dc60 2024-09-13T17:52:01.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.617+0000 7f01f5600640 1 -- 172.21.15.114:0/3026943632 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f01ec0c10a0 con 0x7f01f806dc60 2024-09-13T17:52:01.620 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:52:01.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.621+0000 7f0200400640 1 -- 172.21.15.114:0/3026943632 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f01d80666c0 msgr2=0x7f01d8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:01.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.621+0000 7f0200400640 1 --2- 172.21.15.114:0/3026943632 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f01d80666c0 0x7f01d8068b80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f01f81f8160 tx=0x7f01e4007d40 comp rx=0 tx=0).stop 2024-09-13T17:52:01.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.621+0000 7f0200400640 1 -- 172.21.15.114:0/3026943632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01f806dc60 msgr2=0x7f01f80c3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:01.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.621+0000 7f0200400640 1 --2- 172.21.15.114:0/3026943632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01f806dc60 0x7f01f80c3480 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0ab040 tx=0x7f01ec0192d0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.621+0000 7f0200400640 1 -- 172.21.15.114:0/3026943632 shutdown_connections 2024-09-13T17:52:01.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.621+0000 7f0200400640 1 --2- 172.21.15.114:0/3026943632 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f01d80666c0 0x7f01d8068b80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.621+0000 7f0200400640 1 --2- 172.21.15.114:0/3026943632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01f813c980 0x7f01f8141d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.621+0000 7f0200400640 1 --2- 172.21.15.114:0/3026943632 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f01f813c240 0x7f01f813b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.621+0000 7f0200400640 1 --2- 172.21.15.114:0/3026943632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01f806dc60 0x7f01f80c3480 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.621+0000 7f0200400640 1 -- 172.21.15.114:0/3026943632 >> 172.21.15.114:0/3026943632 conn(0x7f01f80660b0 msgr2=0x7f01f806c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:01.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.621+0000 7f0200400640 1 -- 172.21.15.114:0/3026943632 shutdown_connections 2024-09-13T17:52:01.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.621+0000 7f0200400640 1 -- 172.21.15.114:0/3026943632 wait complete. 2024-09-13T17:52:01.641 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:52:01.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3b00000640 1 Processor -- start 2024-09-13T17:52:01.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3b00000640 1 -- start start 2024-09-13T17:52:01.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3b00000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3af813f420 0x7f3af806d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:01.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3b00000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af80cd220 con 0x7f3af806da90 2024-09-13T17:52:01.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3b00000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af806ded0 con 0x7f3af813c240 2024-09-13T17:52:01.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3b00000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af815a740 con 0x7f3af813f420 2024-09-13T17:52:01.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3afe000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3af806da90 0x7f3af80cd650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:39552/0 (socket says 172.21.15.114:39552) 2024-09-13T17:52:01.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3afe000640 1 -- 172.21.15.114:0/1982050639 learned_addr learned my addr 172.21.15.114:0/1982050639 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:01.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3afcc00640 1 --2- 172.21.15.114:0/1982050639 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3af813f420 0x7f3af806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:01.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3af7e00640 1 -- 172.21.15.114:0/1982050639 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 528958425 0 0) 0x7f3af80cd220 con 0x7f3af806da90 2024-09-13T17:52:01.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3af7e00640 1 -- 172.21.15.114:0/1982050639 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ae0005740 con 0x7f3af806da90 2024-09-13T17:52:01.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3af7e00640 1 -- 172.21.15.114:0/1982050639 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1258597754 0 0) 0x7f3af806ded0 con 0x7f3af813c240 2024-09-13T17:52:01.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3af7e00640 1 -- 172.21.15.114:0/1982050639 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3af80cd220 con 0x7f3af813c240 2024-09-13T17:52:01.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3af7e00640 1 -- 172.21.15.114:0/1982050639 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2833191027 0 0) 0x7f3ae0005740 con 0x7f3af806da90 2024-09-13T17:52:01.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3af7e00640 1 -- 172.21.15.114:0/1982050639 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3af813f420 msgr2=0x7f3af806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:01.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3af7e00640 1 --2- 172.21.15.114:0/1982050639 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3af813f420 0x7f3af806d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3af7e00640 1 -- 172.21.15.114:0/1982050639 >> v1:172.21.15.134:6789/0 conn(0x7f3af813c240 legacy=0x7f3af813c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:01.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3af7e00640 1 -- 172.21.15.114:0/1982050639 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af8159bc0 con 0x7f3af806da90 2024-09-13T17:52:01.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3af7e00640 1 -- 172.21.15.114:0/1982050639 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7f3af0001a00 con 0x7f3af806da90 2024-09-13T17:52:01.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3afcc00640 1 --2- 172.21.15.114:0/1982050639 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3af813f420 0x7f3af806d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:52:01.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3af7e00640 1 -- 172.21.15.114:0/1982050639 >> v1:172.21.15.114:6789/0 conn(0x7f3af806da90 legacy=0x7f3af80cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:01.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3af7e00640 1 --2- 172.21.15.114:0/1982050639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ae0005d50 0x7f3ae0006150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:01.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3af7e00640 1 --2- 172.21.15.114:0/1982050639 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3af813f420 0x7f3ae00069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:01.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3af7e00640 1 --2- 172.21.15.114:0/1982050639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae0006f20 0x7f3ae00073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:01.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3af7e00640 1 -- 172.21.15.114:0/1982050639 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af815a740 con 0x7f3ae0005d50 2024-09-13T17:52:01.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3af7e00640 1 -- 172.21.15.114:0/1982050639 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae000dc50 con 0x7f3ae0006f20 2024-09-13T17:52:01.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3af7e00640 1 -- 172.21.15.114:0/1982050639 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae000dd90 con 0x7f3af813f420 2024-09-13T17:52:01.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3afd600640 1 --2- 172.21.15.114:0/1982050639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ae0005d50 0x7f3ae0006150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:01.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3afe000640 1 --2- 172.21.15.114:0/1982050639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae0006f20 0x7f3ae00073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:01.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3afcc00640 1 --2- 172.21.15.114:0/1982050639 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3af813f420 0x7f3ae00069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:01.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3afd600640 1 -- 172.21.15.114:0/1982050639 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3af813f420 msgr2=0x7f3ae00069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:01.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3afd600640 1 --2- 172.21.15.114:0/1982050639 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3af813f420 0x7f3ae00069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3afd600640 1 -- 172.21.15.114:0/1982050639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae0006f20 msgr2=0x7f3ae00073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:01.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3afd600640 1 --2- 172.21.15.114:0/1982050639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae0006f20 0x7f3ae00073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3afd600640 1 -- 172.21.15.114:0/1982050639 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae4009420 con 0x7f3ae0005d50 2024-09-13T17:52:01.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3afcc00640 1 --2- 172.21.15.114:0/1982050639 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3af813f420 0x7f3ae00069e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:01.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.777+0000 7f3afe000640 1 --2- 172.21.15.114:0/1982050639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae0006f20 0x7f3ae00073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:01.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.781+0000 7f3afd600640 1 --2- 172.21.15.114:0/1982050639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ae0005d50 0x7f3ae0006150 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3aec001900 tx=0x7f3aec01c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb61284f81edc54 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:01.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.781+0000 7f3af7e00640 1 -- 172.21.15.114:0/1982050639 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec0052d0 con 0x7f3ae0005d50 2024-09-13T17:52:01.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.781+0000 7f3af7e00640 1 -- 172.21.15.114:0/1982050639 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aec005450 con 0x7f3ae0005d50 2024-09-13T17:52:01.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.781+0000 7f3af7e00640 1 -- 172.21.15.114:0/1982050639 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec003840 con 0x7f3ae0005d50 2024-09-13T17:52:01.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.781+0000 7f3b00000640 1 -- 172.21.15.114:0/1982050639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ae0005d50 msgr2=0x7f3ae0006150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:01.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.781+0000 7f3b00000640 1 --2- 172.21.15.114:0/1982050639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ae0005d50 0x7f3ae0006150 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3aec001900 tx=0x7f3aec01c550 comp rx=0 tx=0).stop 2024-09-13T17:52:01.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.781+0000 7f3afe000640 1 -- 172.21.15.114:0/1982050639 reap_dead start 2024-09-13T17:52:01.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.781+0000 7f3b00000640 1 -- 172.21.15.114:0/1982050639 shutdown_connections 2024-09-13T17:52:01.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.781+0000 7f3b00000640 1 -- 172.21.15.114:0/1982050639 >> 172.21.15.114:0/1982050639 conn(0x7f3af80660b0 msgr2=0x7f3af8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:01.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.781+0000 7f3b00000640 1 -- 172.21.15.114:0/1982050639 shutdown_connections 2024-09-13T17:52:01.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.781+0000 7f3b00000640 1 -- 172.21.15.114:0/1982050639 wait complete. 2024-09-13T17:52:01.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.785+0000 7f3b00000640 1 Processor -- start 2024-09-13T17:52:01.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.785+0000 7f3b00000640 1 -- start start 2024-09-13T17:52:01.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.785+0000 7f3b00000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae0005d50 0x7f3af80b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:01.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.785+0000 7f3b00000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3af815f750 0x7f3af8158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:01.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.785+0000 7f3b00000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3af80af320 0x7f3af813d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:01.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.785+0000 7f3b00000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af80b0ec0 con 0x7f3af815f750 2024-09-13T17:52:01.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.785+0000 7f3b00000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af8158570 con 0x7f3ae0005d50 2024-09-13T17:52:01.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.785+0000 7f3b00000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af80af8e0 con 0x7f3af80af320 2024-09-13T17:52:01.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.785+0000 7f3afcc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3af815f750 0x7f3af8158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:01.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.785+0000 7f3afcc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3af815f750 0x7f3af8158030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45802/0 (socket says 172.21.15.114:45802) 2024-09-13T17:52:01.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.785+0000 7f3afcc00640 1 -- 172.21.15.114:0/4063712056 learned_addr learned my addr 172.21.15.114:0/4063712056 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:01.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.785+0000 7f3afd600640 1 --2- 172.21.15.114:0/4063712056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae0005d50 0x7f3af80b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:01.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.785+0000 7f3afe000640 1 --2- 172.21.15.114:0/4063712056 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3af80af320 0x7f3af813d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:01.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.785+0000 7f3afcc00640 1 -- 172.21.15.114:0/4063712056 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3af80af320 msgr2=0x7f3af813d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:01.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.785+0000 7f3afcc00640 1 --2- 172.21.15.114:0/4063712056 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3af80af320 0x7f3af813d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.785+0000 7f3afcc00640 1 -- 172.21.15.114:0/4063712056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae0005d50 msgr2=0x7f3af80b0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:01.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.785+0000 7f3afcc00640 1 --2- 172.21.15.114:0/4063712056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae0005d50 0x7f3af80b0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.785+0000 7f3afcc00640 1 -- 172.21.15.114:0/4063712056 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af80afbc0 con 0x7f3af815f750 2024-09-13T17:52:01.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.785+0000 7f3afcc00640 1 --2- 172.21.15.114:0/4063712056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3af815f750 0x7f3af8158030 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40118d0 tx=0x7f3ae4011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:01.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.785+0000 7f3af5600640 1 -- 172.21.15.114:0/4063712056 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae400fbd0 con 0x7f3af815f750 2024-09-13T17:52:01.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.785+0000 7f3af5600640 1 -- 172.21.15.114:0/4063712056 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae400fd30 con 0x7f3af815f750 2024-09-13T17:52:01.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.785+0000 7f3af5600640 1 -- 172.21.15.114:0/4063712056 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4015680 con 0x7f3af815f750 2024-09-13T17:52:01.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.785+0000 7f3b00000640 1 -- 172.21.15.114:0/4063712056 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af80afea0 con 0x7f3af815f750 2024-09-13T17:52:01.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.785+0000 7f3b00000640 1 -- 172.21.15.114:0/4063712056 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af80b0460 con 0x7f3af815f750 2024-09-13T17:52:01.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.789+0000 7f3b00000640 1 -- 172.21.15.114:0/4063712056 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af80b0620 con 0x7f3af815f750 2024-09-13T17:52:01.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.789+0000 7f3af5600640 1 -- 172.21.15.114:0/4063712056 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3ae40157e0 con 0x7f3af815f750 2024-09-13T17:52:01.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.789+0000 7f3af5600640 1 --2- 172.21.15.114:0/4063712056 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3ad80666c0 0x7f3ad8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:01.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.789+0000 7f3af5600640 1 -- 172.21.15.114:0/4063712056 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3ae4084db0 con 0x7f3af815f750 2024-09-13T17:52:01.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.789+0000 7f3afd600640 1 --2- 172.21.15.114:0/4063712056 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3ad80666c0 0x7f3ad8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:01.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.789+0000 7f3afd600640 1 --2- 172.21.15.114:0/4063712056 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3ad80666c0 0x7f3ad8068b80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3aec0ad000 tx=0x7f3aec0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:01.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.793+0000 7f3af5600640 1 -- 172.21.15.114:0/4063712056 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3ae4089070 con 0x7f3af815f750 2024-09-13T17:52:01.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.965+0000 7f3b00000640 1 -- 172.21.15.114:0/4063712056 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3af80caaf0 con 0x7f3af815f750 2024-09-13T17:52:01.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.965+0000 7f3af5600640 1 -- 172.21.15.114:0/4063712056 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3ae4051f00 con 0x7f3af815f750 2024-09-13T17:52:01.968 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-13T17:52:01.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.969+0000 7f3b00000640 1 -- 172.21.15.114:0/4063712056 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3ad80666c0 msgr2=0x7f3ad8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:01.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.969+0000 7f3b00000640 1 --2- 172.21.15.114:0/4063712056 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3ad80666c0 0x7f3ad8068b80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3aec0ad000 tx=0x7f3aec0a7000 comp rx=0 tx=0).stop 2024-09-13T17:52:01.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.969+0000 7f3b00000640 1 -- 172.21.15.114:0/4063712056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3af815f750 msgr2=0x7f3af8158030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:01.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.969+0000 7f3b00000640 1 --2- 172.21.15.114:0/4063712056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3af815f750 0x7f3af8158030 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40118d0 tx=0x7f3ae4011d90 comp rx=0 tx=0).stop 2024-09-13T17:52:01.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.969+0000 7f3b00000640 1 -- 172.21.15.114:0/4063712056 shutdown_connections 2024-09-13T17:52:01.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.969+0000 7f3b00000640 1 --2- 172.21.15.114:0/4063712056 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3ad80666c0 0x7f3ad8068b80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.969+0000 7f3b00000640 1 --2- 172.21.15.114:0/4063712056 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3af80af320 0x7f3af813d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.969+0000 7f3b00000640 1 --2- 172.21.15.114:0/4063712056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3af815f750 0x7f3af8158030 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.969+0000 7f3b00000640 1 --2- 172.21.15.114:0/4063712056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae0005d50 0x7f3af80b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:01.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.969+0000 7f3b00000640 1 -- 172.21.15.114:0/4063712056 >> 172.21.15.114:0/4063712056 conn(0x7f3af80660b0 msgr2=0x7f3af80ad8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:01.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.969+0000 7f3b00000640 1 -- 172.21.15.114:0/4063712056 shutdown_connections 2024-09-13T17:52:01.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:01.969+0000 7f3b00000640 1 -- 172.21.15.114:0/4063712056 wait complete. 2024-09-13T17:52:01.989 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:52:01.989 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:52:01.998 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:52:02.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.173+0000 7f4ca6c00640 1 Processor -- start 2024-09-13T17:52:02.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.173+0000 7f4ca6c00640 1 -- start start 2024-09-13T17:52:02.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.173+0000 7f4ca6c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ca0151420 0x7f4ca00cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:02.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.173+0000 7f4ca6c00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4ca00ccba0 0x7f4ca0070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:02.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.173+0000 7f4ca6c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca0070db0 con 0x7f4ca0070960 2024-09-13T17:52:02.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.173+0000 7f4ca6c00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca00cbc30 con 0x7f4ca00ccba0 2024-09-13T17:52:02.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.173+0000 7f4ca6c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca0151800 con 0x7f4ca0151420 2024-09-13T17:52:02.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.173+0000 7f4ca4c00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4ca0070960 0x7f4ca015df20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:39556/0 (socket says 172.21.15.114:39556) 2024-09-13T17:52:02.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.173+0000 7f4ca4c00640 1 -- 172.21.15.114:0/2505806766 learned_addr learned my addr 172.21.15.114:0/2505806766 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:02.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.173+0000 7f4c9fe00640 1 --2- 172.21.15.114:0/2505806766 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ca0151420 0x7f4ca00cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:02.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.173+0000 7f4c97400640 1 --2- 172.21.15.114:0/2505806766 >> v2:172.21.15.134:3300/0 conn(0x7f4ca00ccba0 0x7f4ca0070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:02.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.177+0000 7f4c9f400640 1 -- 172.21.15.114:0/2505806766 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3741097167 0 0) 0x7f4c980014a0 con 0x7f4ca0070960 2024-09-13T17:52:02.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.177+0000 7f4c9f400640 1 -- 172.21.15.114:0/2505806766 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c84003530 con 0x7f4ca0070960 2024-09-13T17:52:02.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.177+0000 7f4c9fe00640 1 -- 172.21.15.114:0/2505806766 >> v2:172.21.15.134:3300/0 conn(0x7f4ca00ccba0 msgr2=0x7f4ca0070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:02.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.177+0000 7f4c9fe00640 1 --2- 172.21.15.114:0/2505806766 >> v2:172.21.15.134:3300/0 conn(0x7f4ca00ccba0 0x7f4ca0070420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:02.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.177+0000 7f4c9fe00640 1 -- 172.21.15.114:0/2505806766 >> v1:172.21.15.114:6789/0 conn(0x7f4ca0070960 legacy=0x7f4ca015df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:02.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.177+0000 7f4c9fe00640 1 -- 172.21.15.114:0/2505806766 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca00cafb0 con 0x7f4ca0151420 2024-09-13T17:52:02.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.177+0000 7f4c9fe00640 1 --2- 172.21.15.114:0/2505806766 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ca0151420 0x7f4ca00cc660 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4c900097c0 tx=0x7f4c9001c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=689b04ee90572bfc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:02.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.177+0000 7f4c9f400640 1 -- 172.21.15.114:0/2505806766 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c90004230 con 0x7f4ca0151420 2024-09-13T17:52:02.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.177+0000 7f4c9f400640 1 -- 172.21.15.114:0/2505806766 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c900a7050 con 0x7f4ca0151420 2024-09-13T17:52:02.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.177+0000 7f4c9f400640 1 -- 172.21.15.114:0/2505806766 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c90003620 con 0x7f4ca0151420 2024-09-13T17:52:02.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.181+0000 7f4ca6c00640 1 -- 172.21.15.114:0/2505806766 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ca0151420 msgr2=0x7f4ca00cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:02.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.181+0000 7f4ca6c00640 1 --2- 172.21.15.114:0/2505806766 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ca0151420 0x7f4ca00cc660 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4c900097c0 tx=0x7f4c9001c350 comp rx=0 tx=0).stop 2024-09-13T17:52:02.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.181+0000 7f4ca6c00640 1 -- 172.21.15.114:0/2505806766 shutdown_connections 2024-09-13T17:52:02.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.181+0000 7f4ca6c00640 1 --2- 172.21.15.114:0/2505806766 >> v2:172.21.15.134:3300/0 conn(0x7f4ca00ccba0 0x7f4ca0070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:02.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.181+0000 7f4ca6c00640 1 --2- 172.21.15.114:0/2505806766 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ca0151420 0x7f4ca00cc660 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:02.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.181+0000 7f4ca6c00640 1 -- 172.21.15.114:0/2505806766 >> 172.21.15.114:0/2505806766 conn(0x7f4ca00660b0 msgr2=0x7f4ca0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:02.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.181+0000 7f4ca6c00640 1 -- 172.21.15.114:0/2505806766 shutdown_connections 2024-09-13T17:52:02.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.181+0000 7f4ca6c00640 1 -- 172.21.15.114:0/2505806766 wait complete. 2024-09-13T17:52:02.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.181+0000 7f4ca6c00640 1 Processor -- start 2024-09-13T17:52:02.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.181+0000 7f4ca6c00640 1 -- start start 2024-09-13T17:52:02.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.181+0000 7f4ca6c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ca0070960 0x7f4ca014cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:02.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.181+0000 7f4ca6c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ca00ccba0 0x7f4ca014f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:02.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.181+0000 7f4ca6c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ca0151420 0x7f4ca0151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:02.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.181+0000 7f4ca6c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca014d4f0 con 0x7f4ca0151420 2024-09-13T17:52:02.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.181+0000 7f4ca6c00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca00ae7c0 con 0x7f4ca00ccba0 2024-09-13T17:52:02.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.181+0000 7f4ca6c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca00ae490 con 0x7f4ca0070960 2024-09-13T17:52:02.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.181+0000 7f4ca4c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ca0151420 0x7f4ca0151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:02.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.181+0000 7f4ca4c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ca0151420 0x7f4ca0151cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45818/0 (socket says 172.21.15.114:45818) 2024-09-13T17:52:02.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.181+0000 7f4ca4c00640 1 -- 172.21.15.114:0/2632537950 learned_addr learned my addr 172.21.15.114:0/2632537950 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:02.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.181+0000 7f4c97400640 1 --2- 172.21.15.114:0/2632537950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ca00ccba0 0x7f4ca014f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:02.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.181+0000 7f4c9fe00640 1 --2- 172.21.15.114:0/2632537950 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ca0070960 0x7f4ca014cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:02.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.181+0000 7f4ca4c00640 1 -- 172.21.15.114:0/2632537950 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ca0070960 msgr2=0x7f4ca014cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:02.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.181+0000 7f4ca4c00640 1 --2- 172.21.15.114:0/2632537950 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ca0070960 0x7f4ca014cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:02.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.181+0000 7f4ca4c00640 1 -- 172.21.15.114:0/2632537950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ca00ccba0 msgr2=0x7f4ca014f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:02.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.181+0000 7f4ca4c00640 1 --2- 172.21.15.114:0/2632537950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ca00ccba0 0x7f4ca014f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:02.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.181+0000 7f4ca4c00640 1 -- 172.21.15.114:0/2632537950 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c90009420 con 0x7f4ca0151420 2024-09-13T17:52:02.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.185+0000 7f4ca4c00640 1 --2- 172.21.15.114:0/2632537950 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ca0151420 0x7f4ca0151cd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800cb40 tx=0x7f4c9800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:02.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.185+0000 7f4c9cc00640 1 -- 172.21.15.114:0/2632537950 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9800aca0 con 0x7f4ca0151420 2024-09-13T17:52:02.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.185+0000 7f4c9cc00640 1 -- 172.21.15.114:0/2632537950 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9800ae00 con 0x7f4ca0151420 2024-09-13T17:52:02.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.185+0000 7f4c9cc00640 1 -- 172.21.15.114:0/2632537950 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c98012620 con 0x7f4ca0151420 2024-09-13T17:52:02.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.185+0000 7f4ca6c00640 1 -- 172.21.15.114:0/2632537950 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca014fa50 con 0x7f4ca0151420 2024-09-13T17:52:02.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.185+0000 7f4ca6c00640 1 -- 172.21.15.114:0/2632537950 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca0150010 con 0x7f4ca0151420 2024-09-13T17:52:02.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.185+0000 7f4ca6c00640 1 -- 172.21.15.114:0/2632537950 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca00ae930 con 0x7f4ca0151420 2024-09-13T17:52:02.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.185+0000 7f4c9cc00640 1 -- 172.21.15.114:0/2632537950 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4c98007070 con 0x7f4ca0151420 2024-09-13T17:52:02.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.185+0000 7f4c9cc00640 1 --2- 172.21.15.114:0/2632537950 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4c7c066690 0x7f4c7c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:02.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.185+0000 7f4c9cc00640 1 -- 172.21.15.114:0/2632537950 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4c98084290 con 0x7f4ca0151420 2024-09-13T17:52:02.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.185+0000 7f4c9fe00640 1 --2- 172.21.15.114:0/2632537950 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4c7c066690 0x7f4c7c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:02.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.189+0000 7f4c9fe00640 1 --2- 172.21.15.114:0/2632537950 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4c7c066690 0x7f4c7c068b50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4c900ad000 tx=0x7f4c900a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:02.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.189+0000 7f4c9cc00640 1 -- 172.21.15.114:0/2632537950 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4c980513c0 con 0x7f4ca0151420 2024-09-13T17:52:02.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.345+0000 7f4ca6c00640 1 -- 172.21.15.114:0/2632537950 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ca0070db0 con 0x7f4ca0151420 2024-09-13T17:52:02.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.345+0000 7f4c9cc00640 1 -- 172.21.15.114:0/2632537950 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18394 (secure 0 0 0) 0x7f4ca0070db0 con 0x7f4ca0151420 2024-09-13T17:52:02.349 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:02.349 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:51:54.213439+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:51:48.278220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:51:48.773888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:51:51.856300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:52:02.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.349+0000 7f4ca6c00640 1 -- 172.21.15.114:0/2632537950 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4c7c066690 msgr2=0x7f4c7c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:02.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.349+0000 7f4ca6c00640 1 --2- 172.21.15.114:0/2632537950 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4c7c066690 0x7f4c7c068b50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4c900ad000 tx=0x7f4c900a6000 comp rx=0 tx=0).stop 2024-09-13T17:52:02.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.349+0000 7f4ca6c00640 1 -- 172.21.15.114:0/2632537950 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ca0151420 msgr2=0x7f4ca0151cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:02.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.349+0000 7f4ca6c00640 1 --2- 172.21.15.114:0/2632537950 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ca0151420 0x7f4ca0151cd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800cb40 tx=0x7f4c9800a060 comp rx=0 tx=0).stop 2024-09-13T17:52:02.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.349+0000 7f4ca6c00640 1 -- 172.21.15.114:0/2632537950 shutdown_connections 2024-09-13T17:52:02.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.349+0000 7f4ca6c00640 1 --2- 172.21.15.114:0/2632537950 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4c7c066690 0x7f4c7c068b50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:02.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.349+0000 7f4ca6c00640 1 --2- 172.21.15.114:0/2632537950 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ca0151420 0x7f4ca0151cd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:02.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.349+0000 7f4ca6c00640 1 --2- 172.21.15.114:0/2632537950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ca00ccba0 0x7f4ca014f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:02.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.349+0000 7f4ca6c00640 1 --2- 172.21.15.114:0/2632537950 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4ca0070960 0x7f4ca014cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:02.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.349+0000 7f4ca6c00640 1 -- 172.21.15.114:0/2632537950 >> 172.21.15.114:0/2632537950 conn(0x7f4ca00660b0 msgr2=0x7f4ca015a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:02.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.349+0000 7f4ca6c00640 1 -- 172.21.15.114:0/2632537950 shutdown_connections 2024-09-13T17:52:02.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.349+0000 7f4ca6c00640 1 -- 172.21.15.114:0/2632537950 wait complete. 2024-09-13T17:52:02.369 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:51:37.996254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:51:48.278220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:51:48.773888+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:51:51.856300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:52:02.370 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:52:02.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.505+0000 7f16d1200640 1 Processor -- start 2024-09-13T17:52:02.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.505+0000 7f16d1200640 1 -- start start 2024-09-13T17:52:02.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.505+0000 7f16d1200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f16cc13c240 0x7f16cc13f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:02.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.505+0000 7f16d1200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f16cc13c980 0x7f16cc06d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:02.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.505+0000 7f16d1200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16cc0cd220 con 0x7f16cc06da90 2024-09-13T17:52:02.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.505+0000 7f16d1200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16cc13f960 con 0x7f16cc13c240 2024-09-13T17:52:02.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.505+0000 7f16d1200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc06ded0 con 0x7f16cc13c980 2024-09-13T17:52:02.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.509+0000 7f16c9e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f16cc13c240 0x7f16cc13f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:02.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.509+0000 7f16c1400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f16cc13c980 0x7f16cc06d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:02.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.509+0000 7f16c1400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f16cc13c980 0x7f16cc06d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:52514/0 (socket says 172.21.15.114:52514) 2024-09-13T17:52:02.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.509+0000 7f16c1400640 1 -- 172.21.15.114:0/1843940275 learned_addr learned my addr 172.21.15.114:0/1843940275 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:02.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.509+0000 7f16c9e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f16cc13c240 0x7f16cc13f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:46394/0 (socket says 172.21.15.114:46394) 2024-09-13T17:52:02.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.509+0000 7f16c1400640 1 -- 172.21.15.114:0/1843940275 >> v2:172.21.15.134:3300/0 conn(0x7f16cc13c240 msgr2=0x7f16cc13f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:02.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.509+0000 7f16c1400640 1 --2- 172.21.15.114:0/1843940275 >> v2:172.21.15.134:3300/0 conn(0x7f16cc13c240 0x7f16cc13f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:02.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.509+0000 7f16c1400640 1 -- 172.21.15.114:0/1843940275 >> v1:172.21.15.134:6789/0 conn(0x7f16cc06da90 legacy=0x7f16cc0cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:02.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.509+0000 7f16c1400640 1 -- 172.21.15.114:0/1843940275 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc15a740 con 0x7f16cc13c980 2024-09-13T17:52:02.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.509+0000 7f16c1400640 1 --2- 172.21.15.114:0/1843940275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f16cc13c980 0x7f16cc06d550 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f16b4009870 tx=0x7f16b401c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51be4b5c01943db server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:02.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.513+0000 7f16c9400640 1 -- 172.21.15.114:0/1843940275 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b40a95f0 con 0x7f16cc13c980 2024-09-13T17:52:02.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.513+0000 7f16c9400640 1 -- 172.21.15.114:0/1843940275 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b40a9750 con 0x7f16cc13c980 2024-09-13T17:52:02.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.513+0000 7f16c9400640 1 -- 172.21.15.114:0/1843940275 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b40a9ae0 con 0x7f16cc13c980 2024-09-13T17:52:02.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.513+0000 7f16d1200640 1 -- 172.21.15.114:0/1843940275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f16cc13c980 msgr2=0x7f16cc06d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:02.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.513+0000 7f16d1200640 1 --2- 172.21.15.114:0/1843940275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f16cc13c980 0x7f16cc06d550 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f16b4009870 tx=0x7f16b401c530 comp rx=0 tx=0).stop 2024-09-13T17:52:02.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.513+0000 7f16d1200640 1 -- 172.21.15.114:0/1843940275 shutdown_connections 2024-09-13T17:52:02.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.513+0000 7f16d1200640 1 --2- 172.21.15.114:0/1843940275 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f16cc13c980 0x7f16cc06d550 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:02.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.513+0000 7f16d1200640 1 --2- 172.21.15.114:0/1843940275 >> v2:172.21.15.134:3300/0 conn(0x7f16cc13c240 0x7f16cc13f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:02.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.513+0000 7f16d1200640 1 -- 172.21.15.114:0/1843940275 >> 172.21.15.114:0/1843940275 conn(0x7f16cc0660b0 msgr2=0x7f16cc069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:02.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.513+0000 7f16d1200640 1 -- 172.21.15.114:0/1843940275 shutdown_connections 2024-09-13T17:52:02.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.513+0000 7f16d1200640 1 -- 172.21.15.114:0/1843940275 wait complete. 2024-09-13T17:52:02.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.513+0000 7f16d1200640 1 Processor -- start 2024-09-13T17:52:02.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.513+0000 7f16d1200640 1 -- start start 2024-09-13T17:52:02.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.513+0000 7f16d1200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16cc06da90 0x7f16cc139df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:02.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.513+0000 7f16d1200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16cc13c240 0x7f16cc0ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:02.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.513+0000 7f16d1200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f16cc13c980 0x7f16cc0acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:02.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.513+0000 7f16d1200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc13a330 con 0x7f16cc13c240 2024-09-13T17:52:02.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.513+0000 7f16d1200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc0ae320 con 0x7f16cc06da90 2024-09-13T17:52:02.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.513+0000 7f16d1200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc0ae600 con 0x7f16cc13c980 2024-09-13T17:52:02.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.513+0000 7f16c1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16cc13c240 0x7f16cc0ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:02.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.513+0000 7f16c1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16cc13c240 0x7f16cc0ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45822/0 (socket says 172.21.15.114:45822) 2024-09-13T17:52:02.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.513+0000 7f16c1400640 1 -- 172.21.15.114:0/2193222186 learned_addr learned my addr 172.21.15.114:0/2193222186 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:02.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.513+0000 7f16c9e00640 1 --2- 172.21.15.114:0/2193222186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16cc06da90 0x7f16cc139df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:02.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.513+0000 7f16ca800640 1 --2- 172.21.15.114:0/2193222186 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f16cc13c980 0x7f16cc0acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:02.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.517+0000 7f16c1400640 1 -- 172.21.15.114:0/2193222186 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f16cc13c980 msgr2=0x7f16cc0acdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:02.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.517+0000 7f16c1400640 1 --2- 172.21.15.114:0/2193222186 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f16cc13c980 0x7f16cc0acdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:02.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.517+0000 7f16c1400640 1 -- 172.21.15.114:0/2193222186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16cc06da90 msgr2=0x7f16cc139df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:02.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.517+0000 7f16c1400640 1 --2- 172.21.15.114:0/2193222186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16cc06da90 0x7f16cc139df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:02.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.517+0000 7f16c1400640 1 -- 172.21.15.114:0/2193222186 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b40094d0 con 0x7f16cc13c240 2024-09-13T17:52:02.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.517+0000 7f16c1400640 1 --2- 172.21.15.114:0/2193222186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16cc13c240 0x7f16cc0ac870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f16b401abe0 tx=0x7f16b40192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:02.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.517+0000 7f16c2a00640 1 -- 172.21.15.114:0/2193222186 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b40b1800 con 0x7f16cc13c240 2024-09-13T17:52:02.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.517+0000 7f16c2a00640 1 -- 172.21.15.114:0/2193222186 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b40b1960 con 0x7f16cc13c240 2024-09-13T17:52:02.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.517+0000 7f16d1200640 1 -- 172.21.15.114:0/2193222186 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16cc0ae8e0 con 0x7f16cc13c240 2024-09-13T17:52:02.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.517+0000 7f16c2a00640 1 -- 172.21.15.114:0/2193222186 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b40b1d10 con 0x7f16cc13c240 2024-09-13T17:52:02.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.517+0000 7f16d1200640 1 -- 172.21.15.114:0/2193222186 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16cc0aeea0 con 0x7f16cc13c240 2024-09-13T17:52:02.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.517+0000 7f16d1200640 1 -- 172.21.15.114:0/2193222186 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16cc0ce200 con 0x7f16cc13c240 2024-09-13T17:52:02.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.517+0000 7f16c2a00640 1 -- 172.21.15.114:0/2193222186 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f16b40bb3f0 con 0x7f16cc13c240 2024-09-13T17:52:02.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.517+0000 7f16c2a00640 1 --2- 172.21.15.114:0/2193222186 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f16a8066690 0x7f16a8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:02.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.517+0000 7f16c2a00640 1 -- 172.21.15.114:0/2193222186 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f16b411e8b0 con 0x7f16cc13c240 2024-09-13T17:52:02.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.517+0000 7f16c9e00640 1 --2- 172.21.15.114:0/2193222186 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f16a8066690 0x7f16a8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:02.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.521+0000 7f16c9e00640 1 --2- 172.21.15.114:0/2193222186 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f16a8066690 0x7f16a8068b50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0113e0 tx=0x7f16bc00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:02.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.521+0000 7f16c2a00640 1 -- 172.21.15.114:0/2193222186 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f16b40eb9e0 con 0x7f16cc13c240 2024-09-13T17:52:02.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.677+0000 7f16d1200640 1 -- 172.21.15.114:0/2193222186 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f16cc13b790 con 0x7f16cc13c240 2024-09-13T17:52:02.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.677+0000 7f16c2a00640 1 -- 172.21.15.114:0/2193222186 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f16b40ef000 con 0x7f16cc13c240 2024-09-13T17:52:02.679 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-13T17:52:02.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.677+0000 7f16d1200640 1 -- 172.21.15.114:0/2193222186 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f16a8066690 msgr2=0x7f16a8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:02.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.677+0000 7f16d1200640 1 --2- 172.21.15.114:0/2193222186 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f16a8066690 0x7f16a8068b50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0113e0 tx=0x7f16bc00b040 comp rx=0 tx=0).stop 2024-09-13T17:52:02.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.677+0000 7f16d1200640 1 -- 172.21.15.114:0/2193222186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16cc13c240 msgr2=0x7f16cc0ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:02.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.677+0000 7f16d1200640 1 --2- 172.21.15.114:0/2193222186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16cc13c240 0x7f16cc0ac870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f16b401abe0 tx=0x7f16b40192d0 comp rx=0 tx=0).stop 2024-09-13T17:52:02.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.677+0000 7f16d1200640 1 -- 172.21.15.114:0/2193222186 shutdown_connections 2024-09-13T17:52:02.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.677+0000 7f16d1200640 1 --2- 172.21.15.114:0/2193222186 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f16a8066690 0x7f16a8068b50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:02.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.677+0000 7f16d1200640 1 --2- 172.21.15.114:0/2193222186 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f16cc13c980 0x7f16cc0acdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:02.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.677+0000 7f16d1200640 1 --2- 172.21.15.114:0/2193222186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16cc13c240 0x7f16cc0ac870 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:02.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.677+0000 7f16d1200640 1 --2- 172.21.15.114:0/2193222186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f16cc06da90 0x7f16cc139df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:02.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.677+0000 7f16d1200640 1 -- 172.21.15.114:0/2193222186 >> 172.21.15.114:0/2193222186 conn(0x7f16cc0660b0 msgr2=0x7f16cc152f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:02.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.677+0000 7f16d1200640 1 -- 172.21.15.114:0/2193222186 shutdown_connections 2024-09-13T17:52:02.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.677+0000 7f16d1200640 1 -- 172.21.15.114:0/2193222186 wait complete. 2024-09-13T17:52:02.699 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:52:02.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.833+0000 7ff238c00640 1 Processor -- start 2024-09-13T17:52:02.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.833+0000 7ff238c00640 1 -- start start 2024-09-13T17:52:02.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff238c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff23413f420 0x7ff23406d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:02.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff238c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2340cd220 con 0x7ff23406da90 2024-09-13T17:52:02.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff238c00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff23406ded0 con 0x7ff23413c240 2024-09-13T17:52:02.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff238c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23415a740 con 0x7ff23413f420 2024-09-13T17:52:02.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff232800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff23406da90 0x7ff2340cd650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:39570/0 (socket says 172.21.15.114:39570) 2024-09-13T17:52:02.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff232800640 1 -- 172.21.15.114:0/1031239436 learned_addr learned my addr 172.21.15.114:0/1031239436 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:02.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff231400640 1 -- 172.21.15.114:0/1031239436 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3518880289 0 0) 0x7ff2340cd220 con 0x7ff23406da90 2024-09-13T17:52:02.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff229400640 1 --2- 172.21.15.114:0/1031239436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff23413f420 0x7ff23406d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:02.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff231400640 1 -- 172.21.15.114:0/1031239436 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff218005740 con 0x7ff23406da90 2024-09-13T17:52:02.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff231400640 1 -- 172.21.15.114:0/1031239436 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1365624526 0 0) 0x7ff218005740 con 0x7ff23406da90 2024-09-13T17:52:02.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff231400640 1 -- 172.21.15.114:0/1031239436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff23413f420 msgr2=0x7ff23406d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:02.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff231400640 1 --2- 172.21.15.114:0/1031239436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff23413f420 0x7ff23406d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:02.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff231400640 1 -- 172.21.15.114:0/1031239436 >> v1:172.21.15.134:6789/0 conn(0x7ff23413c240 legacy=0x7ff23413c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:02.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff231400640 1 -- 172.21.15.114:0/1031239436 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff234159bc0 con 0x7ff23406da90 2024-09-13T17:52:02.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff231400640 1 -- 172.21.15.114:0/1031239436 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7ff22c001a00 con 0x7ff23406da90 2024-09-13T17:52:02.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff231400640 1 -- 172.21.15.114:0/1031239436 >> v1:172.21.15.114:6789/0 conn(0x7ff23406da90 legacy=0x7ff2340cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:02.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff231400640 1 --2- 172.21.15.114:0/1031239436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff23413f420 0x7ff218005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:02.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff231400640 1 --2- 172.21.15.114:0/1031239436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff218006100 0x7ff2180069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:02.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff231400640 1 --2- 172.21.15.114:0/1031239436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff218006f20 0x7ff2180073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:02.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff231400640 1 -- 172.21.15.114:0/1031239436 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23415a740 con 0x7ff218006100 2024-09-13T17:52:02.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff231400640 1 -- 172.21.15.114:0/1031239436 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21800dc00 con 0x7ff218006f20 2024-09-13T17:52:02.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff231400640 1 -- 172.21.15.114:0/1031239436 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21800ddc0 con 0x7ff23413f420 2024-09-13T17:52:02.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff229400640 1 --2- 172.21.15.114:0/1031239436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff218006100 0x7ff2180069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:02.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff232800640 1 --2- 172.21.15.114:0/1031239436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff218006f20 0x7ff2180073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:02.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff231e00640 1 --2- 172.21.15.114:0/1031239436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff23413f420 0x7ff218005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:02.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff229400640 1 -- 172.21.15.114:0/1031239436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff23413f420 msgr2=0x7ff218005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:02.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff229400640 1 --2- 172.21.15.114:0/1031239436 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff23413f420 0x7ff218005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:02.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff229400640 1 -- 172.21.15.114:0/1031239436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff218006f20 msgr2=0x7ff2180073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:02.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff229400640 1 --2- 172.21.15.114:0/1031239436 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff218006f20 0x7ff2180073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:02.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.837+0000 7ff229400640 1 -- 172.21.15.114:0/1031239436 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff218005740 con 0x7ff218006100 2024-09-13T17:52:02.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.841+0000 7ff229400640 1 --2- 172.21.15.114:0/1031239436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff218006100 0x7ff2180069e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff21c009ae0 tx=0x7ff21c01c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de15a91147e19de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:02.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.841+0000 7ff231400640 1 -- 172.21.15.114:0/1031239436 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c0a55a0 con 0x7ff218006100 2024-09-13T17:52:02.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.841+0000 7ff231400640 1 -- 172.21.15.114:0/1031239436 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21c0a5700 con 0x7ff218006100 2024-09-13T17:52:02.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.841+0000 7ff231400640 1 -- 172.21.15.114:0/1031239436 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c0a5ab0 con 0x7ff218006100 2024-09-13T17:52:02.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.841+0000 7ff238c00640 1 -- 172.21.15.114:0/1031239436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff218006100 msgr2=0x7ff2180069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:02.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.841+0000 7ff238c00640 1 --2- 172.21.15.114:0/1031239436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff218006100 0x7ff2180069e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff21c009ae0 tx=0x7ff21c01c9b0 comp rx=0 tx=0).stop 2024-09-13T17:52:02.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.841+0000 7ff232800640 1 -- 172.21.15.114:0/1031239436 reap_dead start 2024-09-13T17:52:02.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.841+0000 7ff238c00640 1 -- 172.21.15.114:0/1031239436 shutdown_connections 2024-09-13T17:52:02.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.841+0000 7ff238c00640 1 -- 172.21.15.114:0/1031239436 >> 172.21.15.114:0/1031239436 conn(0x7ff2340660b0 msgr2=0x7ff234069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:02.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.841+0000 7ff238c00640 1 -- 172.21.15.114:0/1031239436 shutdown_connections 2024-09-13T17:52:02.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.841+0000 7ff238c00640 1 -- 172.21.15.114:0/1031239436 wait complete. 2024-09-13T17:52:02.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.845+0000 7ff238c00640 1 Processor -- start 2024-09-13T17:52:02.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.845+0000 7ff238c00640 1 -- start start 2024-09-13T17:52:02.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.845+0000 7ff238c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff218006100 0x7ff234139ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:02.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.845+0000 7ff238c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff2340ad2d0 0x7ff2340ad750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:02.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.845+0000 7ff238c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2341f5170 0x7ff2341f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:02.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.845+0000 7ff238c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2340c3840 con 0x7ff218006100 2024-09-13T17:52:02.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.845+0000 7ff238c00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2340adc90 con 0x7ff2341f5170 2024-09-13T17:52:02.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.845+0000 7ff238c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2341f5b30 con 0x7ff2340ad2d0 2024-09-13T17:52:02.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.845+0000 7ff231e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff218006100 0x7ff234139ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:02.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.845+0000 7ff231e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff218006100 0x7ff234139ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45844/0 (socket says 172.21.15.114:45844) 2024-09-13T17:52:02.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.845+0000 7ff231e00640 1 -- 172.21.15.114:0/20974672 learned_addr learned my addr 172.21.15.114:0/20974672 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:02.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.845+0000 7ff229400640 1 --2- 172.21.15.114:0/20974672 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff2340ad2d0 0x7ff2340ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:02.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.845+0000 7ff232800640 1 --2- 172.21.15.114:0/20974672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2341f5170 0x7ff2341f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:02.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.845+0000 7ff231e00640 1 -- 172.21.15.114:0/20974672 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff2340ad2d0 msgr2=0x7ff2340ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:02.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.845+0000 7ff231e00640 1 --2- 172.21.15.114:0/20974672 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff2340ad2d0 0x7ff2340ad750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:02.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.845+0000 7ff231e00640 1 -- 172.21.15.114:0/20974672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2341f5170 msgr2=0x7ff2341f55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:02.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.845+0000 7ff231e00640 1 --2- 172.21.15.114:0/20974672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2341f5170 0x7ff2341f55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:02.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.845+0000 7ff231e00640 1 -- 172.21.15.114:0/20974672 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23413a010 con 0x7ff218006100 2024-09-13T17:52:02.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.845+0000 7ff231e00640 1 --2- 172.21.15.114:0/20974672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff218006100 0x7ff234139ad0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff224011b70 tx=0x7ff22400f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:02.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.845+0000 7ff22aa00640 1 -- 172.21.15.114:0/20974672 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224011c60 con 0x7ff218006100 2024-09-13T17:52:02.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.845+0000 7ff22aa00640 1 -- 172.21.15.114:0/20974672 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff224011de0 con 0x7ff218006100 2024-09-13T17:52:02.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.845+0000 7ff238c00640 1 -- 172.21.15.114:0/20974672 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2341f5df0 con 0x7ff218006100 2024-09-13T17:52:02.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.845+0000 7ff22aa00640 1 -- 172.21.15.114:0/20974672 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224005310 con 0x7ff218006100 2024-09-13T17:52:02.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.845+0000 7ff238c00640 1 -- 172.21.15.114:0/20974672 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2341f3130 con 0x7ff218006100 2024-09-13T17:52:02.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.845+0000 7ff238c00640 1 -- 172.21.15.114:0/20974672 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2341f2c90 con 0x7ff218006100 2024-09-13T17:52:02.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.849+0000 7ff22aa00640 1 -- 172.21.15.114:0/20974672 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff224003600 con 0x7ff218006100 2024-09-13T17:52:02.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.849+0000 7ff22aa00640 1 --2- 172.21.15.114:0/20974672 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff210066690 0x7ff210068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:02.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.849+0000 7ff22aa00640 1 -- 172.21.15.114:0/20974672 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff224087d90 con 0x7ff218006100 2024-09-13T17:52:02.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.849+0000 7ff229400640 1 --2- 172.21.15.114:0/20974672 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff210066690 0x7ff210068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:02.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.849+0000 7ff229400640 1 --2- 172.21.15.114:0/20974672 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff210066690 0x7ff210068b50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff21c0af000 tx=0x7ff21c0046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:02.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:02.853+0000 7ff22aa00640 1 -- 172.21.15.114:0/20974672 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff224054e00 con 0x7ff218006100 2024-09-13T17:52:03.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.009+0000 7ff238c00640 1 -- 172.21.15.114:0/20974672 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff234070620 con 0x7ff218006100 2024-09-13T17:52:03.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.009+0000 7ff22aa00640 1 -- 172.21.15.114:0/20974672 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff224019020 con 0x7ff218006100 2024-09-13T17:52:03.013 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:52:03.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.013+0000 7ff238c00640 1 -- 172.21.15.114:0/20974672 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff210066690 msgr2=0x7ff210068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:03.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.013+0000 7ff238c00640 1 --2- 172.21.15.114:0/20974672 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff210066690 0x7ff210068b50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff21c0af000 tx=0x7ff21c0046d0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.013+0000 7ff238c00640 1 -- 172.21.15.114:0/20974672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff218006100 msgr2=0x7ff234139ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:03.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.013+0000 7ff238c00640 1 --2- 172.21.15.114:0/20974672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff218006100 0x7ff234139ad0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff224011b70 tx=0x7ff22400f5a0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.013+0000 7ff238c00640 1 -- 172.21.15.114:0/20974672 shutdown_connections 2024-09-13T17:52:03.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.013+0000 7ff238c00640 1 --2- 172.21.15.114:0/20974672 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff210066690 0x7ff210068b50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.013+0000 7ff238c00640 1 --2- 172.21.15.114:0/20974672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2341f5170 0x7ff2341f55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.013+0000 7ff238c00640 1 --2- 172.21.15.114:0/20974672 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff2340ad2d0 0x7ff2340ad750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.013+0000 7ff238c00640 1 --2- 172.21.15.114:0/20974672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff218006100 0x7ff234139ad0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.013+0000 7ff238c00640 1 -- 172.21.15.114:0/20974672 >> 172.21.15.114:0/20974672 conn(0x7ff2340660b0 msgr2=0x7ff234069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:03.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.013+0000 7ff238c00640 1 -- 172.21.15.114:0/20974672 shutdown_connections 2024-09-13T17:52:03.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.013+0000 7ff238c00640 1 -- 172.21.15.114:0/20974672 wait complete. 2024-09-13T17:52:03.034 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:52:03.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.169+0000 7fb1e4800640 1 Processor -- start 2024-09-13T17:52:03.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.169+0000 7fb1e4800640 1 -- start start 2024-09-13T17:52:03.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.169+0000 7fb1e4800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb1dc06dc60 0x7fb1dc0cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:03.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.169+0000 7fb1e4800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1dc0cd220 con 0x7fb1dc13c240 2024-09-13T17:52:03.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.169+0000 7fb1e4800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1dc15a740 con 0x7fb1dc13f420 2024-09-13T17:52:03.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.169+0000 7fb1e4800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1dc159bc0 con 0x7fb1dc06dc60 2024-09-13T17:52:03.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.169+0000 7fb1e2800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb1dc06dc60 0x7fb1dc0cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:03.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.173+0000 7fb1e1e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb1dc13c240 0x7fb1dc13c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:39578/0 (socket says 172.21.15.114:39578) 2024-09-13T17:52:03.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.173+0000 7fb1e1e00640 1 -- 172.21.15.114:0/1422730652 learned_addr learned my addr 172.21.15.114:0/1422730652 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:03.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.173+0000 7fb1e2800640 1 -- 172.21.15.114:0/1422730652 >> v1:172.21.15.134:6789/0 conn(0x7fb1dc13f420 legacy=0x7fb1dc06d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:03.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.173+0000 7fb1e2800640 1 -- 172.21.15.114:0/1422730652 >> v1:172.21.15.114:6789/0 conn(0x7fb1dc13c240 legacy=0x7fb1dc13c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:03.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.173+0000 7fb1e2800640 1 -- 172.21.15.114:0/1422730652 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1dc159ea0 con 0x7fb1dc06dc60 2024-09-13T17:52:03.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.173+0000 7fb1e0a00640 1 -- 172.21.15.114:0/1422730652 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1845636413 0 0) 0x7fb1dc0cd220 con 0x7fb1dc13c240 2024-09-13T17:52:03.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.173+0000 7fb1e2800640 1 --2- 172.21.15.114:0/1422730652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1dc06dc60 0x7fb1dc0cd650 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8009d90 tx=0x7fb1d801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7919bce92d1ddc76 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:03.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.173+0000 7fb1e0a00640 1 -- 172.21.15.114:0/1422730652 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d80a5970 con 0x7fb1dc06dc60 2024-09-13T17:52:03.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.173+0000 7fb1e0a00640 1 -- 172.21.15.114:0/1422730652 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d80a5ad0 con 0x7fb1dc06dc60 2024-09-13T17:52:03.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.173+0000 7fb1e0a00640 1 -- 172.21.15.114:0/1422730652 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d80a5e60 con 0x7fb1dc06dc60 2024-09-13T17:52:03.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.177+0000 7fb1e4800640 1 -- 172.21.15.114:0/1422730652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1dc06dc60 msgr2=0x7fb1dc0cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:03.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.177+0000 7fb1e4800640 1 --2- 172.21.15.114:0/1422730652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1dc06dc60 0x7fb1dc0cd650 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8009d90 tx=0x7fb1d801c8b0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.177+0000 7fb1e4800640 1 -- 172.21.15.114:0/1422730652 shutdown_connections 2024-09-13T17:52:03.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.177+0000 7fb1e4800640 1 --2- 172.21.15.114:0/1422730652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1dc06dc60 0x7fb1dc0cd650 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.177+0000 7fb1e4800640 1 -- 172.21.15.114:0/1422730652 >> 172.21.15.114:0/1422730652 conn(0x7fb1dc0660b0 msgr2=0x7fb1dc069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:03.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.177+0000 7fb1e4800640 1 -- 172.21.15.114:0/1422730652 shutdown_connections 2024-09-13T17:52:03.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.177+0000 7fb1e4800640 1 -- 172.21.15.114:0/1422730652 wait complete. 2024-09-13T17:52:03.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.177+0000 7fb1e4800640 1 Processor -- start 2024-09-13T17:52:03.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.177+0000 7fb1e4800640 1 -- start start 2024-09-13T17:52:03.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.177+0000 7fb1e4800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1dc06dc60 0x7fb1dc156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:03.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.177+0000 7fb1e4800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb1dc13c240 0x7fb1dc1385b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:03.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.177+0000 7fb1e4800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1dc13f420 0x7fb1dc0ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:03.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.177+0000 7fb1e4800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc157060 con 0x7fb1dc13f420 2024-09-13T17:52:03.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.177+0000 7fb1e4800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc151620 con 0x7fb1dc06dc60 2024-09-13T17:52:03.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.177+0000 7fb1e4800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc151900 con 0x7fb1dc13c240 2024-09-13T17:52:03.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.177+0000 7fb1e2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1dc13f420 0x7fb1dc0ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:03.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.177+0000 7fb1e2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1dc13f420 0x7fb1dc0ae180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45864/0 (socket says 172.21.15.114:45864) 2024-09-13T17:52:03.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.177+0000 7fb1e2800640 1 -- 172.21.15.114:0/3032187733 learned_addr learned my addr 172.21.15.114:0/3032187733 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:03.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.177+0000 7fb1e1400640 1 --2- 172.21.15.114:0/3032187733 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb1dc13c240 0x7fb1dc1385b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:03.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.177+0000 7fb1e1e00640 1 --2- 172.21.15.114:0/3032187733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1dc06dc60 0x7fb1dc156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:03.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.177+0000 7fb1e2800640 1 -- 172.21.15.114:0/3032187733 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb1dc13c240 msgr2=0x7fb1dc1385b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:03.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.177+0000 7fb1e2800640 1 --2- 172.21.15.114:0/3032187733 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb1dc13c240 0x7fb1dc1385b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.177+0000 7fb1e2800640 1 -- 172.21.15.114:0/3032187733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1dc06dc60 msgr2=0x7fb1dc156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:03.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.177+0000 7fb1e2800640 1 --2- 172.21.15.114:0/3032187733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1dc06dc60 0x7fb1dc156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.177+0000 7fb1e2800640 1 -- 172.21.15.114:0/3032187733 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d8009a70 con 0x7fb1dc13f420 2024-09-13T17:52:03.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.177+0000 7fb1e1e00640 1 --2- 172.21.15.114:0/3032187733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1dc06dc60 0x7fb1dc156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:03.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.177+0000 7fb1e2800640 1 --2- 172.21.15.114:0/3032187733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1dc13f420 0x7fb1dc0ae180 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb1d80b0040 tx=0x7fb1dc0ce3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:03.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.181+0000 7fb1d6000640 1 -- 172.21.15.114:0/3032187733 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d80ade20 con 0x7fb1dc13f420 2024-09-13T17:52:03.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.181+0000 7fb1d6000640 1 -- 172.21.15.114:0/3032187733 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d80b8420 con 0x7fb1dc13f420 2024-09-13T17:52:03.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.181+0000 7fb1d6000640 1 -- 172.21.15.114:0/3032187733 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d80b87d0 con 0x7fb1dc13f420 2024-09-13T17:52:03.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.181+0000 7fb1e4800640 1 -- 172.21.15.114:0/3032187733 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1dc151be0 con 0x7fb1dc13f420 2024-09-13T17:52:03.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.181+0000 7fb1e4800640 1 -- 172.21.15.114:0/3032187733 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1dc1521a0 con 0x7fb1dc13f420 2024-09-13T17:52:03.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.181+0000 7fb1e4800640 1 -- 172.21.15.114:0/3032187733 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1dc0705d0 con 0x7fb1dc13f420 2024-09-13T17:52:03.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.181+0000 7fb1d6000640 1 -- 172.21.15.114:0/3032187733 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb1d80b4040 con 0x7fb1dc13f420 2024-09-13T17:52:03.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.181+0000 7fb1d6000640 1 --2- 172.21.15.114:0/3032187733 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb1c0066690 0x7fb1c0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:03.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.181+0000 7fb1d6000640 1 -- 172.21.15.114:0/3032187733 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb1d811f2e0 con 0x7fb1dc13f420 2024-09-13T17:52:03.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.185+0000 7fb1e1e00640 1 --2- 172.21.15.114:0/3032187733 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb1c0066690 0x7fb1c0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:03.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.185+0000 7fb1e1e00640 1 --2- 172.21.15.114:0/3032187733 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb1c0066690 0x7fb1c0068b50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0007fd0 tx=0x7fb1d0007c80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:03.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.185+0000 7fb1d6000640 1 -- 172.21.15.114:0/3032187733 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb1d80ec5e0 con 0x7fb1dc13f420 2024-09-13T17:52:03.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.337+0000 7fb1e4800640 1 -- 172.21.15.114:0/3032187733 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb1dc0cd650 con 0x7fb1dc13f420 2024-09-13T17:52:03.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.341+0000 7fb1d6000640 1 -- 172.21.15.114:0/3032187733 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb1d80efc00 con 0x7fb1dc13f420 2024-09-13T17:52:03.341 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-09-13T17:52:03.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.341+0000 7fb1e4800640 1 -- 172.21.15.114:0/3032187733 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb1c0066690 msgr2=0x7fb1c0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:03.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.341+0000 7fb1e4800640 1 --2- 172.21.15.114:0/3032187733 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb1c0066690 0x7fb1c0068b50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0007fd0 tx=0x7fb1d0007c80 comp rx=0 tx=0).stop 2024-09-13T17:52:03.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.341+0000 7fb1e4800640 1 -- 172.21.15.114:0/3032187733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1dc13f420 msgr2=0x7fb1dc0ae180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:03.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.341+0000 7fb1e4800640 1 --2- 172.21.15.114:0/3032187733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1dc13f420 0x7fb1dc0ae180 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb1d80b0040 tx=0x7fb1dc0ce3a0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.341+0000 7fb1e4800640 1 -- 172.21.15.114:0/3032187733 shutdown_connections 2024-09-13T17:52:03.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.341+0000 7fb1e4800640 1 --2- 172.21.15.114:0/3032187733 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb1c0066690 0x7fb1c0068b50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.341+0000 7fb1e4800640 1 --2- 172.21.15.114:0/3032187733 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1dc13f420 0x7fb1dc0ae180 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.341+0000 7fb1e4800640 1 --2- 172.21.15.114:0/3032187733 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb1dc13c240 0x7fb1dc1385b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.341+0000 7fb1e4800640 1 --2- 172.21.15.114:0/3032187733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1dc06dc60 0x7fb1dc156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.341+0000 7fb1e4800640 1 -- 172.21.15.114:0/3032187733 >> 172.21.15.114:0/3032187733 conn(0x7fb1dc0660b0 msgr2=0x7fb1dc0b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:03.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.341+0000 7fb1e4800640 1 -- 172.21.15.114:0/3032187733 shutdown_connections 2024-09-13T17:52:03.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.341+0000 7fb1e4800640 1 -- 172.21.15.114:0/3032187733 wait complete. 2024-09-13T17:52:03.366 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:52:03.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.501+0000 7fa953200640 1 Processor -- start 2024-09-13T17:52:03.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.505+0000 7fa953200640 1 -- start start 2024-09-13T17:52:03.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.505+0000 7fa953200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa94c070420 0x7fa94c070860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:03.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.505+0000 7fa953200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa94c06c540 0x7fa94c06c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:03.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.505+0000 7fa953200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa94c070da0 con 0x7fa94c151420 2024-09-13T17:52:03.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.505+0000 7fa953200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa94c0cbc30 con 0x7fa94c06c540 2024-09-13T17:52:03.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.505+0000 7fa953200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c151800 con 0x7fa94c070420 2024-09-13T17:52:03.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.505+0000 7fa951200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa94c06c540 0x7fa94c06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:03.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.505+0000 7fa94be00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa94c151420 0x7fa94c0cc660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:39586/0 (socket says 172.21.15.114:39586) 2024-09-13T17:52:03.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.505+0000 7fa94be00640 1 -- 172.21.15.114:0/130030241 learned_addr learned my addr 172.21.15.114:0/130030241 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:03.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.505+0000 7fa94b400640 1 --2- 172.21.15.114:0/130030241 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa94c070420 0x7fa94c070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:03.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.505+0000 7fa951200640 1 -- 172.21.15.114:0/130030241 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa94c070420 msgr2=0x7fa94c070860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:03.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.505+0000 7fa951200640 1 --2- 172.21.15.114:0/130030241 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa94c070420 0x7fa94c070860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.505+0000 7fa951200640 1 -- 172.21.15.114:0/130030241 >> v1:172.21.15.114:6789/0 conn(0x7fa94c151420 legacy=0x7fa94c0cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:03.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.505+0000 7fa951200640 1 -- 172.21.15.114:0/130030241 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94c0cafb0 con 0x7fa94c06c540 2024-09-13T17:52:03.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.505+0000 7fa94b400640 1 --2- 172.21.15.114:0/130030241 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa94c070420 0x7fa94c070860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:52:03.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.509+0000 7fa951200640 1 --2- 172.21.15.114:0/130030241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa94c06c540 0x7fa94c06c990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa9440097c0 tx=0x7fa94401c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b7d87b70ec0cb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:03.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.509+0000 7fa94aa00640 1 -- 172.21.15.114:0/130030241 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa944004230 con 0x7fa94c06c540 2024-09-13T17:52:03.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.509+0000 7fa94aa00640 1 -- 172.21.15.114:0/130030241 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9440a7050 con 0x7fa94c06c540 2024-09-13T17:52:03.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.509+0000 7fa94aa00640 1 -- 172.21.15.114:0/130030241 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa944003620 con 0x7fa94c06c540 2024-09-13T17:52:03.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.509+0000 7fa953200640 1 -- 172.21.15.114:0/130030241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa94c06c540 msgr2=0x7fa94c06c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:03.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.509+0000 7fa953200640 1 --2- 172.21.15.114:0/130030241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa94c06c540 0x7fa94c06c990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa9440097c0 tx=0x7fa94401c350 comp rx=0 tx=0).stop 2024-09-13T17:52:03.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.509+0000 7fa953200640 1 -- 172.21.15.114:0/130030241 shutdown_connections 2024-09-13T17:52:03.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.509+0000 7fa953200640 1 --2- 172.21.15.114:0/130030241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa94c06c540 0x7fa94c06c990 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.509+0000 7fa953200640 1 --2- 172.21.15.114:0/130030241 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa94c070420 0x7fa94c070860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.509+0000 7fa953200640 1 -- 172.21.15.114:0/130030241 >> 172.21.15.114:0/130030241 conn(0x7fa94c0660b0 msgr2=0x7fa94c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:03.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.509+0000 7fa953200640 1 -- 172.21.15.114:0/130030241 shutdown_connections 2024-09-13T17:52:03.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.509+0000 7fa953200640 1 -- 172.21.15.114:0/130030241 wait complete. 2024-09-13T17:52:03.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.509+0000 7fa953200640 1 Processor -- start 2024-09-13T17:52:03.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.509+0000 7fa953200640 1 -- start start 2024-09-13T17:52:03.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.513+0000 7fa953200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa94c06c540 0x7fa94c0ae730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:03.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.513+0000 7fa953200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa94c070420 0x7fa94c13fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:03.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.513+0000 7fa953200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa94c151420 0x7fa94c0a74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:03.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.513+0000 7fa953200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c0afbc0 con 0x7fa94c06c540 2024-09-13T17:52:03.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.513+0000 7fa953200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c0aec70 con 0x7fa94c070420 2024-09-13T17:52:03.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.513+0000 7fa953200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c0aef40 con 0x7fa94c151420 2024-09-13T17:52:03.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.513+0000 7fa94be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa94c06c540 0x7fa94c0ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:03.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.513+0000 7fa94be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa94c06c540 0x7fa94c0ae730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45880/0 (socket says 172.21.15.114:45880) 2024-09-13T17:52:03.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.513+0000 7fa94be00640 1 -- 172.21.15.114:0/790008148 learned_addr learned my addr 172.21.15.114:0/790008148 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:03.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.513+0000 7fa951200640 1 --2- 172.21.15.114:0/790008148 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa94c151420 0x7fa94c0a74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:03.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.513+0000 7fa94b400640 1 --2- 172.21.15.114:0/790008148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa94c070420 0x7fa94c13fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:03.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.513+0000 7fa94be00640 1 -- 172.21.15.114:0/790008148 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa94c151420 msgr2=0x7fa94c0a74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:03.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.513+0000 7fa94be00640 1 --2- 172.21.15.114:0/790008148 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa94c151420 0x7fa94c0a74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.513+0000 7fa94be00640 1 -- 172.21.15.114:0/790008148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa94c070420 msgr2=0x7fa94c13fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:03.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.513+0000 7fa94be00640 1 --2- 172.21.15.114:0/790008148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa94c070420 0x7fa94c13fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.513+0000 7fa94be00640 1 -- 172.21.15.114:0/790008148 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa944009420 con 0x7fa94c06c540 2024-09-13T17:52:03.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.513+0000 7fa951200640 1 --2- 172.21.15.114:0/790008148 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa94c151420 0x7fa94c0a74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:52:03.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.513+0000 7fa94b400640 1 --2- 172.21.15.114:0/790008148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa94c070420 0x7fa94c13fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:52:03.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.513+0000 7fa94be00640 1 --2- 172.21.15.114:0/790008148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa94c06c540 0x7fa94c0ae730 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa93c00cb10 tx=0x7fa93c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:03.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.513+0000 7fa943e00640 1 -- 172.21.15.114:0/790008148 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c00ac70 con 0x7fa94c06c540 2024-09-13T17:52:03.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.513+0000 7fa943e00640 1 -- 172.21.15.114:0/790008148 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93c00add0 con 0x7fa94c06c540 2024-09-13T17:52:03.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.513+0000 7fa943e00640 1 -- 172.21.15.114:0/790008148 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c012620 con 0x7fa94c06c540 2024-09-13T17:52:03.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.513+0000 7fa953200640 1 -- 172.21.15.114:0/790008148 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94c0af220 con 0x7fa94c06c540 2024-09-13T17:52:03.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.513+0000 7fa953200640 1 -- 172.21.15.114:0/790008148 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94c0af7e0 con 0x7fa94c06c540 2024-09-13T17:52:03.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.513+0000 7fa953200640 1 -- 172.21.15.114:0/790008148 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa94c06c990 con 0x7fa94c06c540 2024-09-13T17:52:03.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.513+0000 7fa943e00640 1 -- 172.21.15.114:0/790008148 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa93c007070 con 0x7fa94c06c540 2024-09-13T17:52:03.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.517+0000 7fa943e00640 1 --2- 172.21.15.114:0/790008148 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa92c066690 0x7fa92c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:03.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.517+0000 7fa943e00640 1 -- 172.21.15.114:0/790008148 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa93c0844e0 con 0x7fa94c06c540 2024-09-13T17:52:03.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.517+0000 7fa94b400640 1 --2- 172.21.15.114:0/790008148 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa92c066690 0x7fa92c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:03.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.517+0000 7fa94b400640 1 --2- 172.21.15.114:0/790008148 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa92c066690 0x7fa92c068b50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa94c0cac60 tx=0x7fa938008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:03.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.521+0000 7fa943e00640 1 -- 172.21.15.114:0/790008148 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa93c0514c0 con 0x7fa94c06c540 2024-09-13T17:52:03.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.681+0000 7fa953200640 1 -- 172.21.15.114:0/790008148 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa94c0713e0 con 0x7fa94c06c540 2024-09-13T17:52:03.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.681+0000 7fa943e00640 1 -- 172.21.15.114:0/790008148 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa93c054ae0 con 0x7fa94c06c540 2024-09-13T17:52:03.684 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:52:03.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.685+0000 7fa953200640 1 -- 172.21.15.114:0/790008148 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa92c066690 msgr2=0x7fa92c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.685+0000 7fa953200640 1 --2- 172.21.15.114:0/790008148 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa92c066690 0x7fa92c068b50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa94c0cac60 tx=0x7fa938008040 comp rx=0 tx=0).stop 2024-09-13T17:52:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.685+0000 7fa953200640 1 -- 172.21.15.114:0/790008148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa94c06c540 msgr2=0x7fa94c0ae730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.685+0000 7fa953200640 1 --2- 172.21.15.114:0/790008148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa94c06c540 0x7fa94c0ae730 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa93c00cb10 tx=0x7fa93c00a060 comp rx=0 tx=0).stop 2024-09-13T17:52:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.685+0000 7fa953200640 1 -- 172.21.15.114:0/790008148 shutdown_connections 2024-09-13T17:52:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.685+0000 7fa953200640 1 --2- 172.21.15.114:0/790008148 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa92c066690 0x7fa92c068b50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.685+0000 7fa953200640 1 --2- 172.21.15.114:0/790008148 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa94c151420 0x7fa94c0a74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.685+0000 7fa953200640 1 --2- 172.21.15.114:0/790008148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa94c070420 0x7fa94c13fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.685+0000 7fa953200640 1 --2- 172.21.15.114:0/790008148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa94c06c540 0x7fa94c0ae730 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.685+0000 7fa953200640 1 -- 172.21.15.114:0/790008148 >> 172.21.15.114:0/790008148 conn(0x7fa94c0660b0 msgr2=0x7fa94c15bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.685+0000 7fa953200640 1 -- 172.21.15.114:0/790008148 shutdown_connections 2024-09-13T17:52:03.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.685+0000 7fa953200640 1 -- 172.21.15.114:0/790008148 wait complete. 2024-09-13T17:52:03.703 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:52:03.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.837+0000 7f187e400640 1 Processor -- start 2024-09-13T17:52:03.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.837+0000 7f187e400640 1 -- start start 2024-09-13T17:52:03.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.841+0000 7f187e400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1878151420 0x7f18780cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:03.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.841+0000 7f187e400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1878070b30 0x7f187806c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:03.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.841+0000 7f187e400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1878151800 con 0x7f18780ccba0 2024-09-13T17:52:03.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.841+0000 7f187e400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18780cbc30 con 0x7f1878070b30 2024-09-13T17:52:03.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.841+0000 7f187e400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18780cafb0 con 0x7f1878151420 2024-09-13T17:52:03.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.841+0000 7f1876a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f18780ccba0 0x7f1878070420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:39594/0 (socket says 172.21.15.114:39594) 2024-09-13T17:52:03.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.841+0000 7f1876a00640 1 -- 172.21.15.114:0/2518077960 learned_addr learned my addr 172.21.15.114:0/2518077960 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:03.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.841+0000 7f1877400640 1 --2- 172.21.15.114:0/2518077960 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1878151420 0x7f18780cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:03.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.841+0000 7f1877e00640 1 --2- 172.21.15.114:0/2518077960 >> v2:172.21.15.134:3300/0 conn(0x7f1878070b30 0x7f187806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:03.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.841+0000 7f1876000640 1 -- 172.21.15.114:0/2518077960 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2658766752 0 0) 0x7f1878151800 con 0x7f18780ccba0 2024-09-13T17:52:03.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.841+0000 7f1876000640 1 -- 172.21.15.114:0/2518077960 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f185c003530 con 0x7f18780ccba0 2024-09-13T17:52:03.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.841+0000 7f1877400640 1 -- 172.21.15.114:0/2518077960 >> v2:172.21.15.134:3300/0 conn(0x7f1878070b30 msgr2=0x7f187806c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:03.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.841+0000 7f1877400640 1 --2- 172.21.15.114:0/2518077960 >> v2:172.21.15.134:3300/0 conn(0x7f1878070b30 0x7f187806c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.841+0000 7f1877400640 1 -- 172.21.15.114:0/2518077960 >> v1:172.21.15.114:6789/0 conn(0x7f18780ccba0 legacy=0x7f1878070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:03.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.841+0000 7f1877400640 1 -- 172.21.15.114:0/2518077960 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18780cb290 con 0x7f1878151420 2024-09-13T17:52:03.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.845+0000 7f1877400640 1 --2- 172.21.15.114:0/2518077960 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1878151420 0x7f18780cc660 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1868009d90 tx=0x7f186801c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbbf14fe8cfd1ad6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:03.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.845+0000 7f1876000640 1 -- 172.21.15.114:0/2518077960 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18680a58e0 con 0x7f1878151420 2024-09-13T17:52:03.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.845+0000 7f1876000640 1 -- 172.21.15.114:0/2518077960 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18680a5a40 con 0x7f1878151420 2024-09-13T17:52:03.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.845+0000 7f1876000640 1 -- 172.21.15.114:0/2518077960 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18680a5dd0 con 0x7f1878151420 2024-09-13T17:52:03.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.845+0000 7f187e400640 1 -- 172.21.15.114:0/2518077960 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1878151420 msgr2=0x7f18780cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:03.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.845+0000 7f187e400640 1 --2- 172.21.15.114:0/2518077960 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1878151420 0x7f18780cc660 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1868009d90 tx=0x7f186801c820 comp rx=0 tx=0).stop 2024-09-13T17:52:03.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.845+0000 7f187e400640 1 -- 172.21.15.114:0/2518077960 shutdown_connections 2024-09-13T17:52:03.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.845+0000 7f187e400640 1 --2- 172.21.15.114:0/2518077960 >> v2:172.21.15.134:3300/0 conn(0x7f1878070b30 0x7f187806c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.845+0000 7f187e400640 1 --2- 172.21.15.114:0/2518077960 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1878151420 0x7f18780cc660 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.845+0000 7f187e400640 1 -- 172.21.15.114:0/2518077960 >> 172.21.15.114:0/2518077960 conn(0x7f18780660b0 msgr2=0x7f1878069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:03.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.845+0000 7f187e400640 1 -- 172.21.15.114:0/2518077960 shutdown_connections 2024-09-13T17:52:03.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.845+0000 7f187e400640 1 -- 172.21.15.114:0/2518077960 wait complete. 2024-09-13T17:52:03.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.845+0000 7f187e400640 1 Processor -- start 2024-09-13T17:52:03.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.845+0000 7f187e400640 1 -- start start 2024-09-13T17:52:03.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.845+0000 7f187e400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1878070b30 0x7f187813edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:03.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.845+0000 7f187e400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18780ccba0 0x7f1878163640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:03.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.849+0000 7f187e400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1878151420 0x7f18780afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:03.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.849+0000 7f187e400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187813f2f0 con 0x7f18780ccba0 2024-09-13T17:52:03.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.849+0000 7f187e400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1878163b80 con 0x7f1878070b30 2024-09-13T17:52:03.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.849+0000 7f187e400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18781625a0 con 0x7f1878151420 2024-09-13T17:52:03.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.849+0000 7f1876a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18780ccba0 0x7f1878163640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:03.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.849+0000 7f1876a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18780ccba0 0x7f1878163640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45896/0 (socket says 172.21.15.114:45896) 2024-09-13T17:52:03.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.849+0000 7f1876a00640 1 -- 172.21.15.114:0/4222711875 learned_addr learned my addr 172.21.15.114:0/4222711875 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:03.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.849+0000 7f1877400640 1 --2- 172.21.15.114:0/4222711875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1878070b30 0x7f187813edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:03.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.849+0000 7f1877e00640 1 --2- 172.21.15.114:0/4222711875 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1878151420 0x7f18780afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:03.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.849+0000 7f1876a00640 1 -- 172.21.15.114:0/4222711875 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1878151420 msgr2=0x7f18780afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:03.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.849+0000 7f1876a00640 1 --2- 172.21.15.114:0/4222711875 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1878151420 0x7f18780afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.849+0000 7f1876a00640 1 -- 172.21.15.114:0/4222711875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1878070b30 msgr2=0x7f187813edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:03.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.849+0000 7f1876a00640 1 --2- 172.21.15.114:0/4222711875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1878070b30 0x7f187813edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:03.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.849+0000 7f1876a00640 1 -- 172.21.15.114:0/4222711875 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1868009a70 con 0x7f18780ccba0 2024-09-13T17:52:03.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.849+0000 7f1876a00640 1 --2- 172.21.15.114:0/4222711875 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18780ccba0 0x7f1878163640 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1864001ec0 tx=0x7f186400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:03.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.849+0000 7f186f400640 1 -- 172.21.15.114:0/4222711875 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1864005cf0 con 0x7f18780ccba0 2024-09-13T17:52:03.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.849+0000 7f186f400640 1 -- 172.21.15.114:0/4222711875 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1864005e70 con 0x7f18780ccba0 2024-09-13T17:52:03.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.849+0000 7f187e400640 1 -- 172.21.15.114:0/4222711875 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1878162880 con 0x7f18780ccba0 2024-09-13T17:52:03.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.849+0000 7f186f400640 1 -- 172.21.15.114:0/4222711875 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18640072f0 con 0x7f18780ccba0 2024-09-13T17:52:03.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.849+0000 7f187e400640 1 -- 172.21.15.114:0/4222711875 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1878162e40 con 0x7f18780ccba0 2024-09-13T17:52:03.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.849+0000 7f187e400640 1 -- 172.21.15.114:0/4222711875 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f187815c780 con 0x7f18780ccba0 2024-09-13T17:52:03.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.849+0000 7f186f400640 1 -- 172.21.15.114:0/4222711875 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1864007450 con 0x7f18780ccba0 2024-09-13T17:52:03.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.853+0000 7f186f400640 1 --2- 172.21.15.114:0/4222711875 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1858066690 0x7f1858068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:03.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.853+0000 7f186f400640 1 -- 172.21.15.114:0/4222711875 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1864083970 con 0x7f18780ccba0 2024-09-13T17:52:03.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.853+0000 7f1877400640 1 --2- 172.21.15.114:0/4222711875 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1858066690 0x7f1858068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:03.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.853+0000 7f1877400640 1 --2- 172.21.15.114:0/4222711875 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1858066690 0x7f1858068b50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f18680af000 tx=0x7f18680a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:03.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:03.857+0000 7f186f400640 1 -- 172.21.15.114:0/4222711875 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1864050a00 con 0x7f18780ccba0 2024-09-13T17:52:04.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:04.021+0000 7f187e400640 1 -- 172.21.15.114:0/4222711875 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f187815c4a0 con 0x7f18780ccba0 2024-09-13T17:52:04.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:04.021+0000 7f186f400640 1 -- 172.21.15.114:0/4222711875 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1864017080 con 0x7f18780ccba0 2024-09-13T17:52:04.024 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-13T17:52:04.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:04.025+0000 7f187e400640 1 -- 172.21.15.114:0/4222711875 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1858066690 msgr2=0x7f1858068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:04.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:04.025+0000 7f187e400640 1 --2- 172.21.15.114:0/4222711875 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1858066690 0x7f1858068b50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f18680af000 tx=0x7f18680a7070 comp rx=0 tx=0).stop 2024-09-13T17:52:04.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:04.025+0000 7f187e400640 1 -- 172.21.15.114:0/4222711875 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18780ccba0 msgr2=0x7f1878163640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:04.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:04.025+0000 7f187e400640 1 --2- 172.21.15.114:0/4222711875 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18780ccba0 0x7f1878163640 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1864001ec0 tx=0x7f186400c820 comp rx=0 tx=0).stop 2024-09-13T17:52:04.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:04.025+0000 7f187e400640 1 -- 172.21.15.114:0/4222711875 shutdown_connections 2024-09-13T17:52:04.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:04.025+0000 7f187e400640 1 --2- 172.21.15.114:0/4222711875 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1858066690 0x7f1858068b50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:04.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:04.025+0000 7f187e400640 1 --2- 172.21.15.114:0/4222711875 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1878151420 0x7f18780afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:04.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:04.025+0000 7f187e400640 1 --2- 172.21.15.114:0/4222711875 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18780ccba0 0x7f1878163640 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:04.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:04.025+0000 7f187e400640 1 --2- 172.21.15.114:0/4222711875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1878070b30 0x7f187813edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:04.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:04.025+0000 7f187e400640 1 -- 172.21.15.114:0/4222711875 >> 172.21.15.114:0/4222711875 conn(0x7f18780660b0 msgr2=0x7f18780ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:04.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:04.025+0000 7f187e400640 1 -- 172.21.15.114:0/4222711875 shutdown_connections 2024-09-13T17:52:04.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:04.025+0000 7f187e400640 1 -- 172.21.15.114:0/4222711875 wait complete. 2024-09-13T17:52:04.044 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi114.front.sepia.ceph.com... 2024-09-13T17:52:04.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:04.045 DEBUG:teuthology.orchestra.run.smithi114:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-13T17:52:04.070 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi114.stderr:ceph-fuse[34890]: fuse finished with error 0 and tester_r 0 2024-09-13T17:52:04.072 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:52:10.174 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-09-13T17:52:10.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:10.175 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-13T17:52:10.199 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:52:10.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.385+0000 7f9fd3400640 1 Processor -- start 2024-09-13T17:52:10.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.385+0000 7f9fd3400640 1 -- start start 2024-09-13T17:52:10.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.385+0000 7f9fd3400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9fcc13f420 0x7f9fcc06d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:10.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.385+0000 7f9fd3400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fcc06da90 0x7f9fcc0cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:10.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.385+0000 7f9fd3400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fcc0cd220 con 0x7f9fcc13c240 2024-09-13T17:52:10.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.385+0000 7f9fd3400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fcc06df40 con 0x7f9fcc13f420 2024-09-13T17:52:10.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.385+0000 7f9fd3400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc15a740 con 0x7f9fcc06da90 2024-09-13T17:52:10.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.385+0000 7f9fcbe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9fcc13f420 0x7f9fcc06d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:10.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.385+0000 7f9fcbe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9fcc13f420 0x7f9fcc06d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45906/0 (socket says 172.21.15.114:45906) 2024-09-13T17:52:10.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.385+0000 7f9fcbe00640 1 -- 172.21.15.114:0/170837933 learned_addr learned my addr 172.21.15.114:0/170837933 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:10.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.385+0000 7f9fd1400640 1 --2- 172.21.15.114:0/170837933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fcc06da90 0x7f9fcc0cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:10.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.385+0000 7f9fcbe00640 1 -- 172.21.15.114:0/170837933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fcc06da90 msgr2=0x7f9fcc0cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:10.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.385+0000 7f9fcbe00640 1 --2- 172.21.15.114:0/170837933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fcc06da90 0x7f9fcc0cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:10.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.385+0000 7f9fcbe00640 1 -- 172.21.15.114:0/170837933 >> v1:172.21.15.134:6789/0 conn(0x7f9fcc13c240 legacy=0x7f9fcc13c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:10.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.385+0000 7f9fcbe00640 1 -- 172.21.15.114:0/170837933 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fcc159bc0 con 0x7f9fcc13f420 2024-09-13T17:52:10.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.389+0000 7f9fcbe00640 1 --2- 172.21.15.114:0/170837933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fcc13f420 0x7f9fcc06d550 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8009870 tx=0x7f9fb801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd742538b2a1bd00 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:10.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.389+0000 7f9fcb400640 1 -- 172.21.15.114:0/170837933 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb80a95f0 con 0x7f9fcc13f420 2024-09-13T17:52:10.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.389+0000 7f9fcb400640 1 -- 172.21.15.114:0/170837933 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb80a9750 con 0x7f9fcc13f420 2024-09-13T17:52:10.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.389+0000 7f9fcb400640 1 -- 172.21.15.114:0/170837933 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb80a9ae0 con 0x7f9fcc13f420 2024-09-13T17:52:10.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.389+0000 7f9fd3400640 1 -- 172.21.15.114:0/170837933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fcc13f420 msgr2=0x7f9fcc06d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:10.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.389+0000 7f9fd3400640 1 --2- 172.21.15.114:0/170837933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fcc13f420 0x7f9fcc06d550 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8009870 tx=0x7f9fb801c530 comp rx=0 tx=0).stop 2024-09-13T17:52:10.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.389+0000 7f9fd3400640 1 -- 172.21.15.114:0/170837933 shutdown_connections 2024-09-13T17:52:10.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.389+0000 7f9fd3400640 1 --2- 172.21.15.114:0/170837933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fcc06da90 0x7f9fcc0cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:10.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.389+0000 7f9fd3400640 1 --2- 172.21.15.114:0/170837933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fcc13f420 0x7f9fcc06d550 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:10.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.389+0000 7f9fd3400640 1 -- 172.21.15.114:0/170837933 >> 172.21.15.114:0/170837933 conn(0x7f9fcc0660b0 msgr2=0x7f9fcc069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:10.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.389+0000 7f9fd3400640 1 -- 172.21.15.114:0/170837933 shutdown_connections 2024-09-13T17:52:10.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.389+0000 7f9fd3400640 1 -- 172.21.15.114:0/170837933 wait complete. 2024-09-13T17:52:10.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.393+0000 7f9fd3400640 1 Processor -- start 2024-09-13T17:52:10.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.393+0000 7f9fd3400640 1 -- start start 2024-09-13T17:52:10.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.393+0000 7f9fd3400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fcc06da90 0x7f9fcc137e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:10.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.393+0000 7f9fd3400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fcc13c240 0x7f9fcc150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:10.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.393+0000 7f9fd3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fcc13f420 0x7f9fcc1500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:10.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.393+0000 7f9fd3400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc0af770 con 0x7f9fcc13f420 2024-09-13T17:52:10.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.393+0000 7f9fd3400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc0afa50 con 0x7f9fcc13c240 2024-09-13T17:52:10.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.393+0000 7f9fd3400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc0afd30 con 0x7f9fcc06da90 2024-09-13T17:52:10.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.393+0000 7f9fd1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fcc13f420 0x7f9fcc1500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:10.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.393+0000 7f9fd1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fcc13f420 0x7f9fcc1500d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45918/0 (socket says 172.21.15.114:45918) 2024-09-13T17:52:10.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.393+0000 7f9fd1400640 1 -- 172.21.15.114:0/3315888245 learned_addr learned my addr 172.21.15.114:0/3315888245 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:10.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.393+0000 7f9fcbe00640 1 --2- 172.21.15.114:0/3315888245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fcc13c240 0x7f9fcc150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:10.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.393+0000 7f9fd0a00640 1 --2- 172.21.15.114:0/3315888245 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fcc06da90 0x7f9fcc137e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:10.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.393+0000 7f9fd1400640 1 -- 172.21.15.114:0/3315888245 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fcc06da90 msgr2=0x7f9fcc137e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:10.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.393+0000 7f9fd1400640 1 --2- 172.21.15.114:0/3315888245 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fcc06da90 0x7f9fcc137e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:10.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.393+0000 7f9fd1400640 1 -- 172.21.15.114:0/3315888245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fcc13c240 msgr2=0x7f9fcc150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:10.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.393+0000 7f9fd1400640 1 --2- 172.21.15.114:0/3315888245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fcc13c240 0x7f9fcc150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:10.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.393+0000 7f9fd1400640 1 -- 172.21.15.114:0/3315888245 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb80094d0 con 0x7f9fcc13f420 2024-09-13T17:52:10.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.393+0000 7f9fd1400640 1 --2- 172.21.15.114:0/3315888245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fcc13f420 0x7f9fcc1500d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400efc0 tx=0x7f9fc400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:10.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.393+0000 7f9fc8c00640 1 -- 172.21.15.114:0/3315888245 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4014480 con 0x7f9fcc13f420 2024-09-13T17:52:10.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.393+0000 7f9fc8c00640 1 -- 172.21.15.114:0/3315888245 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc400f040 con 0x7f9fcc13f420 2024-09-13T17:52:10.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.393+0000 7f9fc8c00640 1 -- 172.21.15.114:0/3315888245 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4014820 con 0x7f9fcc13f420 2024-09-13T17:52:10.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.393+0000 7f9fd3400640 1 -- 172.21.15.114:0/3315888245 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fcc0b0010 con 0x7f9fcc13f420 2024-09-13T17:52:10.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.393+0000 7f9fd3400640 1 -- 172.21.15.114:0/3315888245 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fcc151a40 con 0x7f9fcc13f420 2024-09-13T17:52:10.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.393+0000 7f9fd3400640 1 -- 172.21.15.114:0/3315888245 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fcc159790 con 0x7f9fcc13f420 2024-09-13T17:52:10.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.397+0000 7f9fc8c00640 1 -- 172.21.15.114:0/3315888245 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9fc4014980 con 0x7f9fcc13f420 2024-09-13T17:52:10.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.397+0000 7f9fc8c00640 1 --2- 172.21.15.114:0/3315888245 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9fac066690 0x7f9fac068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:10.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.397+0000 7f9fc8c00640 1 -- 172.21.15.114:0/3315888245 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9fc4084f50 con 0x7f9fcc13f420 2024-09-13T17:52:10.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.397+0000 7f9fd0a00640 1 --2- 172.21.15.114:0/3315888245 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9fac066690 0x7f9fac068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:10.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.397+0000 7f9fd0a00640 1 --2- 172.21.15.114:0/3315888245 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9fac066690 0x7f9fac068b50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0007fd0 tx=0x7f9fc0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:10.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.401+0000 7f9fc8c00640 1 -- 172.21.15.114:0/3315888245 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9fc4051fe0 con 0x7f9fcc13f420 2024-09-13T17:52:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.553+0000 7f9fd3400640 1 -- 172.21.15.114:0/3315888245 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9fcc0b3310 con 0x7f9fcc13f420 2024-09-13T17:52:10.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.557+0000 7f9fc8c00640 1 -- 172.21.15.114:0/3315888245 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18394 (secure 0 0 0) 0x7f9fc4018020 con 0x7f9fcc13f420 2024-09-13T17:52:10.559 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:10.559 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:51:54.213439+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:51:48.278220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:51:48.773888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:51:51.856300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:52:10.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.557+0000 7f9fd3400640 1 -- 172.21.15.114:0/3315888245 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9fac066690 msgr2=0x7f9fac068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:10.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.557+0000 7f9fd3400640 1 --2- 172.21.15.114:0/3315888245 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9fac066690 0x7f9fac068b50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0007fd0 tx=0x7f9fc0009040 comp rx=0 tx=0).stop 2024-09-13T17:52:10.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.557+0000 7f9fd3400640 1 -- 172.21.15.114:0/3315888245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fcc13f420 msgr2=0x7f9fcc1500d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:10.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.557+0000 7f9fd3400640 1 --2- 172.21.15.114:0/3315888245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fcc13f420 0x7f9fcc1500d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400efc0 tx=0x7f9fc400c490 comp rx=0 tx=0).stop 2024-09-13T17:52:10.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.557+0000 7f9fd3400640 1 -- 172.21.15.114:0/3315888245 shutdown_connections 2024-09-13T17:52:10.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.557+0000 7f9fd3400640 1 --2- 172.21.15.114:0/3315888245 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9fac066690 0x7f9fac068b50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:10.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.557+0000 7f9fd3400640 1 --2- 172.21.15.114:0/3315888245 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fcc13f420 0x7f9fcc1500d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:10.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.557+0000 7f9fd3400640 1 --2- 172.21.15.114:0/3315888245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fcc13c240 0x7f9fcc150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:10.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.557+0000 7f9fd3400640 1 --2- 172.21.15.114:0/3315888245 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9fcc06da90 0x7f9fcc137e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:10.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.557+0000 7f9fd3400640 1 -- 172.21.15.114:0/3315888245 >> 172.21.15.114:0/3315888245 conn(0x7f9fcc0660b0 msgr2=0x7f9fcc13a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:10.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.557+0000 7f9fd3400640 1 -- 172.21.15.114:0/3315888245 shutdown_connections 2024-09-13T17:52:10.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.557+0000 7f9fd3400640 1 -- 172.21.15.114:0/3315888245 wait complete. 2024-09-13T17:52:10.581 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:52:10.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.713+0000 7feb00000640 1 Processor -- start 2024-09-13T17:52:10.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.713+0000 7feb00000640 1 -- start start 2024-09-13T17:52:10.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.713+0000 7feb00000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feaf8156db0 0x7feaf806d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.713+0000 7feb00000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7feaf815a320 0x7feaf815a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.713+0000 7feb00000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf806dd50 con 0x7feaf815aef0 2024-09-13T17:52:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.713+0000 7feb00000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf806e030 con 0x7feaf8156db0 2024-09-13T17:52:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.713+0000 7feb00000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf806e310 con 0x7feaf815a320 2024-09-13T17:52:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.713+0000 7feafd600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feaf8156db0 0x7feaf806d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.713+0000 7feafd600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feaf8156db0 0x7feaf806d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45932/0 (socket says 172.21.15.114:45932) 2024-09-13T17:52:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.713+0000 7feafd600640 1 -- 172.21.15.114:0/2238188501 learned_addr learned my addr 172.21.15.114:0/2238188501 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.713+0000 7feafcc00640 1 --2- 172.21.15.114:0/2238188501 >> v2:172.21.15.134:3300/0 conn(0x7feaf815a320 0x7feaf815a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.713+0000 7feafd600640 1 -- 172.21.15.114:0/2238188501 >> v2:172.21.15.134:3300/0 conn(0x7feaf815a320 msgr2=0x7feaf815a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.713+0000 7feafd600640 1 --2- 172.21.15.114:0/2238188501 >> v2:172.21.15.134:3300/0 conn(0x7feaf815a320 0x7feaf815a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.713+0000 7feafd600640 1 -- 172.21.15.114:0/2238188501 >> v1:172.21.15.134:6789/0 conn(0x7feaf815aef0 legacy=0x7feaf806edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.713+0000 7feafd600640 1 -- 172.21.15.114:0/2238188501 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf806e5f0 con 0x7feaf8156db0 2024-09-13T17:52:10.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.717+0000 7feafd600640 1 --2- 172.21.15.114:0/2238188501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feaf8156db0 0x7feaf806d640 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7feaf8072550 tx=0x7feaec01d3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c82fbb924b67ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:10.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.717+0000 7feaf7e00640 1 -- 172.21.15.114:0/2238188501 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec0a5730 con 0x7feaf8156db0 2024-09-13T17:52:10.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.717+0000 7feaf7e00640 1 -- 172.21.15.114:0/2238188501 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaec0a5890 con 0x7feaf8156db0 2024-09-13T17:52:10.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.717+0000 7feaf7e00640 1 -- 172.21.15.114:0/2238188501 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec0a5c20 con 0x7feaf8156db0 2024-09-13T17:52:10.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.717+0000 7feb00000640 1 -- 172.21.15.114:0/2238188501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feaf8156db0 msgr2=0x7feaf806d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:10.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.717+0000 7feb00000640 1 --2- 172.21.15.114:0/2238188501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feaf8156db0 0x7feaf806d640 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7feaf8072550 tx=0x7feaec01d3c0 comp rx=0 tx=0).stop 2024-09-13T17:52:10.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.717+0000 7feb00000640 1 -- 172.21.15.114:0/2238188501 shutdown_connections 2024-09-13T17:52:10.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.717+0000 7feb00000640 1 --2- 172.21.15.114:0/2238188501 >> v2:172.21.15.134:3300/0 conn(0x7feaf815a320 0x7feaf815a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:10.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.717+0000 7feb00000640 1 --2- 172.21.15.114:0/2238188501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feaf8156db0 0x7feaf806d640 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:10.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.717+0000 7feb00000640 1 -- 172.21.15.114:0/2238188501 >> 172.21.15.114:0/2238188501 conn(0x7feaf8098a70 msgr2=0x7feaf80b4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:10.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.717+0000 7feb00000640 1 -- 172.21.15.114:0/2238188501 shutdown_connections 2024-09-13T17:52:10.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.717+0000 7feb00000640 1 -- 172.21.15.114:0/2238188501 wait complete. 2024-09-13T17:52:10.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.721+0000 7feb00000640 1 Processor -- start 2024-09-13T17:52:10.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.721+0000 7feb00000640 1 -- start start 2024-09-13T17:52:10.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.721+0000 7feb00000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feaf8156db0 0x7feaf80ad420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:10.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.721+0000 7feb00000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feaf815a320 0x7feaf80b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:10.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.721+0000 7feb00000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feaf815aef0 0x7feaf8148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:10.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.721+0000 7feb00000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf80ae6c0 con 0x7feaf8156db0 2024-09-13T17:52:10.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.721+0000 7feb00000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf80b1bd0 con 0x7feaf815aef0 2024-09-13T17:52:10.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.721+0000 7feb00000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf81494d0 con 0x7feaf815a320 2024-09-13T17:52:10.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.721+0000 7feafd600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feaf8156db0 0x7feaf80ad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:10.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.721+0000 7feafd600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feaf8156db0 0x7feaf80ad420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45944/0 (socket says 172.21.15.114:45944) 2024-09-13T17:52:10.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.721+0000 7feafd600640 1 -- 172.21.15.114:0/2500760789 learned_addr learned my addr 172.21.15.114:0/2500760789 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:10.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.721+0000 7feafcc00640 1 --2- 172.21.15.114:0/2500760789 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feaf815a320 0x7feaf80b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:10.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.721+0000 7feafe000640 1 --2- 172.21.15.114:0/2500760789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feaf815aef0 0x7feaf8148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:10.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.721+0000 7feafd600640 1 -- 172.21.15.114:0/2500760789 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feaf815a320 msgr2=0x7feaf80b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:10.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.721+0000 7feafd600640 1 --2- 172.21.15.114:0/2500760789 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feaf815a320 0x7feaf80b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:10.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.721+0000 7feafd600640 1 -- 172.21.15.114:0/2500760789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feaf815aef0 msgr2=0x7feaf8148f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:10.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.721+0000 7feafd600640 1 --2- 172.21.15.114:0/2500760789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feaf815aef0 0x7feaf8148f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:10.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.721+0000 7feafd600640 1 -- 172.21.15.114:0/2500760789 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaec009b30 con 0x7feaf8156db0 2024-09-13T17:52:10.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.721+0000 7feafcc00640 1 --2- 172.21.15.114:0/2500760789 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feaf815a320 0x7feaf80b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:10.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.721+0000 7feafd600640 1 --2- 172.21.15.114:0/2500760789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feaf8156db0 0x7feaf80ad420 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7feaec019570 tx=0x7feaec019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:10.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.721+0000 7feaf5600640 1 -- 172.21.15.114:0/2500760789 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec0b8470 con 0x7feaf8156db0 2024-09-13T17:52:10.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.721+0000 7feaf5600640 1 -- 172.21.15.114:0/2500760789 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaec0b85f0 con 0x7feaf8156db0 2024-09-13T17:52:10.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.721+0000 7feaf5600640 1 -- 172.21.15.114:0/2500760789 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec0b89a0 con 0x7feaf8156db0 2024-09-13T17:52:10.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.721+0000 7feb00000640 1 -- 172.21.15.114:0/2500760789 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf80adab0 con 0x7feaf8156db0 2024-09-13T17:52:10.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.721+0000 7feb00000640 1 -- 172.21.15.114:0/2500760789 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf80ae070 con 0x7feaf8156db0 2024-09-13T17:52:10.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.725+0000 7feb00000640 1 -- 172.21.15.114:0/2500760789 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf8157e10 con 0x7feaf8156db0 2024-09-13T17:52:10.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.725+0000 7feaf5600640 1 -- 172.21.15.114:0/2500760789 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feaec0b8b00 con 0x7feaf8156db0 2024-09-13T17:52:10.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.725+0000 7feaf5600640 1 --2- 172.21.15.114:0/2500760789 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fead8066690 0x7fead8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:10.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.725+0000 7feaf5600640 1 -- 172.21.15.114:0/2500760789 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feaec11f680 con 0x7feaf8156db0 2024-09-13T17:52:10.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.725+0000 7feafcc00640 1 --2- 172.21.15.114:0/2500760789 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fead8066690 0x7fead8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:10.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.725+0000 7feafcc00640 1 --2- 172.21.15.114:0/2500760789 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fead8066690 0x7fead8068b50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7feae400b240 tx=0x7feae400b3a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:10.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.729+0000 7feaf5600640 1 -- 172.21.15.114:0/2500760789 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feaec0ec810 con 0x7feaf8156db0 2024-09-13T17:52:10.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.881+0000 7feb00000640 1 -- 172.21.15.114:0/2500760789 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feaf806d640 con 0x7feaf8156db0 2024-09-13T17:52:10.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.885+0000 7feaf5600640 1 -- 172.21.15.114:0/2500760789 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18394 (secure 0 0 0) 0x7feaec0b8db0 con 0x7feaf8156db0 2024-09-13T17:52:10.886 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:10.886 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:51:54.213439+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:51:48.278220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:51:48.773888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:51:51.856300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:52:10.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.885+0000 7feb00000640 1 -- 172.21.15.114:0/2500760789 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fead8066690 msgr2=0x7fead8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:10.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.885+0000 7feb00000640 1 --2- 172.21.15.114:0/2500760789 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fead8066690 0x7fead8068b50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7feae400b240 tx=0x7feae400b3a0 comp rx=0 tx=0).stop 2024-09-13T17:52:10.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.885+0000 7feb00000640 1 -- 172.21.15.114:0/2500760789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feaf8156db0 msgr2=0x7feaf80ad420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:10.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.885+0000 7feb00000640 1 --2- 172.21.15.114:0/2500760789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feaf8156db0 0x7feaf80ad420 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7feaec019570 tx=0x7feaec019700 comp rx=0 tx=0).stop 2024-09-13T17:52:10.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.885+0000 7feb00000640 1 -- 172.21.15.114:0/2500760789 shutdown_connections 2024-09-13T17:52:10.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.885+0000 7feb00000640 1 --2- 172.21.15.114:0/2500760789 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fead8066690 0x7fead8068b50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:10.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.885+0000 7feb00000640 1 --2- 172.21.15.114:0/2500760789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feaf815aef0 0x7feaf8148f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:10.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.885+0000 7feb00000640 1 --2- 172.21.15.114:0/2500760789 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feaf815a320 0x7feaf80b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:10.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.885+0000 7feb00000640 1 --2- 172.21.15.114:0/2500760789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feaf8156db0 0x7feaf80ad420 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:10.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.885+0000 7feb00000640 1 -- 172.21.15.114:0/2500760789 >> 172.21.15.114:0/2500760789 conn(0x7feaf8098a70 msgr2=0x7feaf814f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:10.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.885+0000 7feb00000640 1 -- 172.21.15.114:0/2500760789 shutdown_connections 2024-09-13T17:52:10.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:10.885+0000 7feb00000640 1 -- 172.21.15.114:0/2500760789 wait complete. 2024-09-13T17:52:10.908 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T17:52:11.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.045+0000 7f7f79000640 1 Processor -- start 2024-09-13T17:52:11.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.045+0000 7f7f79000640 1 -- start start 2024-09-13T17:52:11.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.045+0000 7f7f79000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f7413c240 0x7f7f7413f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:11.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.045+0000 7f7f79000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7f7406dc60 0x7f7f740cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:11.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.045+0000 7f7f79000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f740cd220 con 0x7f7f7413c980 2024-09-13T17:52:11.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.045+0000 7f7f79000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f7413f960 con 0x7f7f7406dc60 2024-09-13T17:52:11.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.045+0000 7f7f79000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7415a740 con 0x7f7f7413c240 2024-09-13T17:52:11.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.049+0000 7f7f72800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7f7406dc60 0x7f7f740cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:11.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.049+0000 7f7f71e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f7413c240 0x7f7f7413f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:11.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.049+0000 7f7f72800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7f7406dc60 0x7f7f740cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:56188/0 (socket says 172.21.15.114:56188) 2024-09-13T17:52:11.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.049+0000 7f7f72800640 1 -- 172.21.15.114:0/2620055068 learned_addr learned my addr 172.21.15.114:0/2620055068 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:11.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.049+0000 7f7f71e00640 1 -- 172.21.15.114:0/2620055068 >> v2:172.21.15.134:3300/0 conn(0x7f7f7406dc60 msgr2=0x7f7f740cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:11.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.049+0000 7f7f71e00640 1 --2- 172.21.15.114:0/2620055068 >> v2:172.21.15.134:3300/0 conn(0x7f7f7406dc60 0x7f7f740cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:11.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.049+0000 7f7f71e00640 1 -- 172.21.15.114:0/2620055068 >> v1:172.21.15.134:6789/0 conn(0x7f7f7413c980 legacy=0x7f7f7406d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:11.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.049+0000 7f7f71e00640 1 -- 172.21.15.114:0/2620055068 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f74159bc0 con 0x7f7f7413c240 2024-09-13T17:52:11.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.049+0000 7f7f72800640 1 --2- 172.21.15.114:0/2620055068 >> v2:172.21.15.134:3300/0 conn(0x7f7f7406dc60 0x7f7f740cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:52:11.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.049+0000 7f7f71e00640 1 --2- 172.21.15.114:0/2620055068 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f7413c240 0x7f7f7413f420 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7f640097c0 tx=0x7f7f6401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8db9550e4e1b5e9c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:11.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.049+0000 7f7f71400640 1 -- 172.21.15.114:0/2620055068 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f640ab670 con 0x7f7f7413c240 2024-09-13T17:52:11.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.049+0000 7f7f71400640 1 -- 172.21.15.114:0/2620055068 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f640ab7d0 con 0x7f7f7413c240 2024-09-13T17:52:11.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.053+0000 7f7f71400640 1 -- 172.21.15.114:0/2620055068 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f640abb60 con 0x7f7f7413c240 2024-09-13T17:52:11.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.053+0000 7f7f79000640 1 -- 172.21.15.114:0/2620055068 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f7413c240 msgr2=0x7f7f7413f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:11.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.053+0000 7f7f79000640 1 --2- 172.21.15.114:0/2620055068 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f7413c240 0x7f7f7413f420 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7f640097c0 tx=0x7f7f6401c470 comp rx=0 tx=0).stop 2024-09-13T17:52:11.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.053+0000 7f7f79000640 1 -- 172.21.15.114:0/2620055068 shutdown_connections 2024-09-13T17:52:11.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.053+0000 7f7f79000640 1 --2- 172.21.15.114:0/2620055068 >> v2:172.21.15.134:3300/0 conn(0x7f7f7406dc60 0x7f7f740cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:11.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.053+0000 7f7f79000640 1 --2- 172.21.15.114:0/2620055068 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f7413c240 0x7f7f7413f420 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:11.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.053+0000 7f7f79000640 1 -- 172.21.15.114:0/2620055068 >> 172.21.15.114:0/2620055068 conn(0x7f7f740660b0 msgr2=0x7f7f74069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:11.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.053+0000 7f7f79000640 1 -- 172.21.15.114:0/2620055068 shutdown_connections 2024-09-13T17:52:11.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.053+0000 7f7f79000640 1 -- 172.21.15.114:0/2620055068 wait complete. 2024-09-13T17:52:11.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.053+0000 7f7f79000640 1 Processor -- start 2024-09-13T17:52:11.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.053+0000 7f7f79000640 1 -- start start 2024-09-13T17:52:11.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.053+0000 7f7f79000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f7406dc60 0x7f7f741f8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:11.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.053+0000 7f7f79000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f7413c240 0x7f7f74156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:11.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.053+0000 7f7f79000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f7413c980 0x7f7f740ac930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:11.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.053+0000 7f7f79000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f741f8ed0 con 0x7f7f7413c240 2024-09-13T17:52:11.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.053+0000 7f7f79000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f740ae5d0 con 0x7f7f7413c980 2024-09-13T17:52:11.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.053+0000 7f7f79000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f740ae8b0 con 0x7f7f7406dc60 2024-09-13T17:52:11.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.053+0000 7f7f69400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f7413c240 0x7f7f74156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:11.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.053+0000 7f7f69400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f7413c240 0x7f7f74156760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49962/0 (socket says 172.21.15.114:49962) 2024-09-13T17:52:11.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.053+0000 7f7f69400640 1 -- 172.21.15.114:0/2676613282 learned_addr learned my addr 172.21.15.114:0/2676613282 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:11.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.053+0000 7f7f71e00640 1 --2- 172.21.15.114:0/2676613282 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f7406dc60 0x7f7f741f8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:11.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.053+0000 7f7f72800640 1 --2- 172.21.15.114:0/2676613282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f7413c980 0x7f7f740ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:11.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.057+0000 7f7f69400640 1 -- 172.21.15.114:0/2676613282 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f7406dc60 msgr2=0x7f7f741f8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:11.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.057+0000 7f7f69400640 1 --2- 172.21.15.114:0/2676613282 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f7406dc60 0x7f7f741f8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:11.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.057+0000 7f7f69400640 1 -- 172.21.15.114:0/2676613282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f7413c980 msgr2=0x7f7f740ac930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:11.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.057+0000 7f7f69400640 1 --2- 172.21.15.114:0/2676613282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f7413c980 0x7f7f740ac930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:11.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.057+0000 7f7f69400640 1 -- 172.21.15.114:0/2676613282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c00bd40 con 0x7f7f7413c240 2024-09-13T17:52:11.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.057+0000 7f7f69400640 1 --2- 172.21.15.114:0/2676613282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f7413c240 0x7f7f74156760 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00c3c0 tx=0x7f7f5c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:11.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.057+0000 7f7f6aa00640 1 -- 172.21.15.114:0/2676613282 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c0052d0 con 0x7f7f7413c240 2024-09-13T17:52:11.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.057+0000 7f7f6aa00640 1 -- 172.21.15.114:0/2676613282 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5c005430 con 0x7f7f7413c240 2024-09-13T17:52:11.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.057+0000 7f7f6aa00640 1 -- 172.21.15.114:0/2676613282 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c003840 con 0x7f7f7413c240 2024-09-13T17:52:11.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.057+0000 7f7f79000640 1 -- 172.21.15.114:0/2676613282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f64009420 con 0x7f7f7413c240 2024-09-13T17:52:11.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.057+0000 7f7f79000640 1 -- 172.21.15.114:0/2676613282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f740aee70 con 0x7f7f7413c240 2024-09-13T17:52:11.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.057+0000 7f7f79000640 1 -- 172.21.15.114:0/2676613282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f74067960 con 0x7f7f7413c240 2024-09-13T17:52:11.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.057+0000 7f7f6aa00640 1 -- 172.21.15.114:0/2676613282 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7f5c0039a0 con 0x7f7f7413c240 2024-09-13T17:52:11.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.057+0000 7f7f6aa00640 1 --2- 172.21.15.114:0/2676613282 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7f50066690 0x7f7f50068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:11.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.057+0000 7f7f6aa00640 1 -- 172.21.15.114:0/2676613282 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7f5c0839e0 con 0x7f7f7413c240 2024-09-13T17:52:11.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.057+0000 7f7f71e00640 1 --2- 172.21.15.114:0/2676613282 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7f50066690 0x7f7f50068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:11.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.061+0000 7f7f71e00640 1 --2- 172.21.15.114:0/2676613282 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7f50066690 0x7f7f50068b50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7f640af000 tx=0x7f7f64004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:11.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.061+0000 7f7f6aa00640 1 -- 172.21.15.114:0/2676613282 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7f5c050a70 con 0x7f7f7413c240 2024-09-13T17:52:11.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:11.248+0000 7f7f79000640 1 -- 172.21.15.114:0/2676613282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7f74159790 con 0x7f7f7413c240 2024-09-13T17:52:12.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.040+0000 7f7f6aa00640 1 -- 172.21.15.114:0/2676613282 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7f5c054090 con 0x7f7f7413c240 2024-09-13T17:52:12.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.040+0000 7f7f79000640 1 -- 172.21.15.114:0/2676613282 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7f50066690 msgr2=0x7f7f50068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:12.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.040+0000 7f7f79000640 1 --2- 172.21.15.114:0/2676613282 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7f50066690 0x7f7f50068b50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7f640af000 tx=0x7f7f64004740 comp rx=0 tx=0).stop 2024-09-13T17:52:12.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.040+0000 7f7f79000640 1 -- 172.21.15.114:0/2676613282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f7413c240 msgr2=0x7f7f74156760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:12.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.040+0000 7f7f79000640 1 --2- 172.21.15.114:0/2676613282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f7413c240 0x7f7f74156760 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00c3c0 tx=0x7f7f5c00c880 comp rx=0 tx=0).stop 2024-09-13T17:52:12.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.044+0000 7f7f79000640 1 -- 172.21.15.114:0/2676613282 shutdown_connections 2024-09-13T17:52:12.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.044+0000 7f7f79000640 1 --2- 172.21.15.114:0/2676613282 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7f50066690 0x7f7f50068b50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:12.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.044+0000 7f7f79000640 1 --2- 172.21.15.114:0/2676613282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f7413c980 0x7f7f740ac930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:12.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.044+0000 7f7f79000640 1 --2- 172.21.15.114:0/2676613282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f7413c240 0x7f7f74156760 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:12.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.044+0000 7f7f79000640 1 --2- 172.21.15.114:0/2676613282 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7f7406dc60 0x7f7f741f8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:12.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.044+0000 7f7f79000640 1 -- 172.21.15.114:0/2676613282 >> 172.21.15.114:0/2676613282 conn(0x7f7f740660b0 msgr2=0x7f7f7415afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:12.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.044+0000 7f7f79000640 1 -- 172.21.15.114:0/2676613282 shutdown_connections 2024-09-13T17:52:12.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.044+0000 7f7f79000640 1 -- 172.21.15.114:0/2676613282 wait complete. 2024-09-13T17:52:12.068 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-13T17:52:12.069 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T17:52:12.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.208+0000 7f4068400640 1 Processor -- start 2024-09-13T17:52:12.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.208+0000 7f4068400640 1 -- start start 2024-09-13T17:52:12.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.208+0000 7f4068400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f406013c240 0x7f406013f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:12.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.208+0000 7f4068400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f406013c980 0x7f406006d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:12.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.208+0000 7f4068400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f406006da90 0x7f40600cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:12.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.208+0000 7f4068400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f406006df00 con 0x7f406006da90 2024-09-13T17:52:12.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.208+0000 7f4068400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40600cd220 con 0x7f406013c980 2024-09-13T17:52:12.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.208+0000 7f4068400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f406013f960 con 0x7f406013c240 2024-09-13T17:52:12.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.208+0000 7f4066400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f406006da90 0x7f40600cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:12.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.208+0000 7f4066400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f406006da90 0x7f40600cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49976/0 (socket says 172.21.15.114:49976) 2024-09-13T17:52:12.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.208+0000 7f4066400640 1 -- 172.21.15.114:0/184555084 learned_addr learned my addr 172.21.15.114:0/184555084 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:12.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.208+0000 7f4065a00640 1 --2- 172.21.15.114:0/184555084 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f406013c240 0x7f406013f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:12.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.208+0000 7f4065000640 1 --2- 172.21.15.114:0/184555084 >> v2:172.21.15.134:3300/0 conn(0x7f406013c980 0x7f406006d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:12.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.208+0000 7f4066400640 1 -- 172.21.15.114:0/184555084 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f406013c240 msgr2=0x7f406013f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:12.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.208+0000 7f4066400640 1 --2- 172.21.15.114:0/184555084 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f406013c240 0x7f406013f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:12.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.208+0000 7f4066400640 1 -- 172.21.15.114:0/184555084 >> v2:172.21.15.134:3300/0 conn(0x7f406013c980 msgr2=0x7f406006d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:12.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.208+0000 7f4066400640 1 --2- 172.21.15.114:0/184555084 >> v2:172.21.15.134:3300/0 conn(0x7f406013c980 0x7f406006d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:12.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.208+0000 7f4066400640 1 -- 172.21.15.114:0/184555084 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406015a740 con 0x7f406006da90 2024-09-13T17:52:12.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.212+0000 7f4066400640 1 --2- 172.21.15.114:0/184555084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f406006da90 0x7f40600cd650 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f406006e930 tx=0x7f405801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef63c5b34141c9d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:12.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.212+0000 7f405fe00640 1 -- 172.21.15.114:0/184555084 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40580a5840 con 0x7f406006da90 2024-09-13T17:52:12.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.212+0000 7f405fe00640 1 -- 172.21.15.114:0/184555084 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40580a59a0 con 0x7f406006da90 2024-09-13T17:52:12.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.212+0000 7f405fe00640 1 -- 172.21.15.114:0/184555084 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40580a5d30 con 0x7f406006da90 2024-09-13T17:52:12.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.212+0000 7f4068400640 1 -- 172.21.15.114:0/184555084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f406006da90 msgr2=0x7f40600cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:12.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.212+0000 7f4068400640 1 --2- 172.21.15.114:0/184555084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f406006da90 0x7f40600cd650 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f406006e930 tx=0x7f405801c9c0 comp rx=0 tx=0).stop 2024-09-13T17:52:12.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.212+0000 7f4068400640 1 -- 172.21.15.114:0/184555084 shutdown_connections 2024-09-13T17:52:12.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.212+0000 7f4068400640 1 --2- 172.21.15.114:0/184555084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f406006da90 0x7f40600cd650 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:12.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.212+0000 7f4068400640 1 --2- 172.21.15.114:0/184555084 >> v2:172.21.15.134:3300/0 conn(0x7f406013c980 0x7f406006d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:12.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.212+0000 7f4068400640 1 --2- 172.21.15.114:0/184555084 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f406013c240 0x7f406013f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:12.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.212+0000 7f4068400640 1 -- 172.21.15.114:0/184555084 >> 172.21.15.114:0/184555084 conn(0x7f40600660b0 msgr2=0x7f4060069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:12.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.212+0000 7f4068400640 1 -- 172.21.15.114:0/184555084 shutdown_connections 2024-09-13T17:52:12.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.212+0000 7f4068400640 1 -- 172.21.15.114:0/184555084 wait complete. 2024-09-13T17:52:12.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.216+0000 7f4068400640 1 Processor -- start 2024-09-13T17:52:12.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.216+0000 7f4068400640 1 -- start start 2024-09-13T17:52:12.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.216+0000 7f4068400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f406006da90 0x7f4060151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:12.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.216+0000 7f4068400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f406013c240 0x7f40600b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:12.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.216+0000 7f4068400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f406013c980 0x7f4060153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:12.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.216+0000 7f4068400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4060151bc0 con 0x7f406013c240 2024-09-13T17:52:12.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.216+0000 7f4068400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40600b1900 con 0x7f406006da90 2024-09-13T17:52:12.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.216+0000 7f4068400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40600b1be0 con 0x7f406013c980 2024-09-13T17:52:12.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.216+0000 7f4065000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f406013c240 0x7f40600b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:12.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.216+0000 7f4065000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f406013c240 0x7f40600b29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49984/0 (socket says 172.21.15.114:49984) 2024-09-13T17:52:12.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.216+0000 7f4065000640 1 -- 172.21.15.114:0/2523120402 learned_addr learned my addr 172.21.15.114:0/2523120402 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:12.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.216+0000 7f4066400640 1 --2- 172.21.15.114:0/2523120402 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f406013c980 0x7f4060153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:12.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.216+0000 7f4065a00640 1 --2- 172.21.15.114:0/2523120402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f406006da90 0x7f4060151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:12.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.216+0000 7f4065000640 1 -- 172.21.15.114:0/2523120402 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f406013c980 msgr2=0x7f4060153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:12.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.216+0000 7f4065000640 1 --2- 172.21.15.114:0/2523120402 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f406013c980 0x7f4060153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:12.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.216+0000 7f4065000640 1 -- 172.21.15.114:0/2523120402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f406006da90 msgr2=0x7f4060151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:12.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.216+0000 7f4065000640 1 --2- 172.21.15.114:0/2523120402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f406006da90 0x7f4060151680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:12.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.216+0000 7f4065000640 1 -- 172.21.15.114:0/2523120402 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4058009b30 con 0x7f406013c240 2024-09-13T17:52:12.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.216+0000 7f4065000640 1 --2- 172.21.15.114:0/2523120402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f406013c240 0x7f40600b29a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f404c00d5f0 tx=0x7f404c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:12.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.216+0000 7f405d600640 1 -- 172.21.15.114:0/2523120402 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c0125f0 con 0x7f406013c240 2024-09-13T17:52:12.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.216+0000 7f405d600640 1 -- 172.21.15.114:0/2523120402 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404c012750 con 0x7f406013c240 2024-09-13T17:52:12.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.216+0000 7f405d600640 1 -- 172.21.15.114:0/2523120402 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c012b00 con 0x7f406013c240 2024-09-13T17:52:12.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.216+0000 7f4068400640 1 -- 172.21.15.114:0/2523120402 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40600b1ec0 con 0x7f406013c240 2024-09-13T17:52:12.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.216+0000 7f4068400640 1 -- 172.21.15.114:0/2523120402 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40600b2480 con 0x7f406013c240 2024-09-13T17:52:12.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.216+0000 7f4068400640 1 -- 172.21.15.114:0/2523120402 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f406013cdf0 con 0x7f406013c240 2024-09-13T17:52:12.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.220+0000 7f405d600640 1 -- 172.21.15.114:0/2523120402 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f404c012c60 con 0x7f406013c240 2024-09-13T17:52:12.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.220+0000 7f405d600640 1 --2- 172.21.15.114:0/2523120402 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4040066690 0x7f4040068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:12.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.220+0000 7f405d600640 1 -- 172.21.15.114:0/2523120402 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f404c0849a0 con 0x7f406013c240 2024-09-13T17:52:12.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.220+0000 7f4065a00640 1 --2- 172.21.15.114:0/2523120402 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4040066690 0x7f4040068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:12.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.220+0000 7f4065a00640 1 --2- 172.21.15.114:0/2523120402 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4040066690 0x7f4040068b50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f406015cad0 tx=0x7f4054008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:12.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.224+0000 7f405d600640 1 -- 172.21.15.114:0/2523120402 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f404c051a10 con 0x7f406013c240 2024-09-13T17:52:12.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:12.408+0000 7f4068400640 1 -- 172.21.15.114:0/2523120402 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f406015a210 con 0x7f406013c240 2024-09-13T17:52:13.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.040+0000 7f405d600640 1 -- 172.21.15.114:0/2523120402 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f404c055030 con 0x7f406013c240 2024-09-13T17:52:13.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.044+0000 7f4068400640 1 -- 172.21.15.114:0/2523120402 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4040066690 msgr2=0x7f4040068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:13.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.044+0000 7f4068400640 1 --2- 172.21.15.114:0/2523120402 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4040066690 0x7f4040068b50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f406015cad0 tx=0x7f4054008040 comp rx=0 tx=0).stop 2024-09-13T17:52:13.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.044+0000 7f4068400640 1 -- 172.21.15.114:0/2523120402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f406013c240 msgr2=0x7f40600b29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:13.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.044+0000 7f4068400640 1 --2- 172.21.15.114:0/2523120402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f406013c240 0x7f40600b29a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f404c00d5f0 tx=0x7f404c00dab0 comp rx=0 tx=0).stop 2024-09-13T17:52:13.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.044+0000 7f4068400640 1 -- 172.21.15.114:0/2523120402 shutdown_connections 2024-09-13T17:52:13.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.044+0000 7f4068400640 1 --2- 172.21.15.114:0/2523120402 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4040066690 0x7f4040068b50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:13.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.044+0000 7f4068400640 1 --2- 172.21.15.114:0/2523120402 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f406013c980 0x7f4060153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:13.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.044+0000 7f4068400640 1 --2- 172.21.15.114:0/2523120402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f406013c240 0x7f40600b29a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:13.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.044+0000 7f4068400640 1 --2- 172.21.15.114:0/2523120402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f406006da90 0x7f4060151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:13.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.044+0000 7f4068400640 1 -- 172.21.15.114:0/2523120402 >> 172.21.15.114:0/2523120402 conn(0x7f40600660b0 msgr2=0x7f40601564d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:13.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.044+0000 7f4068400640 1 -- 172.21.15.114:0/2523120402 shutdown_connections 2024-09-13T17:52:13.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.044+0000 7f4068400640 1 -- 172.21.15.114:0/2523120402 wait complete. 2024-09-13T17:52:13.068 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T17:52:13.068 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:52:13.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.204+0000 7f7553200640 1 Processor -- start 2024-09-13T17:52:13.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.204+0000 7f7553200640 1 -- start start 2024-09-13T17:52:13.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.204+0000 7f7553200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f755415c880 0x7f75540d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:13.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.204+0000 7f7553200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f755406bfc0 0x7f7554098a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:13.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.204+0000 7f7553200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7554099400 con 0x7f7554098fb0 2024-09-13T17:52:13.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.204+0000 7f7553200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f755415cc60 con 0x7f755406bfc0 2024-09-13T17:52:13.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.204+0000 7f7553200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75540ca980 con 0x7f755415c880 2024-09-13T17:52:13.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.204+0000 7f7549400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f755406bfc0 0x7f7554098a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:13.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.204+0000 7f7549400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f755406bfc0 0x7f7554098a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49986/0 (socket says 172.21.15.114:49986) 2024-09-13T17:52:13.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.204+0000 7f7549400640 1 -- 172.21.15.114:0/2239659822 learned_addr learned my addr 172.21.15.114:0/2239659822 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:13.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.204+0000 7f7551e00640 1 --2- 172.21.15.114:0/2239659822 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f755415c880 0x7f75540d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:13.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.204+0000 7f7549400640 1 -- 172.21.15.114:0/2239659822 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f755415c880 msgr2=0x7f75540d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:13.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.204+0000 7f7549400640 1 --2- 172.21.15.114:0/2239659822 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f755415c880 0x7f75540d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:13.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.204+0000 7f7549400640 1 -- 172.21.15.114:0/2239659822 >> v1:172.21.15.134:6789/0 conn(0x7f7554098fb0 legacy=0x7f75540ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:13.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.204+0000 7f7549400640 1 -- 172.21.15.114:0/2239659822 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755406c450 con 0x7f755406bfc0 2024-09-13T17:52:13.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.208+0000 7f7549400640 1 --2- 172.21.15.114:0/2239659822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f755406bfc0 0x7f7554098a70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f753c009870 tx=0x7f753c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc1e5379e58fcd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:13.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.208+0000 7f7551400640 1 -- 172.21.15.114:0/2239659822 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c0ab620 con 0x7f755406bfc0 2024-09-13T17:52:13.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.208+0000 7f7551400640 1 -- 172.21.15.114:0/2239659822 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753c0ab780 con 0x7f755406bfc0 2024-09-13T17:52:13.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.208+0000 7f7551400640 1 -- 172.21.15.114:0/2239659822 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753c0abb10 con 0x7f755406bfc0 2024-09-13T17:52:13.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.208+0000 7f7553200640 1 -- 172.21.15.114:0/2239659822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f755406bfc0 msgr2=0x7f7554098a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:13.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.208+0000 7f7553200640 1 --2- 172.21.15.114:0/2239659822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f755406bfc0 0x7f7554098a70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f753c009870 tx=0x7f753c01c460 comp rx=0 tx=0).stop 2024-09-13T17:52:13.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.208+0000 7f7553200640 1 -- 172.21.15.114:0/2239659822 shutdown_connections 2024-09-13T17:52:13.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.208+0000 7f7553200640 1 --2- 172.21.15.114:0/2239659822 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f755406bfc0 0x7f7554098a70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:13.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.208+0000 7f7553200640 1 --2- 172.21.15.114:0/2239659822 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f755415c880 0x7f75540d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:13.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.208+0000 7f7553200640 1 -- 172.21.15.114:0/2239659822 >> 172.21.15.114:0/2239659822 conn(0x7f75540d0330 msgr2=0x7f75540d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:13.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.208+0000 7f7553200640 1 -- 172.21.15.114:0/2239659822 shutdown_connections 2024-09-13T17:52:13.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.208+0000 7f7553200640 1 -- 172.21.15.114:0/2239659822 wait complete. 2024-09-13T17:52:13.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.208+0000 7f7553200640 1 Processor -- start 2024-09-13T17:52:13.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.208+0000 7f7553200640 1 -- start start 2024-09-13T17:52:13.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.212+0000 7f7553200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7554098fb0 0x7f75540c7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:13.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.212+0000 7f7553200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f755415c880 0x7f7554157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:13.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.212+0000 7f7553200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75540b3ff0 0x7f75540b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:13.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.212+0000 7f7553200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75540b32a0 con 0x7f75540b3ff0 2024-09-13T17:52:13.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.212+0000 7f7553200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75540b3510 con 0x7f7554098fb0 2024-09-13T17:52:13.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.212+0000 7f7553200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75540b37f0 con 0x7f755415c880 2024-09-13T17:52:13.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.212+0000 7f7552800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75540b3ff0 0x7f75540b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:13.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.212+0000 7f7552800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75540b3ff0 0x7f75540b44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49990/0 (socket says 172.21.15.114:49990) 2024-09-13T17:52:13.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.212+0000 7f7552800640 1 -- 172.21.15.114:0/258435737 learned_addr learned my addr 172.21.15.114:0/258435737 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:13.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.212+0000 7f7551e00640 1 --2- 172.21.15.114:0/258435737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7554098fb0 0x7f75540c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:13.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.212+0000 7f7549400640 1 --2- 172.21.15.114:0/258435737 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f755415c880 0x7f7554157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:13.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.212+0000 7f7552800640 1 -- 172.21.15.114:0/258435737 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f755415c880 msgr2=0x7f7554157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:13.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.212+0000 7f7552800640 1 --2- 172.21.15.114:0/258435737 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f755415c880 0x7f7554157950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:13.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.212+0000 7f7552800640 1 -- 172.21.15.114:0/258435737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7554098fb0 msgr2=0x7f75540c7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:13.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.212+0000 7f7552800640 1 --2- 172.21.15.114:0/258435737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7554098fb0 0x7f75540c7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:13.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.212+0000 7f7552800640 1 -- 172.21.15.114:0/258435737 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753c0094d0 con 0x7f75540b3ff0 2024-09-13T17:52:13.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.212+0000 7f7549400640 1 --2- 172.21.15.114:0/258435737 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f755415c880 0x7f7554157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:13.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.212+0000 7f7551e00640 1 --2- 172.21.15.114:0/258435737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7554098fb0 0x7f75540c7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:13.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.212+0000 7f7552800640 1 --2- 172.21.15.114:0/258435737 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75540b3ff0 0x7f75540b44a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f754c00b970 tx=0x7f754c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:13.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.212+0000 7f754aa00640 1 -- 172.21.15.114:0/258435737 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c00cb40 con 0x7f75540b3ff0 2024-09-13T17:52:13.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.212+0000 7f754aa00640 1 -- 172.21.15.114:0/258435737 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c00cca0 con 0x7f75540b3ff0 2024-09-13T17:52:13.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.212+0000 7f754aa00640 1 -- 172.21.15.114:0/258435737 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c014680 con 0x7f75540b3ff0 2024-09-13T17:52:13.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.212+0000 7f7553200640 1 -- 172.21.15.114:0/258435737 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75540b3ad0 con 0x7f75540b3ff0 2024-09-13T17:52:13.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.212+0000 7f7553200640 1 -- 172.21.15.114:0/258435737 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75540c8280 con 0x7f75540b3ff0 2024-09-13T17:52:13.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.212+0000 7f7553200640 1 -- 172.21.15.114:0/258435737 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75540b3d10 con 0x7f75540b3ff0 2024-09-13T17:52:13.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.212+0000 7f754aa00640 1 -- 172.21.15.114:0/258435737 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f754c01d3b0 con 0x7f75540b3ff0 2024-09-13T17:52:13.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.216+0000 7f754aa00640 1 --2- 172.21.15.114:0/258435737 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f75300666c0 0x7f7530068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:13.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.216+0000 7f754aa00640 1 -- 172.21.15.114:0/258435737 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f754c0842d0 con 0x7f75540b3ff0 2024-09-13T17:52:13.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.216+0000 7f7551e00640 1 --2- 172.21.15.114:0/258435737 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f75300666c0 0x7f7530068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:13.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.216+0000 7f7551e00640 1 --2- 172.21.15.114:0/258435737 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f75300666c0 0x7f7530068b80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f754400b9f0 tx=0x7f7544008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:13.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.220+0000 7f754aa00640 1 -- 172.21.15.114:0/258435737 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f75540b3d10 con 0x7f75540b3ff0 2024-09-13T17:52:13.306 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:52:13.310 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:52:13.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.404+0000 7f7553200640 1 -- 172.21.15.114:0/258435737 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75540b3cc0 con 0x7f75540b3ff0 2024-09-13T17:52:13.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.408+0000 7f754aa00640 1 -- 172.21.15.114:0/258435737 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4739 (secure 0 0 0) 0x7f754c0512b0 con 0x7f75540b3ff0 2024-09-13T17:52:13.410 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:13.410 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/534634081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":534634081},{"type":"v1","addr":"172.21.15.134:6835","nonce":534634081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1773366615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1773366615},{"type":"v1","addr":"172.21.15.114:6836","nonce":1773366615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4122490085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":4122490085},{"type":"v1","addr":"172.21.15.114:6837","nonce":4122490085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:51:49.789079+0000","modified":"2024-09-13T17:52:13.041461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/1863104078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1863104078},{"type":"v1","addr":"172.21.15.134:6834","nonce":1863104078}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:52:13.410 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 9 2024-09-13T17:52:13.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.408+0000 7f7553200640 1 -- 172.21.15.114:0/258435737 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f75300666c0 msgr2=0x7f7530068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:13.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.408+0000 7f7553200640 1 --2- 172.21.15.114:0/258435737 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f75300666c0 0x7f7530068b80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f754400b9f0 tx=0x7f7544008040 comp rx=0 tx=0).stop 2024-09-13T17:52:13.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.408+0000 7f7553200640 1 -- 172.21.15.114:0/258435737 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75540b3ff0 msgr2=0x7f75540b44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:13.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.408+0000 7f7553200640 1 --2- 172.21.15.114:0/258435737 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75540b3ff0 0x7f75540b44a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f754c00b970 tx=0x7f754c00be30 comp rx=0 tx=0).stop 2024-09-13T17:52:13.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.408+0000 7f7553200640 1 -- 172.21.15.114:0/258435737 shutdown_connections 2024-09-13T17:52:13.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.408+0000 7f7553200640 1 --2- 172.21.15.114:0/258435737 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f75300666c0 0x7f7530068b80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:13.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.408+0000 7f7553200640 1 --2- 172.21.15.114:0/258435737 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75540b3ff0 0x7f75540b44a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:13.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.408+0000 7f7553200640 1 --2- 172.21.15.114:0/258435737 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f755415c880 0x7f7554157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:13.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.408+0000 7f7553200640 1 --2- 172.21.15.114:0/258435737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7554098fb0 0x7f75540c7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:13.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.408+0000 7f7553200640 1 -- 172.21.15.114:0/258435737 >> 172.21.15.114:0/258435737 conn(0x7f75540d0330 msgr2=0x7f75540cd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:13.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.408+0000 7f7553200640 1 -- 172.21.15.114:0/258435737 shutdown_connections 2024-09-13T17:52:13.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.408+0000 7f7553200640 1 -- 172.21.15.114:0/258435737 wait complete. 2024-09-13T17:52:13.434 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:52:13.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.624+0000 7f0467200640 1 Processor -- start 2024-09-13T17:52:13.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.624+0000 7f0467200640 1 -- start start 2024-09-13T17:52:13.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.624+0000 7f0467200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04600ce0b0 0x7f046015e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:13.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.624+0000 7f0467200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04600ce540 con 0x7f046015a650 2024-09-13T17:52:13.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.624+0000 7f0467200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04600ce820 con 0x7f046015e5f0 2024-09-13T17:52:13.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.624+0000 7f0467200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f046015ea80 con 0x7f04600ce0b0 2024-09-13T17:52:13.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.624+0000 7f045fe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f046015a650 0x7f0460099480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33262/0 (socket says 172.21.15.114:33262) 2024-09-13T17:52:13.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.624+0000 7f045fe00640 1 -- 172.21.15.114:0/1136833636 learned_addr learned my addr 172.21.15.114:0/1136833636 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:13.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.624+0000 7f045f400640 1 -- 172.21.15.114:0/1136833636 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780080114 0 0) 0x7f04600ce540 con 0x7f046015a650 2024-09-13T17:52:13.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.624+0000 7f045f400640 1 -- 172.21.15.114:0/1136833636 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0444003530 con 0x7f046015a650 2024-09-13T17:52:13.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.624+0000 7f0457400640 1 --2- 172.21.15.114:0/1136833636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04600ce0b0 0x7f046015e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:13.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.624+0000 7f045f400640 1 -- 172.21.15.114:0/1136833636 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 521677614 0 0) 0x7f0444003530 con 0x7f046015a650 2024-09-13T17:52:13.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.624+0000 7f045f400640 1 -- 172.21.15.114:0/1136833636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04600ce0b0 msgr2=0x7f046015e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:13.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.624+0000 7f045f400640 1 --2- 172.21.15.114:0/1136833636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04600ce0b0 0x7f046015e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:13.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.624+0000 7f045f400640 1 -- 172.21.15.114:0/1136833636 >> v1:172.21.15.134:6789/0 conn(0x7f046015e5f0 legacy=0x7f04600cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:13.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.624+0000 7f045f400640 1 -- 172.21.15.114:0/1136833636 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04600ceb00 con 0x7f046015a650 2024-09-13T17:52:13.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.624+0000 7f045f400640 1 -- 172.21.15.114:0/1136833636 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7f0450001a00 con 0x7f046015a650 2024-09-13T17:52:13.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.624+0000 7f045f400640 1 -- 172.21.15.114:0/1136833636 >> v1:172.21.15.114:6789/0 conn(0x7f046015a650 legacy=0x7f0460099480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:13.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.628+0000 7f045f400640 1 --2- 172.21.15.114:0/1136833636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04440039b0 0x7f0444003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:13.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.628+0000 7f045f400640 1 --2- 172.21.15.114:0/1136833636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04440047d0 0x7f0444004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:13.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.628+0000 7f045f400640 1 --2- 172.21.15.114:0/1136833636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0444005190 0x7f044400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:13.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.628+0000 7f045f400640 1 -- 172.21.15.114:0/1136833636 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046015ea80 con 0x7f04440047d0 2024-09-13T17:52:13.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.628+0000 7f045f400640 1 -- 172.21.15.114:0/1136833636 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044400bed0 con 0x7f04440039b0 2024-09-13T17:52:13.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.628+0000 7f045f400640 1 -- 172.21.15.114:0/1136833636 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044400c090 con 0x7f0444005190 2024-09-13T17:52:13.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.628+0000 7f0457400640 1 --2- 172.21.15.114:0/1136833636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04440047d0 0x7f0444004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:13.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.628+0000 7f045fe00640 1 --2- 172.21.15.114:0/1136833636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04440039b0 0x7f0444003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:13.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.628+0000 7f0465200640 1 --2- 172.21.15.114:0/1136833636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0444005190 0x7f044400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:13.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.628+0000 7f0457400640 1 -- 172.21.15.114:0/1136833636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0444005190 msgr2=0x7f044400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:13.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.628+0000 7f0457400640 1 --2- 172.21.15.114:0/1136833636 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0444005190 0x7f044400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:13.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.628+0000 7f0457400640 1 -- 172.21.15.114:0/1136833636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04440039b0 msgr2=0x7f0444003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:13.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.628+0000 7f0457400640 1 --2- 172.21.15.114:0/1136833636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04440039b0 0x7f0444003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:13.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.628+0000 7f0457400640 1 -- 172.21.15.114:0/1136833636 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0444003530 con 0x7f04440047d0 2024-09-13T17:52:13.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.628+0000 7f0457400640 1 --2- 172.21.15.114:0/1136833636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04440047d0 0x7f0444004c50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f044800ba30 tx=0x7f044801c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b8f30d89d9fbaa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:13.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.628+0000 7f045f400640 1 -- 172.21.15.114:0/1136833636 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04480ac440 con 0x7f04440047d0 2024-09-13T17:52:13.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.628+0000 7f045f400640 1 -- 172.21.15.114:0/1136833636 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04480ac5a0 con 0x7f04440047d0 2024-09-13T17:52:13.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.628+0000 7f045f400640 1 -- 172.21.15.114:0/1136833636 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04480ac950 con 0x7f04440047d0 2024-09-13T17:52:13.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.632+0000 7f0467200640 1 -- 172.21.15.114:0/1136833636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04440047d0 msgr2=0x7f0444004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:13.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.632+0000 7f0467200640 1 --2- 172.21.15.114:0/1136833636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04440047d0 0x7f0444004c50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f044800ba30 tx=0x7f044801c6a0 comp rx=0 tx=0).stop 2024-09-13T17:52:13.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.632+0000 7f0465200640 1 -- 172.21.15.114:0/1136833636 reap_dead start 2024-09-13T17:52:13.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.632+0000 7f0467200640 1 -- 172.21.15.114:0/1136833636 shutdown_connections 2024-09-13T17:52:13.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.632+0000 7f0467200640 1 -- 172.21.15.114:0/1136833636 >> 172.21.15.114:0/1136833636 conn(0x7f04600d04e0 msgr2=0x7f04600d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:13.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.632+0000 7f0467200640 1 -- 172.21.15.114:0/1136833636 shutdown_connections 2024-09-13T17:52:13.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.632+0000 7f0467200640 1 -- 172.21.15.114:0/1136833636 wait complete. 2024-09-13T17:52:13.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.632+0000 7f0467200640 1 Processor -- start 2024-09-13T17:52:13.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.632+0000 7f0467200640 1 -- start start 2024-09-13T17:52:13.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.632+0000 7f0467200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04440047d0 0x7f04600c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:13.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.632+0000 7f0467200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04600cc630 0x7f04600ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:13.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.632+0000 7f0467200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04600ccff0 0x7f04600ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:13.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.632+0000 7f0467200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04600cd4a0 con 0x7f04600cc630 2024-09-13T17:52:13.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.632+0000 7f0467200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04600cc1a0 con 0x7f04600ccff0 2024-09-13T17:52:13.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.632+0000 7f0467200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0460157fc0 con 0x7f04440047d0 2024-09-13T17:52:13.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.632+0000 7f0457400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04600cc630 0x7f04600ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:13.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.632+0000 7f0457400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04600cc630 0x7f04600ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50006/0 (socket says 172.21.15.114:50006) 2024-09-13T17:52:13.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.632+0000 7f0457400640 1 -- 172.21.15.114:0/2648827923 learned_addr learned my addr 172.21.15.114:0/2648827923 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:13.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.632+0000 7f045fe00640 1 --2- 172.21.15.114:0/2648827923 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04440047d0 0x7f04600c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:13.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.632+0000 7f0465200640 1 --2- 172.21.15.114:0/2648827923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04600ccff0 0x7f04600ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:13.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.632+0000 7f0457400640 1 -- 172.21.15.114:0/2648827923 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04440047d0 msgr2=0x7f04600c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:13.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.632+0000 7f0457400640 1 --2- 172.21.15.114:0/2648827923 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04440047d0 0x7f04600c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:13.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.632+0000 7f0457400640 1 -- 172.21.15.114:0/2648827923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04600ccff0 msgr2=0x7f04600ad2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:13.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.632+0000 7f0457400640 1 --2- 172.21.15.114:0/2648827923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04600ccff0 0x7f04600ad2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:13.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.632+0000 7f0457400640 1 -- 172.21.15.114:0/2648827923 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04600cb590 con 0x7f04600cc630 2024-09-13T17:52:13.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.636+0000 7f0457400640 1 --2- 172.21.15.114:0/2648827923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04600cc630 0x7f04600ccab0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f04480ae040 tx=0x7f0444005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:13.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.636+0000 7f045cc00640 1 -- 172.21.15.114:0/2648827923 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0448004020 con 0x7f04600cc630 2024-09-13T17:52:13.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.636+0000 7f045cc00640 1 -- 172.21.15.114:0/2648827923 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04480b9070 con 0x7f04600cc630 2024-09-13T17:52:13.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.636+0000 7f045cc00640 1 -- 172.21.15.114:0/2648827923 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04480043a0 con 0x7f04600cc630 2024-09-13T17:52:13.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.636+0000 7f0467200640 1 -- 172.21.15.114:0/2648827923 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04600cb870 con 0x7f04600cc630 2024-09-13T17:52:13.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.636+0000 7f0467200640 1 -- 172.21.15.114:0/2648827923 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04600cbe30 con 0x7f04600cc630 2024-09-13T17:52:13.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.636+0000 7f0467200640 1 -- 172.21.15.114:0/2648827923 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04600ce0b0 con 0x7f04600cc630 2024-09-13T17:52:13.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.636+0000 7f045cc00640 1 -- 172.21.15.114:0/2648827923 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f04480aa050 con 0x7f04600cc630 2024-09-13T17:52:13.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.636+0000 7f045cc00640 1 --2- 172.21.15.114:0/2648827923 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f043c0666c0 0x7f043c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:13.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.636+0000 7f045cc00640 1 -- 172.21.15.114:0/2648827923 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f044811e0b0 con 0x7f04600cc630 2024-09-13T17:52:13.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.636+0000 7f045fe00640 1 --2- 172.21.15.114:0/2648827923 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f043c0666c0 0x7f043c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:13.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.640+0000 7f045fe00640 1 --2- 172.21.15.114:0/2648827923 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f043c0666c0 0x7f043c068b80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0450001b30 tx=0x7f04500017c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:13.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.640+0000 7f045cc00640 1 -- 172.21.15.114:0/2648827923 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f04480eb300 con 0x7f04600cc630 2024-09-13T17:52:13.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.804+0000 7f0467200640 1 -- 172.21.15.114:0/2648827923 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04600cc2e0 con 0x7f04600cc630 2024-09-13T17:52:13.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.804+0000 7f045cc00640 1 -- 172.21.15.114:0/2648827923 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18394 (secure 0 0 0) 0x7f04480ee920 con 0x7f04600cc630 2024-09-13T17:52:13.807 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:13.808 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:51:54.213439+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:51:48.278220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:51:48.773888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:51:51.856300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:52:13.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.808+0000 7f0467200640 1 -- 172.21.15.114:0/2648827923 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f043c0666c0 msgr2=0x7f043c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:13.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.808+0000 7f0467200640 1 --2- 172.21.15.114:0/2648827923 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f043c0666c0 0x7f043c068b80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0450001b30 tx=0x7f04500017c0 comp rx=0 tx=0).stop 2024-09-13T17:52:13.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.808+0000 7f0467200640 1 -- 172.21.15.114:0/2648827923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04600cc630 msgr2=0x7f04600ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:13.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.808+0000 7f0467200640 1 --2- 172.21.15.114:0/2648827923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04600cc630 0x7f04600ccab0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f04480ae040 tx=0x7f0444005800 comp rx=0 tx=0).stop 2024-09-13T17:52:13.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.808+0000 7f0467200640 1 -- 172.21.15.114:0/2648827923 shutdown_connections 2024-09-13T17:52:13.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.808+0000 7f0467200640 1 --2- 172.21.15.114:0/2648827923 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f043c0666c0 0x7f043c068b80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:13.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.808+0000 7f0467200640 1 --2- 172.21.15.114:0/2648827923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04600ccff0 0x7f04600ad2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:13.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.808+0000 7f0467200640 1 --2- 172.21.15.114:0/2648827923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04600cc630 0x7f04600ccab0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:13.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.808+0000 7f0467200640 1 --2- 172.21.15.114:0/2648827923 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f04440047d0 0x7f04600c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:13.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.808+0000 7f0467200640 1 -- 172.21.15.114:0/2648827923 >> 172.21.15.114:0/2648827923 conn(0x7f04600d04e0 msgr2=0x7f046006f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:13.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.808+0000 7f0467200640 1 -- 172.21.15.114:0/2648827923 shutdown_connections 2024-09-13T17:52:13.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.808+0000 7f0467200640 1 -- 172.21.15.114:0/2648827923 wait complete. 2024-09-13T17:52:13.830 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T17:52:13.830 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:52:13.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.964+0000 7fce41400640 1 Processor -- start 2024-09-13T17:52:13.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.964+0000 7fce41400640 1 -- start start 2024-09-13T17:52:13.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.968+0000 7fce41400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce3c0b2d50 0x7fce3c15a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:13.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.968+0000 7fce41400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce3c0b3160 con 0x7fce3c0cae20 2024-09-13T17:52:13.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.968+0000 7fce41400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce3c0b33f0 con 0x7fce3c0b28c0 2024-09-13T17:52:13.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.968+0000 7fce41400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c15d020 con 0x7fce3c0b2d50 2024-09-13T17:52:13.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.968+0000 7fce3a800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fce3c0cae20 0x7fce3c0cb200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33274/0 (socket says 172.21.15.114:33274) 2024-09-13T17:52:13.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.968+0000 7fce3a800640 1 -- 172.21.15.114:0/1372264019 learned_addr learned my addr 172.21.15.114:0/1372264019 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:13.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.968+0000 7fce3b200640 1 --2- 172.21.15.114:0/1372264019 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce3c0b2d50 0x7fce3c15a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:13.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.968+0000 7fce39400640 1 -- 172.21.15.114:0/1372264019 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2346796071 0 0) 0x7fce3c0b3160 con 0x7fce3c0cae20 2024-09-13T17:52:13.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.968+0000 7fce39400640 1 -- 172.21.15.114:0/1372264019 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce20003530 con 0x7fce3c0cae20 2024-09-13T17:52:13.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.968+0000 7fce3b200640 1 -- 172.21.15.114:0/1372264019 >> v1:172.21.15.134:6789/0 conn(0x7fce3c0b28c0 legacy=0x7fce3c159990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:13.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.968+0000 7fce39400640 1 -- 172.21.15.114:0/1372264019 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3000501491 0 0) 0x7fce3c0b33f0 con 0x7fce3c0b28c0 2024-09-13T17:52:13.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.968+0000 7fce3b200640 1 -- 172.21.15.114:0/1372264019 >> v1:172.21.15.114:6789/0 conn(0x7fce3c0cae20 legacy=0x7fce3c0cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:13.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.968+0000 7fce3b200640 1 -- 172.21.15.114:0/1372264019 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3c15d300 con 0x7fce3c0b2d50 2024-09-13T17:52:13.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.972+0000 7fce3b200640 1 --2- 172.21.15.114:0/1372264019 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce3c0b2d50 0x7fce3c15a0a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fce34009dc0 tx=0x7fce3401c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39d623b04c2a6125 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:13.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.972+0000 7fce39400640 1 -- 172.21.15.114:0/1372264019 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce340a5980 con 0x7fce3c0b2d50 2024-09-13T17:52:13.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.972+0000 7fce39400640 1 -- 172.21.15.114:0/1372264019 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce340a5ae0 con 0x7fce3c0b2d50 2024-09-13T17:52:13.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.972+0000 7fce39400640 1 -- 172.21.15.114:0/1372264019 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce340a5e50 con 0x7fce3c0b2d50 2024-09-13T17:52:13.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.972+0000 7fce41400640 1 -- 172.21.15.114:0/1372264019 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce3c0b2d50 msgr2=0x7fce3c15a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:13.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.972+0000 7fce41400640 1 --2- 172.21.15.114:0/1372264019 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce3c0b2d50 0x7fce3c15a0a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fce34009dc0 tx=0x7fce3401c960 comp rx=0 tx=0).stop 2024-09-13T17:52:13.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.972+0000 7fce41400640 1 -- 172.21.15.114:0/1372264019 shutdown_connections 2024-09-13T17:52:13.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.972+0000 7fce41400640 1 --2- 172.21.15.114:0/1372264019 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce3c0b2d50 0x7fce3c15a0a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:13.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.972+0000 7fce41400640 1 -- 172.21.15.114:0/1372264019 >> 172.21.15.114:0/1372264019 conn(0x7fce3c0b01a0 msgr2=0x7fce3c0b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:13.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.972+0000 7fce41400640 1 -- 172.21.15.114:0/1372264019 shutdown_connections 2024-09-13T17:52:13.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.972+0000 7fce41400640 1 -- 172.21.15.114:0/1372264019 wait complete. 2024-09-13T17:52:13.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.972+0000 7fce41400640 1 Processor -- start 2024-09-13T17:52:13.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.972+0000 7fce41400640 1 -- start start 2024-09-13T17:52:13.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.976+0000 7fce41400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce3c0b28c0 0x7fce3c14d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:13.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.976+0000 7fce41400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce3c0b2d50 0x7fce3c14b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:13.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.976+0000 7fce41400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce3c0cae20 0x7fce3c0aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:13.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.976+0000 7fce41400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c160380 con 0x7fce3c0b28c0 2024-09-13T17:52:13.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.976+0000 7fce41400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c14c110 con 0x7fce3c0cae20 2024-09-13T17:52:13.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.976+0000 7fce41400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c14c3f0 con 0x7fce3c0b2d50 2024-09-13T17:52:13.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.976+0000 7fce3a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce3c0b28c0 0x7fce3c14d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:13.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.976+0000 7fce3a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce3c0b28c0 0x7fce3c14d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50010/0 (socket says 172.21.15.114:50010) 2024-09-13T17:52:13.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.976+0000 7fce3a800640 1 -- 172.21.15.114:0/2032228707 learned_addr learned my addr 172.21.15.114:0/2032228707 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:13.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.976+0000 7fce39e00640 1 --2- 172.21.15.114:0/2032228707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce3c0b2d50 0x7fce3c14b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:13.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.976+0000 7fce3b200640 1 --2- 172.21.15.114:0/2032228707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce3c0cae20 0x7fce3c0aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:13.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.976+0000 7fce3a800640 1 -- 172.21.15.114:0/2032228707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce3c0b2d50 msgr2=0x7fce3c14b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:13.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.976+0000 7fce3a800640 1 --2- 172.21.15.114:0/2032228707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce3c0b2d50 0x7fce3c14b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:13.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.976+0000 7fce3a800640 1 -- 172.21.15.114:0/2032228707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce3c0cae20 msgr2=0x7fce3c0aba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:13.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.976+0000 7fce3a800640 1 --2- 172.21.15.114:0/2032228707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce3c0cae20 0x7fce3c0aba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:13.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.976+0000 7fce3a800640 1 -- 172.21.15.114:0/2032228707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce34009a70 con 0x7fce3c0b28c0 2024-09-13T17:52:13.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.976+0000 7fce3a800640 1 --2- 172.21.15.114:0/2032228707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce3c0b28c0 0x7fce3c14d1b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fce2c0010f0 tx=0x7fce2c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:13.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.976+0000 7fce32a00640 1 -- 172.21.15.114:0/2032228707 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c005cf0 con 0x7fce3c0b28c0 2024-09-13T17:52:13.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.976+0000 7fce32a00640 1 -- 172.21.15.114:0/2032228707 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2c005e70 con 0x7fce3c0b28c0 2024-09-13T17:52:13.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.976+0000 7fce41400640 1 -- 172.21.15.114:0/2032228707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce3c14c6d0 con 0x7fce3c0b28c0 2024-09-13T17:52:13.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.976+0000 7fce32a00640 1 -- 172.21.15.114:0/2032228707 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c0072d0 con 0x7fce3c0b28c0 2024-09-13T17:52:13.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.976+0000 7fce41400640 1 -- 172.21.15.114:0/2032228707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce3c14cc90 con 0x7fce3c0b28c0 2024-09-13T17:52:13.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.976+0000 7fce41400640 1 -- 172.21.15.114:0/2032228707 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce3c0cb200 con 0x7fce3c0b28c0 2024-09-13T17:52:13.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.976+0000 7fce32a00640 1 -- 172.21.15.114:0/2032228707 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fce2c007430 con 0x7fce3c0b28c0 2024-09-13T17:52:13.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.980+0000 7fce32a00640 1 --2- 172.21.15.114:0/2032228707 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fce1c066690 0x7fce1c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:13.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.980+0000 7fce32a00640 1 -- 172.21.15.114:0/2032228707 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fce2c083a50 con 0x7fce3c0b28c0 2024-09-13T17:52:13.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.980+0000 7fce39e00640 1 --2- 172.21.15.114:0/2032228707 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fce1c066690 0x7fce1c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:13.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.980+0000 7fce39e00640 1 --2- 172.21.15.114:0/2032228707 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fce1c066690 0x7fce1c068b50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fce3c14de50 tx=0x7fce28009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:13.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:13.984+0000 7fce32a00640 1 -- 172.21.15.114:0/2032228707 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fce2c050ae0 con 0x7fce3c0b28c0 2024-09-13T17:52:14.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.140+0000 7fce41400640 1 -- 172.21.15.114:0/2032228707 --> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fce3c0cd5b0 con 0x7fce1c066690 2024-09-13T17:52:14.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.152+0000 7fce32a00640 1 -- 172.21.15.114:0/2032228707 <== mgr.4102 v2:172.21.15.114:6832/137691478 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345284 (secure 0 0 0) 0x7fce3c0cd5b0 con 0x7fce1c066690 2024-09-13T17:52:14.157 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:14.161 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-13T17:52:14.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.156+0000 7fce41400640 1 -- 172.21.15.114:0/2032228707 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fce1c066690 msgr2=0x7fce1c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:14.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.156+0000 7fce41400640 1 --2- 172.21.15.114:0/2032228707 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fce1c066690 0x7fce1c068b50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fce3c14de50 tx=0x7fce28009040 comp rx=0 tx=0).stop 2024-09-13T17:52:14.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.156+0000 7fce41400640 1 -- 172.21.15.114:0/2032228707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce3c0b28c0 msgr2=0x7fce3c14d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:14.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.156+0000 7fce41400640 1 --2- 172.21.15.114:0/2032228707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce3c0b28c0 0x7fce3c14d1b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fce2c0010f0 tx=0x7fce2c00c890 comp rx=0 tx=0).stop 2024-09-13T17:52:14.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.156+0000 7fce41400640 1 -- 172.21.15.114:0/2032228707 shutdown_connections 2024-09-13T17:52:14.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.156+0000 7fce41400640 1 --2- 172.21.15.114:0/2032228707 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fce1c066690 0x7fce1c068b50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:14.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.156+0000 7fce41400640 1 --2- 172.21.15.114:0/2032228707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce3c0cae20 0x7fce3c0aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:14.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.156+0000 7fce41400640 1 --2- 172.21.15.114:0/2032228707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fce3c0b2d50 0x7fce3c14b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:14.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.156+0000 7fce41400640 1 --2- 172.21.15.114:0/2032228707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce3c0b28c0 0x7fce3c14d1b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:14.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.156+0000 7fce41400640 1 -- 172.21.15.114:0/2032228707 >> 172.21.15.114:0/2032228707 conn(0x7fce3c0b01a0 msgr2=0x7fce3c0cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:14.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.156+0000 7fce41400640 1 -- 172.21.15.114:0/2032228707 shutdown_connections 2024-09-13T17:52:14.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.156+0000 7fce41400640 1 -- 172.21.15.114:0/2032228707 wait complete. 2024-09-13T17:52:14.180 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-09-13T17:52:13.939495+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1988162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2231,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003385"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837772+0000","last_change":"2024-09-13T17:51:49.424735+0000","last_active":"2024-09-13T17:51:53.837772+0000","last_peered":"2024-09-13T17:51:53.837772+0000","last_clean":"2024-09-13T17:51:53.837772+0000","last_became_active":"2024-09-13T17:51:49.424461+0000","last_became_peered":"2024-09-13T17:51:49.424461+0000","last_unstale":"2024-09-13T17:51:53.837772+0000","last_undegraded":"2024-09-13T17:51:53.837772+0000","last_fullsized":"2024-09-13T17:51:53.837772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:05.776083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827298+0000","last_change":"2024-09-13T17:51:49.822366+0000","last_active":"2024-09-13T17:51:53.827298+0000","last_peered":"2024-09-13T17:51:53.827298+0000","last_clean":"2024-09-13T17:51:53.827298+0000","last_became_active":"2024-09-13T17:51:49.822088+0000","last_became_peered":"2024-09-13T17:51:49.822088+0000","last_unstale":"2024-09-13T17:51:53.827298+0000","last_undegraded":"2024-09-13T17:51:53.827298+0000","last_fullsized":"2024-09-13T17:51:53.827298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:19.843619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.898097+0000","last_change":"2024-09-13T17:51:53.888282+0000","last_active":"2024-09-13T17:51:53.898097+0000","last_peered":"2024-09-13T17:51:53.898097+0000","last_clean":"2024-09-13T17:51:53.898097+0000","last_became_active":"2024-09-13T17:51:53.887931+0000","last_became_peered":"2024-09-13T17:51:53.887931+0000","last_unstale":"2024-09-13T17:51:53.898097+0000","last_undegraded":"2024-09-13T17:51:53.898097+0000","last_fullsized":"2024-09-13T17:51:53.898097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:50:08.665223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827194+0000","last_change":"2024-09-13T17:51:49.417919+0000","last_active":"2024-09-13T17:51:53.827194+0000","last_peered":"2024-09-13T17:51:53.827194+0000","last_clean":"2024-09-13T17:51:53.827194+0000","last_became_active":"2024-09-13T17:51:49.417669+0000","last_became_peered":"2024-09-13T17:51:49.417669+0000","last_unstale":"2024-09-13T17:51:53.827194+0000","last_undegraded":"2024-09-13T17:51:53.827194+0000","last_fullsized":"2024-09-13T17:51:53.827194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:05.776083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837561+0000","last_change":"2024-09-13T17:51:49.820810+0000","last_active":"2024-09-13T17:51:53.837561+0000","last_peered":"2024-09-13T17:51:53.837561+0000","last_clean":"2024-09-13T17:51:53.837561+0000","last_became_active":"2024-09-13T17:51:49.820576+0000","last_became_peered":"2024-09-13T17:51:49.820576+0000","last_unstale":"2024-09-13T17:51:53.837561+0000","last_undegraded":"2024-09-13T17:51:53.837561+0000","last_fullsized":"2024-09-13T17:51:53.837561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:26.069550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.855045+0000","last_change":"2024-09-13T17:51:53.853653+0000","last_active":"2024-09-13T17:51:53.855045+0000","last_peered":"2024-09-13T17:51:53.855045+0000","last_clean":"2024-09-13T17:51:53.855045+0000","last_became_active":"2024-09-13T17:51:53.853265+0000","last_became_peered":"2024-09-13T17:51:53.853265+0000","last_unstale":"2024-09-13T17:51:53.855045+0000","last_undegraded":"2024-09-13T17:51:53.855045+0000","last_fullsized":"2024-09-13T17:51:53.855045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:21.706044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.884139+0000","last_change":"2024-09-13T17:51:49.429851+0000","last_active":"2024-09-13T17:51:53.884139+0000","last_peered":"2024-09-13T17:51:53.884139+0000","last_clean":"2024-09-13T17:51:53.884139+0000","last_became_active":"2024-09-13T17:51:49.428737+0000","last_became_peered":"2024-09-13T17:51:49.428737+0000","last_unstale":"2024-09-13T17:51:53.884139+0000","last_undegraded":"2024-09-13T17:51:53.884139+0000","last_fullsized":"2024-09-13T17:51:53.884139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:06.732541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.830753+0000","last_change":"2024-09-13T17:51:49.819895+0000","last_active":"2024-09-13T17:51:53.830753+0000","last_peered":"2024-09-13T17:51:53.830753+0000","last_clean":"2024-09-13T17:51:53.830753+0000","last_became_active":"2024-09-13T17:51:49.819636+0000","last_became_peered":"2024-09-13T17:51:49.819636+0000","last_unstale":"2024-09-13T17:51:53.830753+0000","last_undegraded":"2024-09-13T17:51:53.830753+0000","last_fullsized":"2024-09-13T17:51:53.830753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:16.626937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.851436+0000","last_change":"2024-09-13T17:51:53.848452+0000","last_active":"2024-09-13T17:51:53.851436+0000","last_peered":"2024-09-13T17:51:53.851436+0000","last_clean":"2024-09-13T17:51:53.851436+0000","last_became_active":"2024-09-13T17:51:53.847653+0000","last_became_peered":"2024-09-13T17:51:53.847653+0000","last_unstale":"2024-09-13T17:51:53.851436+0000","last_undegraded":"2024-09-13T17:51:53.851436+0000","last_fullsized":"2024-09-13T17:51:53.851436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:05.592560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882694+0000","last_change":"2024-09-13T17:51:49.430634+0000","last_active":"2024-09-13T17:51:53.882694+0000","last_peered":"2024-09-13T17:51:53.882694+0000","last_clean":"2024-09-13T17:51:53.882694+0000","last_became_active":"2024-09-13T17:51:49.428490+0000","last_became_peered":"2024-09-13T17:51:49.428490+0000","last_unstale":"2024-09-13T17:51:53.882694+0000","last_undegraded":"2024-09-13T17:51:53.882694+0000","last_fullsized":"2024-09-13T17:51:53.882694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:20.612271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.836270+0000","last_change":"2024-09-13T17:51:49.810371+0000","last_active":"2024-09-13T17:51:53.836270+0000","last_peered":"2024-09-13T17:51:53.836270+0000","last_clean":"2024-09-13T17:51:53.836270+0000","last_became_active":"2024-09-13T17:51:49.810008+0000","last_became_peered":"2024-09-13T17:51:49.810008+0000","last_unstale":"2024-09-13T17:51:53.836270+0000","last_undegraded":"2024-09-13T17:51:53.836270+0000","last_fullsized":"2024-09-13T17:51:53.836270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:54.519014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.851812+0000","last_change":"2024-09-13T17:51:53.850425+0000","last_active":"2024-09-13T17:51:53.851812+0000","last_peered":"2024-09-13T17:51:53.851812+0000","last_clean":"2024-09-13T17:51:53.851812+0000","last_became_active":"2024-09-13T17:51:53.848615+0000","last_became_peered":"2024-09-13T17:51:53.848615+0000","last_unstale":"2024-09-13T17:51:53.851812+0000","last_undegraded":"2024-09-13T17:51:53.851812+0000","last_fullsized":"2024-09-13T17:51:53.851812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:00.438042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827600+0000","last_change":"2024-09-13T17:51:49.814942+0000","last_active":"2024-09-13T17:51:53.827600+0000","last_peered":"2024-09-13T17:51:53.827600+0000","last_clean":"2024-09-13T17:51:53.827600+0000","last_became_active":"2024-09-13T17:51:49.814562+0000","last_became_peered":"2024-09-13T17:51:49.814562+0000","last_unstale":"2024-09-13T17:51:53.827600+0000","last_undegraded":"2024-09-13T17:51:53.827600+0000","last_fullsized":"2024-09-13T17:51:53.827600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:18.962464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882721+0000","last_change":"2024-09-13T17:51:49.426550+0000","last_active":"2024-09-13T17:51:53.882721+0000","last_peered":"2024-09-13T17:51:53.882721+0000","last_clean":"2024-09-13T17:51:53.882721+0000","last_became_active":"2024-09-13T17:51:49.424996+0000","last_became_peered":"2024-09-13T17:51:49.424996+0000","last_unstale":"2024-09-13T17:51:53.882721+0000","last_undegraded":"2024-09-13T17:51:53.882721+0000","last_fullsized":"2024-09-13T17:51:53.882721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:22.023124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.852108+0000","last_change":"2024-09-13T17:51:53.851132+0000","last_active":"2024-09-13T17:51:53.852108+0000","last_peered":"2024-09-13T17:51:53.852108+0000","last_clean":"2024-09-13T17:51:53.852108+0000","last_became_active":"2024-09-13T17:51:53.850766+0000","last_became_peered":"2024-09-13T17:51:53.850766+0000","last_unstale":"2024-09-13T17:51:53.852108+0000","last_undegraded":"2024-09-13T17:51:53.852108+0000","last_fullsized":"2024-09-13T17:51:53.852108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:28.299853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.825693+0000","last_change":"2024-09-13T17:51:49.827994+0000","last_active":"2024-09-13T17:51:53.825693+0000","last_peered":"2024-09-13T17:51:53.825693+0000","last_clean":"2024-09-13T17:51:53.825693+0000","last_became_active":"2024-09-13T17:51:49.827737+0000","last_became_peered":"2024-09-13T17:51:49.827737+0000","last_unstale":"2024-09-13T17:51:53.825693+0000","last_undegraded":"2024-09-13T17:51:53.825693+0000","last_fullsized":"2024-09-13T17:51:53.825693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:18.962464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827386+0000","last_change":"2024-09-13T17:51:49.421799+0000","last_active":"2024-09-13T17:51:53.827386+0000","last_peered":"2024-09-13T17:51:53.827386+0000","last_clean":"2024-09-13T17:51:53.827386+0000","last_became_active":"2024-09-13T17:51:49.420657+0000","last_became_peered":"2024-09-13T17:51:49.420657+0000","last_unstale":"2024-09-13T17:51:53.827386+0000","last_undegraded":"2024-09-13T17:51:53.827386+0000","last_fullsized":"2024-09-13T17:51:53.827386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:53.206793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.843724+0000","last_change":"2024-09-13T17:51:53.843027+0000","last_active":"2024-09-13T17:51:53.843724+0000","last_peered":"2024-09-13T17:51:53.843724+0000","last_clean":"2024-09-13T17:51:53.843724+0000","last_became_active":"2024-09-13T17:51:53.842576+0000","last_became_peered":"2024-09-13T17:51:53.842576+0000","last_unstale":"2024-09-13T17:51:53.843724+0000","last_undegraded":"2024-09-13T17:51:53.843724+0000","last_fullsized":"2024-09-13T17:51:53.843724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:04.738599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826762+0000","last_change":"2024-09-13T17:51:49.820882+0000","last_active":"2024-09-13T17:51:53.826762+0000","last_peered":"2024-09-13T17:51:53.826762+0000","last_clean":"2024-09-13T17:51:53.826762+0000","last_became_active":"2024-09-13T17:51:49.820420+0000","last_became_peered":"2024-09-13T17:51:49.820420+0000","last_unstale":"2024-09-13T17:51:53.826762+0000","last_undegraded":"2024-09-13T17:51:53.826762+0000","last_fullsized":"2024-09-13T17:51:53.826762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:38.101006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.824631+0000","last_change":"2024-09-13T17:51:49.411703+0000","last_active":"2024-09-13T17:51:53.824631+0000","last_peered":"2024-09-13T17:51:53.824631+0000","last_clean":"2024-09-13T17:51:53.824631+0000","last_became_active":"2024-09-13T17:51:49.411421+0000","last_became_peered":"2024-09-13T17:51:49.411421+0000","last_unstale":"2024-09-13T17:51:53.824631+0000","last_undegraded":"2024-09-13T17:51:53.824631+0000","last_fullsized":"2024-09-13T17:51:53.824631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:06.421994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.888157+0000","last_change":"2024-09-13T17:51:53.884773+0000","last_active":"2024-09-13T17:51:53.888157+0000","last_peered":"2024-09-13T17:51:53.888157+0000","last_clean":"2024-09-13T17:51:53.888157+0000","last_became_active":"2024-09-13T17:51:53.884392+0000","last_became_peered":"2024-09-13T17:51:53.884392+0000","last_unstale":"2024-09-13T17:51:53.888157+0000","last_undegraded":"2024-09-13T17:51:53.888157+0000","last_fullsized":"2024-09-13T17:51:53.888157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:35.046158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.834403+0000","last_change":"2024-09-13T17:51:49.810146+0000","last_active":"2024-09-13T17:51:53.834403+0000","last_peered":"2024-09-13T17:51:53.834403+0000","last_clean":"2024-09-13T17:51:53.834403+0000","last_became_active":"2024-09-13T17:51:49.809659+0000","last_became_peered":"2024-09-13T17:51:49.809659+0000","last_unstale":"2024-09-13T17:51:53.834403+0000","last_undegraded":"2024-09-13T17:51:53.834403+0000","last_fullsized":"2024-09-13T17:51:53.834403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:22.017119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882255+0000","last_change":"2024-09-13T17:51:49.420646+0000","last_active":"2024-09-13T17:51:53.882255+0000","last_peered":"2024-09-13T17:51:53.882255+0000","last_clean":"2024-09-13T17:51:53.882255+0000","last_became_active":"2024-09-13T17:51:49.420353+0000","last_became_peered":"2024-09-13T17:51:49.420353+0000","last_unstale":"2024-09-13T17:51:53.882255+0000","last_undegraded":"2024-09-13T17:51:53.882255+0000","last_fullsized":"2024-09-13T17:51:53.882255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:21.010810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.851627+0000","last_change":"2024-09-13T17:51:53.849048+0000","last_active":"2024-09-13T17:51:53.851627+0000","last_peered":"2024-09-13T17:51:53.851627+0000","last_clean":"2024-09-13T17:51:53.851627+0000","last_became_active":"2024-09-13T17:51:53.848610+0000","last_became_peered":"2024-09-13T17:51:53.848610+0000","last_unstale":"2024-09-13T17:51:53.851627+0000","last_undegraded":"2024-09-13T17:51:53.851627+0000","last_fullsized":"2024-09-13T17:51:53.851627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:23.757828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837389+0000","last_change":"2024-09-13T17:51:49.813776+0000","last_active":"2024-09-13T17:51:53.837389+0000","last_peered":"2024-09-13T17:51:53.837389+0000","last_clean":"2024-09-13T17:51:53.837389+0000","last_became_active":"2024-09-13T17:51:49.813446+0000","last_became_peered":"2024-09-13T17:51:49.813446+0000","last_unstale":"2024-09-13T17:51:53.837389+0000","last_undegraded":"2024-09-13T17:51:53.837389+0000","last_fullsized":"2024-09-13T17:51:53.837389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:38.101006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827985+0000","last_change":"2024-09-13T17:51:49.424387+0000","last_active":"2024-09-13T17:51:53.827985+0000","last_peered":"2024-09-13T17:51:53.827985+0000","last_clean":"2024-09-13T17:51:53.827985+0000","last_became_active":"2024-09-13T17:51:49.424056+0000","last_became_peered":"2024-09-13T17:51:49.424056+0000","last_unstale":"2024-09-13T17:51:53.827985+0000","last_undegraded":"2024-09-13T17:51:53.827985+0000","last_fullsized":"2024-09-13T17:51:53.827985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:39.329721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.890240+0000","last_change":"2024-09-13T17:51:53.887729+0000","last_active":"2024-09-13T17:51:53.890240+0000","last_peered":"2024-09-13T17:51:53.890240+0000","last_clean":"2024-09-13T17:51:53.890240+0000","last_became_active":"2024-09-13T17:51:53.887339+0000","last_became_peered":"2024-09-13T17:51:53.887339+0000","last_unstale":"2024-09-13T17:51:53.890240+0000","last_undegraded":"2024-09-13T17:51:53.890240+0000","last_fullsized":"2024-09-13T17:51:53.890240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:46.649388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.829910+0000","last_change":"2024-09-13T17:51:49.826015+0000","last_active":"2024-09-13T17:51:53.829910+0000","last_peered":"2024-09-13T17:51:53.829910+0000","last_clean":"2024-09-13T17:51:53.829910+0000","last_became_active":"2024-09-13T17:51:49.825697+0000","last_became_peered":"2024-09-13T17:51:49.825697+0000","last_unstale":"2024-09-13T17:51:53.829910+0000","last_undegraded":"2024-09-13T17:51:53.829910+0000","last_fullsized":"2024-09-13T17:51:53.829910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:12.044921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826611+0000","last_change":"2024-09-13T17:51:49.421246+0000","last_active":"2024-09-13T17:51:53.826611+0000","last_peered":"2024-09-13T17:51:53.826611+0000","last_clean":"2024-09-13T17:51:53.826611+0000","last_became_active":"2024-09-13T17:51:49.419599+0000","last_became_peered":"2024-09-13T17:51:49.419599+0000","last_unstale":"2024-09-13T17:51:53.826611+0000","last_undegraded":"2024-09-13T17:51:53.826611+0000","last_fullsized":"2024-09-13T17:51:53.826611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:22.023124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.898030+0000","last_change":"2024-09-13T17:51:53.886455+0000","last_active":"2024-09-13T17:51:53.898030+0000","last_peered":"2024-09-13T17:51:53.898030+0000","last_clean":"2024-09-13T17:51:53.898030+0000","last_became_active":"2024-09-13T17:51:53.885310+0000","last_became_peered":"2024-09-13T17:51:53.885310+0000","last_unstale":"2024-09-13T17:51:53.898030+0000","last_undegraded":"2024-09-13T17:51:53.898030+0000","last_fullsized":"2024-09-13T17:51:53.898030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:20.352407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.824729+0000","last_change":"2024-09-13T17:51:49.810357+0000","last_active":"2024-09-13T17:51:53.824729+0000","last_peered":"2024-09-13T17:51:53.824729+0000","last_clean":"2024-09-13T17:51:53.824729+0000","last_became_active":"2024-09-13T17:51:49.810114+0000","last_became_peered":"2024-09-13T17:51:49.810114+0000","last_unstale":"2024-09-13T17:51:53.824729+0000","last_undegraded":"2024-09-13T17:51:53.824729+0000","last_fullsized":"2024-09-13T17:51:53.824729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:16.626937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.884340+0000","last_change":"2024-09-13T17:51:49.423732+0000","last_active":"2024-09-13T17:51:53.884340+0000","last_peered":"2024-09-13T17:51:53.884340+0000","last_clean":"2024-09-13T17:51:53.884340+0000","last_became_active":"2024-09-13T17:51:49.422959+0000","last_became_peered":"2024-09-13T17:51:49.422959+0000","last_unstale":"2024-09-13T17:51:53.884340+0000","last_undegraded":"2024-09-13T17:51:53.884340+0000","last_fullsized":"2024-09-13T17:51:53.884340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:07.122247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.888684+0000","last_change":"2024-09-13T17:51:53.884526+0000","last_active":"2024-09-13T17:51:53.888684+0000","last_peered":"2024-09-13T17:51:53.888684+0000","last_clean":"2024-09-13T17:51:53.888684+0000","last_became_active":"2024-09-13T17:51:53.884114+0000","last_became_peered":"2024-09-13T17:51:53.884114+0000","last_unstale":"2024-09-13T17:51:53.888684+0000","last_undegraded":"2024-09-13T17:51:53.888684+0000","last_fullsized":"2024-09-13T17:51:53.888684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:11.718873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.836339+0000","last_change":"2024-09-13T17:51:49.830157+0000","last_active":"2024-09-13T17:51:53.836339+0000","last_peered":"2024-09-13T17:51:53.836339+0000","last_clean":"2024-09-13T17:51:53.836339+0000","last_became_active":"2024-09-13T17:51:49.829791+0000","last_became_peered":"2024-09-13T17:51:49.829791+0000","last_unstale":"2024-09-13T17:51:53.836339+0000","last_undegraded":"2024-09-13T17:51:53.836339+0000","last_fullsized":"2024-09-13T17:51:53.836339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:34.576074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826239+0000","last_change":"2024-09-13T17:51:49.417458+0000","last_active":"2024-09-13T17:51:53.826239+0000","last_peered":"2024-09-13T17:51:53.826239+0000","last_clean":"2024-09-13T17:51:53.826239+0000","last_became_active":"2024-09-13T17:51:49.417205+0000","last_became_peered":"2024-09-13T17:51:49.417205+0000","last_unstale":"2024-09-13T17:51:53.826239+0000","last_undegraded":"2024-09-13T17:51:53.826239+0000","last_fullsized":"2024-09-13T17:51:53.826239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:20.612271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.854428+0000","last_change":"2024-09-13T17:51:53.850163+0000","last_active":"2024-09-13T17:51:53.854428+0000","last_peered":"2024-09-13T17:51:53.854428+0000","last_clean":"2024-09-13T17:51:53.854428+0000","last_became_active":"2024-09-13T17:51:53.847840+0000","last_became_peered":"2024-09-13T17:51:53.847840+0000","last_unstale":"2024-09-13T17:51:53.854428+0000","last_undegraded":"2024-09-13T17:51:53.854428+0000","last_fullsized":"2024-09-13T17:51:53.854428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:04.738599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.834848+0000","last_change":"2024-09-13T17:51:49.807208+0000","last_active":"2024-09-13T17:51:53.834848+0000","last_peered":"2024-09-13T17:51:53.834848+0000","last_clean":"2024-09-13T17:51:53.834848+0000","last_became_active":"2024-09-13T17:51:49.806837+0000","last_became_peered":"2024-09-13T17:51:49.806837+0000","last_unstale":"2024-09-13T17:51:53.834848+0000","last_undegraded":"2024-09-13T17:51:53.834848+0000","last_fullsized":"2024-09-13T17:51:53.834848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:21.618580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.838674+0000","last_change":"2024-09-13T17:51:49.422538+0000","last_active":"2024-09-13T17:51:53.838674+0000","last_peered":"2024-09-13T17:51:53.838674+0000","last_clean":"2024-09-13T17:51:53.838674+0000","last_became_active":"2024-09-13T17:51:49.422079+0000","last_became_peered":"2024-09-13T17:51:49.422079+0000","last_unstale":"2024-09-13T17:51:53.838674+0000","last_undegraded":"2024-09-13T17:51:53.838674+0000","last_fullsized":"2024-09-13T17:51:53.838674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:01.166296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.853333+0000","last_change":"2024-09-13T17:51:53.848470+0000","last_active":"2024-09-13T17:51:53.853333+0000","last_peered":"2024-09-13T17:51:53.853333+0000","last_clean":"2024-09-13T17:51:53.853333+0000","last_became_active":"2024-09-13T17:51:53.847907+0000","last_became_peered":"2024-09-13T17:51:53.847907+0000","last_unstale":"2024-09-13T17:51:53.853333+0000","last_undegraded":"2024-09-13T17:51:53.853333+0000","last_fullsized":"2024-09-13T17:51:53.853333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:01.791551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.824107+0000","last_change":"2024-09-13T17:51:49.803724+0000","last_active":"2024-09-13T17:51:53.824107+0000","last_peered":"2024-09-13T17:51:53.824107+0000","last_clean":"2024-09-13T17:51:53.824107+0000","last_became_active":"2024-09-13T17:51:49.803488+0000","last_became_peered":"2024-09-13T17:51:49.803488+0000","last_unstale":"2024-09-13T17:51:53.824107+0000","last_undegraded":"2024-09-13T17:51:53.824107+0000","last_fullsized":"2024-09-13T17:51:53.824107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:18.962464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.838227+0000","last_change":"2024-09-13T17:51:49.420825+0000","last_active":"2024-09-13T17:51:53.838227+0000","last_peered":"2024-09-13T17:51:53.838227+0000","last_clean":"2024-09-13T17:51:53.838227+0000","last_became_active":"2024-09-13T17:51:49.420459+0000","last_became_peered":"2024-09-13T17:51:49.420459+0000","last_unstale":"2024-09-13T17:51:53.838227+0000","last_undegraded":"2024-09-13T17:51:53.838227+0000","last_fullsized":"2024-09-13T17:51:53.838227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:05.515948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.847206+0000","last_change":"2024-09-13T17:51:53.842609+0000","last_active":"2024-09-13T17:51:53.847206+0000","last_peered":"2024-09-13T17:51:53.847206+0000","last_clean":"2024-09-13T17:51:53.847206+0000","last_became_active":"2024-09-13T17:51:53.842195+0000","last_became_peered":"2024-09-13T17:51:53.842195+0000","last_unstale":"2024-09-13T17:51:53.847206+0000","last_undegraded":"2024-09-13T17:51:53.847206+0000","last_fullsized":"2024-09-13T17:51:53.847206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:48:59.044958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.835739+0000","last_change":"2024-09-13T17:51:49.803582+0000","last_active":"2024-09-13T17:51:53.835739+0000","last_peered":"2024-09-13T17:51:53.835739+0000","last_clean":"2024-09-13T17:51:53.835739+0000","last_became_active":"2024-09-13T17:51:49.803242+0000","last_became_peered":"2024-09-13T17:51:49.803242+0000","last_unstale":"2024-09-13T17:51:53.835739+0000","last_undegraded":"2024-09-13T17:51:53.835739+0000","last_fullsized":"2024-09-13T17:51:53.835739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:35.902537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882372+0000","last_change":"2024-09-13T17:51:49.427107+0000","last_active":"2024-09-13T17:51:53.882372+0000","last_peered":"2024-09-13T17:51:53.882372+0000","last_clean":"2024-09-13T17:51:53.882372+0000","last_became_active":"2024-09-13T17:51:49.426867+0000","last_became_peered":"2024-09-13T17:51:49.426867+0000","last_unstale":"2024-09-13T17:51:53.882372+0000","last_undegraded":"2024-09-13T17:51:53.882372+0000","last_fullsized":"2024-09-13T17:51:53.882372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:53.206793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.888656+0000","last_change":"2024-09-13T17:51:53.884097+0000","last_active":"2024-09-13T17:51:53.888656+0000","last_peered":"2024-09-13T17:51:53.888656+0000","last_clean":"2024-09-13T17:51:53.888656+0000","last_became_active":"2024-09-13T17:51:53.883622+0000","last_became_peered":"2024-09-13T17:51:53.883622+0000","last_unstale":"2024-09-13T17:51:53.888656+0000","last_undegraded":"2024-09-13T17:51:53.888656+0000","last_fullsized":"2024-09-13T17:51:53.888656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:46.649388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826078+0000","last_change":"2024-09-13T17:51:49.838792+0000","last_active":"2024-09-13T17:51:53.826078+0000","last_peered":"2024-09-13T17:51:53.826078+0000","last_clean":"2024-09-13T17:51:53.826078+0000","last_became_active":"2024-09-13T17:51:49.838580+0000","last_became_peered":"2024-09-13T17:51:49.838580+0000","last_unstale":"2024-09-13T17:51:53.826078+0000","last_undegraded":"2024-09-13T17:51:53.826078+0000","last_fullsized":"2024-09-13T17:51:53.826078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:21.449832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.834191+0000","last_change":"2024-09-13T17:51:49.416568+0000","last_active":"2024-09-13T17:51:53.834191+0000","last_peered":"2024-09-13T17:51:53.834191+0000","last_clean":"2024-09-13T17:51:53.834191+0000","last_became_active":"2024-09-13T17:51:49.416233+0000","last_became_peered":"2024-09-13T17:51:49.416233+0000","last_unstale":"2024-09-13T17:51:53.834191+0000","last_undegraded":"2024-09-13T17:51:53.834191+0000","last_fullsized":"2024-09-13T17:51:53.834191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:39.329721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882384+0000","last_change":"2024-09-13T17:51:40.205691+0000","last_active":"2024-09-13T17:51:53.882384+0000","last_peered":"2024-09-13T17:51:53.882384+0000","last_clean":"2024-09-13T17:51:53.882384+0000","last_became_active":"2024-09-13T17:51:40.204577+0000","last_became_peered":"2024-09-13T17:51:40.204577+0000","last_unstale":"2024-09-13T17:51:53.882384+0000","last_undegraded":"2024-09-13T17:51:53.882384+0000","last_fullsized":"2024-09-13T17:51:53.882384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_clean_scrub_stamp":"2024-09-13T17:51:38.340495+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:37.899275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.889483+0000","last_change":"2024-09-13T17:51:53.885726+0000","last_active":"2024-09-13T17:51:53.889483+0000","last_peered":"2024-09-13T17:51:53.889483+0000","last_clean":"2024-09-13T17:51:53.889483+0000","last_became_active":"2024-09-13T17:51:53.885225+0000","last_became_peered":"2024-09-13T17:51:53.885225+0000","last_unstale":"2024-09-13T17:51:53.889483+0000","last_undegraded":"2024-09-13T17:51:53.889483+0000","last_fullsized":"2024-09-13T17:51:53.889483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:56.070629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.884041+0000","last_change":"2024-09-13T17:51:49.838216+0000","last_active":"2024-09-13T17:51:53.884041+0000","last_peered":"2024-09-13T17:51:53.884041+0000","last_clean":"2024-09-13T17:51:53.884041+0000","last_became_active":"2024-09-13T17:51:49.838023+0000","last_became_peered":"2024-09-13T17:51:49.838023+0000","last_unstale":"2024-09-13T17:51:53.884041+0000","last_undegraded":"2024-09-13T17:51:53.884041+0000","last_fullsized":"2024-09-13T17:51:53.884041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:01.703358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.838525+0000","last_change":"2024-09-13T17:51:49.425601+0000","last_active":"2024-09-13T17:51:53.838525+0000","last_peered":"2024-09-13T17:51:53.838525+0000","last_clean":"2024-09-13T17:51:53.838525+0000","last_became_active":"2024-09-13T17:51:49.425289+0000","last_became_peered":"2024-09-13T17:51:49.425289+0000","last_unstale":"2024-09-13T17:51:53.838525+0000","last_undegraded":"2024-09-13T17:51:53.838525+0000","last_fullsized":"2024-09-13T17:51:53.838525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:06.421994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.888637+0000","last_change":"2024-09-13T17:51:53.885100+0000","last_active":"2024-09-13T17:51:53.888637+0000","last_peered":"2024-09-13T17:51:53.888637+0000","last_clean":"2024-09-13T17:51:53.888637+0000","last_became_active":"2024-09-13T17:51:53.884217+0000","last_became_peered":"2024-09-13T17:51:53.884217+0000","last_unstale":"2024-09-13T17:51:53.888637+0000","last_undegraded":"2024-09-13T17:51:53.888637+0000","last_fullsized":"2024-09-13T17:51:53.888637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:01.791551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.830819+0000","last_change":"2024-09-13T17:51:49.830458+0000","last_active":"2024-09-13T17:51:53.830819+0000","last_peered":"2024-09-13T17:51:53.830819+0000","last_clean":"2024-09-13T17:51:53.830819+0000","last_became_active":"2024-09-13T17:51:49.830026+0000","last_became_peered":"2024-09-13T17:51:49.830026+0000","last_unstale":"2024-09-13T17:51:53.830819+0000","last_undegraded":"2024-09-13T17:51:53.830819+0000","last_fullsized":"2024-09-13T17:51:53.830819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:37.125958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826446+0000","last_change":"2024-09-13T17:51:49.416301+0000","last_active":"2024-09-13T17:51:53.826446+0000","last_peered":"2024-09-13T17:51:53.826446+0000","last_clean":"2024-09-13T17:51:53.826446+0000","last_became_active":"2024-09-13T17:51:49.416065+0000","last_became_peered":"2024-09-13T17:51:49.416065+0000","last_unstale":"2024-09-13T17:51:53.826446+0000","last_undegraded":"2024-09-13T17:51:53.826446+0000","last_fullsized":"2024-09-13T17:51:53.826446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:42.283317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.847340+0000","last_change":"2024-09-13T17:51:53.844047+0000","last_active":"2024-09-13T17:51:53.847340+0000","last_peered":"2024-09-13T17:51:53.847340+0000","last_clean":"2024-09-13T17:51:53.847340+0000","last_became_active":"2024-09-13T17:51:53.843665+0000","last_became_peered":"2024-09-13T17:51:53.843665+0000","last_unstale":"2024-09-13T17:51:53.847340+0000","last_undegraded":"2024-09-13T17:51:53.847340+0000","last_fullsized":"2024-09-13T17:51:53.847340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:04.738599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.884913+0000","last_change":"2024-09-13T17:51:49.836513+0000","last_active":"2024-09-13T17:51:53.884913+0000","last_peered":"2024-09-13T17:51:53.884913+0000","last_clean":"2024-09-13T17:51:53.884913+0000","last_became_active":"2024-09-13T17:51:49.836232+0000","last_became_peered":"2024-09-13T17:51:49.836232+0000","last_unstale":"2024-09-13T17:51:53.884913+0000","last_undegraded":"2024-09-13T17:51:53.884913+0000","last_fullsized":"2024-09-13T17:51:53.884913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:37.125958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.841145+0000","last_change":"2024-09-13T17:51:49.420678+0000","last_active":"2024-09-13T17:51:53.841145+0000","last_peered":"2024-09-13T17:51:53.841145+0000","last_clean":"2024-09-13T17:51:53.841145+0000","last_became_active":"2024-09-13T17:51:49.420418+0000","last_became_peered":"2024-09-13T17:51:49.420418+0000","last_unstale":"2024-09-13T17:51:53.841145+0000","last_undegraded":"2024-09-13T17:51:53.841145+0000","last_fullsized":"2024-09-13T17:51:53.841145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:42.283317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.889765+0000","last_change":"2024-09-13T17:51:53.886172+0000","last_active":"2024-09-13T17:51:53.889765+0000","last_peered":"2024-09-13T17:51:53.889765+0000","last_clean":"2024-09-13T17:51:53.889765+0000","last_became_active":"2024-09-13T17:51:53.885826+0000","last_became_peered":"2024-09-13T17:51:53.885826+0000","last_unstale":"2024-09-13T17:51:53.889765+0000","last_undegraded":"2024-09-13T17:51:53.889765+0000","last_fullsized":"2024-09-13T17:51:53.889765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:46.649388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.885762+0000","last_change":"2024-09-13T17:51:49.834991+0000","last_active":"2024-09-13T17:51:53.885762+0000","last_peered":"2024-09-13T17:51:53.885762+0000","last_clean":"2024-09-13T17:51:53.885762+0000","last_became_active":"2024-09-13T17:51:49.834740+0000","last_became_peered":"2024-09-13T17:51:49.834740+0000","last_unstale":"2024-09-13T17:51:53.885762+0000","last_undegraded":"2024-09-13T17:51:53.885762+0000","last_fullsized":"2024-09-13T17:51:53.885762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:47.337762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.834831+0000","last_change":"2024-09-13T17:51:49.415586+0000","last_active":"2024-09-13T17:51:53.834831+0000","last_peered":"2024-09-13T17:51:53.834831+0000","last_clean":"2024-09-13T17:51:53.834831+0000","last_became_active":"2024-09-13T17:51:49.415184+0000","last_became_peered":"2024-09-13T17:51:49.415184+0000","last_unstale":"2024-09-13T17:51:53.834831+0000","last_undegraded":"2024-09-13T17:51:53.834831+0000","last_fullsized":"2024-09-13T17:51:53.834831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:38.364524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.851409+0000","last_change":"2024-09-13T17:51:53.848234+0000","last_active":"2024-09-13T17:51:53.851409+0000","last_peered":"2024-09-13T17:51:53.851409+0000","last_clean":"2024-09-13T17:51:53.851409+0000","last_became_active":"2024-09-13T17:51:53.847557+0000","last_became_peered":"2024-09-13T17:51:53.847557+0000","last_unstale":"2024-09-13T17:51:53.851409+0000","last_undegraded":"2024-09-13T17:51:53.851409+0000","last_fullsized":"2024-09-13T17:51:53.851409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:51.251781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.883636+0000","last_change":"2024-09-13T17:51:49.830867+0000","last_active":"2024-09-13T17:51:53.883636+0000","last_peered":"2024-09-13T17:51:53.883636+0000","last_clean":"2024-09-13T17:51:53.883636+0000","last_became_active":"2024-09-13T17:51:49.830584+0000","last_became_peered":"2024-09-13T17:51:49.830584+0000","last_unstale":"2024-09-13T17:51:53.883636+0000","last_undegraded":"2024-09-13T17:51:53.883636+0000","last_fullsized":"2024-09-13T17:51:53.883636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:51.162047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837955+0000","last_change":"2024-09-13T17:51:49.424019+0000","last_active":"2024-09-13T17:51:53.837955+0000","last_peered":"2024-09-13T17:51:53.837955+0000","last_clean":"2024-09-13T17:51:53.837955+0000","last_became_active":"2024-09-13T17:51:49.423710+0000","last_became_peered":"2024-09-13T17:51:49.423710+0000","last_unstale":"2024-09-13T17:51:53.837955+0000","last_undegraded":"2024-09-13T17:51:53.837955+0000","last_fullsized":"2024-09-13T17:51:53.837955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:01.166296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.849553+0000","last_change":"2024-09-13T17:51:53.844911+0000","last_active":"2024-09-13T17:51:53.849553+0000","last_peered":"2024-09-13T17:51:53.849553+0000","last_clean":"2024-09-13T17:51:53.849553+0000","last_became_active":"2024-09-13T17:51:53.844550+0000","last_became_peered":"2024-09-13T17:51:53.844550+0000","last_unstale":"2024-09-13T17:51:53.849553+0000","last_undegraded":"2024-09-13T17:51:53.849553+0000","last_fullsized":"2024-09-13T17:51:53.849553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:28.299853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826947+0000","last_change":"2024-09-13T17:51:49.811086+0000","last_active":"2024-09-13T17:51:53.826947+0000","last_peered":"2024-09-13T17:51:53.826947+0000","last_clean":"2024-09-13T17:51:53.826947+0000","last_became_active":"2024-09-13T17:51:49.810823+0000","last_became_peered":"2024-09-13T17:51:49.810823+0000","last_unstale":"2024-09-13T17:51:53.826947+0000","last_undegraded":"2024-09-13T17:51:53.826947+0000","last_fullsized":"2024-09-13T17:51:53.826947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:14.458841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827359+0000","last_change":"2024-09-13T17:51:49.426895+0000","last_active":"2024-09-13T17:51:53.827359+0000","last_peered":"2024-09-13T17:51:53.827359+0000","last_clean":"2024-09-13T17:51:53.827359+0000","last_became_active":"2024-09-13T17:51:49.426624+0000","last_became_peered":"2024-09-13T17:51:49.426624+0000","last_unstale":"2024-09-13T17:51:53.827359+0000","last_undegraded":"2024-09-13T17:51:53.827359+0000","last_fullsized":"2024-09-13T17:51:53.827359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:42.283317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.897944+0000","last_change":"2024-09-13T17:51:53.885895+0000","last_active":"2024-09-13T17:51:53.897944+0000","last_peered":"2024-09-13T17:51:53.897944+0000","last_clean":"2024-09-13T17:51:53.897944+0000","last_became_active":"2024-09-13T17:51:53.884841+0000","last_became_peered":"2024-09-13T17:51:53.884841+0000","last_unstale":"2024-09-13T17:51:53.897944+0000","last_undegraded":"2024-09-13T17:51:53.897944+0000","last_fullsized":"2024-09-13T17:51:53.897944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:27.675643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882609+0000","last_change":"2024-09-13T17:51:49.831817+0000","last_active":"2024-09-13T17:51:53.882609+0000","last_peered":"2024-09-13T17:51:53.882609+0000","last_clean":"2024-09-13T17:51:53.882609+0000","last_became_active":"2024-09-13T17:51:49.831354+0000","last_became_peered":"2024-09-13T17:51:49.831354+0000","last_unstale":"2024-09-13T17:51:53.882609+0000","last_undegraded":"2024-09-13T17:51:53.882609+0000","last_fullsized":"2024-09-13T17:51:53.882609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:04.470664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.838565+0000","last_change":"2024-09-13T17:51:49.422566+0000","last_active":"2024-09-13T17:51:53.838565+0000","last_peered":"2024-09-13T17:51:53.838565+0000","last_clean":"2024-09-13T17:51:53.838565+0000","last_became_active":"2024-09-13T17:51:49.421786+0000","last_became_peered":"2024-09-13T17:51:49.421786+0000","last_unstale":"2024-09-13T17:51:53.838565+0000","last_undegraded":"2024-09-13T17:51:53.838565+0000","last_fullsized":"2024-09-13T17:51:53.838565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:42.283317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.897908+0000","last_change":"2024-09-13T17:51:53.884841+0000","last_active":"2024-09-13T17:51:53.897908+0000","last_peered":"2024-09-13T17:51:53.897908+0000","last_clean":"2024-09-13T17:51:53.897908+0000","last_became_active":"2024-09-13T17:51:53.884135+0000","last_became_peered":"2024-09-13T17:51:53.884135+0000","last_unstale":"2024-09-13T17:51:53.897908+0000","last_undegraded":"2024-09-13T17:51:53.897908+0000","last_fullsized":"2024-09-13T17:51:53.897908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:53.766560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.836501+0000","last_change":"2024-09-13T17:51:49.824264+0000","last_active":"2024-09-13T17:51:53.836501+0000","last_peered":"2024-09-13T17:51:53.836501+0000","last_clean":"2024-09-13T17:51:53.836501+0000","last_became_active":"2024-09-13T17:51:49.823959+0000","last_became_peered":"2024-09-13T17:51:49.823959+0000","last_unstale":"2024-09-13T17:51:53.836501+0000","last_undegraded":"2024-09-13T17:51:53.836501+0000","last_fullsized":"2024-09-13T17:51:53.836501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:19.843619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837204+0000","last_change":"2024-09-13T17:51:49.425477+0000","last_active":"2024-09-13T17:51:53.837204+0000","last_peered":"2024-09-13T17:51:53.837204+0000","last_clean":"2024-09-13T17:51:53.837204+0000","last_became_active":"2024-09-13T17:51:49.425220+0000","last_became_peered":"2024-09-13T17:51:49.425220+0000","last_unstale":"2024-09-13T17:51:53.837204+0000","last_undegraded":"2024-09-13T17:51:53.837204+0000","last_fullsized":"2024-09-13T17:51:53.837204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:38.364524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.887527+0000","last_change":"2024-09-13T17:51:53.883758+0000","last_active":"2024-09-13T17:51:53.887527+0000","last_peered":"2024-09-13T17:51:53.887527+0000","last_clean":"2024-09-13T17:51:53.887527+0000","last_became_active":"2024-09-13T17:51:53.883328+0000","last_became_peered":"2024-09-13T17:51:53.883328+0000","last_unstale":"2024-09-13T17:51:53.887527+0000","last_undegraded":"2024-09-13T17:51:53.887527+0000","last_fullsized":"2024-09-13T17:51:53.887527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:39.243101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882767+0000","last_change":"2024-09-13T17:51:49.832481+0000","last_active":"2024-09-13T17:51:53.882767+0000","last_peered":"2024-09-13T17:51:53.882767+0000","last_clean":"2024-09-13T17:51:53.882767+0000","last_became_active":"2024-09-13T17:51:49.832173+0000","last_became_peered":"2024-09-13T17:51:49.832173+0000","last_unstale":"2024-09-13T17:51:53.882767+0000","last_undegraded":"2024-09-13T17:51:53.882767+0000","last_fullsized":"2024-09-13T17:51:53.882767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:34.576074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:51:59.930293+0000","last_change":"2024-09-13T17:51:49.430279+0000","last_active":"2024-09-13T17:51:59.930293+0000","last_peered":"2024-09-13T17:51:59.930293+0000","last_clean":"2024-09-13T17:51:59.930293+0000","last_became_active":"2024-09-13T17:51:49.430015+0000","last_became_peered":"2024-09-13T17:51:49.430015+0000","last_unstale":"2024-09-13T17:51:59.930293+0000","last_undegraded":"2024-09-13T17:51:59.930293+0000","last_fullsized":"2024-09-13T17:51:59.930293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:53.206793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.853325+0000","last_change":"2024-09-13T17:51:53.848938+0000","last_active":"2024-09-13T17:51:53.853325+0000","last_peered":"2024-09-13T17:51:53.853325+0000","last_clean":"2024-09-13T17:51:53.853325+0000","last_became_active":"2024-09-13T17:51:53.848420+0000","last_became_peered":"2024-09-13T17:51:53.848420+0000","last_unstale":"2024-09-13T17:51:53.853325+0000","last_undegraded":"2024-09-13T17:51:53.853325+0000","last_fullsized":"2024-09-13T17:51:53.853325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:06.615337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.834925+0000","last_change":"2024-09-13T17:51:49.827666+0000","last_active":"2024-09-13T17:51:53.834925+0000","last_peered":"2024-09-13T17:51:53.834925+0000","last_clean":"2024-09-13T17:51:53.834925+0000","last_became_active":"2024-09-13T17:51:49.827010+0000","last_became_peered":"2024-09-13T17:51:49.827010+0000","last_unstale":"2024-09-13T17:51:53.834925+0000","last_undegraded":"2024-09-13T17:51:53.834925+0000","last_fullsized":"2024-09-13T17:51:53.834925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:23.029433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826358+0000","last_change":"2024-09-13T17:51:49.421670+0000","last_active":"2024-09-13T17:51:53.826358+0000","last_peered":"2024-09-13T17:51:53.826358+0000","last_clean":"2024-09-13T17:51:53.826358+0000","last_became_active":"2024-09-13T17:51:49.418903+0000","last_became_peered":"2024-09-13T17:51:49.418903+0000","last_unstale":"2024-09-13T17:51:53.826358+0000","last_undegraded":"2024-09-13T17:51:53.826358+0000","last_fullsized":"2024-09-13T17:51:53.826358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:39.329721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.851665+0000","last_change":"2024-09-13T17:51:53.849211+0000","last_active":"2024-09-13T17:51:53.851665+0000","last_peered":"2024-09-13T17:51:53.851665+0000","last_clean":"2024-09-13T17:51:53.851665+0000","last_became_active":"2024-09-13T17:51:53.848829+0000","last_became_peered":"2024-09-13T17:51:53.848829+0000","last_unstale":"2024-09-13T17:51:53.851665+0000","last_undegraded":"2024-09-13T17:51:53.851665+0000","last_fullsized":"2024-09-13T17:51:53.851665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:56.070629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837633+0000","last_change":"2024-09-13T17:51:49.832116+0000","last_active":"2024-09-13T17:51:53.837633+0000","last_peered":"2024-09-13T17:51:53.837633+0000","last_clean":"2024-09-13T17:51:53.837633+0000","last_became_active":"2024-09-13T17:51:49.831837+0000","last_became_peered":"2024-09-13T17:51:49.831837+0000","last_unstale":"2024-09-13T17:51:53.837633+0000","last_undegraded":"2024-09-13T17:51:53.837633+0000","last_fullsized":"2024-09-13T17:51:53.837633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:07.738851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.832758+0000","last_change":"2024-09-13T17:51:49.421180+0000","last_active":"2024-09-13T17:51:53.832758+0000","last_peered":"2024-09-13T17:51:53.832758+0000","last_clean":"2024-09-13T17:51:53.832758+0000","last_became_active":"2024-09-13T17:51:49.420518+0000","last_became_peered":"2024-09-13T17:51:49.420518+0000","last_unstale":"2024-09-13T17:51:53.832758+0000","last_undegraded":"2024-09-13T17:51:53.832758+0000","last_fullsized":"2024-09-13T17:51:53.832758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:06.421994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.844571+0000","last_change":"2024-09-13T17:51:53.840737+0000","last_active":"2024-09-13T17:51:53.844571+0000","last_peered":"2024-09-13T17:51:53.844571+0000","last_clean":"2024-09-13T17:51:53.844571+0000","last_became_active":"2024-09-13T17:51:53.838857+0000","last_became_peered":"2024-09-13T17:51:53.838857+0000","last_unstale":"2024-09-13T17:51:53.844571+0000","last_undegraded":"2024-09-13T17:51:53.844571+0000","last_fullsized":"2024-09-13T17:51:53.844571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:00.438042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.832711+0000","last_change":"2024-09-13T17:51:49.820669+0000","last_active":"2024-09-13T17:51:53.832711+0000","last_peered":"2024-09-13T17:51:53.832711+0000","last_clean":"2024-09-13T17:51:53.832711+0000","last_became_active":"2024-09-13T17:51:49.820401+0000","last_became_peered":"2024-09-13T17:51:49.820401+0000","last_unstale":"2024-09-13T17:51:53.832711+0000","last_undegraded":"2024-09-13T17:51:53.832711+0000","last_fullsized":"2024-09-13T17:51:53.832711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:12.044921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827878+0000","last_change":"2024-09-13T17:51:49.428974+0000","last_active":"2024-09-13T17:51:53.827878+0000","last_peered":"2024-09-13T17:51:53.827878+0000","last_clean":"2024-09-13T17:51:53.827878+0000","last_became_active":"2024-09-13T17:51:49.428658+0000","last_became_peered":"2024-09-13T17:51:49.428658+0000","last_unstale":"2024-09-13T17:51:53.827878+0000","last_undegraded":"2024-09-13T17:51:53.827878+0000","last_fullsized":"2024-09-13T17:51:53.827878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:55.567370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.898056+0000","last_change":"2024-09-13T17:51:53.887256+0000","last_active":"2024-09-13T17:51:53.898056+0000","last_peered":"2024-09-13T17:51:53.898056+0000","last_clean":"2024-09-13T17:51:53.898056+0000","last_became_active":"2024-09-13T17:51:53.886890+0000","last_became_peered":"2024-09-13T17:51:53.886890+0000","last_unstale":"2024-09-13T17:51:53.898056+0000","last_undegraded":"2024-09-13T17:51:53.898056+0000","last_fullsized":"2024-09-13T17:51:53.898056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:50.331208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.891341+0000","last_change":"2024-09-13T17:51:53.887867+0000","last_active":"2024-09-13T17:51:53.891341+0000","last_peered":"2024-09-13T17:51:53.891341+0000","last_clean":"2024-09-13T17:51:53.891341+0000","last_became_active":"2024-09-13T17:51:53.887513+0000","last_became_peered":"2024-09-13T17:51:53.887513+0000","last_unstale":"2024-09-13T17:51:53.891341+0000","last_undegraded":"2024-09-13T17:51:53.891341+0000","last_fullsized":"2024-09-13T17:51:53.891341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:35.046158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.824092+0000","last_change":"2024-09-13T17:51:49.818712+0000","last_active":"2024-09-13T17:51:53.824092+0000","last_peered":"2024-09-13T17:51:53.824092+0000","last_clean":"2024-09-13T17:51:53.824092+0000","last_became_active":"2024-09-13T17:51:49.818441+0000","last_became_peered":"2024-09-13T17:51:49.818441+0000","last_unstale":"2024-09-13T17:51:53.824092+0000","last_undegraded":"2024-09-13T17:51:53.824092+0000","last_fullsized":"2024-09-13T17:51:53.824092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:43.263003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.831201+0000","last_change":"2024-09-13T17:51:49.414687+0000","last_active":"2024-09-13T17:51:53.831201+0000","last_peered":"2024-09-13T17:51:53.831201+0000","last_clean":"2024-09-13T17:51:53.831201+0000","last_became_active":"2024-09-13T17:51:49.414417+0000","last_became_peered":"2024-09-13T17:51:49.414417+0000","last_unstale":"2024-09-13T17:51:53.831201+0000","last_undegraded":"2024-09-13T17:51:53.831201+0000","last_fullsized":"2024-09-13T17:51:53.831201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:05.515948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.850818+0000","last_change":"2024-09-13T17:51:53.848088+0000","last_active":"2024-09-13T17:51:53.850818+0000","last_peered":"2024-09-13T17:51:53.850818+0000","last_clean":"2024-09-13T17:51:53.850818+0000","last_became_active":"2024-09-13T17:51:53.847545+0000","last_became_peered":"2024-09-13T17:51:53.847545+0000","last_unstale":"2024-09-13T17:51:53.850818+0000","last_undegraded":"2024-09-13T17:51:53.850818+0000","last_fullsized":"2024-09-13T17:51:53.850818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:25.404881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826689+0000","last_change":"2024-09-13T17:51:49.820694+0000","last_active":"2024-09-13T17:51:53.826689+0000","last_peered":"2024-09-13T17:51:53.826689+0000","last_clean":"2024-09-13T17:51:53.826689+0000","last_became_active":"2024-09-13T17:51:49.819217+0000","last_became_peered":"2024-09-13T17:51:49.819217+0000","last_unstale":"2024-09-13T17:51:53.826689+0000","last_undegraded":"2024-09-13T17:51:53.826689+0000","last_fullsized":"2024-09-13T17:51:53.826689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:16.626937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827381+0000","last_change":"2024-09-13T17:51:49.424168+0000","last_active":"2024-09-13T17:51:53.827381+0000","last_peered":"2024-09-13T17:51:53.827381+0000","last_clean":"2024-09-13T17:51:53.827381+0000","last_became_active":"2024-09-13T17:51:49.423884+0000","last_became_peered":"2024-09-13T17:51:49.423884+0000","last_unstale":"2024-09-13T17:51:53.827381+0000","last_undegraded":"2024-09-13T17:51:53.827381+0000","last_fullsized":"2024-09-13T17:51:53.827381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:38.364524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827736+0000","last_change":"2024-09-13T17:51:49.428168+0000","last_active":"2024-09-13T17:51:53.827736+0000","last_peered":"2024-09-13T17:51:53.827736+0000","last_clean":"2024-09-13T17:51:53.827736+0000","last_became_active":"2024-09-13T17:51:49.427823+0000","last_became_peered":"2024-09-13T17:51:49.427823+0000","last_unstale":"2024-09-13T17:51:53.827736+0000","last_undegraded":"2024-09-13T17:51:53.827736+0000","last_fullsized":"2024-09-13T17:51:53.827736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:06.421994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837095+0000","last_change":"2024-09-13T17:51:49.805322+0000","last_active":"2024-09-13T17:51:53.837095+0000","last_peered":"2024-09-13T17:51:53.837095+0000","last_clean":"2024-09-13T17:51:53.837095+0000","last_became_active":"2024-09-13T17:51:49.804205+0000","last_became_peered":"2024-09-13T17:51:49.804205+0000","last_unstale":"2024-09-13T17:51:53.837095+0000","last_undegraded":"2024-09-13T17:51:53.837095+0000","last_fullsized":"2024-09-13T17:51:53.837095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:43.263003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.854352+0000","last_change":"2024-09-13T17:51:53.851986+0000","last_active":"2024-09-13T17:51:53.854352+0000","last_peered":"2024-09-13T17:51:53.854352+0000","last_clean":"2024-09-13T17:51:53.854352+0000","last_became_active":"2024-09-13T17:51:53.851630+0000","last_became_peered":"2024-09-13T17:51:53.851630+0000","last_unstale":"2024-09-13T17:51:53.854352+0000","last_undegraded":"2024-09-13T17:51:53.854352+0000","last_fullsized":"2024-09-13T17:51:53.854352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:39.323134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827078+0000","last_change":"2024-09-13T17:51:49.417653+0000","last_active":"2024-09-13T17:51:53.827078+0000","last_peered":"2024-09-13T17:51:53.827078+0000","last_clean":"2024-09-13T17:51:53.827078+0000","last_became_active":"2024-09-13T17:51:49.417424+0000","last_became_peered":"2024-09-13T17:51:49.417424+0000","last_unstale":"2024-09-13T17:51:53.827078+0000","last_undegraded":"2024-09-13T17:51:53.827078+0000","last_fullsized":"2024-09-13T17:51:53.827078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:01.166296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.834334+0000","last_change":"2024-09-13T17:51:49.806919+0000","last_active":"2024-09-13T17:51:53.834334+0000","last_peered":"2024-09-13T17:51:53.834334+0000","last_clean":"2024-09-13T17:51:53.834334+0000","last_became_active":"2024-09-13T17:51:49.806493+0000","last_became_peered":"2024-09-13T17:51:49.806493+0000","last_unstale":"2024-09-13T17:51:53.834334+0000","last_undegraded":"2024-09-13T17:51:53.834334+0000","last_fullsized":"2024-09-13T17:51:53.834334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:54.213102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.856376+0000","last_change":"2024-09-13T17:51:53.850120+0000","last_active":"2024-09-13T17:51:53.856376+0000","last_peered":"2024-09-13T17:51:53.856376+0000","last_clean":"2024-09-13T17:51:53.856376+0000","last_became_active":"2024-09-13T17:51:53.849730+0000","last_became_peered":"2024-09-13T17:51:53.849730+0000","last_unstale":"2024-09-13T17:51:53.856376+0000","last_undegraded":"2024-09-13T17:51:53.856376+0000","last_fullsized":"2024-09-13T17:51:53.856376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:05.592560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826849+0000","last_change":"2024-09-13T17:51:49.826333+0000","last_active":"2024-09-13T17:51:53.826849+0000","last_peered":"2024-09-13T17:51:53.826849+0000","last_clean":"2024-09-13T17:51:53.826849+0000","last_became_active":"2024-09-13T17:51:49.826071+0000","last_became_peered":"2024-09-13T17:51:49.826071+0000","last_unstale":"2024-09-13T17:51:53.826849+0000","last_undegraded":"2024-09-13T17:51:53.826849+0000","last_fullsized":"2024-09-13T17:51:53.826849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:38.101006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837999+0000","last_change":"2024-09-13T17:51:49.809218+0000","last_active":"2024-09-13T17:51:53.837999+0000","last_peered":"2024-09-13T17:51:53.837999+0000","last_clean":"2024-09-13T17:51:53.837999+0000","last_became_active":"2024-09-13T17:51:49.808985+0000","last_became_peered":"2024-09-13T17:51:49.808985+0000","last_unstale":"2024-09-13T17:51:53.837999+0000","last_undegraded":"2024-09-13T17:51:53.837999+0000","last_fullsized":"2024-09-13T17:51:53.837999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:21.618580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.838422+0000","last_change":"2024-09-13T17:51:49.830357+0000","last_active":"2024-09-13T17:51:53.838422+0000","last_peered":"2024-09-13T17:51:53.838422+0000","last_clean":"2024-09-13T17:51:53.838422+0000","last_became_active":"2024-09-13T17:51:49.830084+0000","last_became_peered":"2024-09-13T17:51:49.830084+0000","last_unstale":"2024-09-13T17:51:53.838422+0000","last_undegraded":"2024-09-13T17:51:53.838422+0000","last_fullsized":"2024-09-13T17:51:53.838422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:21.449832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.836968+0000","last_change":"2024-09-13T17:51:49.826591+0000","last_active":"2024-09-13T17:51:53.836968+0000","last_peered":"2024-09-13T17:51:53.836968+0000","last_clean":"2024-09-13T17:51:53.836968+0000","last_became_active":"2024-09-13T17:51:49.826406+0000","last_became_peered":"2024-09-13T17:51:49.826406+0000","last_unstale":"2024-09-13T17:51:53.836968+0000","last_undegraded":"2024-09-13T17:51:53.836968+0000","last_fullsized":"2024-09-13T17:51:53.836968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:36.343757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.828767+0000","last_change":"2024-09-13T17:51:49.831819+0000","last_active":"2024-09-13T17:51:53.828767+0000","last_peered":"2024-09-13T17:51:53.828767+0000","last_clean":"2024-09-13T17:51:53.828767+0000","last_became_active":"2024-09-13T17:51:49.831617+0000","last_became_peered":"2024-09-13T17:51:49.831617+0000","last_unstale":"2024-09-13T17:51:53.828767+0000","last_undegraded":"2024-09-13T17:51:53.828767+0000","last_fullsized":"2024-09-13T17:51:53.828767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:43.263003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826257+0000","last_change":"2024-09-13T17:51:49.826770+0000","last_active":"2024-09-13T17:51:53.826257+0000","last_peered":"2024-09-13T17:51:53.826257+0000","last_clean":"2024-09-13T17:51:53.826257+0000","last_became_active":"2024-09-13T17:51:49.826103+0000","last_became_peered":"2024-09-13T17:51:49.826103+0000","last_unstale":"2024-09-13T17:51:53.826257+0000","last_undegraded":"2024-09-13T17:51:53.826257+0000","last_fullsized":"2024-09-13T17:51:53.826257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:35.902537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827779+0000","last_change":"2024-09-13T17:51:49.816685+0000","last_active":"2024-09-13T17:51:53.827779+0000","last_peered":"2024-09-13T17:51:53.827779+0000","last_clean":"2024-09-13T17:51:53.827779+0000","last_became_active":"2024-09-13T17:51:49.816364+0000","last_became_peered":"2024-09-13T17:51:49.816364+0000","last_unstale":"2024-09-13T17:51:53.827779+0000","last_undegraded":"2024-09-13T17:51:53.827779+0000","last_fullsized":"2024-09-13T17:51:53.827779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:19.843619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.829842+0000","last_change":"2024-09-13T17:51:49.829446+0000","last_active":"2024-09-13T17:51:53.829842+0000","last_peered":"2024-09-13T17:51:53.829842+0000","last_clean":"2024-09-13T17:51:53.829842+0000","last_became_active":"2024-09-13T17:51:49.829196+0000","last_became_peered":"2024-09-13T17:51:49.829196+0000","last_unstale":"2024-09-13T17:51:53.829842+0000","last_undegraded":"2024-09-13T17:51:53.829842+0000","last_fullsized":"2024-09-13T17:51:53.829842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:14.458841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.831119+0000","last_change":"2024-09-13T17:51:49.835245+0000","last_active":"2024-09-13T17:51:53.831119+0000","last_peered":"2024-09-13T17:51:53.831119+0000","last_clean":"2024-09-13T17:51:53.831119+0000","last_became_active":"2024-09-13T17:51:49.834941+0000","last_became_peered":"2024-09-13T17:51:49.834941+0000","last_unstale":"2024-09-13T17:51:53.831119+0000","last_undegraded":"2024-09-13T17:51:53.831119+0000","last_fullsized":"2024-09-13T17:51:53.831119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:18.962464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827310+0000","last_change":"2024-09-13T17:51:49.831150+0000","last_active":"2024-09-13T17:51:53.827310+0000","last_peered":"2024-09-13T17:51:53.827310+0000","last_clean":"2024-09-13T17:51:53.827310+0000","last_became_active":"2024-09-13T17:51:49.830923+0000","last_became_peered":"2024-09-13T17:51:49.830923+0000","last_unstale":"2024-09-13T17:51:53.827310+0000","last_undegraded":"2024-09-13T17:51:53.827310+0000","last_fullsized":"2024-09-13T17:51:53.827310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:35.902537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.835969+0000","last_change":"2024-09-13T17:51:49.831132+0000","last_active":"2024-09-13T17:51:53.835969+0000","last_peered":"2024-09-13T17:51:53.835969+0000","last_clean":"2024-09-13T17:51:53.835969+0000","last_became_active":"2024-09-13T17:51:49.822819+0000","last_became_peered":"2024-09-13T17:51:49.822819+0000","last_unstale":"2024-09-13T17:51:53.835969+0000","last_undegraded":"2024-09-13T17:51:53.835969+0000","last_fullsized":"2024-09-13T17:51:53.835969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:01.180550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.836860+0000","last_change":"2024-09-13T17:51:49.826381+0000","last_active":"2024-09-13T17:51:53.836860+0000","last_peered":"2024-09-13T17:51:53.836860+0000","last_clean":"2024-09-13T17:51:53.836860+0000","last_became_active":"2024-09-13T17:51:49.816777+0000","last_became_peered":"2024-09-13T17:51:49.816777+0000","last_unstale":"2024-09-13T17:51:53.836860+0000","last_undegraded":"2024-09-13T17:51:53.836860+0000","last_fullsized":"2024-09-13T17:51:53.836860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:18.962464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827364+0000","last_change":"2024-09-13T17:51:49.815417+0000","last_active":"2024-09-13T17:51:53.827364+0000","last_peered":"2024-09-13T17:51:53.827364+0000","last_clean":"2024-09-13T17:51:53.827364+0000","last_became_active":"2024-09-13T17:51:49.814545+0000","last_became_peered":"2024-09-13T17:51:49.814545+0000","last_unstale":"2024-09-13T17:51:53.827364+0000","last_undegraded":"2024-09-13T17:51:53.827364+0000","last_fullsized":"2024-09-13T17:51:53.827364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:26.069550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.884324+0000","last_change":"2024-09-13T17:51:49.832628+0000","last_active":"2024-09-13T17:51:53.884324+0000","last_peered":"2024-09-13T17:51:53.884324+0000","last_clean":"2024-09-13T17:51:53.884324+0000","last_became_active":"2024-09-13T17:51:49.832374+0000","last_became_peered":"2024-09-13T17:51:49.832374+0000","last_unstale":"2024-09-13T17:51:53.884324+0000","last_undegraded":"2024-09-13T17:51:53.884324+0000","last_fullsized":"2024-09-13T17:51:53.884324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:01.180550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.841065+0000","last_change":"2024-09-13T17:51:49.815728+0000","last_active":"2024-09-13T17:51:53.841065+0000","last_peered":"2024-09-13T17:51:53.841065+0000","last_clean":"2024-09-13T17:51:53.841065+0000","last_became_active":"2024-09-13T17:51:49.815464+0000","last_became_peered":"2024-09-13T17:51:49.815464+0000","last_unstale":"2024-09-13T17:51:53.841065+0000","last_undegraded":"2024-09-13T17:51:53.841065+0000","last_fullsized":"2024-09-13T17:51:53.841065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:22.017119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.830807+0000","last_change":"2024-09-13T17:51:49.823164+0000","last_active":"2024-09-13T17:51:53.830807+0000","last_peered":"2024-09-13T17:51:53.830807+0000","last_clean":"2024-09-13T17:51:53.830807+0000","last_became_active":"2024-09-13T17:51:49.822858+0000","last_became_peered":"2024-09-13T17:51:49.822858+0000","last_unstale":"2024-09-13T17:51:53.830807+0000","last_undegraded":"2024-09-13T17:51:53.830807+0000","last_fullsized":"2024-09-13T17:51:53.830807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:12:04.288019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.830989+0000","last_change":"2024-09-13T17:51:49.820290+0000","last_active":"2024-09-13T17:51:53.830989+0000","last_peered":"2024-09-13T17:51:53.830989+0000","last_clean":"2024-09-13T17:51:53.830989+0000","last_became_active":"2024-09-13T17:51:49.820037+0000","last_became_peered":"2024-09-13T17:51:49.820037+0000","last_unstale":"2024-09-13T17:51:53.830989+0000","last_undegraded":"2024-09-13T17:51:53.830989+0000","last_fullsized":"2024-09-13T17:51:53.830989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:51.162047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.824544+0000","last_change":"2024-09-13T17:51:49.806528+0000","last_active":"2024-09-13T17:51:53.824544+0000","last_peered":"2024-09-13T17:51:53.824544+0000","last_clean":"2024-09-13T17:51:53.824544+0000","last_became_active":"2024-09-13T17:51:49.806269+0000","last_became_peered":"2024-09-13T17:51:49.806269+0000","last_unstale":"2024-09-13T17:51:53.824544+0000","last_undegraded":"2024-09-13T17:51:53.824544+0000","last_fullsized":"2024-09-13T17:51:53.824544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:26.069550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.836406+0000","last_change":"2024-09-13T17:51:49.808911+0000","last_active":"2024-09-13T17:51:53.836406+0000","last_peered":"2024-09-13T17:51:53.836406+0000","last_clean":"2024-09-13T17:51:53.836406+0000","last_became_active":"2024-09-13T17:51:49.808332+0000","last_became_peered":"2024-09-13T17:51:49.808332+0000","last_unstale":"2024-09-13T17:51:53.836406+0000","last_undegraded":"2024-09-13T17:51:53.836406+0000","last_fullsized":"2024-09-13T17:51:53.836406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:14.458841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.825613+0000","last_change":"2024-09-13T17:51:49.826315+0000","last_active":"2024-09-13T17:51:53.825613+0000","last_peered":"2024-09-13T17:51:53.825613+0000","last_clean":"2024-09-13T17:51:53.825613+0000","last_became_active":"2024-09-13T17:51:49.825996+0000","last_became_peered":"2024-09-13T17:51:49.825996+0000","last_unstale":"2024-09-13T17:51:53.825613+0000","last_undegraded":"2024-09-13T17:51:53.825613+0000","last_fullsized":"2024-09-13T17:51:53.825613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:26.069550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.834840+0000","last_change":"2024-09-13T17:51:49.814558+0000","last_active":"2024-09-13T17:51:53.834840+0000","last_peered":"2024-09-13T17:51:53.834840+0000","last_clean":"2024-09-13T17:51:53.834840+0000","last_became_active":"2024-09-13T17:51:49.814289+0000","last_became_peered":"2024-09-13T17:51:49.814289+0000","last_unstale":"2024-09-13T17:51:53.834840+0000","last_undegraded":"2024-09-13T17:51:53.834840+0000","last_fullsized":"2024-09-13T17:51:53.834840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:08.128556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.828014+0000","last_change":"2024-09-13T17:51:49.838829+0000","last_active":"2024-09-13T17:51:53.828014+0000","last_peered":"2024-09-13T17:51:53.828014+0000","last_clean":"2024-09-13T17:51:53.828014+0000","last_became_active":"2024-09-13T17:51:49.838534+0000","last_became_peered":"2024-09-13T17:51:49.838534+0000","last_unstale":"2024-09-13T17:51:53.828014+0000","last_undegraded":"2024-09-13T17:51:53.828014+0000","last_fullsized":"2024-09-13T17:51:53.828014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:16.626937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827668+0000","last_change":"2024-09-13T17:51:49.838082+0000","last_active":"2024-09-13T17:51:53.827668+0000","last_peered":"2024-09-13T17:51:53.827668+0000","last_clean":"2024-09-13T17:51:53.827668+0000","last_became_active":"2024-09-13T17:51:49.837831+0000","last_became_peered":"2024-09-13T17:51:49.837831+0000","last_unstale":"2024-09-13T17:51:53.827668+0000","last_undegraded":"2024-09-13T17:51:53.827668+0000","last_fullsized":"2024-09-13T17:51:53.827668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:43.263003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.884838+0000","last_change":"2024-09-13T17:51:49.838813+0000","last_active":"2024-09-13T17:51:53.884838+0000","last_peered":"2024-09-13T17:51:53.884838+0000","last_clean":"2024-09-13T17:51:53.884838+0000","last_became_active":"2024-09-13T17:51:49.838605+0000","last_became_peered":"2024-09-13T17:51:49.838605+0000","last_unstale":"2024-09-13T17:51:53.884838+0000","last_undegraded":"2024-09-13T17:51:53.884838+0000","last_fullsized":"2024-09-13T17:51:53.884838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:58.370954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826601+0000","last_change":"2024-09-13T17:51:49.839695+0000","last_active":"2024-09-13T17:51:53.826601+0000","last_peered":"2024-09-13T17:51:53.826601+0000","last_clean":"2024-09-13T17:51:53.826601+0000","last_became_active":"2024-09-13T17:51:49.839480+0000","last_became_peered":"2024-09-13T17:51:49.839480+0000","last_unstale":"2024-09-13T17:51:53.826601+0000","last_undegraded":"2024-09-13T17:51:53.826601+0000","last_fullsized":"2024-09-13T17:51:53.826601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:34.576074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.883275+0000","last_change":"2024-09-13T17:51:49.826878+0000","last_active":"2024-09-13T17:51:53.883275+0000","last_peered":"2024-09-13T17:51:53.883275+0000","last_clean":"2024-09-13T17:51:53.883275+0000","last_became_active":"2024-09-13T17:51:49.825030+0000","last_became_peered":"2024-09-13T17:51:49.825030+0000","last_unstale":"2024-09-13T17:51:53.883275+0000","last_undegraded":"2024-09-13T17:51:53.883275+0000","last_fullsized":"2024-09-13T17:51:53.883275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:12:04.288019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.835914+0000","last_change":"2024-09-13T17:51:49.811222+0000","last_active":"2024-09-13T17:51:53.835914+0000","last_peered":"2024-09-13T17:51:53.835914+0000","last_clean":"2024-09-13T17:51:53.835914+0000","last_became_active":"2024-09-13T17:51:49.810759+0000","last_became_peered":"2024-09-13T17:51:49.810759+0000","last_unstale":"2024-09-13T17:51:53.835914+0000","last_undegraded":"2024-09-13T17:51:53.835914+0000","last_fullsized":"2024-09-13T17:51:53.835914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:19.843619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882539+0000","last_change":"2024-09-13T17:51:49.833530+0000","last_active":"2024-09-13T17:51:53.882539+0000","last_peered":"2024-09-13T17:51:53.882539+0000","last_clean":"2024-09-13T17:51:53.882539+0000","last_became_active":"2024-09-13T17:51:49.832951+0000","last_became_peered":"2024-09-13T17:51:49.832951+0000","last_unstale":"2024-09-13T17:51:53.882539+0000","last_undegraded":"2024-09-13T17:51:53.882539+0000","last_fullsized":"2024-09-13T17:51:53.882539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:54.519014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.830679+0000","last_change":"2024-09-13T17:51:49.830297+0000","last_active":"2024-09-13T17:51:53.830679+0000","last_peered":"2024-09-13T17:51:53.830679+0000","last_clean":"2024-09-13T17:51:53.830679+0000","last_became_active":"2024-09-13T17:51:49.829669+0000","last_became_peered":"2024-09-13T17:51:49.829669+0000","last_unstale":"2024-09-13T17:51:53.830679+0000","last_undegraded":"2024-09-13T17:51:53.830679+0000","last_fullsized":"2024-09-13T17:51:53.830679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:47.337762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.843087+0000","last_change":"2024-09-13T17:51:49.803908+0000","last_active":"2024-09-13T17:51:53.843087+0000","last_peered":"2024-09-13T17:51:53.843087+0000","last_clean":"2024-09-13T17:51:53.843087+0000","last_became_active":"2024-09-13T17:51:49.803684+0000","last_became_peered":"2024-09-13T17:51:49.803684+0000","last_unstale":"2024-09-13T17:51:53.843087+0000","last_undegraded":"2024-09-13T17:51:53.843087+0000","last_fullsized":"2024-09-13T17:51:53.843087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:45.192413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826601+0000","last_change":"2024-09-13T17:51:49.815512+0000","last_active":"2024-09-13T17:51:53.826601+0000","last_peered":"2024-09-13T17:51:53.826601+0000","last_clean":"2024-09-13T17:51:53.826601+0000","last_became_active":"2024-09-13T17:51:49.814103+0000","last_became_peered":"2024-09-13T17:51:49.814103+0000","last_unstale":"2024-09-13T17:51:53.826601+0000","last_undegraded":"2024-09-13T17:51:53.826601+0000","last_fullsized":"2024-09-13T17:51:53.826601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:19.843619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.885722+0000","last_change":"2024-09-13T17:51:49.827858+0000","last_active":"2024-09-13T17:51:53.885722+0000","last_peered":"2024-09-13T17:51:53.885722+0000","last_clean":"2024-09-13T17:51:53.885722+0000","last_became_active":"2024-09-13T17:51:49.827613+0000","last_became_peered":"2024-09-13T17:51:49.827613+0000","last_unstale":"2024-09-13T17:51:53.885722+0000","last_undegraded":"2024-09-13T17:51:53.885722+0000","last_fullsized":"2024-09-13T17:51:53.885722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:03.945317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:52:14.188 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:52:14.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.356+0000 7f66b7600640 1 Processor -- start 2024-09-13T17:52:14.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.356+0000 7f66b7600640 1 -- start start 2024-09-13T17:52:14.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.360+0000 7f66b7600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f66b013f420 0x7f66b006d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:14.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.360+0000 7f66b7600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f66b006da90 0x7f66b00cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:14.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.360+0000 7f66b7600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66b00cd220 con 0x7f66b013c240 2024-09-13T17:52:14.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.360+0000 7f66b7600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66b006df40 con 0x7f66b006da90 2024-09-13T17:52:14.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.360+0000 7f66b7600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66b015a740 con 0x7f66b013f420 2024-09-13T17:52:14.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.360+0000 7f66b5600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f66b006da90 0x7f66b00cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:14.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.360+0000 7f66b5600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f66b006da90 0x7f66b00cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50018/0 (socket says 172.21.15.114:50018) 2024-09-13T17:52:14.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.360+0000 7f66b5600640 1 -- 172.21.15.114:0/2695443856 learned_addr learned my addr 172.21.15.114:0/2695443856 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:14.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.360+0000 7f66a7e00640 1 --2- 172.21.15.114:0/2695443856 >> v2:172.21.15.134:3300/0 conn(0x7f66b013f420 0x7f66b006d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:14.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.360+0000 7f66b5600640 1 -- 172.21.15.114:0/2695443856 >> v2:172.21.15.134:3300/0 conn(0x7f66b013f420 msgr2=0x7f66b006d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:14.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.360+0000 7f66b5600640 1 --2- 172.21.15.114:0/2695443856 >> v2:172.21.15.134:3300/0 conn(0x7f66b013f420 0x7f66b006d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:14.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.360+0000 7f66b5600640 1 -- 172.21.15.114:0/2695443856 >> v1:172.21.15.114:6789/0 conn(0x7f66b013c240 legacy=0x7f66b013c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:14.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.360+0000 7f66b5600640 1 -- 172.21.15.114:0/2695443856 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b0159bc0 con 0x7f66b006da90 2024-09-13T17:52:14.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.364+0000 7f66b5600640 1 --2- 172.21.15.114:0/2695443856 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66b006da90 0x7f66b00cd650 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f66b00ae130 tx=0x7f66a801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32fb413b4f30ec6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:14.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.364+0000 7f66afe00640 1 -- 172.21.15.114:0/2695443856 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a80a5880 con 0x7f66b006da90 2024-09-13T17:52:14.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.364+0000 7f66afe00640 1 -- 172.21.15.114:0/2695443856 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a80a59e0 con 0x7f66b006da90 2024-09-13T17:52:14.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.364+0000 7f66afe00640 1 -- 172.21.15.114:0/2695443856 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a80a5d70 con 0x7f66b006da90 2024-09-13T17:52:14.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.364+0000 7f66b7600640 1 -- 172.21.15.114:0/2695443856 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66b006da90 msgr2=0x7f66b00cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:14.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.364+0000 7f66b7600640 1 --2- 172.21.15.114:0/2695443856 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66b006da90 0x7f66b00cd650 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f66b00ae130 tx=0x7f66a801c9c0 comp rx=0 tx=0).stop 2024-09-13T17:52:14.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.364+0000 7f66b7600640 1 -- 172.21.15.114:0/2695443856 shutdown_connections 2024-09-13T17:52:14.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.364+0000 7f66b7600640 1 --2- 172.21.15.114:0/2695443856 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66b006da90 0x7f66b00cd650 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:14.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.364+0000 7f66b7600640 1 --2- 172.21.15.114:0/2695443856 >> v2:172.21.15.134:3300/0 conn(0x7f66b013f420 0x7f66b006d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:14.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.364+0000 7f66b7600640 1 -- 172.21.15.114:0/2695443856 >> 172.21.15.114:0/2695443856 conn(0x7f66b00660b0 msgr2=0x7f66b0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:14.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.364+0000 7f66b7600640 1 -- 172.21.15.114:0/2695443856 shutdown_connections 2024-09-13T17:52:14.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.364+0000 7f66b7600640 1 -- 172.21.15.114:0/2695443856 wait complete. 2024-09-13T17:52:14.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.364+0000 7f66b7600640 1 Processor -- start 2024-09-13T17:52:14.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.364+0000 7f66b7600640 1 -- start start 2024-09-13T17:52:14.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.364+0000 7f66b7600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f66b006da90 0x7f66b00ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:14.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.364+0000 7f66b7600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66b013c240 0x7f66b01f9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:14.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.364+0000 7f66b7600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66b013f420 0x7f66b013ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:14.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.364+0000 7f66b7600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b01f55b0 con 0x7f66b013f420 2024-09-13T17:52:14.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.364+0000 7f66b7600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b0153c50 con 0x7f66b013c240 2024-09-13T17:52:14.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.364+0000 7f66b7600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b01f9b50 con 0x7f66b006da90 2024-09-13T17:52:14.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.364+0000 7f66b5600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66b013f420 0x7f66b013ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:14.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.368+0000 7f66b5600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66b013f420 0x7f66b013ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50020/0 (socket says 172.21.15.114:50020) 2024-09-13T17:52:14.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.368+0000 7f66b5600640 1 -- 172.21.15.114:0/1488266816 learned_addr learned my addr 172.21.15.114:0/1488266816 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:14.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.368+0000 7f66b4c00640 1 --2- 172.21.15.114:0/1488266816 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f66b006da90 0x7f66b00ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:14.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.368+0000 7f66a7e00640 1 --2- 172.21.15.114:0/1488266816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66b013c240 0x7f66b01f9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:14.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.368+0000 7f66b5600640 1 -- 172.21.15.114:0/1488266816 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f66b006da90 msgr2=0x7f66b00ae180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:14.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.368+0000 7f66b5600640 1 --2- 172.21.15.114:0/1488266816 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f66b006da90 0x7f66b00ae180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:14.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.368+0000 7f66b5600640 1 -- 172.21.15.114:0/1488266816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66b013c240 msgr2=0x7f66b01f9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:14.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.368+0000 7f66b5600640 1 --2- 172.21.15.114:0/1488266816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66b013c240 0x7f66b01f9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:14.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.368+0000 7f66b5600640 1 -- 172.21.15.114:0/1488266816 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a8009b30 con 0x7f66b013f420 2024-09-13T17:52:14.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.368+0000 7f66a7e00640 1 --2- 172.21.15.114:0/1488266816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66b013c240 0x7f66b01f9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:52:14.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.368+0000 7f66b4c00640 1 --2- 172.21.15.114:0/1488266816 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f66b006da90 0x7f66b00ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:52:14.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.368+0000 7f66b5600640 1 --2- 172.21.15.114:0/1488266816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66b013f420 0x7f66b013ada0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f66a801a5f0 tx=0x7f66b00ce3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:14.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.368+0000 7f66ad600640 1 -- 172.21.15.114:0/1488266816 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a80b8670 con 0x7f66b013f420 2024-09-13T17:52:14.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.368+0000 7f66ad600640 1 -- 172.21.15.114:0/1488266816 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a80b8830 con 0x7f66b013f420 2024-09-13T17:52:14.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.368+0000 7f66ad600640 1 -- 172.21.15.114:0/1488266816 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a80b8be0 con 0x7f66b013f420 2024-09-13T17:52:14.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.368+0000 7f66b7600640 1 -- 172.21.15.114:0/1488266816 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66b00ae760 con 0x7f66b013f420 2024-09-13T17:52:14.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.368+0000 7f66b7600640 1 -- 172.21.15.114:0/1488266816 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66b00aed20 con 0x7f66b013f420 2024-09-13T17:52:14.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.368+0000 7f66b7600640 1 -- 172.21.15.114:0/1488266816 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66b0153e00 con 0x7f66b013f420 2024-09-13T17:52:14.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.368+0000 7f66ad600640 1 -- 172.21.15.114:0/1488266816 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f66a80b8d40 con 0x7f66b013f420 2024-09-13T17:52:14.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.372+0000 7f66ad600640 1 --2- 172.21.15.114:0/1488266816 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f668c066690 0x7f668c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:14.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.372+0000 7f66ad600640 1 -- 172.21.15.114:0/1488266816 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f66a811f710 con 0x7f66b013f420 2024-09-13T17:52:14.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.372+0000 7f66b4c00640 1 --2- 172.21.15.114:0/1488266816 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f668c066690 0x7f668c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:14.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.372+0000 7f66b4c00640 1 --2- 172.21.15.114:0/1488266816 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f668c066690 0x7f668c068b50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f66b01572c0 tx=0x7f66a0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:14.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.376+0000 7f66ad600640 1 -- 172.21.15.114:0/1488266816 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f66b0153e00 con 0x7f66b013f420 2024-09-13T17:52:14.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.528+0000 7f66b7600640 1 -- 172.21.15.114:0/1488266816 --> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f66b0070620 con 0x7f668c066690 2024-09-13T17:52:14.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.536+0000 7f66ad600640 1 -- 172.21.15.114:0/1488266816 <== mgr.4102 v2:172.21.15.114:6832/137691478 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345284 (secure 0 0 0) 0x7f66a00013f0 con 0x7f668c066690 2024-09-13T17:52:14.542 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:14.544 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-13T17:52:14.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.540+0000 7f66b7600640 1 -- 172.21.15.114:0/1488266816 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f668c066690 msgr2=0x7f668c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:14.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.540+0000 7f66b7600640 1 --2- 172.21.15.114:0/1488266816 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f668c066690 0x7f668c068b50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f66b01572c0 tx=0x7f66a0009040 comp rx=0 tx=0).stop 2024-09-13T17:52:14.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.540+0000 7f66b7600640 1 -- 172.21.15.114:0/1488266816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66b013f420 msgr2=0x7f66b013ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:14.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.540+0000 7f66b7600640 1 --2- 172.21.15.114:0/1488266816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66b013f420 0x7f66b013ada0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f66a801a5f0 tx=0x7f66b00ce3a0 comp rx=0 tx=0).stop 2024-09-13T17:52:14.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.540+0000 7f66b7600640 1 -- 172.21.15.114:0/1488266816 shutdown_connections 2024-09-13T17:52:14.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.540+0000 7f66b7600640 1 --2- 172.21.15.114:0/1488266816 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f668c066690 0x7f668c068b50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:14.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.540+0000 7f66b7600640 1 --2- 172.21.15.114:0/1488266816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66b013f420 0x7f66b013ada0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:14.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.540+0000 7f66b7600640 1 --2- 172.21.15.114:0/1488266816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66b013c240 0x7f66b01f9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:14.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.540+0000 7f66b7600640 1 --2- 172.21.15.114:0/1488266816 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f66b006da90 0x7f66b00ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:14.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.540+0000 7f66b7600640 1 -- 172.21.15.114:0/1488266816 >> 172.21.15.114:0/1488266816 conn(0x7f66b00660b0 msgr2=0x7f66b00ac150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:14.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.540+0000 7f66b7600640 1 -- 172.21.15.114:0/1488266816 shutdown_connections 2024-09-13T17:52:14.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.540+0000 7f66b7600640 1 -- 172.21.15.114:0/1488266816 wait complete. 2024-09-13T17:52:14.563 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-09-13T17:52:13.939495+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1988162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2231,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003385"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837772+0000","last_change":"2024-09-13T17:51:49.424735+0000","last_active":"2024-09-13T17:51:53.837772+0000","last_peered":"2024-09-13T17:51:53.837772+0000","last_clean":"2024-09-13T17:51:53.837772+0000","last_became_active":"2024-09-13T17:51:49.424461+0000","last_became_peered":"2024-09-13T17:51:49.424461+0000","last_unstale":"2024-09-13T17:51:53.837772+0000","last_undegraded":"2024-09-13T17:51:53.837772+0000","last_fullsized":"2024-09-13T17:51:53.837772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:05.776083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827298+0000","last_change":"2024-09-13T17:51:49.822366+0000","last_active":"2024-09-13T17:51:53.827298+0000","last_peered":"2024-09-13T17:51:53.827298+0000","last_clean":"2024-09-13T17:51:53.827298+0000","last_became_active":"2024-09-13T17:51:49.822088+0000","last_became_peered":"2024-09-13T17:51:49.822088+0000","last_unstale":"2024-09-13T17:51:53.827298+0000","last_undegraded":"2024-09-13T17:51:53.827298+0000","last_fullsized":"2024-09-13T17:51:53.827298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:19.843619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.898097+0000","last_change":"2024-09-13T17:51:53.888282+0000","last_active":"2024-09-13T17:51:53.898097+0000","last_peered":"2024-09-13T17:51:53.898097+0000","last_clean":"2024-09-13T17:51:53.898097+0000","last_became_active":"2024-09-13T17:51:53.887931+0000","last_became_peered":"2024-09-13T17:51:53.887931+0000","last_unstale":"2024-09-13T17:51:53.898097+0000","last_undegraded":"2024-09-13T17:51:53.898097+0000","last_fullsized":"2024-09-13T17:51:53.898097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:50:08.665223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827194+0000","last_change":"2024-09-13T17:51:49.417919+0000","last_active":"2024-09-13T17:51:53.827194+0000","last_peered":"2024-09-13T17:51:53.827194+0000","last_clean":"2024-09-13T17:51:53.827194+0000","last_became_active":"2024-09-13T17:51:49.417669+0000","last_became_peered":"2024-09-13T17:51:49.417669+0000","last_unstale":"2024-09-13T17:51:53.827194+0000","last_undegraded":"2024-09-13T17:51:53.827194+0000","last_fullsized":"2024-09-13T17:51:53.827194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:05.776083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837561+0000","last_change":"2024-09-13T17:51:49.820810+0000","last_active":"2024-09-13T17:51:53.837561+0000","last_peered":"2024-09-13T17:51:53.837561+0000","last_clean":"2024-09-13T17:51:53.837561+0000","last_became_active":"2024-09-13T17:51:49.820576+0000","last_became_peered":"2024-09-13T17:51:49.820576+0000","last_unstale":"2024-09-13T17:51:53.837561+0000","last_undegraded":"2024-09-13T17:51:53.837561+0000","last_fullsized":"2024-09-13T17:51:53.837561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:26.069550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.855045+0000","last_change":"2024-09-13T17:51:53.853653+0000","last_active":"2024-09-13T17:51:53.855045+0000","last_peered":"2024-09-13T17:51:53.855045+0000","last_clean":"2024-09-13T17:51:53.855045+0000","last_became_active":"2024-09-13T17:51:53.853265+0000","last_became_peered":"2024-09-13T17:51:53.853265+0000","last_unstale":"2024-09-13T17:51:53.855045+0000","last_undegraded":"2024-09-13T17:51:53.855045+0000","last_fullsized":"2024-09-13T17:51:53.855045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:21.706044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.884139+0000","last_change":"2024-09-13T17:51:49.429851+0000","last_active":"2024-09-13T17:51:53.884139+0000","last_peered":"2024-09-13T17:51:53.884139+0000","last_clean":"2024-09-13T17:51:53.884139+0000","last_became_active":"2024-09-13T17:51:49.428737+0000","last_became_peered":"2024-09-13T17:51:49.428737+0000","last_unstale":"2024-09-13T17:51:53.884139+0000","last_undegraded":"2024-09-13T17:51:53.884139+0000","last_fullsized":"2024-09-13T17:51:53.884139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:06.732541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.830753+0000","last_change":"2024-09-13T17:51:49.819895+0000","last_active":"2024-09-13T17:51:53.830753+0000","last_peered":"2024-09-13T17:51:53.830753+0000","last_clean":"2024-09-13T17:51:53.830753+0000","last_became_active":"2024-09-13T17:51:49.819636+0000","last_became_peered":"2024-09-13T17:51:49.819636+0000","last_unstale":"2024-09-13T17:51:53.830753+0000","last_undegraded":"2024-09-13T17:51:53.830753+0000","last_fullsized":"2024-09-13T17:51:53.830753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:16.626937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.851436+0000","last_change":"2024-09-13T17:51:53.848452+0000","last_active":"2024-09-13T17:51:53.851436+0000","last_peered":"2024-09-13T17:51:53.851436+0000","last_clean":"2024-09-13T17:51:53.851436+0000","last_became_active":"2024-09-13T17:51:53.847653+0000","last_became_peered":"2024-09-13T17:51:53.847653+0000","last_unstale":"2024-09-13T17:51:53.851436+0000","last_undegraded":"2024-09-13T17:51:53.851436+0000","last_fullsized":"2024-09-13T17:51:53.851436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:05.592560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882694+0000","last_change":"2024-09-13T17:51:49.430634+0000","last_active":"2024-09-13T17:51:53.882694+0000","last_peered":"2024-09-13T17:51:53.882694+0000","last_clean":"2024-09-13T17:51:53.882694+0000","last_became_active":"2024-09-13T17:51:49.428490+0000","last_became_peered":"2024-09-13T17:51:49.428490+0000","last_unstale":"2024-09-13T17:51:53.882694+0000","last_undegraded":"2024-09-13T17:51:53.882694+0000","last_fullsized":"2024-09-13T17:51:53.882694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:20.612271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.836270+0000","last_change":"2024-09-13T17:51:49.810371+0000","last_active":"2024-09-13T17:51:53.836270+0000","last_peered":"2024-09-13T17:51:53.836270+0000","last_clean":"2024-09-13T17:51:53.836270+0000","last_became_active":"2024-09-13T17:51:49.810008+0000","last_became_peered":"2024-09-13T17:51:49.810008+0000","last_unstale":"2024-09-13T17:51:53.836270+0000","last_undegraded":"2024-09-13T17:51:53.836270+0000","last_fullsized":"2024-09-13T17:51:53.836270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:54.519014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.851812+0000","last_change":"2024-09-13T17:51:53.850425+0000","last_active":"2024-09-13T17:51:53.851812+0000","last_peered":"2024-09-13T17:51:53.851812+0000","last_clean":"2024-09-13T17:51:53.851812+0000","last_became_active":"2024-09-13T17:51:53.848615+0000","last_became_peered":"2024-09-13T17:51:53.848615+0000","last_unstale":"2024-09-13T17:51:53.851812+0000","last_undegraded":"2024-09-13T17:51:53.851812+0000","last_fullsized":"2024-09-13T17:51:53.851812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:00.438042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827600+0000","last_change":"2024-09-13T17:51:49.814942+0000","last_active":"2024-09-13T17:51:53.827600+0000","last_peered":"2024-09-13T17:51:53.827600+0000","last_clean":"2024-09-13T17:51:53.827600+0000","last_became_active":"2024-09-13T17:51:49.814562+0000","last_became_peered":"2024-09-13T17:51:49.814562+0000","last_unstale":"2024-09-13T17:51:53.827600+0000","last_undegraded":"2024-09-13T17:51:53.827600+0000","last_fullsized":"2024-09-13T17:51:53.827600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:18.962464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882721+0000","last_change":"2024-09-13T17:51:49.426550+0000","last_active":"2024-09-13T17:51:53.882721+0000","last_peered":"2024-09-13T17:51:53.882721+0000","last_clean":"2024-09-13T17:51:53.882721+0000","last_became_active":"2024-09-13T17:51:49.424996+0000","last_became_peered":"2024-09-13T17:51:49.424996+0000","last_unstale":"2024-09-13T17:51:53.882721+0000","last_undegraded":"2024-09-13T17:51:53.882721+0000","last_fullsized":"2024-09-13T17:51:53.882721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:22.023124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.852108+0000","last_change":"2024-09-13T17:51:53.851132+0000","last_active":"2024-09-13T17:51:53.852108+0000","last_peered":"2024-09-13T17:51:53.852108+0000","last_clean":"2024-09-13T17:51:53.852108+0000","last_became_active":"2024-09-13T17:51:53.850766+0000","last_became_peered":"2024-09-13T17:51:53.850766+0000","last_unstale":"2024-09-13T17:51:53.852108+0000","last_undegraded":"2024-09-13T17:51:53.852108+0000","last_fullsized":"2024-09-13T17:51:53.852108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:28.299853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.825693+0000","last_change":"2024-09-13T17:51:49.827994+0000","last_active":"2024-09-13T17:51:53.825693+0000","last_peered":"2024-09-13T17:51:53.825693+0000","last_clean":"2024-09-13T17:51:53.825693+0000","last_became_active":"2024-09-13T17:51:49.827737+0000","last_became_peered":"2024-09-13T17:51:49.827737+0000","last_unstale":"2024-09-13T17:51:53.825693+0000","last_undegraded":"2024-09-13T17:51:53.825693+0000","last_fullsized":"2024-09-13T17:51:53.825693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:18.962464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827386+0000","last_change":"2024-09-13T17:51:49.421799+0000","last_active":"2024-09-13T17:51:53.827386+0000","last_peered":"2024-09-13T17:51:53.827386+0000","last_clean":"2024-09-13T17:51:53.827386+0000","last_became_active":"2024-09-13T17:51:49.420657+0000","last_became_peered":"2024-09-13T17:51:49.420657+0000","last_unstale":"2024-09-13T17:51:53.827386+0000","last_undegraded":"2024-09-13T17:51:53.827386+0000","last_fullsized":"2024-09-13T17:51:53.827386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:53.206793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.843724+0000","last_change":"2024-09-13T17:51:53.843027+0000","last_active":"2024-09-13T17:51:53.843724+0000","last_peered":"2024-09-13T17:51:53.843724+0000","last_clean":"2024-09-13T17:51:53.843724+0000","last_became_active":"2024-09-13T17:51:53.842576+0000","last_became_peered":"2024-09-13T17:51:53.842576+0000","last_unstale":"2024-09-13T17:51:53.843724+0000","last_undegraded":"2024-09-13T17:51:53.843724+0000","last_fullsized":"2024-09-13T17:51:53.843724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:04.738599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826762+0000","last_change":"2024-09-13T17:51:49.820882+0000","last_active":"2024-09-13T17:51:53.826762+0000","last_peered":"2024-09-13T17:51:53.826762+0000","last_clean":"2024-09-13T17:51:53.826762+0000","last_became_active":"2024-09-13T17:51:49.820420+0000","last_became_peered":"2024-09-13T17:51:49.820420+0000","last_unstale":"2024-09-13T17:51:53.826762+0000","last_undegraded":"2024-09-13T17:51:53.826762+0000","last_fullsized":"2024-09-13T17:51:53.826762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:38.101006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.824631+0000","last_change":"2024-09-13T17:51:49.411703+0000","last_active":"2024-09-13T17:51:53.824631+0000","last_peered":"2024-09-13T17:51:53.824631+0000","last_clean":"2024-09-13T17:51:53.824631+0000","last_became_active":"2024-09-13T17:51:49.411421+0000","last_became_peered":"2024-09-13T17:51:49.411421+0000","last_unstale":"2024-09-13T17:51:53.824631+0000","last_undegraded":"2024-09-13T17:51:53.824631+0000","last_fullsized":"2024-09-13T17:51:53.824631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:06.421994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.888157+0000","last_change":"2024-09-13T17:51:53.884773+0000","last_active":"2024-09-13T17:51:53.888157+0000","last_peered":"2024-09-13T17:51:53.888157+0000","last_clean":"2024-09-13T17:51:53.888157+0000","last_became_active":"2024-09-13T17:51:53.884392+0000","last_became_peered":"2024-09-13T17:51:53.884392+0000","last_unstale":"2024-09-13T17:51:53.888157+0000","last_undegraded":"2024-09-13T17:51:53.888157+0000","last_fullsized":"2024-09-13T17:51:53.888157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:35.046158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.834403+0000","last_change":"2024-09-13T17:51:49.810146+0000","last_active":"2024-09-13T17:51:53.834403+0000","last_peered":"2024-09-13T17:51:53.834403+0000","last_clean":"2024-09-13T17:51:53.834403+0000","last_became_active":"2024-09-13T17:51:49.809659+0000","last_became_peered":"2024-09-13T17:51:49.809659+0000","last_unstale":"2024-09-13T17:51:53.834403+0000","last_undegraded":"2024-09-13T17:51:53.834403+0000","last_fullsized":"2024-09-13T17:51:53.834403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:22.017119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882255+0000","last_change":"2024-09-13T17:51:49.420646+0000","last_active":"2024-09-13T17:51:53.882255+0000","last_peered":"2024-09-13T17:51:53.882255+0000","last_clean":"2024-09-13T17:51:53.882255+0000","last_became_active":"2024-09-13T17:51:49.420353+0000","last_became_peered":"2024-09-13T17:51:49.420353+0000","last_unstale":"2024-09-13T17:51:53.882255+0000","last_undegraded":"2024-09-13T17:51:53.882255+0000","last_fullsized":"2024-09-13T17:51:53.882255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:21.010810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.851627+0000","last_change":"2024-09-13T17:51:53.849048+0000","last_active":"2024-09-13T17:51:53.851627+0000","last_peered":"2024-09-13T17:51:53.851627+0000","last_clean":"2024-09-13T17:51:53.851627+0000","last_became_active":"2024-09-13T17:51:53.848610+0000","last_became_peered":"2024-09-13T17:51:53.848610+0000","last_unstale":"2024-09-13T17:51:53.851627+0000","last_undegraded":"2024-09-13T17:51:53.851627+0000","last_fullsized":"2024-09-13T17:51:53.851627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:23.757828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837389+0000","last_change":"2024-09-13T17:51:49.813776+0000","last_active":"2024-09-13T17:51:53.837389+0000","last_peered":"2024-09-13T17:51:53.837389+0000","last_clean":"2024-09-13T17:51:53.837389+0000","last_became_active":"2024-09-13T17:51:49.813446+0000","last_became_peered":"2024-09-13T17:51:49.813446+0000","last_unstale":"2024-09-13T17:51:53.837389+0000","last_undegraded":"2024-09-13T17:51:53.837389+0000","last_fullsized":"2024-09-13T17:51:53.837389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:38.101006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827985+0000","last_change":"2024-09-13T17:51:49.424387+0000","last_active":"2024-09-13T17:51:53.827985+0000","last_peered":"2024-09-13T17:51:53.827985+0000","last_clean":"2024-09-13T17:51:53.827985+0000","last_became_active":"2024-09-13T17:51:49.424056+0000","last_became_peered":"2024-09-13T17:51:49.424056+0000","last_unstale":"2024-09-13T17:51:53.827985+0000","last_undegraded":"2024-09-13T17:51:53.827985+0000","last_fullsized":"2024-09-13T17:51:53.827985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:39.329721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.890240+0000","last_change":"2024-09-13T17:51:53.887729+0000","last_active":"2024-09-13T17:51:53.890240+0000","last_peered":"2024-09-13T17:51:53.890240+0000","last_clean":"2024-09-13T17:51:53.890240+0000","last_became_active":"2024-09-13T17:51:53.887339+0000","last_became_peered":"2024-09-13T17:51:53.887339+0000","last_unstale":"2024-09-13T17:51:53.890240+0000","last_undegraded":"2024-09-13T17:51:53.890240+0000","last_fullsized":"2024-09-13T17:51:53.890240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:46.649388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.829910+0000","last_change":"2024-09-13T17:51:49.826015+0000","last_active":"2024-09-13T17:51:53.829910+0000","last_peered":"2024-09-13T17:51:53.829910+0000","last_clean":"2024-09-13T17:51:53.829910+0000","last_became_active":"2024-09-13T17:51:49.825697+0000","last_became_peered":"2024-09-13T17:51:49.825697+0000","last_unstale":"2024-09-13T17:51:53.829910+0000","last_undegraded":"2024-09-13T17:51:53.829910+0000","last_fullsized":"2024-09-13T17:51:53.829910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:12.044921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826611+0000","last_change":"2024-09-13T17:51:49.421246+0000","last_active":"2024-09-13T17:51:53.826611+0000","last_peered":"2024-09-13T17:51:53.826611+0000","last_clean":"2024-09-13T17:51:53.826611+0000","last_became_active":"2024-09-13T17:51:49.419599+0000","last_became_peered":"2024-09-13T17:51:49.419599+0000","last_unstale":"2024-09-13T17:51:53.826611+0000","last_undegraded":"2024-09-13T17:51:53.826611+0000","last_fullsized":"2024-09-13T17:51:53.826611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:22.023124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.898030+0000","last_change":"2024-09-13T17:51:53.886455+0000","last_active":"2024-09-13T17:51:53.898030+0000","last_peered":"2024-09-13T17:51:53.898030+0000","last_clean":"2024-09-13T17:51:53.898030+0000","last_became_active":"2024-09-13T17:51:53.885310+0000","last_became_peered":"2024-09-13T17:51:53.885310+0000","last_unstale":"2024-09-13T17:51:53.898030+0000","last_undegraded":"2024-09-13T17:51:53.898030+0000","last_fullsized":"2024-09-13T17:51:53.898030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:20.352407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.824729+0000","last_change":"2024-09-13T17:51:49.810357+0000","last_active":"2024-09-13T17:51:53.824729+0000","last_peered":"2024-09-13T17:51:53.824729+0000","last_clean":"2024-09-13T17:51:53.824729+0000","last_became_active":"2024-09-13T17:51:49.810114+0000","last_became_peered":"2024-09-13T17:51:49.810114+0000","last_unstale":"2024-09-13T17:51:53.824729+0000","last_undegraded":"2024-09-13T17:51:53.824729+0000","last_fullsized":"2024-09-13T17:51:53.824729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:16.626937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.884340+0000","last_change":"2024-09-13T17:51:49.423732+0000","last_active":"2024-09-13T17:51:53.884340+0000","last_peered":"2024-09-13T17:51:53.884340+0000","last_clean":"2024-09-13T17:51:53.884340+0000","last_became_active":"2024-09-13T17:51:49.422959+0000","last_became_peered":"2024-09-13T17:51:49.422959+0000","last_unstale":"2024-09-13T17:51:53.884340+0000","last_undegraded":"2024-09-13T17:51:53.884340+0000","last_fullsized":"2024-09-13T17:51:53.884340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:07.122247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.888684+0000","last_change":"2024-09-13T17:51:53.884526+0000","last_active":"2024-09-13T17:51:53.888684+0000","last_peered":"2024-09-13T17:51:53.888684+0000","last_clean":"2024-09-13T17:51:53.888684+0000","last_became_active":"2024-09-13T17:51:53.884114+0000","last_became_peered":"2024-09-13T17:51:53.884114+0000","last_unstale":"2024-09-13T17:51:53.888684+0000","last_undegraded":"2024-09-13T17:51:53.888684+0000","last_fullsized":"2024-09-13T17:51:53.888684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:11.718873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.836339+0000","last_change":"2024-09-13T17:51:49.830157+0000","last_active":"2024-09-13T17:51:53.836339+0000","last_peered":"2024-09-13T17:51:53.836339+0000","last_clean":"2024-09-13T17:51:53.836339+0000","last_became_active":"2024-09-13T17:51:49.829791+0000","last_became_peered":"2024-09-13T17:51:49.829791+0000","last_unstale":"2024-09-13T17:51:53.836339+0000","last_undegraded":"2024-09-13T17:51:53.836339+0000","last_fullsized":"2024-09-13T17:51:53.836339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:34.576074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826239+0000","last_change":"2024-09-13T17:51:49.417458+0000","last_active":"2024-09-13T17:51:53.826239+0000","last_peered":"2024-09-13T17:51:53.826239+0000","last_clean":"2024-09-13T17:51:53.826239+0000","last_became_active":"2024-09-13T17:51:49.417205+0000","last_became_peered":"2024-09-13T17:51:49.417205+0000","last_unstale":"2024-09-13T17:51:53.826239+0000","last_undegraded":"2024-09-13T17:51:53.826239+0000","last_fullsized":"2024-09-13T17:51:53.826239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:20.612271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.854428+0000","last_change":"2024-09-13T17:51:53.850163+0000","last_active":"2024-09-13T17:51:53.854428+0000","last_peered":"2024-09-13T17:51:53.854428+0000","last_clean":"2024-09-13T17:51:53.854428+0000","last_became_active":"2024-09-13T17:51:53.847840+0000","last_became_peered":"2024-09-13T17:51:53.847840+0000","last_unstale":"2024-09-13T17:51:53.854428+0000","last_undegraded":"2024-09-13T17:51:53.854428+0000","last_fullsized":"2024-09-13T17:51:53.854428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:04.738599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.834848+0000","last_change":"2024-09-13T17:51:49.807208+0000","last_active":"2024-09-13T17:51:53.834848+0000","last_peered":"2024-09-13T17:51:53.834848+0000","last_clean":"2024-09-13T17:51:53.834848+0000","last_became_active":"2024-09-13T17:51:49.806837+0000","last_became_peered":"2024-09-13T17:51:49.806837+0000","last_unstale":"2024-09-13T17:51:53.834848+0000","last_undegraded":"2024-09-13T17:51:53.834848+0000","last_fullsized":"2024-09-13T17:51:53.834848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:21.618580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.838674+0000","last_change":"2024-09-13T17:51:49.422538+0000","last_active":"2024-09-13T17:51:53.838674+0000","last_peered":"2024-09-13T17:51:53.838674+0000","last_clean":"2024-09-13T17:51:53.838674+0000","last_became_active":"2024-09-13T17:51:49.422079+0000","last_became_peered":"2024-09-13T17:51:49.422079+0000","last_unstale":"2024-09-13T17:51:53.838674+0000","last_undegraded":"2024-09-13T17:51:53.838674+0000","last_fullsized":"2024-09-13T17:51:53.838674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:01.166296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.853333+0000","last_change":"2024-09-13T17:51:53.848470+0000","last_active":"2024-09-13T17:51:53.853333+0000","last_peered":"2024-09-13T17:51:53.853333+0000","last_clean":"2024-09-13T17:51:53.853333+0000","last_became_active":"2024-09-13T17:51:53.847907+0000","last_became_peered":"2024-09-13T17:51:53.847907+0000","last_unstale":"2024-09-13T17:51:53.853333+0000","last_undegraded":"2024-09-13T17:51:53.853333+0000","last_fullsized":"2024-09-13T17:51:53.853333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:01.791551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.824107+0000","last_change":"2024-09-13T17:51:49.803724+0000","last_active":"2024-09-13T17:51:53.824107+0000","last_peered":"2024-09-13T17:51:53.824107+0000","last_clean":"2024-09-13T17:51:53.824107+0000","last_became_active":"2024-09-13T17:51:49.803488+0000","last_became_peered":"2024-09-13T17:51:49.803488+0000","last_unstale":"2024-09-13T17:51:53.824107+0000","last_undegraded":"2024-09-13T17:51:53.824107+0000","last_fullsized":"2024-09-13T17:51:53.824107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:18.962464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.838227+0000","last_change":"2024-09-13T17:51:49.420825+0000","last_active":"2024-09-13T17:51:53.838227+0000","last_peered":"2024-09-13T17:51:53.838227+0000","last_clean":"2024-09-13T17:51:53.838227+0000","last_became_active":"2024-09-13T17:51:49.420459+0000","last_became_peered":"2024-09-13T17:51:49.420459+0000","last_unstale":"2024-09-13T17:51:53.838227+0000","last_undegraded":"2024-09-13T17:51:53.838227+0000","last_fullsized":"2024-09-13T17:51:53.838227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:05.515948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.847206+0000","last_change":"2024-09-13T17:51:53.842609+0000","last_active":"2024-09-13T17:51:53.847206+0000","last_peered":"2024-09-13T17:51:53.847206+0000","last_clean":"2024-09-13T17:51:53.847206+0000","last_became_active":"2024-09-13T17:51:53.842195+0000","last_became_peered":"2024-09-13T17:51:53.842195+0000","last_unstale":"2024-09-13T17:51:53.847206+0000","last_undegraded":"2024-09-13T17:51:53.847206+0000","last_fullsized":"2024-09-13T17:51:53.847206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:48:59.044958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.835739+0000","last_change":"2024-09-13T17:51:49.803582+0000","last_active":"2024-09-13T17:51:53.835739+0000","last_peered":"2024-09-13T17:51:53.835739+0000","last_clean":"2024-09-13T17:51:53.835739+0000","last_became_active":"2024-09-13T17:51:49.803242+0000","last_became_peered":"2024-09-13T17:51:49.803242+0000","last_unstale":"2024-09-13T17:51:53.835739+0000","last_undegraded":"2024-09-13T17:51:53.835739+0000","last_fullsized":"2024-09-13T17:51:53.835739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:35.902537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882372+0000","last_change":"2024-09-13T17:51:49.427107+0000","last_active":"2024-09-13T17:51:53.882372+0000","last_peered":"2024-09-13T17:51:53.882372+0000","last_clean":"2024-09-13T17:51:53.882372+0000","last_became_active":"2024-09-13T17:51:49.426867+0000","last_became_peered":"2024-09-13T17:51:49.426867+0000","last_unstale":"2024-09-13T17:51:53.882372+0000","last_undegraded":"2024-09-13T17:51:53.882372+0000","last_fullsized":"2024-09-13T17:51:53.882372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:53.206793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.888656+0000","last_change":"2024-09-13T17:51:53.884097+0000","last_active":"2024-09-13T17:51:53.888656+0000","last_peered":"2024-09-13T17:51:53.888656+0000","last_clean":"2024-09-13T17:51:53.888656+0000","last_became_active":"2024-09-13T17:51:53.883622+0000","last_became_peered":"2024-09-13T17:51:53.883622+0000","last_unstale":"2024-09-13T17:51:53.888656+0000","last_undegraded":"2024-09-13T17:51:53.888656+0000","last_fullsized":"2024-09-13T17:51:53.888656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:46.649388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826078+0000","last_change":"2024-09-13T17:51:49.838792+0000","last_active":"2024-09-13T17:51:53.826078+0000","last_peered":"2024-09-13T17:51:53.826078+0000","last_clean":"2024-09-13T17:51:53.826078+0000","last_became_active":"2024-09-13T17:51:49.838580+0000","last_became_peered":"2024-09-13T17:51:49.838580+0000","last_unstale":"2024-09-13T17:51:53.826078+0000","last_undegraded":"2024-09-13T17:51:53.826078+0000","last_fullsized":"2024-09-13T17:51:53.826078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:21.449832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.834191+0000","last_change":"2024-09-13T17:51:49.416568+0000","last_active":"2024-09-13T17:51:53.834191+0000","last_peered":"2024-09-13T17:51:53.834191+0000","last_clean":"2024-09-13T17:51:53.834191+0000","last_became_active":"2024-09-13T17:51:49.416233+0000","last_became_peered":"2024-09-13T17:51:49.416233+0000","last_unstale":"2024-09-13T17:51:53.834191+0000","last_undegraded":"2024-09-13T17:51:53.834191+0000","last_fullsized":"2024-09-13T17:51:53.834191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:39.329721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882384+0000","last_change":"2024-09-13T17:51:40.205691+0000","last_active":"2024-09-13T17:51:53.882384+0000","last_peered":"2024-09-13T17:51:53.882384+0000","last_clean":"2024-09-13T17:51:53.882384+0000","last_became_active":"2024-09-13T17:51:40.204577+0000","last_became_peered":"2024-09-13T17:51:40.204577+0000","last_unstale":"2024-09-13T17:51:53.882384+0000","last_undegraded":"2024-09-13T17:51:53.882384+0000","last_fullsized":"2024-09-13T17:51:53.882384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_clean_scrub_stamp":"2024-09-13T17:51:38.340495+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:37.899275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.889483+0000","last_change":"2024-09-13T17:51:53.885726+0000","last_active":"2024-09-13T17:51:53.889483+0000","last_peered":"2024-09-13T17:51:53.889483+0000","last_clean":"2024-09-13T17:51:53.889483+0000","last_became_active":"2024-09-13T17:51:53.885225+0000","last_became_peered":"2024-09-13T17:51:53.885225+0000","last_unstale":"2024-09-13T17:51:53.889483+0000","last_undegraded":"2024-09-13T17:51:53.889483+0000","last_fullsized":"2024-09-13T17:51:53.889483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:56.070629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.884041+0000","last_change":"2024-09-13T17:51:49.838216+0000","last_active":"2024-09-13T17:51:53.884041+0000","last_peered":"2024-09-13T17:51:53.884041+0000","last_clean":"2024-09-13T17:51:53.884041+0000","last_became_active":"2024-09-13T17:51:49.838023+0000","last_became_peered":"2024-09-13T17:51:49.838023+0000","last_unstale":"2024-09-13T17:51:53.884041+0000","last_undegraded":"2024-09-13T17:51:53.884041+0000","last_fullsized":"2024-09-13T17:51:53.884041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:01.703358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.838525+0000","last_change":"2024-09-13T17:51:49.425601+0000","last_active":"2024-09-13T17:51:53.838525+0000","last_peered":"2024-09-13T17:51:53.838525+0000","last_clean":"2024-09-13T17:51:53.838525+0000","last_became_active":"2024-09-13T17:51:49.425289+0000","last_became_peered":"2024-09-13T17:51:49.425289+0000","last_unstale":"2024-09-13T17:51:53.838525+0000","last_undegraded":"2024-09-13T17:51:53.838525+0000","last_fullsized":"2024-09-13T17:51:53.838525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:06.421994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.888637+0000","last_change":"2024-09-13T17:51:53.885100+0000","last_active":"2024-09-13T17:51:53.888637+0000","last_peered":"2024-09-13T17:51:53.888637+0000","last_clean":"2024-09-13T17:51:53.888637+0000","last_became_active":"2024-09-13T17:51:53.884217+0000","last_became_peered":"2024-09-13T17:51:53.884217+0000","last_unstale":"2024-09-13T17:51:53.888637+0000","last_undegraded":"2024-09-13T17:51:53.888637+0000","last_fullsized":"2024-09-13T17:51:53.888637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:01.791551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.830819+0000","last_change":"2024-09-13T17:51:49.830458+0000","last_active":"2024-09-13T17:51:53.830819+0000","last_peered":"2024-09-13T17:51:53.830819+0000","last_clean":"2024-09-13T17:51:53.830819+0000","last_became_active":"2024-09-13T17:51:49.830026+0000","last_became_peered":"2024-09-13T17:51:49.830026+0000","last_unstale":"2024-09-13T17:51:53.830819+0000","last_undegraded":"2024-09-13T17:51:53.830819+0000","last_fullsized":"2024-09-13T17:51:53.830819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:37.125958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826446+0000","last_change":"2024-09-13T17:51:49.416301+0000","last_active":"2024-09-13T17:51:53.826446+0000","last_peered":"2024-09-13T17:51:53.826446+0000","last_clean":"2024-09-13T17:51:53.826446+0000","last_became_active":"2024-09-13T17:51:49.416065+0000","last_became_peered":"2024-09-13T17:51:49.416065+0000","last_unstale":"2024-09-13T17:51:53.826446+0000","last_undegraded":"2024-09-13T17:51:53.826446+0000","last_fullsized":"2024-09-13T17:51:53.826446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:42.283317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.847340+0000","last_change":"2024-09-13T17:51:53.844047+0000","last_active":"2024-09-13T17:51:53.847340+0000","last_peered":"2024-09-13T17:51:53.847340+0000","last_clean":"2024-09-13T17:51:53.847340+0000","last_became_active":"2024-09-13T17:51:53.843665+0000","last_became_peered":"2024-09-13T17:51:53.843665+0000","last_unstale":"2024-09-13T17:51:53.847340+0000","last_undegraded":"2024-09-13T17:51:53.847340+0000","last_fullsized":"2024-09-13T17:51:53.847340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:04.738599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.884913+0000","last_change":"2024-09-13T17:51:49.836513+0000","last_active":"2024-09-13T17:51:53.884913+0000","last_peered":"2024-09-13T17:51:53.884913+0000","last_clean":"2024-09-13T17:51:53.884913+0000","last_became_active":"2024-09-13T17:51:49.836232+0000","last_became_peered":"2024-09-13T17:51:49.836232+0000","last_unstale":"2024-09-13T17:51:53.884913+0000","last_undegraded":"2024-09-13T17:51:53.884913+0000","last_fullsized":"2024-09-13T17:51:53.884913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:37.125958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.841145+0000","last_change":"2024-09-13T17:51:49.420678+0000","last_active":"2024-09-13T17:51:53.841145+0000","last_peered":"2024-09-13T17:51:53.841145+0000","last_clean":"2024-09-13T17:51:53.841145+0000","last_became_active":"2024-09-13T17:51:49.420418+0000","last_became_peered":"2024-09-13T17:51:49.420418+0000","last_unstale":"2024-09-13T17:51:53.841145+0000","last_undegraded":"2024-09-13T17:51:53.841145+0000","last_fullsized":"2024-09-13T17:51:53.841145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:42.283317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.889765+0000","last_change":"2024-09-13T17:51:53.886172+0000","last_active":"2024-09-13T17:51:53.889765+0000","last_peered":"2024-09-13T17:51:53.889765+0000","last_clean":"2024-09-13T17:51:53.889765+0000","last_became_active":"2024-09-13T17:51:53.885826+0000","last_became_peered":"2024-09-13T17:51:53.885826+0000","last_unstale":"2024-09-13T17:51:53.889765+0000","last_undegraded":"2024-09-13T17:51:53.889765+0000","last_fullsized":"2024-09-13T17:51:53.889765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:46.649388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.885762+0000","last_change":"2024-09-13T17:51:49.834991+0000","last_active":"2024-09-13T17:51:53.885762+0000","last_peered":"2024-09-13T17:51:53.885762+0000","last_clean":"2024-09-13T17:51:53.885762+0000","last_became_active":"2024-09-13T17:51:49.834740+0000","last_became_peered":"2024-09-13T17:51:49.834740+0000","last_unstale":"2024-09-13T17:51:53.885762+0000","last_undegraded":"2024-09-13T17:51:53.885762+0000","last_fullsized":"2024-09-13T17:51:53.885762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:47.337762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.834831+0000","last_change":"2024-09-13T17:51:49.415586+0000","last_active":"2024-09-13T17:51:53.834831+0000","last_peered":"2024-09-13T17:51:53.834831+0000","last_clean":"2024-09-13T17:51:53.834831+0000","last_became_active":"2024-09-13T17:51:49.415184+0000","last_became_peered":"2024-09-13T17:51:49.415184+0000","last_unstale":"2024-09-13T17:51:53.834831+0000","last_undegraded":"2024-09-13T17:51:53.834831+0000","last_fullsized":"2024-09-13T17:51:53.834831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:38.364524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.851409+0000","last_change":"2024-09-13T17:51:53.848234+0000","last_active":"2024-09-13T17:51:53.851409+0000","last_peered":"2024-09-13T17:51:53.851409+0000","last_clean":"2024-09-13T17:51:53.851409+0000","last_became_active":"2024-09-13T17:51:53.847557+0000","last_became_peered":"2024-09-13T17:51:53.847557+0000","last_unstale":"2024-09-13T17:51:53.851409+0000","last_undegraded":"2024-09-13T17:51:53.851409+0000","last_fullsized":"2024-09-13T17:51:53.851409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:51.251781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.883636+0000","last_change":"2024-09-13T17:51:49.830867+0000","last_active":"2024-09-13T17:51:53.883636+0000","last_peered":"2024-09-13T17:51:53.883636+0000","last_clean":"2024-09-13T17:51:53.883636+0000","last_became_active":"2024-09-13T17:51:49.830584+0000","last_became_peered":"2024-09-13T17:51:49.830584+0000","last_unstale":"2024-09-13T17:51:53.883636+0000","last_undegraded":"2024-09-13T17:51:53.883636+0000","last_fullsized":"2024-09-13T17:51:53.883636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:51.162047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837955+0000","last_change":"2024-09-13T17:51:49.424019+0000","last_active":"2024-09-13T17:51:53.837955+0000","last_peered":"2024-09-13T17:51:53.837955+0000","last_clean":"2024-09-13T17:51:53.837955+0000","last_became_active":"2024-09-13T17:51:49.423710+0000","last_became_peered":"2024-09-13T17:51:49.423710+0000","last_unstale":"2024-09-13T17:51:53.837955+0000","last_undegraded":"2024-09-13T17:51:53.837955+0000","last_fullsized":"2024-09-13T17:51:53.837955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:01.166296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.849553+0000","last_change":"2024-09-13T17:51:53.844911+0000","last_active":"2024-09-13T17:51:53.849553+0000","last_peered":"2024-09-13T17:51:53.849553+0000","last_clean":"2024-09-13T17:51:53.849553+0000","last_became_active":"2024-09-13T17:51:53.844550+0000","last_became_peered":"2024-09-13T17:51:53.844550+0000","last_unstale":"2024-09-13T17:51:53.849553+0000","last_undegraded":"2024-09-13T17:51:53.849553+0000","last_fullsized":"2024-09-13T17:51:53.849553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:28.299853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826947+0000","last_change":"2024-09-13T17:51:49.811086+0000","last_active":"2024-09-13T17:51:53.826947+0000","last_peered":"2024-09-13T17:51:53.826947+0000","last_clean":"2024-09-13T17:51:53.826947+0000","last_became_active":"2024-09-13T17:51:49.810823+0000","last_became_peered":"2024-09-13T17:51:49.810823+0000","last_unstale":"2024-09-13T17:51:53.826947+0000","last_undegraded":"2024-09-13T17:51:53.826947+0000","last_fullsized":"2024-09-13T17:51:53.826947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:14.458841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827359+0000","last_change":"2024-09-13T17:51:49.426895+0000","last_active":"2024-09-13T17:51:53.827359+0000","last_peered":"2024-09-13T17:51:53.827359+0000","last_clean":"2024-09-13T17:51:53.827359+0000","last_became_active":"2024-09-13T17:51:49.426624+0000","last_became_peered":"2024-09-13T17:51:49.426624+0000","last_unstale":"2024-09-13T17:51:53.827359+0000","last_undegraded":"2024-09-13T17:51:53.827359+0000","last_fullsized":"2024-09-13T17:51:53.827359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:42.283317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.897944+0000","last_change":"2024-09-13T17:51:53.885895+0000","last_active":"2024-09-13T17:51:53.897944+0000","last_peered":"2024-09-13T17:51:53.897944+0000","last_clean":"2024-09-13T17:51:53.897944+0000","last_became_active":"2024-09-13T17:51:53.884841+0000","last_became_peered":"2024-09-13T17:51:53.884841+0000","last_unstale":"2024-09-13T17:51:53.897944+0000","last_undegraded":"2024-09-13T17:51:53.897944+0000","last_fullsized":"2024-09-13T17:51:53.897944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:27.675643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882609+0000","last_change":"2024-09-13T17:51:49.831817+0000","last_active":"2024-09-13T17:51:53.882609+0000","last_peered":"2024-09-13T17:51:53.882609+0000","last_clean":"2024-09-13T17:51:53.882609+0000","last_became_active":"2024-09-13T17:51:49.831354+0000","last_became_peered":"2024-09-13T17:51:49.831354+0000","last_unstale":"2024-09-13T17:51:53.882609+0000","last_undegraded":"2024-09-13T17:51:53.882609+0000","last_fullsized":"2024-09-13T17:51:53.882609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:04.470664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.838565+0000","last_change":"2024-09-13T17:51:49.422566+0000","last_active":"2024-09-13T17:51:53.838565+0000","last_peered":"2024-09-13T17:51:53.838565+0000","last_clean":"2024-09-13T17:51:53.838565+0000","last_became_active":"2024-09-13T17:51:49.421786+0000","last_became_peered":"2024-09-13T17:51:49.421786+0000","last_unstale":"2024-09-13T17:51:53.838565+0000","last_undegraded":"2024-09-13T17:51:53.838565+0000","last_fullsized":"2024-09-13T17:51:53.838565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:42.283317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.897908+0000","last_change":"2024-09-13T17:51:53.884841+0000","last_active":"2024-09-13T17:51:53.897908+0000","last_peered":"2024-09-13T17:51:53.897908+0000","last_clean":"2024-09-13T17:51:53.897908+0000","last_became_active":"2024-09-13T17:51:53.884135+0000","last_became_peered":"2024-09-13T17:51:53.884135+0000","last_unstale":"2024-09-13T17:51:53.897908+0000","last_undegraded":"2024-09-13T17:51:53.897908+0000","last_fullsized":"2024-09-13T17:51:53.897908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:53.766560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.836501+0000","last_change":"2024-09-13T17:51:49.824264+0000","last_active":"2024-09-13T17:51:53.836501+0000","last_peered":"2024-09-13T17:51:53.836501+0000","last_clean":"2024-09-13T17:51:53.836501+0000","last_became_active":"2024-09-13T17:51:49.823959+0000","last_became_peered":"2024-09-13T17:51:49.823959+0000","last_unstale":"2024-09-13T17:51:53.836501+0000","last_undegraded":"2024-09-13T17:51:53.836501+0000","last_fullsized":"2024-09-13T17:51:53.836501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:19.843619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837204+0000","last_change":"2024-09-13T17:51:49.425477+0000","last_active":"2024-09-13T17:51:53.837204+0000","last_peered":"2024-09-13T17:51:53.837204+0000","last_clean":"2024-09-13T17:51:53.837204+0000","last_became_active":"2024-09-13T17:51:49.425220+0000","last_became_peered":"2024-09-13T17:51:49.425220+0000","last_unstale":"2024-09-13T17:51:53.837204+0000","last_undegraded":"2024-09-13T17:51:53.837204+0000","last_fullsized":"2024-09-13T17:51:53.837204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:38.364524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.887527+0000","last_change":"2024-09-13T17:51:53.883758+0000","last_active":"2024-09-13T17:51:53.887527+0000","last_peered":"2024-09-13T17:51:53.887527+0000","last_clean":"2024-09-13T17:51:53.887527+0000","last_became_active":"2024-09-13T17:51:53.883328+0000","last_became_peered":"2024-09-13T17:51:53.883328+0000","last_unstale":"2024-09-13T17:51:53.887527+0000","last_undegraded":"2024-09-13T17:51:53.887527+0000","last_fullsized":"2024-09-13T17:51:53.887527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:39.243101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882767+0000","last_change":"2024-09-13T17:51:49.832481+0000","last_active":"2024-09-13T17:51:53.882767+0000","last_peered":"2024-09-13T17:51:53.882767+0000","last_clean":"2024-09-13T17:51:53.882767+0000","last_became_active":"2024-09-13T17:51:49.832173+0000","last_became_peered":"2024-09-13T17:51:49.832173+0000","last_unstale":"2024-09-13T17:51:53.882767+0000","last_undegraded":"2024-09-13T17:51:53.882767+0000","last_fullsized":"2024-09-13T17:51:53.882767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:34.576074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:51:59.930293+0000","last_change":"2024-09-13T17:51:49.430279+0000","last_active":"2024-09-13T17:51:59.930293+0000","last_peered":"2024-09-13T17:51:59.930293+0000","last_clean":"2024-09-13T17:51:59.930293+0000","last_became_active":"2024-09-13T17:51:49.430015+0000","last_became_peered":"2024-09-13T17:51:49.430015+0000","last_unstale":"2024-09-13T17:51:59.930293+0000","last_undegraded":"2024-09-13T17:51:59.930293+0000","last_fullsized":"2024-09-13T17:51:59.930293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:53.206793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.853325+0000","last_change":"2024-09-13T17:51:53.848938+0000","last_active":"2024-09-13T17:51:53.853325+0000","last_peered":"2024-09-13T17:51:53.853325+0000","last_clean":"2024-09-13T17:51:53.853325+0000","last_became_active":"2024-09-13T17:51:53.848420+0000","last_became_peered":"2024-09-13T17:51:53.848420+0000","last_unstale":"2024-09-13T17:51:53.853325+0000","last_undegraded":"2024-09-13T17:51:53.853325+0000","last_fullsized":"2024-09-13T17:51:53.853325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:06.615337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.834925+0000","last_change":"2024-09-13T17:51:49.827666+0000","last_active":"2024-09-13T17:51:53.834925+0000","last_peered":"2024-09-13T17:51:53.834925+0000","last_clean":"2024-09-13T17:51:53.834925+0000","last_became_active":"2024-09-13T17:51:49.827010+0000","last_became_peered":"2024-09-13T17:51:49.827010+0000","last_unstale":"2024-09-13T17:51:53.834925+0000","last_undegraded":"2024-09-13T17:51:53.834925+0000","last_fullsized":"2024-09-13T17:51:53.834925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:23.029433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826358+0000","last_change":"2024-09-13T17:51:49.421670+0000","last_active":"2024-09-13T17:51:53.826358+0000","last_peered":"2024-09-13T17:51:53.826358+0000","last_clean":"2024-09-13T17:51:53.826358+0000","last_became_active":"2024-09-13T17:51:49.418903+0000","last_became_peered":"2024-09-13T17:51:49.418903+0000","last_unstale":"2024-09-13T17:51:53.826358+0000","last_undegraded":"2024-09-13T17:51:53.826358+0000","last_fullsized":"2024-09-13T17:51:53.826358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:39.329721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.851665+0000","last_change":"2024-09-13T17:51:53.849211+0000","last_active":"2024-09-13T17:51:53.851665+0000","last_peered":"2024-09-13T17:51:53.851665+0000","last_clean":"2024-09-13T17:51:53.851665+0000","last_became_active":"2024-09-13T17:51:53.848829+0000","last_became_peered":"2024-09-13T17:51:53.848829+0000","last_unstale":"2024-09-13T17:51:53.851665+0000","last_undegraded":"2024-09-13T17:51:53.851665+0000","last_fullsized":"2024-09-13T17:51:53.851665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:56.070629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837633+0000","last_change":"2024-09-13T17:51:49.832116+0000","last_active":"2024-09-13T17:51:53.837633+0000","last_peered":"2024-09-13T17:51:53.837633+0000","last_clean":"2024-09-13T17:51:53.837633+0000","last_became_active":"2024-09-13T17:51:49.831837+0000","last_became_peered":"2024-09-13T17:51:49.831837+0000","last_unstale":"2024-09-13T17:51:53.837633+0000","last_undegraded":"2024-09-13T17:51:53.837633+0000","last_fullsized":"2024-09-13T17:51:53.837633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:07.738851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.832758+0000","last_change":"2024-09-13T17:51:49.421180+0000","last_active":"2024-09-13T17:51:53.832758+0000","last_peered":"2024-09-13T17:51:53.832758+0000","last_clean":"2024-09-13T17:51:53.832758+0000","last_became_active":"2024-09-13T17:51:49.420518+0000","last_became_peered":"2024-09-13T17:51:49.420518+0000","last_unstale":"2024-09-13T17:51:53.832758+0000","last_undegraded":"2024-09-13T17:51:53.832758+0000","last_fullsized":"2024-09-13T17:51:53.832758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:06.421994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.844571+0000","last_change":"2024-09-13T17:51:53.840737+0000","last_active":"2024-09-13T17:51:53.844571+0000","last_peered":"2024-09-13T17:51:53.844571+0000","last_clean":"2024-09-13T17:51:53.844571+0000","last_became_active":"2024-09-13T17:51:53.838857+0000","last_became_peered":"2024-09-13T17:51:53.838857+0000","last_unstale":"2024-09-13T17:51:53.844571+0000","last_undegraded":"2024-09-13T17:51:53.844571+0000","last_fullsized":"2024-09-13T17:51:53.844571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:00.438042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.832711+0000","last_change":"2024-09-13T17:51:49.820669+0000","last_active":"2024-09-13T17:51:53.832711+0000","last_peered":"2024-09-13T17:51:53.832711+0000","last_clean":"2024-09-13T17:51:53.832711+0000","last_became_active":"2024-09-13T17:51:49.820401+0000","last_became_peered":"2024-09-13T17:51:49.820401+0000","last_unstale":"2024-09-13T17:51:53.832711+0000","last_undegraded":"2024-09-13T17:51:53.832711+0000","last_fullsized":"2024-09-13T17:51:53.832711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:12.044921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827878+0000","last_change":"2024-09-13T17:51:49.428974+0000","last_active":"2024-09-13T17:51:53.827878+0000","last_peered":"2024-09-13T17:51:53.827878+0000","last_clean":"2024-09-13T17:51:53.827878+0000","last_became_active":"2024-09-13T17:51:49.428658+0000","last_became_peered":"2024-09-13T17:51:49.428658+0000","last_unstale":"2024-09-13T17:51:53.827878+0000","last_undegraded":"2024-09-13T17:51:53.827878+0000","last_fullsized":"2024-09-13T17:51:53.827878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:55.567370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.898056+0000","last_change":"2024-09-13T17:51:53.887256+0000","last_active":"2024-09-13T17:51:53.898056+0000","last_peered":"2024-09-13T17:51:53.898056+0000","last_clean":"2024-09-13T17:51:53.898056+0000","last_became_active":"2024-09-13T17:51:53.886890+0000","last_became_peered":"2024-09-13T17:51:53.886890+0000","last_unstale":"2024-09-13T17:51:53.898056+0000","last_undegraded":"2024-09-13T17:51:53.898056+0000","last_fullsized":"2024-09-13T17:51:53.898056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:50.331208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.891341+0000","last_change":"2024-09-13T17:51:53.887867+0000","last_active":"2024-09-13T17:51:53.891341+0000","last_peered":"2024-09-13T17:51:53.891341+0000","last_clean":"2024-09-13T17:51:53.891341+0000","last_became_active":"2024-09-13T17:51:53.887513+0000","last_became_peered":"2024-09-13T17:51:53.887513+0000","last_unstale":"2024-09-13T17:51:53.891341+0000","last_undegraded":"2024-09-13T17:51:53.891341+0000","last_fullsized":"2024-09-13T17:51:53.891341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:35.046158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.824092+0000","last_change":"2024-09-13T17:51:49.818712+0000","last_active":"2024-09-13T17:51:53.824092+0000","last_peered":"2024-09-13T17:51:53.824092+0000","last_clean":"2024-09-13T17:51:53.824092+0000","last_became_active":"2024-09-13T17:51:49.818441+0000","last_became_peered":"2024-09-13T17:51:49.818441+0000","last_unstale":"2024-09-13T17:51:53.824092+0000","last_undegraded":"2024-09-13T17:51:53.824092+0000","last_fullsized":"2024-09-13T17:51:53.824092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:43.263003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.831201+0000","last_change":"2024-09-13T17:51:49.414687+0000","last_active":"2024-09-13T17:51:53.831201+0000","last_peered":"2024-09-13T17:51:53.831201+0000","last_clean":"2024-09-13T17:51:53.831201+0000","last_became_active":"2024-09-13T17:51:49.414417+0000","last_became_peered":"2024-09-13T17:51:49.414417+0000","last_unstale":"2024-09-13T17:51:53.831201+0000","last_undegraded":"2024-09-13T17:51:53.831201+0000","last_fullsized":"2024-09-13T17:51:53.831201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:05.515948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.850818+0000","last_change":"2024-09-13T17:51:53.848088+0000","last_active":"2024-09-13T17:51:53.850818+0000","last_peered":"2024-09-13T17:51:53.850818+0000","last_clean":"2024-09-13T17:51:53.850818+0000","last_became_active":"2024-09-13T17:51:53.847545+0000","last_became_peered":"2024-09-13T17:51:53.847545+0000","last_unstale":"2024-09-13T17:51:53.850818+0000","last_undegraded":"2024-09-13T17:51:53.850818+0000","last_fullsized":"2024-09-13T17:51:53.850818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:25.404881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826689+0000","last_change":"2024-09-13T17:51:49.820694+0000","last_active":"2024-09-13T17:51:53.826689+0000","last_peered":"2024-09-13T17:51:53.826689+0000","last_clean":"2024-09-13T17:51:53.826689+0000","last_became_active":"2024-09-13T17:51:49.819217+0000","last_became_peered":"2024-09-13T17:51:49.819217+0000","last_unstale":"2024-09-13T17:51:53.826689+0000","last_undegraded":"2024-09-13T17:51:53.826689+0000","last_fullsized":"2024-09-13T17:51:53.826689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:16.626937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827381+0000","last_change":"2024-09-13T17:51:49.424168+0000","last_active":"2024-09-13T17:51:53.827381+0000","last_peered":"2024-09-13T17:51:53.827381+0000","last_clean":"2024-09-13T17:51:53.827381+0000","last_became_active":"2024-09-13T17:51:49.423884+0000","last_became_peered":"2024-09-13T17:51:49.423884+0000","last_unstale":"2024-09-13T17:51:53.827381+0000","last_undegraded":"2024-09-13T17:51:53.827381+0000","last_fullsized":"2024-09-13T17:51:53.827381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:38.364524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827736+0000","last_change":"2024-09-13T17:51:49.428168+0000","last_active":"2024-09-13T17:51:53.827736+0000","last_peered":"2024-09-13T17:51:53.827736+0000","last_clean":"2024-09-13T17:51:53.827736+0000","last_became_active":"2024-09-13T17:51:49.427823+0000","last_became_peered":"2024-09-13T17:51:49.427823+0000","last_unstale":"2024-09-13T17:51:53.827736+0000","last_undegraded":"2024-09-13T17:51:53.827736+0000","last_fullsized":"2024-09-13T17:51:53.827736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:06.421994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837095+0000","last_change":"2024-09-13T17:51:49.805322+0000","last_active":"2024-09-13T17:51:53.837095+0000","last_peered":"2024-09-13T17:51:53.837095+0000","last_clean":"2024-09-13T17:51:53.837095+0000","last_became_active":"2024-09-13T17:51:49.804205+0000","last_became_peered":"2024-09-13T17:51:49.804205+0000","last_unstale":"2024-09-13T17:51:53.837095+0000","last_undegraded":"2024-09-13T17:51:53.837095+0000","last_fullsized":"2024-09-13T17:51:53.837095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:43.263003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.854352+0000","last_change":"2024-09-13T17:51:53.851986+0000","last_active":"2024-09-13T17:51:53.854352+0000","last_peered":"2024-09-13T17:51:53.854352+0000","last_clean":"2024-09-13T17:51:53.854352+0000","last_became_active":"2024-09-13T17:51:53.851630+0000","last_became_peered":"2024-09-13T17:51:53.851630+0000","last_unstale":"2024-09-13T17:51:53.854352+0000","last_undegraded":"2024-09-13T17:51:53.854352+0000","last_fullsized":"2024-09-13T17:51:53.854352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:39.323134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827078+0000","last_change":"2024-09-13T17:51:49.417653+0000","last_active":"2024-09-13T17:51:53.827078+0000","last_peered":"2024-09-13T17:51:53.827078+0000","last_clean":"2024-09-13T17:51:53.827078+0000","last_became_active":"2024-09-13T17:51:49.417424+0000","last_became_peered":"2024-09-13T17:51:49.417424+0000","last_unstale":"2024-09-13T17:51:53.827078+0000","last_undegraded":"2024-09-13T17:51:53.827078+0000","last_fullsized":"2024-09-13T17:51:53.827078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:01.166296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.834334+0000","last_change":"2024-09-13T17:51:49.806919+0000","last_active":"2024-09-13T17:51:53.834334+0000","last_peered":"2024-09-13T17:51:53.834334+0000","last_clean":"2024-09-13T17:51:53.834334+0000","last_became_active":"2024-09-13T17:51:49.806493+0000","last_became_peered":"2024-09-13T17:51:49.806493+0000","last_unstale":"2024-09-13T17:51:53.834334+0000","last_undegraded":"2024-09-13T17:51:53.834334+0000","last_fullsized":"2024-09-13T17:51:53.834334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:54.213102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.856376+0000","last_change":"2024-09-13T17:51:53.850120+0000","last_active":"2024-09-13T17:51:53.856376+0000","last_peered":"2024-09-13T17:51:53.856376+0000","last_clean":"2024-09-13T17:51:53.856376+0000","last_became_active":"2024-09-13T17:51:53.849730+0000","last_became_peered":"2024-09-13T17:51:53.849730+0000","last_unstale":"2024-09-13T17:51:53.856376+0000","last_undegraded":"2024-09-13T17:51:53.856376+0000","last_fullsized":"2024-09-13T17:51:53.856376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:05.592560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826849+0000","last_change":"2024-09-13T17:51:49.826333+0000","last_active":"2024-09-13T17:51:53.826849+0000","last_peered":"2024-09-13T17:51:53.826849+0000","last_clean":"2024-09-13T17:51:53.826849+0000","last_became_active":"2024-09-13T17:51:49.826071+0000","last_became_peered":"2024-09-13T17:51:49.826071+0000","last_unstale":"2024-09-13T17:51:53.826849+0000","last_undegraded":"2024-09-13T17:51:53.826849+0000","last_fullsized":"2024-09-13T17:51:53.826849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:38.101006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837999+0000","last_change":"2024-09-13T17:51:49.809218+0000","last_active":"2024-09-13T17:51:53.837999+0000","last_peered":"2024-09-13T17:51:53.837999+0000","last_clean":"2024-09-13T17:51:53.837999+0000","last_became_active":"2024-09-13T17:51:49.808985+0000","last_became_peered":"2024-09-13T17:51:49.808985+0000","last_unstale":"2024-09-13T17:51:53.837999+0000","last_undegraded":"2024-09-13T17:51:53.837999+0000","last_fullsized":"2024-09-13T17:51:53.837999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:21.618580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.838422+0000","last_change":"2024-09-13T17:51:49.830357+0000","last_active":"2024-09-13T17:51:53.838422+0000","last_peered":"2024-09-13T17:51:53.838422+0000","last_clean":"2024-09-13T17:51:53.838422+0000","last_became_active":"2024-09-13T17:51:49.830084+0000","last_became_peered":"2024-09-13T17:51:49.830084+0000","last_unstale":"2024-09-13T17:51:53.838422+0000","last_undegraded":"2024-09-13T17:51:53.838422+0000","last_fullsized":"2024-09-13T17:51:53.838422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:21.449832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.836968+0000","last_change":"2024-09-13T17:51:49.826591+0000","last_active":"2024-09-13T17:51:53.836968+0000","last_peered":"2024-09-13T17:51:53.836968+0000","last_clean":"2024-09-13T17:51:53.836968+0000","last_became_active":"2024-09-13T17:51:49.826406+0000","last_became_peered":"2024-09-13T17:51:49.826406+0000","last_unstale":"2024-09-13T17:51:53.836968+0000","last_undegraded":"2024-09-13T17:51:53.836968+0000","last_fullsized":"2024-09-13T17:51:53.836968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:36.343757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.828767+0000","last_change":"2024-09-13T17:51:49.831819+0000","last_active":"2024-09-13T17:51:53.828767+0000","last_peered":"2024-09-13T17:51:53.828767+0000","last_clean":"2024-09-13T17:51:53.828767+0000","last_became_active":"2024-09-13T17:51:49.831617+0000","last_became_peered":"2024-09-13T17:51:49.831617+0000","last_unstale":"2024-09-13T17:51:53.828767+0000","last_undegraded":"2024-09-13T17:51:53.828767+0000","last_fullsized":"2024-09-13T17:51:53.828767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:43.263003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826257+0000","last_change":"2024-09-13T17:51:49.826770+0000","last_active":"2024-09-13T17:51:53.826257+0000","last_peered":"2024-09-13T17:51:53.826257+0000","last_clean":"2024-09-13T17:51:53.826257+0000","last_became_active":"2024-09-13T17:51:49.826103+0000","last_became_peered":"2024-09-13T17:51:49.826103+0000","last_unstale":"2024-09-13T17:51:53.826257+0000","last_undegraded":"2024-09-13T17:51:53.826257+0000","last_fullsized":"2024-09-13T17:51:53.826257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:35.902537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827779+0000","last_change":"2024-09-13T17:51:49.816685+0000","last_active":"2024-09-13T17:51:53.827779+0000","last_peered":"2024-09-13T17:51:53.827779+0000","last_clean":"2024-09-13T17:51:53.827779+0000","last_became_active":"2024-09-13T17:51:49.816364+0000","last_became_peered":"2024-09-13T17:51:49.816364+0000","last_unstale":"2024-09-13T17:51:53.827779+0000","last_undegraded":"2024-09-13T17:51:53.827779+0000","last_fullsized":"2024-09-13T17:51:53.827779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:19.843619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.829842+0000","last_change":"2024-09-13T17:51:49.829446+0000","last_active":"2024-09-13T17:51:53.829842+0000","last_peered":"2024-09-13T17:51:53.829842+0000","last_clean":"2024-09-13T17:51:53.829842+0000","last_became_active":"2024-09-13T17:51:49.829196+0000","last_became_peered":"2024-09-13T17:51:49.829196+0000","last_unstale":"2024-09-13T17:51:53.829842+0000","last_undegraded":"2024-09-13T17:51:53.829842+0000","last_fullsized":"2024-09-13T17:51:53.829842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:14.458841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.831119+0000","last_change":"2024-09-13T17:51:49.835245+0000","last_active":"2024-09-13T17:51:53.831119+0000","last_peered":"2024-09-13T17:51:53.831119+0000","last_clean":"2024-09-13T17:51:53.831119+0000","last_became_active":"2024-09-13T17:51:49.834941+0000","last_became_peered":"2024-09-13T17:51:49.834941+0000","last_unstale":"2024-09-13T17:51:53.831119+0000","last_undegraded":"2024-09-13T17:51:53.831119+0000","last_fullsized":"2024-09-13T17:51:53.831119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:18.962464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827310+0000","last_change":"2024-09-13T17:51:49.831150+0000","last_active":"2024-09-13T17:51:53.827310+0000","last_peered":"2024-09-13T17:51:53.827310+0000","last_clean":"2024-09-13T17:51:53.827310+0000","last_became_active":"2024-09-13T17:51:49.830923+0000","last_became_peered":"2024-09-13T17:51:49.830923+0000","last_unstale":"2024-09-13T17:51:53.827310+0000","last_undegraded":"2024-09-13T17:51:53.827310+0000","last_fullsized":"2024-09-13T17:51:53.827310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:35.902537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.835969+0000","last_change":"2024-09-13T17:51:49.831132+0000","last_active":"2024-09-13T17:51:53.835969+0000","last_peered":"2024-09-13T17:51:53.835969+0000","last_clean":"2024-09-13T17:51:53.835969+0000","last_became_active":"2024-09-13T17:51:49.822819+0000","last_became_peered":"2024-09-13T17:51:49.822819+0000","last_unstale":"2024-09-13T17:51:53.835969+0000","last_undegraded":"2024-09-13T17:51:53.835969+0000","last_fullsized":"2024-09-13T17:51:53.835969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:01.180550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.836860+0000","last_change":"2024-09-13T17:51:49.826381+0000","last_active":"2024-09-13T17:51:53.836860+0000","last_peered":"2024-09-13T17:51:53.836860+0000","last_clean":"2024-09-13T17:51:53.836860+0000","last_became_active":"2024-09-13T17:51:49.816777+0000","last_became_peered":"2024-09-13T17:51:49.816777+0000","last_unstale":"2024-09-13T17:51:53.836860+0000","last_undegraded":"2024-09-13T17:51:53.836860+0000","last_fullsized":"2024-09-13T17:51:53.836860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:18.962464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827364+0000","last_change":"2024-09-13T17:51:49.815417+0000","last_active":"2024-09-13T17:51:53.827364+0000","last_peered":"2024-09-13T17:51:53.827364+0000","last_clean":"2024-09-13T17:51:53.827364+0000","last_became_active":"2024-09-13T17:51:49.814545+0000","last_became_peered":"2024-09-13T17:51:49.814545+0000","last_unstale":"2024-09-13T17:51:53.827364+0000","last_undegraded":"2024-09-13T17:51:53.827364+0000","last_fullsized":"2024-09-13T17:51:53.827364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:26.069550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.884324+0000","last_change":"2024-09-13T17:51:49.832628+0000","last_active":"2024-09-13T17:51:53.884324+0000","last_peered":"2024-09-13T17:51:53.884324+0000","last_clean":"2024-09-13T17:51:53.884324+0000","last_became_active":"2024-09-13T17:51:49.832374+0000","last_became_peered":"2024-09-13T17:51:49.832374+0000","last_unstale":"2024-09-13T17:51:53.884324+0000","last_undegraded":"2024-09-13T17:51:53.884324+0000","last_fullsized":"2024-09-13T17:51:53.884324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:01.180550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.841065+0000","last_change":"2024-09-13T17:51:49.815728+0000","last_active":"2024-09-13T17:51:53.841065+0000","last_peered":"2024-09-13T17:51:53.841065+0000","last_clean":"2024-09-13T17:51:53.841065+0000","last_became_active":"2024-09-13T17:51:49.815464+0000","last_became_peered":"2024-09-13T17:51:49.815464+0000","last_unstale":"2024-09-13T17:51:53.841065+0000","last_undegraded":"2024-09-13T17:51:53.841065+0000","last_fullsized":"2024-09-13T17:51:53.841065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:22.017119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.830807+0000","last_change":"2024-09-13T17:51:49.823164+0000","last_active":"2024-09-13T17:51:53.830807+0000","last_peered":"2024-09-13T17:51:53.830807+0000","last_clean":"2024-09-13T17:51:53.830807+0000","last_became_active":"2024-09-13T17:51:49.822858+0000","last_became_peered":"2024-09-13T17:51:49.822858+0000","last_unstale":"2024-09-13T17:51:53.830807+0000","last_undegraded":"2024-09-13T17:51:53.830807+0000","last_fullsized":"2024-09-13T17:51:53.830807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:12:04.288019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.830989+0000","last_change":"2024-09-13T17:51:49.820290+0000","last_active":"2024-09-13T17:51:53.830989+0000","last_peered":"2024-09-13T17:51:53.830989+0000","last_clean":"2024-09-13T17:51:53.830989+0000","last_became_active":"2024-09-13T17:51:49.820037+0000","last_became_peered":"2024-09-13T17:51:49.820037+0000","last_unstale":"2024-09-13T17:51:53.830989+0000","last_undegraded":"2024-09-13T17:51:53.830989+0000","last_fullsized":"2024-09-13T17:51:53.830989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:51.162047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.824544+0000","last_change":"2024-09-13T17:51:49.806528+0000","last_active":"2024-09-13T17:51:53.824544+0000","last_peered":"2024-09-13T17:51:53.824544+0000","last_clean":"2024-09-13T17:51:53.824544+0000","last_became_active":"2024-09-13T17:51:49.806269+0000","last_became_peered":"2024-09-13T17:51:49.806269+0000","last_unstale":"2024-09-13T17:51:53.824544+0000","last_undegraded":"2024-09-13T17:51:53.824544+0000","last_fullsized":"2024-09-13T17:51:53.824544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:26.069550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.836406+0000","last_change":"2024-09-13T17:51:49.808911+0000","last_active":"2024-09-13T17:51:53.836406+0000","last_peered":"2024-09-13T17:51:53.836406+0000","last_clean":"2024-09-13T17:51:53.836406+0000","last_became_active":"2024-09-13T17:51:49.808332+0000","last_became_peered":"2024-09-13T17:51:49.808332+0000","last_unstale":"2024-09-13T17:51:53.836406+0000","last_undegraded":"2024-09-13T17:51:53.836406+0000","last_fullsized":"2024-09-13T17:51:53.836406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:14.458841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.825613+0000","last_change":"2024-09-13T17:51:49.826315+0000","last_active":"2024-09-13T17:51:53.825613+0000","last_peered":"2024-09-13T17:51:53.825613+0000","last_clean":"2024-09-13T17:51:53.825613+0000","last_became_active":"2024-09-13T17:51:49.825996+0000","last_became_peered":"2024-09-13T17:51:49.825996+0000","last_unstale":"2024-09-13T17:51:53.825613+0000","last_undegraded":"2024-09-13T17:51:53.825613+0000","last_fullsized":"2024-09-13T17:51:53.825613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:26.069550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.834840+0000","last_change":"2024-09-13T17:51:49.814558+0000","last_active":"2024-09-13T17:51:53.834840+0000","last_peered":"2024-09-13T17:51:53.834840+0000","last_clean":"2024-09-13T17:51:53.834840+0000","last_became_active":"2024-09-13T17:51:49.814289+0000","last_became_peered":"2024-09-13T17:51:49.814289+0000","last_unstale":"2024-09-13T17:51:53.834840+0000","last_undegraded":"2024-09-13T17:51:53.834840+0000","last_fullsized":"2024-09-13T17:51:53.834840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:08.128556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.828014+0000","last_change":"2024-09-13T17:51:49.838829+0000","last_active":"2024-09-13T17:51:53.828014+0000","last_peered":"2024-09-13T17:51:53.828014+0000","last_clean":"2024-09-13T17:51:53.828014+0000","last_became_active":"2024-09-13T17:51:49.838534+0000","last_became_peered":"2024-09-13T17:51:49.838534+0000","last_unstale":"2024-09-13T17:51:53.828014+0000","last_undegraded":"2024-09-13T17:51:53.828014+0000","last_fullsized":"2024-09-13T17:51:53.828014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:16.626937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827668+0000","last_change":"2024-09-13T17:51:49.838082+0000","last_active":"2024-09-13T17:51:53.827668+0000","last_peered":"2024-09-13T17:51:53.827668+0000","last_clean":"2024-09-13T17:51:53.827668+0000","last_became_active":"2024-09-13T17:51:49.837831+0000","last_became_peered":"2024-09-13T17:51:49.837831+0000","last_unstale":"2024-09-13T17:51:53.827668+0000","last_undegraded":"2024-09-13T17:51:53.827668+0000","last_fullsized":"2024-09-13T17:51:53.827668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:43.263003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.884838+0000","last_change":"2024-09-13T17:51:49.838813+0000","last_active":"2024-09-13T17:51:53.884838+0000","last_peered":"2024-09-13T17:51:53.884838+0000","last_clean":"2024-09-13T17:51:53.884838+0000","last_became_active":"2024-09-13T17:51:49.838605+0000","last_became_peered":"2024-09-13T17:51:49.838605+0000","last_unstale":"2024-09-13T17:51:53.884838+0000","last_undegraded":"2024-09-13T17:51:53.884838+0000","last_fullsized":"2024-09-13T17:51:53.884838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:58.370954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826601+0000","last_change":"2024-09-13T17:51:49.839695+0000","last_active":"2024-09-13T17:51:53.826601+0000","last_peered":"2024-09-13T17:51:53.826601+0000","last_clean":"2024-09-13T17:51:53.826601+0000","last_became_active":"2024-09-13T17:51:49.839480+0000","last_became_peered":"2024-09-13T17:51:49.839480+0000","last_unstale":"2024-09-13T17:51:53.826601+0000","last_undegraded":"2024-09-13T17:51:53.826601+0000","last_fullsized":"2024-09-13T17:51:53.826601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:34.576074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.883275+0000","last_change":"2024-09-13T17:51:49.826878+0000","last_active":"2024-09-13T17:51:53.883275+0000","last_peered":"2024-09-13T17:51:53.883275+0000","last_clean":"2024-09-13T17:51:53.883275+0000","last_became_active":"2024-09-13T17:51:49.825030+0000","last_became_peered":"2024-09-13T17:51:49.825030+0000","last_unstale":"2024-09-13T17:51:53.883275+0000","last_undegraded":"2024-09-13T17:51:53.883275+0000","last_fullsized":"2024-09-13T17:51:53.883275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:12:04.288019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.835914+0000","last_change":"2024-09-13T17:51:49.811222+0000","last_active":"2024-09-13T17:51:53.835914+0000","last_peered":"2024-09-13T17:51:53.835914+0000","last_clean":"2024-09-13T17:51:53.835914+0000","last_became_active":"2024-09-13T17:51:49.810759+0000","last_became_peered":"2024-09-13T17:51:49.810759+0000","last_unstale":"2024-09-13T17:51:53.835914+0000","last_undegraded":"2024-09-13T17:51:53.835914+0000","last_fullsized":"2024-09-13T17:51:53.835914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:19.843619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882539+0000","last_change":"2024-09-13T17:51:49.833530+0000","last_active":"2024-09-13T17:51:53.882539+0000","last_peered":"2024-09-13T17:51:53.882539+0000","last_clean":"2024-09-13T17:51:53.882539+0000","last_became_active":"2024-09-13T17:51:49.832951+0000","last_became_peered":"2024-09-13T17:51:49.832951+0000","last_unstale":"2024-09-13T17:51:53.882539+0000","last_undegraded":"2024-09-13T17:51:53.882539+0000","last_fullsized":"2024-09-13T17:51:53.882539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:54.519014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.830679+0000","last_change":"2024-09-13T17:51:49.830297+0000","last_active":"2024-09-13T17:51:53.830679+0000","last_peered":"2024-09-13T17:51:53.830679+0000","last_clean":"2024-09-13T17:51:53.830679+0000","last_became_active":"2024-09-13T17:51:49.829669+0000","last_became_peered":"2024-09-13T17:51:49.829669+0000","last_unstale":"2024-09-13T17:51:53.830679+0000","last_undegraded":"2024-09-13T17:51:53.830679+0000","last_fullsized":"2024-09-13T17:51:53.830679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:47.337762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.843087+0000","last_change":"2024-09-13T17:51:49.803908+0000","last_active":"2024-09-13T17:51:53.843087+0000","last_peered":"2024-09-13T17:51:53.843087+0000","last_clean":"2024-09-13T17:51:53.843087+0000","last_became_active":"2024-09-13T17:51:49.803684+0000","last_became_peered":"2024-09-13T17:51:49.803684+0000","last_unstale":"2024-09-13T17:51:53.843087+0000","last_undegraded":"2024-09-13T17:51:53.843087+0000","last_fullsized":"2024-09-13T17:51:53.843087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:45.192413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826601+0000","last_change":"2024-09-13T17:51:49.815512+0000","last_active":"2024-09-13T17:51:53.826601+0000","last_peered":"2024-09-13T17:51:53.826601+0000","last_clean":"2024-09-13T17:51:53.826601+0000","last_became_active":"2024-09-13T17:51:49.814103+0000","last_became_peered":"2024-09-13T17:51:49.814103+0000","last_unstale":"2024-09-13T17:51:53.826601+0000","last_undegraded":"2024-09-13T17:51:53.826601+0000","last_fullsized":"2024-09-13T17:51:53.826601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:19.843619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.885722+0000","last_change":"2024-09-13T17:51:49.827858+0000","last_active":"2024-09-13T17:51:53.885722+0000","last_peered":"2024-09-13T17:51:53.885722+0000","last_clean":"2024-09-13T17:51:53.885722+0000","last_became_active":"2024-09-13T17:51:49.827613+0000","last_became_peered":"2024-09-13T17:51:49.827613+0000","last_unstale":"2024-09-13T17:51:53.885722+0000","last_undegraded":"2024-09-13T17:51:53.885722+0000","last_fullsized":"2024-09-13T17:51:53.885722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:03.945317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:52:14.568 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T17:52:14.569 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T17:52:14.569 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T17:52:14.569 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T17:52:14.569 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T17:52:14.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.736+0000 7f12e2000640 1 Processor -- start 2024-09-13T17:52:14.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.736+0000 7f12e2000640 1 -- start start 2024-09-13T17:52:14.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.740+0000 7f12e2000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12dc0b4ab0 0x7f12dc0ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:14.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.740+0000 7f12e2000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f12dc0cada0 0x7f12dc0cb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:14.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.740+0000 7f12e2000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12dc099d70 con 0x7f12dc15a4a0 2024-09-13T17:52:14.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.740+0000 7f12e2000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12dc0997b0 con 0x7f12dc0cada0 2024-09-13T17:52:14.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.740+0000 7f12e2000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc099a90 con 0x7f12dc0b4ab0 2024-09-13T17:52:14.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.740+0000 7f12e1600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f12dc0cada0 0x7f12dc0cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:14.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.740+0000 7f12e1600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f12dc0cada0 0x7f12dc0cb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50022/0 (socket says 172.21.15.114:50022) 2024-09-13T17:52:14.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.740+0000 7f12e1600640 1 -- 172.21.15.114:0/385861528 learned_addr learned my addr 172.21.15.114:0/385861528 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:14.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.740+0000 7f12dbe00640 1 --2- 172.21.15.114:0/385861528 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12dc0b4ab0 0x7f12dc0ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:14.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.740+0000 7f12e1600640 1 -- 172.21.15.114:0/385861528 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12dc0b4ab0 msgr2=0x7f12dc0ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:14.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.740+0000 7f12e1600640 1 --2- 172.21.15.114:0/385861528 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12dc0b4ab0 0x7f12dc0ce940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:14.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.740+0000 7f12e1600640 1 -- 172.21.15.114:0/385861528 >> v1:172.21.15.114:6789/0 conn(0x7f12dc15a4a0 legacy=0x7f12dc0ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:14.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.740+0000 7f12e1600640 1 -- 172.21.15.114:0/385861528 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc0b32a0 con 0x7f12dc0cada0 2024-09-13T17:52:14.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.744+0000 7f12e1600640 1 --2- 172.21.15.114:0/385861528 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12dc0cada0 0x7f12dc0cb250 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f12d4009e50 tx=0x7f12d401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb3e36c7960f404 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:14.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.744+0000 7f12db400640 1 -- 172.21.15.114:0/385861528 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d40a64b0 con 0x7f12dc0cada0 2024-09-13T17:52:14.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.744+0000 7f12db400640 1 -- 172.21.15.114:0/385861528 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d40a6610 con 0x7f12dc0cada0 2024-09-13T17:52:14.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.744+0000 7f12db400640 1 -- 172.21.15.114:0/385861528 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d40a69a0 con 0x7f12dc0cada0 2024-09-13T17:52:14.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.744+0000 7f12e2000640 1 -- 172.21.15.114:0/385861528 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12dc0cada0 msgr2=0x7f12dc0cb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:14.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.744+0000 7f12e2000640 1 --2- 172.21.15.114:0/385861528 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12dc0cada0 0x7f12dc0cb250 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f12d4009e50 tx=0x7f12d401ca00 comp rx=0 tx=0).stop 2024-09-13T17:52:14.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.744+0000 7f12e2000640 1 -- 172.21.15.114:0/385861528 shutdown_connections 2024-09-13T17:52:14.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.744+0000 7f12e2000640 1 --2- 172.21.15.114:0/385861528 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12dc0cada0 0x7f12dc0cb250 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:14.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.744+0000 7f12e2000640 1 --2- 172.21.15.114:0/385861528 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12dc0b4ab0 0x7f12dc0ce940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:14.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.744+0000 7f12e2000640 1 -- 172.21.15.114:0/385861528 >> 172.21.15.114:0/385861528 conn(0x7f12dc0d0330 msgr2=0x7f12dc0d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:14.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.744+0000 7f12e2000640 1 -- 172.21.15.114:0/385861528 shutdown_connections 2024-09-13T17:52:14.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.744+0000 7f12e2000640 1 -- 172.21.15.114:0/385861528 wait complete. 2024-09-13T17:52:14.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.744+0000 7f12e2000640 1 Processor -- start 2024-09-13T17:52:14.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.744+0000 7f12e2000640 1 -- start start 2024-09-13T17:52:14.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.748+0000 7f12e2000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12dc0b4ab0 0x7f12dc14a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:14.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.748+0000 7f12e2000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12dc0cada0 0x7f12dc149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:14.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.748+0000 7f12e2000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12dc15a4a0 0x7f12dc0b5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:14.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.748+0000 7f12e2000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc0c4cd0 con 0x7f12dc15a4a0 2024-09-13T17:52:14.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.748+0000 7f12e2000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc0c4fb0 con 0x7f12dc0b4ab0 2024-09-13T17:52:14.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.748+0000 7f12e2000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc0c5290 con 0x7f12dc0cada0 2024-09-13T17:52:14.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.748+0000 7f12e1600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12dc15a4a0 0x7f12dc0b5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:14.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.748+0000 7f12e1600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12dc15a4a0 0x7f12dc0b5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50030/0 (socket says 172.21.15.114:50030) 2024-09-13T17:52:14.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.748+0000 7f12e1600640 1 -- 172.21.15.114:0/1451478177 learned_addr learned my addr 172.21.15.114:0/1451478177 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:14.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.748+0000 7f12e0c00640 1 --2- 172.21.15.114:0/1451478177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12dc0b4ab0 0x7f12dc14a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:14.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.748+0000 7f12dbe00640 1 --2- 172.21.15.114:0/1451478177 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12dc0cada0 0x7f12dc149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:14.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.748+0000 7f12e1600640 1 -- 172.21.15.114:0/1451478177 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12dc0cada0 msgr2=0x7f12dc149f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:14.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.748+0000 7f12e1600640 1 --2- 172.21.15.114:0/1451478177 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12dc0cada0 0x7f12dc149f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:14.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.748+0000 7f12e1600640 1 -- 172.21.15.114:0/1451478177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12dc0b4ab0 msgr2=0x7f12dc14a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:14.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.748+0000 7f12e1600640 1 --2- 172.21.15.114:0/1451478177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12dc0b4ab0 0x7f12dc14a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:14.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.748+0000 7f12e1600640 1 -- 172.21.15.114:0/1451478177 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d4009b30 con 0x7f12dc15a4a0 2024-09-13T17:52:14.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.748+0000 7f12dbe00640 1 --2- 172.21.15.114:0/1451478177 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12dc0cada0 0x7f12dc149f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:14.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.748+0000 7f12e1600640 1 --2- 172.21.15.114:0/1451478177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12dc15a4a0 0x7f12dc0b5690 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f12d401a630 tx=0x7f12d40197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:14.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.748+0000 7f12d8c00640 1 -- 172.21.15.114:0/1451478177 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d40b4070 con 0x7f12dc15a4a0 2024-09-13T17:52:14.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.748+0000 7f12d8c00640 1 -- 172.21.15.114:0/1451478177 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d4009150 con 0x7f12dc15a4a0 2024-09-13T17:52:14.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.748+0000 7f12e2000640 1 -- 172.21.15.114:0/1451478177 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12dc0c5570 con 0x7f12dc15a4a0 2024-09-13T17:52:14.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.748+0000 7f12d8c00640 1 -- 172.21.15.114:0/1451478177 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d40a69e0 con 0x7f12dc15a4a0 2024-09-13T17:52:14.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.748+0000 7f12e2000640 1 -- 172.21.15.114:0/1451478177 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12dc14a4b0 con 0x7f12dc15a4a0 2024-09-13T17:52:14.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.748+0000 7f12e2000640 1 -- 172.21.15.114:0/1451478177 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12dc0cb250 con 0x7f12dc15a4a0 2024-09-13T17:52:14.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.748+0000 7f12d8c00640 1 -- 172.21.15.114:0/1451478177 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f12d40b8070 con 0x7f12dc15a4a0 2024-09-13T17:52:14.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.752+0000 7f12d8c00640 1 --2- 172.21.15.114:0/1451478177 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f12bc066690 0x7f12bc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:14.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.752+0000 7f12d8c00640 1 -- 172.21.15.114:0/1451478177 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f12d40aa070 con 0x7f12dc15a4a0 2024-09-13T17:52:14.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.752+0000 7f12e0c00640 1 --2- 172.21.15.114:0/1451478177 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f12bc066690 0x7f12bc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:14.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.752+0000 7f12e0c00640 1 --2- 172.21.15.114:0/1451478177 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f12bc066690 0x7f12bc068b50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f12d0007fd0 tx=0x7f12d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:14.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.756+0000 7f12d8c00640 1 -- 172.21.15.114:0/1451478177 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f12d40eb2e0 con 0x7f12dc15a4a0 2024-09-13T17:52:14.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.948+0000 7f12e2000640 1 -- 172.21.15.114:0/1451478177 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f12dc0c5a20 con 0x7f12dc15a4a0 2024-09-13T17:52:14.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.952+0000 7f12d8c00640 1 -- 172.21.15.114:0/1451478177 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164902 (secure 0 0 0) 0x7f12d40ee900 con 0x7f12dc15a4a0 2024-09-13T17:52:14.955 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:14.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.952+0000 7f12e2000640 1 -- 172.21.15.114:0/1451478177 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f12bc066690 msgr2=0x7f12bc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:14.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.952+0000 7f12e2000640 1 --2- 172.21.15.114:0/1451478177 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f12bc066690 0x7f12bc068b50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f12d0007fd0 tx=0x7f12d0009040 comp rx=0 tx=0).stop 2024-09-13T17:52:14.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.952+0000 7f12e2000640 1 -- 172.21.15.114:0/1451478177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12dc15a4a0 msgr2=0x7f12dc0b5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:14.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.952+0000 7f12e2000640 1 --2- 172.21.15.114:0/1451478177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12dc15a4a0 0x7f12dc0b5690 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f12d401a630 tx=0x7f12d40197a0 comp rx=0 tx=0).stop 2024-09-13T17:52:14.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.952+0000 7f12e2000640 1 -- 172.21.15.114:0/1451478177 shutdown_connections 2024-09-13T17:52:14.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.952+0000 7f12e2000640 1 --2- 172.21.15.114:0/1451478177 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f12bc066690 0x7f12bc068b50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:14.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.952+0000 7f12e2000640 1 --2- 172.21.15.114:0/1451478177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12dc15a4a0 0x7f12dc0b5690 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:14.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.952+0000 7f12e2000640 1 --2- 172.21.15.114:0/1451478177 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12dc0cada0 0x7f12dc149f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:14.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.952+0000 7f12e2000640 1 --2- 172.21.15.114:0/1451478177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12dc0b4ab0 0x7f12dc14a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:14.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.952+0000 7f12e2000640 1 -- 172.21.15.114:0/1451478177 >> 172.21.15.114:0/1451478177 conn(0x7f12dc0d0330 msgr2=0x7f12dc0ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:14.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.952+0000 7f12e2000640 1 -- 172.21.15.114:0/1451478177 shutdown_connections 2024-09-13T17:52:14.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:14.952+0000 7f12e2000640 1 -- 172.21.15.114:0/1451478177 wait complete. 2024-09-13T17:52:14.975 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":137691478},{"type":"v1","addr":"172.21.15.114:6833","nonce":137691478}]},"active_addr":"172.21.15.114:6833/137691478","active_change":"2024-09-13T17:51:29.919773+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":373501143}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":253119431}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":1219874733}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":3101425976}]}]} 2024-09-13T17:52:14.979 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T17:52:14.979 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T17:52:14.979 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:52:15.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.112+0000 7fe8d9200640 1 Processor -- start 2024-09-13T17:52:15.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.112+0000 7fe8d9200640 1 -- start start 2024-09-13T17:52:15.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.116+0000 7fe8d9200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe8d413f420 0x7fe8d406d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.116+0000 7fe8d9200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe8d406da90 0x7fe8d40cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.116+0000 7fe8d9200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d40cd220 con 0x7fe8d413c240 2024-09-13T17:52:15.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.116+0000 7fe8d9200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d406df40 con 0x7fe8d413f420 2024-09-13T17:52:15.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.116+0000 7fe8d9200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d415a740 con 0x7fe8d406da90 2024-09-13T17:52:15.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.116+0000 7fe8d1400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe8d413f420 0x7fe8d406d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.116+0000 7fe8d1400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe8d413f420 0x7fe8d406d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50032/0 (socket says 172.21.15.114:50032) 2024-09-13T17:52:15.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.116+0000 7fe8d1400640 1 -- 172.21.15.114:0/1389503654 learned_addr learned my addr 172.21.15.114:0/1389503654 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:15.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.116+0000 7fe8d2800640 1 --2- 172.21.15.114:0/1389503654 >> v2:172.21.15.134:3300/0 conn(0x7fe8d406da90 0x7fe8d40cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.116+0000 7fe8d1400640 1 -- 172.21.15.114:0/1389503654 >> v2:172.21.15.134:3300/0 conn(0x7fe8d406da90 msgr2=0x7fe8d40cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:15.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.116+0000 7fe8d1400640 1 --2- 172.21.15.114:0/1389503654 >> v2:172.21.15.134:3300/0 conn(0x7fe8d406da90 0x7fe8d40cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.116+0000 7fe8d1400640 1 -- 172.21.15.114:0/1389503654 >> v1:172.21.15.134:6789/0 conn(0x7fe8d413c240 legacy=0x7fe8d413c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.116+0000 7fe8d1400640 1 -- 172.21.15.114:0/1389503654 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d4159bc0 con 0x7fe8d413f420 2024-09-13T17:52:15.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.120+0000 7fe8d1400640 1 --2- 172.21.15.114:0/1389503654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8d413f420 0x7fe8d406d550 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40cc4f0 tx=0x7fe8c001ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7684393f6b85ccab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.120+0000 7fe8d0a00640 1 -- 172.21.15.114:0/1389503654 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c00a7c90 con 0x7fe8d413f420 2024-09-13T17:52:15.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.120+0000 7fe8d0a00640 1 -- 172.21.15.114:0/1389503654 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c00a7df0 con 0x7fe8d413f420 2024-09-13T17:52:15.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.120+0000 7fe8d0a00640 1 -- 172.21.15.114:0/1389503654 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c00af660 con 0x7fe8d413f420 2024-09-13T17:52:15.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.120+0000 7fe8d9200640 1 -- 172.21.15.114:0/1389503654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8d413f420 msgr2=0x7fe8d406d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.120+0000 7fe8d9200640 1 --2- 172.21.15.114:0/1389503654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8d413f420 0x7fe8d406d550 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40cc4f0 tx=0x7fe8c001ebc0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.120+0000 7fe8d9200640 1 -- 172.21.15.114:0/1389503654 shutdown_connections 2024-09-13T17:52:15.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.120+0000 7fe8d9200640 1 --2- 172.21.15.114:0/1389503654 >> v2:172.21.15.134:3300/0 conn(0x7fe8d406da90 0x7fe8d40cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.120+0000 7fe8d9200640 1 --2- 172.21.15.114:0/1389503654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8d413f420 0x7fe8d406d550 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.120+0000 7fe8d9200640 1 -- 172.21.15.114:0/1389503654 >> 172.21.15.114:0/1389503654 conn(0x7fe8d40660b0 msgr2=0x7fe8d4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:15.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.120+0000 7fe8d9200640 1 -- 172.21.15.114:0/1389503654 shutdown_connections 2024-09-13T17:52:15.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.120+0000 7fe8d9200640 1 -- 172.21.15.114:0/1389503654 wait complete. 2024-09-13T17:52:15.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.120+0000 7fe8d9200640 1 Processor -- start 2024-09-13T17:52:15.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.120+0000 7fe8d9200640 1 -- start start 2024-09-13T17:52:15.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.120+0000 7fe8d9200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8d406da90 0x7fe8d4156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.120+0000 7fe8d9200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8d413c240 0x7fe8d413d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.120+0000 7fe8d9200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8d413f420 0x7fe8d413d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.120+0000 7fe8d9200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d4138110 con 0x7fe8d413f420 2024-09-13T17:52:15.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.120+0000 7fe8d9200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d4157190 con 0x7fe8d406da90 2024-09-13T17:52:15.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.120+0000 7fe8d9200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d413a330 con 0x7fe8d413c240 2024-09-13T17:52:15.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.120+0000 7fe8d2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8d413f420 0x7fe8d413d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.120+0000 7fe8d2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8d413f420 0x7fe8d413d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50036/0 (socket says 172.21.15.114:50036) 2024-09-13T17:52:15.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.120+0000 7fe8d2800640 1 -- 172.21.15.114:0/548156005 learned_addr learned my addr 172.21.15.114:0/548156005 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:15.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.124+0000 7fe8d1e00640 1 --2- 172.21.15.114:0/548156005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8d406da90 0x7fe8d4156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.124+0000 7fe8d2800640 1 -- 172.21.15.114:0/548156005 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8d413c240 msgr2=0x7fe8d413d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.124+0000 7fe8d2800640 1 --2- 172.21.15.114:0/548156005 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8d413c240 0x7fe8d413d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.124+0000 7fe8d2800640 1 -- 172.21.15.114:0/548156005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8d406da90 msgr2=0x7fe8d4156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.124+0000 7fe8d2800640 1 --2- 172.21.15.114:0/548156005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8d406da90 0x7fe8d4156c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.124+0000 7fe8d2800640 1 -- 172.21.15.114:0/548156005 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c000b770 con 0x7fe8d413f420 2024-09-13T17:52:15.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.124+0000 7fe8d2800640 1 --2- 172.21.15.114:0/548156005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8d413f420 0x7fe8d413d780 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc00e930 tx=0x7fe8cc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.124+0000 7fe8ca000640 1 -- 172.21.15.114:0/548156005 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc0096b0 con 0x7fe8d413f420 2024-09-13T17:52:15.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.124+0000 7fe8ca000640 1 -- 172.21.15.114:0/548156005 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8cc00c9a0 con 0x7fe8d413f420 2024-09-13T17:52:15.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.124+0000 7fe8d9200640 1 -- 172.21.15.114:0/548156005 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d413ddb0 con 0x7fe8d413f420 2024-09-13T17:52:15.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.124+0000 7fe8ca000640 1 -- 172.21.15.114:0/548156005 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc00cd30 con 0x7fe8d413f420 2024-09-13T17:52:15.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.124+0000 7fe8d9200640 1 -- 172.21.15.114:0/548156005 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d4137ac0 con 0x7fe8d413f420 2024-09-13T17:52:15.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.124+0000 7fe8d9200640 1 -- 172.21.15.114:0/548156005 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d413f830 con 0x7fe8d413f420 2024-09-13T17:52:15.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.124+0000 7fe8ca000640 1 -- 172.21.15.114:0/548156005 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe8cc013470 con 0x7fe8d413f420 2024-09-13T17:52:15.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.124+0000 7fe8ca000640 1 --2- 172.21.15.114:0/548156005 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe8b4066690 0x7fe8b4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.124+0000 7fe8ca000640 1 -- 172.21.15.114:0/548156005 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe8cc084b30 con 0x7fe8d413f420 2024-09-13T17:52:15.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.124+0000 7fe8d1e00640 1 --2- 172.21.15.114:0/548156005 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe8b4066690 0x7fe8b4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.128+0000 7fe8d1e00640 1 --2- 172.21.15.114:0/548156005 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe8b4066690 0x7fe8b4068b50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe8c40012f0 tx=0x7fe8c4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.128+0000 7fe8ca000640 1 -- 172.21.15.114:0/548156005 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe8cc051bd0 con 0x7fe8d413f420 2024-09-13T17:52:15.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.284+0000 7fe8d9200640 1 -- 172.21.15.114:0/548156005 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8d4159790 con 0x7fe8d413f420 2024-09-13T17:52:15.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.284+0000 7fe8ca000640 1 -- 172.21.15.114:0/548156005 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18394 (secure 0 0 0) 0x7fe8cc017090 con 0x7fe8d413f420 2024-09-13T17:52:15.287 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:15.288 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:51:54.213439+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:51:48.278220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:51:48.773888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:51:51.856300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:52:15.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.288+0000 7fe8d9200640 1 -- 172.21.15.114:0/548156005 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe8b4066690 msgr2=0x7fe8b4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.288+0000 7fe8d9200640 1 --2- 172.21.15.114:0/548156005 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe8b4066690 0x7fe8b4068b50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe8c40012f0 tx=0x7fe8c4009040 comp rx=0 tx=0).stop 2024-09-13T17:52:15.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.288+0000 7fe8d9200640 1 -- 172.21.15.114:0/548156005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8d413f420 msgr2=0x7fe8d413d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.288+0000 7fe8d9200640 1 --2- 172.21.15.114:0/548156005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8d413f420 0x7fe8d413d780 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc00e930 tx=0x7fe8cc00edf0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.288+0000 7fe8d9200640 1 -- 172.21.15.114:0/548156005 shutdown_connections 2024-09-13T17:52:15.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.288+0000 7fe8d9200640 1 --2- 172.21.15.114:0/548156005 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe8b4066690 0x7fe8b4068b50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.288+0000 7fe8d9200640 1 --2- 172.21.15.114:0/548156005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8d413f420 0x7fe8d413d780 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.288+0000 7fe8d9200640 1 --2- 172.21.15.114:0/548156005 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe8d413c240 0x7fe8d413d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.288+0000 7fe8d9200640 1 --2- 172.21.15.114:0/548156005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8d406da90 0x7fe8d4156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.288+0000 7fe8d9200640 1 -- 172.21.15.114:0/548156005 >> 172.21.15.114:0/548156005 conn(0x7fe8d40660b0 msgr2=0x7fe8d4158020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:15.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.288+0000 7fe8d9200640 1 -- 172.21.15.114:0/548156005 shutdown_connections 2024-09-13T17:52:15.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.288+0000 7fe8d9200640 1 -- 172.21.15.114:0/548156005 wait complete. 2024-09-13T17:52:15.309 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T17:52:15.309 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:52:15.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.440+0000 7f6268400640 1 Processor -- start 2024-09-13T17:52:15.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.440+0000 7f6268400640 1 -- start start 2024-09-13T17:52:15.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.440+0000 7f6268400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6260151420 0x7f62600cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.440+0000 7f6268400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6260070b30 0x7f626006c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.440+0000 7f6268400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6260151800 con 0x7f62600ccba0 2024-09-13T17:52:15.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.440+0000 7f6268400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62600cbc30 con 0x7f6260070b30 2024-09-13T17:52:15.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.440+0000 7f6268400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62600cafb0 con 0x7f6260151420 2024-09-13T17:52:15.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.440+0000 7f6265a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6260151420 0x7f62600cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.440+0000 7f6265a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6260151420 0x7f62600cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:46950/0 (socket says 172.21.15.114:46950) 2024-09-13T17:52:15.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.440+0000 7f6266400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6260070b30 0x7f626006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.444+0000 7f6265a00640 1 -- 172.21.15.114:0/753392693 learned_addr learned my addr 172.21.15.114:0/753392693 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:15.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.444+0000 7f6265a00640 1 -- 172.21.15.114:0/753392693 >> v2:172.21.15.134:3300/0 conn(0x7f6260070b30 msgr2=0x7f626006c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:15.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.444+0000 7f6265a00640 1 --2- 172.21.15.114:0/753392693 >> v2:172.21.15.134:3300/0 conn(0x7f6260070b30 0x7f626006c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.444+0000 7f6265a00640 1 -- 172.21.15.114:0/753392693 >> v1:172.21.15.134:6789/0 conn(0x7f62600ccba0 legacy=0x7f6260070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.444+0000 7f6265a00640 1 -- 172.21.15.114:0/753392693 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62600cb290 con 0x7f6260151420 2024-09-13T17:52:15.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.444+0000 7f6265a00640 1 --2- 172.21.15.114:0/753392693 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6260151420 0x7f62600cc660 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6254009870 tx=0x7f625401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acb74deeb9e050cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.444+0000 7f625fe00640 1 -- 172.21.15.114:0/753392693 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62540ab610 con 0x7f6260151420 2024-09-13T17:52:15.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.444+0000 7f625fe00640 1 -- 172.21.15.114:0/753392693 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62540ab770 con 0x7f6260151420 2024-09-13T17:52:15.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.444+0000 7f625fe00640 1 -- 172.21.15.114:0/753392693 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62540abb00 con 0x7f6260151420 2024-09-13T17:52:15.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.448+0000 7f6268400640 1 -- 172.21.15.114:0/753392693 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6260151420 msgr2=0x7f62600cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.448+0000 7f6268400640 1 --2- 172.21.15.114:0/753392693 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6260151420 0x7f62600cc660 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6254009870 tx=0x7f625401c410 comp rx=0 tx=0).stop 2024-09-13T17:52:15.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.448+0000 7f6268400640 1 -- 172.21.15.114:0/753392693 shutdown_connections 2024-09-13T17:52:15.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.448+0000 7f6268400640 1 --2- 172.21.15.114:0/753392693 >> v2:172.21.15.134:3300/0 conn(0x7f6260070b30 0x7f626006c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.448+0000 7f6268400640 1 --2- 172.21.15.114:0/753392693 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6260151420 0x7f62600cc660 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.448+0000 7f6268400640 1 -- 172.21.15.114:0/753392693 >> 172.21.15.114:0/753392693 conn(0x7f62600660b0 msgr2=0x7f6260069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:15.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.448+0000 7f6268400640 1 -- 172.21.15.114:0/753392693 shutdown_connections 2024-09-13T17:52:15.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.448+0000 7f6268400640 1 -- 172.21.15.114:0/753392693 wait complete. 2024-09-13T17:52:15.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.448+0000 7f6268400640 1 Processor -- start 2024-09-13T17:52:15.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.448+0000 7f6268400640 1 -- start start 2024-09-13T17:52:15.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.448+0000 7f6268400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6260070b30 0x7f626014e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.448+0000 7f6268400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62600ccba0 0x7f62600af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.448+0000 7f6268400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6260151420 0x7f626014b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.448+0000 7f6268400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626014ed70 con 0x7f62600ccba0 2024-09-13T17:52:15.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.448+0000 7f6268400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626014f050 con 0x7f6260070b30 2024-09-13T17:52:15.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.448+0000 7f6268400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626014f330 con 0x7f6260151420 2024-09-13T17:52:15.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.448+0000 7f6265000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62600ccba0 0x7f62600af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.448+0000 7f6265000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62600ccba0 0x7f62600af290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50046/0 (socket says 172.21.15.114:50046) 2024-09-13T17:52:15.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.448+0000 7f6265000640 1 -- 172.21.15.114:0/2195669131 learned_addr learned my addr 172.21.15.114:0/2195669131 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:15.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.448+0000 7f6265a00640 1 --2- 172.21.15.114:0/2195669131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6260070b30 0x7f626014e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.448+0000 7f6266400640 1 --2- 172.21.15.114:0/2195669131 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6260151420 0x7f626014b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.448+0000 7f6265000640 1 -- 172.21.15.114:0/2195669131 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6260151420 msgr2=0x7f626014b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.448+0000 7f6265000640 1 --2- 172.21.15.114:0/2195669131 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6260151420 0x7f626014b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.448+0000 7f6265000640 1 -- 172.21.15.114:0/2195669131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6260070b30 msgr2=0x7f626014e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.448+0000 7f6265000640 1 --2- 172.21.15.114:0/2195669131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6260070b30 0x7f626014e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.448+0000 7f6265000640 1 -- 172.21.15.114:0/2195669131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62540094d0 con 0x7f62600ccba0 2024-09-13T17:52:15.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.452+0000 7f6265000640 1 --2- 172.21.15.114:0/2195669131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62600ccba0 0x7f62600af290 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f624c00c430 tx=0x7f624c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.452+0000 7f625d600640 1 -- 172.21.15.114:0/2195669131 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c0052d0 con 0x7f62600ccba0 2024-09-13T17:52:15.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.452+0000 7f625d600640 1 -- 172.21.15.114:0/2195669131 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624c005430 con 0x7f62600ccba0 2024-09-13T17:52:15.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.452+0000 7f625d600640 1 -- 172.21.15.114:0/2195669131 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c003860 con 0x7f62600ccba0 2024-09-13T17:52:15.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.452+0000 7f6268400640 1 -- 172.21.15.114:0/2195669131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626014f610 con 0x7f62600ccba0 2024-09-13T17:52:15.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.452+0000 7f6268400640 1 -- 172.21.15.114:0/2195669131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626014e940 con 0x7f62600ccba0 2024-09-13T17:52:15.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.452+0000 7f6268400640 1 -- 172.21.15.114:0/2195669131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f626006c540 con 0x7f62600ccba0 2024-09-13T17:52:15.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.452+0000 7f625d600640 1 -- 172.21.15.114:0/2195669131 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f624c0039c0 con 0x7f62600ccba0 2024-09-13T17:52:15.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.452+0000 7f625d600640 1 --2- 172.21.15.114:0/2195669131 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6240066690 0x7f6240068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.452+0000 7f625d600640 1 -- 172.21.15.114:0/2195669131 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f624c0838a0 con 0x7f62600ccba0 2024-09-13T17:52:15.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.452+0000 7f6265a00640 1 --2- 172.21.15.114:0/2195669131 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6240066690 0x7f6240068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.456+0000 7f6265a00640 1 --2- 172.21.15.114:0/2195669131 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6240066690 0x7f6240068b50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f62540af000 tx=0x7f62540b6040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.456+0000 7f625d600640 1 -- 172.21.15.114:0/2195669131 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f624c050a60 con 0x7f62600ccba0 2024-09-13T17:52:15.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.612+0000 7f6268400640 1 -- 172.21.15.114:0/2195669131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f626014fac0 con 0x7f62600ccba0 2024-09-13T17:52:15.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.612+0000 7f625d600640 1 -- 172.21.15.114:0/2195669131 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18394 (secure 0 0 0) 0x7f624c054080 con 0x7f62600ccba0 2024-09-13T17:52:15.616 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:15.617 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:51:54.213439+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:51:48.278220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:51:48.773888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:51:51.856300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:52:15.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.616+0000 7f6268400640 1 -- 172.21.15.114:0/2195669131 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6240066690 msgr2=0x7f6240068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.616+0000 7f6268400640 1 --2- 172.21.15.114:0/2195669131 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6240066690 0x7f6240068b50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f62540af000 tx=0x7f62540b6040 comp rx=0 tx=0).stop 2024-09-13T17:52:15.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.616+0000 7f6268400640 1 -- 172.21.15.114:0/2195669131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62600ccba0 msgr2=0x7f62600af290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.616+0000 7f6268400640 1 --2- 172.21.15.114:0/2195669131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62600ccba0 0x7f62600af290 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f624c00c430 tx=0x7f624c00c8f0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.616+0000 7f6268400640 1 -- 172.21.15.114:0/2195669131 shutdown_connections 2024-09-13T17:52:15.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.616+0000 7f6268400640 1 --2- 172.21.15.114:0/2195669131 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6240066690 0x7f6240068b50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.616+0000 7f6268400640 1 --2- 172.21.15.114:0/2195669131 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6260151420 0x7f626014b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.616+0000 7f6268400640 1 --2- 172.21.15.114:0/2195669131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62600ccba0 0x7f62600af290 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.616+0000 7f6268400640 1 --2- 172.21.15.114:0/2195669131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6260070b30 0x7f626014e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.616+0000 7f6268400640 1 -- 172.21.15.114:0/2195669131 >> 172.21.15.114:0/2195669131 conn(0x7f62600660b0 msgr2=0x7f6260159ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:15.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.616+0000 7f6268400640 1 -- 172.21.15.114:0/2195669131 shutdown_connections 2024-09-13T17:52:15.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.616+0000 7f6268400640 1 -- 172.21.15.114:0/2195669131 wait complete. 2024-09-13T17:52:15.638 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T17:52:15.639 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T17:52:15.639 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T17:52:15.640 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T17:52:15.640 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-13T17:52:15.641 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-13T17:52:15.641 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-13T17:52:15.642 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-13T17:52:15.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.876+0000 7fd2cfe00640 1 Processor -- start 2024-09-13T17:52:15.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.876+0000 7fd2cfe00640 1 -- start start 2024-09-13T17:52:15.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.880+0000 7fd2cfe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd2c80b39b0 0x7fd2c80cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.880+0000 7fd2cfe00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2c80ccc20 0x7fd2c8070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.880+0000 7fd2cfe00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2c8161e90 con 0x7fd2c81608b0 2024-09-13T17:52:15.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.876+0000 7f5b40c00640 1 Processor -- start 2024-09-13T17:52:15.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.876+0000 7f5b40c00640 1 -- start start 2024-09-13T17:52:15.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.880+0000 7f5b40c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5b3c0cf690 0x7f5b3c0d0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.880+0000 7f5b40c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b3c15c820 0x7f5b3c15cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.880+0000 7f5b40c00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b3c0d24b0 con 0x7f5b3c0cdad0 2024-09-13T17:52:15.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.880+0000 7f5b40c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b3c0d30a0 con 0x7f5b3c0cf690 2024-09-13T17:52:15.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.880+0000 7f5b40c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c0b1f50 con 0x7f5b3c15c820 2024-09-13T17:52:15.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.880+0000 7fd2cfe00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c80b1c60 con 0x7fd2c80b39b0 2024-09-13T17:52:15.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.880+0000 7fd2cfe00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c81613a0 con 0x7fd2c80ccc20 2024-09-13T17:52:15.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.880+0000 7fd2cde00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2c80ccc20 0x7fd2c8070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.880+0000 7fd2cde00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2c80ccc20 0x7fd2c8070c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:46962/0 (socket says 172.21.15.114:46962) 2024-09-13T17:52:15.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.880+0000 7fd2cde00640 1 -- 172.21.15.114:0/2765429958 learned_addr learned my addr 172.21.15.114:0/2765429958 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:15.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.880+0000 7fd2cde00640 1 -- 172.21.15.114:0/2765429958 >> v2:172.21.15.114:3300/0 conn(0x7fd2c80b39b0 msgr2=0x7fd2c80cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:15.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.880+0000 7fd2cde00640 1 --2- 172.21.15.114:0/2765429958 >> v2:172.21.15.114:3300/0 conn(0x7fd2c80b39b0 0x7fd2c80cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.880+0000 7fd2cde00640 1 -- 172.21.15.114:0/2765429958 >> v1:172.21.15.114:6789/0 conn(0x7fd2c81608b0 legacy=0x7fd2c8160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:15.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.880+0000 7f780d200640 1 Processor -- start 2024-09-13T17:52:15.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.880+0000 7f5b39400640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f5b3c0cdad0 0x7f5b3c0cfa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:51172/0 (socket says 172.21.15.114:51172) 2024-09-13T17:52:15.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.880+0000 7f5b39400640 1 -- 172.21.15.114:0/1864506960 learned_addr learned my addr 172.21.15.114:0/1864506960 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:15.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.880+0000 7f5b3a800640 1 --2- 172.21.15.114:0/1864506960 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b3c15c820 0x7f5b3c15cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.880+0000 7f5b39e00640 1 --2- 172.21.15.114:0/1864506960 >> v2:172.21.15.114:3300/0 conn(0x7f5b3c0cf690 0x7f5b3c0d0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.880+0000 7f5b3a800640 1 -- 172.21.15.114:0/1864506960 >> v2:172.21.15.114:3300/0 conn(0x7f5b3c0cf690 msgr2=0x7f5b3c0d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:15.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.880+0000 7f5b3a800640 1 --2- 172.21.15.114:0/1864506960 >> v2:172.21.15.114:3300/0 conn(0x7f5b3c0cf690 0x7f5b3c0d0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.880+0000 7f5b3a800640 1 -- 172.21.15.114:0/1864506960 >> v1:172.21.15.134:6789/0 conn(0x7f5b3c0cdad0 legacy=0x7f5b3c0cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.880+0000 7f5b3a800640 1 -- 172.21.15.114:0/1864506960 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3c0d2700 con 0x7f5b3c15c820 2024-09-13T17:52:15.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.880+0000 7fd2cde00640 1 -- 172.21.15.114:0/2765429958 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c80ce440 con 0x7fd2c80ccc20 2024-09-13T17:52:15.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.880+0000 7f780d200640 1 -- start start 2024-09-13T17:52:15.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.884+0000 7f780d200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f78000e2960 0x7f7800053e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.884+0000 7f780d200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7800006da0 0x7f78000071b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.884+0000 7f780d200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7800058840 con 0x7f7800057750 2024-09-13T17:52:15.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.884+0000 7f780d200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f780003bb40 con 0x7f78000e2960 2024-09-13T17:52:15.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.884+0000 7f780d200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78000076f0 con 0x7f7800006da0 2024-09-13T17:52:15.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.884+0000 7f7807e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7800006da0 0x7f78000071b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.884+0000 7fefbc800640 1 Processor -- start 2024-09-13T17:52:15.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.884+0000 7f7807e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7800006da0 0x7f78000071b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:56340/0 (socket says 172.21.15.114:56340) 2024-09-13T17:52:15.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.884+0000 7f7806a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7800057750 0x7f780003c270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33324/0 (socket says 172.21.15.114:33324) 2024-09-13T17:52:15.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.884+0000 7f7806a00640 1 -- 172.21.15.114:0/2067128618 learned_addr learned my addr 172.21.15.114:0/2067128618 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:15.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.884+0000 7fefbc800640 1 -- start start 2024-09-13T17:52:15.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.884+0000 7f7807400640 1 --2- 172.21.15.114:0/2067128618 >> v2:172.21.15.114:3300/0 conn(0x7f78000e2960 0x7f7800053e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.888+0000 7f7807e00640 1 -- 172.21.15.114:0/2067128618 >> v2:172.21.15.114:3300/0 conn(0x7f78000e2960 msgr2=0x7f7800053e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:15.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.888+0000 7f7807e00640 1 --2- 172.21.15.114:0/2067128618 >> v2:172.21.15.114:3300/0 conn(0x7f78000e2960 0x7f7800053e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.888+0000 7f7807e00640 1 -- 172.21.15.114:0/2067128618 >> v1:172.21.15.114:6789/0 conn(0x7f7800057750 legacy=0x7f780003c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.888+0000 7fd2cde00640 1 --2- 172.21.15.114:0/2765429958 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2c80ccc20 0x7fd2c8070c90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0009e50 tx=0x7fd2c001c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36a0ce66141a96d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.888+0000 7f7807e00640 1 -- 172.21.15.114:0/2067128618 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7800057fa0 con 0x7f7800006da0 2024-09-13T17:52:15.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.888+0000 7f5b3a800640 1 --2- 172.21.15.114:0/1864506960 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b3c15c820 0x7f5b3c15cc90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009d90 tx=0x7f5b34025030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a33ca911ba0f8830 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.888+0000 7f5b38a00640 1 -- 172.21.15.114:0/1864506960 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b340b4600 con 0x7f5b3c15c820 2024-09-13T17:52:15.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.888+0000 7f5b38a00640 1 -- 172.21.15.114:0/1864506960 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b340b0050 con 0x7f5b3c15c820 2024-09-13T17:52:15.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.888+0000 7f5b38a00640 1 -- 172.21.15.114:0/1864506960 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b340b4980 con 0x7f5b3c15c820 2024-09-13T17:52:15.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.888+0000 7fd2c7e00640 1 -- 172.21.15.114:0/2765429958 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c00a56f0 con 0x7fd2c80ccc20 2024-09-13T17:52:15.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.888+0000 7fd2c7e00640 1 -- 172.21.15.114:0/2765429958 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c00a5850 con 0x7fd2c80ccc20 2024-09-13T17:52:15.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.888+0000 7fd2c7e00640 1 -- 172.21.15.114:0/2765429958 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c00a5be0 con 0x7fd2c80ccc20 2024-09-13T17:52:15.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.888+0000 7fefb9e00640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fefb4066260 0x7fefb40b1510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:51180/0 (socket says 172.21.15.114:51180) 2024-09-13T17:52:15.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.888+0000 7fefb9e00640 1 -- 172.21.15.114:0/2685610551 learned_addr learned my addr 172.21.15.114:0/2685610551 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:15.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.888+0000 7fd2cfe00640 1 -- 172.21.15.114:0/2765429958 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2c80ccc20 msgr2=0x7fd2c8070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.888+0000 7fd2cfe00640 1 --2- 172.21.15.114:0/2765429958 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2c80ccc20 0x7fd2c8070c90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0009e50 tx=0x7fd2c001c960 comp rx=0 tx=0).stop 2024-09-13T17:52:15.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.888+0000 7fefbc800640 1 --2- 172.21.15.114:0/2685610551 >> v2:172.21.15.134:3300/0 conn(0x7fefb40b3770 0x7fefb4152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.888+0000 7fd2cfe00640 1 -- 172.21.15.114:0/2765429958 shutdown_connections 2024-09-13T17:52:15.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.888+0000 7fd2cfe00640 1 --2- 172.21.15.114:0/2765429958 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2c80ccc20 0x7fd2c8070c90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.888+0000 7fd2cfe00640 1 --2- 172.21.15.114:0/2765429958 >> v2:172.21.15.114:3300/0 conn(0x7fd2c80b39b0 0x7fd2c80cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.888+0000 7fd2cfe00640 1 -- 172.21.15.114:0/2765429958 >> 172.21.15.114:0/2765429958 conn(0x7fd2c806a3b0 msgr2=0x7fd2c806a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:15.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.888+0000 7f5b40c00640 1 -- 172.21.15.114:0/1864506960 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b3c15c820 msgr2=0x7f5b3c15cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.888+0000 7fefbc800640 1 -- 172.21.15.114:0/2685610551 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb40b1d40 con 0x7fefb4159360 2024-09-13T17:52:15.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.888+0000 7fefbc800640 1 -- 172.21.15.114:0/2685610551 --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb40b2020 con 0x7fefb4066260 2024-09-13T17:52:15.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.888+0000 7f5b40c00640 1 --2- 172.21.15.114:0/1864506960 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b3c15c820 0x7f5b3c15cc90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009d90 tx=0x7f5b34025030 comp rx=0 tx=0).stop 2024-09-13T17:52:15.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.888+0000 7fefb9400640 1 --2- 172.21.15.114:0/2685610551 >> v2:172.21.15.134:3300/0 conn(0x7fefb40b3770 0x7fefb4152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.888+0000 7fefbc800640 1 -- 172.21.15.114:0/2685610551 --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb4158f40 con 0x7fefb40b3770 2024-09-13T17:52:15.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7f5b40c00640 1 -- 172.21.15.114:0/1864506960 shutdown_connections 2024-09-13T17:52:15.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fd2cfe00640 1 -- 172.21.15.114:0/2765429958 shutdown_connections 2024-09-13T17:52:15.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7f5b40c00640 1 --2- 172.21.15.114:0/1864506960 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b3c15c820 0x7f5b3c15cc90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7f5b40c00640 1 --2- 172.21.15.114:0/1864506960 >> v2:172.21.15.114:3300/0 conn(0x7f5b3c0cf690 0x7f5b3c0d0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7f5b40c00640 1 -- 172.21.15.114:0/1864506960 >> 172.21.15.114:0/1864506960 conn(0x7f5b3c066080 msgr2=0x7f5b3c066490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:15.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7f5b40c00640 1 -- 172.21.15.114:0/1864506960 shutdown_connections 2024-09-13T17:52:15.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7f5b40c00640 1 -- 172.21.15.114:0/1864506960 wait complete. 2024-09-13T17:52:15.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fd2cfe00640 1 -- 172.21.15.114:0/2765429958 wait complete. 2024-09-13T17:52:15.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fd2cfe00640 1 Processor -- start 2024-09-13T17:52:15.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7f7807e00640 1 --2- 172.21.15.114:0/2067128618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7800006da0 0x7f78000071b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f78000e6540 tx=0x7f77fc01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7a14c957ed46372 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7f7806000640 1 -- 172.21.15.114:0/2067128618 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0ab650 con 0x7f7800006da0 2024-09-13T17:52:15.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.888+0000 7f9d81200640 1 Processor -- start 2024-09-13T17:52:15.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7f9d81200640 1 -- start start 2024-09-13T17:52:15.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fe187800640 1 Processor -- start 2024-09-13T17:52:15.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fe187800640 1 -- start start 2024-09-13T17:52:15.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fe187800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe1801594c0 0x7fe1800ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fe187800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1800cf650 con 0x7fe1800b3130 2024-09-13T17:52:15.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fe187800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe18006ab30 con 0x7fe18006e420 2024-09-13T17:52:15.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fe187800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe18006a940 con 0x7fe1801594c0 2024-09-13T17:52:15.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fefb8a00640 1 -- 172.21.15.114:0/2685610551 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566960500 0 0) 0x7fefb40b2020 con 0x7fefb4066260 2024-09-13T17:52:15.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fefb8a00640 1 -- 172.21.15.114:0/2685610551 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef9c005740 con 0x7fefb4066260 2024-09-13T17:52:15.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fefb8a00640 1 -- 172.21.15.114:0/2685610551 <== mon.1 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3136176210 0 0) 0x7fef9c005740 con 0x7fefb4066260 2024-09-13T17:52:15.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fefb8a00640 1 -- 172.21.15.114:0/2685610551 >> v2:172.21.15.134:3300/0 conn(0x7fefb40b3770 msgr2=0x7fefb4152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:15.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fefb8a00640 1 --2- 172.21.15.114:0/2685610551 >> v2:172.21.15.134:3300/0 conn(0x7fefb40b3770 0x7fefb4152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fefb8a00640 1 -- 172.21.15.114:0/2685610551 >> v1:172.21.15.114:6789/0 conn(0x7fefb4159360 legacy=0x7fefb4070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:15.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fefb8a00640 1 -- 172.21.15.114:0/2685610551 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb40b2300 con 0x7fefb4066260 2024-09-13T17:52:15.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fefb8a00640 1 -- 172.21.15.114:0/2685610551 <== mon.1 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7fefa4001660 con 0x7fefb4066260 2024-09-13T17:52:15.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fefb9400640 1 --2- 172.21.15.114:0/2685610551 >> v2:172.21.15.134:3300/0 conn(0x7fefb40b3770 0x7fefb4152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:52:15.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fefb8a00640 1 -- 172.21.15.114:0/2685610551 >> v1:172.21.15.134:6789/0 conn(0x7fefb4066260 legacy=0x7fefb40b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fefb8a00640 1 --2- 172.21.15.114:0/2685610551 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef9c005b90 0x7fef9c005f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fefb8a00640 1 --2- 172.21.15.114:0/2685610551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef9c0064b0 0x7fef9c0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fefb8a00640 1 --2- 172.21.15.114:0/2685610551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef9c007120 0x7fef9c00ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fefb8a00640 1 -- 172.21.15.114:0/2685610551 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb4158f40 con 0x7fef9c005b90 2024-09-13T17:52:15.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fefb9400640 1 --2- 172.21.15.114:0/2685610551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef9c0064b0 0x7fef9c0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fefb8a00640 1 -- 172.21.15.114:0/2685610551 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c0104e0 con 0x7fef9c0064b0 2024-09-13T17:52:15.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fefb8a00640 1 -- 172.21.15.114:0/2685610551 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c010650 con 0x7fef9c007120 2024-09-13T17:52:15.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fefba800640 1 --2- 172.21.15.114:0/2685610551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef9c007120 0x7fef9c00ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7f7806000640 1 -- 172.21.15.114:0/2067128618 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc0ab7b0 con 0x7f7800006da0 2024-09-13T17:52:15.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7f7806000640 1 -- 172.21.15.114:0/2067128618 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0abb40 con 0x7f7800006da0 2024-09-13T17:52:15.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fd2cfe00640 1 -- start start 2024-09-13T17:52:15.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fefb9400640 1 -- 172.21.15.114:0/2685610551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef9c007120 msgr2=0x7fef9c00ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:15.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7f9d81200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9d7c069f80 0x7f9d7c06d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fe185800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe1800b3130 0x7fe18006d400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33338/0 (socket says 172.21.15.114:33338) 2024-09-13T17:52:15.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fe185800640 1 -- 172.21.15.114:0/724566740 learned_addr learned my addr 172.21.15.114:0/724566740 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:15.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7f5b40c00640 1 Processor -- start 2024-09-13T17:52:15.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fefb9400640 1 --2- 172.21.15.114:0/2685610551 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fef9c007120 0x7fef9c00ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fefb9400640 1 -- 172.21.15.114:0/2685610551 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef9c005b90 msgr2=0x7fef9c005f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:15.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fefb9400640 1 --2- 172.21.15.114:0/2685610551 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef9c005b90 0x7fef9c005f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7fefb9400640 1 -- 172.21.15.114:0/2685610551 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c005740 con 0x7fef9c0064b0 2024-09-13T17:52:15.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7f9d81200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d7c0ae960 0x7f9d7c1647e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7f9d81200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7c0ce5e0 con 0x7f9d7c098f50 2024-09-13T17:52:15.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7f9d81200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d7c0ce860 con 0x7f9d7c069f80 2024-09-13T17:52:15.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7f9d81200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c0cf3c0 con 0x7f9d7c0ae960 2024-09-13T17:52:15.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7f9d79400640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f9d7c098f50 0x7f9d7c06a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:51196/0 (socket says 172.21.15.114:51196) 2024-09-13T17:52:15.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.892+0000 7f9d79400640 1 -- 172.21.15.114:0/3416721168 learned_addr learned my addr 172.21.15.114:0/3416721168 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:15.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f9d79e00640 1 --2- 172.21.15.114:0/3416721168 >> v2:172.21.15.134:3300/0 conn(0x7f9d7c069f80 0x7f9d7c06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7fefba800640 1 -- 172.21.15.114:0/2685610551 reap_dead start 2024-09-13T17:52:15.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f780d200640 1 -- 172.21.15.114:0/2067128618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7800006da0 msgr2=0x7f78000071b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f780d200640 1 --2- 172.21.15.114:0/2067128618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7800006da0 0x7f78000071b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f78000e6540 tx=0x7f77fc01c450 comp rx=0 tx=0).stop 2024-09-13T17:52:15.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7fe184e00640 1 --2- 172.21.15.114:0/724566740 >> v2:172.21.15.114:3300/0 conn(0x7fe1801594c0 0x7fe1800ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7fe17f400640 1 -- 172.21.15.114:0/724566740 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1832908916 0 0) 0x7fe1800cf650 con 0x7fe1800b3130 2024-09-13T17:52:15.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7fe17f400640 1 -- 172.21.15.114:0/724566740 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe168005740 con 0x7fe1800b3130 2024-09-13T17:52:15.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f9d7a800640 1 --2- 172.21.15.114:0/3416721168 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d7c0ae960 0x7f9d7c1647e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f780d200640 1 -- 172.21.15.114:0/2067128618 shutdown_connections 2024-09-13T17:52:15.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f5b40c00640 1 -- start start 2024-09-13T17:52:15.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f780d200640 1 --2- 172.21.15.114:0/2067128618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7800006da0 0x7f78000071b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f780d200640 1 --2- 172.21.15.114:0/2067128618 >> v2:172.21.15.114:3300/0 conn(0x7f78000e2960 0x7f7800053e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f780d200640 1 -- 172.21.15.114:0/2067128618 >> 172.21.15.114:0/2067128618 conn(0x7f780003a500 msgr2=0x7f780003a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:15.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f780d200640 1 -- 172.21.15.114:0/2067128618 shutdown_connections 2024-09-13T17:52:15.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f780d200640 1 -- 172.21.15.114:0/2067128618 wait complete. 2024-09-13T17:52:15.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f9d78a00640 1 -- 172.21.15.114:0/3416721168 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 538220695 0 0) 0x7f9d7c0ce5e0 con 0x7f9d7c098f50 2024-09-13T17:52:15.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f9d78a00640 1 -- 172.21.15.114:0/3416721168 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d60003530 con 0x7f9d7c098f50 2024-09-13T17:52:15.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7fe184e00640 1 -- 172.21.15.114:0/724566740 >> v1:172.21.15.134:6789/0 conn(0x7fe18006e420 legacy=0x7fe18006ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7fe184e00640 1 -- 172.21.15.114:0/724566740 >> v1:172.21.15.114:6789/0 conn(0x7fe1800b3130 legacy=0x7fe18006d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f1e47400640 1 Processor -- start 2024-09-13T17:52:15.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f1e47400640 1 -- start start 2024-09-13T17:52:15.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7fd2cfe00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2c80b39b0 0x7fd2c815cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7fd2cfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2c80ccc20 0x7fd2c8155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7fd2cfe00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2c81608b0 0x7fd2c8156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7fe184e00640 1 -- 172.21.15.114:0/724566740 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1801598a0 con 0x7fe1801594c0 2024-09-13T17:52:15.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f5b40c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b3c0cdad0 0x7f5b3c159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f5b40c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b3c0cf690 0x7f5b3c06dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f5b40c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b3c15c820 0x7f5b3c15a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f5b40c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c06fa00 con 0x7f5b3c15c820 2024-09-13T17:52:15.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7fd2cca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2c80ccc20 0x7fd2c8155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7fd2cca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2c80ccc20 0x7fd2c8155e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50102/0 (socket says 172.21.15.114:50102) 2024-09-13T17:52:15.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7fd2cca00640 1 -- 172.21.15.114:0/2910105221 learned_addr learned my addr 172.21.15.114:0/2910105221 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:15.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7fd2cfe00640 1 -- 172.21.15.114:0/2910105221 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c815e2b0 con 0x7fd2c80ccc20 2024-09-13T17:52:15.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fd2cfe00640 1 -- 172.21.15.114:0/2910105221 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c815d730 con 0x7fd2c81608b0 2024-09-13T17:52:15.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fd2cfe00640 1 -- 172.21.15.114:0/2910105221 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c815da10 con 0x7fd2c80b39b0 2024-09-13T17:52:15.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fd2cd400640 1 --2- 172.21.15.114:0/2910105221 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2c80b39b0 0x7fd2c815cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fd2cde00640 1 --2- 172.21.15.114:0/2910105221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2c81608b0 0x7fd2c8156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7f780d200640 1 Processor -- start 2024-09-13T17:52:15.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f1e47400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e400d0100 0x7f1e400cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f1e47400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1e400b0cd0 0x7f1e4013fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7f1e44a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e400d0100 0x7f1e400cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7f1e44a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e400d0100 0x7f1e400cf1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:47010/0 (socket says 172.21.15.114:47010) 2024-09-13T17:52:15.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f9d7a800640 1 -- 172.21.15.114:0/3416721168 >> v2:172.21.15.134:3300/0 conn(0x7f9d7c069f80 msgr2=0x7f9d7c06d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:15.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f9d7a800640 1 --2- 172.21.15.114:0/3416721168 >> v2:172.21.15.134:3300/0 conn(0x7f9d7c069f80 0x7f9d7c06d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f9d7a800640 1 -- 172.21.15.114:0/3416721168 >> v1:172.21.15.134:6789/0 conn(0x7f9d7c098f50 legacy=0x7f9d7c06a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f9d7a800640 1 -- 172.21.15.114:0/3416721168 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c0ceb20 con 0x7f9d7c0ae960 2024-09-13T17:52:15.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7f780d200640 1 -- start start 2024-09-13T17:52:15.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fefb9400640 1 --2- 172.21.15.114:0/2685610551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef9c0064b0 0x7fef9c0069e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fefa800aba0 tx=0x7fefa801c6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d16700863d11b72 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f5b40c00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c14b410 con 0x7f5b3c0cdad0 2024-09-13T17:52:15.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f5b40c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c06edf0 con 0x7f5b3c0cf690 2024-09-13T17:52:15.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f5b3a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b3c15c820 0x7f5b3c15a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f5b3a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b3c15c820 0x7f5b3c15a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50100/0 (socket says 172.21.15.114:50100) 2024-09-13T17:52:15.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f5b3a800640 1 -- 172.21.15.114:0/3849115258 learned_addr learned my addr 172.21.15.114:0/3849115258 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:15.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f5b3a800640 1 -- 172.21.15.114:0/3849115258 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b3c0cf690 msgr2=0x7f5b3c06dcb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:52:15.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f5b3a800640 1 --2- 172.21.15.114:0/3849115258 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5b3c0cf690 0x7f5b3c06dcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f5b3a800640 1 -- 172.21.15.114:0/3849115258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b3c0cdad0 msgr2=0x7f5b3c159420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:52:15.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f5b3a800640 1 --2- 172.21.15.114:0/3849115258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b3c0cdad0 0x7f5b3c159420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f5b3a800640 1 -- 172.21.15.114:0/3849115258 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b34009a70 con 0x7f5b3c15c820 2024-09-13T17:52:15.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f5b3a800640 1 --2- 172.21.15.114:0/3849115258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b3c15c820 0x7f5b3c15a450 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5b340b7040 tx=0x7f5b34021dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f5b32000640 1 -- 172.21.15.114:0/3849115258 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b340be820 con 0x7f5b3c15c820 2024-09-13T17:52:15.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7f1e3fe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1e400b08b0 0x7f1e400b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33348/0 (socket says 172.21.15.114:33348) 2024-09-13T17:52:15.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fefb8a00640 1 -- 172.21.15.114:0/2685610551 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa80a8660 con 0x7fef9c0064b0 2024-09-13T17:52:15.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7f1e44a00640 1 -- 172.21.15.114:0/3136736777 learned_addr learned my addr 172.21.15.114:0/3136736777 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:15.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f5b32000640 1 -- 172.21.15.114:0/3849115258 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b340be980 con 0x7f5b3c15c820 2024-09-13T17:52:15.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f5b32000640 1 -- 172.21.15.114:0/3849115258 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b340bed30 con 0x7f5b3c15c820 2024-09-13T17:52:15.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.896+0000 7f5b40c00640 1 -- 172.21.15.114:0/3849115258 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3c06f0d0 con 0x7f5b3c15c820 2024-09-13T17:52:15.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7f5b40c00640 1 -- 172.21.15.114:0/3849115258 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3c06f690 con 0x7f5b3c15c820 2024-09-13T17:52:15.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7f1e47400640 1 -- 172.21.15.114:0/3136736777 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e4015b7e0 con 0x7f1e400b08b0 2024-09-13T17:52:15.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fefb8a00640 1 -- 172.21.15.114:0/2685610551 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa80a87c0 con 0x7fef9c0064b0 2024-09-13T17:52:15.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7f1e47400640 1 -- 172.21.15.114:0/3136736777 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e4015a9e0 con 0x7f1e400b0cd0 2024-09-13T17:52:15.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7f1e47400640 1 -- 172.21.15.114:0/3136736777 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4015abd0 con 0x7f1e400d0100 2024-09-13T17:52:15.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7f34af000640 1 Processor -- start 2024-09-13T17:52:15.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fefb8a00640 1 -- 172.21.15.114:0/2685610551 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa80a8660 con 0x7fef9c0064b0 2024-09-13T17:52:15.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7f5b40c00640 1 -- 172.21.15.114:0/3849115258 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5b3c0d2cc0 con 0x7f5b3c15c820 2024-09-13T17:52:15.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fd2cde00640 1 -- 172.21.15.114:0/2910105221 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2c80b39b0 msgr2=0x7fd2c815cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fd2cde00640 1 --2- 172.21.15.114:0/2910105221 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2c80b39b0 0x7fd2c815cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fd2cde00640 1 -- 172.21.15.114:0/2910105221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2c80ccc20 msgr2=0x7fd2c8155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fd2cde00640 1 --2- 172.21.15.114:0/2910105221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2c80ccc20 0x7fd2c8155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fd2cde00640 1 -- 172.21.15.114:0/2910105221 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c0009b30 con 0x7fd2c81608b0 2024-09-13T17:52:15.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fd2cde00640 1 --2- 172.21.15.114:0/2910105221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2c81608b0 0x7fd2c8156340 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd2c00ab000 tx=0x7fd2c0019700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fd2cd400640 1 --2- 172.21.15.114:0/2910105221 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd2c80b39b0 0x7fd2c815cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:52:15.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fe184e00640 1 --2- 172.21.15.114:0/724566740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1801594c0 0x7fe1800ccad0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe1740097f0 tx=0x7fe17401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e61317c646b53e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fefbc800640 1 -- 172.21.15.114:0/2685610551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef9c0064b0 msgr2=0x7fef9c0069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fefbc800640 1 --2- 172.21.15.114:0/2685610551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef9c0064b0 0x7fef9c0069e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fefa800aba0 tx=0x7fefa801c6f0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fefbc800640 1 -- 172.21.15.114:0/2685610551 shutdown_connections 2024-09-13T17:52:15.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fefbc800640 1 --2- 172.21.15.114:0/2685610551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef9c0064b0 0x7fef9c0069e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fefbc800640 1 -- 172.21.15.114:0/2685610551 >> 172.21.15.114:0/2685610551 conn(0x7fefb4065e50 msgr2=0x7fefb4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:15.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7f1e44a00640 1 -- 172.21.15.114:0/3136736777 >> v2:172.21.15.114:3300/0 conn(0x7f1e400b0cd0 msgr2=0x7f1e4013fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:15.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7f1e45400640 1 --2- 172.21.15.114:0/3136736777 >> v2:172.21.15.114:3300/0 conn(0x7f1e400b0cd0 0x7f1e4013fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7f1e44a00640 1 --2- 172.21.15.114:0/3136736777 >> v2:172.21.15.114:3300/0 conn(0x7f1e400b0cd0 0x7f1e4013fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7f1e44a00640 1 -- 172.21.15.114:0/3136736777 >> v1:172.21.15.114:6789/0 conn(0x7f1e400b08b0 legacy=0x7f1e400b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7f1e44a00640 1 -- 172.21.15.114:0/3136736777 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e4015aeb0 con 0x7f1e400d0100 2024-09-13T17:52:15.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7f5b32000640 1 -- 172.21.15.114:0/3849115258 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5b340bb050 con 0x7f5b3c15c820 2024-09-13T17:52:15.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fe17f400640 1 -- 172.21.15.114:0/724566740 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1740ab600 con 0x7fe1801594c0 2024-09-13T17:52:15.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7f1e45400640 1 --2- 172.21.15.114:0/3136736777 >> v2:172.21.15.114:3300/0 conn(0x7f1e400b0cd0 0x7f1e4013fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:52:15.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7f34af000640 1 -- start start 2024-09-13T17:52:15.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fd2c5600640 1 -- 172.21.15.114:0/2910105221 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c00b8470 con 0x7fd2c81608b0 2024-09-13T17:52:15.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fd2c5600640 1 -- 172.21.15.114:0/2910105221 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c00b85d0 con 0x7fd2c81608b0 2024-09-13T17:52:15.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fd2cfe00640 1 -- 172.21.15.114:0/2910105221 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c815dcf0 con 0x7fd2c81608b0 2024-09-13T17:52:15.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7f34af000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f34a8152be0 0x7f34a80b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7f34af000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f34a8070420 0x7f34a8070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7f34af000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a8152fc0 con 0x7f34a80b3770 2024-09-13T17:52:15.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7f34af000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a8158f40 con 0x7f34a8070420 2024-09-13T17:52:15.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7f34af000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a8070dd0 con 0x7f34a8152be0 2024-09-13T17:52:15.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fd2c5600640 1 -- 172.21.15.114:0/2910105221 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c00b8940 con 0x7fd2c81608b0 2024-09-13T17:52:15.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fd2cfe00640 1 -- 172.21.15.114:0/2910105221 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c8156d90 con 0x7fd2c81608b0 2024-09-13T17:52:15.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fe17f400640 1 -- 172.21.15.114:0/724566740 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1740a7050 con 0x7fe1801594c0 2024-09-13T17:52:15.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fe17f400640 1 -- 172.21.15.114:0/724566740 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1740ab980 con 0x7fe1801594c0 2024-09-13T17:52:15.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7fefbc800640 1 -- 172.21.15.114:0/2685610551 shutdown_connections 2024-09-13T17:52:15.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f5b32000640 1 --2- 172.21.15.114:0/3849115258 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5b1c0666e0 0x7f5b1c068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f5b32000640 1 -- 172.21.15.114:0/3849115258 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5b34128a40 con 0x7f5b3c15c820 2024-09-13T17:52:15.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f5b32000640 1 --2- 172.21.15.114:0/3849115258 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x7f5b1c06fd20 0x7f5b1c072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f5b32000640 1 -- 172.21.15.114:0/3849115258 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5b1c072830 con 0x7f5b1c06fd20 2024-09-13T17:52:15.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f5b32000640 1 -- 172.21.15.114:0/3849115258 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b34128ee0 con 0x7f5b3c15c820 2024-09-13T17:52:15.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7f780d200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7800006da0 0x7f780004de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7f7807400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7800006da0 0x7f780004de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.900+0000 7f7807400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7800006da0 0x7f780004de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:47018/0 (socket says 172.21.15.114:47018) 2024-09-13T17:52:15.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f780d200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7800057750 0x7f780004e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f780d200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78000e2960 0x7f78000dc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f780d200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780004fae0 con 0x7f78000e2960 2024-09-13T17:52:15.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f780d200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78000cfb50 con 0x7f7800057750 2024-09-13T17:52:15.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f780d200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78000cfe30 con 0x7f7800006da0 2024-09-13T17:52:15.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f9d7a800640 1 --2- 172.21.15.114:0/3416721168 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d7c0ae960 0x7f9d7c1647e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9d74009d90 tx=0x7f9d7401c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a731fa76e7a00417 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7fe187800640 1 -- 172.21.15.114:0/724566740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1801594c0 msgr2=0x7fe1800ccad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7fe187800640 1 --2- 172.21.15.114:0/724566740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1801594c0 0x7fe1800ccad0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe1740097f0 tx=0x7fe17401c450 comp rx=0 tx=0).stop 2024-09-13T17:52:15.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7fe187800640 1 -- 172.21.15.114:0/724566740 shutdown_connections 2024-09-13T17:52:15.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7fe187800640 1 --2- 172.21.15.114:0/724566740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1801594c0 0x7fe1800ccad0 secure :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe1740097f0 tx=0x7fe17401c450 comp rx=0 tx=0).stop 2024-09-13T17:52:15.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7fe187800640 1 -- 172.21.15.114:0/724566740 >> 172.21.15.114:0/724566740 conn(0x7fe1800b11d0 msgr2=0x7fe1800cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:15.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7fefbc800640 1 -- 172.21.15.114:0/2685610551 wait complete. 2024-09-13T17:52:15.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f34a7400640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f34a80b3770 0x7f34a8159360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:51200/0 (socket says 172.21.15.114:51200) 2024-09-13T17:52:15.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f34a7400640 1 -- 172.21.15.114:0/3845877867 learned_addr learned my addr 172.21.15.114:0/3845877867 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:15.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f34a7e00640 1 --2- 172.21.15.114:0/3845877867 >> v2:172.21.15.134:3300/0 conn(0x7f34a8152be0 0x7f34a80b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7fd2cfe00640 1 -- 172.21.15.114:0/2910105221 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd2c80cc6e0 con 0x7fd2c81608b0 2024-09-13T17:52:15.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f5b39400640 1 --2- 172.21.15.114:0/3849115258 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x7f5b1c06fd20 0x7f5b1c072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f5b39e00640 1 --2- 172.21.15.114:0/3849115258 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5b1c0666e0 0x7f5b1c068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f7806a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7800057750 0x7f780004e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f7806a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7800057750 0x7f780004e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:56380/0 (socket says 172.21.15.114:56380) 2024-09-13T17:52:15.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f7806a00640 1 -- 172.21.15.114:0/2481734755 learned_addr learned my addr 172.21.15.114:0/2481734755 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:15.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7fe187800640 1 -- 172.21.15.114:0/724566740 shutdown_connections 2024-09-13T17:52:15.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f34a7e00640 1 -- 172.21.15.114:0/3845877867 >> v2:172.21.15.114:3300/0 conn(0x7f34a8070420 msgr2=0x7f34a8070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:15.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f34a7e00640 1 --2- 172.21.15.114:0/3845877867 >> v2:172.21.15.114:3300/0 conn(0x7f34a8070420 0x7f34a8070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f34a7e00640 1 -- 172.21.15.114:0/3845877867 >> v1:172.21.15.134:6789/0 conn(0x7f34a80b3770 legacy=0x7f34a8159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f34a7e00640 1 -- 172.21.15.114:0/3845877867 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a80b1d40 con 0x7f34a8152be0 2024-09-13T17:52:15.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f7806a00640 1 -- 172.21.15.114:0/2481734755 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7800006da0 msgr2=0x7f780004de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f7806a00640 1 --2- 172.21.15.114:0/2481734755 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7800006da0 0x7f780004de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f7806a00640 1 -- 172.21.15.114:0/2481734755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78000e2960 msgr2=0x7f78000dc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f7806a00640 1 --2- 172.21.15.114:0/2481734755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78000e2960 0x7f78000dc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f7806a00640 1 -- 172.21.15.114:0/2481734755 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc009420 con 0x7f7800057750 2024-09-13T17:52:15.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f9d78a00640 1 -- 172.21.15.114:0/3416721168 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d740a5a30 con 0x7f9d7c0ae960 2024-09-13T17:52:15.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f9d78a00640 1 -- 172.21.15.114:0/3416721168 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d740a5b90 con 0x7f9d7c0ae960 2024-09-13T17:52:15.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f9d78a00640 1 -- 172.21.15.114:0/3416721168 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d740ad440 con 0x7f9d7c0ae960 2024-09-13T17:52:15.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7fd2c5600640 1 -- 172.21.15.114:0/2910105221 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd2c00b8aa0 con 0x7fd2c81608b0 2024-09-13T17:52:15.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7fe187800640 1 -- 172.21.15.114:0/724566740 wait complete. 2024-09-13T17:52:15.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f7806a00640 1 --2- 172.21.15.114:0/2481734755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7800057750 0x7f780004e600 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f77f400c500 tx=0x7f77f400c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f5b39e00640 1 --2- 172.21.15.114:0/3849115258 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5b1c0666e0 0x7f5b1c068ba0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c009870 tx=0x7f5b2c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f5b39400640 1 --2- 172.21.15.114:0/3849115258 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x7f5b1c06fd20 0x7f5b1c072160 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f77fb400640 1 -- 172.21.15.114:0/2481734755 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f4005cf0 con 0x7f7800057750 2024-09-13T17:52:15.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fd2c5600640 1 --2- 172.21.15.114:0/2910105221 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd2a8066690 0x7fd2a8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fd2c5600640 1 -- 172.21.15.114:0/2910105221 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd2c011fd50 con 0x7fd2c81608b0 2024-09-13T17:52:15.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f780d200640 1 -- 172.21.15.114:0/2481734755 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78000d0110 con 0x7f7800057750 2024-09-13T17:52:15.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f780d200640 1 -- 172.21.15.114:0/2481734755 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780004e3a0 con 0x7f7800057750 2024-09-13T17:52:15.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fefbc800640 1 Processor -- start 2024-09-13T17:52:15.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fefbc800640 1 -- start start 2024-09-13T17:52:15.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fd2c5600640 1 --2- 172.21.15.114:0/2910105221 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x7fd2a806fbd0 0x7fd2a8072010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fd2c5600640 1 -- 172.21.15.114:0/2910105221 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd2a80726e0 con 0x7fd2a806fbd0 2024-09-13T17:52:15.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fd2c5600640 1 -- 172.21.15.114:0/2910105221 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2c01200c0 con 0x7fd2c81608b0 2024-09-13T17:52:15.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fd2cd400640 1 --2- 172.21.15.114:0/2910105221 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd2a8066690 0x7fd2a8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.904+0000 7f77fb400640 1 -- 172.21.15.114:0/2481734755 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f4005e50 con 0x7f7800057750 2024-09-13T17:52:15.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7f77fb400640 1 -- 172.21.15.114:0/2481734755 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f4005cf0 con 0x7f7800057750 2024-09-13T17:52:15.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7f77f8c00640 1 -- 172.21.15.114:0/2481734755 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7800057b60 con 0x7f7800057750 2024-09-13T17:52:15.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fd2cca00640 1 --2- 172.21.15.114:0/2910105221 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x7fd2a806fbd0 0x7fd2a8072010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7f34a7e00640 1 --2- 172.21.15.114:0/3845877867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a8152be0 0x7f34a80b1510 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f34a000aea0 tx=0x7f34a001d8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73793fd8ecba3e6b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fe187800640 1 Processor -- start 2024-09-13T17:52:15.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7f9d81200640 1 -- 172.21.15.114:0/3416721168 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d7c0ae960 msgr2=0x7f9d7c1647e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7f9d81200640 1 --2- 172.21.15.114:0/3416721168 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d7c0ae960 0x7f9d7c1647e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9d74009d90 tx=0x7f9d7401c9b0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7f9d81200640 1 -- 172.21.15.114:0/3416721168 shutdown_connections 2024-09-13T17:52:15.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7f9d81200640 1 --2- 172.21.15.114:0/3416721168 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d7c0ae960 0x7f9d7c1647e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7f9d81200640 1 --2- 172.21.15.114:0/3416721168 >> v2:172.21.15.134:3300/0 conn(0x7f9d7c069f80 0x7f9d7c06d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7f9d81200640 1 -- 172.21.15.114:0/3416721168 >> 172.21.15.114:0/3416721168 conn(0x7f9d7c098a70 msgr2=0x7f9d7c0b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:15.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fe187800640 1 -- start start 2024-09-13T17:52:15.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7f5b32000640 1 -- 172.21.15.114:0/3849115258 <== osd.0 v2:172.21.15.114:6808/4163905135 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f5b1c072830 con 0x7f5b1c06fd20 2024-09-13T17:52:15.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7f9d81200640 1 -- 172.21.15.114:0/3416721168 shutdown_connections 2024-09-13T17:52:15.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fefbc800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef9c0064b0 0x7fefb413eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fefbc800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefb4140360 0x7fefb4164350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fefbc800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fefb4164890 0x7fefb4142060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fefbc800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb413f0b0 con 0x7fef9c0064b0 2024-09-13T17:52:15.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fefbc800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb4164d10 con 0x7fefb4140360 2024-09-13T17:52:15.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fefbc800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb413fed0 con 0x7fefb4164890 2024-09-13T17:52:15.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7f34a6a00640 1 -- 172.21.15.114:0/3845877867 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a000a2d0 con 0x7f34a8152be0 2024-09-13T17:52:15.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7f34a6a00640 1 -- 172.21.15.114:0/3845877867 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a00a6780 con 0x7f34a8152be0 2024-09-13T17:52:15.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7f34a6a00640 1 -- 172.21.15.114:0/3845877867 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a00a6b10 con 0x7f34a8152be0 2024-09-13T17:52:15.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fd2cd400640 1 --2- 172.21.15.114:0/2910105221 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd2a8066690 0x7fd2a8068b50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00a850 tx=0x7fd2bc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fefba800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fefb4164890 0x7fefb4142060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fefba800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fefb4164890 0x7fefb4142060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:47020/0 (socket says 172.21.15.114:47020) 2024-09-13T17:52:15.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fefba800640 1 -- 172.21.15.114:0/788292223 learned_addr learned my addr 172.21.15.114:0/788292223 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:15.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7f1e44a00640 1 --2- 172.21.15.114:0/3136736777 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e400d0100 0x7f1e400cf1d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009e50 tx=0x7f1e3801ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bcd3385aaafebe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7f77fb400640 1 -- 172.21.15.114:0/2481734755 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f77f40070f0 con 0x7f7800057750 2024-09-13T17:52:15.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fefb9400640 1 --2- 172.21.15.114:0/788292223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefb4140360 0x7fefb4164350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fefb9e00640 1 --2- 172.21.15.114:0/788292223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef9c0064b0 0x7fefb413eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7f34af000640 1 -- 172.21.15.114:0/3845877867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a8152be0 msgr2=0x7f34a80b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7f34af000640 1 --2- 172.21.15.114:0/3845877867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a8152be0 0x7f34a80b1510 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f34a000aea0 tx=0x7f34a001d8c0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fe187800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe18006e420 0x7fe18014d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fe187800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1800b3130 0x7fe18009c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7f1e3f400640 1 -- 172.21.15.114:0/3136736777 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e380a57f0 con 0x7f1e400d0100 2024-09-13T17:52:15.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fefba800640 1 -- 172.21.15.114:0/788292223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefb4140360 msgr2=0x7fefb4164350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fefba800640 1 --2- 172.21.15.114:0/788292223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefb4140360 0x7fefb4164350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fefba800640 1 -- 172.21.15.114:0/788292223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef9c0064b0 msgr2=0x7fefb413eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fefba800640 1 --2- 172.21.15.114:0/788292223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef9c0064b0 0x7fefb413eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fefba800640 1 -- 172.21.15.114:0/788292223 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb413e8b0 con 0x7fefb4164890 2024-09-13T17:52:15.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fe187800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe180150340 0x7fe18009c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fe187800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1800cb130 con 0x7fe1800b3130 2024-09-13T17:52:15.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7fe187800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18009cc50 con 0x7fe180150340 2024-09-13T17:52:15.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fe187800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe180157e40 con 0x7fe18006e420 2024-09-13T17:52:15.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fd2cca00640 1 --2- 172.21.15.114:0/2910105221 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x7fd2a806fbd0 0x7fd2a8072010 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f77fb400640 1 --2- 172.21.15.114:0/2481734755 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f77e80666f0 0x7f77e8068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f77fb400640 1 -- 172.21.15.114:0/2481734755 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f77f40841e0 con 0x7f7800057750 2024-09-13T17:52:15.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fe184e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe18006e420 0x7fe18014d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fe17fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1800b3130 0x7fe18009c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fe184e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe18006e420 0x7fe18014d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:47032/0 (socket says 172.21.15.114:47032) 2024-09-13T17:52:15.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fe184e00640 1 -- 172.21.15.114:0/2687529109 learned_addr learned my addr 172.21.15.114:0/2687529109 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:15.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fe185800640 1 --2- 172.21.15.114:0/2687529109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe180150340 0x7fe18009c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f77fb400640 1 --2- 172.21.15.114:0/2481734755 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x7f77e806fcb0 0x7f77e80720f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f77fb400640 1 -- 172.21.15.114:0/2481734755 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f77e80727c0 con 0x7f77e806fcb0 2024-09-13T17:52:15.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f77fb400640 1 -- 172.21.15.114:0/2481734755 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77f4084550 con 0x7f7800057750 2024-09-13T17:52:15.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f1e3f400640 1 -- 172.21.15.114:0/3136736777 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e380a5950 con 0x7f1e400d0100 2024-09-13T17:52:15.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.908+0000 7f9d81200640 1 -- 172.21.15.114:0/3416721168 wait complete. 2024-09-13T17:52:15.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f1e3f400640 1 -- 172.21.15.114:0/3136736777 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e380a57f0 con 0x7f1e400d0100 2024-09-13T17:52:15.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fe17fe00640 1 -- 172.21.15.114:0/2687529109 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe18006e420 msgr2=0x7fe18014d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fe17fe00640 1 --2- 172.21.15.114:0/2687529109 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe18006e420 0x7fe18014d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fe17fe00640 1 -- 172.21.15.114:0/2687529109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe180150340 msgr2=0x7fe18009c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fe17fe00640 1 --2- 172.21.15.114:0/2687529109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe180150340 0x7fe18009c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fe17fe00640 1 -- 172.21.15.114:0/2687529109 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe174009420 con 0x7fe1800b3130 2024-09-13T17:52:15.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f9d81200640 1 Processor -- start 2024-09-13T17:52:15.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f7807e00640 1 --2- 172.21.15.114:0/2481734755 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x7f77e806fcb0 0x7f77e80720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fe17fe00640 1 --2- 172.21.15.114:0/2687529109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1800b3130 0x7fe18009c1d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe16c000f70 tx=0x7fe16c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f34af000640 1 -- 172.21.15.114:0/3845877867 shutdown_connections 2024-09-13T17:52:15.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f34af000640 1 --2- 172.21.15.114:0/3845877867 >> v2:172.21.15.114:3300/0 conn(0x7f34a8070420 0x7f34a8070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f34af000640 1 --2- 172.21.15.114:0/3845877867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a8152be0 0x7f34a80b1510 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f34af000640 1 -- 172.21.15.114:0/3845877867 >> 172.21.15.114:0/3845877867 conn(0x7f34a8065e50 msgr2=0x7f34a8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:15.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fefba800640 1 --2- 172.21.15.114:0/788292223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fefb4164890 0x7fefb4142060 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fefb40cab40 tx=0x7fefb000fc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f1e47400640 1 -- 172.21.15.114:0/3136736777 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e400d0100 msgr2=0x7f1e400cf1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f1e47400640 1 --2- 172.21.15.114:0/3136736777 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e400d0100 0x7f1e400cf1d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009e50 tx=0x7f1e3801ca30 comp rx=0 tx=0).stop 2024-09-13T17:52:15.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f1e47400640 1 -- 172.21.15.114:0/3136736777 shutdown_connections 2024-09-13T17:52:15.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f1e47400640 1 --2- 172.21.15.114:0/3136736777 >> v2:172.21.15.114:3300/0 conn(0x7f1e400b0cd0 0x7f1e4013fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f1e47400640 1 --2- 172.21.15.114:0/3136736777 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e400d0100 0x7f1e400cf1d0 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009e50 tx=0x7f1e3801ca30 comp rx=0 tx=0).stop 2024-09-13T17:52:15.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f1e47400640 1 -- 172.21.15.114:0/3136736777 >> 172.21.15.114:0/3136736777 conn(0x7f1e40071a20 msgr2=0x7f1e40098a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:15.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f7807400640 1 --2- 172.21.15.114:0/2481734755 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f77e80666f0 0x7f77e8068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fe17cc00640 1 -- 172.21.15.114:0/2687529109 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c0052d0 con 0x7fe1800b3130 2024-09-13T17:52:15.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fefae000640 1 -- 172.21.15.114:0/788292223 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb000fe50 con 0x7fefb4164890 2024-09-13T17:52:15.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fefae000640 1 -- 172.21.15.114:0/788292223 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb0003b90 con 0x7fefb4164890 2024-09-13T17:52:15.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fefae000640 1 -- 172.21.15.114:0/788292223 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb00050d0 con 0x7fefb4164890 2024-09-13T17:52:15.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f34af000640 1 -- 172.21.15.114:0/3845877867 shutdown_connections 2024-09-13T17:52:15.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f34af000640 1 -- 172.21.15.114:0/3845877867 wait complete. 2024-09-13T17:52:15.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fd2c5600640 1 -- 172.21.15.114:0/2910105221 <== osd.1 v2:172.21.15.114:6816/2809354915 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd2a80726e0 con 0x7fd2a806fbd0 2024-09-13T17:52:15.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f1e47400640 1 -- 172.21.15.114:0/3136736777 shutdown_connections 2024-09-13T17:52:15.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f1e47400640 1 -- 172.21.15.114:0/3136736777 wait complete. 2024-09-13T17:52:15.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fefbc800640 1 -- 172.21.15.114:0/788292223 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb413f2c0 con 0x7fefb4164890 2024-09-13T17:52:15.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fefbc800640 1 -- 172.21.15.114:0/788292223 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb413f880 con 0x7fefb4164890 2024-09-13T17:52:15.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fe187800640 1 -- 172.21.15.114:0/2687529109 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1801580e0 con 0x7fe1800b3130 2024-09-13T17:52:15.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fe187800640 1 -- 172.21.15.114:0/2687529109 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1801586a0 con 0x7fe1800b3130 2024-09-13T17:52:15.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fe17cc00640 1 -- 172.21.15.114:0/2687529109 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16c005430 con 0x7fe1800b3130 2024-09-13T17:52:15.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fe17cc00640 1 -- 172.21.15.114:0/2687529109 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c003840 con 0x7fe1800b3130 2024-09-13T17:52:15.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f7807400640 1 --2- 172.21.15.114:0/2481734755 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f77e80666f0 0x7f77e8068bb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f780804f070 tx=0x7f7808061ae0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f9d81200640 1 -- start start 2024-09-13T17:52:15.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f9d81200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d7c069f80 0x7f9d7c1fbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f9d81200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d7c098f50 0x7f9d7c202750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7f9d79e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d7c069f80 0x7f9d7c1fbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fefbc800640 1 -- 172.21.15.114:0/788292223 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fef90000fd0 con 0x7fefb4164890 2024-09-13T17:52:15.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f9d79e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d7c069f80 0x7f9d7c1fbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50174/0 (socket says 172.21.15.114:50174) 2024-09-13T17:52:15.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.912+0000 7fe187800640 1 -- 172.21.15.114:0/2687529109 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe1800ad8b0 con 0x7fe1800b3130 2024-09-13T17:52:15.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f7807e00640 1 --2- 172.21.15.114:0/2481734755 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x7f77e806fcb0 0x7f77e80720f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f34af000640 1 Processor -- start 2024-09-13T17:52:15.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7fefae000640 1 -- 172.21.15.114:0/788292223 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fefb0005230 con 0x7fefb4164890 2024-09-13T17:52:15.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f34af000640 1 -- start start 2024-09-13T17:52:15.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f1e47400640 1 Processor -- start 2024-09-13T17:52:15.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f77fb400640 1 -- 172.21.15.114:0/2481734755 <== osd.2 v2:172.21.15.114:6800/1009667871 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f77e80727c0 con 0x7f77e806fcb0 2024-09-13T17:52:15.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f9d81200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d7c0ae960 0x7f9d7c15f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f9d81200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c1542d0 con 0x7f9d7c069f80 2024-09-13T17:52:15.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f9d81200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c15c060 con 0x7f9d7c0ae960 2024-09-13T17:52:15.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f9d81200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c202c90 con 0x7f9d7c098f50 2024-09-13T17:52:15.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f9d79e00640 1 -- 172.21.15.114:0/2329457999 learned_addr learned my addr 172.21.15.114:0/2329457999 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:15.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f34af000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a8070420 0x7f34a8151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f34af000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34a80b3770 0x7f34a8153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f34af000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34a8152be0 0x7f34a8156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f34af000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a8154430 con 0x7f34a8152be0 2024-09-13T17:52:15.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f34af000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a8154710 con 0x7f34a8070420 2024-09-13T17:52:15.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f34af000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a81549f0 con 0x7f34a80b3770 2024-09-13T17:52:15.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f9d79400640 1 --2- 172.21.15.114:0/2329457999 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d7c098f50 0x7f9d7c202750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f9d7a800640 1 --2- 172.21.15.114:0/2329457999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d7c0ae960 0x7f9d7c15f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7fe17cc00640 1 -- 172.21.15.114:0/2687529109 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe16c0039a0 con 0x7fe1800b3130 2024-09-13T17:52:15.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7fefae000640 1 --2- 172.21.15.114:0/788292223 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fef98066760 0x7fef98068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f9d79400640 1 -- 172.21.15.114:0/2329457999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d7c0ae960 msgr2=0x7f9d7c15f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f9d79400640 1 --2- 172.21.15.114:0/2329457999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d7c0ae960 0x7f9d7c15f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f9d79400640 1 -- 172.21.15.114:0/2329457999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d7c069f80 msgr2=0x7f9d7c1fbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f9d79400640 1 --2- 172.21.15.114:0/2329457999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d7c069f80 0x7f9d7c1fbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f9d79400640 1 -- 172.21.15.114:0/2329457999 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d74009a70 con 0x7f9d7c098f50 2024-09-13T17:52:15.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7fefae000640 1 -- 172.21.15.114:0/788292223 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fefb0084d30 con 0x7fefb4164890 2024-09-13T17:52:15.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7fefae000640 1 --2- 172.21.15.114:0/788292223 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x7fef9806fda0 0x7fef980721e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7fefae000640 1 -- 172.21.15.114:0/788292223 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef980728b0 con 0x7fef9806fda0 2024-09-13T17:52:15.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7fefae000640 1 -- 172.21.15.114:0/788292223 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefb00850e0 con 0x7fefb4164890 2024-09-13T17:52:15.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f9d79400640 1 --2- 172.21.15.114:0/2329457999 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d7c098f50 0x7f9d7c202750 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c0716a0 tx=0x7f9d68001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f34a7e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a8070420 0x7f34a8151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f34a7e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a8070420 0x7f34a8151e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:56428/0 (socket says 172.21.15.114:56428) 2024-09-13T17:52:15.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f34a7e00640 1 -- 172.21.15.114:0/1706950707 learned_addr learned my addr 172.21.15.114:0/1706950707 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:15.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f34a7400640 1 --2- 172.21.15.114:0/1706950707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34a80b3770 0x7f34a8153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f34ad000640 1 --2- 172.21.15.114:0/1706950707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34a8152be0 0x7f34a8156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.916+0000 7f1e47400640 1 -- start start 2024-09-13T17:52:15.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7fefb9400640 1 --2- 172.21.15.114:0/788292223 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x7fef9806fda0 0x7fef980721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f34a7e00640 1 -- 172.21.15.114:0/1706950707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34a80b3770 msgr2=0x7f34a8153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f9d72000640 1 -- 172.21.15.114:0/2329457999 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d68005cf0 con 0x7f9d7c098f50 2024-09-13T17:52:15.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f9d72000640 1 -- 172.21.15.114:0/2329457999 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d68005e50 con 0x7f9d7c098f50 2024-09-13T17:52:15.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f9d72000640 1 -- 172.21.15.114:0/2329457999 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d680072f0 con 0x7f9d7c098f50 2024-09-13T17:52:15.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f9d81200640 1 -- 172.21.15.114:0/2329457999 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d7c154a00 con 0x7f9d7c098f50 2024-09-13T17:52:15.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7fefb9e00640 1 --2- 172.21.15.114:0/788292223 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fef98066760 0x7fef98068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f9d81200640 1 -- 172.21.15.114:0/2329457999 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7c154fc0 con 0x7f9d7c098f50 2024-09-13T17:52:15.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7fe17cc00640 1 --2- 172.21.15.114:0/2687529109 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe160066690 0x7fe160068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7fe17cc00640 1 -- 172.21.15.114:0/2687529109 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe16c084040 con 0x7fe1800b3130 2024-09-13T17:52:15.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f34a7e00640 1 --2- 172.21.15.114:0/1706950707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34a80b3770 0x7f34a8153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f34a7e00640 1 -- 172.21.15.114:0/1706950707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34a8152be0 msgr2=0x7f34a8156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f34a7e00640 1 --2- 172.21.15.114:0/1706950707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34a8152be0 0x7f34a8156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f34a7e00640 1 -- 172.21.15.114:0/1706950707 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a000ab80 con 0x7f34a8070420 2024-09-13T17:52:15.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f34ad000640 1 --2- 172.21.15.114:0/1706950707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34a8152be0 0x7f34a8156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:52:15.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f34a7400640 1 --2- 172.21.15.114:0/1706950707 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34a80b3770 0x7f34a8153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:52:15.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f1e47400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e400b08b0 0x7f1e40140c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f1e47400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e400b0cd0 0x7f1e401f4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7fe184e00640 1 --2- 172.21.15.114:0/2687529109 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe160066690 0x7fe160068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7fe17cc00640 1 --2- 172.21.15.114:0/2687529109 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x7fe16006fcd0 0x7fe160072110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7fe17cc00640 1 -- 172.21.15.114:0/2687529109 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe1600727e0 con 0x7fe16006fcd0 2024-09-13T17:52:15.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7fefb9400640 1 --2- 172.21.15.114:0/788292223 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x7fef9806fda0 0x7fef980721e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f34a7e00640 1 --2- 172.21.15.114:0/1706950707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a8070420 0x7f34a8151e00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f34a00b0040 tx=0x7f34a001a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f1e44a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e400b08b0 0x7f1e40140c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f1e44a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e400b08b0 0x7f1e40140c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:56442/0 (socket says 172.21.15.114:56442) 2024-09-13T17:52:15.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f1e47400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e4013ccf0 0x7f1e4013c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f1e47400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e40152cf0 con 0x7f1e400b0cd0 2024-09-13T17:52:15.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f1e44a00640 1 -- 172.21.15.114:0/1671246197 learned_addr learned my addr 172.21.15.114:0/1671246197 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:15.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f1e47400640 1 -- 172.21.15.114:0/1671246197 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4013ca30 con 0x7f1e400b08b0 2024-09-13T17:52:15.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f1e47400640 1 -- 172.21.15.114:0/1671246197 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e401437b0 con 0x7f1e4013ccf0 2024-09-13T17:52:15.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7fe17cc00640 1 -- 172.21.15.114:0/2687529109 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe16c0843f0 con 0x7fe1800b3130 2024-09-13T17:52:15.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f1e45400640 1 --2- 172.21.15.114:0/1671246197 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e4013ccf0 0x7f1e4013c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f1e3fe00640 1 --2- 172.21.15.114:0/1671246197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e400b0cd0 0x7f1e401f4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7fe184e00640 1 --2- 172.21.15.114:0/2687529109 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe160066690 0x7fe160068b50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe17401c490 tx=0x7fe174008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f349fe00640 1 -- 172.21.15.114:0/1706950707 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a00bc070 con 0x7f34a8070420 2024-09-13T17:52:15.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7fefb9e00640 1 --2- 172.21.15.114:0/788292223 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fef98066760 0x7fef98068c20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fefa4001e70 tx=0x7fefa4001660 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7fefae000640 1 -- 172.21.15.114:0/788292223 <== osd.5 v2:172.21.15.134:6800/3340754489 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fef980728b0 con 0x7fef9806fda0 2024-09-13T17:52:15.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f1e44a00640 1 -- 172.21.15.114:0/1671246197 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e4013ccf0 msgr2=0x7f1e4013c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f1e44a00640 1 --2- 172.21.15.114:0/1671246197 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1e4013ccf0 0x7f1e4013c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f1e44a00640 1 -- 172.21.15.114:0/1671246197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e400b0cd0 msgr2=0x7f1e401f4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f1e44a00640 1 --2- 172.21.15.114:0/1671246197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e400b0cd0 0x7f1e401f4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f1e44a00640 1 -- 172.21.15.114:0/1671246197 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e38009b30 con 0x7f1e400b08b0 2024-09-13T17:52:15.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f349fe00640 1 -- 172.21.15.114:0/1706950707 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a00b7690 con 0x7f34a8070420 2024-09-13T17:52:15.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f349fe00640 1 -- 172.21.15.114:0/1706950707 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a00b7a60 con 0x7f34a8070420 2024-09-13T17:52:15.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f34af000640 1 -- 172.21.15.114:0/1706950707 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a8154cd0 con 0x7f34a8070420 2024-09-13T17:52:15.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f34af000640 1 -- 172.21.15.114:0/1706950707 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a81554d0 con 0x7f34a8070420 2024-09-13T17:52:15.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f1e44a00640 1 --2- 172.21.15.114:0/1671246197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e400b08b0 0x7f1e40140c30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1e38019640 tx=0x7f1e380197d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7fe185800640 1 --2- 172.21.15.114:0/2687529109 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x7fe16006fcd0 0x7fe160072110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.924+0000 7f1e3cc00640 1 -- 172.21.15.114:0/1671246197 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e380bd070 con 0x7f1e400b08b0 2024-09-13T17:52:15.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.924+0000 7f1e47400640 1 -- 172.21.15.114:0/1671246197 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e40143a90 con 0x7f1e400b08b0 2024-09-13T17:52:15.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.924+0000 7f1e47400640 1 -- 172.21.15.114:0/1671246197 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e401548d0 con 0x7f1e400b08b0 2024-09-13T17:52:15.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.924+0000 7f1e3cc00640 1 -- 172.21.15.114:0/1671246197 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e38009250 con 0x7f1e400b08b0 2024-09-13T17:52:15.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.924+0000 7f1e3cc00640 1 -- 172.21.15.114:0/1671246197 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e38003df0 con 0x7f1e400b08b0 2024-09-13T17:52:15.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.920+0000 7f9d72000640 1 -- 172.21.15.114:0/2329457999 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9d68007450 con 0x7f9d7c098f50 2024-09-13T17:52:15.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.924+0000 7f9d72000640 1 --2- 172.21.15.114:0/2329457999 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9d5c0666e0 0x7f9d5c068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.924+0000 7f1e47400640 1 -- 172.21.15.114:0/1671246197 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1e18000fd0 con 0x7f1e400b08b0 2024-09-13T17:52:15.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.924+0000 7f9d81200640 1 -- 172.21.15.114:0/2329457999 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9d54000fd0 con 0x7f9d7c098f50 2024-09-13T17:52:15.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.924+0000 7f9d72000640 1 -- 172.21.15.114:0/2329457999 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9d68054680 con 0x7f9d7c098f50 2024-09-13T17:52:15.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.924+0000 7fe185800640 1 --2- 172.21.15.114:0/2687529109 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x7fe16006fcd0 0x7fe160072110 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.924+0000 7f9d79e00640 1 --2- 172.21.15.114:0/2329457999 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9d5c0666e0 0x7f9d5c068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.924+0000 7f9d72000640 1 --2- 172.21.15.114:0/2329457999 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x7f9d5c070970 0x7f9d5c072e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.924+0000 7f9d72000640 1 -- 172.21.15.114:0/2329457999 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d5c0734e0 con 0x7f9d5c070970 2024-09-13T17:52:15.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.924+0000 7f9d72000640 1 -- 172.21.15.114:0/2329457999 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d68054450 con 0x7f9d7c098f50 2024-09-13T17:52:15.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.924+0000 7f34af000640 1 -- 172.21.15.114:0/1706950707 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3480000fd0 con 0x7f34a8070420 2024-09-13T17:52:15.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.924+0000 7f349fe00640 1 -- 172.21.15.114:0/1706950707 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f34a00b7bc0 con 0x7f34a8070420 2024-09-13T17:52:15.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.928+0000 7f9d7a800640 1 --2- 172.21.15.114:0/2329457999 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x7f9d5c070970 0x7f9d5c072e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.928+0000 7f9d79e00640 1 --2- 172.21.15.114:0/2329457999 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9d5c0666e0 0x7f9d5c068ba0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c06ead0 tx=0x7f9d6c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.928+0000 7f349fe00640 1 --2- 172.21.15.114:0/1706950707 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3488066760 0x7f3488068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.928+0000 7f349fe00640 1 -- 172.21.15.114:0/1706950707 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f34a011f240 con 0x7f34a8070420 2024-09-13T17:52:15.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.928+0000 7f349fe00640 1 --2- 172.21.15.114:0/1706950707 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x7f348806fda0 0x7f34880721e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.928+0000 7f349fe00640 1 -- 172.21.15.114:0/1706950707 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f34880728b0 con 0x7f348806fda0 2024-09-13T17:52:15.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.928+0000 7f349fe00640 1 -- 172.21.15.114:0/1706950707 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34a0121860 con 0x7f34a8070420 2024-09-13T17:52:15.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.928+0000 7f1e3cc00640 1 -- 172.21.15.114:0/1671246197 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1e38004040 con 0x7f1e400b08b0 2024-09-13T17:52:15.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.928+0000 7f1e3cc00640 1 --2- 172.21.15.114:0/1671246197 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1e20066760 0x7f1e20068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.928+0000 7fe17cc00640 1 -- 172.21.15.114:0/2687529109 <== osd.4 v2:172.21.15.134:6808/3210409298 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fe1600727e0 con 0x7fe16006fcd0 2024-09-13T17:52:15.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.928+0000 7f34ad000640 1 --2- 172.21.15.114:0/1706950707 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x7f348806fda0 0x7f34880721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.928+0000 7f34a7400640 1 --2- 172.21.15.114:0/1706950707 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3488066760 0x7f3488068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.928+0000 7f1e3cc00640 1 -- 172.21.15.114:0/1671246197 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1e3811f0f0 con 0x7f1e400b08b0 2024-09-13T17:52:15.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.928+0000 7f1e3cc00640 1 --2- 172.21.15.114:0/1671246197 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x7f1e2006fd20 0x7f1e20072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:15.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.928+0000 7f1e3cc00640 1 -- 172.21.15.114:0/1671246197 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1e20072830 con 0x7f1e2006fd20 2024-09-13T17:52:15.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.932+0000 7f1e45400640 1 --2- 172.21.15.114:0/1671246197 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x7f1e2006fd20 0x7f1e20072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.932+0000 7f9d7a800640 1 --2- 172.21.15.114:0/2329457999 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x7f9d5c070970 0x7f9d5c072e10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.932+0000 7f1e3fe00640 1 --2- 172.21.15.114:0/1671246197 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1e20066760 0x7f1e20068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:15.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.932+0000 7f1e3cc00640 1 -- 172.21.15.114:0/1671246197 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e380ec1e0 con 0x7f1e400b08b0 2024-09-13T17:52:15.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.932+0000 7f1e3fe00640 1 --2- 172.21.15.114:0/1671246197 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1e20066760 0x7f1e20068c20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1e40144040 tx=0x7f1e30007cb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.932+0000 7f34a7400640 1 --2- 172.21.15.114:0/1706950707 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3488066760 0x7f3488068c20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3494000c10 tx=0x7f34940019b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.932+0000 7f34ad000640 1 --2- 172.21.15.114:0/1706950707 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x7f348806fda0 0x7f34880721e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.932+0000 7f9d72000640 1 -- 172.21.15.114:0/2329457999 <== osd.3 v2:172.21.15.114:6824/1824187331 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f9d5c0734e0 con 0x7f9d5c070970 2024-09-13T17:52:15.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.932+0000 7f1e45400640 1 --2- 172.21.15.114:0/1671246197 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x7f1e2006fd20 0x7f1e20072160 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:15.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.932+0000 7f349fe00640 1 -- 172.21.15.114:0/1706950707 <== osd.6 v2:172.21.15.134:6824/1813072387 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f34880728b0 con 0x7f348806fda0 2024-09-13T17:52:15.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.932+0000 7f1e3cc00640 1 -- 172.21.15.114:0/1671246197 <== osd.7 v2:172.21.15.134:6816/874939117 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f1e20072830 con 0x7f1e2006fd20 2024-09-13T17:52:15.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.936+0000 7f5b40c00640 1 -- 172.21.15.114:0/3849115258 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5b3c06fb40 con 0x7f5b1c06fd20 2024-09-13T17:52:15.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.936+0000 7f5b32000640 1 -- 172.21.15.114:0/3849115258 <== osd.0 v2:172.21.15.114:6808/4163905135 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5b280078f0 con 0x7f5b1c06fd20 2024-09-13T17:52:15.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.940+0000 7f5b40c00640 1 -- 172.21.15.114:0/3849115258 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x7f5b1c06fd20 msgr2=0x7f5b1c072160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.940+0000 7f5b40c00640 1 --2- 172.21.15.114:0/3849115258 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x7f5b1c06fd20 0x7f5b1c072160 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.940+0000 7f5b40c00640 1 -- 172.21.15.114:0/3849115258 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5b1c0666e0 msgr2=0x7f5b1c068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.940+0000 7f5b40c00640 1 --2- 172.21.15.114:0/3849115258 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5b1c0666e0 0x7f5b1c068ba0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c009870 tx=0x7f5b2c008040 comp rx=0 tx=0).stop 2024-09-13T17:52:15.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.940+0000 7f5b40c00640 1 -- 172.21.15.114:0/3849115258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b3c15c820 msgr2=0x7f5b3c15a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.940+0000 7f5b40c00640 1 --2- 172.21.15.114:0/3849115258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b3c15c820 0x7f5b3c15a450 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5b340b7040 tx=0x7f5b34021dd0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.940+0000 7f5b3a800640 1 -- 172.21.15.114:0/3849115258 reap_dead start 2024-09-13T17:52:15.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.940+0000 7f5b40c00640 1 -- 172.21.15.114:0/3849115258 shutdown_connections 2024-09-13T17:52:15.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.940+0000 7f5b40c00640 1 -- 172.21.15.114:0/3849115258 >> 172.21.15.114:0/3849115258 conn(0x7f5b3c066080 msgr2=0x7f5b3c0b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:15.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.940+0000 7f5b40c00640 1 -- 172.21.15.114:0/3849115258 shutdown_connections 2024-09-13T17:52:15.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.944+0000 7f5b40c00640 1 -- 172.21.15.114:0/3849115258 wait complete. 2024-09-13T17:52:15.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.944+0000 7f77f8c00640 1 -- 172.21.15.114:0/2481734755 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f78000d0630 con 0x7f77e806fcb0 2024-09-13T17:52:15.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.944+0000 7f77fb400640 1 -- 172.21.15.114:0/2481734755 <== osd.2 v2:172.21.15.114:6800/1009667871 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f78000d0630 con 0x7f77e806fcb0 2024-09-13T17:52:15.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.944+0000 7fd2cfe00640 1 -- 172.21.15.114:0/2910105221 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd2c815b0f0 con 0x7fd2a806fbd0 2024-09-13T17:52:15.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.944+0000 7f77f8c00640 1 -- 172.21.15.114:0/2481734755 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x7f77e806fcb0 msgr2=0x7f77e80720f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.944+0000 7f77f8c00640 1 --2- 172.21.15.114:0/2481734755 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x7f77e806fcb0 0x7f77e80720f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.944+0000 7f77f8c00640 1 -- 172.21.15.114:0/2481734755 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f77e80666f0 msgr2=0x7f77e8068bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.944+0000 7f77f8c00640 1 --2- 172.21.15.114:0/2481734755 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f77e80666f0 0x7f77e8068bb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f780804f070 tx=0x7f7808061ae0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.944+0000 7f77f8c00640 1 -- 172.21.15.114:0/2481734755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7800057750 msgr2=0x7f780004e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.944+0000 7f77f8c00640 1 --2- 172.21.15.114:0/2481734755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7800057750 0x7f780004e600 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f77f400c500 tx=0x7f77f400c9c0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.944+0000 7f7807e00640 1 -- 172.21.15.114:0/2481734755 reap_dead start 2024-09-13T17:52:15.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.944+0000 7f77f8c00640 1 -- 172.21.15.114:0/2481734755 shutdown_connections 2024-09-13T17:52:15.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.944+0000 7f77f8c00640 1 -- 172.21.15.114:0/2481734755 >> 172.21.15.114:0/2481734755 conn(0x7f780003a500 msgr2=0x7f780004ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:15.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.948+0000 7f77f8c00640 1 -- 172.21.15.114:0/2481734755 shutdown_connections 2024-09-13T17:52:15.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.948+0000 7f77f8c00640 1 -- 172.21.15.114:0/2481734755 wait complete. 2024-09-13T17:52:15.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.948+0000 7fd2c5600640 1 -- 172.21.15.114:0/2910105221 <== osd.1 v2:172.21.15.114:6816/2809354915 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd2c815b0f0 con 0x7fd2a806fbd0 2024-09-13T17:52:15.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.948+0000 7fd2cfe00640 1 -- 172.21.15.114:0/2910105221 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x7fd2a806fbd0 msgr2=0x7fd2a8072010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.948+0000 7fd2cfe00640 1 --2- 172.21.15.114:0/2910105221 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x7fd2a806fbd0 0x7fd2a8072010 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.948+0000 7fd2cfe00640 1 -- 172.21.15.114:0/2910105221 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd2a8066690 msgr2=0x7fd2a8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.948+0000 7fd2cfe00640 1 --2- 172.21.15.114:0/2910105221 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd2a8066690 0x7fd2a8068b50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00a850 tx=0x7fd2bc008040 comp rx=0 tx=0).stop 2024-09-13T17:52:15.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.948+0000 7fd2cfe00640 1 -- 172.21.15.114:0/2910105221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2c81608b0 msgr2=0x7fd2c8156340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.948+0000 7fd2cfe00640 1 --2- 172.21.15.114:0/2910105221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2c81608b0 0x7fd2c8156340 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd2c00ab000 tx=0x7fd2c0019700 comp rx=0 tx=0).stop 2024-09-13T17:52:15.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.948+0000 7fd2cde00640 1 -- 172.21.15.114:0/2910105221 reap_dead start 2024-09-13T17:52:15.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.948+0000 7fd2cfe00640 1 -- 172.21.15.114:0/2910105221 shutdown_connections 2024-09-13T17:52:15.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.948+0000 7fd2cfe00640 1 -- 172.21.15.114:0/2910105221 >> 172.21.15.114:0/2910105221 conn(0x7fd2c806a3b0 msgr2=0x7fd2c80cacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:15.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.948+0000 7fd2cfe00640 1 -- 172.21.15.114:0/2910105221 shutdown_connections 2024-09-13T17:52:15.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.948+0000 7fd2cfe00640 1 -- 172.21.15.114:0/2910105221 wait complete. 2024-09-13T17:52:15.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.952+0000 7fefbc800640 1 -- 172.21.15.114:0/788292223 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fef90002cc0 con 0x7fef9806fda0 2024-09-13T17:52:15.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.956+0000 7fefae000640 1 -- 172.21.15.114:0/788292223 <== osd.5 v2:172.21.15.134:6800/3340754489 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fef90002cc0 con 0x7fef9806fda0 2024-09-13T17:52:15.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.956+0000 7fe187800640 1 -- 172.21.15.114:0/2687529109 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe1800aff60 con 0x7fe16006fcd0 2024-09-13T17:52:15.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.956+0000 7fe17cc00640 1 -- 172.21.15.114:0/2687529109 <== osd.4 v2:172.21.15.134:6808/3210409298 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe1800aff60 con 0x7fe16006fcd0 2024-09-13T17:52:15.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.956+0000 7fefa3400640 1 -- 172.21.15.114:0/788292223 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x7fef9806fda0 msgr2=0x7fef980721e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.956+0000 7fefa3400640 1 --2- 172.21.15.114:0/788292223 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x7fef9806fda0 0x7fef980721e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.956+0000 7fe187800640 1 -- 172.21.15.114:0/2687529109 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x7fe16006fcd0 msgr2=0x7fe160072110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.956+0000 7fe187800640 1 --2- 172.21.15.114:0/2687529109 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x7fe16006fcd0 0x7fe160072110 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.956+0000 7fe187800640 1 -- 172.21.15.114:0/2687529109 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe160066690 msgr2=0x7fe160068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.956+0000 7fe187800640 1 --2- 172.21.15.114:0/2687529109 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe160066690 0x7fe160068b50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe17401c490 tx=0x7fe174008040 comp rx=0 tx=0).stop 2024-09-13T17:52:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.956+0000 7fe187800640 1 -- 172.21.15.114:0/2687529109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1800b3130 msgr2=0x7fe18009c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.956+0000 7fe187800640 1 --2- 172.21.15.114:0/2687529109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1800b3130 0x7fe18009c1d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe16c000f70 tx=0x7fe16c00c890 comp rx=0 tx=0).stop 2024-09-13T17:52:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.956+0000 7fe185800640 1 -- 172.21.15.114:0/2687529109 reap_dead start 2024-09-13T17:52:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.956+0000 7fe187800640 1 -- 172.21.15.114:0/2687529109 shutdown_connections 2024-09-13T17:52:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.956+0000 7fe187800640 1 -- 172.21.15.114:0/2687529109 >> 172.21.15.114:0/2687529109 conn(0x7fe1800b11d0 msgr2=0x7fe1800af850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.956+0000 7fefa3400640 1 -- 172.21.15.114:0/788292223 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fef98066760 msgr2=0x7fef98068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.956+0000 7fefa3400640 1 --2- 172.21.15.114:0/788292223 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fef98066760 0x7fef98068c20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fefa4001e70 tx=0x7fefa4001660 comp rx=0 tx=0).stop 2024-09-13T17:52:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.956+0000 7fefa3400640 1 -- 172.21.15.114:0/788292223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fefb4164890 msgr2=0x7fefb4142060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.956+0000 7fefa3400640 1 --2- 172.21.15.114:0/788292223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fefb4164890 0x7fefb4142060 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fefb40cab40 tx=0x7fefb000fc00 comp rx=0 tx=0).stop 2024-09-13T17:52:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.960+0000 7f9d81200640 1 -- 172.21.15.114:0/2329457999 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9d54002cc0 con 0x7f9d5c070970 2024-09-13T17:52:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.956+0000 7fefba800640 1 -- 172.21.15.114:0/788292223 reap_dead start 2024-09-13T17:52:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.956+0000 7fefa3400640 1 -- 172.21.15.114:0/788292223 shutdown_connections 2024-09-13T17:52:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.956+0000 7fefa3400640 1 -- 172.21.15.114:0/788292223 >> 172.21.15.114:0/788292223 conn(0x7fefb4065e50 msgr2=0x7fefb4159e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.956+0000 7fefa3400640 1 -- 172.21.15.114:0/788292223 shutdown_connections 2024-09-13T17:52:15.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.956+0000 7fefa3400640 1 -- 172.21.15.114:0/788292223 wait complete. 2024-09-13T17:52:15.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.960+0000 7fe187800640 1 -- 172.21.15.114:0/2687529109 shutdown_connections 2024-09-13T17:52:15.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.960+0000 7fe187800640 1 -- 172.21.15.114:0/2687529109 wait complete. 2024-09-13T17:52:15.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.960+0000 7f9d72000640 1 -- 172.21.15.114:0/2329457999 <== osd.3 v2:172.21.15.114:6824/1824187331 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9d54002cc0 con 0x7f9d5c070970 2024-09-13T17:52:15.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.960+0000 7f1e47400640 1 -- 172.21.15.114:0/1671246197 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1e18002cc0 con 0x7f1e2006fd20 2024-09-13T17:52:15.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.960+0000 7f9d81200640 1 -- 172.21.15.114:0/2329457999 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x7f9d5c070970 msgr2=0x7f9d5c072e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.960+0000 7f9d81200640 1 --2- 172.21.15.114:0/2329457999 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x7f9d5c070970 0x7f9d5c072e10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.960+0000 7f9d81200640 1 -- 172.21.15.114:0/2329457999 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9d5c0666e0 msgr2=0x7f9d5c068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.960+0000 7f9d81200640 1 --2- 172.21.15.114:0/2329457999 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9d5c0666e0 0x7f9d5c068ba0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c06ead0 tx=0x7f9d6c008040 comp rx=0 tx=0).stop 2024-09-13T17:52:15.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.960+0000 7f9d81200640 1 -- 172.21.15.114:0/2329457999 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d7c098f50 msgr2=0x7f9d7c202750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.960+0000 7f9d81200640 1 --2- 172.21.15.114:0/2329457999 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9d7c098f50 0x7f9d7c202750 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c0716a0 tx=0x7f9d68001e80 comp rx=0 tx=0).stop 2024-09-13T17:52:15.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.960+0000 7f9d7a800640 1 -- 172.21.15.114:0/2329457999 reap_dead start 2024-09-13T17:52:15.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.960+0000 7f9d81200640 1 -- 172.21.15.114:0/2329457999 shutdown_connections 2024-09-13T17:52:15.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.960+0000 7f9d81200640 1 -- 172.21.15.114:0/2329457999 >> 172.21.15.114:0/2329457999 conn(0x7f9d7c098a70 msgr2=0x7f9d7c0b0750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:15.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.960+0000 7f9d81200640 1 -- 172.21.15.114:0/2329457999 shutdown_connections 2024-09-13T17:52:15.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.960+0000 7f9d81200640 1 -- 172.21.15.114:0/2329457999 wait complete. 2024-09-13T17:52:15.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.960+0000 7f1e3cc00640 1 -- 172.21.15.114:0/1671246197 <== osd.7 v2:172.21.15.134:6816/874939117 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1e18002cc0 con 0x7f1e2006fd20 2024-09-13T17:52:15.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.964+0000 7f34af000640 1 -- 172.21.15.114:0/1706950707 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3480002cc0 con 0x7f348806fda0 2024-09-13T17:52:15.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.964+0000 7f1e47400640 1 -- 172.21.15.114:0/1671246197 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x7f1e2006fd20 msgr2=0x7f1e20072160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.964+0000 7f1e47400640 1 --2- 172.21.15.114:0/1671246197 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x7f1e2006fd20 0x7f1e20072160 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.964+0000 7f1e47400640 1 -- 172.21.15.114:0/1671246197 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1e20066760 msgr2=0x7f1e20068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.964+0000 7f1e47400640 1 --2- 172.21.15.114:0/1671246197 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1e20066760 0x7f1e20068c20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1e40144040 tx=0x7f1e30007cb0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.964+0000 7f1e47400640 1 -- 172.21.15.114:0/1671246197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e400b08b0 msgr2=0x7f1e40140c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.964+0000 7f1e47400640 1 --2- 172.21.15.114:0/1671246197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e400b08b0 0x7f1e40140c30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1e38019640 tx=0x7f1e380197d0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.964+0000 7f1e45400640 1 -- 172.21.15.114:0/1671246197 reap_dead start 2024-09-13T17:52:15.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.964+0000 7f1e47400640 1 -- 172.21.15.114:0/1671246197 shutdown_connections 2024-09-13T17:52:15.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.964+0000 7f1e47400640 1 -- 172.21.15.114:0/1671246197 >> 172.21.15.114:0/1671246197 conn(0x7f1e40071a20 msgr2=0x7f1e4013d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:15.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.968+0000 7f349fe00640 1 -- 172.21.15.114:0/1706950707 <== osd.6 v2:172.21.15.134:6824/1813072387 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3480002cc0 con 0x7f348806fda0 2024-09-13T17:52:15.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.968+0000 7f1e47400640 1 -- 172.21.15.114:0/1671246197 shutdown_connections 2024-09-13T17:52:15.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.968+0000 7f1e47400640 1 -- 172.21.15.114:0/1671246197 wait complete. 2024-09-13T17:52:15.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.968+0000 7f34af000640 1 -- 172.21.15.114:0/1706950707 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x7f348806fda0 msgr2=0x7f34880721e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.968+0000 7f34af000640 1 --2- 172.21.15.114:0/1706950707 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x7f348806fda0 0x7f34880721e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.968+0000 7f34af000640 1 -- 172.21.15.114:0/1706950707 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3488066760 msgr2=0x7f3488068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.968+0000 7f34af000640 1 --2- 172.21.15.114:0/1706950707 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3488066760 0x7f3488068c20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3494000c10 tx=0x7f34940019b0 comp rx=0 tx=0).stop 2024-09-13T17:52:15.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.968+0000 7f34af000640 1 -- 172.21.15.114:0/1706950707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a8070420 msgr2=0x7f34a8151e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:15.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.968+0000 7f34af000640 1 --2- 172.21.15.114:0/1706950707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34a8070420 0x7f34a8151e00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f34a00b0040 tx=0x7f34a001a660 comp rx=0 tx=0).stop 2024-09-13T17:52:15.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.968+0000 7f34ad000640 1 -- 172.21.15.114:0/1706950707 reap_dead start 2024-09-13T17:52:15.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.968+0000 7f34af000640 1 -- 172.21.15.114:0/1706950707 shutdown_connections 2024-09-13T17:52:15.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.968+0000 7f34af000640 1 -- 172.21.15.114:0/1706950707 >> 172.21.15.114:0/1706950707 conn(0x7f34a8065e50 msgr2=0x7f34a815b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:15.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.968+0000 7f34af000640 1 -- 172.21.15.114:0/1706950707 shutdown_connections 2024-09-13T17:52:15.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:15.968+0000 7f34af000640 1 -- 172.21.15.114:0/1706950707 wait complete. 2024-09-13T17:52:15.994 INFO:teuthology.orchestra.run.smithi114.stdout:55834574859 2024-09-13T17:52:15.994 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T17:52:15.995 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2024-09-13T17:52:15.996 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T17:52:15.997 INFO:teuthology.orchestra.run.smithi114.stdout:55834574859 2024-09-13T17:52:15.997 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T17:52:16.003 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2024-09-13T17:52:16.004 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T17:52:16.006 INFO:teuthology.orchestra.run.smithi114.stdout:55834574859 2024-09-13T17:52:16.007 INFO:teuthology.orchestra.run.smithi114.stdout:55834574857 2024-09-13T17:52:16.007 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T17:52:16.008 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T17:52:16.012 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2024-09-13T17:52:16.012 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T17:52:16.017 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2024-09-13T17:52:16.017 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T17:52:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.228+0000 7f3e3f800640 1 Processor -- start 2024-09-13T17:52:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.228+0000 7f32cce00640 1 Processor -- start 2024-09-13T17:52:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.228+0000 7f32cce00640 1 -- start start 2024-09-13T17:52:16.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.228+0000 7f3e3f800640 1 -- start start 2024-09-13T17:52:16.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.228+0000 7f3e3f800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e300533b0 0x7f3e30006f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.228+0000 7f32cce00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f32c814f9d0 0x7f32c8159960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.228+0000 7f3e37e00640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f3e30036710 0x7f3e300de1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:51210/0 (socket says 172.21.15.114:51210) 2024-09-13T17:52:16.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.228+0000 7f32cce00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32c806cb00 0x7f32c8065c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.228+0000 7f32cce00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c8159ea0 con 0x7f32c80b2190 2024-09-13T17:52:16.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.228+0000 7f32cce00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c80cd050 con 0x7f32c814f9d0 2024-09-13T17:52:16.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.228+0000 7f32cce00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c80cd330 con 0x7f32c806cb00 2024-09-13T17:52:16.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.228+0000 7f32c6a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32c806cb00 0x7f32c8065c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.228+0000 7f32c6a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32c806cb00 0x7f32c8065c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:47054/0 (socket says 172.21.15.114:47054) 2024-09-13T17:52:16.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.228+0000 7f32c6a00640 1 -- 172.21.15.114:0/1805185776 learned_addr learned my addr 172.21.15.114:0/1805185776 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:16.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.232+0000 7f32c6a00640 1 -- 172.21.15.114:0/1805185776 >> v2:172.21.15.114:3300/0 conn(0x7f32c814f9d0 msgr2=0x7f32c8159960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:16.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.232+0000 7f32c6a00640 1 --2- 172.21.15.114:0/1805185776 >> v2:172.21.15.114:3300/0 conn(0x7f32c814f9d0 0x7f32c8159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.232+0000 7f32c6a00640 1 -- 172.21.15.114:0/1805185776 >> v1:172.21.15.114:6789/0 conn(0x7f32c80b2190 legacy=0x7f32c80cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:16.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.232+0000 7f32c6a00640 1 -- 172.21.15.114:0/1805185776 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c80cd610 con 0x7f32c806cb00 2024-09-13T17:52:16.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.232+0000 7f3e3ce00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3e30033840 0x7f3e30036000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33360/0 (socket says 172.21.15.114:33360) 2024-09-13T17:52:16.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.232+0000 7f3e3f800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e30055480 con 0x7f3e30033840 2024-09-13T17:52:16.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.232+0000 7f3e3f800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e30033c20 con 0x7f3e30036710 2024-09-13T17:52:16.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.232+0000 7f3e3f800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e300397f0 con 0x7f3e300533b0 2024-09-13T17:52:16.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.232+0000 7f3e37e00640 1 -- 172.21.15.114:0/3450946099 learned_addr learned my addr 172.21.15.114:0/3450946099 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:16.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.232+0000 7f3e3d800640 1 --2- 172.21.15.114:0/3450946099 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e300533b0 0x7f3e30006f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.232+0000 7f3e3d800640 1 -- 172.21.15.114:0/3450946099 >> v1:172.21.15.134:6789/0 conn(0x7f3e30036710 legacy=0x7f3e300de1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.232+0000 7f3e3d800640 1 -- 172.21.15.114:0/3450946099 >> v1:172.21.15.114:6789/0 conn(0x7f3e30033840 legacy=0x7f3e30036000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.232+0000 7f3e3d800640 1 -- 172.21.15.114:0/3450946099 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e30039ad0 con 0x7f3e300533b0 2024-09-13T17:52:16.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.236+0000 7f32c6a00640 1 --2- 172.21.15.114:0/1805185776 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32c806cb00 0x7f32c8065c80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f32b4010bb0 tx=0x7f32b4020a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50418efd3f2066b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:16.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.236+0000 7f32c6000640 1 -- 172.21.15.114:0/1805185776 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b40a98b0 con 0x7f32c806cb00 2024-09-13T17:52:16.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.236+0000 7f32c6000640 1 -- 172.21.15.114:0/1805185776 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b40a9a10 con 0x7f32c806cb00 2024-09-13T17:52:16.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.236+0000 7f32c6000640 1 -- 172.21.15.114:0/1805185776 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b40a9da0 con 0x7f32c806cb00 2024-09-13T17:52:16.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.236+0000 7f3e3d800640 1 --2- 172.21.15.114:0/3450946099 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e300533b0 0x7f3e30006f20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0087f0 tx=0x7f3e2c01e7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1abd526e1be8bc86 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:16.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.240+0000 7f32cce00640 1 -- 172.21.15.114:0/1805185776 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32c806cb00 msgr2=0x7f32c8065c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.240+0000 7f32cce00640 1 --2- 172.21.15.114:0/1805185776 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32c806cb00 0x7f32c8065c80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f32b4010bb0 tx=0x7f32b4020a10 comp rx=0 tx=0).stop 2024-09-13T17:52:16.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.240+0000 7fc594000640 1 Processor -- start 2024-09-13T17:52:16.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.240+0000 7f3e37400640 1 -- 172.21.15.114:0/3450946099 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c0a8660 con 0x7f3e300533b0 2024-09-13T17:52:16.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.240+0000 7f3e37400640 1 -- 172.21.15.114:0/3450946099 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2c0a87c0 con 0x7f3e300533b0 2024-09-13T17:52:16.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.240+0000 7f32cce00640 1 -- 172.21.15.114:0/1805185776 shutdown_connections 2024-09-13T17:52:16.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.240+0000 7f32cce00640 1 --2- 172.21.15.114:0/1805185776 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32c806cb00 0x7f32c8065c80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.240+0000 7f32cce00640 1 --2- 172.21.15.114:0/1805185776 >> v2:172.21.15.114:3300/0 conn(0x7f32c814f9d0 0x7f32c8159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.240+0000 7f32cce00640 1 -- 172.21.15.114:0/1805185776 >> 172.21.15.114:0/1805185776 conn(0x7f32c80718f0 msgr2=0x7f32c8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:16.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.240+0000 7f3e37400640 1 -- 172.21.15.114:0/3450946099 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c0a8b50 con 0x7f3e300533b0 2024-09-13T17:52:16.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.240+0000 7fc594000640 1 -- start start 2024-09-13T17:52:16.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.240+0000 7f32cce00640 1 -- 172.21.15.114:0/1805185776 shutdown_connections 2024-09-13T17:52:16.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.240+0000 7f32cce00640 1 -- 172.21.15.114:0/1805185776 wait complete. 2024-09-13T17:52:16.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.240+0000 7f3e3f800640 1 -- 172.21.15.114:0/3450946099 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e300533b0 msgr2=0x7f3e30006f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.240+0000 7f3e3f800640 1 --2- 172.21.15.114:0/3450946099 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e300533b0 0x7f3e30006f20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0087f0 tx=0x7f3e2c01e7b0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.240+0000 7f3e3f800640 1 -- 172.21.15.114:0/3450946099 shutdown_connections 2024-09-13T17:52:16.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.240+0000 7f3e3f800640 1 --2- 172.21.15.114:0/3450946099 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e300533b0 0x7f3e30006f20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.240+0000 7f3e3f800640 1 -- 172.21.15.114:0/3450946099 >> 172.21.15.114:0/3450946099 conn(0x7f3e3001d910 msgr2=0x7f3e30054580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:16.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.240+0000 7f3e3f800640 1 -- 172.21.15.114:0/3450946099 shutdown_connections 2024-09-13T17:52:16.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.240+0000 7f3e3f800640 1 -- 172.21.15.114:0/3450946099 wait complete. 2024-09-13T17:52:16.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.240+0000 7f32cce00640 1 Processor -- start 2024-09-13T17:52:16.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.240+0000 7f32cce00640 1 -- start start 2024-09-13T17:52:16.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7f3e3f800640 1 Processor -- start 2024-09-13T17:52:16.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7fc594000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc58c0d0310 0x7fc58c15cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7fc594000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc58c0d24b0 con 0x7fc58c0cdad0 2024-09-13T17:52:16.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7fc594000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc58c0b1f50 con 0x7fc58c0cf690 2024-09-13T17:52:16.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7fc594000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58c0d30a0 con 0x7fc58c0d0310 2024-09-13T17:52:16.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7f32cce00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32c806cb00 0x7f32c814b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7f32cce00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32c80b2190 0x7f32c8156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7f32cce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32c814f9d0 0x7f32c8148560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7f32cce00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c814b9b0 con 0x7f32c814f9d0 2024-09-13T17:52:16.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7f32cce00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c815c760 con 0x7f32c806cb00 2024-09-13T17:52:16.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7f32cce00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c815ca40 con 0x7f32c80b2190 2024-09-13T17:52:16.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7f3e3f800640 1 -- start start 2024-09-13T17:52:16.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7fc590c00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc58c0cdad0 0x7fc58c15c820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33374/0 (socket says 172.21.15.114:33374) 2024-09-13T17:52:16.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7fc590c00640 1 -- 172.21.15.114:0/1969792690 learned_addr learned my addr 172.21.15.114:0/1969792690 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:16.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7f32c7400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32c806cb00 0x7f32c814b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7f32c7400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32c806cb00 0x7f32c814b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:56458/0 (socket says 172.21.15.114:56458) 2024-09-13T17:52:16.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7f32c7400640 1 -- 172.21.15.114:0/827125742 learned_addr learned my addr 172.21.15.114:0/827125742 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:16.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7f32c6a00640 1 --2- 172.21.15.114:0/827125742 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32c80b2190 0x7f32c8156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7fc58be00640 1 -- 172.21.15.114:0/1969792690 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1966704017 0 0) 0x7fc58c0b1f50 con 0x7fc58c0cf690 2024-09-13T17:52:16.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7f32c7e00640 1 --2- 172.21.15.114:0/827125742 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32c814f9d0 0x7f32c8148560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7f32c7400640 1 -- 172.21.15.114:0/827125742 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32c80b2190 msgr2=0x7f32c8156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7f32c7400640 1 --2- 172.21.15.114:0/827125742 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32c80b2190 0x7f32c8156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7f32c7400640 1 -- 172.21.15.114:0/827125742 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32c814f9d0 msgr2=0x7f32c8148560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7f32c7400640 1 --2- 172.21.15.114:0/827125742 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32c814f9d0 0x7f32c8148560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7f32c7400640 1 -- 172.21.15.114:0/827125742 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b4010810 con 0x7f32c806cb00 2024-09-13T17:52:16.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7fc58be00640 1 -- 172.21.15.114:0/1969792690 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc574003530 con 0x7fc58c0cf690 2024-09-13T17:52:16.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7fc592000640 1 --2- 172.21.15.114:0/1969792690 >> v2:172.21.15.134:3300/0 conn(0x7fc58c0d0310 0x7fc58c15cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7effc8c00640 1 Processor -- start 2024-09-13T17:52:16.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7f3e3f800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e30033840 0x7f3e3004bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7f3e3f800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e30036710 0x7f3e3004f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7f32c7400640 1 --2- 172.21.15.114:0/827125742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32c806cb00 0x7f32c814b270 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f32b800b410 tx=0x7f32b800b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:16.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7fc58be00640 1 -- 172.21.15.114:0/1969792690 <== mon.1 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1853338864 0 0) 0x7fc574003530 con 0x7fc58c0cf690 2024-09-13T17:52:16.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7fc58be00640 1 -- 172.21.15.114:0/1969792690 >> v2:172.21.15.134:3300/0 conn(0x7fc58c0d0310 msgr2=0x7fc58c15cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:16.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7fc58be00640 1 --2- 172.21.15.114:0/1969792690 >> v2:172.21.15.134:3300/0 conn(0x7fc58c0d0310 0x7fc58c15cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7fc58be00640 1 -- 172.21.15.114:0/1969792690 >> v1:172.21.15.114:6789/0 conn(0x7fc58c0cdad0 legacy=0x7fc58c15c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7fc58be00640 1 -- 172.21.15.114:0/1969792690 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58c0d2700 con 0x7fc58c0cf690 2024-09-13T17:52:16.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7fc58be00640 1 -- 172.21.15.114:0/1969792690 <== mon.1 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7fc580001680 con 0x7fc58c0cf690 2024-09-13T17:52:16.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7fc58be00640 1 -- 172.21.15.114:0/1969792690 >> v1:172.21.15.134:6789/0 conn(0x7fc58c0cf690 legacy=0x7fc58c0cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7fc58be00640 1 --2- 172.21.15.114:0/1969792690 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc5740039d0 0x7fc574003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7fc58be00640 1 --2- 172.21.15.114:0/1969792690 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5740047d0 0x7fc574004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7fc58be00640 1 --2- 172.21.15.114:0/1969792690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc574005190 0x7fc5740141a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7fc58be00640 1 -- 172.21.15.114:0/1969792690 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c0d30a0 con 0x7fc5740047d0 2024-09-13T17:52:16.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7fc58be00640 1 -- 172.21.15.114:0/1969792690 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5740148a0 con 0x7fc574005190 2024-09-13T17:52:16.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7fc58be00640 1 -- 172.21.15.114:0/1969792690 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc574014a60 con 0x7fc5740039d0 2024-09-13T17:52:16.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7effc8c00640 1 -- start start 2024-09-13T17:52:16.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7f3e3f800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e300533b0 0x7f3e3004f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7f3e37e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e30036710 0x7f3e3004f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7f3e37e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e30036710 0x7f3e3004f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:47088/0 (socket says 172.21.15.114:47088) 2024-09-13T17:52:16.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7f3e3f800640 1 -- 172.21.15.114:0/1028550405 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e301801e0 con 0x7f3e30033840 2024-09-13T17:52:16.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7f3e3f800640 1 -- 172.21.15.114:0/1028550405 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3017f8d0 con 0x7f3e300533b0 2024-09-13T17:52:16.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7f3e3f800640 1 -- 172.21.15.114:0/1028550405 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e300c7b90 con 0x7f3e30036710 2024-09-13T17:52:16.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7f3e37e00640 1 -- 172.21.15.114:0/1028550405 learned_addr learned my addr 172.21.15.114:0/1028550405 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:16.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7f32bf400640 1 -- 172.21.15.114:0/827125742 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b8011830 con 0x7f32c806cb00 2024-09-13T17:52:16.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.244+0000 7f32bf400640 1 -- 172.21.15.114:0/827125742 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b8011990 con 0x7f32c806cb00 2024-09-13T17:52:16.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7fc590c00640 1 --2- 172.21.15.114:0/1969792690 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5740047d0 0x7fc574004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7f3e3d800640 1 --2- 172.21.15.114:0/1028550405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e300533b0 0x7f3e3004f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7fc591600640 1 --2- 172.21.15.114:0/1969792690 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc5740039d0 0x7fc574003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7f32cce00640 1 -- 172.21.15.114:0/827125742 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c815cd20 con 0x7f32c806cb00 2024-09-13T17:52:16.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7f32cce00640 1 -- 172.21.15.114:0/827125742 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c8148aa0 con 0x7f32c806cb00 2024-09-13T17:52:16.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7f32bf400640 1 -- 172.21.15.114:0/827125742 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b8011d40 con 0x7f32c806cb00 2024-09-13T17:52:16.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7fc592000640 1 --2- 172.21.15.114:0/1969792690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc574005190 0x7fc5740141a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7effc8c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7effc40cda40 0x7effc40d1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7effc8c00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7effc40d1ea0 0x7effc40af530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7effc8c00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc40d14d0 con 0x7effc41607e0 2024-09-13T17:52:16.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7effc8c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc40d08c0 con 0x7effc40cda40 2024-09-13T17:52:16.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7effc8c00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc40d0ba0 con 0x7effc40d1ea0 2024-09-13T17:52:16.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7f3e37e00640 1 -- 172.21.15.114:0/1028550405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e300533b0 msgr2=0x7f3e3004f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7f3e37e00640 1 --2- 172.21.15.114:0/1028550405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e300533b0 0x7f3e3004f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7f3e37e00640 1 -- 172.21.15.114:0/1028550405 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e30033840 msgr2=0x7f3e3004bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7f3e37e00640 1 --2- 172.21.15.114:0/1028550405 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e30033840 0x7f3e3004bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7effc3400640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7effc41607e0 0x7effc40d00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:51240/0 (socket says 172.21.15.114:51240) 2024-09-13T17:52:16.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7effc3e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7effc40d1ea0 0x7effc40af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7effc3e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7effc40d1ea0 0x7effc40af530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:56486/0 (socket says 172.21.15.114:56486) 2024-09-13T17:52:16.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7effc3e00640 1 -- 172.21.15.114:0/3482208887 learned_addr learned my addr 172.21.15.114:0/3482208887 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:16.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7f3e37e00640 1 -- 172.21.15.114:0/1028550405 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e2c0084a0 con 0x7f3e30036710 2024-09-13T17:52:16.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7f3e3d800640 1 --2- 172.21.15.114:0/1028550405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e300533b0 0x7f3e3004f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:52:16.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7effc2a00640 1 --2- 172.21.15.114:0/3482208887 >> v2:172.21.15.114:3300/0 conn(0x7effc40cda40 0x7effc40d1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7effc2a00640 1 -- 172.21.15.114:0/3482208887 >> v2:172.21.15.134:3300/0 conn(0x7effc40d1ea0 msgr2=0x7effc40af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:16.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7fc590c00640 1 -- 172.21.15.114:0/1969792690 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc5740039d0 msgr2=0x7fc574003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:16.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7fc590c00640 1 --2- 172.21.15.114:0/1969792690 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc5740039d0 0x7fc574003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7fc590c00640 1 -- 172.21.15.114:0/1969792690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc574005190 msgr2=0x7fc5740141a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:16.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7fc590c00640 1 --2- 172.21.15.114:0/1969792690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc574005190 0x7fc5740141a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7fc590c00640 1 -- 172.21.15.114:0/1969792690 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc574003530 con 0x7fc5740047d0 2024-09-13T17:52:16.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7fc592000640 1 --2- 172.21.15.114:0/1969792690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc574005190 0x7fc5740141a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:52:16.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7fc592000640 1 -- 172.21.15.114:0/1969792690 reap_dead start 2024-09-13T17:52:16.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7fc591600640 1 --2- 172.21.15.114:0/1969792690 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc5740039d0 0x7fc574003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:52:16.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7f32cce00640 1 -- 172.21.15.114:0/827125742 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c815e740 con 0x7f32c806cb00 2024-09-13T17:52:16.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7f3e37e00640 1 --2- 172.21.15.114:0/1028550405 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e30036710 0x7f3e3004f1a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3e2400c780 tx=0x7f3e2400cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:16.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7effc2000640 1 -- 172.21.15.114:0/3482208887 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813265343 0 0) 0x7effc40d14d0 con 0x7effc41607e0 2024-09-13T17:52:16.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7effc2a00640 1 --2- 172.21.15.114:0/3482208887 >> v2:172.21.15.134:3300/0 conn(0x7effc40d1ea0 0x7effc40af530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7effc2a00640 1 -- 172.21.15.114:0/3482208887 >> v1:172.21.15.134:6789/0 conn(0x7effc41607e0 legacy=0x7effc40d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.248+0000 7effc2a00640 1 -- 172.21.15.114:0/3482208887 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc40d0e80 con 0x7effc40cda40 2024-09-13T17:52:16.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.252+0000 7f32bf400640 1 -- 172.21.15.114:0/827125742 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f32b801a400 con 0x7f32c806cb00 2024-09-13T17:52:16.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.252+0000 7f3e34c00640 1 -- 172.21.15.114:0/1028550405 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e240072d0 con 0x7f3e30036710 2024-09-13T17:52:16.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.252+0000 7f3e34c00640 1 -- 172.21.15.114:0/1028550405 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e24007450 con 0x7f3e30036710 2024-09-13T17:52:16.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.252+0000 7f3e3f800640 1 -- 172.21.15.114:0/1028550405 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e3017fb90 con 0x7f3e30036710 2024-09-13T17:52:16.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.252+0000 7f3e3f800640 1 -- 172.21.15.114:0/1028550405 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e3004c000 con 0x7f3e30036710 2024-09-13T17:52:16.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.252+0000 7f3e34c00640 1 -- 172.21.15.114:0/1028550405 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e240047f0 con 0x7f3e30036710 2024-09-13T17:52:16.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.252+0000 7f32bf400640 1 --2- 172.21.15.114:0/827125742 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f32a8066710 0x7f32a8068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.252+0000 7f32bf400640 1 -- 172.21.15.114:0/827125742 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f32b80844e0 con 0x7f32c806cb00 2024-09-13T17:52:16.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.252+0000 7f32c6a00640 1 --2- 172.21.15.114:0/827125742 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f32a8066710 0x7f32a8068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.252+0000 7effc3e00640 1 --2- 172.21.15.114:0/3482208887 >> v2:172.21.15.134:3300/0 conn(0x7effc40d1ea0 0x7effc40af530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:52:16.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7f3e3f800640 1 -- 172.21.15.114:0/1028550405 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e30006f20 con 0x7f3e30036710 2024-09-13T17:52:16.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7fc590c00640 1 --2- 172.21.15.114:0/1969792690 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5740047d0 0x7fc574004c50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc578001850 tx=0x7fc57801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55adff2ccde1287e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:16.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7f32c6a00640 1 --2- 172.21.15.114:0/827125742 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f32a8066710 0x7f32a8068bd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f32b40b3000 tx=0x7f32b40ab070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:16.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7fc58be00640 1 -- 172.21.15.114:0/1969792690 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc578004ab0 con 0x7fc5740047d0 2024-09-13T17:52:16.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7fc58be00640 1 -- 172.21.15.114:0/1969792690 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5780a7070 con 0x7fc5740047d0 2024-09-13T17:52:16.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7f3e34c00640 1 -- 172.21.15.114:0/1028550405 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3e24004950 con 0x7f3e30036710 2024-09-13T17:52:16.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7effc2a00640 1 --2- 172.21.15.114:0/3482208887 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effc40cda40 0x7effc40d1960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7effc40d3350 tx=0x7effb401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838044d0264ca68e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:16.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7fa192c00640 1 Processor -- start 2024-09-13T17:52:16.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7fa192c00640 1 -- start start 2024-09-13T17:52:16.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7effc2000640 1 -- 172.21.15.114:0/3482208887 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb40ad660 con 0x7effc40cda40 2024-09-13T17:52:16.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7fc58be00640 1 -- 172.21.15.114:0/1969792690 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc578004e50 con 0x7fc5740047d0 2024-09-13T17:52:16.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7effc2000640 1 -- 172.21.15.114:0/3482208887 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb40ad7c0 con 0x7effc40cda40 2024-09-13T17:52:16.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7effc2000640 1 -- 172.21.15.114:0/3482208887 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb40adb50 con 0x7effc40cda40 2024-09-13T17:52:16.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7fc594000640 1 -- 172.21.15.114:0/1969792690 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5740047d0 msgr2=0x7fc574004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7fc594000640 1 --2- 172.21.15.114:0/1969792690 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5740047d0 0x7fc574004c50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc578001850 tx=0x7fc57801c4c0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7f3e34c00640 1 --2- 172.21.15.114:0/1028550405 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3e180666e0 0x7f3e18068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7f3e34c00640 1 -- 172.21.15.114:0/1028550405 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3e24083af0 con 0x7f3e30036710 2024-09-13T17:52:16.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7f3e3ce00640 1 --2- 172.21.15.114:0/1028550405 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3e180666e0 0x7f3e18068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7fc594000640 1 -- 172.21.15.114:0/1969792690 shutdown_connections 2024-09-13T17:52:16.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7fc594000640 1 --2- 172.21.15.114:0/1969792690 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5740047d0 0x7fc574004c50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7fc594000640 1 -- 172.21.15.114:0/1969792690 >> 172.21.15.114:0/1969792690 conn(0x7fc58c066080 msgr2=0x7fc58c066490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:16.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7fc594000640 1 -- 172.21.15.114:0/1969792690 shutdown_connections 2024-09-13T17:52:16.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7fc594000640 1 -- 172.21.15.114:0/1969792690 wait complete. 2024-09-13T17:52:16.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7f32bf400640 1 -- 172.21.15.114:0/827125742 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f32c815e740 con 0x7f32c806cb00 2024-09-13T17:52:16.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7fa192c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa18c160c30 0x7fa18c06c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7fa192c00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa18c0cdfb0 0x7fa18c0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7fa192c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa18c06cd40 con 0x7fa18c070420 2024-09-13T17:52:16.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7fa192c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa18c06d020 con 0x7fa18c160c30 2024-09-13T17:52:16.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7fa192c00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa18c0b28d0 con 0x7fa18c0cdfb0 2024-09-13T17:52:16.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7effc8c00640 1 -- 172.21.15.114:0/3482208887 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effc40cda40 msgr2=0x7effc40d1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7effc8c00640 1 --2- 172.21.15.114:0/3482208887 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effc40cda40 0x7effc40d1960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7effc40d3350 tx=0x7effb401c450 comp rx=0 tx=0).stop 2024-09-13T17:52:16.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7f41e8400640 1 Processor -- start 2024-09-13T17:52:16.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.260+0000 7fa190c00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa18c0cdfb0 0x7fa18c0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.260+0000 7fa190c00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa18c0cdfb0 0x7fa18c0b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:56488/0 (socket says 172.21.15.114:56488) 2024-09-13T17:52:16.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.260+0000 7fa190c00640 1 -- 172.21.15.114:0/2558651373 learned_addr learned my addr 172.21.15.114:0/2558651373 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:16.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.256+0000 7f41e8400640 1 -- start start 2024-09-13T17:52:16.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.260+0000 7f3e3ce00640 1 --2- 172.21.15.114:0/1028550405 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3e180666e0 0x7f3e18068ba0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3e3804fb60 tx=0x7f3e38066c90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:16.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.260+0000 7fa190c00640 1 -- 172.21.15.114:0/2558651373 >> v2:172.21.15.114:3300/0 conn(0x7fa18c160c30 msgr2=0x7fa18c06c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:16.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.260+0000 7fa190c00640 1 --2- 172.21.15.114:0/2558651373 >> v2:172.21.15.114:3300/0 conn(0x7fa18c160c30 0x7fa18c06c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.260+0000 7fa190c00640 1 -- 172.21.15.114:0/2558651373 >> v1:172.21.15.114:6789/0 conn(0x7fa18c070420 legacy=0x7fa18c070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.260+0000 7fa190c00640 1 -- 172.21.15.114:0/2558651373 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18c0b2bb0 con 0x7fa18c0cdfb0 2024-09-13T17:52:16.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.260+0000 7effc8c00640 1 -- 172.21.15.114:0/3482208887 shutdown_connections 2024-09-13T17:52:16.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.260+0000 7effc8c00640 1 --2- 172.21.15.114:0/3482208887 >> v2:172.21.15.134:3300/0 conn(0x7effc40d1ea0 0x7effc40af530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.260+0000 7effc8c00640 1 --2- 172.21.15.114:0/3482208887 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effc40cda40 0x7effc40d1960 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.260+0000 7effc8c00640 1 -- 172.21.15.114:0/3482208887 >> 172.21.15.114:0/3482208887 conn(0x7effc408a000 msgr2=0x7effc40d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:16.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.260+0000 7effc8c00640 1 -- 172.21.15.114:0/3482208887 shutdown_connections 2024-09-13T17:52:16.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.260+0000 7effc8c00640 1 -- 172.21.15.114:0/3482208887 wait complete. 2024-09-13T17:52:16.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.260+0000 7fc594000640 1 Processor -- start 2024-09-13T17:52:16.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.260+0000 7f41e8400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41e0070420 0x7f41e0070800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.260+0000 7f41e8400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f41e0160c30 0x7f41e006c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.260+0000 7f41e8400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e0070d40 con 0x7f41e00cdfb0 2024-09-13T17:52:16.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.260+0000 7f41e8400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e006cd40 con 0x7f41e0160c30 2024-09-13T17:52:16.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.260+0000 7f41e8400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e006d020 con 0x7f41e0070420 2024-09-13T17:52:16.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.260+0000 7fc594000640 1 -- start start 2024-09-13T17:52:16.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.260+0000 7fc594000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5740047d0 0x7fc58c150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.260+0000 7fc594000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc58c151600 0x7fc58c151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.260+0000 7fc594000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc58c0cae40 0x7fc58c0cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.260+0000 7fc594000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c15e3c0 con 0x7fc5740047d0 2024-09-13T17:52:16.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.260+0000 7f41e6400640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f41e00cdfb0 0x7f41e00b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:51248/0 (socket says 172.21.15.114:51248) 2024-09-13T17:52:16.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.260+0000 7f41e6400640 1 -- 172.21.15.114:0/2491241100 learned_addr learned my addr 172.21.15.114:0/2491241100 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:16.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.260+0000 7f41e5000640 1 --2- 172.21.15.114:0/2491241100 >> v2:172.21.15.134:3300/0 conn(0x7f41e0160c30 0x7f41e006c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7fc594000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c0cbb10 con 0x7fc58c0cae40 2024-09-13T17:52:16.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7effc8c00640 1 Processor -- start 2024-09-13T17:52:16.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7f41e5a00640 1 --2- 172.21.15.114:0/2491241100 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41e0070420 0x7f41e0070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7f3e34c00640 1 -- 172.21.15.114:0/1028550405 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3e24050d00 con 0x7f3e30036710 2024-09-13T17:52:16.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7effc8c00640 1 -- start start 2024-09-13T17:52:16.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7fc594000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c0cbdf0 con 0x7fc58c151600 2024-09-13T17:52:16.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7fc592000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc58c0cae40 0x7fc58c0cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7fc592000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc58c0cae40 0x7fc58c0cb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:56506/0 (socket says 172.21.15.114:56506) 2024-09-13T17:52:16.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7fc592000640 1 -- 172.21.15.114:0/3449710644 learned_addr learned my addr 172.21.15.114:0/3449710644 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:16.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7fc591600640 1 --2- 172.21.15.114:0/3449710644 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5740047d0 0x7fc58c150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7fc590c00640 1 --2- 172.21.15.114:0/3449710644 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc58c151600 0x7fc58c151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7fc592000640 1 -- 172.21.15.114:0/3449710644 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc58c151600 msgr2=0x7fc58c151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7fc592000640 1 --2- 172.21.15.114:0/3449710644 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc58c151600 0x7fc58c151a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7fc592000640 1 -- 172.21.15.114:0/3449710644 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5740047d0 msgr2=0x7fc58c150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7fc592000640 1 --2- 172.21.15.114:0/3449710644 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5740047d0 0x7fc58c150dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7fc592000640 1 -- 172.21.15.114:0/3449710644 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58c0cc0d0 con 0x7fc58c0cae40 2024-09-13T17:52:16.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7effc8c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7effc40cda40 0x7effc415caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7effc8c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effc40d1ea0 0x7effc415abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7fc592000640 1 --2- 172.21.15.114:0/3449710644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc58c0cae40 0x7fc58c0cb2c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0cdf70 tx=0x7fc58400f580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:16.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7effc8c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7effc41607e0 0x7effc40cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7effc8c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc415cfe0 con 0x7effc40d1ea0 2024-09-13T17:52:16.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7effc8c00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc40b77e0 con 0x7effc41607e0 2024-09-13T17:52:16.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7effc8c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc40c7440 con 0x7effc40cda40 2024-09-13T17:52:16.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7f41e5000640 1 -- 172.21.15.114:0/2491241100 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41e0070420 msgr2=0x7f41e0070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:16.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7f41e5000640 1 --2- 172.21.15.114:0/2491241100 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41e0070420 0x7f41e0070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7f41e5000640 1 -- 172.21.15.114:0/2491241100 >> v1:172.21.15.134:6789/0 conn(0x7f41e00cdfb0 legacy=0x7f41e00b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:16.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7f41e5000640 1 -- 172.21.15.114:0/2491241100 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e00b28d0 con 0x7f41e0160c30 2024-09-13T17:52:16.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7fa190c00640 1 --2- 172.21.15.114:0/2558651373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa18c0cdfb0 0x7fa18c0b30d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa18c0cde20 tx=0x7fa17801c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1520b876d9da8eb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:16.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7fc589600640 1 -- 172.21.15.114:0/3449710644 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58401c070 con 0x7fc58c0cae40 2024-09-13T17:52:16.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7fc589600640 1 -- 172.21.15.114:0/3449710644 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58400f040 con 0x7fc58c0cae40 2024-09-13T17:52:16.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7fc589600640 1 -- 172.21.15.114:0/3449710644 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58400e040 con 0x7fc58c0cae40 2024-09-13T17:52:16.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7effc2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effc40d1ea0 0x7effc415abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7effc3400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7effc40cda40 0x7effc415caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7effc2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effc40d1ea0 0x7effc415abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50272/0 (socket says 172.21.15.114:50272) 2024-09-13T17:52:16.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7effc2a00640 1 -- 172.21.15.114:0/1455914935 learned_addr learned my addr 172.21.15.114:0/1455914935 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:16.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7fc594000640 1 -- 172.21.15.114:0/3449710644 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58c15e050 con 0x7fc58c0cae40 2024-09-13T17:52:16.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7fc594000640 1 -- 172.21.15.114:0/3449710644 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58c151310 con 0x7fc58c0cae40 2024-09-13T17:52:16.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7effc3400640 1 -- 172.21.15.114:0/1455914935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7effc41607e0 msgr2=0x7effc40cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7effc3400640 1 --2- 172.21.15.114:0/1455914935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7effc41607e0 0x7effc40cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7effc3400640 1 -- 172.21.15.114:0/1455914935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effc40d1ea0 msgr2=0x7effc415abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7effc3400640 1 --2- 172.21.15.114:0/1455914935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effc40d1ea0 0x7effc415abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7effc3400640 1 -- 172.21.15.114:0/1455914935 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc009b30 con 0x7effc40cda40 2024-09-13T17:52:16.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.264+0000 7f62c8000640 1 Processor -- start 2024-09-13T17:52:16.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7fa18aa00640 1 -- 172.21.15.114:0/2558651373 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1780aa620 con 0x7fa18c0cdfb0 2024-09-13T17:52:16.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7fa18aa00640 1 -- 172.21.15.114:0/2558651373 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1780aa780 con 0x7fa18c0cdfb0 2024-09-13T17:52:16.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7fa18aa00640 1 -- 172.21.15.114:0/2558651373 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1780aab10 con 0x7fa18c0cdfb0 2024-09-13T17:52:16.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7effc3400640 1 --2- 172.21.15.114:0/1455914935 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7effc40cda40 0x7effc415caa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7effac00c3e0 tx=0x7effac00c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:16.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7fa192c00640 1 -- 172.21.15.114:0/2558651373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa18c0cdfb0 msgr2=0x7fa18c0b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7fa192c00640 1 --2- 172.21.15.114:0/2558651373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa18c0cdfb0 0x7fa18c0b30d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa18c0cde20 tx=0x7fa17801c520 comp rx=0 tx=0).stop 2024-09-13T17:52:16.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7f41e5000640 1 --2- 172.21.15.114:0/2491241100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e0160c30 0x7f41e006c440 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f41cc0097c0 tx=0x7f41cc01c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=535399f3ddf3b89a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:16.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7fa192c00640 1 -- 172.21.15.114:0/2558651373 shutdown_connections 2024-09-13T17:52:16.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7fa192c00640 1 --2- 172.21.15.114:0/2558651373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa18c0cdfb0 0x7fa18c0b30d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7fa192c00640 1 --2- 172.21.15.114:0/2558651373 >> v2:172.21.15.114:3300/0 conn(0x7fa18c160c30 0x7fa18c06c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7fa192c00640 1 -- 172.21.15.114:0/2558651373 >> 172.21.15.114:0/2558651373 conn(0x7fa18c0660b0 msgr2=0x7fa18c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:16.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7effbb400640 1 -- 172.21.15.114:0/1455914935 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac0074e0 con 0x7effc40cda40 2024-09-13T17:52:16.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7effbb400640 1 -- 172.21.15.114:0/1455914935 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac007660 con 0x7effc40cda40 2024-09-13T17:52:16.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7effbb400640 1 -- 172.21.15.114:0/1455914935 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac004a30 con 0x7effc40cda40 2024-09-13T17:52:16.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7effc8c00640 1 -- 172.21.15.114:0/1455914935 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb4009420 con 0x7effc40cda40 2024-09-13T17:52:16.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7effc8c00640 1 -- 172.21.15.114:0/1455914935 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc41fde30 con 0x7effc40cda40 2024-09-13T17:52:16.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7fa192c00640 1 -- 172.21.15.114:0/2558651373 shutdown_connections 2024-09-13T17:52:16.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7fa192c00640 1 -- 172.21.15.114:0/2558651373 wait complete. 2024-09-13T17:52:16.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7f41dfe00640 1 -- 172.21.15.114:0/2491241100 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc0ad640 con 0x7f41e0160c30 2024-09-13T17:52:16.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7f41dfe00640 1 -- 172.21.15.114:0/2491241100 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc0ad7a0 con 0x7f41e0160c30 2024-09-13T17:52:16.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7f41dfe00640 1 -- 172.21.15.114:0/2491241100 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc0adb30 con 0x7f41e0160c30 2024-09-13T17:52:16.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7f41e8400640 1 -- 172.21.15.114:0/2491241100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e0160c30 msgr2=0x7f41e006c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7f41e8400640 1 --2- 172.21.15.114:0/2491241100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e0160c30 0x7f41e006c440 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f41cc0097c0 tx=0x7f41cc01c430 comp rx=0 tx=0).stop 2024-09-13T17:52:16.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7f62c8000640 1 -- start start 2024-09-13T17:52:16.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7f62c8000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f62c0160920 0x7f62c00cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7f62c8000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f62c0160d00 0x7f62c00b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7f62c8000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f62c0164680 0x7f62c00b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7f62c8000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c00cbcc0 con 0x7f62c0160920 2024-09-13T17:52:16.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7f62c8000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c0164bd0 con 0x7f62c0164680 2024-09-13T17:52:16.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7f62c8000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c0164eb0 con 0x7f62c0160d00 2024-09-13T17:52:16.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7f62c5600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f62c0160920 0x7f62c00cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7f62c5600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f62c0160920 0x7f62c00cfb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50282/0 (socket says 172.21.15.114:50282) 2024-09-13T17:52:16.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7f62c5600640 1 -- 172.21.15.114:0/1034094201 learned_addr learned my addr 172.21.15.114:0/1034094201 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:16.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7f62c5600640 1 -- 172.21.15.114:0/1034094201 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f62c0160d00 msgr2=0x7f62c00b4980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T17:52:16.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7f62c5600640 1 --2- 172.21.15.114:0/1034094201 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f62c0160d00 0x7f62c00b4980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7f62c5600640 1 -- 172.21.15.114:0/1034094201 >> v2:172.21.15.134:3300/0 conn(0x7f62c0164680 msgr2=0x7f62c00b4ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T17:52:16.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7f62c5600640 1 --2- 172.21.15.114:0/1034094201 >> v2:172.21.15.134:3300/0 conn(0x7f62c0164680 0x7f62c00b4ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7f62c5600640 1 -- 172.21.15.114:0/1034094201 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c0165190 con 0x7f62c0160920 2024-09-13T17:52:16.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7fc594000640 1 -- 172.21.15.114:0/3449710644 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc58c0b4a90 con 0x7fc58c0cae40 2024-09-13T17:52:16.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7fc589600640 1 -- 172.21.15.114:0/3449710644 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc584015430 con 0x7fc58c0cae40 2024-09-13T17:52:16.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.268+0000 7fc589600640 1 --2- 172.21.15.114:0/3449710644 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc56c066760 0x7fc56c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.272+0000 7fa192c00640 1 Processor -- start 2024-09-13T17:52:16.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.272+0000 7fc589600640 1 -- 172.21.15.114:0/3449710644 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc5840845b0 con 0x7fc58c0cae40 2024-09-13T17:52:16.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.272+0000 7fc591600640 1 --2- 172.21.15.114:0/3449710644 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc56c066760 0x7fc56c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.272+0000 7fa192c00640 1 -- start start 2024-09-13T17:52:16.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.272+0000 7f41e8400640 1 -- 172.21.15.114:0/2491241100 shutdown_connections 2024-09-13T17:52:16.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.272+0000 7f41e8400640 1 --2- 172.21.15.114:0/2491241100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e0160c30 0x7f41e006c440 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.272+0000 7f41e8400640 1 --2- 172.21.15.114:0/2491241100 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41e0070420 0x7f41e0070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.272+0000 7f41e8400640 1 -- 172.21.15.114:0/2491241100 >> 172.21.15.114:0/2491241100 conn(0x7f41e00660b0 msgr2=0x7f41e0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:16.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.272+0000 7f41e8400640 1 -- 172.21.15.114:0/2491241100 shutdown_connections 2024-09-13T17:52:16.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.272+0000 7f41e8400640 1 -- 172.21.15.114:0/2491241100 wait complete. 2024-09-13T17:52:16.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.272+0000 7fc591600640 1 --2- 172.21.15.114:0/3449710644 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc56c066760 0x7fc56c068c20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc580001ae0 tx=0x7fc580001a50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:16.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.272+0000 7effc8c00640 1 -- 172.21.15.114:0/1455914935 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff9c005260 con 0x7effc40cda40 2024-09-13T17:52:16.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.272+0000 7fa192c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa18c070420 0x7fa18c14e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.272+0000 7fa192c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa18c0cdfb0 0x7fa18c1529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.272+0000 7fa192c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa18c160c30 0x7fa18c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.272+0000 7fa18be00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa18c070420 0x7fa18c14e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.272+0000 7fa18be00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa18c070420 0x7fa18c14e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:47158/0 (socket says 172.21.15.114:47158) 2024-09-13T17:52:16.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.272+0000 7fa192c00640 1 -- 172.21.15.114:0/357322745 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c15a9f0 con 0x7fa18c0cdfb0 2024-09-13T17:52:16.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.272+0000 7fa192c00640 1 -- 172.21.15.114:0/357322745 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c15a0c0 con 0x7fa18c160c30 2024-09-13T17:52:16.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.272+0000 7fa192c00640 1 -- 172.21.15.114:0/357322745 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c15a3a0 con 0x7fa18c070420 2024-09-13T17:52:16.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.272+0000 7fa18be00640 1 -- 172.21.15.114:0/357322745 learned_addr learned my addr 172.21.15.114:0/357322745 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:16.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.272+0000 7fa190c00640 1 --2- 172.21.15.114:0/357322745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa18c160c30 0x7fa18c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7fa18b400640 1 --2- 172.21.15.114:0/357322745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa18c0cdfb0 0x7fa18c1529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7fc589600640 1 -- 172.21.15.114:0/3449710644 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc5840516a0 con 0x7fc58c0cae40 2024-09-13T17:52:16.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7f41e8400640 1 Processor -- start 2024-09-13T17:52:16.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.272+0000 7effbb400640 1 -- 172.21.15.114:0/1455914935 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7effac004b90 con 0x7effc40cda40 2024-09-13T17:52:16.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7effbb400640 1 --2- 172.21.15.114:0/1455914935 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7effa0066760 0x7effa0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7effbb400640 1 -- 172.21.15.114:0/1455914935 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7effac084080 con 0x7effc40cda40 2024-09-13T17:52:16.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7effc2a00640 1 --2- 172.21.15.114:0/1455914935 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7effa0066760 0x7effa0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7f62c5600640 1 --2- 172.21.15.114:0/1034094201 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62c0160920 0x7f62c00cfb60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f62c0165750 tx=0x7f62b401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ee49209c4e74ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:16.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7fa18b400640 1 -- 172.21.15.114:0/357322745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa18c070420 msgr2=0x7fa18c14e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7f41e8400640 1 -- start start 2024-09-13T17:52:16.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7fa18b400640 1 --2- 172.21.15.114:0/357322745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa18c070420 0x7fa18c14e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7fa18b400640 1 -- 172.21.15.114:0/357322745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa18c160c30 msgr2=0x7fa18c152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7fa18b400640 1 --2- 172.21.15.114:0/357322745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa18c160c30 0x7fa18c152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7fa18b400640 1 -- 172.21.15.114:0/357322745 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1780094d0 con 0x7fa18c0cdfb0 2024-09-13T17:52:16.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7f41e8400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41e0070420 0x7f41e0149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7f41e8400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41e00cdfb0 0x7f41e014a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7f41e8400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e0160c30 0x7f41e014c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7f41e8400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e015c2d0 con 0x7f41e00cdfb0 2024-09-13T17:52:16.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7f41e8400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e015c5b0 con 0x7f41e0160c30 2024-09-13T17:52:16.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7f41e8400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e015c890 con 0x7f41e0070420 2024-09-13T17:52:16.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7f41e5a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41e0070420 0x7f41e0149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7f41e5a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41e0070420 0x7f41e0149670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:47160/0 (socket says 172.21.15.114:47160) 2024-09-13T17:52:16.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7f41e5a00640 1 -- 172.21.15.114:0/1641092038 learned_addr learned my addr 172.21.15.114:0/1641092038 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:16.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7effc2a00640 1 --2- 172.21.15.114:0/1455914935 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7effa0066760 0x7effa0068c20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7effb401c490 tx=0x7effb4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:16.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7f41e5000640 1 --2- 172.21.15.114:0/1641092038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41e00cdfb0 0x7f41e014a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7f62bfe00640 1 -- 172.21.15.114:0/1034094201 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b40ab650 con 0x7f62c0160920 2024-09-13T17:52:16.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7f62bfe00640 1 -- 172.21.15.114:0/1034094201 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b40ab7b0 con 0x7f62c0160920 2024-09-13T17:52:16.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7f62bfe00640 1 -- 172.21.15.114:0/1034094201 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b40abb40 con 0x7f62c0160920 2024-09-13T17:52:16.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7f41e5a00640 1 -- 172.21.15.114:0/1641092038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e0160c30 msgr2=0x7f41e014c870 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T17:52:16.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7f41e5a00640 1 --2- 172.21.15.114:0/1641092038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e0160c30 0x7f41e014c870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7f41e5a00640 1 -- 172.21.15.114:0/1641092038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41e00cdfb0 msgr2=0x7f41e014a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7fa18b400640 1 --2- 172.21.15.114:0/357322745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa18c0cdfb0 0x7fa18c1529e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa17c00b3e0 tx=0x7fa17c00b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:16.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7f41e5a00640 1 --2- 172.21.15.114:0/1641092038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41e00cdfb0 0x7f41e014a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7f41e5a00640 1 -- 172.21.15.114:0/1641092038 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41cc009420 con 0x7f41e0070420 2024-09-13T17:52:16.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7f41e5000640 1 --2- 172.21.15.114:0/1641092038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41e00cdfb0 0x7f41e014a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:16.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.276+0000 7f41e5a00640 1 --2- 172.21.15.114:0/1641092038 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41e0070420 0x7f41e0149670 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f41d400d800 tx=0x7f41d400dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:16.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.280+0000 7f62c8000640 1 -- 172.21.15.114:0/1034094201 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62c0160920 msgr2=0x7f62c00cfb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.280+0000 7f62c8000640 1 --2- 172.21.15.114:0/1034094201 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62c0160920 0x7f62c00cfb60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f62c0165750 tx=0x7f62b401c530 comp rx=0 tx=0).stop 2024-09-13T17:52:16.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.280+0000 7f62c8000640 1 -- 172.21.15.114:0/1034094201 shutdown_connections 2024-09-13T17:52:16.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.280+0000 7f62c8000640 1 --2- 172.21.15.114:0/1034094201 >> v2:172.21.15.134:3300/0 conn(0x7f62c0164680 0x7f62c00b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.280+0000 7f62c8000640 1 --2- 172.21.15.114:0/1034094201 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f62c0160d00 0x7f62c00b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.280+0000 7f62c8000640 1 --2- 172.21.15.114:0/1034094201 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62c0160920 0x7f62c00cfb60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.280+0000 7f62c8000640 1 -- 172.21.15.114:0/1034094201 >> 172.21.15.114:0/1034094201 conn(0x7f62c0071a20 msgr2=0x7f62c0098a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:16.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.280+0000 7f62c8000640 1 -- 172.21.15.114:0/1034094201 shutdown_connections 2024-09-13T17:52:16.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.280+0000 7f62c8000640 1 -- 172.21.15.114:0/1034094201 wait complete. 2024-09-13T17:52:16.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.280+0000 7fa183e00640 1 -- 172.21.15.114:0/357322745 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c011830 con 0x7fa18c0cdfb0 2024-09-13T17:52:16.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.280+0000 7fa183e00640 1 -- 172.21.15.114:0/357322745 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17c011990 con 0x7fa18c0cdfb0 2024-09-13T17:52:16.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.280+0000 7fa183e00640 1 -- 172.21.15.114:0/357322745 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c011d20 con 0x7fa18c0cdfb0 2024-09-13T17:52:16.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.280+0000 7fa192c00640 1 -- 172.21.15.114:0/357322745 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa18c15a680 con 0x7fa18c0cdfb0 2024-09-13T17:52:16.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.280+0000 7fa192c00640 1 -- 172.21.15.114:0/357322745 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa18c14e0a0 con 0x7fa18c0cdfb0 2024-09-13T17:52:16.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.280+0000 7f41dd600640 1 -- 172.21.15.114:0/1641092038 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d400b6c0 con 0x7f41e0070420 2024-09-13T17:52:16.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.280+0000 7f41dd600640 1 -- 172.21.15.114:0/1641092038 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d400b820 con 0x7f41e0070420 2024-09-13T17:52:16.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.280+0000 7f41dd600640 1 -- 172.21.15.114:0/1641092038 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d400bb90 con 0x7f41e0070420 2024-09-13T17:52:16.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.280+0000 7f41e8400640 1 -- 172.21.15.114:0/1641092038 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e015cb70 con 0x7f41e0070420 2024-09-13T17:52:16.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.280+0000 7f41e8400640 1 -- 172.21.15.114:0/1641092038 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e014a680 con 0x7f41e0070420 2024-09-13T17:52:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.280+0000 7fa192c00640 1 -- 172.21.15.114:0/357322745 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa18c15a810 con 0x7fa18c0cdfb0 2024-09-13T17:52:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.280+0000 7f62c8000640 1 Processor -- start 2024-09-13T17:52:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.280+0000 7f62c8000640 1 -- start start 2024-09-13T17:52:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.284+0000 7f62c8000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62c0160920 0x7f62c0155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.284+0000 7f62c8000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62c0160d00 0x7f62c0155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.284+0000 7f62c8000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f62c0164680 0x7f62c0156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.284+0000 7f62c8000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c014e050 con 0x7f62c0160920 2024-09-13T17:52:16.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.284+0000 7f62c8000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c009b3c0 con 0x7f62c0160d00 2024-09-13T17:52:16.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.284+0000 7f62c8000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c0152cc0 con 0x7f62c0164680 2024-09-13T17:52:16.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.284+0000 7f62c4c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62c0160d00 0x7f62c0155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.284+0000 7f62c4c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62c0160d00 0x7f62c0155ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:56532/0 (socket says 172.21.15.114:56532) 2024-09-13T17:52:16.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.284+0000 7f62c4c00640 1 -- 172.21.15.114:0/1320620641 learned_addr learned my addr 172.21.15.114:0/1320620641 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:16.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.284+0000 7effbb400640 1 -- 172.21.15.114:0/1455914935 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7effac0511a0 con 0x7effc40cda40 2024-09-13T17:52:16.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.284+0000 7f62c6000640 1 --2- 172.21.15.114:0/1320620641 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f62c0164680 0x7f62c0156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.284+0000 7fa183e00640 1 -- 172.21.15.114:0/357322745 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa17c038440 con 0x7fa18c0cdfb0 2024-09-13T17:52:16.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.284+0000 7fa183e00640 1 --2- 172.21.15.114:0/357322745 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa16c066760 0x7fa16c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.284+0000 7fa183e00640 1 -- 172.21.15.114:0/357322745 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa17c084700 con 0x7fa18c0cdfb0 2024-09-13T17:52:16.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.284+0000 7fa18be00640 1 --2- 172.21.15.114:0/357322745 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa16c066760 0x7fa16c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.284+0000 7f62c5600640 1 --2- 172.21.15.114:0/1320620641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62c0160920 0x7f62c0155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.284+0000 7f62c4c00640 1 -- 172.21.15.114:0/1320620641 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f62c0164680 msgr2=0x7f62c0156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.284+0000 7f62c4c00640 1 --2- 172.21.15.114:0/1320620641 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f62c0164680 0x7f62c0156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.284+0000 7f62c4c00640 1 -- 172.21.15.114:0/1320620641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62c0160920 msgr2=0x7f62c0155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.284+0000 7f62c4c00640 1 --2- 172.21.15.114:0/1320620641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62c0160920 0x7f62c0155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.284+0000 7f62c4c00640 1 -- 172.21.15.114:0/1320620641 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b40094d0 con 0x7f62c0160d00 2024-09-13T17:52:16.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.284+0000 7f41dd600640 1 -- 172.21.15.114:0/1641092038 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f41d400bcf0 con 0x7f41e0070420 2024-09-13T17:52:16.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.284+0000 7f41e8400640 1 -- 172.21.15.114:0/1641092038 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e0070800 con 0x7f41e0070420 2024-09-13T17:52:16.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.284+0000 7f41dd600640 1 --2- 172.21.15.114:0/1641092038 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f41c0066690 0x7f41c0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.284+0000 7f41dd600640 1 -- 172.21.15.114:0/1641092038 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f41d4084ac0 con 0x7f41e0070420 2024-09-13T17:52:16.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.284+0000 7fa18be00640 1 --2- 172.21.15.114:0/357322745 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa16c066760 0x7fa16c068c20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa184001f60 tx=0x7fa184009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:16.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.288+0000 7f62c4c00640 1 --2- 172.21.15.114:0/1320620641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62c0160d00 0x7f62c0155ad0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f62b000b470 tx=0x7f62b000b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:16.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.288+0000 7f62bd600640 1 -- 172.21.15.114:0/1320620641 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b0011890 con 0x7f62c0160d00 2024-09-13T17:52:16.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.288+0000 7f62bd600640 1 -- 172.21.15.114:0/1320620641 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b00119f0 con 0x7f62c0160d00 2024-09-13T17:52:16.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.288+0000 7f62bd600640 1 -- 172.21.15.114:0/1320620641 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b0011d80 con 0x7f62c0160d00 2024-09-13T17:52:16.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.288+0000 7f62c8000640 1 -- 172.21.15.114:0/1320620641 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c009a7b0 con 0x7f62c0160d00 2024-09-13T17:52:16.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.288+0000 7f62c8000640 1 -- 172.21.15.114:0/1320620641 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c009ad70 con 0x7f62c0160d00 2024-09-13T17:52:16.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.288+0000 7f62aea00640 1 -- 172.21.15.114:0/1320620641 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6298005260 con 0x7f62c0160d00 2024-09-13T17:52:16.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.292+0000 7f62bd600640 1 -- 172.21.15.114:0/1320620641 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f62b0038440 con 0x7f62c0160d00 2024-09-13T17:52:16.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.292+0000 7f41dd600640 1 -- 172.21.15.114:0/1641092038 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f41d4051aa0 con 0x7f41e0070420 2024-09-13T17:52:16.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.292+0000 7f41e5000640 1 --2- 172.21.15.114:0/1641092038 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f41c0066690 0x7f41c0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.292+0000 7f62bd600640 1 --2- 172.21.15.114:0/1320620641 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f62a4066690 0x7f62a4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.292+0000 7fa183e00640 1 -- 172.21.15.114:0/357322745 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa17c051810 con 0x7fa18c0cdfb0 2024-09-13T17:52:16.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.292+0000 7f62bd600640 1 -- 172.21.15.114:0/1320620641 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f62b0084ac0 con 0x7f62c0160d00 2024-09-13T17:52:16.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.292+0000 7f62c5600640 1 --2- 172.21.15.114:0/1320620641 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f62a4066690 0x7f62a4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.292+0000 7f62c5600640 1 --2- 172.21.15.114:0/1320620641 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f62a4066690 0x7f62a4068b50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f62b40af000 tx=0x7f62b40a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:16.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.296+0000 7f41e5000640 1 --2- 172.21.15.114:0/1641092038 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f41c0066690 0x7f41c0068b50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f41cc0af000 tx=0x7f41cc0a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:16.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.300+0000 7f62bd600640 1 -- 172.21.15.114:0/1320620641 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f62b0051c20 con 0x7f62c0160d00 2024-09-13T17:52:16.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.324+0000 7f7818c00640 1 Processor -- start 2024-09-13T17:52:16.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.324+0000 7f7818c00640 1 -- start start 2024-09-13T17:52:16.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.328+0000 7f7818c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f781406dfb0 0x7f781406cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.328+0000 7f7818c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7814159a10 con 0x7f7814071c60 2024-09-13T17:52:16.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.328+0000 7f7818c00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7814158e00 con 0x7f7814155f90 2024-09-13T17:52:16.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.328+0000 7f7818c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78141590e0 con 0x7f781406dfb0 2024-09-13T17:52:16.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.328+0000 7f7811400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7814071c60 0x7f781406c4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33384/0 (socket says 172.21.15.114:33384) 2024-09-13T17:52:16.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.328+0000 7f7811400640 1 -- 172.21.15.114:0/2529524459 learned_addr learned my addr 172.21.15.114:0/2529524459 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:16.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.328+0000 7f7812800640 1 --2- 172.21.15.114:0/2529524459 >> v2:172.21.15.114:3300/0 conn(0x7f781406dfb0 0x7f781406cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.332+0000 7f7810a00640 1 -- 172.21.15.114:0/2529524459 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762126185 0 0) 0x7f7814159a10 con 0x7f7814071c60 2024-09-13T17:52:16.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.332+0000 7f7810a00640 1 -- 172.21.15.114:0/2529524459 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77f8003530 con 0x7f7814071c60 2024-09-13T17:52:16.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.332+0000 7f7810a00640 1 -- 172.21.15.114:0/2529524459 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702894266 0 0) 0x7f7814158e00 con 0x7f7814155f90 2024-09-13T17:52:16.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.332+0000 7f7810a00640 1 -- 172.21.15.114:0/2529524459 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7814159a10 con 0x7f7814155f90 2024-09-13T17:52:16.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.332+0000 7f7810a00640 1 -- 172.21.15.114:0/2529524459 <== mon.1 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3254603601 0 0) 0x7f7814159a10 con 0x7f7814155f90 2024-09-13T17:52:16.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.332+0000 7f7810a00640 1 -- 172.21.15.114:0/2529524459 >> v2:172.21.15.114:3300/0 conn(0x7f781406dfb0 msgr2=0x7f781406cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:16.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.332+0000 7f7810a00640 1 --2- 172.21.15.114:0/2529524459 >> v2:172.21.15.114:3300/0 conn(0x7f781406dfb0 0x7f781406cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.332+0000 7f7810a00640 1 -- 172.21.15.114:0/2529524459 >> v1:172.21.15.114:6789/0 conn(0x7f7814071c60 legacy=0x7f781406c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.332+0000 7f7810a00640 1 -- 172.21.15.114:0/2529524459 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78141593c0 con 0x7f7814155f90 2024-09-13T17:52:16.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.332+0000 7f7810a00640 1 -- 172.21.15.114:0/2529524459 <== mon.1 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7f7800001680 con 0x7f7814155f90 2024-09-13T17:52:16.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.332+0000 7f7810a00640 1 -- 172.21.15.114:0/2529524459 >> v1:172.21.15.134:6789/0 conn(0x7f7814155f90 legacy=0x7f7814071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.332+0000 7f7810a00640 1 --2- 172.21.15.114:0/2529524459 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77f8003b10 0x7f77f8003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.332+0000 7f7810a00640 1 --2- 172.21.15.114:0/2529524459 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77f80047d0 0x7f77f8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.332+0000 7f7810a00640 1 --2- 172.21.15.114:0/2529524459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77f8005190 0x7f77f8007970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.332+0000 7f7810a00640 1 -- 172.21.15.114:0/2529524459 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78141590e0 con 0x7f77f80047d0 2024-09-13T17:52:16.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.332+0000 7f7810a00640 1 -- 172.21.15.114:0/2529524459 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f8008090 con 0x7f77f8005190 2024-09-13T17:52:16.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.332+0000 7f7810a00640 1 -- 172.21.15.114:0/2529524459 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f8008250 con 0x7f77f8003b10 2024-09-13T17:52:16.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.332+0000 7f7811e00640 1 --2- 172.21.15.114:0/2529524459 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77f8003b10 0x7f77f8003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.332+0000 7f7812800640 1 --2- 172.21.15.114:0/2529524459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77f8005190 0x7f77f8007970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.332+0000 7f7811e00640 1 -- 172.21.15.114:0/2529524459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77f8005190 msgr2=0x7f77f8007970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:16.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.332+0000 7f7811e00640 1 --2- 172.21.15.114:0/2529524459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77f8005190 0x7f77f8007970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.332+0000 7f7811e00640 1 -- 172.21.15.114:0/2529524459 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77f80047d0 msgr2=0x7f77f8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:16.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.332+0000 7f7811e00640 1 --2- 172.21.15.114:0/2529524459 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77f80047d0 0x7f77f8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.332+0000 7f7811e00640 1 -- 172.21.15.114:0/2529524459 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78141593c0 con 0x7f77f8003b10 2024-09-13T17:52:16.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.340+0000 7f7812800640 1 -- 172.21.15.114:0/2529524459 reap_dead start 2024-09-13T17:52:16.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.340+0000 7f7811e00640 1 --2- 172.21.15.114:0/2529524459 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77f8003b10 0x7f77f8003f10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f780000c110 tx=0x7f780001f2b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9457a4cd3aad2f9c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:16.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.340+0000 7f7810a00640 1 -- 172.21.15.114:0/2529524459 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78000b0440 con 0x7f77f8003b10 2024-09-13T17:52:16.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.340+0000 7f7810a00640 1 -- 172.21.15.114:0/2529524459 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78000b05c0 con 0x7f77f8003b10 2024-09-13T17:52:16.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.340+0000 7f7818c00640 1 -- 172.21.15.114:0/2529524459 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77f8003b10 msgr2=0x7f77f8003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.340+0000 7f7818c00640 1 --2- 172.21.15.114:0/2529524459 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77f8003b10 0x7f77f8003f10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f780000c110 tx=0x7f780001f2b0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.340+0000 7f7818c00640 1 -- 172.21.15.114:0/2529524459 shutdown_connections 2024-09-13T17:52:16.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.340+0000 7f7818c00640 1 --2- 172.21.15.114:0/2529524459 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77f8003b10 0x7f77f8003f10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.340+0000 7f7818c00640 1 -- 172.21.15.114:0/2529524459 >> 172.21.15.114:0/2529524459 conn(0x7f78140b3830 msgr2=0x7f78140afdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:16.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.340+0000 7f7818c00640 1 -- 172.21.15.114:0/2529524459 shutdown_connections 2024-09-13T17:52:16.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.340+0000 7f7818c00640 1 -- 172.21.15.114:0/2529524459 wait complete. 2024-09-13T17:52:16.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.344+0000 7f7818c00640 1 Processor -- start 2024-09-13T17:52:16.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.344+0000 7f7818c00640 1 -- start start 2024-09-13T17:52:16.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.348+0000 7f7818c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77f8003b10 0x7f78141ee890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.348+0000 7f7818c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78140c3060 0x7f78140acbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.348+0000 7f7818c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78140c5550 0x7f78140c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.348+0000 7f7811e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77f8003b10 0x7f78141ee890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.348+0000 7f7811e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77f8003b10 0x7f78141ee890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:56548/0 (socket says 172.21.15.114:56548) 2024-09-13T17:52:16.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.348+0000 7f7811400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78140c3060 0x7f78140acbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.348+0000 7f7811400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78140c3060 0x7f78140acbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:47176/0 (socket says 172.21.15.114:47176) 2024-09-13T17:52:16.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.348+0000 7f7812800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78140c5550 0x7f78140c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.348+0000 7f7812800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78140c5550 0x7f78140c59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50342/0 (socket says 172.21.15.114:50342) 2024-09-13T17:52:16.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.348+0000 7f7811e00640 1 -- 172.21.15.114:0/3336491360 learned_addr learned my addr 172.21.15.114:0/3336491360 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:16.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.348+0000 7f7818c00640 1 -- 172.21.15.114:0/3336491360 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78140c44c0 con 0x7f78140c5550 2024-09-13T17:52:16.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.348+0000 7f7818c00640 1 -- 172.21.15.114:0/3336491360 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78141530c0 con 0x7f77f8003b10 2024-09-13T17:52:16.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.348+0000 7f7818c00640 1 -- 172.21.15.114:0/3336491360 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78140c5f10 con 0x7f78140c3060 2024-09-13T17:52:16.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.348+0000 7f7811e00640 1 -- 172.21.15.114:0/3336491360 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78140c3060 msgr2=0x7f78140acbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.348+0000 7f7811e00640 1 --2- 172.21.15.114:0/3336491360 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78140c3060 0x7f78140acbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.348+0000 7f7811e00640 1 -- 172.21.15.114:0/3336491360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78140c5550 msgr2=0x7f78140c59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.348+0000 7f7811e00640 1 --2- 172.21.15.114:0/3336491360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78140c5550 0x7f78140c59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.348+0000 7f7811e00640 1 -- 172.21.15.114:0/3336491360 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78140c48e0 con 0x7f77f8003b10 2024-09-13T17:52:16.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.352+0000 7f7811e00640 1 --2- 172.21.15.114:0/3336491360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77f8003b10 0x7f78141ee890 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7800007b80 tx=0x7f77f8005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:16.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.352+0000 7f780a000640 1 -- 172.21.15.114:0/3336491360 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78000b0d10 con 0x7f77f8003b10 2024-09-13T17:52:16.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.352+0000 7f780a000640 1 -- 172.21.15.114:0/3336491360 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78000b0e70 con 0x7f77f8003b10 2024-09-13T17:52:16.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.352+0000 7f780a000640 1 -- 172.21.15.114:0/3336491360 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78000052c0 con 0x7f77f8003b10 2024-09-13T17:52:16.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.352+0000 7f7818c00640 1 -- 172.21.15.114:0/3336491360 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78140c3840 con 0x7f77f8003b10 2024-09-13T17:52:16.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.352+0000 7f7818c00640 1 -- 172.21.15.114:0/3336491360 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78140c3e00 con 0x7f77f8003b10 2024-09-13T17:52:16.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.352+0000 7f7818c00640 1 -- 172.21.15.114:0/3336491360 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78140706a0 con 0x7f77f8003b10 2024-09-13T17:52:16.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.352+0000 7f780a000640 1 -- 172.21.15.114:0/3336491360 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7800003600 con 0x7f77f8003b10 2024-09-13T17:52:16.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.356+0000 7f780a000640 1 --2- 172.21.15.114:0/3336491360 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f77f4066700 0x7f77f4068bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:16.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.356+0000 7f780a000640 1 -- 172.21.15.114:0/3336491360 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7800131fd0 con 0x7f77f8003b10 2024-09-13T17:52:16.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.356+0000 7f7811400640 1 --2- 172.21.15.114:0/3336491360 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f77f4066700 0x7f77f4068bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:16.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.360+0000 7f7811400640 1 --2- 172.21.15.114:0/3336491360 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f77f4066700 0x7f77f4068bc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f780c0018a0 tx=0x7f780c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:16.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.360+0000 7f780a000640 1 -- 172.21.15.114:0/3336491360 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f78000ff0e0 con 0x7f77f8003b10 2024-09-13T17:52:16.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.592+0000 7fa192c00640 1 -- 172.21.15.114:0/357322745 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa18c0b30d0 con 0x7fa18c0cdfb0 2024-09-13T17:52:16.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.596+0000 7fa183e00640 1 -- 172.21.15.114:0/357322745 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa17c05b030 con 0x7fa18c0cdfb0 2024-09-13T17:52:16.599 INFO:teuthology.orchestra.run.smithi114.stdout:55834574857 2024-09-13T17:52:16.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.600+0000 7fa192c00640 1 -- 172.21.15.114:0/357322745 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa16c066760 msgr2=0x7fa16c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.600+0000 7fa192c00640 1 --2- 172.21.15.114:0/357322745 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa16c066760 0x7fa16c068c20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa184001f60 tx=0x7fa184009040 comp rx=0 tx=0).stop 2024-09-13T17:52:16.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.600+0000 7fa192c00640 1 -- 172.21.15.114:0/357322745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa18c0cdfb0 msgr2=0x7fa18c1529e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.600+0000 7fa192c00640 1 --2- 172.21.15.114:0/357322745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa18c0cdfb0 0x7fa18c1529e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa17c00b3e0 tx=0x7fa17c00b7e0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.600+0000 7fa192c00640 1 -- 172.21.15.114:0/357322745 shutdown_connections 2024-09-13T17:52:16.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.600+0000 7fa192c00640 1 --2- 172.21.15.114:0/357322745 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa16c066760 0x7fa16c068c20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.600+0000 7fa192c00640 1 --2- 172.21.15.114:0/357322745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa18c160c30 0x7fa18c152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.600+0000 7fa192c00640 1 --2- 172.21.15.114:0/357322745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa18c0cdfb0 0x7fa18c1529e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.600+0000 7fa192c00640 1 --2- 172.21.15.114:0/357322745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa18c070420 0x7fa18c14e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.600+0000 7fa192c00640 1 -- 172.21.15.114:0/357322745 >> 172.21.15.114:0/357322745 conn(0x7fa18c0660b0 msgr2=0x7fa18c0af790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:16.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.600+0000 7fa192c00640 1 -- 172.21.15.114:0/357322745 shutdown_connections 2024-09-13T17:52:16.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.600+0000 7fa192c00640 1 -- 172.21.15.114:0/357322745 wait complete. 2024-09-13T17:52:16.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.604+0000 7f3e3f800640 1 -- 172.21.15.114:0/1028550405 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3e3004fc20 con 0x7f3e30036710 2024-09-13T17:52:16.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.604+0000 7f3e34c00640 1 -- 172.21.15.114:0/1028550405 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3e24018020 con 0x7f3e30036710 2024-09-13T17:52:16.609 INFO:teuthology.orchestra.run.smithi114.stdout:55834574859 2024-09-13T17:52:16.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.612+0000 7f3e3f800640 1 -- 172.21.15.114:0/1028550405 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3e180666e0 msgr2=0x7f3e18068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.612+0000 7f3e3f800640 1 --2- 172.21.15.114:0/1028550405 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3e180666e0 0x7f3e18068ba0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3e3804fb60 tx=0x7f3e38066c90 comp rx=0 tx=0).stop 2024-09-13T17:52:16.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.612+0000 7f3e3f800640 1 -- 172.21.15.114:0/1028550405 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e30036710 msgr2=0x7f3e3004f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.612+0000 7f3e3f800640 1 --2- 172.21.15.114:0/1028550405 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e30036710 0x7f3e3004f1a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3e2400c780 tx=0x7f3e2400cc40 comp rx=0 tx=0).stop 2024-09-13T17:52:16.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.612+0000 7f3e3f800640 1 -- 172.21.15.114:0/1028550405 shutdown_connections 2024-09-13T17:52:16.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.612+0000 7f3e3f800640 1 --2- 172.21.15.114:0/1028550405 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3e180666e0 0x7f3e18068ba0 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3e3804fb60 tx=0x7f3e38066c90 comp rx=0 tx=0).stop 2024-09-13T17:52:16.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.612+0000 7f3e3f800640 1 --2- 172.21.15.114:0/1028550405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e300533b0 0x7f3e3004f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.612+0000 7f3e3f800640 1 --2- 172.21.15.114:0/1028550405 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e30036710 0x7f3e3004f1a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.612+0000 7f3e3f800640 1 --2- 172.21.15.114:0/1028550405 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e30033840 0x7f3e3004bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.612+0000 7f3e3f800640 1 -- 172.21.15.114:0/1028550405 >> 172.21.15.114:0/1028550405 conn(0x7f3e3001d910 msgr2=0x7f3e30054560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:16.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.612+0000 7f3e3f800640 1 -- 172.21.15.114:0/1028550405 shutdown_connections 2024-09-13T17:52:16.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.612+0000 7f3e3f800640 1 -- 172.21.15.114:0/1028550405 wait complete. 2024-09-13T17:52:16.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.616+0000 7f32cce00640 1 -- 172.21.15.114:0/827125742 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f32c815e740 con 0x7f32c806cb00 2024-09-13T17:52:16.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.616+0000 7effc8c00640 1 -- 172.21.15.114:0/1455914935 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7eff9c005510 con 0x7effc40cda40 2024-09-13T17:52:16.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.616+0000 7effbb400640 1 -- 172.21.15.114:0/1455914935 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7effac001070 con 0x7effc40cda40 2024-09-13T17:52:16.620 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2024-09-13T17:52:16.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.616+0000 7f32bf400640 1 -- 172.21.15.114:0/827125742 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f32c815e740 con 0x7f32c806cb00 2024-09-13T17:52:16.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.616+0000 7fc594000640 1 -- 172.21.15.114:0/3449710644 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc58c0cbf30 con 0x7fc58c0cae40 2024-09-13T17:52:16.621 INFO:teuthology.orchestra.run.smithi114.stdout:55834574857 2024-09-13T17:52:16.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.620+0000 7fc589600640 1 -- 172.21.15.114:0/3449710644 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc58c0cbf30 con 0x7fc58c0cae40 2024-09-13T17:52:16.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.620+0000 7effc8c00640 1 -- 172.21.15.114:0/1455914935 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7effa0066760 msgr2=0x7effa0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.620+0000 7effc8c00640 1 --2- 172.21.15.114:0/1455914935 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7effa0066760 0x7effa0068c20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7effb401c490 tx=0x7effb4008040 comp rx=0 tx=0).stop 2024-09-13T17:52:16.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.620+0000 7effc8c00640 1 -- 172.21.15.114:0/1455914935 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7effc40cda40 msgr2=0x7effc415caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.620+0000 7effc8c00640 1 --2- 172.21.15.114:0/1455914935 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7effc40cda40 0x7effc415caa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7effac00c3e0 tx=0x7effac00c8a0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.624 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2024-09-13T17:52:16.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.620+0000 7f32cce00640 1 -- 172.21.15.114:0/827125742 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f32a8066710 msgr2=0x7f32a8068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.620+0000 7effc8c00640 1 -- 172.21.15.114:0/1455914935 shutdown_connections 2024-09-13T17:52:16.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.620+0000 7effc8c00640 1 --2- 172.21.15.114:0/1455914935 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7effa0066760 0x7effa0068c20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.620+0000 7effc8c00640 1 --2- 172.21.15.114:0/1455914935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7effc41607e0 0x7effc40cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.620+0000 7effc8c00640 1 --2- 172.21.15.114:0/1455914935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effc40d1ea0 0x7effc415abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.620+0000 7effc8c00640 1 --2- 172.21.15.114:0/1455914935 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7effc40cda40 0x7effc415caa0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.620+0000 7effc8c00640 1 -- 172.21.15.114:0/1455914935 >> 172.21.15.114:0/1455914935 conn(0x7effc408a000 msgr2=0x7effc4160e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:16.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.620+0000 7f32cce00640 1 --2- 172.21.15.114:0/827125742 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f32a8066710 0x7f32a8068bd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f32b40b3000 tx=0x7f32b40ab070 comp rx=0 tx=0).stop 2024-09-13T17:52:16.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.620+0000 7f32cce00640 1 -- 172.21.15.114:0/827125742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32c806cb00 msgr2=0x7f32c814b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.620+0000 7f32cce00640 1 --2- 172.21.15.114:0/827125742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32c806cb00 0x7f32c814b270 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f32b800b410 tx=0x7f32b800b8d0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.620+0000 7f32cce00640 1 -- 172.21.15.114:0/827125742 shutdown_connections 2024-09-13T17:52:16.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.620+0000 7f32cce00640 1 --2- 172.21.15.114:0/827125742 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f32a8066710 0x7f32a8068bd0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.620+0000 7f32cce00640 1 --2- 172.21.15.114:0/827125742 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32c814f9d0 0x7f32c8148560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.620+0000 7effc8c00640 1 -- 172.21.15.114:0/1455914935 shutdown_connections 2024-09-13T17:52:16.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.620+0000 7effc8c00640 1 -- 172.21.15.114:0/1455914935 wait complete. 2024-09-13T17:52:16.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.620+0000 7f32cce00640 1 --2- 172.21.15.114:0/827125742 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f32c80b2190 0x7f32c8156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.620+0000 7f32cce00640 1 --2- 172.21.15.114:0/827125742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32c806cb00 0x7f32c814b270 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.620+0000 7f32cce00640 1 -- 172.21.15.114:0/827125742 >> 172.21.15.114:0/827125742 conn(0x7f32c80718f0 msgr2=0x7f32c8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:16.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.624+0000 7f32cce00640 1 -- 172.21.15.114:0/827125742 shutdown_connections 2024-09-13T17:52:16.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.624+0000 7f32cce00640 1 -- 172.21.15.114:0/827125742 wait complete. 2024-09-13T17:52:16.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.624+0000 7fc594000640 1 -- 172.21.15.114:0/3449710644 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc56c066760 msgr2=0x7fc56c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.624+0000 7fc594000640 1 --2- 172.21.15.114:0/3449710644 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc56c066760 0x7fc56c068c20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc580001ae0 tx=0x7fc580001a50 comp rx=0 tx=0).stop 2024-09-13T17:52:16.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.624+0000 7fc594000640 1 -- 172.21.15.114:0/3449710644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc58c0cae40 msgr2=0x7fc58c0cb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.624+0000 7fc594000640 1 --2- 172.21.15.114:0/3449710644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc58c0cae40 0x7fc58c0cb2c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0cdf70 tx=0x7fc58400f580 comp rx=0 tx=0).stop 2024-09-13T17:52:16.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.624+0000 7fc594000640 1 -- 172.21.15.114:0/3449710644 shutdown_connections 2024-09-13T17:52:16.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.624+0000 7fc594000640 1 --2- 172.21.15.114:0/3449710644 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc56c066760 0x7fc56c068c20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.624+0000 7fc594000640 1 --2- 172.21.15.114:0/3449710644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc58c0cae40 0x7fc58c0cb2c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.624+0000 7fc594000640 1 --2- 172.21.15.114:0/3449710644 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc58c151600 0x7fc58c151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.624+0000 7fc594000640 1 --2- 172.21.15.114:0/3449710644 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5740047d0 0x7fc58c150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.624+0000 7fc594000640 1 -- 172.21.15.114:0/3449710644 >> 172.21.15.114:0/3449710644 conn(0x7fc58c066080 msgr2=0x7fc58c0b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:16.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.624+0000 7f41e8400640 1 -- 172.21.15.114:0/1641092038 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f41e015d020 con 0x7f41e0070420 2024-09-13T17:52:16.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.624+0000 7fc594000640 1 -- 172.21.15.114:0/3449710644 shutdown_connections 2024-09-13T17:52:16.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.624+0000 7fc594000640 1 -- 172.21.15.114:0/3449710644 wait complete. 2024-09-13T17:52:16.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.624+0000 7f41dd600640 1 -- 172.21.15.114:0/1641092038 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f41d40550c0 con 0x7f41e0070420 2024-09-13T17:52:16.630 INFO:teuthology.orchestra.run.smithi114.stdout:55834574856 2024-09-13T17:52:16.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.632+0000 7f41e8400640 1 -- 172.21.15.114:0/1641092038 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f41c0066690 msgr2=0x7f41c0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.632+0000 7f41e8400640 1 --2- 172.21.15.114:0/1641092038 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f41c0066690 0x7f41c0068b50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f41cc0af000 tx=0x7f41cc0a7070 comp rx=0 tx=0).stop 2024-09-13T17:52:16.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.632+0000 7f41e8400640 1 -- 172.21.15.114:0/1641092038 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41e0070420 msgr2=0x7f41e0149670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.632+0000 7f41e8400640 1 --2- 172.21.15.114:0/1641092038 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41e0070420 0x7f41e0149670 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f41d400d800 tx=0x7f41d400dcc0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.632+0000 7f41e8400640 1 -- 172.21.15.114:0/1641092038 shutdown_connections 2024-09-13T17:52:16.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.632+0000 7f41e8400640 1 --2- 172.21.15.114:0/1641092038 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f41c0066690 0x7f41c0068b50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.632+0000 7f41e8400640 1 --2- 172.21.15.114:0/1641092038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41e0160c30 0x7f41e014c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.632+0000 7f41e8400640 1 --2- 172.21.15.114:0/1641092038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41e00cdfb0 0x7f41e014a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.632+0000 7f41e8400640 1 --2- 172.21.15.114:0/1641092038 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f41e0070420 0x7f41e0149670 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.632+0000 7f41e8400640 1 -- 172.21.15.114:0/1641092038 >> 172.21.15.114:0/1641092038 conn(0x7f41e00660b0 msgr2=0x7f41e015b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:16.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.632+0000 7f41e8400640 1 -- 172.21.15.114:0/1641092038 shutdown_connections 2024-09-13T17:52:16.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.632+0000 7f41e8400640 1 -- 172.21.15.114:0/1641092038 wait complete. 2024-09-13T17:52:16.640 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2024-09-13T17:52:16.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.636+0000 7f62aea00640 1 -- 172.21.15.114:0/1320620641 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f62980057e0 con 0x7f62c0160d00 2024-09-13T17:52:16.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.636+0000 7f62bd600640 1 -- 172.21.15.114:0/1320620641 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f62b0055240 con 0x7f62c0160d00 2024-09-13T17:52:16.641 INFO:teuthology.orchestra.run.smithi114.stdout:55834574857 2024-09-13T17:52:16.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.640+0000 7f62aea00640 1 -- 172.21.15.114:0/1320620641 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f62a4066690 msgr2=0x7f62a4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.640+0000 7f62aea00640 1 --2- 172.21.15.114:0/1320620641 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f62a4066690 0x7f62a4068b50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f62b40af000 tx=0x7f62b40a7000 comp rx=0 tx=0).stop 2024-09-13T17:52:16.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.640+0000 7f62aea00640 1 -- 172.21.15.114:0/1320620641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62c0160d00 msgr2=0x7f62c0155ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.640+0000 7f62aea00640 1 --2- 172.21.15.114:0/1320620641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62c0160d00 0x7f62c0155ad0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f62b000b470 tx=0x7f62b000b930 comp rx=0 tx=0).stop 2024-09-13T17:52:16.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.644+0000 7f62aea00640 1 -- 172.21.15.114:0/1320620641 shutdown_connections 2024-09-13T17:52:16.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.644+0000 7f62aea00640 1 --2- 172.21.15.114:0/1320620641 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f62a4066690 0x7f62a4068b50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.644+0000 7f62aea00640 1 --2- 172.21.15.114:0/1320620641 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f62c0164680 0x7f62c0156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.644+0000 7f62aea00640 1 --2- 172.21.15.114:0/1320620641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62c0160d00 0x7f62c0155ad0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.644+0000 7f62aea00640 1 --2- 172.21.15.114:0/1320620641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62c0160920 0x7f62c0155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.644+0000 7f62aea00640 1 -- 172.21.15.114:0/1320620641 >> 172.21.15.114:0/1320620641 conn(0x7f62c0071a20 msgr2=0x7f62c00cb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:16.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.644+0000 7f62aea00640 1 -- 172.21.15.114:0/1320620641 shutdown_connections 2024-09-13T17:52:16.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.644+0000 7f62aea00640 1 -- 172.21.15.114:0/1320620641 wait complete. 2024-09-13T17:52:16.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.0 2024-09-13T17:52:16.650 DEBUG:teuthology.parallel:result is None 2024-09-13T17:52:16.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.2 2024-09-13T17:52:16.667 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.4 2024-09-13T17:52:16.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2024-09-13T17:52:16.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.1 2024-09-13T17:52:16.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2024-09-13T17:52:16.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.676+0000 7f7818c00640 1 -- 172.21.15.114:0/3336491360 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f7814072150 con 0x7f77f8003b10 2024-09-13T17:52:16.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.676+0000 7f780a000640 1 -- 172.21.15.114:0/3336491360 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f78000b5090 con 0x7f77f8003b10 2024-09-13T17:52:16.682 INFO:teuthology.orchestra.run.smithi114.stdout:55834574857 2024-09-13T17:52:16.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.680+0000 7f7818c00640 1 -- 172.21.15.114:0/3336491360 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f77f4066700 msgr2=0x7f77f4068bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.680+0000 7f7818c00640 1 --2- 172.21.15.114:0/3336491360 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f77f4066700 0x7f77f4068bc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f780c0018a0 tx=0x7f780c009040 comp rx=0 tx=0).stop 2024-09-13T17:52:16.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.680+0000 7f7818c00640 1 -- 172.21.15.114:0/3336491360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77f8003b10 msgr2=0x7f78141ee890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:16.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.680+0000 7f7818c00640 1 --2- 172.21.15.114:0/3336491360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77f8003b10 0x7f78141ee890 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7800007b80 tx=0x7f77f8005800 comp rx=0 tx=0).stop 2024-09-13T17:52:16.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.680+0000 7f7818c00640 1 -- 172.21.15.114:0/3336491360 shutdown_connections 2024-09-13T17:52:16.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.680+0000 7f7818c00640 1 --2- 172.21.15.114:0/3336491360 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f77f4066700 0x7f77f4068bc0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.680+0000 7f7818c00640 1 --2- 172.21.15.114:0/3336491360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f78140c5550 0x7f78140c59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.680+0000 7f7818c00640 1 --2- 172.21.15.114:0/3336491360 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f78140c3060 0x7f78140acbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.680+0000 7f7818c00640 1 --2- 172.21.15.114:0/3336491360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77f8003b10 0x7f78141ee890 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:16.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.680+0000 7f7818c00640 1 -- 172.21.15.114:0/3336491360 >> 172.21.15.114:0/3336491360 conn(0x7f78140b3830 msgr2=0x7f78140af570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:16.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.680+0000 7f7818c00640 1 -- 172.21.15.114:0/3336491360 shutdown_connections 2024-09-13T17:52:16.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:16.680+0000 7f7818c00640 1 -- 172.21.15.114:0/3336491360 wait complete. 2024-09-13T17:52:16.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2024-09-13T17:52:17.641 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T17:52:17.663 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T17:52:17.668 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T17:52:17.676 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T17:52:17.677 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T17:52:17.677 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T17:52:17.703 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T17:52:17.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.836+0000 7f348f200640 1 Processor -- start 2024-09-13T17:52:17.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.836+0000 7f348f200640 1 -- start start 2024-09-13T17:52:17.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.836+0000 7f348f200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3490099180 0x7f3490099b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.836+0000 7f348f200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3490160d60 0x7f34900b4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.836+0000 7f348f200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34901614b0 con 0x7f3490160980 2024-09-13T17:52:17.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.836+0000 7f348f200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3490161790 con 0x7f3490160d60 2024-09-13T17:52:17.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.836+0000 7f348f200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3490161a70 con 0x7f3490099180 2024-09-13T17:52:17.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.836+0000 7f348e800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3490160d60 0x7f34900b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.836+0000 7f348de00640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f3490160980 0x7f3490098a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:51266/0 (socket says 172.21.15.114:51266) 2024-09-13T17:52:17.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.836+0000 7f348de00640 1 -- 172.21.15.114:0/450195582 learned_addr learned my addr 172.21.15.114:0/450195582 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:17.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.836+0000 7f348d400640 1 --2- 172.21.15.114:0/450195582 >> v2:172.21.15.134:3300/0 conn(0x7f3490099180 0x7f3490099b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.840+0000 7f348e800640 1 -- 172.21.15.114:0/450195582 >> v2:172.21.15.134:3300/0 conn(0x7f3490099180 msgr2=0x7f3490099b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:17.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.840+0000 7f348e800640 1 --2- 172.21.15.114:0/450195582 >> v2:172.21.15.134:3300/0 conn(0x7f3490099180 0x7f3490099b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.840+0000 7f348e800640 1 -- 172.21.15.114:0/450195582 >> v1:172.21.15.134:6789/0 conn(0x7f3490160980 legacy=0x7f3490098a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:17.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.840+0000 7f348ca00640 1 -- 172.21.15.114:0/450195582 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2492985634 0 0) 0x7f34901614b0 con 0x7f3490160980 2024-09-13T17:52:17.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.840+0000 7f348e800640 1 -- 172.21.15.114:0/450195582 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34900b4110 con 0x7f3490160d60 2024-09-13T17:52:17.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.844+0000 7f348e800640 1 --2- 172.21.15.114:0/450195582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3490160d60 0x7f34900b4630 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f349009a0b0 tx=0x7f348801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae6408c8196ba1e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:17.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.844+0000 7f348ca00640 1 -- 172.21.15.114:0/450195582 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34880a5870 con 0x7f3490160d60 2024-09-13T17:52:17.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.848+0000 7f348ca00640 1 -- 172.21.15.114:0/450195582 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34880a59d0 con 0x7f3490160d60 2024-09-13T17:52:17.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.848+0000 7f348ca00640 1 -- 172.21.15.114:0/450195582 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34880a5d60 con 0x7f3490160d60 2024-09-13T17:52:17.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.848+0000 7f348f200640 1 -- 172.21.15.114:0/450195582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3490160d60 msgr2=0x7f34900b4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:17.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.848+0000 7f348f200640 1 --2- 172.21.15.114:0/450195582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3490160d60 0x7f34900b4630 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f349009a0b0 tx=0x7f348801c950 comp rx=0 tx=0).stop 2024-09-13T17:52:17.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.848+0000 7f348f200640 1 -- 172.21.15.114:0/450195582 shutdown_connections 2024-09-13T17:52:17.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.848+0000 7f348f200640 1 --2- 172.21.15.114:0/450195582 >> v2:172.21.15.134:3300/0 conn(0x7f3490099180 0x7f3490099b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.848+0000 7f348f200640 1 --2- 172.21.15.114:0/450195582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3490160d60 0x7f34900b4630 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.848+0000 7f348f200640 1 -- 172.21.15.114:0/450195582 >> 172.21.15.114:0/450195582 conn(0x7f34900b5a50 msgr2=0x7f34900b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:17.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.848+0000 7f348f200640 1 -- 172.21.15.114:0/450195582 shutdown_connections 2024-09-13T17:52:17.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.848+0000 7f348f200640 1 -- 172.21.15.114:0/450195582 wait complete. 2024-09-13T17:52:17.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.852+0000 7f348f200640 1 Processor -- start 2024-09-13T17:52:17.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.852+0000 7f348f200640 1 -- start start 2024-09-13T17:52:17.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.856+0000 7f348f200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3490099180 0x7f349015d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.856+0000 7f348f200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3490160980 0x7f349015cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.856+0000 7f348de00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3490099180 0x7f349015d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.856+0000 7f348de00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3490099180 0x7f349015d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:47188/0 (socket says 172.21.15.114:47188) 2024-09-13T17:52:17.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.856+0000 7f348f200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3490160d60 0x7f34901f4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.856+0000 7f348f200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34901f2f90 con 0x7f3490160d60 2024-09-13T17:52:17.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.856+0000 7f348f200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34901f6520 con 0x7f3490160980 2024-09-13T17:52:17.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.856+0000 7f348f200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34901f31e0 con 0x7f3490099180 2024-09-13T17:52:17.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.856+0000 7f348d400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3490160980 0x7f349015cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.856+0000 7f348e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3490160d60 0x7f34901f4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.856+0000 7f348e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3490160d60 0x7f34901f4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50358/0 (socket says 172.21.15.114:50358) 2024-09-13T17:52:17.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.856+0000 7f348e800640 1 -- 172.21.15.114:0/546016119 learned_addr learned my addr 172.21.15.114:0/546016119 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:17.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.856+0000 7f348e800640 1 -- 172.21.15.114:0/546016119 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3490099180 msgr2=0x7f349015d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:17.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.856+0000 7f348e800640 1 --2- 172.21.15.114:0/546016119 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3490099180 0x7f349015d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.856+0000 7f348e800640 1 -- 172.21.15.114:0/546016119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3490160980 msgr2=0x7f349015cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:17.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.856+0000 7f348e800640 1 --2- 172.21.15.114:0/546016119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3490160980 0x7f349015cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.856+0000 7f348e800640 1 -- 172.21.15.114:0/546016119 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3488009a70 con 0x7f3490160d60 2024-09-13T17:52:17.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.860+0000 7f348e800640 1 --2- 172.21.15.114:0/546016119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3490160d60 0x7f34901f4f70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3488019560 tx=0x7f34880196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:17.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.864+0000 7f3486000640 1 -- 172.21.15.114:0/546016119 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34880b9860 con 0x7f3490160d60 2024-09-13T17:52:17.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.864+0000 7f3486000640 1 -- 172.21.15.114:0/546016119 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34880b99c0 con 0x7f3490160d60 2024-09-13T17:52:17.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.864+0000 7f3486000640 1 -- 172.21.15.114:0/546016119 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34880b9d70 con 0x7f3490160d60 2024-09-13T17:52:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.868+0000 7f348f200640 1 -- 172.21.15.114:0/546016119 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34901f34c0 con 0x7f3490160d60 2024-09-13T17:52:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.868+0000 7f348f200640 1 -- 172.21.15.114:0/546016119 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34901f6240 con 0x7f3490160d60 2024-09-13T17:52:17.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.868+0000 7f348f200640 1 -- 172.21.15.114:0/546016119 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3490099b70 con 0x7f3490160d60 2024-09-13T17:52:17.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.868+0000 7f3486000640 1 -- 172.21.15.114:0/546016119 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f34880ad440 con 0x7f3490160d60 2024-09-13T17:52:17.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.872+0000 7f3486000640 1 --2- 172.21.15.114:0/546016119 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f34700666e0 0x7f3470068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.872+0000 7f3486000640 1 -- 172.21.15.114:0/546016119 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f348811f640 con 0x7f3490160d60 2024-09-13T17:52:17.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.872+0000 7f348de00640 1 --2- 172.21.15.114:0/546016119 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f34700666e0 0x7f3470068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.872+0000 7f348de00640 1 --2- 172.21.15.114:0/546016119 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f34700666e0 0x7f3470068ba0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3480007fd0 tx=0x7f3480007d60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:17.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.880+0000 7f3486000640 1 -- 172.21.15.114:0/546016119 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f34880ec7e0 con 0x7f3490160d60 2024-09-13T17:52:17.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.896+0000 7fa747200640 1 Processor -- start 2024-09-13T17:52:17.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.896+0000 7f6d8f600640 1 Processor -- start 2024-09-13T17:52:17.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.896+0000 7fa747200640 1 -- start start 2024-09-13T17:52:17.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.896+0000 7f6d8f600640 1 -- start start 2024-09-13T17:52:17.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7fa747200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa748156f40 0x7fa748071890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7fa747200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa74815dce0 con 0x7fa748156b60 2024-09-13T17:52:17.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7fa747200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7480cfc20 con 0x7fa74815d590 2024-09-13T17:52:17.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7fa747200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7480b0770 con 0x7fa748156f40 2024-09-13T17:52:17.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7f6d8f600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6d88066e90 0x7f6d88152b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7f6d8f600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d881530b0 con 0x7f6d8806d5c0 2024-09-13T17:52:17.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7f6d8f600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d8806c890 con 0x7f6d880714d0 2024-09-13T17:52:17.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7f6d8f600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d881599e0 con 0x7f6d88066e90 2024-09-13T17:52:17.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7f6d87e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6d8806d5c0 0x7f6d88070dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33404/0 (socket says 172.21.15.114:33404) 2024-09-13T17:52:17.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7f6d87e00640 1 -- 172.21.15.114:0/328364399 learned_addr learned my addr 172.21.15.114:0/328364399 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:17.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7f6d8cc00640 1 --2- 172.21.15.114:0/328364399 >> v2:172.21.15.134:3300/0 conn(0x7f6d88066e90 0x7f6d88152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7fa745e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa748156b60 0x7fa74815ce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33388/0 (socket says 172.21.15.114:33388) 2024-09-13T17:52:17.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7fa745e00640 1 -- 172.21.15.114:0/2494543099 learned_addr learned my addr 172.21.15.114:0/2494543099 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:17.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7fa744a00640 1 -- 172.21.15.114:0/2494543099 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601634842 0 0) 0x7fa7480cfc20 con 0x7fa74815d590 2024-09-13T17:52:17.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7fa744a00640 1 -- 172.21.15.114:0/2494543099 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa72c005740 con 0x7fa74815d590 2024-09-13T17:52:17.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7fa744a00640 1 -- 172.21.15.114:0/2494543099 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595056089 0 0) 0x7fa74815dce0 con 0x7fa748156b60 2024-09-13T17:52:17.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7fa744a00640 1 -- 172.21.15.114:0/2494543099 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7480cfc20 con 0x7fa748156b60 2024-09-13T17:52:17.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7fa744a00640 1 -- 172.21.15.114:0/2494543099 <== mon.1 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3221811477 0 0) 0x7fa72c005740 con 0x7fa74815d590 2024-09-13T17:52:17.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7fa744a00640 1 -- 172.21.15.114:0/2494543099 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa748156f40 msgr2=0x7fa748071890 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T17:52:17.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7fa744a00640 1 --2- 172.21.15.114:0/2494543099 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa748156f40 0x7fa748071890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7fa744a00640 1 -- 172.21.15.114:0/2494543099 >> v1:172.21.15.114:6789/0 conn(0x7fa748156b60 legacy=0x7fa74815ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:17.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7fa744a00640 1 -- 172.21.15.114:0/2494543099 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7480cfe70 con 0x7fa74815d590 2024-09-13T17:52:17.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7fa744a00640 1 -- 172.21.15.114:0/2494543099 <== mon.1 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7fa738001680 con 0x7fa74815d590 2024-09-13T17:52:17.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7fa744a00640 1 -- 172.21.15.114:0/2494543099 >> v1:172.21.15.134:6789/0 conn(0x7fa74815d590 legacy=0x7fa7480aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:17.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7fa744a00640 1 --2- 172.21.15.114:0/2494543099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa72c005d50 0x7fa72c006150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7fa744a00640 1 --2- 172.21.15.114:0/2494543099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa72c0069e0 0x7fa72c006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7fa744a00640 1 --2- 172.21.15.114:0/2494543099 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa72c0073a0 0x7fa72c00bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7fa744a00640 1 -- 172.21.15.114:0/2494543099 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7480b0770 con 0x7fa72c0069e0 2024-09-13T17:52:17.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7fa744a00640 1 -- 172.21.15.114:0/2494543099 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72c00c0d0 con 0x7fa72c005d50 2024-09-13T17:52:17.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7fa744a00640 1 -- 172.21.15.114:0/2494543099 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa72c00c290 con 0x7fa72c0073a0 2024-09-13T17:52:17.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7fa745e00640 1 --2- 172.21.15.114:0/2494543099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa72c005d50 0x7fa72c006150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.904+0000 7fa745400640 1 --2- 172.21.15.114:0/2494543099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa72c0069e0 0x7fa72c006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.904+0000 7fa745e00640 1 -- 172.21.15.114:0/2494543099 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa72c0073a0 msgr2=0x7fa72c00bb90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T17:52:17.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.904+0000 7fa745e00640 1 --2- 172.21.15.114:0/2494543099 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa72c0073a0 0x7fa72c00bb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.904+0000 7fa745e00640 1 -- 172.21.15.114:0/2494543099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa72c0069e0 msgr2=0x7fa72c006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:17.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.904+0000 7fa745e00640 1 --2- 172.21.15.114:0/2494543099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa72c0069e0 0x7fa72c006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.904+0000 7fa745e00640 1 -- 172.21.15.114:0/2494543099 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7480cfe70 con 0x7fa72c005d50 2024-09-13T17:52:17.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7f6d8cc00640 1 -- 172.21.15.114:0/328364399 >> v1:172.21.15.134:6789/0 conn(0x7f6d880714d0 legacy=0x7f6d88158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:17.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7f6d8cc00640 1 -- 172.21.15.114:0/328364399 >> v1:172.21.15.114:6789/0 conn(0x7f6d8806d5c0 legacy=0x7f6d88070dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:17.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.900+0000 7f6d8cc00640 1 -- 172.21.15.114:0/328364399 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8806cae0 con 0x7f6d88066e90 2024-09-13T17:52:17.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.904+0000 7fa745e00640 1 --2- 172.21.15.114:0/2494543099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa72c005d50 0x7fa72c006150 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa734001a10 tx=0x7fa73401edb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfefe6405e2ef5ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:17.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.904+0000 7fa744a00640 1 -- 172.21.15.114:0/2494543099 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7340ac030 con 0x7fa72c005d50 2024-09-13T17:52:17.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.904+0000 7fa744a00640 1 -- 172.21.15.114:0/2494543099 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa734004ab0 con 0x7fa72c005d50 2024-09-13T17:52:17.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.904+0000 7fa744a00640 1 -- 172.21.15.114:0/2494543099 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa734004e40 con 0x7fa72c005d50 2024-09-13T17:52:17.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.904+0000 7f6d8cc00640 1 --2- 172.21.15.114:0/328364399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d88066e90 0x7f6d88152b70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c0097c0 tx=0x7f6d7c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35c988d6ad484d9f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:17.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.908+0000 7f6d87400640 1 -- 172.21.15.114:0/328364399 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c0ab600 con 0x7f6d88066e90 2024-09-13T17:52:17.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.908+0000 7f6d87400640 1 -- 172.21.15.114:0/328364399 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7c0a7050 con 0x7f6d88066e90 2024-09-13T17:52:17.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.908+0000 7f6d87400640 1 -- 172.21.15.114:0/328364399 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c0ab600 con 0x7f6d88066e90 2024-09-13T17:52:17.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.908+0000 7fa747200640 1 -- 172.21.15.114:0/2494543099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa72c005d50 msgr2=0x7fa72c006150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:17.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.908+0000 7fa747200640 1 --2- 172.21.15.114:0/2494543099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa72c005d50 0x7fa72c006150 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa734001a10 tx=0x7fa73401edb0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.908+0000 7f6d8f600640 1 -- 172.21.15.114:0/328364399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d88066e90 msgr2=0x7f6d88152b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:17.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.908+0000 7f6d8f600640 1 --2- 172.21.15.114:0/328364399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d88066e90 0x7f6d88152b70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c0097c0 tx=0x7f6d7c01c450 comp rx=0 tx=0).stop 2024-09-13T17:52:17.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.908+0000 7fa746800640 1 -- 172.21.15.114:0/2494543099 reap_dead start 2024-09-13T17:52:17.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.908+0000 7fa747200640 1 -- 172.21.15.114:0/2494543099 shutdown_connections 2024-09-13T17:52:17.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.908+0000 7fa747200640 1 -- 172.21.15.114:0/2494543099 >> 172.21.15.114:0/2494543099 conn(0x7fa7480b4a30 msgr2=0x7fa748098a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:17.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.908+0000 7f6d8f600640 1 -- 172.21.15.114:0/328364399 shutdown_connections 2024-09-13T17:52:17.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.908+0000 7f6d8f600640 1 --2- 172.21.15.114:0/328364399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d88066e90 0x7f6d88152b70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.908+0000 7f6d8f600640 1 -- 172.21.15.114:0/328364399 >> 172.21.15.114:0/328364399 conn(0x7f6d8806a3b0 msgr2=0x7f6d8806a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:17.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.908+0000 7fa747200640 1 -- 172.21.15.114:0/2494543099 shutdown_connections 2024-09-13T17:52:17.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.908+0000 7fa747200640 1 -- 172.21.15.114:0/2494543099 wait complete. 2024-09-13T17:52:17.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.908+0000 7f6d8f600640 1 -- 172.21.15.114:0/328364399 shutdown_connections 2024-09-13T17:52:17.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.908+0000 7f6d8f600640 1 -- 172.21.15.114:0/328364399 wait complete. 2024-09-13T17:52:17.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.912+0000 7fa747200640 1 Processor -- start 2024-09-13T17:52:17.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.912+0000 7f6d8f600640 1 Processor -- start 2024-09-13T17:52:17.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.912+0000 7f6d8f600640 1 -- start start 2024-09-13T17:52:17.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.912+0000 7f2ab6a00640 1 Processor -- start 2024-09-13T17:52:17.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.912+0000 7fa747200640 1 -- start start 2024-09-13T17:52:17.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.912+0000 7fa747200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa748153ca0 0x7fa7480993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.912+0000 7fa747200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa748099920 0x7fa74809ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.912+0000 7fa747200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa74809b3a0 0x7fa7481e2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.912+0000 7fa747200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa748099dc0 con 0x7fa748099920 2024-09-13T17:52:17.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.912+0000 7fa747200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74809a0a0 con 0x7fa748153ca0 2024-09-13T17:52:17.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.912+0000 7fa747200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa74809a380 con 0x7fa74809b3a0 2024-09-13T17:52:17.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.912+0000 7fa745400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa748099920 0x7fa74809ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.912+0000 7f2ab6a00640 1 -- start start 2024-09-13T17:52:17.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.912+0000 7fa745400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa748099920 0x7fa74809ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50376/0 (socket says 172.21.15.114:50376) 2024-09-13T17:52:17.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.912+0000 7fa745400640 1 -- 172.21.15.114:0/441220040 learned_addr learned my addr 172.21.15.114:0/441220040 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:17.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7fa746800640 1 --2- 172.21.15.114:0/441220040 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa74809b3a0 0x7fa7481e2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7fa745400640 1 -- 172.21.15.114:0/441220040 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa74809b3a0 msgr2=0x7fa7481e2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:17.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7f6d8f600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d88066e90 0x7f6d881ee0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7fa745400640 1 --2- 172.21.15.114:0/441220040 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa74809b3a0 0x7fa7481e2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7fa745400640 1 -- 172.21.15.114:0/441220040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa748153ca0 msgr2=0x7fa7480993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:17.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7fa745e00640 1 --2- 172.21.15.114:0/441220040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa748153ca0 0x7fa7480993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7fa745400640 1 --2- 172.21.15.114:0/441220040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa748153ca0 0x7fa7480993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7fa745400640 1 -- 172.21.15.114:0/441220040 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74809a660 con 0x7fa748099920 2024-09-13T17:52:17.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7fa745e00640 1 --2- 172.21.15.114:0/441220040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa748153ca0 0x7fa7480993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:52:17.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7fa745400640 1 --2- 172.21.15.114:0/441220040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa748099920 0x7fa74809ae60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa73800e910 tx=0x7fa73800edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:17.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7f6d8f600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6d8806d5c0 0x7f6d8815c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7f6d8f600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d880714d0 0x7f6d8814aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7f6d8f600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8815de40 con 0x7f6d88066e90 2024-09-13T17:52:17.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7f6d8f600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d881f9790 con 0x7f6d880714d0 2024-09-13T17:52:17.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7f6d8f600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8815d1c0 con 0x7f6d8806d5c0 2024-09-13T17:52:17.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7fa73e000640 1 -- 172.21.15.114:0/441220040 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7380052e0 con 0x7fa748099920 2024-09-13T17:52:17.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7fa73e000640 1 -- 172.21.15.114:0/441220040 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa738005440 con 0x7fa748099920 2024-09-13T17:52:17.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7f6d8d600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d880714d0 0x7f6d8814aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7f6d8d600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d880714d0 0x7f6d8814aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:56588/0 (socket says 172.21.15.114:56588) 2024-09-13T17:52:17.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7f6d8d600640 1 -- 172.21.15.114:0/1987064335 learned_addr learned my addr 172.21.15.114:0/1987064335 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:17.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7fa747200640 1 -- 172.21.15.114:0/441220040 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa74809a940 con 0x7fa748099920 2024-09-13T17:52:17.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7f6d8d600640 1 -- 172.21.15.114:0/1987064335 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6d8806d5c0 msgr2=0x7f6d8815c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:17.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7fa747200640 1 -- 172.21.15.114:0/441220040 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7480b3730 con 0x7fa748099920 2024-09-13T17:52:17.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7f6d8d600640 1 --2- 172.21.15.114:0/1987064335 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6d8806d5c0 0x7f6d8815c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7f6d8d600640 1 -- 172.21.15.114:0/1987064335 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d88066e90 msgr2=0x7f6d881ee0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:17.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7fa73e000640 1 -- 172.21.15.114:0/441220040 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7380052e0 con 0x7fa748099920 2024-09-13T17:52:17.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7f6d8d600640 1 --2- 172.21.15.114:0/1987064335 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d88066e90 0x7f6d881ee0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7f6d8d600640 1 -- 172.21.15.114:0/1987064335 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d7c009420 con 0x7f6d880714d0 2024-09-13T17:52:17.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7f6d8d600640 1 --2- 172.21.15.114:0/1987064335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d880714d0 0x7f6d8814aab0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6d8000b970 tx=0x7f6d8000be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:17.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7f2ab6a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab00cf690 0x7f2ab00d0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7f2ab6a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2ab015c820 0x7f2ab015ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7f2ab6a00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab00d24b0 con 0x7f2ab00cdad0 2024-09-13T17:52:17.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7f2ab6a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ab00d30a0 con 0x7f2ab015c820 2024-09-13T17:52:17.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7f2ab6a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab00b1f50 con 0x7f2ab00cf690 2024-09-13T17:52:17.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7fa747200640 1 -- 172.21.15.114:0/441220040 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa74809ab80 con 0x7fa748099920 2024-09-13T17:52:17.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.916+0000 7f2ab4a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2ab015c820 0x7f2ab015ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.920+0000 7f6d84c00640 1 -- 172.21.15.114:0/1987064335 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8000cb40 con 0x7f6d880714d0 2024-09-13T17:52:17.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.920+0000 7f6d84c00640 1 -- 172.21.15.114:0/1987064335 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8000cca0 con 0x7f6d880714d0 2024-09-13T17:52:17.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.920+0000 7f6d8f600640 1 -- 172.21.15.114:0/1987064335 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d8815d4a0 con 0x7f6d880714d0 2024-09-13T17:52:17.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.920+0000 7f6d84c00640 1 -- 172.21.15.114:0/1987064335 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80014660 con 0x7f6d880714d0 2024-09-13T17:52:17.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.920+0000 7f2ab4a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2ab015c820 0x7f2ab015ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50390/0 (socket says 172.21.15.114:50390) 2024-09-13T17:52:17.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.920+0000 7f2ab4a00640 1 -- 172.21.15.114:0/3611644144 learned_addr learned my addr 172.21.15.114:0/3611644144 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:17.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.920+0000 7f6d8f600640 1 -- 172.21.15.114:0/1987064335 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d8815da60 con 0x7f6d880714d0 2024-09-13T17:52:17.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.920+0000 7f6d8f600640 1 -- 172.21.15.114:0/1987064335 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d88152b70 con 0x7f6d880714d0 2024-09-13T17:52:17.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.920+0000 7f6d84c00640 1 -- 172.21.15.114:0/1987064335 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6d800147c0 con 0x7f6d880714d0 2024-09-13T17:52:17.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.920+0000 7fa73e000640 1 -- 172.21.15.114:0/441220040 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa73800c780 con 0x7fa748099920 2024-09-13T17:52:17.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.920+0000 7f2ab4a00640 1 -- 172.21.15.114:0/3611644144 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab00cf690 msgr2=0x7f2ab00d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:17.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.920+0000 7f2ab4a00640 1 --2- 172.21.15.114:0/3611644144 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab00cf690 0x7f2ab00d0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.920+0000 7f2ab4a00640 1 -- 172.21.15.114:0/3611644144 >> v1:172.21.15.134:6789/0 conn(0x7f2ab00cdad0 legacy=0x7f2ab00cfa70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T17:52:17.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.920+0000 7f2ab4a00640 1 -- 172.21.15.114:0/3611644144 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab00d2700 con 0x7f2ab015c820 2024-09-13T17:52:17.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.924+0000 7fa73e000640 1 --2- 172.21.15.114:0/441220040 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa728066720 0x7fa728068be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.924+0000 7f6d84c00640 1 --2- 172.21.15.114:0/1987064335 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6d680666e0 0x7f6d68068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.924+0000 7f6d84c00640 1 -- 172.21.15.114:0/1987064335 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6d80084390 con 0x7f6d880714d0 2024-09-13T17:52:17.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.924+0000 7fa73e000640 1 -- 172.21.15.114:0/441220040 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa738084bb0 con 0x7fa748099920 2024-09-13T17:52:17.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.924+0000 7fa745e00640 1 --2- 172.21.15.114:0/441220040 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa728066720 0x7fa728068be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.924+0000 7fa745e00640 1 --2- 172.21.15.114:0/441220040 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa728066720 0x7fa728068be0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa7340ac000 tx=0x7fa734001350 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:17.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.924+0000 7f2ab4a00640 1 --2- 172.21.15.114:0/3611644144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ab015c820 0x7f2ab015ccb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009e50 tx=0x7f2aa801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4b5559a073c59a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:17.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.924+0000 7f6d8cc00640 1 --2- 172.21.15.114:0/1987064335 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6d680666e0 0x7f6d68068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.924+0000 7f6d8cc00640 1 --2- 172.21.15.114:0/1987064335 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6d680666e0 0x7f6d68068ba0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6d88159cc0 tx=0x7f6d7c004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:17.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.928+0000 7f6d84c00640 1 -- 172.21.15.114:0/1987064335 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6d80051480 con 0x7f6d880714d0 2024-09-13T17:52:17.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.928+0000 7f2aaea00640 1 -- 172.21.15.114:0/3611644144 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa80a5840 con 0x7f2ab015c820 2024-09-13T17:52:17.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.928+0000 7f2aaea00640 1 -- 172.21.15.114:0/3611644144 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa80a59a0 con 0x7f2ab015c820 2024-09-13T17:52:17.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.928+0000 7f2aaea00640 1 -- 172.21.15.114:0/3611644144 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa80a5d30 con 0x7f2ab015c820 2024-09-13T17:52:17.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.928+0000 7f2ab6a00640 1 -- 172.21.15.114:0/3611644144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ab015c820 msgr2=0x7f2ab015ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:17.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.928+0000 7fa73e000640 1 -- 172.21.15.114:0/441220040 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa738051b90 con 0x7fa748099920 2024-09-13T17:52:17.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.928+0000 7f2ab6a00640 1 --2- 172.21.15.114:0/3611644144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ab015c820 0x7f2ab015ccb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8009e50 tx=0x7f2aa801c9c0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.928+0000 7f3611a00640 1 Processor -- start 2024-09-13T17:52:17.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.928+0000 7f2ab6a00640 1 -- 172.21.15.114:0/3611644144 shutdown_connections 2024-09-13T17:52:17.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.928+0000 7f2ab6a00640 1 --2- 172.21.15.114:0/3611644144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ab015c820 0x7f2ab015ccb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.928+0000 7f2ab6a00640 1 --2- 172.21.15.114:0/3611644144 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab00cf690 0x7f2ab00d0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.928+0000 7f2ab6a00640 1 -- 172.21.15.114:0/3611644144 >> 172.21.15.114:0/3611644144 conn(0x7f2ab0066080 msgr2=0x7f2ab0066490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:17.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.928+0000 7f35dec00640 1 Processor -- start 2024-09-13T17:52:17.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.928+0000 7f3611a00640 1 -- start start 2024-09-13T17:52:17.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.932+0000 7f35dec00640 1 -- start start 2024-09-13T17:52:17.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.932+0000 7f2ab6a00640 1 -- 172.21.15.114:0/3611644144 shutdown_connections 2024-09-13T17:52:17.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.932+0000 7f2ab6a00640 1 -- 172.21.15.114:0/3611644144 wait complete. 2024-09-13T17:52:17.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.932+0000 7f3611a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f360c15c5f0 0x7f360c0d0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.932+0000 7f35dec00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f35d8160980 0x7f35d8099b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.932+0000 7f35dec00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f35d8099180 0x7f35d80b4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.932+0000 7f35dec00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d81614b0 con 0x7f35d8160d60 2024-09-13T17:52:17.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.932+0000 7f35dec00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d8161790 con 0x7f35d8099180 2024-09-13T17:52:17.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.932+0000 7f35dec00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d8161a70 con 0x7f35d8160980 2024-09-13T17:52:17.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.932+0000 7f3611a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f360c15c9d0 con 0x7f360c0cebd0 2024-09-13T17:52:17.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.932+0000 7f3611a00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f360c0d14e0 con 0x7f360c0d00e0 2024-09-13T17:52:17.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.932+0000 7f3611a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f360c0ce840 con 0x7f360c15c5f0 2024-09-13T17:52:17.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.932+0000 7f35de200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f35d8099180 0x7f35d80b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.932+0000 7f35dce00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f35d8160d60 0x7f35d8098a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33414/0 (socket says 172.21.15.114:33414) 2024-09-13T17:52:17.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.932+0000 7f35dce00640 1 -- 172.21.15.114:0/2351625795 learned_addr learned my addr 172.21.15.114:0/2351625795 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:17.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.932+0000 7f2ab6a00640 1 Processor -- start 2024-09-13T17:52:17.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.932+0000 7f3603e00640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f360c0d00e0 0x7f360c0ce130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:51300/0 (socket says 172.21.15.114:51300) 2024-09-13T17:52:17.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.932+0000 7f3603e00640 1 -- 172.21.15.114:0/2444460633 learned_addr learned my addr 172.21.15.114:0/2444460633 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:17.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.932+0000 7f360be00640 1 --2- 172.21.15.114:0/2444460633 >> v2:172.21.15.114:3300/0 conn(0x7f360c15c5f0 0x7f360c0d0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.932+0000 7f2ab6a00640 1 -- start start 2024-09-13T17:52:17.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.932+0000 7f360b400640 1 -- 172.21.15.114:0/2444460633 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3627853685 0 0) 0x7f360c0d14e0 con 0x7f360c0d00e0 2024-09-13T17:52:17.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f360b400640 1 -- 172.21.15.114:0/2444460633 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35f0003530 con 0x7f360c0d00e0 2024-09-13T17:52:17.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f35d7e00640 1 -- 172.21.15.114:0/2351625795 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2901554242 0 0) 0x7f35d81614b0 con 0x7f35d8160d60 2024-09-13T17:52:17.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f35d7e00640 1 -- 172.21.15.114:0/2351625795 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35c0003530 con 0x7f35d8160d60 2024-09-13T17:52:17.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f35dd800640 1 --2- 172.21.15.114:0/2351625795 >> v2:172.21.15.134:3300/0 conn(0x7f35d8160980 0x7f35d8099b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f360b400640 1 -- 172.21.15.114:0/2444460633 <== mon.1 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1621424534 0 0) 0x7f35f0003530 con 0x7f360c0d00e0 2024-09-13T17:52:17.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f35d7e00640 1 -- 172.21.15.114:0/2351625795 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2264651391 0 0) 0x7f35c0003530 con 0x7f35d8160d60 2024-09-13T17:52:17.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f35d7e00640 1 -- 172.21.15.114:0/2351625795 >> v2:172.21.15.134:3300/0 conn(0x7f35d8160980 msgr2=0x7f35d8099b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:17.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f35d7e00640 1 --2- 172.21.15.114:0/2351625795 >> v2:172.21.15.134:3300/0 conn(0x7f35d8160980 0x7f35d8099b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f35d7e00640 1 -- 172.21.15.114:0/2351625795 >> v2:172.21.15.114:3300/0 conn(0x7f35d8099180 msgr2=0x7f35d80b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:17.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f35d7e00640 1 --2- 172.21.15.114:0/2351625795 >> v2:172.21.15.114:3300/0 conn(0x7f35d8099180 0x7f35d80b4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f35d7e00640 1 -- 172.21.15.114:0/2351625795 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d80b4110 con 0x7f35d8160d60 2024-09-13T17:52:17.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f35d7e00640 1 -- 172.21.15.114:0/2351625795 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7f35c4001680 con 0x7f35d8160d60 2024-09-13T17:52:17.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f35d7e00640 1 -- 172.21.15.114:0/2351625795 >> v1:172.21.15.114:6789/0 conn(0x7f35d8160d60 legacy=0x7f35d8098a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:17.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f2ab6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ab00cdad0 0x7f2ab014f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f2ab6a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ab00cf690 0x7f2ab00b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f2ab6a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab015c820 0x7f2ab00b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f2ab6a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab00ca670 con 0x7f2ab00cdad0 2024-09-13T17:52:17.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f2ab6a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab00c8d00 con 0x7f2ab00cf690 2024-09-13T17:52:17.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f2ab6a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab00c8fe0 con 0x7f2ab015c820 2024-09-13T17:52:17.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f2aafe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ab00cdad0 0x7f2ab014f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f2ab4a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab015c820 0x7f2ab00b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f2aafe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ab00cdad0 0x7f2ab014f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50414/0 (socket says 172.21.15.114:50414) 2024-09-13T17:52:17.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f2aafe00640 1 -- 172.21.15.114:0/77486385 learned_addr learned my addr 172.21.15.114:0/77486385 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:17.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f2ab4a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab015c820 0x7f2ab00b36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:47242/0 (socket says 172.21.15.114:47242) 2024-09-13T17:52:17.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f2aaf400640 1 --2- 172.21.15.114:0/77486385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ab00cf690 0x7f2ab00b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f360b400640 1 -- 172.21.15.114:0/2444460633 >> v2:172.21.15.114:3300/0 conn(0x7f360c15c5f0 msgr2=0x7f360c0d0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:17.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f360b400640 1 --2- 172.21.15.114:0/2444460633 >> v2:172.21.15.114:3300/0 conn(0x7f360c15c5f0 0x7f360c0d0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f360b400640 1 -- 172.21.15.114:0/2444460633 >> v1:172.21.15.114:6789/0 conn(0x7f360c0cebd0 legacy=0x7f360c06b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:17.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f360b400640 1 -- 172.21.15.114:0/2444460633 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360c0cd370 con 0x7f360c0d00e0 2024-09-13T17:52:17.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f360b400640 1 -- 172.21.15.114:0/2444460633 <== mon.1 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7f35f4001680 con 0x7f360c0d00e0 2024-09-13T17:52:17.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f360b400640 1 -- 172.21.15.114:0/2444460633 >> v1:172.21.15.134:6789/0 conn(0x7f360c0d00e0 legacy=0x7f360c0ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:17.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f360b400640 1 --2- 172.21.15.114:0/2444460633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35f0003980 0x7f35f0003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f360b400640 1 --2- 172.21.15.114:0/2444460633 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35f00047d0 0x7f35f0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f360b400640 1 --2- 172.21.15.114:0/2444460633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35f0005190 0x7f35f000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f360b400640 1 -- 172.21.15.114:0/2444460633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360c0ce840 con 0x7f35f0005190 2024-09-13T17:52:17.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f360b400640 1 -- 172.21.15.114:0/2444460633 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f000c010 con 0x7f35f0003980 2024-09-13T17:52:17.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f360b400640 1 -- 172.21.15.114:0/2444460633 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f000c1d0 con 0x7f35f00047d0 2024-09-13T17:52:17.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f35d7e00640 1 --2- 172.21.15.114:0/2351625795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35c00039a0 0x7f35c0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f35d7e00640 1 --2- 172.21.15.114:0/2351625795 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35c00047d0 0x7f35c0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f35d7e00640 1 --2- 172.21.15.114:0/2351625795 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35c0005190 0x7f35c000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f3603e00640 1 --2- 172.21.15.114:0/2444460633 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35f00047d0 0x7f35f0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f360be00640 1 --2- 172.21.15.114:0/2444460633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35f0003980 0x7f35f0003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f35d7e00640 1 -- 172.21.15.114:0/2351625795 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d8161790 con 0x7f35c00047d0 2024-09-13T17:52:17.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f35d7e00640 1 -- 172.21.15.114:0/2351625795 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d8161a70 con 0x7f35c00039a0 2024-09-13T17:52:17.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f35d7e00640 1 -- 172.21.15.114:0/2351625795 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c000bf80 con 0x7f35c0005190 2024-09-13T17:52:17.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f2aafe00640 1 -- 172.21.15.114:0/77486385 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab015c820 msgr2=0x7f2ab00b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:17.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f2aafe00640 1 --2- 172.21.15.114:0/77486385 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab015c820 0x7f2ab00b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f2aafe00640 1 -- 172.21.15.114:0/77486385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ab00cf690 msgr2=0x7f2ab00b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:17.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f2aafe00640 1 --2- 172.21.15.114:0/77486385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ab00cf690 0x7f2ab00b31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f2aafe00640 1 -- 172.21.15.114:0/77486385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa8009b30 con 0x7f2ab00cdad0 2024-09-13T17:52:17.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f2ab4a00640 1 --2- 172.21.15.114:0/77486385 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab015c820 0x7f2ab00b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:52:17.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f35de200640 1 --2- 172.21.15.114:0/2351625795 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35c0005190 0x7f35c000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f35dd800640 1 --2- 172.21.15.114:0/2351625795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35c00039a0 0x7f35c0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f360be00640 1 -- 172.21.15.114:0/2444460633 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35f00047d0 msgr2=0x7f35f0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:17.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f360be00640 1 --2- 172.21.15.114:0/2444460633 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35f00047d0 0x7f35f0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f360be00640 1 -- 172.21.15.114:0/2444460633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35f0005190 msgr2=0x7f35f000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:17.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f360be00640 1 --2- 172.21.15.114:0/2444460633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35f0005190 0x7f35f000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f360be00640 1 -- 172.21.15.114:0/2444460633 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360c0cd370 con 0x7f35f0003980 2024-09-13T17:52:17.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f35dce00640 1 --2- 172.21.15.114:0/2351625795 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35c00047d0 0x7f35c0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f3611000640 1 -- 172.21.15.114:0/2444460633 reap_dead start 2024-09-13T17:52:17.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f2aafe00640 1 --2- 172.21.15.114:0/77486385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ab00cdad0 0x7f2ab014f370 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00b550 tx=0x7f2a9c00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:17.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f35dd800640 1 -- 172.21.15.114:0/2351625795 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35c0005190 msgr2=0x7f35c000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:17.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f35dd800640 1 --2- 172.21.15.114:0/2351625795 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35c0005190 0x7f35c000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f35dd800640 1 -- 172.21.15.114:0/2351625795 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35c00047d0 msgr2=0x7f35c0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:17.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f35dd800640 1 --2- 172.21.15.114:0/2351625795 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35c00047d0 0x7f35c0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f35dd800640 1 -- 172.21.15.114:0/2351625795 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d81614b0 con 0x7f35c00039a0 2024-09-13T17:52:17.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f35de200640 1 --2- 172.21.15.114:0/2351625795 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35c0005190 0x7f35c000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:52:17.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f35de200640 1 -- 172.21.15.114:0/2351625795 reap_dead start 2024-09-13T17:52:17.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f2aa7e00640 1 -- 172.21.15.114:0/77486385 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c010870 con 0x7f2ab00cdad0 2024-09-13T17:52:17.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f2ab6a00640 1 -- 172.21.15.114:0/77486385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab00c92c0 con 0x7f2ab00cdad0 2024-09-13T17:52:17.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f2ab6a00640 1 -- 172.21.15.114:0/77486385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab01577b0 con 0x7f2ab00cdad0 2024-09-13T17:52:17.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.936+0000 7f2aa7e00640 1 -- 172.21.15.114:0/77486385 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9c0109d0 con 0x7f2ab00cdad0 2024-09-13T17:52:17.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.940+0000 7f2aa7e00640 1 -- 172.21.15.114:0/77486385 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c010870 con 0x7f2ab00cdad0 2024-09-13T17:52:17.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.940+0000 7f2ab6a00640 1 -- 172.21.15.114:0/77486385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a88005260 con 0x7f2ab00cdad0 2024-09-13T17:52:17.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.940+0000 7f360be00640 1 --2- 172.21.15.114:0/2444460633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35f0003980 0x7f35f0003d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f35fc009ae0 tx=0x7f35fc01ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6406fb827cba2a12 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:17.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.940+0000 7f35dd800640 1 --2- 172.21.15.114:0/2351625795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35c00039a0 0x7f35c0003de0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009ae0 tx=0x7f35cc01ca70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73f3b88f3be6872a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:17.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.940+0000 7f2aa7e00640 1 -- 172.21.15.114:0/77486385 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2a9c010b40 con 0x7f2ab00cdad0 2024-09-13T17:52:17.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.944+0000 7f360b400640 1 -- 172.21.15.114:0/2444460633 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc0a5640 con 0x7f35f0003980 2024-09-13T17:52:17.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.944+0000 7f360b400640 1 -- 172.21.15.114:0/2444460633 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35fc0a57a0 con 0x7f35f0003980 2024-09-13T17:52:17.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.944+0000 7f360b400640 1 -- 172.21.15.114:0/2444460633 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc0a5b90 con 0x7f35f0003980 2024-09-13T17:52:17.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.944+0000 7f35d7e00640 1 -- 172.21.15.114:0/2351625795 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc0a5550 con 0x7f35c00039a0 2024-09-13T17:52:17.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.944+0000 7f35d7e00640 1 -- 172.21.15.114:0/2351625795 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35cc0a56b0 con 0x7f35c00039a0 2024-09-13T17:52:17.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.944+0000 7f35d7e00640 1 -- 172.21.15.114:0/2351625795 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc0a5aa0 con 0x7f35c00039a0 2024-09-13T17:52:17.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.944+0000 7f3611a00640 1 -- 172.21.15.114:0/2444460633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35f0003980 msgr2=0x7f35f0003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:17.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.944+0000 7f2aa7e00640 1 --2- 172.21.15.114:0/77486385 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2a900666f0 0x7f2a90068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.944+0000 7f2aa7e00640 1 -- 172.21.15.114:0/77486385 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2a9c054d40 con 0x7f2ab00cdad0 2024-09-13T17:52:17.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.944+0000 7f3611a00640 1 --2- 172.21.15.114:0/2444460633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35f0003980 0x7f35f0003d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f35fc009ae0 tx=0x7f35fc01ca50 comp rx=0 tx=0).stop 2024-09-13T17:52:17.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.944+0000 7f3611a00640 1 -- 172.21.15.114:0/2444460633 shutdown_connections 2024-09-13T17:52:17.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.944+0000 7f3611a00640 1 --2- 172.21.15.114:0/2444460633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35f0003980 0x7f35f0003d80 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f35fc009ae0 tx=0x7f35fc01ca50 comp rx=0 tx=0).stop 2024-09-13T17:52:17.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.944+0000 7f3611a00640 1 -- 172.21.15.114:0/2444460633 >> 172.21.15.114:0/2444460633 conn(0x7f360c08a000 msgr2=0x7f360c0d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:17.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.944+0000 7f35dec00640 1 -- 172.21.15.114:0/2351625795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35c00039a0 msgr2=0x7f35c0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:17.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.944+0000 7f35dec00640 1 --2- 172.21.15.114:0/2351625795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35c00039a0 0x7f35c0003de0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009ae0 tx=0x7f35cc01ca70 comp rx=0 tx=0).stop 2024-09-13T17:52:17.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.944+0000 7f35dec00640 1 -- 172.21.15.114:0/2351625795 shutdown_connections 2024-09-13T17:52:17.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.944+0000 7f35dec00640 1 --2- 172.21.15.114:0/2351625795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35c00039a0 0x7f35c0003de0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.944+0000 7f35dec00640 1 -- 172.21.15.114:0/2351625795 >> 172.21.15.114:0/2351625795 conn(0x7f35d80b5a50 msgr2=0x7f35d80b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:17.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.944+0000 7f35dec00640 1 -- 172.21.15.114:0/2351625795 shutdown_connections 2024-09-13T17:52:17.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.944+0000 7f2aaf400640 1 --2- 172.21.15.114:0/77486385 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2a900666f0 0x7f2a90068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.944+0000 7f2aaf400640 1 --2- 172.21.15.114:0/77486385 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2a900666f0 0x7f2a90068bb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0167410 tx=0x7f2aa00090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:17.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.944+0000 7f35dec00640 1 -- 172.21.15.114:0/2351625795 wait complete. 2024-09-13T17:52:17.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.948+0000 7f3611a00640 1 -- 172.21.15.114:0/2444460633 shutdown_connections 2024-09-13T17:52:17.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.948+0000 7f35dec00640 1 Processor -- start 2024-09-13T17:52:17.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.948+0000 7f35dec00640 1 -- start start 2024-09-13T17:52:17.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.948+0000 7f35dec00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35c00039a0 0x7f35d81f7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.948+0000 7f35dec00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35d8158490 0x7f35d8150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.948+0000 7f35dec00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35d8151610 0x7f35d815e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.948+0000 7f35dec00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d8164e10 con 0x7f35d8158490 2024-09-13T17:52:17.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.948+0000 7f35dec00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d81f79c0 con 0x7f35c00039a0 2024-09-13T17:52:17.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.948+0000 7f35dec00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d8158930 con 0x7f35d8151610 2024-09-13T17:52:17.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.948+0000 7f35dce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35d8158490 0x7f35d8150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.948+0000 7f35dce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35d8158490 0x7f35d8150d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50440/0 (socket says 172.21.15.114:50440) 2024-09-13T17:52:17.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.948+0000 7f35dce00640 1 -- 172.21.15.114:0/3600360522 learned_addr learned my addr 172.21.15.114:0/3600360522 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:17.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.948+0000 7f35dd800640 1 --2- 172.21.15.114:0/3600360522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35c00039a0 0x7f35d81f7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.948+0000 7f35de200640 1 --2- 172.21.15.114:0/3600360522 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35d8151610 0x7f35d815e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.948+0000 7f3611a00640 1 -- 172.21.15.114:0/2444460633 wait complete. 2024-09-13T17:52:17.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.948+0000 7f3611a00640 1 Processor -- start 2024-09-13T17:52:17.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.948+0000 7f35de200640 1 -- 172.21.15.114:0/3600360522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35c00039a0 msgr2=0x7f35d81f7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:17.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.948+0000 7f3611a00640 1 -- start start 2024-09-13T17:52:17.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.948+0000 7f35de200640 1 --2- 172.21.15.114:0/3600360522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35c00039a0 0x7f35d81f7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.948+0000 7f35de200640 1 -- 172.21.15.114:0/3600360522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35d8158490 msgr2=0x7f35d8150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:17.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.948+0000 7f35de200640 1 --2- 172.21.15.114:0/3600360522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35d8158490 0x7f35d8150d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.948+0000 7f35de200640 1 -- 172.21.15.114:0/3600360522 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d8158c10 con 0x7f35d8151610 2024-09-13T17:52:17.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.948+0000 7f35de200640 1 --2- 172.21.15.114:0/3600360522 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35d8151610 0x7f35d815e560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f35d80cc840 tx=0x7f35d000f580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:17.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.952+0000 7f35d5600640 1 -- 172.21.15.114:0/3600360522 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d001c070 con 0x7f35d8151610 2024-09-13T17:52:17.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.952+0000 7f35d5600640 1 -- 172.21.15.114:0/3600360522 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d000f040 con 0x7f35d8151610 2024-09-13T17:52:17.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.952+0000 7f35d5600640 1 -- 172.21.15.114:0/3600360522 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d000e040 con 0x7f35d8151610 2024-09-13T17:52:17.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.952+0000 7f35dec00640 1 -- 172.21.15.114:0/3600360522 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d8158ef0 con 0x7f35d8151610 2024-09-13T17:52:17.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.952+0000 7f35dec00640 1 -- 172.21.15.114:0/3600360522 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d8151240 con 0x7f35d8151610 2024-09-13T17:52:17.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.952+0000 7f3611a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f360c154690 0x7f360c154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.952+0000 7f3611a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f360c0b6a70 0x7f360c0b5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.952+0000 7f3611a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f360c0b6400 0x7f360c06c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.952+0000 7f360be00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f360c154690 0x7f360c154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.952+0000 7f3603e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f360c0b6a70 0x7f360c0b5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.952+0000 7f360be00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f360c154690 0x7f360c154e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:56630/0 (socket says 172.21.15.114:56630) 2024-09-13T17:52:17.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.952+0000 7f35dec00640 1 -- 172.21.15.114:0/3600360522 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d8098a70 con 0x7f35d8151610 2024-09-13T17:52:17.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.952+0000 7f3611000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f360c0b6400 0x7f360c06c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.952+0000 7f3611000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f360c0b6400 0x7f360c06c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50454/0 (socket says 172.21.15.114:50454) 2024-09-13T17:52:17.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.952+0000 7f3611000640 1 -- 172.21.15.114:0/1411772808 learned_addr learned my addr 172.21.15.114:0/1411772808 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:17.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.952+0000 7f3611a00640 1 -- 172.21.15.114:0/1411772808 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360c0b5aa0 con 0x7f360c0b6400 2024-09-13T17:52:17.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.952+0000 7f3611a00640 1 -- 172.21.15.114:0/1411772808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360c0b7250 con 0x7f360c154690 2024-09-13T17:52:17.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.952+0000 7f3611a00640 1 -- 172.21.15.114:0/1411772808 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360c0b7530 con 0x7f360c0b6a70 2024-09-13T17:52:17.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.952+0000 7f35d5600640 1 -- 172.21.15.114:0/3600360522 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f35d00039a0 con 0x7f35d8151610 2024-09-13T17:52:17.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.952+0000 7f360be00640 1 -- 172.21.15.114:0/1411772808 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f360c0b6a70 msgr2=0x7f360c0b5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:17.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.956+0000 7f360be00640 1 --2- 172.21.15.114:0/1411772808 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f360c0b6a70 0x7f360c0b5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.956+0000 7f360be00640 1 -- 172.21.15.114:0/1411772808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f360c0b6400 msgr2=0x7f360c06c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:17.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.956+0000 7f360be00640 1 --2- 172.21.15.114:0/1411772808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f360c0b6400 0x7f360c06c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.956+0000 7f360be00640 1 -- 172.21.15.114:0/1411772808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360c0b53e0 con 0x7f360c154690 2024-09-13T17:52:17.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.956+0000 7f3611000640 1 --2- 172.21.15.114:0/1411772808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f360c0b6400 0x7f360c06c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:52:17.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.956+0000 7f35d5600640 1 --2- 172.21.15.114:0/3600360522 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f35b8066690 0x7f35b8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.956+0000 7f35d5600640 1 -- 172.21.15.114:0/3600360522 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f35d00846e0 con 0x7f35d8151610 2024-09-13T17:52:17.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.956+0000 7f35dd800640 1 --2- 172.21.15.114:0/3600360522 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f35b8066690 0x7f35b8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.956+0000 7f360be00640 1 --2- 172.21.15.114:0/1411772808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f360c154690 0x7f360c154e10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0ac000 tx=0x7f35f0005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:17.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.956+0000 7f35dd800640 1 --2- 172.21.15.114:0/3600360522 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f35b8066690 0x7f35b8068b50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f35cc0af000 tx=0x7f35cc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:17.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.956+0000 7f3608c00640 1 -- 172.21.15.114:0/1411772808 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc0ad640 con 0x7f360c154690 2024-09-13T17:52:17.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.956+0000 7f2aa7e00640 1 -- 172.21.15.114:0/77486385 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2a9c051810 con 0x7f2ab00cdad0 2024-09-13T17:52:17.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.956+0000 7f3608c00640 1 -- 172.21.15.114:0/1411772808 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35fc0ad7a0 con 0x7f360c154690 2024-09-13T17:52:17.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.956+0000 7f3611a00640 1 -- 172.21.15.114:0/1411772808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f360c0b56c0 con 0x7f360c154690 2024-09-13T17:52:17.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.956+0000 7f3608c00640 1 -- 172.21.15.114:0/1411772808 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc0adb30 con 0x7f360c154690 2024-09-13T17:52:17.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.956+0000 7f3611a00640 1 -- 172.21.15.114:0/1411772808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f360c0b6ef0 con 0x7f360c154690 2024-09-13T17:52:17.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.956+0000 7f3611a00640 1 -- 172.21.15.114:0/1411772808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f360c0b5be0 con 0x7f360c154690 2024-09-13T17:52:17.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.960+0000 7f3608c00640 1 -- 172.21.15.114:0/1411772808 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f35fc0b4040 con 0x7f360c154690 2024-09-13T17:52:17.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.960+0000 7f3608c00640 1 --2- 172.21.15.114:0/1411772808 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f35e8066710 0x7f35e8068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.960+0000 7f3608c00640 1 -- 172.21.15.114:0/1411772808 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f35fc11e610 con 0x7f360c154690 2024-09-13T17:52:17.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.960+0000 7f35d5600640 1 -- 172.21.15.114:0/3600360522 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f35d0051750 con 0x7f35d8151610 2024-09-13T17:52:17.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.960+0000 7f3603e00640 1 --2- 172.21.15.114:0/1411772808 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f35e8066710 0x7f35e8068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.960+0000 7f3603e00640 1 --2- 172.21.15.114:0/1411772808 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f35e8066710 0x7f35e8068bd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f35f40017b0 tx=0x7f35f4001440 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:17.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.964+0000 7f3608c00640 1 -- 172.21.15.114:0/1411772808 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f360c0b5be0 con 0x7f360c154690 2024-09-13T17:52:17.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.988+0000 7f1d50a00640 1 Processor -- start 2024-09-13T17:52:17.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.988+0000 7f1d50a00640 1 -- start start 2024-09-13T17:52:17.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.988+0000 7f1d50a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d4c15c380 0x7f1d4c0b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.992+0000 7f1d50a00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1d4c15c760 0x7f1d4c0abab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.992+0000 7f1d4b400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d4c15c380 0x7f1d4c0b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.992+0000 7f1d4b400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d4c15c380 0x7f1d4c0b1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:47292/0 (socket says 172.21.15.114:47292) 2024-09-13T17:52:17.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.992+0000 7f1d4b400640 1 -- 172.21.15.114:0/830733800 learned_addr learned my addr 172.21.15.114:0/830733800 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:17.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.992+0000 7f1d50a00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d4c0ab060 con 0x7f1d4c0b0490 2024-09-13T17:52:17.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.992+0000 7f1d4be00640 1 --2- 172.21.15.114:0/830733800 >> v2:172.21.15.134:3300/0 conn(0x7f1d4c15c760 0x7f1d4c0abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.992+0000 7f1d50a00640 1 -- 172.21.15.114:0/830733800 --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d4c0716f0 con 0x7f1d4c15c760 2024-09-13T17:52:17.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.992+0000 7f1d50a00640 1 -- 172.21.15.114:0/830733800 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c0ab2b0 con 0x7f1d4c15c380 2024-09-13T17:52:17.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.992+0000 7f1d4a000640 1 -- 172.21.15.114:0/830733800 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3108891724 0 0) 0x7f1d4c0ab060 con 0x7f1d4c0b0490 2024-09-13T17:52:17.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.992+0000 7f1d4a000640 1 -- 172.21.15.114:0/830733800 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d30003530 con 0x7f1d4c0b0490 2024-09-13T17:52:17.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.992+0000 7f1d4a000640 1 -- 172.21.15.114:0/830733800 <== mon.1 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1632522091 0 0) 0x7f1d30003530 con 0x7f1d4c0b0490 2024-09-13T17:52:17.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.992+0000 7f1d4a000640 1 -- 172.21.15.114:0/830733800 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d4c15c380 msgr2=0x7f1d4c0b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:17.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.992+0000 7f1d4a000640 1 --2- 172.21.15.114:0/830733800 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d4c15c380 0x7f1d4c0b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.992+0000 7f1d4a000640 1 -- 172.21.15.114:0/830733800 >> v2:172.21.15.134:3300/0 conn(0x7f1d4c15c760 msgr2=0x7f1d4c0abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:17.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.992+0000 7f1d4a000640 1 --2- 172.21.15.114:0/830733800 >> v2:172.21.15.134:3300/0 conn(0x7f1d4c15c760 0x7f1d4c0abab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.992+0000 7f1d4a000640 1 -- 172.21.15.114:0/830733800 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4c0ab590 con 0x7f1d4c0b0490 2024-09-13T17:52:17.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.992+0000 7f1d4a000640 1 -- 172.21.15.114:0/830733800 <== mon.1 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7f1d3c001660 con 0x7f1d4c0b0490 2024-09-13T17:52:17.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.992+0000 7f1d4a000640 1 -- 172.21.15.114:0/830733800 >> v1:172.21.15.134:6789/0 conn(0x7f1d4c0b0490 legacy=0x7f1d4c0b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:17.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.992+0000 7f1d4a000640 1 --2- 172.21.15.114:0/830733800 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d4c15c380 0x7f1d300039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.992+0000 7f1d4a000640 1 --2- 172.21.15.114:0/830733800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d30003ff0 0x7f1d300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.992+0000 7f1d4a000640 1 --2- 172.21.15.114:0/830733800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d30004d10 0x7f1d30005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:17.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.992+0000 7f1d4a000640 1 -- 172.21.15.114:0/830733800 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c0716f0 con 0x7f1d30003ff0 2024-09-13T17:52:17.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.992+0000 7f1d4a000640 1 -- 172.21.15.114:0/830733800 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c0ab2b0 con 0x7f1d30004d10 2024-09-13T17:52:17.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.992+0000 7f1d4a000640 1 -- 172.21.15.114:0/830733800 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3000bb70 con 0x7f1d4c15c380 2024-09-13T17:52:17.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.992+0000 7f1d4be00640 1 --2- 172.21.15.114:0/830733800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d30004d10 0x7f1d30005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.992+0000 7f1d4b400640 1 --2- 172.21.15.114:0/830733800 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d4c15c380 0x7f1d300039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.992+0000 7f1d4aa00640 1 --2- 172.21.15.114:0/830733800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d30003ff0 0x7f1d300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:17.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.996+0000 7f1d4be00640 1 -- 172.21.15.114:0/830733800 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d4c15c380 msgr2=0x7f1d300039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:17.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.996+0000 7f1d4be00640 1 --2- 172.21.15.114:0/830733800 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d4c15c380 0x7f1d300039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.996+0000 7f1d4be00640 1 -- 172.21.15.114:0/830733800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d30003ff0 msgr2=0x7f1d300047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:17.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.996+0000 7f1d4be00640 1 --2- 172.21.15.114:0/830733800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d30003ff0 0x7f1d300047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:17.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:17.996+0000 7f1d4be00640 1 -- 172.21.15.114:0/830733800 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3000bdf0 con 0x7f1d30004d10 2024-09-13T17:52:18.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.000+0000 7f1d4aa00640 1 --2- 172.21.15.114:0/830733800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d30003ff0 0x7f1d300047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:18.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.000+0000 7f1d4be00640 1 --2- 172.21.15.114:0/830733800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d30004d10 0x7f1d30005190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1d44007330 tx=0x7f1d4401ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2cd68da6c0b3552 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:18.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.000+0000 7f1d4a000640 1 -- 172.21.15.114:0/830733800 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d440a5c60 con 0x7f1d30004d10 2024-09-13T17:52:18.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.000+0000 7f1d4a000640 1 -- 172.21.15.114:0/830733800 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d440a5dc0 con 0x7f1d30004d10 2024-09-13T17:52:18.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.000+0000 7f1d4a000640 1 -- 172.21.15.114:0/830733800 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d440ad660 con 0x7f1d30004d10 2024-09-13T17:52:18.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.000+0000 7f1d50a00640 1 -- 172.21.15.114:0/830733800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d30004d10 msgr2=0x7f1d30005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:18.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.000+0000 7f1d50a00640 1 --2- 172.21.15.114:0/830733800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d30004d10 0x7f1d30005190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1d44007330 tx=0x7f1d4401ce30 comp rx=0 tx=0).stop 2024-09-13T17:52:18.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.000+0000 7f1d4be00640 1 -- 172.21.15.114:0/830733800 reap_dead start 2024-09-13T17:52:18.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.000+0000 7f1d50a00640 1 -- 172.21.15.114:0/830733800 shutdown_connections 2024-09-13T17:52:18.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.000+0000 7f1d50a00640 1 -- 172.21.15.114:0/830733800 >> 172.21.15.114:0/830733800 conn(0x7f1d4c0b37c0 msgr2=0x7f1d4c0afd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:18.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.000+0000 7f1d50a00640 1 -- 172.21.15.114:0/830733800 shutdown_connections 2024-09-13T17:52:18.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.000+0000 7f1d50a00640 1 -- 172.21.15.114:0/830733800 wait complete. 2024-09-13T17:52:18.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.004+0000 7f1d50a00640 1 Processor -- start 2024-09-13T17:52:18.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.004+0000 7f1d50a00640 1 -- start start 2024-09-13T17:52:18.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.008+0000 7f1d50a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d30004d10 0x7f1d4c156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:18.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.008+0000 7f1d50a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d4c1fdb10 0x7f1d4c1f9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:18.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.008+0000 7f1d50a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d4c06c7a0 0x7f1d4c06cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:18.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.008+0000 7f1d4b400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d30004d10 0x7f1d4c156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:18.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.008+0000 7f1d4b400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d30004d10 0x7f1d4c156590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:47312/0 (socket says 172.21.15.114:47312) 2024-09-13T17:52:18.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.008+0000 7f1d4be00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d4c06c7a0 0x7f1d4c06cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:18.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.008+0000 7f1d4aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d4c1fdb10 0x7f1d4c1f9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:18.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.008+0000 7f1d4aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d4c1fdb10 0x7f1d4c1f9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50464/0 (socket says 172.21.15.114:50464) 2024-09-13T17:52:18.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.008+0000 7f1d4be00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d4c06c7a0 0x7f1d4c06cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:56656/0 (socket says 172.21.15.114:56656) 2024-09-13T17:52:18.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.008+0000 7f1d4b400640 1 -- 172.21.15.114:0/1556795556 learned_addr learned my addr 172.21.15.114:0/1556795556 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:18.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.008+0000 7f1d50a00640 1 -- 172.21.15.114:0/1556795556 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c06d160 con 0x7f1d4c1fdb10 2024-09-13T17:52:18.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.008+0000 7f1d50a00640 1 -- 172.21.15.114:0/1556795556 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c149de0 con 0x7f1d4c06c7a0 2024-09-13T17:52:18.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.008+0000 7f1d50a00640 1 -- 172.21.15.114:0/1556795556 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c14a0c0 con 0x7f1d30004d10 2024-09-13T17:52:18.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.008+0000 7f1d4b400640 1 -- 172.21.15.114:0/1556795556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d4c06c7a0 msgr2=0x7f1d4c06cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:18.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.008+0000 7f1d4b400640 1 --2- 172.21.15.114:0/1556795556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d4c06c7a0 0x7f1d4c06cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.008+0000 7f1d4b400640 1 -- 172.21.15.114:0/1556795556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d4c1fdb10 msgr2=0x7f1d4c1f9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:18.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.008+0000 7f1d4b400640 1 --2- 172.21.15.114:0/1556795556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d4c1fdb10 0x7f1d4c1f9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.008+0000 7f1d4b400640 1 -- 172.21.15.114:0/1556795556 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4c0b1ee0 con 0x7f1d30004d10 2024-09-13T17:52:18.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.008+0000 7f1d4b400640 1 --2- 172.21.15.114:0/1556795556 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d30004d10 0x7f1d4c156590 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1d380116d0 tx=0x7f1d38011b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:18.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.008+0000 7f1d43400640 1 -- 172.21.15.114:0/1556795556 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3800c070 con 0x7f1d30004d10 2024-09-13T17:52:18.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.008+0000 7f1d43400640 1 -- 172.21.15.114:0/1556795556 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3800f9c0 con 0x7f1d30004d10 2024-09-13T17:52:18.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.008+0000 7f1d50a00640 1 -- 172.21.15.114:0/1556795556 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d4c14a3a0 con 0x7f1d30004d10 2024-09-13T17:52:18.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.008+0000 7f1d43400640 1 -- 172.21.15.114:0/1556795556 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3800fd70 con 0x7f1d30004d10 2024-09-13T17:52:18.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.008+0000 7f1d50a00640 1 -- 172.21.15.114:0/1556795556 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d4c14a960 con 0x7f1d30004d10 2024-09-13T17:52:18.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.012+0000 7f1d43400640 1 -- 172.21.15.114:0/1556795556 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1d38015460 con 0x7f1d30004d10 2024-09-13T17:52:18.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.012+0000 7f1d50a00640 1 -- 172.21.15.114:0/1556795556 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4c0ad860 con 0x7f1d30004d10 2024-09-13T17:52:18.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.012+0000 7f1d43400640 1 --2- 172.21.15.114:0/1556795556 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1d2c066690 0x7f1d2c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:18.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.012+0000 7f1d43400640 1 -- 172.21.15.114:0/1556795556 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1d380847d0 con 0x7f1d30004d10 2024-09-13T17:52:18.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.016+0000 7f1d4aa00640 1 --2- 172.21.15.114:0/1556795556 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1d2c066690 0x7f1d2c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:18.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.016+0000 7f1d4aa00640 1 --2- 172.21.15.114:0/1556795556 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1d2c066690 0x7f1d2c068b50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c097fb0 tx=0x7f1d3c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:18.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.016+0000 7f1d43400640 1 -- 172.21.15.114:0/1556795556 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1d380518f0 con 0x7f1d30004d10 2024-09-13T17:52:18.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.160+0000 7f3611a00640 1 -- 172.21.15.114:0/1411772808 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f360c0b5be0 con 0x7f360c154690 2024-09-13T17:52:18.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.160+0000 7f3608c00640 1 -- 172.21.15.114:0/1411772808 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f360c0b5be0 con 0x7f360c154690 2024-09-13T17:52:18.164 INFO:teuthology.orchestra.run.smithi114.stdout:55834574859 2024-09-13T17:52:18.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.164+0000 7f3611a00640 1 -- 172.21.15.114:0/1411772808 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f35e8066710 msgr2=0x7f35e8068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:18.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.164+0000 7f3611a00640 1 --2- 172.21.15.114:0/1411772808 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f35e8066710 0x7f35e8068bd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f35f40017b0 tx=0x7f35f4001440 comp rx=0 tx=0).stop 2024-09-13T17:52:18.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.164+0000 7f3611a00640 1 -- 172.21.15.114:0/1411772808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f360c154690 msgr2=0x7f360c154e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:18.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.164+0000 7f3611a00640 1 --2- 172.21.15.114:0/1411772808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f360c154690 0x7f360c154e10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0ac000 tx=0x7f35f0005800 comp rx=0 tx=0).stop 2024-09-13T17:52:18.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.164+0000 7f3611a00640 1 -- 172.21.15.114:0/1411772808 shutdown_connections 2024-09-13T17:52:18.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.164+0000 7f3611a00640 1 --2- 172.21.15.114:0/1411772808 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f35e8066710 0x7f35e8068bd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.164+0000 7f3611a00640 1 --2- 172.21.15.114:0/1411772808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f360c0b6400 0x7f360c06c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.164+0000 7f3611a00640 1 --2- 172.21.15.114:0/1411772808 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f360c0b6a70 0x7f360c0b5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.164+0000 7f3611a00640 1 --2- 172.21.15.114:0/1411772808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f360c154690 0x7f360c154e10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.164+0000 7f3611a00640 1 -- 172.21.15.114:0/1411772808 >> 172.21.15.114:0/1411772808 conn(0x7f360c08a000 msgr2=0x7f360c0b12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:18.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.164+0000 7f3611a00640 1 -- 172.21.15.114:0/1411772808 shutdown_connections 2024-09-13T17:52:18.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.164+0000 7f3611a00640 1 -- 172.21.15.114:0/1411772808 wait complete. 2024-09-13T17:52:18.190 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.1 2024-09-13T17:52:18.190 DEBUG:teuthology.parallel:result is None 2024-09-13T17:52:18.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.212+0000 7f348f200640 1 -- 172.21.15.114:0/546016119 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f34900996e0 con 0x7f3490160d60 2024-09-13T17:52:18.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.212+0000 7f3486000640 1 -- 172.21.15.114:0/546016119 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f34880efe00 con 0x7f3490160d60 2024-09-13T17:52:18.214 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2024-09-13T17:52:18.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.212+0000 7f348f200640 1 -- 172.21.15.114:0/546016119 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f34700666e0 msgr2=0x7f3470068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:18.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.212+0000 7f348f200640 1 --2- 172.21.15.114:0/546016119 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f34700666e0 0x7f3470068ba0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3480007fd0 tx=0x7f3480007d60 comp rx=0 tx=0).stop 2024-09-13T17:52:18.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.212+0000 7f348f200640 1 -- 172.21.15.114:0/546016119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3490160d60 msgr2=0x7f34901f4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:18.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.212+0000 7f348f200640 1 --2- 172.21.15.114:0/546016119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3490160d60 0x7f34901f4f70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3488019560 tx=0x7f34880196f0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.212+0000 7f348f200640 1 -- 172.21.15.114:0/546016119 shutdown_connections 2024-09-13T17:52:18.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.212+0000 7f348f200640 1 --2- 172.21.15.114:0/546016119 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f34700666e0 0x7f3470068ba0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.212+0000 7f348f200640 1 --2- 172.21.15.114:0/546016119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3490160d60 0x7f34901f4f70 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.212+0000 7f348f200640 1 --2- 172.21.15.114:0/546016119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3490160980 0x7f349015cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.212+0000 7f348f200640 1 --2- 172.21.15.114:0/546016119 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3490099180 0x7f349015d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.212+0000 7f348f200640 1 -- 172.21.15.114:0/546016119 >> 172.21.15.114:0/546016119 conn(0x7f34900b5a50 msgr2=0x7f349006b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:18.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.212+0000 7f348f200640 1 -- 172.21.15.114:0/546016119 shutdown_connections 2024-09-13T17:52:18.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.212+0000 7f348f200640 1 -- 172.21.15.114:0/546016119 wait complete. 2024-09-13T17:52:18.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2024-09-13T17:52:18.237 DEBUG:teuthology.parallel:result is None 2024-09-13T17:52:18.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.240+0000 7fa747200640 1 -- 172.21.15.114:0/441220040 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa74809ab80 con 0x7fa748099920 2024-09-13T17:52:18.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.240+0000 7fa73e000640 1 -- 172.21.15.114:0/441220040 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa74809ab80 con 0x7fa748099920 2024-09-13T17:52:18.243 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2024-09-13T17:52:18.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.244+0000 7fa747200640 1 -- 172.21.15.114:0/441220040 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa728066720 msgr2=0x7fa728068be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:18.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.244+0000 7fa747200640 1 --2- 172.21.15.114:0/441220040 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa728066720 0x7fa728068be0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa7340ac000 tx=0x7fa734001350 comp rx=0 tx=0).stop 2024-09-13T17:52:18.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.244+0000 7fa747200640 1 -- 172.21.15.114:0/441220040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa748099920 msgr2=0x7fa74809ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:18.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.244+0000 7fa747200640 1 --2- 172.21.15.114:0/441220040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa748099920 0x7fa74809ae60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa73800e910 tx=0x7fa73800edd0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.244+0000 7fa747200640 1 -- 172.21.15.114:0/441220040 shutdown_connections 2024-09-13T17:52:18.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.244+0000 7fa747200640 1 --2- 172.21.15.114:0/441220040 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa728066720 0x7fa728068be0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.244+0000 7fa747200640 1 --2- 172.21.15.114:0/441220040 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa74809b3a0 0x7fa7481e2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.244+0000 7fa747200640 1 --2- 172.21.15.114:0/441220040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa748099920 0x7fa74809ae60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.244+0000 7fa747200640 1 --2- 172.21.15.114:0/441220040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa748153ca0 0x7fa7480993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.244+0000 7fa747200640 1 -- 172.21.15.114:0/441220040 >> 172.21.15.114:0/441220040 conn(0x7fa7480b4a30 msgr2=0x7fa748155830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:18.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.244+0000 7fa747200640 1 -- 172.21.15.114:0/441220040 shutdown_connections 2024-09-13T17:52:18.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.244+0000 7fa747200640 1 -- 172.21.15.114:0/441220040 wait complete. 2024-09-13T17:52:18.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.252+0000 7f35dec00640 1 -- 172.21.15.114:0/3600360522 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f35d806eea0 con 0x7f35d8151610 2024-09-13T17:52:18.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.252+0000 7f35d5600640 1 -- 172.21.15.114:0/3600360522 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f35d0054d70 con 0x7f35d8151610 2024-09-13T17:52:18.255 INFO:teuthology.orchestra.run.smithi114.stdout:55834574859 2024-09-13T17:52:18.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.252+0000 7f35dec00640 1 -- 172.21.15.114:0/3600360522 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f35b8066690 msgr2=0x7f35b8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:18.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.252+0000 7f35dec00640 1 --2- 172.21.15.114:0/3600360522 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f35b8066690 0x7f35b8068b50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f35cc0af000 tx=0x7f35cc008040 comp rx=0 tx=0).stop 2024-09-13T17:52:18.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.252+0000 7f35dec00640 1 -- 172.21.15.114:0/3600360522 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35d8151610 msgr2=0x7f35d815e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:18.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.252+0000 7f35dec00640 1 --2- 172.21.15.114:0/3600360522 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35d8151610 0x7f35d815e560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f35d80cc840 tx=0x7f35d000f580 comp rx=0 tx=0).stop 2024-09-13T17:52:18.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.256+0000 7f35dec00640 1 -- 172.21.15.114:0/3600360522 shutdown_connections 2024-09-13T17:52:18.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.256+0000 7f35dec00640 1 --2- 172.21.15.114:0/3600360522 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f35b8066690 0x7f35b8068b50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.256+0000 7f35dec00640 1 --2- 172.21.15.114:0/3600360522 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f35d8151610 0x7f35d815e560 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.256+0000 7f35dec00640 1 --2- 172.21.15.114:0/3600360522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35d8158490 0x7f35d8150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.256+0000 7f35dec00640 1 --2- 172.21.15.114:0/3600360522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35c00039a0 0x7f35d81f7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.256+0000 7f35dec00640 1 -- 172.21.15.114:0/3600360522 >> 172.21.15.114:0/3600360522 conn(0x7f35d80b5a50 msgr2=0x7f35d806b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:18.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.256+0000 7f35dec00640 1 -- 172.21.15.114:0/3600360522 shutdown_connections 2024-09-13T17:52:18.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.256+0000 7f35dec00640 1 -- 172.21.15.114:0/3600360522 wait complete. 2024-09-13T17:52:18.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.256+0000 7f6d8f600640 1 -- 172.21.15.114:0/1987064335 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6d8814c230 con 0x7f6d880714d0 2024-09-13T17:52:18.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.256+0000 7f6d84c00640 1 -- 172.21.15.114:0/1987064335 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6d80054aa0 con 0x7f6d880714d0 2024-09-13T17:52:18.261 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2024-09-13T17:52:18.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.260+0000 7f6d8f600640 1 -- 172.21.15.114:0/1987064335 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6d680666e0 msgr2=0x7f6d68068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:18.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.260+0000 7f6d8f600640 1 --2- 172.21.15.114:0/1987064335 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6d680666e0 0x7f6d68068ba0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6d88159cc0 tx=0x7f6d7c004740 comp rx=0 tx=0).stop 2024-09-13T17:52:18.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.260+0000 7f6d8f600640 1 -- 172.21.15.114:0/1987064335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d880714d0 msgr2=0x7f6d8814aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:18.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.260+0000 7f6d8f600640 1 --2- 172.21.15.114:0/1987064335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d880714d0 0x7f6d8814aab0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6d8000b970 tx=0x7f6d8000be30 comp rx=0 tx=0).stop 2024-09-13T17:52:18.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.260+0000 7f6d8f600640 1 -- 172.21.15.114:0/1987064335 shutdown_connections 2024-09-13T17:52:18.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.260+0000 7f6d8f600640 1 --2- 172.21.15.114:0/1987064335 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6d680666e0 0x7f6d68068ba0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.260+0000 7f6d8f600640 1 --2- 172.21.15.114:0/1987064335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d880714d0 0x7f6d8814aab0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.260+0000 7f6d8f600640 1 --2- 172.21.15.114:0/1987064335 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6d8806d5c0 0x7f6d8815c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.260+0000 7f6d8f600640 1 --2- 172.21.15.114:0/1987064335 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d88066e90 0x7f6d881ee0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.260+0000 7f6d8f600640 1 -- 172.21.15.114:0/1987064335 >> 172.21.15.114:0/1987064335 conn(0x7f6d8806a3b0 msgr2=0x7f6d8815efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:18.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.260+0000 7f6d8f600640 1 -- 172.21.15.114:0/1987064335 shutdown_connections 2024-09-13T17:52:18.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.260+0000 7f6d8f600640 1 -- 172.21.15.114:0/1987064335 wait complete. 2024-09-13T17:52:18.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2024-09-13T17:52:18.275 DEBUG:teuthology.parallel:result is None 2024-09-13T17:52:18.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2024-09-13T17:52:18.285 DEBUG:teuthology.parallel:result is None 2024-09-13T17:52:18.286 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.4 2024-09-13T17:52:18.286 DEBUG:teuthology.parallel:result is None 2024-09-13T17:52:18.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.288+0000 7f2ab6a00640 1 -- 172.21.15.114:0/77486385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f2a880057e0 con 0x7f2ab00cdad0 2024-09-13T17:52:18.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.288+0000 7f2aa7e00640 1 -- 172.21.15.114:0/77486385 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2a9c014070 con 0x7f2ab00cdad0 2024-09-13T17:52:18.292 INFO:teuthology.orchestra.run.smithi114.stdout:55834574857 2024-09-13T17:52:18.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.292+0000 7f2ab6a00640 1 -- 172.21.15.114:0/77486385 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2a900666f0 msgr2=0x7f2a90068bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:18.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.292+0000 7f2ab6a00640 1 --2- 172.21.15.114:0/77486385 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2a900666f0 0x7f2a90068bb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0167410 tx=0x7f2aa00090e0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.292+0000 7f2ab6a00640 1 -- 172.21.15.114:0/77486385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ab00cdad0 msgr2=0x7f2ab014f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:18.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.292+0000 7f2ab6a00640 1 --2- 172.21.15.114:0/77486385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ab00cdad0 0x7f2ab014f370 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00b550 tx=0x7f2a9c00ba10 comp rx=0 tx=0).stop 2024-09-13T17:52:18.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.292+0000 7f2ab6a00640 1 -- 172.21.15.114:0/77486385 shutdown_connections 2024-09-13T17:52:18.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.292+0000 7f2ab6a00640 1 --2- 172.21.15.114:0/77486385 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2a900666f0 0x7f2a90068bb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.292+0000 7f2ab6a00640 1 --2- 172.21.15.114:0/77486385 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2ab015c820 0x7f2ab00b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.292+0000 7f2ab6a00640 1 --2- 172.21.15.114:0/77486385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ab00cf690 0x7f2ab00b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.292+0000 7f2ab6a00640 1 --2- 172.21.15.114:0/77486385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ab00cdad0 0x7f2ab014f370 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.292+0000 7f2ab6a00640 1 -- 172.21.15.114:0/77486385 >> 172.21.15.114:0/77486385 conn(0x7f2ab0066080 msgr2=0x7f2ab00d0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:18.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.292+0000 7f2ab6a00640 1 -- 172.21.15.114:0/77486385 shutdown_connections 2024-09-13T17:52:18.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.292+0000 7f2ab6a00640 1 -- 172.21.15.114:0/77486385 wait complete. 2024-09-13T17:52:18.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2024-09-13T17:52:18.314 DEBUG:teuthology.parallel:result is None 2024-09-13T17:52:18.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.320+0000 7f1d50a00640 1 -- 172.21.15.114:0/1556795556 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f1d4c0abb40 con 0x7f1d30004d10 2024-09-13T17:52:18.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.320+0000 7f1d43400640 1 -- 172.21.15.114:0/1556795556 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1d38054f10 con 0x7f1d30004d10 2024-09-13T17:52:18.322 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2024-09-13T17:52:18.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.320+0000 7f1d50a00640 1 -- 172.21.15.114:0/1556795556 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1d2c066690 msgr2=0x7f1d2c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:18.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.320+0000 7f1d50a00640 1 --2- 172.21.15.114:0/1556795556 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1d2c066690 0x7f1d2c068b50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c097fb0 tx=0x7f1d3c009040 comp rx=0 tx=0).stop 2024-09-13T17:52:18.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.320+0000 7f1d50a00640 1 -- 172.21.15.114:0/1556795556 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d30004d10 msgr2=0x7f1d4c156590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:18.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.320+0000 7f1d50a00640 1 --2- 172.21.15.114:0/1556795556 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d30004d10 0x7f1d4c156590 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1d380116d0 tx=0x7f1d38011b90 comp rx=0 tx=0).stop 2024-09-13T17:52:18.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.320+0000 7f1d50a00640 1 -- 172.21.15.114:0/1556795556 shutdown_connections 2024-09-13T17:52:18.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.320+0000 7f1d50a00640 1 --2- 172.21.15.114:0/1556795556 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1d2c066690 0x7f1d2c068b50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.320+0000 7f1d50a00640 1 --2- 172.21.15.114:0/1556795556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d4c06c7a0 0x7f1d4c06cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.320+0000 7f1d50a00640 1 --2- 172.21.15.114:0/1556795556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d4c1fdb10 0x7f1d4c1f9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.320+0000 7f1d50a00640 1 --2- 172.21.15.114:0/1556795556 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1d30004d10 0x7f1d4c156590 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.320+0000 7f1d50a00640 1 -- 172.21.15.114:0/1556795556 >> 172.21.15.114:0/1556795556 conn(0x7f1d4c0b37c0 msgr2=0x7f1d4c1ea280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:18.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.320+0000 7f1d50a00640 1 -- 172.21.15.114:0/1556795556 shutdown_connections 2024-09-13T17:52:18.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.320+0000 7f1d50a00640 1 -- 172.21.15.114:0/1556795556 wait complete. 2024-09-13T17:52:18.343 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2024-09-13T17:52:18.343 DEBUG:teuthology.parallel:result is None 2024-09-13T17:52:18.343 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T17:52:18.343 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:52:18.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.516+0000 7fa30b600640 1 Processor -- start 2024-09-13T17:52:18.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.516+0000 7fa30b600640 1 -- start start 2024-09-13T17:52:18.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.516+0000 7fa30b600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa30413c240 0x7fa30413f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:18.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.516+0000 7fa30b600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3040cd220 con 0x7fa30406dc60 2024-09-13T17:52:18.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.516+0000 7fa30b600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30413f960 con 0x7fa30413c980 2024-09-13T17:52:18.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.516+0000 7fa30b600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa30415a740 con 0x7fa30413c240 2024-09-13T17:52:18.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.516+0000 7fa309600640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa30406dc60 0x7fa3040cd650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33422/0 (socket says 172.21.15.114:33422) 2024-09-13T17:52:18.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.516+0000 7fa309600640 1 -- 172.21.15.114:0/1873853385 learned_addr learned my addr 172.21.15.114:0/1873853385 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:18.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.516+0000 7fa308c00640 1 --2- 172.21.15.114:0/1873853385 >> v2:172.21.15.134:3300/0 conn(0x7fa30413c240 0x7fa30413f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:18.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.520+0000 7fa303e00640 1 -- 172.21.15.114:0/1873853385 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457712282 0 0) 0x7fa3040cd220 con 0x7fa30406dc60 2024-09-13T17:52:18.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.520+0000 7fa303e00640 1 -- 172.21.15.114:0/1873853385 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2e8003530 con 0x7fa30406dc60 2024-09-13T17:52:18.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.520+0000 7fa308c00640 1 -- 172.21.15.114:0/1873853385 >> v1:172.21.15.134:6789/0 conn(0x7fa30413c980 legacy=0x7fa30406d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:18.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.520+0000 7fa303e00640 1 -- 172.21.15.114:0/1873853385 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 637609713 0 0) 0x7fa2ec001120 con 0x7fa30413c980 2024-09-13T17:52:18.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.520+0000 7fa308c00640 1 -- 172.21.15.114:0/1873853385 >> v1:172.21.15.114:6789/0 conn(0x7fa30406dc60 legacy=0x7fa3040cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:18.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.520+0000 7fa308c00640 1 -- 172.21.15.114:0/1873853385 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa304159bc0 con 0x7fa30413c240 2024-09-13T17:52:18.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.520+0000 7fa308c00640 1 --2- 172.21.15.114:0/1873853385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa30413c240 0x7fa30413f420 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40097c0 tx=0x7fa2f401c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e76ec7911628a271 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:18.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.520+0000 7fa303e00640 1 -- 172.21.15.114:0/1873853385 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f40ac640 con 0x7fa30413c240 2024-09-13T17:52:18.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.520+0000 7fa303e00640 1 -- 172.21.15.114:0/1873853385 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f40ac7a0 con 0x7fa30413c240 2024-09-13T17:52:18.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.520+0000 7fa303e00640 1 -- 172.21.15.114:0/1873853385 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f40acb30 con 0x7fa30413c240 2024-09-13T17:52:18.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.524+0000 7fa30b600640 1 -- 172.21.15.114:0/1873853385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa30413c240 msgr2=0x7fa30413f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:18.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.524+0000 7fa30b600640 1 --2- 172.21.15.114:0/1873853385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa30413c240 0x7fa30413f420 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40097c0 tx=0x7fa2f401c3e0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.524+0000 7fa30b600640 1 -- 172.21.15.114:0/1873853385 shutdown_connections 2024-09-13T17:52:18.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.524+0000 7fa30b600640 1 --2- 172.21.15.114:0/1873853385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa30413c240 0x7fa30413f420 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.524+0000 7fa30b600640 1 -- 172.21.15.114:0/1873853385 >> 172.21.15.114:0/1873853385 conn(0x7fa3040660b0 msgr2=0x7fa304069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:18.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.524+0000 7fa30b600640 1 -- 172.21.15.114:0/1873853385 shutdown_connections 2024-09-13T17:52:18.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.524+0000 7fa30b600640 1 -- 172.21.15.114:0/1873853385 wait complete. 2024-09-13T17:52:18.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.524+0000 7fa30b600640 1 Processor -- start 2024-09-13T17:52:18.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.524+0000 7fa30b600640 1 -- start start 2024-09-13T17:52:18.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.524+0000 7fa30b600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa30406dc60 0x7fa3040afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:18.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.524+0000 7fa30b600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa30413c240 0x7fa3040ad750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:18.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.524+0000 7fa30b600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa30413c980 0x7fa304144c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:18.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.524+0000 7fa30b600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3040ac6b0 con 0x7fa30413c240 2024-09-13T17:52:18.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.524+0000 7fa30b600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3040ac990 con 0x7fa30406dc60 2024-09-13T17:52:18.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.524+0000 7fa30b600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3040acc70 con 0x7fa30413c980 2024-09-13T17:52:18.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.524+0000 7fa2fbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa30413c240 0x7fa3040ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:18.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.524+0000 7fa2fbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa30413c240 0x7fa3040ad750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50476/0 (socket says 172.21.15.114:50476) 2024-09-13T17:52:18.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.524+0000 7fa2fbe00640 1 -- 172.21.15.114:0/2974477060 learned_addr learned my addr 172.21.15.114:0/2974477060 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:18.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.524+0000 7fa308c00640 1 --2- 172.21.15.114:0/2974477060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa30406dc60 0x7fa3040afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:18.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.524+0000 7fa309600640 1 --2- 172.21.15.114:0/2974477060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa30413c980 0x7fa304144c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:18.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.524+0000 7fa2fbe00640 1 -- 172.21.15.114:0/2974477060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa30413c980 msgr2=0x7fa304144c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:18.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.524+0000 7fa2fbe00640 1 --2- 172.21.15.114:0/2974477060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa30413c980 0x7fa304144c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.524+0000 7fa2fbe00640 1 -- 172.21.15.114:0/2974477060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa30406dc60 msgr2=0x7fa3040afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:18.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.524+0000 7fa2fbe00640 1 --2- 172.21.15.114:0/2974477060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa30406dc60 0x7fa3040afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.524+0000 7fa2fbe00640 1 -- 172.21.15.114:0/2974477060 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f4009420 con 0x7fa30413c240 2024-09-13T17:52:18.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.524+0000 7fa309600640 1 --2- 172.21.15.114:0/2974477060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa30413c980 0x7fa304144c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:18.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.524+0000 7fa2fbe00640 1 --2- 172.21.15.114:0/2974477060 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa30413c240 0x7fa3040ad750 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec001ec0 tx=0x7fa2ec00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:18.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.528+0000 7fa301600640 1 -- 172.21.15.114:0/2974477060 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec0054e0 con 0x7fa30413c240 2024-09-13T17:52:18.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.528+0000 7fa301600640 1 -- 172.21.15.114:0/2974477060 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ec003600 con 0x7fa30413c240 2024-09-13T17:52:18.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.528+0000 7fa30b600640 1 -- 172.21.15.114:0/2974477060 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3040acf50 con 0x7fa30413c240 2024-09-13T17:52:18.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.528+0000 7fa301600640 1 -- 172.21.15.114:0/2974477060 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec0039b0 con 0x7fa30413c240 2024-09-13T17:52:18.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.528+0000 7fa30b600640 1 -- 172.21.15.114:0/2974477060 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3040ac2f0 con 0x7fa30413c240 2024-09-13T17:52:18.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.528+0000 7fa30b600640 1 -- 172.21.15.114:0/2974477060 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa304159790 con 0x7fa30413c240 2024-09-13T17:52:18.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.528+0000 7fa301600640 1 -- 172.21.15.114:0/2974477060 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa2ec003b10 con 0x7fa30413c240 2024-09-13T17:52:18.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.528+0000 7fa301600640 1 --2- 172.21.15.114:0/2974477060 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa2e0066690 0x7fa2e0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:18.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.528+0000 7fa301600640 1 -- 172.21.15.114:0/2974477060 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa2ec083870 con 0x7fa30413c240 2024-09-13T17:52:18.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.528+0000 7fa308c00640 1 --2- 172.21.15.114:0/2974477060 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa2e0066690 0x7fa2e0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:18.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.528+0000 7fa308c00640 1 --2- 172.21.15.114:0/2974477060 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa2e0066690 0x7fa2e0068b50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40ae000 tx=0x7fa2f40a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:18.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.532+0000 7fa301600640 1 -- 172.21.15.114:0/2974477060 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa2ec050900 con 0x7fa30413c240 2024-09-13T17:52:18.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.684+0000 7fa30b600640 1 -- 172.21.15.114:0/2974477060 --> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3040ce170 con 0x7fa2e0066690 2024-09-13T17:52:18.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.692+0000 7fa301600640 1 -- 172.21.15.114:0/2974477060 <== mgr.4102 v2:172.21.15.114:6832/137691478 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345299 (secure 0 0 0) 0x7fa2f40ac910 con 0x7fa2e0066690 2024-09-13T17:52:18.698 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:18.700 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-13T17:52:18.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.696+0000 7fa30b600640 1 -- 172.21.15.114:0/2974477060 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa2e0066690 msgr2=0x7fa2e0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:18.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.696+0000 7fa30b600640 1 --2- 172.21.15.114:0/2974477060 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa2e0066690 0x7fa2e0068b50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40ae000 tx=0x7fa2f40a7000 comp rx=0 tx=0).stop 2024-09-13T17:52:18.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.696+0000 7fa30b600640 1 -- 172.21.15.114:0/2974477060 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa30413c240 msgr2=0x7fa3040ad750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:18.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.696+0000 7fa30b600640 1 --2- 172.21.15.114:0/2974477060 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa30413c240 0x7fa3040ad750 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec001ec0 tx=0x7fa2ec00c8e0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.696+0000 7fa30b600640 1 -- 172.21.15.114:0/2974477060 shutdown_connections 2024-09-13T17:52:18.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.696+0000 7fa30b600640 1 --2- 172.21.15.114:0/2974477060 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa2e0066690 0x7fa2e0068b50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.696+0000 7fa30b600640 1 --2- 172.21.15.114:0/2974477060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa30413c980 0x7fa304144c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.696+0000 7fa30b600640 1 --2- 172.21.15.114:0/2974477060 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa30413c240 0x7fa3040ad750 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.696+0000 7fa30b600640 1 --2- 172.21.15.114:0/2974477060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa30406dc60 0x7fa3040afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.696+0000 7fa30b600640 1 -- 172.21.15.114:0/2974477060 >> 172.21.15.114:0/2974477060 conn(0x7fa3040660b0 msgr2=0x7fa3040b22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:18.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.696+0000 7fa30b600640 1 -- 172.21.15.114:0/2974477060 shutdown_connections 2024-09-13T17:52:18.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.696+0000 7fa30b600640 1 -- 172.21.15.114:0/2974477060 wait complete. 2024-09-13T17:52:18.717 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-13T17:52:17.941186+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1988162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004085"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837772+0000","last_change":"2024-09-13T17:51:49.424735+0000","last_active":"2024-09-13T17:51:53.837772+0000","last_peered":"2024-09-13T17:51:53.837772+0000","last_clean":"2024-09-13T17:51:53.837772+0000","last_became_active":"2024-09-13T17:51:49.424461+0000","last_became_peered":"2024-09-13T17:51:49.424461+0000","last_unstale":"2024-09-13T17:51:53.837772+0000","last_undegraded":"2024-09-13T17:51:53.837772+0000","last_fullsized":"2024-09-13T17:51:53.837772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:05.776083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827298+0000","last_change":"2024-09-13T17:51:49.822366+0000","last_active":"2024-09-13T17:51:53.827298+0000","last_peered":"2024-09-13T17:51:53.827298+0000","last_clean":"2024-09-13T17:51:53.827298+0000","last_became_active":"2024-09-13T17:51:49.822088+0000","last_became_peered":"2024-09-13T17:51:49.822088+0000","last_unstale":"2024-09-13T17:51:53.827298+0000","last_undegraded":"2024-09-13T17:51:53.827298+0000","last_fullsized":"2024-09-13T17:51:53.827298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:19.843619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.898097+0000","last_change":"2024-09-13T17:51:53.888282+0000","last_active":"2024-09-13T17:51:53.898097+0000","last_peered":"2024-09-13T17:51:53.898097+0000","last_clean":"2024-09-13T17:51:53.898097+0000","last_became_active":"2024-09-13T17:51:53.887931+0000","last_became_peered":"2024-09-13T17:51:53.887931+0000","last_unstale":"2024-09-13T17:51:53.898097+0000","last_undegraded":"2024-09-13T17:51:53.898097+0000","last_fullsized":"2024-09-13T17:51:53.898097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:50:08.665223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827194+0000","last_change":"2024-09-13T17:51:49.417919+0000","last_active":"2024-09-13T17:51:53.827194+0000","last_peered":"2024-09-13T17:51:53.827194+0000","last_clean":"2024-09-13T17:51:53.827194+0000","last_became_active":"2024-09-13T17:51:49.417669+0000","last_became_peered":"2024-09-13T17:51:49.417669+0000","last_unstale":"2024-09-13T17:51:53.827194+0000","last_undegraded":"2024-09-13T17:51:53.827194+0000","last_fullsized":"2024-09-13T17:51:53.827194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:05.776083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837561+0000","last_change":"2024-09-13T17:51:49.820810+0000","last_active":"2024-09-13T17:51:53.837561+0000","last_peered":"2024-09-13T17:51:53.837561+0000","last_clean":"2024-09-13T17:51:53.837561+0000","last_became_active":"2024-09-13T17:51:49.820576+0000","last_became_peered":"2024-09-13T17:51:49.820576+0000","last_unstale":"2024-09-13T17:51:53.837561+0000","last_undegraded":"2024-09-13T17:51:53.837561+0000","last_fullsized":"2024-09-13T17:51:53.837561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:26.069550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.855045+0000","last_change":"2024-09-13T17:51:53.853653+0000","last_active":"2024-09-13T17:51:53.855045+0000","last_peered":"2024-09-13T17:51:53.855045+0000","last_clean":"2024-09-13T17:51:53.855045+0000","last_became_active":"2024-09-13T17:51:53.853265+0000","last_became_peered":"2024-09-13T17:51:53.853265+0000","last_unstale":"2024-09-13T17:51:53.855045+0000","last_undegraded":"2024-09-13T17:51:53.855045+0000","last_fullsized":"2024-09-13T17:51:53.855045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:21.706044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.884139+0000","last_change":"2024-09-13T17:51:49.429851+0000","last_active":"2024-09-13T17:51:53.884139+0000","last_peered":"2024-09-13T17:51:53.884139+0000","last_clean":"2024-09-13T17:51:53.884139+0000","last_became_active":"2024-09-13T17:51:49.428737+0000","last_became_peered":"2024-09-13T17:51:49.428737+0000","last_unstale":"2024-09-13T17:51:53.884139+0000","last_undegraded":"2024-09-13T17:51:53.884139+0000","last_fullsized":"2024-09-13T17:51:53.884139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:06.732541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.830753+0000","last_change":"2024-09-13T17:51:49.819895+0000","last_active":"2024-09-13T17:51:53.830753+0000","last_peered":"2024-09-13T17:51:53.830753+0000","last_clean":"2024-09-13T17:51:53.830753+0000","last_became_active":"2024-09-13T17:51:49.819636+0000","last_became_peered":"2024-09-13T17:51:49.819636+0000","last_unstale":"2024-09-13T17:51:53.830753+0000","last_undegraded":"2024-09-13T17:51:53.830753+0000","last_fullsized":"2024-09-13T17:51:53.830753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:16.626937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.851436+0000","last_change":"2024-09-13T17:51:53.848452+0000","last_active":"2024-09-13T17:51:53.851436+0000","last_peered":"2024-09-13T17:51:53.851436+0000","last_clean":"2024-09-13T17:51:53.851436+0000","last_became_active":"2024-09-13T17:51:53.847653+0000","last_became_peered":"2024-09-13T17:51:53.847653+0000","last_unstale":"2024-09-13T17:51:53.851436+0000","last_undegraded":"2024-09-13T17:51:53.851436+0000","last_fullsized":"2024-09-13T17:51:53.851436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:05.592560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882694+0000","last_change":"2024-09-13T17:51:49.430634+0000","last_active":"2024-09-13T17:51:53.882694+0000","last_peered":"2024-09-13T17:51:53.882694+0000","last_clean":"2024-09-13T17:51:53.882694+0000","last_became_active":"2024-09-13T17:51:49.428490+0000","last_became_peered":"2024-09-13T17:51:49.428490+0000","last_unstale":"2024-09-13T17:51:53.882694+0000","last_undegraded":"2024-09-13T17:51:53.882694+0000","last_fullsized":"2024-09-13T17:51:53.882694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:20.612271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.836270+0000","last_change":"2024-09-13T17:51:49.810371+0000","last_active":"2024-09-13T17:51:53.836270+0000","last_peered":"2024-09-13T17:51:53.836270+0000","last_clean":"2024-09-13T17:51:53.836270+0000","last_became_active":"2024-09-13T17:51:49.810008+0000","last_became_peered":"2024-09-13T17:51:49.810008+0000","last_unstale":"2024-09-13T17:51:53.836270+0000","last_undegraded":"2024-09-13T17:51:53.836270+0000","last_fullsized":"2024-09-13T17:51:53.836270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:54.519014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.851812+0000","last_change":"2024-09-13T17:51:53.850425+0000","last_active":"2024-09-13T17:51:53.851812+0000","last_peered":"2024-09-13T17:51:53.851812+0000","last_clean":"2024-09-13T17:51:53.851812+0000","last_became_active":"2024-09-13T17:51:53.848615+0000","last_became_peered":"2024-09-13T17:51:53.848615+0000","last_unstale":"2024-09-13T17:51:53.851812+0000","last_undegraded":"2024-09-13T17:51:53.851812+0000","last_fullsized":"2024-09-13T17:51:53.851812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:00.438042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827600+0000","last_change":"2024-09-13T17:51:49.814942+0000","last_active":"2024-09-13T17:51:53.827600+0000","last_peered":"2024-09-13T17:51:53.827600+0000","last_clean":"2024-09-13T17:51:53.827600+0000","last_became_active":"2024-09-13T17:51:49.814562+0000","last_became_peered":"2024-09-13T17:51:49.814562+0000","last_unstale":"2024-09-13T17:51:53.827600+0000","last_undegraded":"2024-09-13T17:51:53.827600+0000","last_fullsized":"2024-09-13T17:51:53.827600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:18.962464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882721+0000","last_change":"2024-09-13T17:51:49.426550+0000","last_active":"2024-09-13T17:51:53.882721+0000","last_peered":"2024-09-13T17:51:53.882721+0000","last_clean":"2024-09-13T17:51:53.882721+0000","last_became_active":"2024-09-13T17:51:49.424996+0000","last_became_peered":"2024-09-13T17:51:49.424996+0000","last_unstale":"2024-09-13T17:51:53.882721+0000","last_undegraded":"2024-09-13T17:51:53.882721+0000","last_fullsized":"2024-09-13T17:51:53.882721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:22.023124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.852108+0000","last_change":"2024-09-13T17:51:53.851132+0000","last_active":"2024-09-13T17:51:53.852108+0000","last_peered":"2024-09-13T17:51:53.852108+0000","last_clean":"2024-09-13T17:51:53.852108+0000","last_became_active":"2024-09-13T17:51:53.850766+0000","last_became_peered":"2024-09-13T17:51:53.850766+0000","last_unstale":"2024-09-13T17:51:53.852108+0000","last_undegraded":"2024-09-13T17:51:53.852108+0000","last_fullsized":"2024-09-13T17:51:53.852108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:28.299853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.825693+0000","last_change":"2024-09-13T17:51:49.827994+0000","last_active":"2024-09-13T17:51:53.825693+0000","last_peered":"2024-09-13T17:51:53.825693+0000","last_clean":"2024-09-13T17:51:53.825693+0000","last_became_active":"2024-09-13T17:51:49.827737+0000","last_became_peered":"2024-09-13T17:51:49.827737+0000","last_unstale":"2024-09-13T17:51:53.825693+0000","last_undegraded":"2024-09-13T17:51:53.825693+0000","last_fullsized":"2024-09-13T17:51:53.825693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:18.962464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827386+0000","last_change":"2024-09-13T17:51:49.421799+0000","last_active":"2024-09-13T17:51:53.827386+0000","last_peered":"2024-09-13T17:51:53.827386+0000","last_clean":"2024-09-13T17:51:53.827386+0000","last_became_active":"2024-09-13T17:51:49.420657+0000","last_became_peered":"2024-09-13T17:51:49.420657+0000","last_unstale":"2024-09-13T17:51:53.827386+0000","last_undegraded":"2024-09-13T17:51:53.827386+0000","last_fullsized":"2024-09-13T17:51:53.827386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:53.206793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.843724+0000","last_change":"2024-09-13T17:51:53.843027+0000","last_active":"2024-09-13T17:51:53.843724+0000","last_peered":"2024-09-13T17:51:53.843724+0000","last_clean":"2024-09-13T17:51:53.843724+0000","last_became_active":"2024-09-13T17:51:53.842576+0000","last_became_peered":"2024-09-13T17:51:53.842576+0000","last_unstale":"2024-09-13T17:51:53.843724+0000","last_undegraded":"2024-09-13T17:51:53.843724+0000","last_fullsized":"2024-09-13T17:51:53.843724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:04.738599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826762+0000","last_change":"2024-09-13T17:51:49.820882+0000","last_active":"2024-09-13T17:51:53.826762+0000","last_peered":"2024-09-13T17:51:53.826762+0000","last_clean":"2024-09-13T17:51:53.826762+0000","last_became_active":"2024-09-13T17:51:49.820420+0000","last_became_peered":"2024-09-13T17:51:49.820420+0000","last_unstale":"2024-09-13T17:51:53.826762+0000","last_undegraded":"2024-09-13T17:51:53.826762+0000","last_fullsized":"2024-09-13T17:51:53.826762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:38.101006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.824631+0000","last_change":"2024-09-13T17:51:49.411703+0000","last_active":"2024-09-13T17:51:53.824631+0000","last_peered":"2024-09-13T17:51:53.824631+0000","last_clean":"2024-09-13T17:51:53.824631+0000","last_became_active":"2024-09-13T17:51:49.411421+0000","last_became_peered":"2024-09-13T17:51:49.411421+0000","last_unstale":"2024-09-13T17:51:53.824631+0000","last_undegraded":"2024-09-13T17:51:53.824631+0000","last_fullsized":"2024-09-13T17:51:53.824631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:06.421994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.888157+0000","last_change":"2024-09-13T17:51:53.884773+0000","last_active":"2024-09-13T17:51:53.888157+0000","last_peered":"2024-09-13T17:51:53.888157+0000","last_clean":"2024-09-13T17:51:53.888157+0000","last_became_active":"2024-09-13T17:51:53.884392+0000","last_became_peered":"2024-09-13T17:51:53.884392+0000","last_unstale":"2024-09-13T17:51:53.888157+0000","last_undegraded":"2024-09-13T17:51:53.888157+0000","last_fullsized":"2024-09-13T17:51:53.888157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:35.046158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.834403+0000","last_change":"2024-09-13T17:51:49.810146+0000","last_active":"2024-09-13T17:51:53.834403+0000","last_peered":"2024-09-13T17:51:53.834403+0000","last_clean":"2024-09-13T17:51:53.834403+0000","last_became_active":"2024-09-13T17:51:49.809659+0000","last_became_peered":"2024-09-13T17:51:49.809659+0000","last_unstale":"2024-09-13T17:51:53.834403+0000","last_undegraded":"2024-09-13T17:51:53.834403+0000","last_fullsized":"2024-09-13T17:51:53.834403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:22.017119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882255+0000","last_change":"2024-09-13T17:51:49.420646+0000","last_active":"2024-09-13T17:51:53.882255+0000","last_peered":"2024-09-13T17:51:53.882255+0000","last_clean":"2024-09-13T17:51:53.882255+0000","last_became_active":"2024-09-13T17:51:49.420353+0000","last_became_peered":"2024-09-13T17:51:49.420353+0000","last_unstale":"2024-09-13T17:51:53.882255+0000","last_undegraded":"2024-09-13T17:51:53.882255+0000","last_fullsized":"2024-09-13T17:51:53.882255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:21.010810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.851627+0000","last_change":"2024-09-13T17:51:53.849048+0000","last_active":"2024-09-13T17:51:53.851627+0000","last_peered":"2024-09-13T17:51:53.851627+0000","last_clean":"2024-09-13T17:51:53.851627+0000","last_became_active":"2024-09-13T17:51:53.848610+0000","last_became_peered":"2024-09-13T17:51:53.848610+0000","last_unstale":"2024-09-13T17:51:53.851627+0000","last_undegraded":"2024-09-13T17:51:53.851627+0000","last_fullsized":"2024-09-13T17:51:53.851627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:23.757828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837389+0000","last_change":"2024-09-13T17:51:49.813776+0000","last_active":"2024-09-13T17:51:53.837389+0000","last_peered":"2024-09-13T17:51:53.837389+0000","last_clean":"2024-09-13T17:51:53.837389+0000","last_became_active":"2024-09-13T17:51:49.813446+0000","last_became_peered":"2024-09-13T17:51:49.813446+0000","last_unstale":"2024-09-13T17:51:53.837389+0000","last_undegraded":"2024-09-13T17:51:53.837389+0000","last_fullsized":"2024-09-13T17:51:53.837389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:38.101006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827985+0000","last_change":"2024-09-13T17:51:49.424387+0000","last_active":"2024-09-13T17:51:53.827985+0000","last_peered":"2024-09-13T17:51:53.827985+0000","last_clean":"2024-09-13T17:51:53.827985+0000","last_became_active":"2024-09-13T17:51:49.424056+0000","last_became_peered":"2024-09-13T17:51:49.424056+0000","last_unstale":"2024-09-13T17:51:53.827985+0000","last_undegraded":"2024-09-13T17:51:53.827985+0000","last_fullsized":"2024-09-13T17:51:53.827985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:39.329721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.890240+0000","last_change":"2024-09-13T17:51:53.887729+0000","last_active":"2024-09-13T17:51:53.890240+0000","last_peered":"2024-09-13T17:51:53.890240+0000","last_clean":"2024-09-13T17:51:53.890240+0000","last_became_active":"2024-09-13T17:51:53.887339+0000","last_became_peered":"2024-09-13T17:51:53.887339+0000","last_unstale":"2024-09-13T17:51:53.890240+0000","last_undegraded":"2024-09-13T17:51:53.890240+0000","last_fullsized":"2024-09-13T17:51:53.890240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:46.649388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.829910+0000","last_change":"2024-09-13T17:51:49.826015+0000","last_active":"2024-09-13T17:51:53.829910+0000","last_peered":"2024-09-13T17:51:53.829910+0000","last_clean":"2024-09-13T17:51:53.829910+0000","last_became_active":"2024-09-13T17:51:49.825697+0000","last_became_peered":"2024-09-13T17:51:49.825697+0000","last_unstale":"2024-09-13T17:51:53.829910+0000","last_undegraded":"2024-09-13T17:51:53.829910+0000","last_fullsized":"2024-09-13T17:51:53.829910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:12.044921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826611+0000","last_change":"2024-09-13T17:51:49.421246+0000","last_active":"2024-09-13T17:51:53.826611+0000","last_peered":"2024-09-13T17:51:53.826611+0000","last_clean":"2024-09-13T17:51:53.826611+0000","last_became_active":"2024-09-13T17:51:49.419599+0000","last_became_peered":"2024-09-13T17:51:49.419599+0000","last_unstale":"2024-09-13T17:51:53.826611+0000","last_undegraded":"2024-09-13T17:51:53.826611+0000","last_fullsized":"2024-09-13T17:51:53.826611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:22.023124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.898030+0000","last_change":"2024-09-13T17:51:53.886455+0000","last_active":"2024-09-13T17:51:53.898030+0000","last_peered":"2024-09-13T17:51:53.898030+0000","last_clean":"2024-09-13T17:51:53.898030+0000","last_became_active":"2024-09-13T17:51:53.885310+0000","last_became_peered":"2024-09-13T17:51:53.885310+0000","last_unstale":"2024-09-13T17:51:53.898030+0000","last_undegraded":"2024-09-13T17:51:53.898030+0000","last_fullsized":"2024-09-13T17:51:53.898030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:20.352407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.824729+0000","last_change":"2024-09-13T17:51:49.810357+0000","last_active":"2024-09-13T17:51:53.824729+0000","last_peered":"2024-09-13T17:51:53.824729+0000","last_clean":"2024-09-13T17:51:53.824729+0000","last_became_active":"2024-09-13T17:51:49.810114+0000","last_became_peered":"2024-09-13T17:51:49.810114+0000","last_unstale":"2024-09-13T17:51:53.824729+0000","last_undegraded":"2024-09-13T17:51:53.824729+0000","last_fullsized":"2024-09-13T17:51:53.824729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:16.626937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.884340+0000","last_change":"2024-09-13T17:51:49.423732+0000","last_active":"2024-09-13T17:51:53.884340+0000","last_peered":"2024-09-13T17:51:53.884340+0000","last_clean":"2024-09-13T17:51:53.884340+0000","last_became_active":"2024-09-13T17:51:49.422959+0000","last_became_peered":"2024-09-13T17:51:49.422959+0000","last_unstale":"2024-09-13T17:51:53.884340+0000","last_undegraded":"2024-09-13T17:51:53.884340+0000","last_fullsized":"2024-09-13T17:51:53.884340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:07.122247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.888684+0000","last_change":"2024-09-13T17:51:53.884526+0000","last_active":"2024-09-13T17:51:53.888684+0000","last_peered":"2024-09-13T17:51:53.888684+0000","last_clean":"2024-09-13T17:51:53.888684+0000","last_became_active":"2024-09-13T17:51:53.884114+0000","last_became_peered":"2024-09-13T17:51:53.884114+0000","last_unstale":"2024-09-13T17:51:53.888684+0000","last_undegraded":"2024-09-13T17:51:53.888684+0000","last_fullsized":"2024-09-13T17:51:53.888684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:11.718873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.836339+0000","last_change":"2024-09-13T17:51:49.830157+0000","last_active":"2024-09-13T17:51:53.836339+0000","last_peered":"2024-09-13T17:51:53.836339+0000","last_clean":"2024-09-13T17:51:53.836339+0000","last_became_active":"2024-09-13T17:51:49.829791+0000","last_became_peered":"2024-09-13T17:51:49.829791+0000","last_unstale":"2024-09-13T17:51:53.836339+0000","last_undegraded":"2024-09-13T17:51:53.836339+0000","last_fullsized":"2024-09-13T17:51:53.836339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:34.576074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826239+0000","last_change":"2024-09-13T17:51:49.417458+0000","last_active":"2024-09-13T17:51:53.826239+0000","last_peered":"2024-09-13T17:51:53.826239+0000","last_clean":"2024-09-13T17:51:53.826239+0000","last_became_active":"2024-09-13T17:51:49.417205+0000","last_became_peered":"2024-09-13T17:51:49.417205+0000","last_unstale":"2024-09-13T17:51:53.826239+0000","last_undegraded":"2024-09-13T17:51:53.826239+0000","last_fullsized":"2024-09-13T17:51:53.826239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:20.612271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.854428+0000","last_change":"2024-09-13T17:51:53.850163+0000","last_active":"2024-09-13T17:51:53.854428+0000","last_peered":"2024-09-13T17:51:53.854428+0000","last_clean":"2024-09-13T17:51:53.854428+0000","last_became_active":"2024-09-13T17:51:53.847840+0000","last_became_peered":"2024-09-13T17:51:53.847840+0000","last_unstale":"2024-09-13T17:51:53.854428+0000","last_undegraded":"2024-09-13T17:51:53.854428+0000","last_fullsized":"2024-09-13T17:51:53.854428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:04.738599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.834848+0000","last_change":"2024-09-13T17:51:49.807208+0000","last_active":"2024-09-13T17:51:53.834848+0000","last_peered":"2024-09-13T17:51:53.834848+0000","last_clean":"2024-09-13T17:51:53.834848+0000","last_became_active":"2024-09-13T17:51:49.806837+0000","last_became_peered":"2024-09-13T17:51:49.806837+0000","last_unstale":"2024-09-13T17:51:53.834848+0000","last_undegraded":"2024-09-13T17:51:53.834848+0000","last_fullsized":"2024-09-13T17:51:53.834848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:21.618580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.838674+0000","last_change":"2024-09-13T17:51:49.422538+0000","last_active":"2024-09-13T17:51:53.838674+0000","last_peered":"2024-09-13T17:51:53.838674+0000","last_clean":"2024-09-13T17:51:53.838674+0000","last_became_active":"2024-09-13T17:51:49.422079+0000","last_became_peered":"2024-09-13T17:51:49.422079+0000","last_unstale":"2024-09-13T17:51:53.838674+0000","last_undegraded":"2024-09-13T17:51:53.838674+0000","last_fullsized":"2024-09-13T17:51:53.838674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:01.166296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.853333+0000","last_change":"2024-09-13T17:51:53.848470+0000","last_active":"2024-09-13T17:51:53.853333+0000","last_peered":"2024-09-13T17:51:53.853333+0000","last_clean":"2024-09-13T17:51:53.853333+0000","last_became_active":"2024-09-13T17:51:53.847907+0000","last_became_peered":"2024-09-13T17:51:53.847907+0000","last_unstale":"2024-09-13T17:51:53.853333+0000","last_undegraded":"2024-09-13T17:51:53.853333+0000","last_fullsized":"2024-09-13T17:51:53.853333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:01.791551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.824107+0000","last_change":"2024-09-13T17:51:49.803724+0000","last_active":"2024-09-13T17:51:53.824107+0000","last_peered":"2024-09-13T17:51:53.824107+0000","last_clean":"2024-09-13T17:51:53.824107+0000","last_became_active":"2024-09-13T17:51:49.803488+0000","last_became_peered":"2024-09-13T17:51:49.803488+0000","last_unstale":"2024-09-13T17:51:53.824107+0000","last_undegraded":"2024-09-13T17:51:53.824107+0000","last_fullsized":"2024-09-13T17:51:53.824107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:18.962464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.838227+0000","last_change":"2024-09-13T17:51:49.420825+0000","last_active":"2024-09-13T17:51:53.838227+0000","last_peered":"2024-09-13T17:51:53.838227+0000","last_clean":"2024-09-13T17:51:53.838227+0000","last_became_active":"2024-09-13T17:51:49.420459+0000","last_became_peered":"2024-09-13T17:51:49.420459+0000","last_unstale":"2024-09-13T17:51:53.838227+0000","last_undegraded":"2024-09-13T17:51:53.838227+0000","last_fullsized":"2024-09-13T17:51:53.838227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:05.515948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.847206+0000","last_change":"2024-09-13T17:51:53.842609+0000","last_active":"2024-09-13T17:51:53.847206+0000","last_peered":"2024-09-13T17:51:53.847206+0000","last_clean":"2024-09-13T17:51:53.847206+0000","last_became_active":"2024-09-13T17:51:53.842195+0000","last_became_peered":"2024-09-13T17:51:53.842195+0000","last_unstale":"2024-09-13T17:51:53.847206+0000","last_undegraded":"2024-09-13T17:51:53.847206+0000","last_fullsized":"2024-09-13T17:51:53.847206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:48:59.044958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.835739+0000","last_change":"2024-09-13T17:51:49.803582+0000","last_active":"2024-09-13T17:51:53.835739+0000","last_peered":"2024-09-13T17:51:53.835739+0000","last_clean":"2024-09-13T17:51:53.835739+0000","last_became_active":"2024-09-13T17:51:49.803242+0000","last_became_peered":"2024-09-13T17:51:49.803242+0000","last_unstale":"2024-09-13T17:51:53.835739+0000","last_undegraded":"2024-09-13T17:51:53.835739+0000","last_fullsized":"2024-09-13T17:51:53.835739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:35.902537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882372+0000","last_change":"2024-09-13T17:51:49.427107+0000","last_active":"2024-09-13T17:51:53.882372+0000","last_peered":"2024-09-13T17:51:53.882372+0000","last_clean":"2024-09-13T17:51:53.882372+0000","last_became_active":"2024-09-13T17:51:49.426867+0000","last_became_peered":"2024-09-13T17:51:49.426867+0000","last_unstale":"2024-09-13T17:51:53.882372+0000","last_undegraded":"2024-09-13T17:51:53.882372+0000","last_fullsized":"2024-09-13T17:51:53.882372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:53.206793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.888656+0000","last_change":"2024-09-13T17:51:53.884097+0000","last_active":"2024-09-13T17:51:53.888656+0000","last_peered":"2024-09-13T17:51:53.888656+0000","last_clean":"2024-09-13T17:51:53.888656+0000","last_became_active":"2024-09-13T17:51:53.883622+0000","last_became_peered":"2024-09-13T17:51:53.883622+0000","last_unstale":"2024-09-13T17:51:53.888656+0000","last_undegraded":"2024-09-13T17:51:53.888656+0000","last_fullsized":"2024-09-13T17:51:53.888656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:46.649388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826078+0000","last_change":"2024-09-13T17:51:49.838792+0000","last_active":"2024-09-13T17:51:53.826078+0000","last_peered":"2024-09-13T17:51:53.826078+0000","last_clean":"2024-09-13T17:51:53.826078+0000","last_became_active":"2024-09-13T17:51:49.838580+0000","last_became_peered":"2024-09-13T17:51:49.838580+0000","last_unstale":"2024-09-13T17:51:53.826078+0000","last_undegraded":"2024-09-13T17:51:53.826078+0000","last_fullsized":"2024-09-13T17:51:53.826078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:21.449832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.834191+0000","last_change":"2024-09-13T17:51:49.416568+0000","last_active":"2024-09-13T17:51:53.834191+0000","last_peered":"2024-09-13T17:51:53.834191+0000","last_clean":"2024-09-13T17:51:53.834191+0000","last_became_active":"2024-09-13T17:51:49.416233+0000","last_became_peered":"2024-09-13T17:51:49.416233+0000","last_unstale":"2024-09-13T17:51:53.834191+0000","last_undegraded":"2024-09-13T17:51:53.834191+0000","last_fullsized":"2024-09-13T17:51:53.834191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:39.329721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882384+0000","last_change":"2024-09-13T17:51:40.205691+0000","last_active":"2024-09-13T17:51:53.882384+0000","last_peered":"2024-09-13T17:51:53.882384+0000","last_clean":"2024-09-13T17:51:53.882384+0000","last_became_active":"2024-09-13T17:51:40.204577+0000","last_became_peered":"2024-09-13T17:51:40.204577+0000","last_unstale":"2024-09-13T17:51:53.882384+0000","last_undegraded":"2024-09-13T17:51:53.882384+0000","last_fullsized":"2024-09-13T17:51:53.882384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_clean_scrub_stamp":"2024-09-13T17:51:38.340495+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:37.899275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.889483+0000","last_change":"2024-09-13T17:51:53.885726+0000","last_active":"2024-09-13T17:51:53.889483+0000","last_peered":"2024-09-13T17:51:53.889483+0000","last_clean":"2024-09-13T17:51:53.889483+0000","last_became_active":"2024-09-13T17:51:53.885225+0000","last_became_peered":"2024-09-13T17:51:53.885225+0000","last_unstale":"2024-09-13T17:51:53.889483+0000","last_undegraded":"2024-09-13T17:51:53.889483+0000","last_fullsized":"2024-09-13T17:51:53.889483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:56.070629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.884041+0000","last_change":"2024-09-13T17:51:49.838216+0000","last_active":"2024-09-13T17:51:53.884041+0000","last_peered":"2024-09-13T17:51:53.884041+0000","last_clean":"2024-09-13T17:51:53.884041+0000","last_became_active":"2024-09-13T17:51:49.838023+0000","last_became_peered":"2024-09-13T17:51:49.838023+0000","last_unstale":"2024-09-13T17:51:53.884041+0000","last_undegraded":"2024-09-13T17:51:53.884041+0000","last_fullsized":"2024-09-13T17:51:53.884041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:01.703358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.838525+0000","last_change":"2024-09-13T17:51:49.425601+0000","last_active":"2024-09-13T17:51:53.838525+0000","last_peered":"2024-09-13T17:51:53.838525+0000","last_clean":"2024-09-13T17:51:53.838525+0000","last_became_active":"2024-09-13T17:51:49.425289+0000","last_became_peered":"2024-09-13T17:51:49.425289+0000","last_unstale":"2024-09-13T17:51:53.838525+0000","last_undegraded":"2024-09-13T17:51:53.838525+0000","last_fullsized":"2024-09-13T17:51:53.838525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:06.421994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.888637+0000","last_change":"2024-09-13T17:51:53.885100+0000","last_active":"2024-09-13T17:51:53.888637+0000","last_peered":"2024-09-13T17:51:53.888637+0000","last_clean":"2024-09-13T17:51:53.888637+0000","last_became_active":"2024-09-13T17:51:53.884217+0000","last_became_peered":"2024-09-13T17:51:53.884217+0000","last_unstale":"2024-09-13T17:51:53.888637+0000","last_undegraded":"2024-09-13T17:51:53.888637+0000","last_fullsized":"2024-09-13T17:51:53.888637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:01.791551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.830819+0000","last_change":"2024-09-13T17:51:49.830458+0000","last_active":"2024-09-13T17:51:53.830819+0000","last_peered":"2024-09-13T17:51:53.830819+0000","last_clean":"2024-09-13T17:51:53.830819+0000","last_became_active":"2024-09-13T17:51:49.830026+0000","last_became_peered":"2024-09-13T17:51:49.830026+0000","last_unstale":"2024-09-13T17:51:53.830819+0000","last_undegraded":"2024-09-13T17:51:53.830819+0000","last_fullsized":"2024-09-13T17:51:53.830819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:37.125958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826446+0000","last_change":"2024-09-13T17:51:49.416301+0000","last_active":"2024-09-13T17:51:53.826446+0000","last_peered":"2024-09-13T17:51:53.826446+0000","last_clean":"2024-09-13T17:51:53.826446+0000","last_became_active":"2024-09-13T17:51:49.416065+0000","last_became_peered":"2024-09-13T17:51:49.416065+0000","last_unstale":"2024-09-13T17:51:53.826446+0000","last_undegraded":"2024-09-13T17:51:53.826446+0000","last_fullsized":"2024-09-13T17:51:53.826446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:42.283317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.847340+0000","last_change":"2024-09-13T17:51:53.844047+0000","last_active":"2024-09-13T17:51:53.847340+0000","last_peered":"2024-09-13T17:51:53.847340+0000","last_clean":"2024-09-13T17:51:53.847340+0000","last_became_active":"2024-09-13T17:51:53.843665+0000","last_became_peered":"2024-09-13T17:51:53.843665+0000","last_unstale":"2024-09-13T17:51:53.847340+0000","last_undegraded":"2024-09-13T17:51:53.847340+0000","last_fullsized":"2024-09-13T17:51:53.847340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:04.738599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.884913+0000","last_change":"2024-09-13T17:51:49.836513+0000","last_active":"2024-09-13T17:51:53.884913+0000","last_peered":"2024-09-13T17:51:53.884913+0000","last_clean":"2024-09-13T17:51:53.884913+0000","last_became_active":"2024-09-13T17:51:49.836232+0000","last_became_peered":"2024-09-13T17:51:49.836232+0000","last_unstale":"2024-09-13T17:51:53.884913+0000","last_undegraded":"2024-09-13T17:51:53.884913+0000","last_fullsized":"2024-09-13T17:51:53.884913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:37.125958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.841145+0000","last_change":"2024-09-13T17:51:49.420678+0000","last_active":"2024-09-13T17:51:53.841145+0000","last_peered":"2024-09-13T17:51:53.841145+0000","last_clean":"2024-09-13T17:51:53.841145+0000","last_became_active":"2024-09-13T17:51:49.420418+0000","last_became_peered":"2024-09-13T17:51:49.420418+0000","last_unstale":"2024-09-13T17:51:53.841145+0000","last_undegraded":"2024-09-13T17:51:53.841145+0000","last_fullsized":"2024-09-13T17:51:53.841145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:42.283317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.889765+0000","last_change":"2024-09-13T17:51:53.886172+0000","last_active":"2024-09-13T17:51:53.889765+0000","last_peered":"2024-09-13T17:51:53.889765+0000","last_clean":"2024-09-13T17:51:53.889765+0000","last_became_active":"2024-09-13T17:51:53.885826+0000","last_became_peered":"2024-09-13T17:51:53.885826+0000","last_unstale":"2024-09-13T17:51:53.889765+0000","last_undegraded":"2024-09-13T17:51:53.889765+0000","last_fullsized":"2024-09-13T17:51:53.889765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:46.649388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.885762+0000","last_change":"2024-09-13T17:51:49.834991+0000","last_active":"2024-09-13T17:51:53.885762+0000","last_peered":"2024-09-13T17:51:53.885762+0000","last_clean":"2024-09-13T17:51:53.885762+0000","last_became_active":"2024-09-13T17:51:49.834740+0000","last_became_peered":"2024-09-13T17:51:49.834740+0000","last_unstale":"2024-09-13T17:51:53.885762+0000","last_undegraded":"2024-09-13T17:51:53.885762+0000","last_fullsized":"2024-09-13T17:51:53.885762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:47.337762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.834831+0000","last_change":"2024-09-13T17:51:49.415586+0000","last_active":"2024-09-13T17:51:53.834831+0000","last_peered":"2024-09-13T17:51:53.834831+0000","last_clean":"2024-09-13T17:51:53.834831+0000","last_became_active":"2024-09-13T17:51:49.415184+0000","last_became_peered":"2024-09-13T17:51:49.415184+0000","last_unstale":"2024-09-13T17:51:53.834831+0000","last_undegraded":"2024-09-13T17:51:53.834831+0000","last_fullsized":"2024-09-13T17:51:53.834831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:38.364524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.851409+0000","last_change":"2024-09-13T17:51:53.848234+0000","last_active":"2024-09-13T17:51:53.851409+0000","last_peered":"2024-09-13T17:51:53.851409+0000","last_clean":"2024-09-13T17:51:53.851409+0000","last_became_active":"2024-09-13T17:51:53.847557+0000","last_became_peered":"2024-09-13T17:51:53.847557+0000","last_unstale":"2024-09-13T17:51:53.851409+0000","last_undegraded":"2024-09-13T17:51:53.851409+0000","last_fullsized":"2024-09-13T17:51:53.851409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:51.251781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.883636+0000","last_change":"2024-09-13T17:51:49.830867+0000","last_active":"2024-09-13T17:51:53.883636+0000","last_peered":"2024-09-13T17:51:53.883636+0000","last_clean":"2024-09-13T17:51:53.883636+0000","last_became_active":"2024-09-13T17:51:49.830584+0000","last_became_peered":"2024-09-13T17:51:49.830584+0000","last_unstale":"2024-09-13T17:51:53.883636+0000","last_undegraded":"2024-09-13T17:51:53.883636+0000","last_fullsized":"2024-09-13T17:51:53.883636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:51.162047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837955+0000","last_change":"2024-09-13T17:51:49.424019+0000","last_active":"2024-09-13T17:51:53.837955+0000","last_peered":"2024-09-13T17:51:53.837955+0000","last_clean":"2024-09-13T17:51:53.837955+0000","last_became_active":"2024-09-13T17:51:49.423710+0000","last_became_peered":"2024-09-13T17:51:49.423710+0000","last_unstale":"2024-09-13T17:51:53.837955+0000","last_undegraded":"2024-09-13T17:51:53.837955+0000","last_fullsized":"2024-09-13T17:51:53.837955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:01.166296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.849553+0000","last_change":"2024-09-13T17:51:53.844911+0000","last_active":"2024-09-13T17:51:53.849553+0000","last_peered":"2024-09-13T17:51:53.849553+0000","last_clean":"2024-09-13T17:51:53.849553+0000","last_became_active":"2024-09-13T17:51:53.844550+0000","last_became_peered":"2024-09-13T17:51:53.844550+0000","last_unstale":"2024-09-13T17:51:53.849553+0000","last_undegraded":"2024-09-13T17:51:53.849553+0000","last_fullsized":"2024-09-13T17:51:53.849553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:28.299853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826947+0000","last_change":"2024-09-13T17:51:49.811086+0000","last_active":"2024-09-13T17:51:53.826947+0000","last_peered":"2024-09-13T17:51:53.826947+0000","last_clean":"2024-09-13T17:51:53.826947+0000","last_became_active":"2024-09-13T17:51:49.810823+0000","last_became_peered":"2024-09-13T17:51:49.810823+0000","last_unstale":"2024-09-13T17:51:53.826947+0000","last_undegraded":"2024-09-13T17:51:53.826947+0000","last_fullsized":"2024-09-13T17:51:53.826947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:14.458841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827359+0000","last_change":"2024-09-13T17:51:49.426895+0000","last_active":"2024-09-13T17:51:53.827359+0000","last_peered":"2024-09-13T17:51:53.827359+0000","last_clean":"2024-09-13T17:51:53.827359+0000","last_became_active":"2024-09-13T17:51:49.426624+0000","last_became_peered":"2024-09-13T17:51:49.426624+0000","last_unstale":"2024-09-13T17:51:53.827359+0000","last_undegraded":"2024-09-13T17:51:53.827359+0000","last_fullsized":"2024-09-13T17:51:53.827359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:42.283317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.897944+0000","last_change":"2024-09-13T17:51:53.885895+0000","last_active":"2024-09-13T17:51:53.897944+0000","last_peered":"2024-09-13T17:51:53.897944+0000","last_clean":"2024-09-13T17:51:53.897944+0000","last_became_active":"2024-09-13T17:51:53.884841+0000","last_became_peered":"2024-09-13T17:51:53.884841+0000","last_unstale":"2024-09-13T17:51:53.897944+0000","last_undegraded":"2024-09-13T17:51:53.897944+0000","last_fullsized":"2024-09-13T17:51:53.897944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:27.675643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882609+0000","last_change":"2024-09-13T17:51:49.831817+0000","last_active":"2024-09-13T17:51:53.882609+0000","last_peered":"2024-09-13T17:51:53.882609+0000","last_clean":"2024-09-13T17:51:53.882609+0000","last_became_active":"2024-09-13T17:51:49.831354+0000","last_became_peered":"2024-09-13T17:51:49.831354+0000","last_unstale":"2024-09-13T17:51:53.882609+0000","last_undegraded":"2024-09-13T17:51:53.882609+0000","last_fullsized":"2024-09-13T17:51:53.882609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:04.470664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.838565+0000","last_change":"2024-09-13T17:51:49.422566+0000","last_active":"2024-09-13T17:51:53.838565+0000","last_peered":"2024-09-13T17:51:53.838565+0000","last_clean":"2024-09-13T17:51:53.838565+0000","last_became_active":"2024-09-13T17:51:49.421786+0000","last_became_peered":"2024-09-13T17:51:49.421786+0000","last_unstale":"2024-09-13T17:51:53.838565+0000","last_undegraded":"2024-09-13T17:51:53.838565+0000","last_fullsized":"2024-09-13T17:51:53.838565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:42.283317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.897908+0000","last_change":"2024-09-13T17:51:53.884841+0000","last_active":"2024-09-13T17:51:53.897908+0000","last_peered":"2024-09-13T17:51:53.897908+0000","last_clean":"2024-09-13T17:51:53.897908+0000","last_became_active":"2024-09-13T17:51:53.884135+0000","last_became_peered":"2024-09-13T17:51:53.884135+0000","last_unstale":"2024-09-13T17:51:53.897908+0000","last_undegraded":"2024-09-13T17:51:53.897908+0000","last_fullsized":"2024-09-13T17:51:53.897908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:53.766560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.836501+0000","last_change":"2024-09-13T17:51:49.824264+0000","last_active":"2024-09-13T17:51:53.836501+0000","last_peered":"2024-09-13T17:51:53.836501+0000","last_clean":"2024-09-13T17:51:53.836501+0000","last_became_active":"2024-09-13T17:51:49.823959+0000","last_became_peered":"2024-09-13T17:51:49.823959+0000","last_unstale":"2024-09-13T17:51:53.836501+0000","last_undegraded":"2024-09-13T17:51:53.836501+0000","last_fullsized":"2024-09-13T17:51:53.836501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:19.843619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837204+0000","last_change":"2024-09-13T17:51:49.425477+0000","last_active":"2024-09-13T17:51:53.837204+0000","last_peered":"2024-09-13T17:51:53.837204+0000","last_clean":"2024-09-13T17:51:53.837204+0000","last_became_active":"2024-09-13T17:51:49.425220+0000","last_became_peered":"2024-09-13T17:51:49.425220+0000","last_unstale":"2024-09-13T17:51:53.837204+0000","last_undegraded":"2024-09-13T17:51:53.837204+0000","last_fullsized":"2024-09-13T17:51:53.837204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:38.364524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.887527+0000","last_change":"2024-09-13T17:51:53.883758+0000","last_active":"2024-09-13T17:51:53.887527+0000","last_peered":"2024-09-13T17:51:53.887527+0000","last_clean":"2024-09-13T17:51:53.887527+0000","last_became_active":"2024-09-13T17:51:53.883328+0000","last_became_peered":"2024-09-13T17:51:53.883328+0000","last_unstale":"2024-09-13T17:51:53.887527+0000","last_undegraded":"2024-09-13T17:51:53.887527+0000","last_fullsized":"2024-09-13T17:51:53.887527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:39.243101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882767+0000","last_change":"2024-09-13T17:51:49.832481+0000","last_active":"2024-09-13T17:51:53.882767+0000","last_peered":"2024-09-13T17:51:53.882767+0000","last_clean":"2024-09-13T17:51:53.882767+0000","last_became_active":"2024-09-13T17:51:49.832173+0000","last_became_peered":"2024-09-13T17:51:49.832173+0000","last_unstale":"2024-09-13T17:51:53.882767+0000","last_undegraded":"2024-09-13T17:51:53.882767+0000","last_fullsized":"2024-09-13T17:51:53.882767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:34.576074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:51:59.930293+0000","last_change":"2024-09-13T17:51:49.430279+0000","last_active":"2024-09-13T17:51:59.930293+0000","last_peered":"2024-09-13T17:51:59.930293+0000","last_clean":"2024-09-13T17:51:59.930293+0000","last_became_active":"2024-09-13T17:51:49.430015+0000","last_became_peered":"2024-09-13T17:51:49.430015+0000","last_unstale":"2024-09-13T17:51:59.930293+0000","last_undegraded":"2024-09-13T17:51:59.930293+0000","last_fullsized":"2024-09-13T17:51:59.930293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:53.206793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.853325+0000","last_change":"2024-09-13T17:51:53.848938+0000","last_active":"2024-09-13T17:51:53.853325+0000","last_peered":"2024-09-13T17:51:53.853325+0000","last_clean":"2024-09-13T17:51:53.853325+0000","last_became_active":"2024-09-13T17:51:53.848420+0000","last_became_peered":"2024-09-13T17:51:53.848420+0000","last_unstale":"2024-09-13T17:51:53.853325+0000","last_undegraded":"2024-09-13T17:51:53.853325+0000","last_fullsized":"2024-09-13T17:51:53.853325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:06.615337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.834925+0000","last_change":"2024-09-13T17:51:49.827666+0000","last_active":"2024-09-13T17:51:53.834925+0000","last_peered":"2024-09-13T17:51:53.834925+0000","last_clean":"2024-09-13T17:51:53.834925+0000","last_became_active":"2024-09-13T17:51:49.827010+0000","last_became_peered":"2024-09-13T17:51:49.827010+0000","last_unstale":"2024-09-13T17:51:53.834925+0000","last_undegraded":"2024-09-13T17:51:53.834925+0000","last_fullsized":"2024-09-13T17:51:53.834925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:23.029433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826358+0000","last_change":"2024-09-13T17:51:49.421670+0000","last_active":"2024-09-13T17:51:53.826358+0000","last_peered":"2024-09-13T17:51:53.826358+0000","last_clean":"2024-09-13T17:51:53.826358+0000","last_became_active":"2024-09-13T17:51:49.418903+0000","last_became_peered":"2024-09-13T17:51:49.418903+0000","last_unstale":"2024-09-13T17:51:53.826358+0000","last_undegraded":"2024-09-13T17:51:53.826358+0000","last_fullsized":"2024-09-13T17:51:53.826358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:39.329721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.851665+0000","last_change":"2024-09-13T17:51:53.849211+0000","last_active":"2024-09-13T17:51:53.851665+0000","last_peered":"2024-09-13T17:51:53.851665+0000","last_clean":"2024-09-13T17:51:53.851665+0000","last_became_active":"2024-09-13T17:51:53.848829+0000","last_became_peered":"2024-09-13T17:51:53.848829+0000","last_unstale":"2024-09-13T17:51:53.851665+0000","last_undegraded":"2024-09-13T17:51:53.851665+0000","last_fullsized":"2024-09-13T17:51:53.851665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:56.070629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837633+0000","last_change":"2024-09-13T17:51:49.832116+0000","last_active":"2024-09-13T17:51:53.837633+0000","last_peered":"2024-09-13T17:51:53.837633+0000","last_clean":"2024-09-13T17:51:53.837633+0000","last_became_active":"2024-09-13T17:51:49.831837+0000","last_became_peered":"2024-09-13T17:51:49.831837+0000","last_unstale":"2024-09-13T17:51:53.837633+0000","last_undegraded":"2024-09-13T17:51:53.837633+0000","last_fullsized":"2024-09-13T17:51:53.837633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:07.738851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.832758+0000","last_change":"2024-09-13T17:51:49.421180+0000","last_active":"2024-09-13T17:51:53.832758+0000","last_peered":"2024-09-13T17:51:53.832758+0000","last_clean":"2024-09-13T17:51:53.832758+0000","last_became_active":"2024-09-13T17:51:49.420518+0000","last_became_peered":"2024-09-13T17:51:49.420518+0000","last_unstale":"2024-09-13T17:51:53.832758+0000","last_undegraded":"2024-09-13T17:51:53.832758+0000","last_fullsized":"2024-09-13T17:51:53.832758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:06.421994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.844571+0000","last_change":"2024-09-13T17:51:53.840737+0000","last_active":"2024-09-13T17:51:53.844571+0000","last_peered":"2024-09-13T17:51:53.844571+0000","last_clean":"2024-09-13T17:51:53.844571+0000","last_became_active":"2024-09-13T17:51:53.838857+0000","last_became_peered":"2024-09-13T17:51:53.838857+0000","last_unstale":"2024-09-13T17:51:53.844571+0000","last_undegraded":"2024-09-13T17:51:53.844571+0000","last_fullsized":"2024-09-13T17:51:53.844571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:00.438042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.832711+0000","last_change":"2024-09-13T17:51:49.820669+0000","last_active":"2024-09-13T17:51:53.832711+0000","last_peered":"2024-09-13T17:51:53.832711+0000","last_clean":"2024-09-13T17:51:53.832711+0000","last_became_active":"2024-09-13T17:51:49.820401+0000","last_became_peered":"2024-09-13T17:51:49.820401+0000","last_unstale":"2024-09-13T17:51:53.832711+0000","last_undegraded":"2024-09-13T17:51:53.832711+0000","last_fullsized":"2024-09-13T17:51:53.832711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:12.044921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827878+0000","last_change":"2024-09-13T17:51:49.428974+0000","last_active":"2024-09-13T17:51:53.827878+0000","last_peered":"2024-09-13T17:51:53.827878+0000","last_clean":"2024-09-13T17:51:53.827878+0000","last_became_active":"2024-09-13T17:51:49.428658+0000","last_became_peered":"2024-09-13T17:51:49.428658+0000","last_unstale":"2024-09-13T17:51:53.827878+0000","last_undegraded":"2024-09-13T17:51:53.827878+0000","last_fullsized":"2024-09-13T17:51:53.827878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:55.567370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.898056+0000","last_change":"2024-09-13T17:51:53.887256+0000","last_active":"2024-09-13T17:51:53.898056+0000","last_peered":"2024-09-13T17:51:53.898056+0000","last_clean":"2024-09-13T17:51:53.898056+0000","last_became_active":"2024-09-13T17:51:53.886890+0000","last_became_peered":"2024-09-13T17:51:53.886890+0000","last_unstale":"2024-09-13T17:51:53.898056+0000","last_undegraded":"2024-09-13T17:51:53.898056+0000","last_fullsized":"2024-09-13T17:51:53.898056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:50.331208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.891341+0000","last_change":"2024-09-13T17:51:53.887867+0000","last_active":"2024-09-13T17:51:53.891341+0000","last_peered":"2024-09-13T17:51:53.891341+0000","last_clean":"2024-09-13T17:51:53.891341+0000","last_became_active":"2024-09-13T17:51:53.887513+0000","last_became_peered":"2024-09-13T17:51:53.887513+0000","last_unstale":"2024-09-13T17:51:53.891341+0000","last_undegraded":"2024-09-13T17:51:53.891341+0000","last_fullsized":"2024-09-13T17:51:53.891341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:35.046158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.824092+0000","last_change":"2024-09-13T17:51:49.818712+0000","last_active":"2024-09-13T17:51:53.824092+0000","last_peered":"2024-09-13T17:51:53.824092+0000","last_clean":"2024-09-13T17:51:53.824092+0000","last_became_active":"2024-09-13T17:51:49.818441+0000","last_became_peered":"2024-09-13T17:51:49.818441+0000","last_unstale":"2024-09-13T17:51:53.824092+0000","last_undegraded":"2024-09-13T17:51:53.824092+0000","last_fullsized":"2024-09-13T17:51:53.824092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:43.263003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.831201+0000","last_change":"2024-09-13T17:51:49.414687+0000","last_active":"2024-09-13T17:51:53.831201+0000","last_peered":"2024-09-13T17:51:53.831201+0000","last_clean":"2024-09-13T17:51:53.831201+0000","last_became_active":"2024-09-13T17:51:49.414417+0000","last_became_peered":"2024-09-13T17:51:49.414417+0000","last_unstale":"2024-09-13T17:51:53.831201+0000","last_undegraded":"2024-09-13T17:51:53.831201+0000","last_fullsized":"2024-09-13T17:51:53.831201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:05.515948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.850818+0000","last_change":"2024-09-13T17:51:53.848088+0000","last_active":"2024-09-13T17:51:53.850818+0000","last_peered":"2024-09-13T17:51:53.850818+0000","last_clean":"2024-09-13T17:51:53.850818+0000","last_became_active":"2024-09-13T17:51:53.847545+0000","last_became_peered":"2024-09-13T17:51:53.847545+0000","last_unstale":"2024-09-13T17:51:53.850818+0000","last_undegraded":"2024-09-13T17:51:53.850818+0000","last_fullsized":"2024-09-13T17:51:53.850818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:25.404881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826689+0000","last_change":"2024-09-13T17:51:49.820694+0000","last_active":"2024-09-13T17:51:53.826689+0000","last_peered":"2024-09-13T17:51:53.826689+0000","last_clean":"2024-09-13T17:51:53.826689+0000","last_became_active":"2024-09-13T17:51:49.819217+0000","last_became_peered":"2024-09-13T17:51:49.819217+0000","last_unstale":"2024-09-13T17:51:53.826689+0000","last_undegraded":"2024-09-13T17:51:53.826689+0000","last_fullsized":"2024-09-13T17:51:53.826689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:16.626937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827381+0000","last_change":"2024-09-13T17:51:49.424168+0000","last_active":"2024-09-13T17:51:53.827381+0000","last_peered":"2024-09-13T17:51:53.827381+0000","last_clean":"2024-09-13T17:51:53.827381+0000","last_became_active":"2024-09-13T17:51:49.423884+0000","last_became_peered":"2024-09-13T17:51:49.423884+0000","last_unstale":"2024-09-13T17:51:53.827381+0000","last_undegraded":"2024-09-13T17:51:53.827381+0000","last_fullsized":"2024-09-13T17:51:53.827381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:38.364524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827736+0000","last_change":"2024-09-13T17:51:49.428168+0000","last_active":"2024-09-13T17:51:53.827736+0000","last_peered":"2024-09-13T17:51:53.827736+0000","last_clean":"2024-09-13T17:51:53.827736+0000","last_became_active":"2024-09-13T17:51:49.427823+0000","last_became_peered":"2024-09-13T17:51:49.427823+0000","last_unstale":"2024-09-13T17:51:53.827736+0000","last_undegraded":"2024-09-13T17:51:53.827736+0000","last_fullsized":"2024-09-13T17:51:53.827736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:06.421994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837095+0000","last_change":"2024-09-13T17:51:49.805322+0000","last_active":"2024-09-13T17:51:53.837095+0000","last_peered":"2024-09-13T17:51:53.837095+0000","last_clean":"2024-09-13T17:51:53.837095+0000","last_became_active":"2024-09-13T17:51:49.804205+0000","last_became_peered":"2024-09-13T17:51:49.804205+0000","last_unstale":"2024-09-13T17:51:53.837095+0000","last_undegraded":"2024-09-13T17:51:53.837095+0000","last_fullsized":"2024-09-13T17:51:53.837095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:43.263003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.854352+0000","last_change":"2024-09-13T17:51:53.851986+0000","last_active":"2024-09-13T17:51:53.854352+0000","last_peered":"2024-09-13T17:51:53.854352+0000","last_clean":"2024-09-13T17:51:53.854352+0000","last_became_active":"2024-09-13T17:51:53.851630+0000","last_became_peered":"2024-09-13T17:51:53.851630+0000","last_unstale":"2024-09-13T17:51:53.854352+0000","last_undegraded":"2024-09-13T17:51:53.854352+0000","last_fullsized":"2024-09-13T17:51:53.854352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:39.323134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827078+0000","last_change":"2024-09-13T17:51:49.417653+0000","last_active":"2024-09-13T17:51:53.827078+0000","last_peered":"2024-09-13T17:51:53.827078+0000","last_clean":"2024-09-13T17:51:53.827078+0000","last_became_active":"2024-09-13T17:51:49.417424+0000","last_became_peered":"2024-09-13T17:51:49.417424+0000","last_unstale":"2024-09-13T17:51:53.827078+0000","last_undegraded":"2024-09-13T17:51:53.827078+0000","last_fullsized":"2024-09-13T17:51:53.827078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:01.166296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.834334+0000","last_change":"2024-09-13T17:51:49.806919+0000","last_active":"2024-09-13T17:51:53.834334+0000","last_peered":"2024-09-13T17:51:53.834334+0000","last_clean":"2024-09-13T17:51:53.834334+0000","last_became_active":"2024-09-13T17:51:49.806493+0000","last_became_peered":"2024-09-13T17:51:49.806493+0000","last_unstale":"2024-09-13T17:51:53.834334+0000","last_undegraded":"2024-09-13T17:51:53.834334+0000","last_fullsized":"2024-09-13T17:51:53.834334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:54.213102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.856376+0000","last_change":"2024-09-13T17:51:53.850120+0000","last_active":"2024-09-13T17:51:53.856376+0000","last_peered":"2024-09-13T17:51:53.856376+0000","last_clean":"2024-09-13T17:51:53.856376+0000","last_became_active":"2024-09-13T17:51:53.849730+0000","last_became_peered":"2024-09-13T17:51:53.849730+0000","last_unstale":"2024-09-13T17:51:53.856376+0000","last_undegraded":"2024-09-13T17:51:53.856376+0000","last_fullsized":"2024-09-13T17:51:53.856376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:05.592560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826849+0000","last_change":"2024-09-13T17:51:49.826333+0000","last_active":"2024-09-13T17:51:53.826849+0000","last_peered":"2024-09-13T17:51:53.826849+0000","last_clean":"2024-09-13T17:51:53.826849+0000","last_became_active":"2024-09-13T17:51:49.826071+0000","last_became_peered":"2024-09-13T17:51:49.826071+0000","last_unstale":"2024-09-13T17:51:53.826849+0000","last_undegraded":"2024-09-13T17:51:53.826849+0000","last_fullsized":"2024-09-13T17:51:53.826849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:38.101006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837999+0000","last_change":"2024-09-13T17:51:49.809218+0000","last_active":"2024-09-13T17:51:53.837999+0000","last_peered":"2024-09-13T17:51:53.837999+0000","last_clean":"2024-09-13T17:51:53.837999+0000","last_became_active":"2024-09-13T17:51:49.808985+0000","last_became_peered":"2024-09-13T17:51:49.808985+0000","last_unstale":"2024-09-13T17:51:53.837999+0000","last_undegraded":"2024-09-13T17:51:53.837999+0000","last_fullsized":"2024-09-13T17:51:53.837999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:21.618580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.838422+0000","last_change":"2024-09-13T17:51:49.830357+0000","last_active":"2024-09-13T17:51:53.838422+0000","last_peered":"2024-09-13T17:51:53.838422+0000","last_clean":"2024-09-13T17:51:53.838422+0000","last_became_active":"2024-09-13T17:51:49.830084+0000","last_became_peered":"2024-09-13T17:51:49.830084+0000","last_unstale":"2024-09-13T17:51:53.838422+0000","last_undegraded":"2024-09-13T17:51:53.838422+0000","last_fullsized":"2024-09-13T17:51:53.838422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:21.449832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.836968+0000","last_change":"2024-09-13T17:51:49.826591+0000","last_active":"2024-09-13T17:51:53.836968+0000","last_peered":"2024-09-13T17:51:53.836968+0000","last_clean":"2024-09-13T17:51:53.836968+0000","last_became_active":"2024-09-13T17:51:49.826406+0000","last_became_peered":"2024-09-13T17:51:49.826406+0000","last_unstale":"2024-09-13T17:51:53.836968+0000","last_undegraded":"2024-09-13T17:51:53.836968+0000","last_fullsized":"2024-09-13T17:51:53.836968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:36.343757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.828767+0000","last_change":"2024-09-13T17:51:49.831819+0000","last_active":"2024-09-13T17:51:53.828767+0000","last_peered":"2024-09-13T17:51:53.828767+0000","last_clean":"2024-09-13T17:51:53.828767+0000","last_became_active":"2024-09-13T17:51:49.831617+0000","last_became_peered":"2024-09-13T17:51:49.831617+0000","last_unstale":"2024-09-13T17:51:53.828767+0000","last_undegraded":"2024-09-13T17:51:53.828767+0000","last_fullsized":"2024-09-13T17:51:53.828767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:43.263003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826257+0000","last_change":"2024-09-13T17:51:49.826770+0000","last_active":"2024-09-13T17:51:53.826257+0000","last_peered":"2024-09-13T17:51:53.826257+0000","last_clean":"2024-09-13T17:51:53.826257+0000","last_became_active":"2024-09-13T17:51:49.826103+0000","last_became_peered":"2024-09-13T17:51:49.826103+0000","last_unstale":"2024-09-13T17:51:53.826257+0000","last_undegraded":"2024-09-13T17:51:53.826257+0000","last_fullsized":"2024-09-13T17:51:53.826257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:35.902537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827779+0000","last_change":"2024-09-13T17:51:49.816685+0000","last_active":"2024-09-13T17:51:53.827779+0000","last_peered":"2024-09-13T17:51:53.827779+0000","last_clean":"2024-09-13T17:51:53.827779+0000","last_became_active":"2024-09-13T17:51:49.816364+0000","last_became_peered":"2024-09-13T17:51:49.816364+0000","last_unstale":"2024-09-13T17:51:53.827779+0000","last_undegraded":"2024-09-13T17:51:53.827779+0000","last_fullsized":"2024-09-13T17:51:53.827779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:19.843619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.829842+0000","last_change":"2024-09-13T17:51:49.829446+0000","last_active":"2024-09-13T17:51:53.829842+0000","last_peered":"2024-09-13T17:51:53.829842+0000","last_clean":"2024-09-13T17:51:53.829842+0000","last_became_active":"2024-09-13T17:51:49.829196+0000","last_became_peered":"2024-09-13T17:51:49.829196+0000","last_unstale":"2024-09-13T17:51:53.829842+0000","last_undegraded":"2024-09-13T17:51:53.829842+0000","last_fullsized":"2024-09-13T17:51:53.829842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:14.458841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.831119+0000","last_change":"2024-09-13T17:51:49.835245+0000","last_active":"2024-09-13T17:51:53.831119+0000","last_peered":"2024-09-13T17:51:53.831119+0000","last_clean":"2024-09-13T17:51:53.831119+0000","last_became_active":"2024-09-13T17:51:49.834941+0000","last_became_peered":"2024-09-13T17:51:49.834941+0000","last_unstale":"2024-09-13T17:51:53.831119+0000","last_undegraded":"2024-09-13T17:51:53.831119+0000","last_fullsized":"2024-09-13T17:51:53.831119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:18.962464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827310+0000","last_change":"2024-09-13T17:51:49.831150+0000","last_active":"2024-09-13T17:51:53.827310+0000","last_peered":"2024-09-13T17:51:53.827310+0000","last_clean":"2024-09-13T17:51:53.827310+0000","last_became_active":"2024-09-13T17:51:49.830923+0000","last_became_peered":"2024-09-13T17:51:49.830923+0000","last_unstale":"2024-09-13T17:51:53.827310+0000","last_undegraded":"2024-09-13T17:51:53.827310+0000","last_fullsized":"2024-09-13T17:51:53.827310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:35.902537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.835969+0000","last_change":"2024-09-13T17:51:49.831132+0000","last_active":"2024-09-13T17:51:53.835969+0000","last_peered":"2024-09-13T17:51:53.835969+0000","last_clean":"2024-09-13T17:51:53.835969+0000","last_became_active":"2024-09-13T17:51:49.822819+0000","last_became_peered":"2024-09-13T17:51:49.822819+0000","last_unstale":"2024-09-13T17:51:53.835969+0000","last_undegraded":"2024-09-13T17:51:53.835969+0000","last_fullsized":"2024-09-13T17:51:53.835969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:01.180550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.836860+0000","last_change":"2024-09-13T17:51:49.826381+0000","last_active":"2024-09-13T17:51:53.836860+0000","last_peered":"2024-09-13T17:51:53.836860+0000","last_clean":"2024-09-13T17:51:53.836860+0000","last_became_active":"2024-09-13T17:51:49.816777+0000","last_became_peered":"2024-09-13T17:51:49.816777+0000","last_unstale":"2024-09-13T17:51:53.836860+0000","last_undegraded":"2024-09-13T17:51:53.836860+0000","last_fullsized":"2024-09-13T17:51:53.836860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:18.962464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827364+0000","last_change":"2024-09-13T17:51:49.815417+0000","last_active":"2024-09-13T17:51:53.827364+0000","last_peered":"2024-09-13T17:51:53.827364+0000","last_clean":"2024-09-13T17:51:53.827364+0000","last_became_active":"2024-09-13T17:51:49.814545+0000","last_became_peered":"2024-09-13T17:51:49.814545+0000","last_unstale":"2024-09-13T17:51:53.827364+0000","last_undegraded":"2024-09-13T17:51:53.827364+0000","last_fullsized":"2024-09-13T17:51:53.827364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:26.069550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.884324+0000","last_change":"2024-09-13T17:51:49.832628+0000","last_active":"2024-09-13T17:51:53.884324+0000","last_peered":"2024-09-13T17:51:53.884324+0000","last_clean":"2024-09-13T17:51:53.884324+0000","last_became_active":"2024-09-13T17:51:49.832374+0000","last_became_peered":"2024-09-13T17:51:49.832374+0000","last_unstale":"2024-09-13T17:51:53.884324+0000","last_undegraded":"2024-09-13T17:51:53.884324+0000","last_fullsized":"2024-09-13T17:51:53.884324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:01.180550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.841065+0000","last_change":"2024-09-13T17:51:49.815728+0000","last_active":"2024-09-13T17:51:53.841065+0000","last_peered":"2024-09-13T17:51:53.841065+0000","last_clean":"2024-09-13T17:51:53.841065+0000","last_became_active":"2024-09-13T17:51:49.815464+0000","last_became_peered":"2024-09-13T17:51:49.815464+0000","last_unstale":"2024-09-13T17:51:53.841065+0000","last_undegraded":"2024-09-13T17:51:53.841065+0000","last_fullsized":"2024-09-13T17:51:53.841065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:22.017119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.830807+0000","last_change":"2024-09-13T17:51:49.823164+0000","last_active":"2024-09-13T17:51:53.830807+0000","last_peered":"2024-09-13T17:51:53.830807+0000","last_clean":"2024-09-13T17:51:53.830807+0000","last_became_active":"2024-09-13T17:51:49.822858+0000","last_became_peered":"2024-09-13T17:51:49.822858+0000","last_unstale":"2024-09-13T17:51:53.830807+0000","last_undegraded":"2024-09-13T17:51:53.830807+0000","last_fullsized":"2024-09-13T17:51:53.830807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:12:04.288019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.830989+0000","last_change":"2024-09-13T17:51:49.820290+0000","last_active":"2024-09-13T17:51:53.830989+0000","last_peered":"2024-09-13T17:51:53.830989+0000","last_clean":"2024-09-13T17:51:53.830989+0000","last_became_active":"2024-09-13T17:51:49.820037+0000","last_became_peered":"2024-09-13T17:51:49.820037+0000","last_unstale":"2024-09-13T17:51:53.830989+0000","last_undegraded":"2024-09-13T17:51:53.830989+0000","last_fullsized":"2024-09-13T17:51:53.830989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:51.162047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.824544+0000","last_change":"2024-09-13T17:51:49.806528+0000","last_active":"2024-09-13T17:51:53.824544+0000","last_peered":"2024-09-13T17:51:53.824544+0000","last_clean":"2024-09-13T17:51:53.824544+0000","last_became_active":"2024-09-13T17:51:49.806269+0000","last_became_peered":"2024-09-13T17:51:49.806269+0000","last_unstale":"2024-09-13T17:51:53.824544+0000","last_undegraded":"2024-09-13T17:51:53.824544+0000","last_fullsized":"2024-09-13T17:51:53.824544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:26.069550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.836406+0000","last_change":"2024-09-13T17:51:49.808911+0000","last_active":"2024-09-13T17:51:53.836406+0000","last_peered":"2024-09-13T17:51:53.836406+0000","last_clean":"2024-09-13T17:51:53.836406+0000","last_became_active":"2024-09-13T17:51:49.808332+0000","last_became_peered":"2024-09-13T17:51:49.808332+0000","last_unstale":"2024-09-13T17:51:53.836406+0000","last_undegraded":"2024-09-13T17:51:53.836406+0000","last_fullsized":"2024-09-13T17:51:53.836406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:14.458841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.825613+0000","last_change":"2024-09-13T17:51:49.826315+0000","last_active":"2024-09-13T17:51:53.825613+0000","last_peered":"2024-09-13T17:51:53.825613+0000","last_clean":"2024-09-13T17:51:53.825613+0000","last_became_active":"2024-09-13T17:51:49.825996+0000","last_became_peered":"2024-09-13T17:51:49.825996+0000","last_unstale":"2024-09-13T17:51:53.825613+0000","last_undegraded":"2024-09-13T17:51:53.825613+0000","last_fullsized":"2024-09-13T17:51:53.825613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:26.069550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.834840+0000","last_change":"2024-09-13T17:51:49.814558+0000","last_active":"2024-09-13T17:51:53.834840+0000","last_peered":"2024-09-13T17:51:53.834840+0000","last_clean":"2024-09-13T17:51:53.834840+0000","last_became_active":"2024-09-13T17:51:49.814289+0000","last_became_peered":"2024-09-13T17:51:49.814289+0000","last_unstale":"2024-09-13T17:51:53.834840+0000","last_undegraded":"2024-09-13T17:51:53.834840+0000","last_fullsized":"2024-09-13T17:51:53.834840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:08.128556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.828014+0000","last_change":"2024-09-13T17:51:49.838829+0000","last_active":"2024-09-13T17:51:53.828014+0000","last_peered":"2024-09-13T17:51:53.828014+0000","last_clean":"2024-09-13T17:51:53.828014+0000","last_became_active":"2024-09-13T17:51:49.838534+0000","last_became_peered":"2024-09-13T17:51:49.838534+0000","last_unstale":"2024-09-13T17:51:53.828014+0000","last_undegraded":"2024-09-13T17:51:53.828014+0000","last_fullsized":"2024-09-13T17:51:53.828014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:16.626937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827668+0000","last_change":"2024-09-13T17:51:49.838082+0000","last_active":"2024-09-13T17:51:53.827668+0000","last_peered":"2024-09-13T17:51:53.827668+0000","last_clean":"2024-09-13T17:51:53.827668+0000","last_became_active":"2024-09-13T17:51:49.837831+0000","last_became_peered":"2024-09-13T17:51:49.837831+0000","last_unstale":"2024-09-13T17:51:53.827668+0000","last_undegraded":"2024-09-13T17:51:53.827668+0000","last_fullsized":"2024-09-13T17:51:53.827668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:43.263003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.884838+0000","last_change":"2024-09-13T17:51:49.838813+0000","last_active":"2024-09-13T17:51:53.884838+0000","last_peered":"2024-09-13T17:51:53.884838+0000","last_clean":"2024-09-13T17:51:53.884838+0000","last_became_active":"2024-09-13T17:51:49.838605+0000","last_became_peered":"2024-09-13T17:51:49.838605+0000","last_unstale":"2024-09-13T17:51:53.884838+0000","last_undegraded":"2024-09-13T17:51:53.884838+0000","last_fullsized":"2024-09-13T17:51:53.884838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:58.370954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826601+0000","last_change":"2024-09-13T17:51:49.839695+0000","last_active":"2024-09-13T17:51:53.826601+0000","last_peered":"2024-09-13T17:51:53.826601+0000","last_clean":"2024-09-13T17:51:53.826601+0000","last_became_active":"2024-09-13T17:51:49.839480+0000","last_became_peered":"2024-09-13T17:51:49.839480+0000","last_unstale":"2024-09-13T17:51:53.826601+0000","last_undegraded":"2024-09-13T17:51:53.826601+0000","last_fullsized":"2024-09-13T17:51:53.826601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:34.576074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.883275+0000","last_change":"2024-09-13T17:51:49.826878+0000","last_active":"2024-09-13T17:51:53.883275+0000","last_peered":"2024-09-13T17:51:53.883275+0000","last_clean":"2024-09-13T17:51:53.883275+0000","last_became_active":"2024-09-13T17:51:49.825030+0000","last_became_peered":"2024-09-13T17:51:49.825030+0000","last_unstale":"2024-09-13T17:51:53.883275+0000","last_undegraded":"2024-09-13T17:51:53.883275+0000","last_fullsized":"2024-09-13T17:51:53.883275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:12:04.288019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.835914+0000","last_change":"2024-09-13T17:51:49.811222+0000","last_active":"2024-09-13T17:51:53.835914+0000","last_peered":"2024-09-13T17:51:53.835914+0000","last_clean":"2024-09-13T17:51:53.835914+0000","last_became_active":"2024-09-13T17:51:49.810759+0000","last_became_peered":"2024-09-13T17:51:49.810759+0000","last_unstale":"2024-09-13T17:51:53.835914+0000","last_undegraded":"2024-09-13T17:51:53.835914+0000","last_fullsized":"2024-09-13T17:51:53.835914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:19.843619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882539+0000","last_change":"2024-09-13T17:51:49.833530+0000","last_active":"2024-09-13T17:51:53.882539+0000","last_peered":"2024-09-13T17:51:53.882539+0000","last_clean":"2024-09-13T17:51:53.882539+0000","last_became_active":"2024-09-13T17:51:49.832951+0000","last_became_peered":"2024-09-13T17:51:49.832951+0000","last_unstale":"2024-09-13T17:51:53.882539+0000","last_undegraded":"2024-09-13T17:51:53.882539+0000","last_fullsized":"2024-09-13T17:51:53.882539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:54.519014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.830679+0000","last_change":"2024-09-13T17:51:49.830297+0000","last_active":"2024-09-13T17:51:53.830679+0000","last_peered":"2024-09-13T17:51:53.830679+0000","last_clean":"2024-09-13T17:51:53.830679+0000","last_became_active":"2024-09-13T17:51:49.829669+0000","last_became_peered":"2024-09-13T17:51:49.829669+0000","last_unstale":"2024-09-13T17:51:53.830679+0000","last_undegraded":"2024-09-13T17:51:53.830679+0000","last_fullsized":"2024-09-13T17:51:53.830679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:47.337762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.843087+0000","last_change":"2024-09-13T17:51:49.803908+0000","last_active":"2024-09-13T17:51:53.843087+0000","last_peered":"2024-09-13T17:51:53.843087+0000","last_clean":"2024-09-13T17:51:53.843087+0000","last_became_active":"2024-09-13T17:51:49.803684+0000","last_became_peered":"2024-09-13T17:51:49.803684+0000","last_unstale":"2024-09-13T17:51:53.843087+0000","last_undegraded":"2024-09-13T17:51:53.843087+0000","last_fullsized":"2024-09-13T17:51:53.843087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:45.192413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826601+0000","last_change":"2024-09-13T17:51:49.815512+0000","last_active":"2024-09-13T17:51:53.826601+0000","last_peered":"2024-09-13T17:51:53.826601+0000","last_clean":"2024-09-13T17:51:53.826601+0000","last_became_active":"2024-09-13T17:51:49.814103+0000","last_became_peered":"2024-09-13T17:51:49.814103+0000","last_unstale":"2024-09-13T17:51:53.826601+0000","last_undegraded":"2024-09-13T17:51:53.826601+0000","last_fullsized":"2024-09-13T17:51:53.826601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:19.843619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.885722+0000","last_change":"2024-09-13T17:51:49.827858+0000","last_active":"2024-09-13T17:51:53.885722+0000","last_peered":"2024-09-13T17:51:53.885722+0000","last_clean":"2024-09-13T17:51:53.885722+0000","last_became_active":"2024-09-13T17:51:49.827613+0000","last_became_peered":"2024-09-13T17:51:49.827613+0000","last_unstale":"2024-09-13T17:51:53.885722+0000","last_undegraded":"2024-09-13T17:51:53.885722+0000","last_fullsized":"2024-09-13T17:51:53.885722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:03.945317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:52:18.723 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:52:18.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.892+0000 7ff656200640 1 Processor -- start 2024-09-13T17:52:18.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.892+0000 7ff656200640 1 -- start start 2024-09-13T17:52:18.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.892+0000 7ff656200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff6501602a0 0x7ff6500b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:18.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.892+0000 7ff656200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6500b4ec0 0x7ff65015d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:18.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.892+0000 7ff656200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff650145df0 con 0x7ff650145a10 2024-09-13T17:52:18.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.892+0000 7ff656200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6501612b0 con 0x7ff6501602a0 2024-09-13T17:52:18.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.892+0000 7ff656200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65015ccf0 con 0x7ff6500b4ec0 2024-09-13T17:52:18.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.892+0000 7ff646a00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff6501602a0 0x7ff6500b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:18.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.892+0000 7ff64f400640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ff650145a10 0x7ff6500cf610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:51324/0 (socket says 172.21.15.114:51324) 2024-09-13T17:52:18.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.892+0000 7ff64fe00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6500b4ec0 0x7ff65015d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:18.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.892+0000 7ff64f400640 1 -- 172.21.15.114:0/3806790164 learned_addr learned my addr 172.21.15.114:0/3806790164 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:18.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.892+0000 7ff646a00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff6501602a0 0x7ff6500b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:56674/0 (socket says 172.21.15.114:56674) 2024-09-13T17:52:18.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.892+0000 7ff646a00640 1 -- 172.21.15.114:0/3806790164 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6500b4ec0 msgr2=0x7ff65015d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:18.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.892+0000 7ff646a00640 1 --2- 172.21.15.114:0/3806790164 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6500b4ec0 0x7ff65015d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.892+0000 7ff646a00640 1 -- 172.21.15.114:0/3806790164 >> v1:172.21.15.134:6789/0 conn(0x7ff650145a10 legacy=0x7ff6500cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:18.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.892+0000 7ff646a00640 1 -- 172.21.15.114:0/3806790164 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6501462f0 con 0x7ff6501602a0 2024-09-13T17:52:18.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.896+0000 7ff646a00640 1 --2- 172.21.15.114:0/3806790164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6501602a0 0x7ff6500b4980 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff6380097c0 tx=0x7ff63801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a19824099074637 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:18.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.896+0000 7ff64ea00640 1 -- 172.21.15.114:0/3806790164 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6380ad640 con 0x7ff6501602a0 2024-09-13T17:52:18.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.896+0000 7ff64ea00640 1 -- 172.21.15.114:0/3806790164 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6380ad7a0 con 0x7ff6501602a0 2024-09-13T17:52:18.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.896+0000 7ff64ea00640 1 -- 172.21.15.114:0/3806790164 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6380adb30 con 0x7ff6501602a0 2024-09-13T17:52:18.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.896+0000 7ff656200640 1 -- 172.21.15.114:0/3806790164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6501602a0 msgr2=0x7ff6500b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:18.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.896+0000 7ff656200640 1 --2- 172.21.15.114:0/3806790164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6501602a0 0x7ff6500b4980 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff6380097c0 tx=0x7ff63801c4a0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.896+0000 7ff656200640 1 -- 172.21.15.114:0/3806790164 shutdown_connections 2024-09-13T17:52:18.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.896+0000 7ff656200640 1 --2- 172.21.15.114:0/3806790164 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6500b4ec0 0x7ff65015d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.896+0000 7ff656200640 1 --2- 172.21.15.114:0/3806790164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6501602a0 0x7ff6500b4980 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.896+0000 7ff656200640 1 -- 172.21.15.114:0/3806790164 >> 172.21.15.114:0/3806790164 conn(0x7ff650071a20 msgr2=0x7ff650098a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:18.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.900+0000 7ff656200640 1 -- 172.21.15.114:0/3806790164 shutdown_connections 2024-09-13T17:52:18.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.900+0000 7ff656200640 1 -- 172.21.15.114:0/3806790164 wait complete. 2024-09-13T17:52:18.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.900+0000 7ff656200640 1 Processor -- start 2024-09-13T17:52:18.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.900+0000 7ff656200640 1 -- start start 2024-09-13T17:52:18.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.900+0000 7ff656200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6500b4ec0 0x7ff6501451a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:18.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.900+0000 7ff656200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff650145a10 0x7ff6500b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:18.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.900+0000 7ff656200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6500b15f0 0x7ff65015b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:18.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.900+0000 7ff656200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6500aedf0 con 0x7ff650145a10 2024-09-13T17:52:18.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.900+0000 7ff656200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6500b1a70 con 0x7ff6500b15f0 2024-09-13T17:52:18.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.900+0000 7ff656200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6500afc00 con 0x7ff6500b4ec0 2024-09-13T17:52:18.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.900+0000 7ff646a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff650145a10 0x7ff6500b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:18.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.900+0000 7ff646a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff650145a10 0x7ff6500b10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50478/0 (socket says 172.21.15.114:50478) 2024-09-13T17:52:18.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.900+0000 7ff646a00640 1 -- 172.21.15.114:0/281937576 learned_addr learned my addr 172.21.15.114:0/281937576 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:18.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.900+0000 7ff64f400640 1 --2- 172.21.15.114:0/281937576 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6500b4ec0 0x7ff6501451a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:18.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.900+0000 7ff64fe00640 1 --2- 172.21.15.114:0/281937576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6500b15f0 0x7ff65015b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:18.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.900+0000 7ff646a00640 1 -- 172.21.15.114:0/281937576 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6500b4ec0 msgr2=0x7ff6501451a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:18.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.900+0000 7ff646a00640 1 --2- 172.21.15.114:0/281937576 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6500b4ec0 0x7ff6501451a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.900+0000 7ff646a00640 1 -- 172.21.15.114:0/281937576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6500b15f0 msgr2=0x7ff65015b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:18.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.900+0000 7ff646a00640 1 --2- 172.21.15.114:0/281937576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6500b15f0 0x7ff65015b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:18.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.900+0000 7ff646a00640 1 -- 172.21.15.114:0/281937576 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff638009420 con 0x7ff650145a10 2024-09-13T17:52:18.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.900+0000 7ff646a00640 1 --2- 172.21.15.114:0/281937576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff650145a10 0x7ff6500b10b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff6380b0040 tx=0x7ff638019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:18.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.900+0000 7ff647e00640 1 -- 172.21.15.114:0/281937576 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6380b6610 con 0x7ff650145a10 2024-09-13T17:52:18.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.900+0000 7ff647e00640 1 -- 172.21.15.114:0/281937576 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6380a6040 con 0x7ff650145a10 2024-09-13T17:52:18.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.900+0000 7ff647e00640 1 -- 172.21.15.114:0/281937576 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6380b69d0 con 0x7ff650145a10 2024-09-13T17:52:18.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.904+0000 7ff656200640 1 -- 172.21.15.114:0/281937576 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff650144a60 con 0x7ff650145a10 2024-09-13T17:52:18.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.904+0000 7ff656200640 1 -- 172.21.15.114:0/281937576 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6500b03b0 con 0x7ff650145a10 2024-09-13T17:52:18.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.904+0000 7ff656200640 1 -- 172.21.15.114:0/281937576 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff650144bf0 con 0x7ff650145a10 2024-09-13T17:52:18.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.904+0000 7ff647e00640 1 -- 172.21.15.114:0/281937576 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff6380b4040 con 0x7ff650145a10 2024-09-13T17:52:18.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.904+0000 7ff647e00640 1 --2- 172.21.15.114:0/281937576 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff62c066690 0x7ff62c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:18.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.904+0000 7ff647e00640 1 -- 172.21.15.114:0/281937576 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff63811e660 con 0x7ff650145a10 2024-09-13T17:52:18.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.904+0000 7ff64f400640 1 --2- 172.21.15.114:0/281937576 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff62c066690 0x7ff62c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:18.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.904+0000 7ff64f400640 1 --2- 172.21.15.114:0/281937576 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff62c066690 0x7ff62c068b50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff640005890 tx=0x7ff640009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:18.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:18.908+0000 7ff647e00640 1 -- 172.21.15.114:0/281937576 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff6380eb780 con 0x7ff650145a10 2024-09-13T17:52:19.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.060+0000 7ff656200640 1 -- 172.21.15.114:0/281937576 --> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff650160fd0 con 0x7ff62c066690 2024-09-13T17:52:19.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.068+0000 7ff647e00640 1 -- 172.21.15.114:0/281937576 <== mgr.4102 v2:172.21.15.114:6832/137691478 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345299 (secure 0 0 0) 0x7ff640001ce0 con 0x7ff62c066690 2024-09-13T17:52:19.076 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:19.078 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-13T17:52:19.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.072+0000 7ff656200640 1 -- 172.21.15.114:0/281937576 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff62c066690 msgr2=0x7ff62c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:19.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.072+0000 7ff656200640 1 --2- 172.21.15.114:0/281937576 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff62c066690 0x7ff62c068b50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff640005890 tx=0x7ff640009040 comp rx=0 tx=0).stop 2024-09-13T17:52:19.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.072+0000 7ff656200640 1 -- 172.21.15.114:0/281937576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff650145a10 msgr2=0x7ff6500b10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:19.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.072+0000 7ff656200640 1 --2- 172.21.15.114:0/281937576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff650145a10 0x7ff6500b10b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff6380b0040 tx=0x7ff638019240 comp rx=0 tx=0).stop 2024-09-13T17:52:19.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.072+0000 7ff656200640 1 -- 172.21.15.114:0/281937576 shutdown_connections 2024-09-13T17:52:19.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.072+0000 7ff656200640 1 --2- 172.21.15.114:0/281937576 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff62c066690 0x7ff62c068b50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.072+0000 7ff656200640 1 --2- 172.21.15.114:0/281937576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6500b15f0 0x7ff65015b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.072+0000 7ff656200640 1 --2- 172.21.15.114:0/281937576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff650145a10 0x7ff6500b10b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.072+0000 7ff656200640 1 --2- 172.21.15.114:0/281937576 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6500b4ec0 0x7ff6501451a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.072+0000 7ff656200640 1 -- 172.21.15.114:0/281937576 >> 172.21.15.114:0/281937576 conn(0x7ff650071a20 msgr2=0x7ff650098a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:19.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.072+0000 7ff656200640 1 -- 172.21.15.114:0/281937576 shutdown_connections 2024-09-13T17:52:19.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.072+0000 7ff656200640 1 -- 172.21.15.114:0/281937576 wait complete. 2024-09-13T17:52:19.097 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-13T17:52:17.941186+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219384,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755336,"statfs":{"total":773094113280,"available":772869464064,"internally_reserved":0,"allocated":3284992,"data_stored":1988162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004085"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837772+0000","last_change":"2024-09-13T17:51:49.424735+0000","last_active":"2024-09-13T17:51:53.837772+0000","last_peered":"2024-09-13T17:51:53.837772+0000","last_clean":"2024-09-13T17:51:53.837772+0000","last_became_active":"2024-09-13T17:51:49.424461+0000","last_became_peered":"2024-09-13T17:51:49.424461+0000","last_unstale":"2024-09-13T17:51:53.837772+0000","last_undegraded":"2024-09-13T17:51:53.837772+0000","last_fullsized":"2024-09-13T17:51:53.837772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:05.776083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827298+0000","last_change":"2024-09-13T17:51:49.822366+0000","last_active":"2024-09-13T17:51:53.827298+0000","last_peered":"2024-09-13T17:51:53.827298+0000","last_clean":"2024-09-13T17:51:53.827298+0000","last_became_active":"2024-09-13T17:51:49.822088+0000","last_became_peered":"2024-09-13T17:51:49.822088+0000","last_unstale":"2024-09-13T17:51:53.827298+0000","last_undegraded":"2024-09-13T17:51:53.827298+0000","last_fullsized":"2024-09-13T17:51:53.827298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:19.843619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.898097+0000","last_change":"2024-09-13T17:51:53.888282+0000","last_active":"2024-09-13T17:51:53.898097+0000","last_peered":"2024-09-13T17:51:53.898097+0000","last_clean":"2024-09-13T17:51:53.898097+0000","last_became_active":"2024-09-13T17:51:53.887931+0000","last_became_peered":"2024-09-13T17:51:53.887931+0000","last_unstale":"2024-09-13T17:51:53.898097+0000","last_undegraded":"2024-09-13T17:51:53.898097+0000","last_fullsized":"2024-09-13T17:51:53.898097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:50:08.665223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827194+0000","last_change":"2024-09-13T17:51:49.417919+0000","last_active":"2024-09-13T17:51:53.827194+0000","last_peered":"2024-09-13T17:51:53.827194+0000","last_clean":"2024-09-13T17:51:53.827194+0000","last_became_active":"2024-09-13T17:51:49.417669+0000","last_became_peered":"2024-09-13T17:51:49.417669+0000","last_unstale":"2024-09-13T17:51:53.827194+0000","last_undegraded":"2024-09-13T17:51:53.827194+0000","last_fullsized":"2024-09-13T17:51:53.827194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:05.776083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837561+0000","last_change":"2024-09-13T17:51:49.820810+0000","last_active":"2024-09-13T17:51:53.837561+0000","last_peered":"2024-09-13T17:51:53.837561+0000","last_clean":"2024-09-13T17:51:53.837561+0000","last_became_active":"2024-09-13T17:51:49.820576+0000","last_became_peered":"2024-09-13T17:51:49.820576+0000","last_unstale":"2024-09-13T17:51:53.837561+0000","last_undegraded":"2024-09-13T17:51:53.837561+0000","last_fullsized":"2024-09-13T17:51:53.837561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:26.069550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.855045+0000","last_change":"2024-09-13T17:51:53.853653+0000","last_active":"2024-09-13T17:51:53.855045+0000","last_peered":"2024-09-13T17:51:53.855045+0000","last_clean":"2024-09-13T17:51:53.855045+0000","last_became_active":"2024-09-13T17:51:53.853265+0000","last_became_peered":"2024-09-13T17:51:53.853265+0000","last_unstale":"2024-09-13T17:51:53.855045+0000","last_undegraded":"2024-09-13T17:51:53.855045+0000","last_fullsized":"2024-09-13T17:51:53.855045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:21.706044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.884139+0000","last_change":"2024-09-13T17:51:49.429851+0000","last_active":"2024-09-13T17:51:53.884139+0000","last_peered":"2024-09-13T17:51:53.884139+0000","last_clean":"2024-09-13T17:51:53.884139+0000","last_became_active":"2024-09-13T17:51:49.428737+0000","last_became_peered":"2024-09-13T17:51:49.428737+0000","last_unstale":"2024-09-13T17:51:53.884139+0000","last_undegraded":"2024-09-13T17:51:53.884139+0000","last_fullsized":"2024-09-13T17:51:53.884139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:06.732541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.830753+0000","last_change":"2024-09-13T17:51:49.819895+0000","last_active":"2024-09-13T17:51:53.830753+0000","last_peered":"2024-09-13T17:51:53.830753+0000","last_clean":"2024-09-13T17:51:53.830753+0000","last_became_active":"2024-09-13T17:51:49.819636+0000","last_became_peered":"2024-09-13T17:51:49.819636+0000","last_unstale":"2024-09-13T17:51:53.830753+0000","last_undegraded":"2024-09-13T17:51:53.830753+0000","last_fullsized":"2024-09-13T17:51:53.830753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:16.626937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.851436+0000","last_change":"2024-09-13T17:51:53.848452+0000","last_active":"2024-09-13T17:51:53.851436+0000","last_peered":"2024-09-13T17:51:53.851436+0000","last_clean":"2024-09-13T17:51:53.851436+0000","last_became_active":"2024-09-13T17:51:53.847653+0000","last_became_peered":"2024-09-13T17:51:53.847653+0000","last_unstale":"2024-09-13T17:51:53.851436+0000","last_undegraded":"2024-09-13T17:51:53.851436+0000","last_fullsized":"2024-09-13T17:51:53.851436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:05.592560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882694+0000","last_change":"2024-09-13T17:51:49.430634+0000","last_active":"2024-09-13T17:51:53.882694+0000","last_peered":"2024-09-13T17:51:53.882694+0000","last_clean":"2024-09-13T17:51:53.882694+0000","last_became_active":"2024-09-13T17:51:49.428490+0000","last_became_peered":"2024-09-13T17:51:49.428490+0000","last_unstale":"2024-09-13T17:51:53.882694+0000","last_undegraded":"2024-09-13T17:51:53.882694+0000","last_fullsized":"2024-09-13T17:51:53.882694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:20.612271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.836270+0000","last_change":"2024-09-13T17:51:49.810371+0000","last_active":"2024-09-13T17:51:53.836270+0000","last_peered":"2024-09-13T17:51:53.836270+0000","last_clean":"2024-09-13T17:51:53.836270+0000","last_became_active":"2024-09-13T17:51:49.810008+0000","last_became_peered":"2024-09-13T17:51:49.810008+0000","last_unstale":"2024-09-13T17:51:53.836270+0000","last_undegraded":"2024-09-13T17:51:53.836270+0000","last_fullsized":"2024-09-13T17:51:53.836270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:54.519014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.851812+0000","last_change":"2024-09-13T17:51:53.850425+0000","last_active":"2024-09-13T17:51:53.851812+0000","last_peered":"2024-09-13T17:51:53.851812+0000","last_clean":"2024-09-13T17:51:53.851812+0000","last_became_active":"2024-09-13T17:51:53.848615+0000","last_became_peered":"2024-09-13T17:51:53.848615+0000","last_unstale":"2024-09-13T17:51:53.851812+0000","last_undegraded":"2024-09-13T17:51:53.851812+0000","last_fullsized":"2024-09-13T17:51:53.851812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:00.438042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827600+0000","last_change":"2024-09-13T17:51:49.814942+0000","last_active":"2024-09-13T17:51:53.827600+0000","last_peered":"2024-09-13T17:51:53.827600+0000","last_clean":"2024-09-13T17:51:53.827600+0000","last_became_active":"2024-09-13T17:51:49.814562+0000","last_became_peered":"2024-09-13T17:51:49.814562+0000","last_unstale":"2024-09-13T17:51:53.827600+0000","last_undegraded":"2024-09-13T17:51:53.827600+0000","last_fullsized":"2024-09-13T17:51:53.827600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:18.962464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882721+0000","last_change":"2024-09-13T17:51:49.426550+0000","last_active":"2024-09-13T17:51:53.882721+0000","last_peered":"2024-09-13T17:51:53.882721+0000","last_clean":"2024-09-13T17:51:53.882721+0000","last_became_active":"2024-09-13T17:51:49.424996+0000","last_became_peered":"2024-09-13T17:51:49.424996+0000","last_unstale":"2024-09-13T17:51:53.882721+0000","last_undegraded":"2024-09-13T17:51:53.882721+0000","last_fullsized":"2024-09-13T17:51:53.882721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:22.023124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.852108+0000","last_change":"2024-09-13T17:51:53.851132+0000","last_active":"2024-09-13T17:51:53.852108+0000","last_peered":"2024-09-13T17:51:53.852108+0000","last_clean":"2024-09-13T17:51:53.852108+0000","last_became_active":"2024-09-13T17:51:53.850766+0000","last_became_peered":"2024-09-13T17:51:53.850766+0000","last_unstale":"2024-09-13T17:51:53.852108+0000","last_undegraded":"2024-09-13T17:51:53.852108+0000","last_fullsized":"2024-09-13T17:51:53.852108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:28.299853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.825693+0000","last_change":"2024-09-13T17:51:49.827994+0000","last_active":"2024-09-13T17:51:53.825693+0000","last_peered":"2024-09-13T17:51:53.825693+0000","last_clean":"2024-09-13T17:51:53.825693+0000","last_became_active":"2024-09-13T17:51:49.827737+0000","last_became_peered":"2024-09-13T17:51:49.827737+0000","last_unstale":"2024-09-13T17:51:53.825693+0000","last_undegraded":"2024-09-13T17:51:53.825693+0000","last_fullsized":"2024-09-13T17:51:53.825693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:18.962464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827386+0000","last_change":"2024-09-13T17:51:49.421799+0000","last_active":"2024-09-13T17:51:53.827386+0000","last_peered":"2024-09-13T17:51:53.827386+0000","last_clean":"2024-09-13T17:51:53.827386+0000","last_became_active":"2024-09-13T17:51:49.420657+0000","last_became_peered":"2024-09-13T17:51:49.420657+0000","last_unstale":"2024-09-13T17:51:53.827386+0000","last_undegraded":"2024-09-13T17:51:53.827386+0000","last_fullsized":"2024-09-13T17:51:53.827386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:53.206793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.843724+0000","last_change":"2024-09-13T17:51:53.843027+0000","last_active":"2024-09-13T17:51:53.843724+0000","last_peered":"2024-09-13T17:51:53.843724+0000","last_clean":"2024-09-13T17:51:53.843724+0000","last_became_active":"2024-09-13T17:51:53.842576+0000","last_became_peered":"2024-09-13T17:51:53.842576+0000","last_unstale":"2024-09-13T17:51:53.843724+0000","last_undegraded":"2024-09-13T17:51:53.843724+0000","last_fullsized":"2024-09-13T17:51:53.843724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:04.738599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826762+0000","last_change":"2024-09-13T17:51:49.820882+0000","last_active":"2024-09-13T17:51:53.826762+0000","last_peered":"2024-09-13T17:51:53.826762+0000","last_clean":"2024-09-13T17:51:53.826762+0000","last_became_active":"2024-09-13T17:51:49.820420+0000","last_became_peered":"2024-09-13T17:51:49.820420+0000","last_unstale":"2024-09-13T17:51:53.826762+0000","last_undegraded":"2024-09-13T17:51:53.826762+0000","last_fullsized":"2024-09-13T17:51:53.826762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:38.101006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.824631+0000","last_change":"2024-09-13T17:51:49.411703+0000","last_active":"2024-09-13T17:51:53.824631+0000","last_peered":"2024-09-13T17:51:53.824631+0000","last_clean":"2024-09-13T17:51:53.824631+0000","last_became_active":"2024-09-13T17:51:49.411421+0000","last_became_peered":"2024-09-13T17:51:49.411421+0000","last_unstale":"2024-09-13T17:51:53.824631+0000","last_undegraded":"2024-09-13T17:51:53.824631+0000","last_fullsized":"2024-09-13T17:51:53.824631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:06.421994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.888157+0000","last_change":"2024-09-13T17:51:53.884773+0000","last_active":"2024-09-13T17:51:53.888157+0000","last_peered":"2024-09-13T17:51:53.888157+0000","last_clean":"2024-09-13T17:51:53.888157+0000","last_became_active":"2024-09-13T17:51:53.884392+0000","last_became_peered":"2024-09-13T17:51:53.884392+0000","last_unstale":"2024-09-13T17:51:53.888157+0000","last_undegraded":"2024-09-13T17:51:53.888157+0000","last_fullsized":"2024-09-13T17:51:53.888157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:35.046158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.834403+0000","last_change":"2024-09-13T17:51:49.810146+0000","last_active":"2024-09-13T17:51:53.834403+0000","last_peered":"2024-09-13T17:51:53.834403+0000","last_clean":"2024-09-13T17:51:53.834403+0000","last_became_active":"2024-09-13T17:51:49.809659+0000","last_became_peered":"2024-09-13T17:51:49.809659+0000","last_unstale":"2024-09-13T17:51:53.834403+0000","last_undegraded":"2024-09-13T17:51:53.834403+0000","last_fullsized":"2024-09-13T17:51:53.834403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:22.017119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882255+0000","last_change":"2024-09-13T17:51:49.420646+0000","last_active":"2024-09-13T17:51:53.882255+0000","last_peered":"2024-09-13T17:51:53.882255+0000","last_clean":"2024-09-13T17:51:53.882255+0000","last_became_active":"2024-09-13T17:51:49.420353+0000","last_became_peered":"2024-09-13T17:51:49.420353+0000","last_unstale":"2024-09-13T17:51:53.882255+0000","last_undegraded":"2024-09-13T17:51:53.882255+0000","last_fullsized":"2024-09-13T17:51:53.882255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:21.010810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.851627+0000","last_change":"2024-09-13T17:51:53.849048+0000","last_active":"2024-09-13T17:51:53.851627+0000","last_peered":"2024-09-13T17:51:53.851627+0000","last_clean":"2024-09-13T17:51:53.851627+0000","last_became_active":"2024-09-13T17:51:53.848610+0000","last_became_peered":"2024-09-13T17:51:53.848610+0000","last_unstale":"2024-09-13T17:51:53.851627+0000","last_undegraded":"2024-09-13T17:51:53.851627+0000","last_fullsized":"2024-09-13T17:51:53.851627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:23.757828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837389+0000","last_change":"2024-09-13T17:51:49.813776+0000","last_active":"2024-09-13T17:51:53.837389+0000","last_peered":"2024-09-13T17:51:53.837389+0000","last_clean":"2024-09-13T17:51:53.837389+0000","last_became_active":"2024-09-13T17:51:49.813446+0000","last_became_peered":"2024-09-13T17:51:49.813446+0000","last_unstale":"2024-09-13T17:51:53.837389+0000","last_undegraded":"2024-09-13T17:51:53.837389+0000","last_fullsized":"2024-09-13T17:51:53.837389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:38.101006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827985+0000","last_change":"2024-09-13T17:51:49.424387+0000","last_active":"2024-09-13T17:51:53.827985+0000","last_peered":"2024-09-13T17:51:53.827985+0000","last_clean":"2024-09-13T17:51:53.827985+0000","last_became_active":"2024-09-13T17:51:49.424056+0000","last_became_peered":"2024-09-13T17:51:49.424056+0000","last_unstale":"2024-09-13T17:51:53.827985+0000","last_undegraded":"2024-09-13T17:51:53.827985+0000","last_fullsized":"2024-09-13T17:51:53.827985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:39.329721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.890240+0000","last_change":"2024-09-13T17:51:53.887729+0000","last_active":"2024-09-13T17:51:53.890240+0000","last_peered":"2024-09-13T17:51:53.890240+0000","last_clean":"2024-09-13T17:51:53.890240+0000","last_became_active":"2024-09-13T17:51:53.887339+0000","last_became_peered":"2024-09-13T17:51:53.887339+0000","last_unstale":"2024-09-13T17:51:53.890240+0000","last_undegraded":"2024-09-13T17:51:53.890240+0000","last_fullsized":"2024-09-13T17:51:53.890240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:46.649388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.829910+0000","last_change":"2024-09-13T17:51:49.826015+0000","last_active":"2024-09-13T17:51:53.829910+0000","last_peered":"2024-09-13T17:51:53.829910+0000","last_clean":"2024-09-13T17:51:53.829910+0000","last_became_active":"2024-09-13T17:51:49.825697+0000","last_became_peered":"2024-09-13T17:51:49.825697+0000","last_unstale":"2024-09-13T17:51:53.829910+0000","last_undegraded":"2024-09-13T17:51:53.829910+0000","last_fullsized":"2024-09-13T17:51:53.829910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:12.044921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826611+0000","last_change":"2024-09-13T17:51:49.421246+0000","last_active":"2024-09-13T17:51:53.826611+0000","last_peered":"2024-09-13T17:51:53.826611+0000","last_clean":"2024-09-13T17:51:53.826611+0000","last_became_active":"2024-09-13T17:51:49.419599+0000","last_became_peered":"2024-09-13T17:51:49.419599+0000","last_unstale":"2024-09-13T17:51:53.826611+0000","last_undegraded":"2024-09-13T17:51:53.826611+0000","last_fullsized":"2024-09-13T17:51:53.826611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:22.023124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.898030+0000","last_change":"2024-09-13T17:51:53.886455+0000","last_active":"2024-09-13T17:51:53.898030+0000","last_peered":"2024-09-13T17:51:53.898030+0000","last_clean":"2024-09-13T17:51:53.898030+0000","last_became_active":"2024-09-13T17:51:53.885310+0000","last_became_peered":"2024-09-13T17:51:53.885310+0000","last_unstale":"2024-09-13T17:51:53.898030+0000","last_undegraded":"2024-09-13T17:51:53.898030+0000","last_fullsized":"2024-09-13T17:51:53.898030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:20.352407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.824729+0000","last_change":"2024-09-13T17:51:49.810357+0000","last_active":"2024-09-13T17:51:53.824729+0000","last_peered":"2024-09-13T17:51:53.824729+0000","last_clean":"2024-09-13T17:51:53.824729+0000","last_became_active":"2024-09-13T17:51:49.810114+0000","last_became_peered":"2024-09-13T17:51:49.810114+0000","last_unstale":"2024-09-13T17:51:53.824729+0000","last_undegraded":"2024-09-13T17:51:53.824729+0000","last_fullsized":"2024-09-13T17:51:53.824729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:16.626937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.884340+0000","last_change":"2024-09-13T17:51:49.423732+0000","last_active":"2024-09-13T17:51:53.884340+0000","last_peered":"2024-09-13T17:51:53.884340+0000","last_clean":"2024-09-13T17:51:53.884340+0000","last_became_active":"2024-09-13T17:51:49.422959+0000","last_became_peered":"2024-09-13T17:51:49.422959+0000","last_unstale":"2024-09-13T17:51:53.884340+0000","last_undegraded":"2024-09-13T17:51:53.884340+0000","last_fullsized":"2024-09-13T17:51:53.884340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:07.122247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.888684+0000","last_change":"2024-09-13T17:51:53.884526+0000","last_active":"2024-09-13T17:51:53.888684+0000","last_peered":"2024-09-13T17:51:53.888684+0000","last_clean":"2024-09-13T17:51:53.888684+0000","last_became_active":"2024-09-13T17:51:53.884114+0000","last_became_peered":"2024-09-13T17:51:53.884114+0000","last_unstale":"2024-09-13T17:51:53.888684+0000","last_undegraded":"2024-09-13T17:51:53.888684+0000","last_fullsized":"2024-09-13T17:51:53.888684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:11.718873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.836339+0000","last_change":"2024-09-13T17:51:49.830157+0000","last_active":"2024-09-13T17:51:53.836339+0000","last_peered":"2024-09-13T17:51:53.836339+0000","last_clean":"2024-09-13T17:51:53.836339+0000","last_became_active":"2024-09-13T17:51:49.829791+0000","last_became_peered":"2024-09-13T17:51:49.829791+0000","last_unstale":"2024-09-13T17:51:53.836339+0000","last_undegraded":"2024-09-13T17:51:53.836339+0000","last_fullsized":"2024-09-13T17:51:53.836339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:34.576074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826239+0000","last_change":"2024-09-13T17:51:49.417458+0000","last_active":"2024-09-13T17:51:53.826239+0000","last_peered":"2024-09-13T17:51:53.826239+0000","last_clean":"2024-09-13T17:51:53.826239+0000","last_became_active":"2024-09-13T17:51:49.417205+0000","last_became_peered":"2024-09-13T17:51:49.417205+0000","last_unstale":"2024-09-13T17:51:53.826239+0000","last_undegraded":"2024-09-13T17:51:53.826239+0000","last_fullsized":"2024-09-13T17:51:53.826239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:20.612271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.854428+0000","last_change":"2024-09-13T17:51:53.850163+0000","last_active":"2024-09-13T17:51:53.854428+0000","last_peered":"2024-09-13T17:51:53.854428+0000","last_clean":"2024-09-13T17:51:53.854428+0000","last_became_active":"2024-09-13T17:51:53.847840+0000","last_became_peered":"2024-09-13T17:51:53.847840+0000","last_unstale":"2024-09-13T17:51:53.854428+0000","last_undegraded":"2024-09-13T17:51:53.854428+0000","last_fullsized":"2024-09-13T17:51:53.854428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:04.738599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.834848+0000","last_change":"2024-09-13T17:51:49.807208+0000","last_active":"2024-09-13T17:51:53.834848+0000","last_peered":"2024-09-13T17:51:53.834848+0000","last_clean":"2024-09-13T17:51:53.834848+0000","last_became_active":"2024-09-13T17:51:49.806837+0000","last_became_peered":"2024-09-13T17:51:49.806837+0000","last_unstale":"2024-09-13T17:51:53.834848+0000","last_undegraded":"2024-09-13T17:51:53.834848+0000","last_fullsized":"2024-09-13T17:51:53.834848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:21.618580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.838674+0000","last_change":"2024-09-13T17:51:49.422538+0000","last_active":"2024-09-13T17:51:53.838674+0000","last_peered":"2024-09-13T17:51:53.838674+0000","last_clean":"2024-09-13T17:51:53.838674+0000","last_became_active":"2024-09-13T17:51:49.422079+0000","last_became_peered":"2024-09-13T17:51:49.422079+0000","last_unstale":"2024-09-13T17:51:53.838674+0000","last_undegraded":"2024-09-13T17:51:53.838674+0000","last_fullsized":"2024-09-13T17:51:53.838674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:01.166296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.853333+0000","last_change":"2024-09-13T17:51:53.848470+0000","last_active":"2024-09-13T17:51:53.853333+0000","last_peered":"2024-09-13T17:51:53.853333+0000","last_clean":"2024-09-13T17:51:53.853333+0000","last_became_active":"2024-09-13T17:51:53.847907+0000","last_became_peered":"2024-09-13T17:51:53.847907+0000","last_unstale":"2024-09-13T17:51:53.853333+0000","last_undegraded":"2024-09-13T17:51:53.853333+0000","last_fullsized":"2024-09-13T17:51:53.853333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:01.791551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.824107+0000","last_change":"2024-09-13T17:51:49.803724+0000","last_active":"2024-09-13T17:51:53.824107+0000","last_peered":"2024-09-13T17:51:53.824107+0000","last_clean":"2024-09-13T17:51:53.824107+0000","last_became_active":"2024-09-13T17:51:49.803488+0000","last_became_peered":"2024-09-13T17:51:49.803488+0000","last_unstale":"2024-09-13T17:51:53.824107+0000","last_undegraded":"2024-09-13T17:51:53.824107+0000","last_fullsized":"2024-09-13T17:51:53.824107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:18.962464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.838227+0000","last_change":"2024-09-13T17:51:49.420825+0000","last_active":"2024-09-13T17:51:53.838227+0000","last_peered":"2024-09-13T17:51:53.838227+0000","last_clean":"2024-09-13T17:51:53.838227+0000","last_became_active":"2024-09-13T17:51:49.420459+0000","last_became_peered":"2024-09-13T17:51:49.420459+0000","last_unstale":"2024-09-13T17:51:53.838227+0000","last_undegraded":"2024-09-13T17:51:53.838227+0000","last_fullsized":"2024-09-13T17:51:53.838227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:05.515948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.847206+0000","last_change":"2024-09-13T17:51:53.842609+0000","last_active":"2024-09-13T17:51:53.847206+0000","last_peered":"2024-09-13T17:51:53.847206+0000","last_clean":"2024-09-13T17:51:53.847206+0000","last_became_active":"2024-09-13T17:51:53.842195+0000","last_became_peered":"2024-09-13T17:51:53.842195+0000","last_unstale":"2024-09-13T17:51:53.847206+0000","last_undegraded":"2024-09-13T17:51:53.847206+0000","last_fullsized":"2024-09-13T17:51:53.847206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:48:59.044958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.835739+0000","last_change":"2024-09-13T17:51:49.803582+0000","last_active":"2024-09-13T17:51:53.835739+0000","last_peered":"2024-09-13T17:51:53.835739+0000","last_clean":"2024-09-13T17:51:53.835739+0000","last_became_active":"2024-09-13T17:51:49.803242+0000","last_became_peered":"2024-09-13T17:51:49.803242+0000","last_unstale":"2024-09-13T17:51:53.835739+0000","last_undegraded":"2024-09-13T17:51:53.835739+0000","last_fullsized":"2024-09-13T17:51:53.835739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:35.902537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882372+0000","last_change":"2024-09-13T17:51:49.427107+0000","last_active":"2024-09-13T17:51:53.882372+0000","last_peered":"2024-09-13T17:51:53.882372+0000","last_clean":"2024-09-13T17:51:53.882372+0000","last_became_active":"2024-09-13T17:51:49.426867+0000","last_became_peered":"2024-09-13T17:51:49.426867+0000","last_unstale":"2024-09-13T17:51:53.882372+0000","last_undegraded":"2024-09-13T17:51:53.882372+0000","last_fullsized":"2024-09-13T17:51:53.882372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:53.206793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.888656+0000","last_change":"2024-09-13T17:51:53.884097+0000","last_active":"2024-09-13T17:51:53.888656+0000","last_peered":"2024-09-13T17:51:53.888656+0000","last_clean":"2024-09-13T17:51:53.888656+0000","last_became_active":"2024-09-13T17:51:53.883622+0000","last_became_peered":"2024-09-13T17:51:53.883622+0000","last_unstale":"2024-09-13T17:51:53.888656+0000","last_undegraded":"2024-09-13T17:51:53.888656+0000","last_fullsized":"2024-09-13T17:51:53.888656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:46.649388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826078+0000","last_change":"2024-09-13T17:51:49.838792+0000","last_active":"2024-09-13T17:51:53.826078+0000","last_peered":"2024-09-13T17:51:53.826078+0000","last_clean":"2024-09-13T17:51:53.826078+0000","last_became_active":"2024-09-13T17:51:49.838580+0000","last_became_peered":"2024-09-13T17:51:49.838580+0000","last_unstale":"2024-09-13T17:51:53.826078+0000","last_undegraded":"2024-09-13T17:51:53.826078+0000","last_fullsized":"2024-09-13T17:51:53.826078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:21.449832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.834191+0000","last_change":"2024-09-13T17:51:49.416568+0000","last_active":"2024-09-13T17:51:53.834191+0000","last_peered":"2024-09-13T17:51:53.834191+0000","last_clean":"2024-09-13T17:51:53.834191+0000","last_became_active":"2024-09-13T17:51:49.416233+0000","last_became_peered":"2024-09-13T17:51:49.416233+0000","last_unstale":"2024-09-13T17:51:53.834191+0000","last_undegraded":"2024-09-13T17:51:53.834191+0000","last_fullsized":"2024-09-13T17:51:53.834191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:39.329721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882384+0000","last_change":"2024-09-13T17:51:40.205691+0000","last_active":"2024-09-13T17:51:53.882384+0000","last_peered":"2024-09-13T17:51:53.882384+0000","last_clean":"2024-09-13T17:51:53.882384+0000","last_became_active":"2024-09-13T17:51:40.204577+0000","last_became_peered":"2024-09-13T17:51:40.204577+0000","last_unstale":"2024-09-13T17:51:53.882384+0000","last_undegraded":"2024-09-13T17:51:53.882384+0000","last_fullsized":"2024-09-13T17:51:53.882384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_clean_scrub_stamp":"2024-09-13T17:51:38.340495+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:37.899275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.889483+0000","last_change":"2024-09-13T17:51:53.885726+0000","last_active":"2024-09-13T17:51:53.889483+0000","last_peered":"2024-09-13T17:51:53.889483+0000","last_clean":"2024-09-13T17:51:53.889483+0000","last_became_active":"2024-09-13T17:51:53.885225+0000","last_became_peered":"2024-09-13T17:51:53.885225+0000","last_unstale":"2024-09-13T17:51:53.889483+0000","last_undegraded":"2024-09-13T17:51:53.889483+0000","last_fullsized":"2024-09-13T17:51:53.889483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:56.070629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.884041+0000","last_change":"2024-09-13T17:51:49.838216+0000","last_active":"2024-09-13T17:51:53.884041+0000","last_peered":"2024-09-13T17:51:53.884041+0000","last_clean":"2024-09-13T17:51:53.884041+0000","last_became_active":"2024-09-13T17:51:49.838023+0000","last_became_peered":"2024-09-13T17:51:49.838023+0000","last_unstale":"2024-09-13T17:51:53.884041+0000","last_undegraded":"2024-09-13T17:51:53.884041+0000","last_fullsized":"2024-09-13T17:51:53.884041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:01.703358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.838525+0000","last_change":"2024-09-13T17:51:49.425601+0000","last_active":"2024-09-13T17:51:53.838525+0000","last_peered":"2024-09-13T17:51:53.838525+0000","last_clean":"2024-09-13T17:51:53.838525+0000","last_became_active":"2024-09-13T17:51:49.425289+0000","last_became_peered":"2024-09-13T17:51:49.425289+0000","last_unstale":"2024-09-13T17:51:53.838525+0000","last_undegraded":"2024-09-13T17:51:53.838525+0000","last_fullsized":"2024-09-13T17:51:53.838525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:06.421994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.888637+0000","last_change":"2024-09-13T17:51:53.885100+0000","last_active":"2024-09-13T17:51:53.888637+0000","last_peered":"2024-09-13T17:51:53.888637+0000","last_clean":"2024-09-13T17:51:53.888637+0000","last_became_active":"2024-09-13T17:51:53.884217+0000","last_became_peered":"2024-09-13T17:51:53.884217+0000","last_unstale":"2024-09-13T17:51:53.888637+0000","last_undegraded":"2024-09-13T17:51:53.888637+0000","last_fullsized":"2024-09-13T17:51:53.888637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:01.791551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.830819+0000","last_change":"2024-09-13T17:51:49.830458+0000","last_active":"2024-09-13T17:51:53.830819+0000","last_peered":"2024-09-13T17:51:53.830819+0000","last_clean":"2024-09-13T17:51:53.830819+0000","last_became_active":"2024-09-13T17:51:49.830026+0000","last_became_peered":"2024-09-13T17:51:49.830026+0000","last_unstale":"2024-09-13T17:51:53.830819+0000","last_undegraded":"2024-09-13T17:51:53.830819+0000","last_fullsized":"2024-09-13T17:51:53.830819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:37.125958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826446+0000","last_change":"2024-09-13T17:51:49.416301+0000","last_active":"2024-09-13T17:51:53.826446+0000","last_peered":"2024-09-13T17:51:53.826446+0000","last_clean":"2024-09-13T17:51:53.826446+0000","last_became_active":"2024-09-13T17:51:49.416065+0000","last_became_peered":"2024-09-13T17:51:49.416065+0000","last_unstale":"2024-09-13T17:51:53.826446+0000","last_undegraded":"2024-09-13T17:51:53.826446+0000","last_fullsized":"2024-09-13T17:51:53.826446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:42.283317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.847340+0000","last_change":"2024-09-13T17:51:53.844047+0000","last_active":"2024-09-13T17:51:53.847340+0000","last_peered":"2024-09-13T17:51:53.847340+0000","last_clean":"2024-09-13T17:51:53.847340+0000","last_became_active":"2024-09-13T17:51:53.843665+0000","last_became_peered":"2024-09-13T17:51:53.843665+0000","last_unstale":"2024-09-13T17:51:53.847340+0000","last_undegraded":"2024-09-13T17:51:53.847340+0000","last_fullsized":"2024-09-13T17:51:53.847340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:04.738599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.884913+0000","last_change":"2024-09-13T17:51:49.836513+0000","last_active":"2024-09-13T17:51:53.884913+0000","last_peered":"2024-09-13T17:51:53.884913+0000","last_clean":"2024-09-13T17:51:53.884913+0000","last_became_active":"2024-09-13T17:51:49.836232+0000","last_became_peered":"2024-09-13T17:51:49.836232+0000","last_unstale":"2024-09-13T17:51:53.884913+0000","last_undegraded":"2024-09-13T17:51:53.884913+0000","last_fullsized":"2024-09-13T17:51:53.884913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:37.125958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.841145+0000","last_change":"2024-09-13T17:51:49.420678+0000","last_active":"2024-09-13T17:51:53.841145+0000","last_peered":"2024-09-13T17:51:53.841145+0000","last_clean":"2024-09-13T17:51:53.841145+0000","last_became_active":"2024-09-13T17:51:49.420418+0000","last_became_peered":"2024-09-13T17:51:49.420418+0000","last_unstale":"2024-09-13T17:51:53.841145+0000","last_undegraded":"2024-09-13T17:51:53.841145+0000","last_fullsized":"2024-09-13T17:51:53.841145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:42.283317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.889765+0000","last_change":"2024-09-13T17:51:53.886172+0000","last_active":"2024-09-13T17:51:53.889765+0000","last_peered":"2024-09-13T17:51:53.889765+0000","last_clean":"2024-09-13T17:51:53.889765+0000","last_became_active":"2024-09-13T17:51:53.885826+0000","last_became_peered":"2024-09-13T17:51:53.885826+0000","last_unstale":"2024-09-13T17:51:53.889765+0000","last_undegraded":"2024-09-13T17:51:53.889765+0000","last_fullsized":"2024-09-13T17:51:53.889765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:46.649388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.885762+0000","last_change":"2024-09-13T17:51:49.834991+0000","last_active":"2024-09-13T17:51:53.885762+0000","last_peered":"2024-09-13T17:51:53.885762+0000","last_clean":"2024-09-13T17:51:53.885762+0000","last_became_active":"2024-09-13T17:51:49.834740+0000","last_became_peered":"2024-09-13T17:51:49.834740+0000","last_unstale":"2024-09-13T17:51:53.885762+0000","last_undegraded":"2024-09-13T17:51:53.885762+0000","last_fullsized":"2024-09-13T17:51:53.885762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:47.337762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.834831+0000","last_change":"2024-09-13T17:51:49.415586+0000","last_active":"2024-09-13T17:51:53.834831+0000","last_peered":"2024-09-13T17:51:53.834831+0000","last_clean":"2024-09-13T17:51:53.834831+0000","last_became_active":"2024-09-13T17:51:49.415184+0000","last_became_peered":"2024-09-13T17:51:49.415184+0000","last_unstale":"2024-09-13T17:51:53.834831+0000","last_undegraded":"2024-09-13T17:51:53.834831+0000","last_fullsized":"2024-09-13T17:51:53.834831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:38.364524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.851409+0000","last_change":"2024-09-13T17:51:53.848234+0000","last_active":"2024-09-13T17:51:53.851409+0000","last_peered":"2024-09-13T17:51:53.851409+0000","last_clean":"2024-09-13T17:51:53.851409+0000","last_became_active":"2024-09-13T17:51:53.847557+0000","last_became_peered":"2024-09-13T17:51:53.847557+0000","last_unstale":"2024-09-13T17:51:53.851409+0000","last_undegraded":"2024-09-13T17:51:53.851409+0000","last_fullsized":"2024-09-13T17:51:53.851409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:51.251781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.883636+0000","last_change":"2024-09-13T17:51:49.830867+0000","last_active":"2024-09-13T17:51:53.883636+0000","last_peered":"2024-09-13T17:51:53.883636+0000","last_clean":"2024-09-13T17:51:53.883636+0000","last_became_active":"2024-09-13T17:51:49.830584+0000","last_became_peered":"2024-09-13T17:51:49.830584+0000","last_unstale":"2024-09-13T17:51:53.883636+0000","last_undegraded":"2024-09-13T17:51:53.883636+0000","last_fullsized":"2024-09-13T17:51:53.883636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:51.162047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837955+0000","last_change":"2024-09-13T17:51:49.424019+0000","last_active":"2024-09-13T17:51:53.837955+0000","last_peered":"2024-09-13T17:51:53.837955+0000","last_clean":"2024-09-13T17:51:53.837955+0000","last_became_active":"2024-09-13T17:51:49.423710+0000","last_became_peered":"2024-09-13T17:51:49.423710+0000","last_unstale":"2024-09-13T17:51:53.837955+0000","last_undegraded":"2024-09-13T17:51:53.837955+0000","last_fullsized":"2024-09-13T17:51:53.837955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:01.166296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.849553+0000","last_change":"2024-09-13T17:51:53.844911+0000","last_active":"2024-09-13T17:51:53.849553+0000","last_peered":"2024-09-13T17:51:53.849553+0000","last_clean":"2024-09-13T17:51:53.849553+0000","last_became_active":"2024-09-13T17:51:53.844550+0000","last_became_peered":"2024-09-13T17:51:53.844550+0000","last_unstale":"2024-09-13T17:51:53.849553+0000","last_undegraded":"2024-09-13T17:51:53.849553+0000","last_fullsized":"2024-09-13T17:51:53.849553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:28.299853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826947+0000","last_change":"2024-09-13T17:51:49.811086+0000","last_active":"2024-09-13T17:51:53.826947+0000","last_peered":"2024-09-13T17:51:53.826947+0000","last_clean":"2024-09-13T17:51:53.826947+0000","last_became_active":"2024-09-13T17:51:49.810823+0000","last_became_peered":"2024-09-13T17:51:49.810823+0000","last_unstale":"2024-09-13T17:51:53.826947+0000","last_undegraded":"2024-09-13T17:51:53.826947+0000","last_fullsized":"2024-09-13T17:51:53.826947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:14.458841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827359+0000","last_change":"2024-09-13T17:51:49.426895+0000","last_active":"2024-09-13T17:51:53.827359+0000","last_peered":"2024-09-13T17:51:53.827359+0000","last_clean":"2024-09-13T17:51:53.827359+0000","last_became_active":"2024-09-13T17:51:49.426624+0000","last_became_peered":"2024-09-13T17:51:49.426624+0000","last_unstale":"2024-09-13T17:51:53.827359+0000","last_undegraded":"2024-09-13T17:51:53.827359+0000","last_fullsized":"2024-09-13T17:51:53.827359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:42.283317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.897944+0000","last_change":"2024-09-13T17:51:53.885895+0000","last_active":"2024-09-13T17:51:53.897944+0000","last_peered":"2024-09-13T17:51:53.897944+0000","last_clean":"2024-09-13T17:51:53.897944+0000","last_became_active":"2024-09-13T17:51:53.884841+0000","last_became_peered":"2024-09-13T17:51:53.884841+0000","last_unstale":"2024-09-13T17:51:53.897944+0000","last_undegraded":"2024-09-13T17:51:53.897944+0000","last_fullsized":"2024-09-13T17:51:53.897944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:27.675643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882609+0000","last_change":"2024-09-13T17:51:49.831817+0000","last_active":"2024-09-13T17:51:53.882609+0000","last_peered":"2024-09-13T17:51:53.882609+0000","last_clean":"2024-09-13T17:51:53.882609+0000","last_became_active":"2024-09-13T17:51:49.831354+0000","last_became_peered":"2024-09-13T17:51:49.831354+0000","last_unstale":"2024-09-13T17:51:53.882609+0000","last_undegraded":"2024-09-13T17:51:53.882609+0000","last_fullsized":"2024-09-13T17:51:53.882609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:04.470664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.838565+0000","last_change":"2024-09-13T17:51:49.422566+0000","last_active":"2024-09-13T17:51:53.838565+0000","last_peered":"2024-09-13T17:51:53.838565+0000","last_clean":"2024-09-13T17:51:53.838565+0000","last_became_active":"2024-09-13T17:51:49.421786+0000","last_became_peered":"2024-09-13T17:51:49.421786+0000","last_unstale":"2024-09-13T17:51:53.838565+0000","last_undegraded":"2024-09-13T17:51:53.838565+0000","last_fullsized":"2024-09-13T17:51:53.838565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:42.283317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.897908+0000","last_change":"2024-09-13T17:51:53.884841+0000","last_active":"2024-09-13T17:51:53.897908+0000","last_peered":"2024-09-13T17:51:53.897908+0000","last_clean":"2024-09-13T17:51:53.897908+0000","last_became_active":"2024-09-13T17:51:53.884135+0000","last_became_peered":"2024-09-13T17:51:53.884135+0000","last_unstale":"2024-09-13T17:51:53.897908+0000","last_undegraded":"2024-09-13T17:51:53.897908+0000","last_fullsized":"2024-09-13T17:51:53.897908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:53.766560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.836501+0000","last_change":"2024-09-13T17:51:49.824264+0000","last_active":"2024-09-13T17:51:53.836501+0000","last_peered":"2024-09-13T17:51:53.836501+0000","last_clean":"2024-09-13T17:51:53.836501+0000","last_became_active":"2024-09-13T17:51:49.823959+0000","last_became_peered":"2024-09-13T17:51:49.823959+0000","last_unstale":"2024-09-13T17:51:53.836501+0000","last_undegraded":"2024-09-13T17:51:53.836501+0000","last_fullsized":"2024-09-13T17:51:53.836501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:19.843619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837204+0000","last_change":"2024-09-13T17:51:49.425477+0000","last_active":"2024-09-13T17:51:53.837204+0000","last_peered":"2024-09-13T17:51:53.837204+0000","last_clean":"2024-09-13T17:51:53.837204+0000","last_became_active":"2024-09-13T17:51:49.425220+0000","last_became_peered":"2024-09-13T17:51:49.425220+0000","last_unstale":"2024-09-13T17:51:53.837204+0000","last_undegraded":"2024-09-13T17:51:53.837204+0000","last_fullsized":"2024-09-13T17:51:53.837204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:38.364524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.887527+0000","last_change":"2024-09-13T17:51:53.883758+0000","last_active":"2024-09-13T17:51:53.887527+0000","last_peered":"2024-09-13T17:51:53.887527+0000","last_clean":"2024-09-13T17:51:53.887527+0000","last_became_active":"2024-09-13T17:51:53.883328+0000","last_became_peered":"2024-09-13T17:51:53.883328+0000","last_unstale":"2024-09-13T17:51:53.887527+0000","last_undegraded":"2024-09-13T17:51:53.887527+0000","last_fullsized":"2024-09-13T17:51:53.887527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:39.243101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882767+0000","last_change":"2024-09-13T17:51:49.832481+0000","last_active":"2024-09-13T17:51:53.882767+0000","last_peered":"2024-09-13T17:51:53.882767+0000","last_clean":"2024-09-13T17:51:53.882767+0000","last_became_active":"2024-09-13T17:51:49.832173+0000","last_became_peered":"2024-09-13T17:51:49.832173+0000","last_unstale":"2024-09-13T17:51:53.882767+0000","last_undegraded":"2024-09-13T17:51:53.882767+0000","last_fullsized":"2024-09-13T17:51:53.882767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:34.576074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T17:51:59.930293+0000","last_change":"2024-09-13T17:51:49.430279+0000","last_active":"2024-09-13T17:51:59.930293+0000","last_peered":"2024-09-13T17:51:59.930293+0000","last_clean":"2024-09-13T17:51:59.930293+0000","last_became_active":"2024-09-13T17:51:49.430015+0000","last_became_peered":"2024-09-13T17:51:49.430015+0000","last_unstale":"2024-09-13T17:51:59.930293+0000","last_undegraded":"2024-09-13T17:51:59.930293+0000","last_fullsized":"2024-09-13T17:51:59.930293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:53.206793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.853325+0000","last_change":"2024-09-13T17:51:53.848938+0000","last_active":"2024-09-13T17:51:53.853325+0000","last_peered":"2024-09-13T17:51:53.853325+0000","last_clean":"2024-09-13T17:51:53.853325+0000","last_became_active":"2024-09-13T17:51:53.848420+0000","last_became_peered":"2024-09-13T17:51:53.848420+0000","last_unstale":"2024-09-13T17:51:53.853325+0000","last_undegraded":"2024-09-13T17:51:53.853325+0000","last_fullsized":"2024-09-13T17:51:53.853325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:06.615337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.834925+0000","last_change":"2024-09-13T17:51:49.827666+0000","last_active":"2024-09-13T17:51:53.834925+0000","last_peered":"2024-09-13T17:51:53.834925+0000","last_clean":"2024-09-13T17:51:53.834925+0000","last_became_active":"2024-09-13T17:51:49.827010+0000","last_became_peered":"2024-09-13T17:51:49.827010+0000","last_unstale":"2024-09-13T17:51:53.834925+0000","last_undegraded":"2024-09-13T17:51:53.834925+0000","last_fullsized":"2024-09-13T17:51:53.834925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:23.029433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826358+0000","last_change":"2024-09-13T17:51:49.421670+0000","last_active":"2024-09-13T17:51:53.826358+0000","last_peered":"2024-09-13T17:51:53.826358+0000","last_clean":"2024-09-13T17:51:53.826358+0000","last_became_active":"2024-09-13T17:51:49.418903+0000","last_became_peered":"2024-09-13T17:51:49.418903+0000","last_unstale":"2024-09-13T17:51:53.826358+0000","last_undegraded":"2024-09-13T17:51:53.826358+0000","last_fullsized":"2024-09-13T17:51:53.826358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:39.329721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.851665+0000","last_change":"2024-09-13T17:51:53.849211+0000","last_active":"2024-09-13T17:51:53.851665+0000","last_peered":"2024-09-13T17:51:53.851665+0000","last_clean":"2024-09-13T17:51:53.851665+0000","last_became_active":"2024-09-13T17:51:53.848829+0000","last_became_peered":"2024-09-13T17:51:53.848829+0000","last_unstale":"2024-09-13T17:51:53.851665+0000","last_undegraded":"2024-09-13T17:51:53.851665+0000","last_fullsized":"2024-09-13T17:51:53.851665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:56.070629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837633+0000","last_change":"2024-09-13T17:51:49.832116+0000","last_active":"2024-09-13T17:51:53.837633+0000","last_peered":"2024-09-13T17:51:53.837633+0000","last_clean":"2024-09-13T17:51:53.837633+0000","last_became_active":"2024-09-13T17:51:49.831837+0000","last_became_peered":"2024-09-13T17:51:49.831837+0000","last_unstale":"2024-09-13T17:51:53.837633+0000","last_undegraded":"2024-09-13T17:51:53.837633+0000","last_fullsized":"2024-09-13T17:51:53.837633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:07.738851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.832758+0000","last_change":"2024-09-13T17:51:49.421180+0000","last_active":"2024-09-13T17:51:53.832758+0000","last_peered":"2024-09-13T17:51:53.832758+0000","last_clean":"2024-09-13T17:51:53.832758+0000","last_became_active":"2024-09-13T17:51:49.420518+0000","last_became_peered":"2024-09-13T17:51:49.420518+0000","last_unstale":"2024-09-13T17:51:53.832758+0000","last_undegraded":"2024-09-13T17:51:53.832758+0000","last_fullsized":"2024-09-13T17:51:53.832758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:06.421994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.844571+0000","last_change":"2024-09-13T17:51:53.840737+0000","last_active":"2024-09-13T17:51:53.844571+0000","last_peered":"2024-09-13T17:51:53.844571+0000","last_clean":"2024-09-13T17:51:53.844571+0000","last_became_active":"2024-09-13T17:51:53.838857+0000","last_became_peered":"2024-09-13T17:51:53.838857+0000","last_unstale":"2024-09-13T17:51:53.844571+0000","last_undegraded":"2024-09-13T17:51:53.844571+0000","last_fullsized":"2024-09-13T17:51:53.844571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:00.438042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.832711+0000","last_change":"2024-09-13T17:51:49.820669+0000","last_active":"2024-09-13T17:51:53.832711+0000","last_peered":"2024-09-13T17:51:53.832711+0000","last_clean":"2024-09-13T17:51:53.832711+0000","last_became_active":"2024-09-13T17:51:49.820401+0000","last_became_peered":"2024-09-13T17:51:49.820401+0000","last_unstale":"2024-09-13T17:51:53.832711+0000","last_undegraded":"2024-09-13T17:51:53.832711+0000","last_fullsized":"2024-09-13T17:51:53.832711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:12.044921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827878+0000","last_change":"2024-09-13T17:51:49.428974+0000","last_active":"2024-09-13T17:51:53.827878+0000","last_peered":"2024-09-13T17:51:53.827878+0000","last_clean":"2024-09-13T17:51:53.827878+0000","last_became_active":"2024-09-13T17:51:49.428658+0000","last_became_peered":"2024-09-13T17:51:49.428658+0000","last_unstale":"2024-09-13T17:51:53.827878+0000","last_undegraded":"2024-09-13T17:51:53.827878+0000","last_fullsized":"2024-09-13T17:51:53.827878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:55.567370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.898056+0000","last_change":"2024-09-13T17:51:53.887256+0000","last_active":"2024-09-13T17:51:53.898056+0000","last_peered":"2024-09-13T17:51:53.898056+0000","last_clean":"2024-09-13T17:51:53.898056+0000","last_became_active":"2024-09-13T17:51:53.886890+0000","last_became_peered":"2024-09-13T17:51:53.886890+0000","last_unstale":"2024-09-13T17:51:53.898056+0000","last_undegraded":"2024-09-13T17:51:53.898056+0000","last_fullsized":"2024-09-13T17:51:53.898056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:50.331208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.891341+0000","last_change":"2024-09-13T17:51:53.887867+0000","last_active":"2024-09-13T17:51:53.891341+0000","last_peered":"2024-09-13T17:51:53.891341+0000","last_clean":"2024-09-13T17:51:53.891341+0000","last_became_active":"2024-09-13T17:51:53.887513+0000","last_became_peered":"2024-09-13T17:51:53.887513+0000","last_unstale":"2024-09-13T17:51:53.891341+0000","last_undegraded":"2024-09-13T17:51:53.891341+0000","last_fullsized":"2024-09-13T17:51:53.891341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:48:35.046158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.824092+0000","last_change":"2024-09-13T17:51:49.818712+0000","last_active":"2024-09-13T17:51:53.824092+0000","last_peered":"2024-09-13T17:51:53.824092+0000","last_clean":"2024-09-13T17:51:53.824092+0000","last_became_active":"2024-09-13T17:51:49.818441+0000","last_became_peered":"2024-09-13T17:51:49.818441+0000","last_unstale":"2024-09-13T17:51:53.824092+0000","last_undegraded":"2024-09-13T17:51:53.824092+0000","last_fullsized":"2024-09-13T17:51:53.824092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:43.263003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.831201+0000","last_change":"2024-09-13T17:51:49.414687+0000","last_active":"2024-09-13T17:51:53.831201+0000","last_peered":"2024-09-13T17:51:53.831201+0000","last_clean":"2024-09-13T17:51:53.831201+0000","last_became_active":"2024-09-13T17:51:49.414417+0000","last_became_peered":"2024-09-13T17:51:49.414417+0000","last_unstale":"2024-09-13T17:51:53.831201+0000","last_undegraded":"2024-09-13T17:51:53.831201+0000","last_fullsized":"2024-09-13T17:51:53.831201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:05.515948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.850818+0000","last_change":"2024-09-13T17:51:53.848088+0000","last_active":"2024-09-13T17:51:53.850818+0000","last_peered":"2024-09-13T17:51:53.850818+0000","last_clean":"2024-09-13T17:51:53.850818+0000","last_became_active":"2024-09-13T17:51:53.847545+0000","last_became_peered":"2024-09-13T17:51:53.847545+0000","last_unstale":"2024-09-13T17:51:53.850818+0000","last_undegraded":"2024-09-13T17:51:53.850818+0000","last_fullsized":"2024-09-13T17:51:53.850818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:25.404881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826689+0000","last_change":"2024-09-13T17:51:49.820694+0000","last_active":"2024-09-13T17:51:53.826689+0000","last_peered":"2024-09-13T17:51:53.826689+0000","last_clean":"2024-09-13T17:51:53.826689+0000","last_became_active":"2024-09-13T17:51:49.819217+0000","last_became_peered":"2024-09-13T17:51:49.819217+0000","last_unstale":"2024-09-13T17:51:53.826689+0000","last_undegraded":"2024-09-13T17:51:53.826689+0000","last_fullsized":"2024-09-13T17:51:53.826689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:16.626937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827381+0000","last_change":"2024-09-13T17:51:49.424168+0000","last_active":"2024-09-13T17:51:53.827381+0000","last_peered":"2024-09-13T17:51:53.827381+0000","last_clean":"2024-09-13T17:51:53.827381+0000","last_became_active":"2024-09-13T17:51:49.423884+0000","last_became_peered":"2024-09-13T17:51:49.423884+0000","last_unstale":"2024-09-13T17:51:53.827381+0000","last_undegraded":"2024-09-13T17:51:53.827381+0000","last_fullsized":"2024-09-13T17:51:53.827381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:38.364524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827736+0000","last_change":"2024-09-13T17:51:49.428168+0000","last_active":"2024-09-13T17:51:53.827736+0000","last_peered":"2024-09-13T17:51:53.827736+0000","last_clean":"2024-09-13T17:51:53.827736+0000","last_became_active":"2024-09-13T17:51:49.427823+0000","last_became_peered":"2024-09-13T17:51:49.427823+0000","last_unstale":"2024-09-13T17:51:53.827736+0000","last_undegraded":"2024-09-13T17:51:53.827736+0000","last_fullsized":"2024-09-13T17:51:53.827736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:06.421994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837095+0000","last_change":"2024-09-13T17:51:49.805322+0000","last_active":"2024-09-13T17:51:53.837095+0000","last_peered":"2024-09-13T17:51:53.837095+0000","last_clean":"2024-09-13T17:51:53.837095+0000","last_became_active":"2024-09-13T17:51:49.804205+0000","last_became_peered":"2024-09-13T17:51:49.804205+0000","last_unstale":"2024-09-13T17:51:53.837095+0000","last_undegraded":"2024-09-13T17:51:53.837095+0000","last_fullsized":"2024-09-13T17:51:53.837095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:43.263003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.854352+0000","last_change":"2024-09-13T17:51:53.851986+0000","last_active":"2024-09-13T17:51:53.854352+0000","last_peered":"2024-09-13T17:51:53.854352+0000","last_clean":"2024-09-13T17:51:53.854352+0000","last_became_active":"2024-09-13T17:51:53.851630+0000","last_became_peered":"2024-09-13T17:51:53.851630+0000","last_unstale":"2024-09-13T17:51:53.854352+0000","last_undegraded":"2024-09-13T17:51:53.854352+0000","last_fullsized":"2024-09-13T17:51:53.854352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:39.323134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827078+0000","last_change":"2024-09-13T17:51:49.417653+0000","last_active":"2024-09-13T17:51:53.827078+0000","last_peered":"2024-09-13T17:51:53.827078+0000","last_clean":"2024-09-13T17:51:53.827078+0000","last_became_active":"2024-09-13T17:51:49.417424+0000","last_became_peered":"2024-09-13T17:51:49.417424+0000","last_unstale":"2024-09-13T17:51:53.827078+0000","last_undegraded":"2024-09-13T17:51:53.827078+0000","last_fullsized":"2024-09-13T17:51:53.827078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:48.383027+0000","last_clean_scrub_stamp":"2024-09-13T17:51:48.383027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:01.166296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.834334+0000","last_change":"2024-09-13T17:51:49.806919+0000","last_active":"2024-09-13T17:51:53.834334+0000","last_peered":"2024-09-13T17:51:53.834334+0000","last_clean":"2024-09-13T17:51:53.834334+0000","last_became_active":"2024-09-13T17:51:49.806493+0000","last_became_peered":"2024-09-13T17:51:49.806493+0000","last_unstale":"2024-09-13T17:51:53.834334+0000","last_undegraded":"2024-09-13T17:51:53.834334+0000","last_fullsized":"2024-09-13T17:51:53.834334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:54.213102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.856376+0000","last_change":"2024-09-13T17:51:53.850120+0000","last_active":"2024-09-13T17:51:53.856376+0000","last_peered":"2024-09-13T17:51:53.856376+0000","last_clean":"2024-09-13T17:51:53.856376+0000","last_became_active":"2024-09-13T17:51:53.849730+0000","last_became_peered":"2024-09-13T17:51:53.849730+0000","last_unstale":"2024-09-13T17:51:53.856376+0000","last_undegraded":"2024-09-13T17:51:53.856376+0000","last_fullsized":"2024-09-13T17:51:53.856376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:52.809933+0000","last_clean_scrub_stamp":"2024-09-13T17:51:52.809933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:05.592560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826849+0000","last_change":"2024-09-13T17:51:49.826333+0000","last_active":"2024-09-13T17:51:53.826849+0000","last_peered":"2024-09-13T17:51:53.826849+0000","last_clean":"2024-09-13T17:51:53.826849+0000","last_became_active":"2024-09-13T17:51:49.826071+0000","last_became_peered":"2024-09-13T17:51:49.826071+0000","last_unstale":"2024-09-13T17:51:53.826849+0000","last_undegraded":"2024-09-13T17:51:53.826849+0000","last_fullsized":"2024-09-13T17:51:53.826849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:38.101006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.837999+0000","last_change":"2024-09-13T17:51:49.809218+0000","last_active":"2024-09-13T17:51:53.837999+0000","last_peered":"2024-09-13T17:51:53.837999+0000","last_clean":"2024-09-13T17:51:53.837999+0000","last_became_active":"2024-09-13T17:51:49.808985+0000","last_became_peered":"2024-09-13T17:51:49.808985+0000","last_unstale":"2024-09-13T17:51:53.837999+0000","last_undegraded":"2024-09-13T17:51:53.837999+0000","last_fullsized":"2024-09-13T17:51:53.837999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:21.618580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.838422+0000","last_change":"2024-09-13T17:51:49.830357+0000","last_active":"2024-09-13T17:51:53.838422+0000","last_peered":"2024-09-13T17:51:53.838422+0000","last_clean":"2024-09-13T17:51:53.838422+0000","last_became_active":"2024-09-13T17:51:49.830084+0000","last_became_peered":"2024-09-13T17:51:49.830084+0000","last_unstale":"2024-09-13T17:51:53.838422+0000","last_undegraded":"2024-09-13T17:51:53.838422+0000","last_fullsized":"2024-09-13T17:51:53.838422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:21.449832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.836968+0000","last_change":"2024-09-13T17:51:49.826591+0000","last_active":"2024-09-13T17:51:53.836968+0000","last_peered":"2024-09-13T17:51:53.836968+0000","last_clean":"2024-09-13T17:51:53.836968+0000","last_became_active":"2024-09-13T17:51:49.826406+0000","last_became_peered":"2024-09-13T17:51:49.826406+0000","last_unstale":"2024-09-13T17:51:53.836968+0000","last_undegraded":"2024-09-13T17:51:53.836968+0000","last_fullsized":"2024-09-13T17:51:53.836968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:36.343757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.828767+0000","last_change":"2024-09-13T17:51:49.831819+0000","last_active":"2024-09-13T17:51:53.828767+0000","last_peered":"2024-09-13T17:51:53.828767+0000","last_clean":"2024-09-13T17:51:53.828767+0000","last_became_active":"2024-09-13T17:51:49.831617+0000","last_became_peered":"2024-09-13T17:51:49.831617+0000","last_unstale":"2024-09-13T17:51:53.828767+0000","last_undegraded":"2024-09-13T17:51:53.828767+0000","last_fullsized":"2024-09-13T17:51:53.828767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:43.263003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826257+0000","last_change":"2024-09-13T17:51:49.826770+0000","last_active":"2024-09-13T17:51:53.826257+0000","last_peered":"2024-09-13T17:51:53.826257+0000","last_clean":"2024-09-13T17:51:53.826257+0000","last_became_active":"2024-09-13T17:51:49.826103+0000","last_became_peered":"2024-09-13T17:51:49.826103+0000","last_unstale":"2024-09-13T17:51:53.826257+0000","last_undegraded":"2024-09-13T17:51:53.826257+0000","last_fullsized":"2024-09-13T17:51:53.826257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:35.902537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827779+0000","last_change":"2024-09-13T17:51:49.816685+0000","last_active":"2024-09-13T17:51:53.827779+0000","last_peered":"2024-09-13T17:51:53.827779+0000","last_clean":"2024-09-13T17:51:53.827779+0000","last_became_active":"2024-09-13T17:51:49.816364+0000","last_became_peered":"2024-09-13T17:51:49.816364+0000","last_unstale":"2024-09-13T17:51:53.827779+0000","last_undegraded":"2024-09-13T17:51:53.827779+0000","last_fullsized":"2024-09-13T17:51:53.827779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:19.843619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.829842+0000","last_change":"2024-09-13T17:51:49.829446+0000","last_active":"2024-09-13T17:51:53.829842+0000","last_peered":"2024-09-13T17:51:53.829842+0000","last_clean":"2024-09-13T17:51:53.829842+0000","last_became_active":"2024-09-13T17:51:49.829196+0000","last_became_peered":"2024-09-13T17:51:49.829196+0000","last_unstale":"2024-09-13T17:51:53.829842+0000","last_undegraded":"2024-09-13T17:51:53.829842+0000","last_fullsized":"2024-09-13T17:51:53.829842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:14.458841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.831119+0000","last_change":"2024-09-13T17:51:49.835245+0000","last_active":"2024-09-13T17:51:53.831119+0000","last_peered":"2024-09-13T17:51:53.831119+0000","last_clean":"2024-09-13T17:51:53.831119+0000","last_became_active":"2024-09-13T17:51:49.834941+0000","last_became_peered":"2024-09-13T17:51:49.834941+0000","last_unstale":"2024-09-13T17:51:53.831119+0000","last_undegraded":"2024-09-13T17:51:53.831119+0000","last_fullsized":"2024-09-13T17:51:53.831119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:18.962464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827310+0000","last_change":"2024-09-13T17:51:49.831150+0000","last_active":"2024-09-13T17:51:53.827310+0000","last_peered":"2024-09-13T17:51:53.827310+0000","last_clean":"2024-09-13T17:51:53.827310+0000","last_became_active":"2024-09-13T17:51:49.830923+0000","last_became_peered":"2024-09-13T17:51:49.830923+0000","last_unstale":"2024-09-13T17:51:53.827310+0000","last_undegraded":"2024-09-13T17:51:53.827310+0000","last_fullsized":"2024-09-13T17:51:53.827310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:35.902537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.835969+0000","last_change":"2024-09-13T17:51:49.831132+0000","last_active":"2024-09-13T17:51:53.835969+0000","last_peered":"2024-09-13T17:51:53.835969+0000","last_clean":"2024-09-13T17:51:53.835969+0000","last_became_active":"2024-09-13T17:51:49.822819+0000","last_became_peered":"2024-09-13T17:51:49.822819+0000","last_unstale":"2024-09-13T17:51:53.835969+0000","last_undegraded":"2024-09-13T17:51:53.835969+0000","last_fullsized":"2024-09-13T17:51:53.835969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:01.180550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.836860+0000","last_change":"2024-09-13T17:51:49.826381+0000","last_active":"2024-09-13T17:51:53.836860+0000","last_peered":"2024-09-13T17:51:53.836860+0000","last_clean":"2024-09-13T17:51:53.836860+0000","last_became_active":"2024-09-13T17:51:49.816777+0000","last_became_peered":"2024-09-13T17:51:49.816777+0000","last_unstale":"2024-09-13T17:51:53.836860+0000","last_undegraded":"2024-09-13T17:51:53.836860+0000","last_fullsized":"2024-09-13T17:51:53.836860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:18.962464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827364+0000","last_change":"2024-09-13T17:51:49.815417+0000","last_active":"2024-09-13T17:51:53.827364+0000","last_peered":"2024-09-13T17:51:53.827364+0000","last_clean":"2024-09-13T17:51:53.827364+0000","last_became_active":"2024-09-13T17:51:49.814545+0000","last_became_peered":"2024-09-13T17:51:49.814545+0000","last_unstale":"2024-09-13T17:51:53.827364+0000","last_undegraded":"2024-09-13T17:51:53.827364+0000","last_fullsized":"2024-09-13T17:51:53.827364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:26.069550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.884324+0000","last_change":"2024-09-13T17:51:49.832628+0000","last_active":"2024-09-13T17:51:53.884324+0000","last_peered":"2024-09-13T17:51:53.884324+0000","last_clean":"2024-09-13T17:51:53.884324+0000","last_became_active":"2024-09-13T17:51:49.832374+0000","last_became_peered":"2024-09-13T17:51:49.832374+0000","last_unstale":"2024-09-13T17:51:53.884324+0000","last_undegraded":"2024-09-13T17:51:53.884324+0000","last_fullsized":"2024-09-13T17:51:53.884324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:01.180550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.841065+0000","last_change":"2024-09-13T17:51:49.815728+0000","last_active":"2024-09-13T17:51:53.841065+0000","last_peered":"2024-09-13T17:51:53.841065+0000","last_clean":"2024-09-13T17:51:53.841065+0000","last_became_active":"2024-09-13T17:51:49.815464+0000","last_became_peered":"2024-09-13T17:51:49.815464+0000","last_unstale":"2024-09-13T17:51:53.841065+0000","last_undegraded":"2024-09-13T17:51:53.841065+0000","last_fullsized":"2024-09-13T17:51:53.841065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:22.017119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.830807+0000","last_change":"2024-09-13T17:51:49.823164+0000","last_active":"2024-09-13T17:51:53.830807+0000","last_peered":"2024-09-13T17:51:53.830807+0000","last_clean":"2024-09-13T17:51:53.830807+0000","last_became_active":"2024-09-13T17:51:49.822858+0000","last_became_peered":"2024-09-13T17:51:49.822858+0000","last_unstale":"2024-09-13T17:51:53.830807+0000","last_undegraded":"2024-09-13T17:51:53.830807+0000","last_fullsized":"2024-09-13T17:51:53.830807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:12:04.288019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.830989+0000","last_change":"2024-09-13T17:51:49.820290+0000","last_active":"2024-09-13T17:51:53.830989+0000","last_peered":"2024-09-13T17:51:53.830989+0000","last_clean":"2024-09-13T17:51:53.830989+0000","last_became_active":"2024-09-13T17:51:49.820037+0000","last_became_peered":"2024-09-13T17:51:49.820037+0000","last_unstale":"2024-09-13T17:51:53.830989+0000","last_undegraded":"2024-09-13T17:51:53.830989+0000","last_fullsized":"2024-09-13T17:51:53.830989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:51.162047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.824544+0000","last_change":"2024-09-13T17:51:49.806528+0000","last_active":"2024-09-13T17:51:53.824544+0000","last_peered":"2024-09-13T17:51:53.824544+0000","last_clean":"2024-09-13T17:51:53.824544+0000","last_became_active":"2024-09-13T17:51:49.806269+0000","last_became_peered":"2024-09-13T17:51:49.806269+0000","last_unstale":"2024-09-13T17:51:53.824544+0000","last_undegraded":"2024-09-13T17:51:53.824544+0000","last_fullsized":"2024-09-13T17:51:53.824544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:26.069550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.836406+0000","last_change":"2024-09-13T17:51:49.808911+0000","last_active":"2024-09-13T17:51:53.836406+0000","last_peered":"2024-09-13T17:51:53.836406+0000","last_clean":"2024-09-13T17:51:53.836406+0000","last_became_active":"2024-09-13T17:51:49.808332+0000","last_became_peered":"2024-09-13T17:51:49.808332+0000","last_unstale":"2024-09-13T17:51:53.836406+0000","last_undegraded":"2024-09-13T17:51:53.836406+0000","last_fullsized":"2024-09-13T17:51:53.836406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:14.458841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.825613+0000","last_change":"2024-09-13T17:51:49.826315+0000","last_active":"2024-09-13T17:51:53.825613+0000","last_peered":"2024-09-13T17:51:53.825613+0000","last_clean":"2024-09-13T17:51:53.825613+0000","last_became_active":"2024-09-13T17:51:49.825996+0000","last_became_peered":"2024-09-13T17:51:49.825996+0000","last_unstale":"2024-09-13T17:51:53.825613+0000","last_undegraded":"2024-09-13T17:51:53.825613+0000","last_fullsized":"2024-09-13T17:51:53.825613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:26.069550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.834840+0000","last_change":"2024-09-13T17:51:49.814558+0000","last_active":"2024-09-13T17:51:53.834840+0000","last_peered":"2024-09-13T17:51:53.834840+0000","last_clean":"2024-09-13T17:51:53.834840+0000","last_became_active":"2024-09-13T17:51:49.814289+0000","last_became_peered":"2024-09-13T17:51:49.814289+0000","last_unstale":"2024-09-13T17:51:53.834840+0000","last_undegraded":"2024-09-13T17:51:53.834840+0000","last_fullsized":"2024-09-13T17:51:53.834840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:08.128556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.828014+0000","last_change":"2024-09-13T17:51:49.838829+0000","last_active":"2024-09-13T17:51:53.828014+0000","last_peered":"2024-09-13T17:51:53.828014+0000","last_clean":"2024-09-13T17:51:53.828014+0000","last_became_active":"2024-09-13T17:51:49.838534+0000","last_became_peered":"2024-09-13T17:51:49.838534+0000","last_unstale":"2024-09-13T17:51:53.828014+0000","last_undegraded":"2024-09-13T17:51:53.828014+0000","last_fullsized":"2024-09-13T17:51:53.828014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:16.626937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.827668+0000","last_change":"2024-09-13T17:51:49.838082+0000","last_active":"2024-09-13T17:51:53.827668+0000","last_peered":"2024-09-13T17:51:53.827668+0000","last_clean":"2024-09-13T17:51:53.827668+0000","last_became_active":"2024-09-13T17:51:49.837831+0000","last_became_peered":"2024-09-13T17:51:49.837831+0000","last_unstale":"2024-09-13T17:51:53.827668+0000","last_undegraded":"2024-09-13T17:51:53.827668+0000","last_fullsized":"2024-09-13T17:51:53.827668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:43.263003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.884838+0000","last_change":"2024-09-13T17:51:49.838813+0000","last_active":"2024-09-13T17:51:53.884838+0000","last_peered":"2024-09-13T17:51:53.884838+0000","last_clean":"2024-09-13T17:51:53.884838+0000","last_became_active":"2024-09-13T17:51:49.838605+0000","last_became_peered":"2024-09-13T17:51:49.838605+0000","last_unstale":"2024-09-13T17:51:53.884838+0000","last_undegraded":"2024-09-13T17:51:53.884838+0000","last_fullsized":"2024-09-13T17:51:53.884838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:58.370954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826601+0000","last_change":"2024-09-13T17:51:49.839695+0000","last_active":"2024-09-13T17:51:53.826601+0000","last_peered":"2024-09-13T17:51:53.826601+0000","last_clean":"2024-09-13T17:51:53.826601+0000","last_became_active":"2024-09-13T17:51:49.839480+0000","last_became_peered":"2024-09-13T17:51:49.839480+0000","last_unstale":"2024-09-13T17:51:53.826601+0000","last_undegraded":"2024-09-13T17:51:53.826601+0000","last_fullsized":"2024-09-13T17:51:53.826601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:43:34.576074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.883275+0000","last_change":"2024-09-13T17:51:49.826878+0000","last_active":"2024-09-13T17:51:53.883275+0000","last_peered":"2024-09-13T17:51:53.883275+0000","last_clean":"2024-09-13T17:51:53.883275+0000","last_became_active":"2024-09-13T17:51:49.825030+0000","last_became_peered":"2024-09-13T17:51:49.825030+0000","last_unstale":"2024-09-13T17:51:53.883275+0000","last_undegraded":"2024-09-13T17:51:53.883275+0000","last_fullsized":"2024-09-13T17:51:53.883275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:12:04.288019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.835914+0000","last_change":"2024-09-13T17:51:49.811222+0000","last_active":"2024-09-13T17:51:53.835914+0000","last_peered":"2024-09-13T17:51:53.835914+0000","last_clean":"2024-09-13T17:51:53.835914+0000","last_became_active":"2024-09-13T17:51:49.810759+0000","last_became_peered":"2024-09-13T17:51:49.810759+0000","last_unstale":"2024-09-13T17:51:53.835914+0000","last_undegraded":"2024-09-13T17:51:53.835914+0000","last_fullsized":"2024-09-13T17:51:53.835914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:19.843619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.882539+0000","last_change":"2024-09-13T17:51:49.833530+0000","last_active":"2024-09-13T17:51:53.882539+0000","last_peered":"2024-09-13T17:51:53.882539+0000","last_clean":"2024-09-13T17:51:53.882539+0000","last_became_active":"2024-09-13T17:51:49.832951+0000","last_became_peered":"2024-09-13T17:51:49.832951+0000","last_unstale":"2024-09-13T17:51:53.882539+0000","last_undegraded":"2024-09-13T17:51:53.882539+0000","last_fullsized":"2024-09-13T17:51:53.882539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:54.519014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.830679+0000","last_change":"2024-09-13T17:51:49.830297+0000","last_active":"2024-09-13T17:51:53.830679+0000","last_peered":"2024-09-13T17:51:53.830679+0000","last_clean":"2024-09-13T17:51:53.830679+0000","last_became_active":"2024-09-13T17:51:49.829669+0000","last_became_peered":"2024-09-13T17:51:49.829669+0000","last_unstale":"2024-09-13T17:51:53.830679+0000","last_undegraded":"2024-09-13T17:51:53.830679+0000","last_fullsized":"2024-09-13T17:51:53.830679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:47.337762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.843087+0000","last_change":"2024-09-13T17:51:49.803908+0000","last_active":"2024-09-13T17:51:53.843087+0000","last_peered":"2024-09-13T17:51:53.843087+0000","last_clean":"2024-09-13T17:51:53.843087+0000","last_became_active":"2024-09-13T17:51:49.803684+0000","last_became_peered":"2024-09-13T17:51:49.803684+0000","last_unstale":"2024-09-13T17:51:53.843087+0000","last_undegraded":"2024-09-13T17:51:53.843087+0000","last_fullsized":"2024-09-13T17:51:53.843087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:45.192413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.826601+0000","last_change":"2024-09-13T17:51:49.815512+0000","last_active":"2024-09-13T17:51:53.826601+0000","last_peered":"2024-09-13T17:51:53.826601+0000","last_clean":"2024-09-13T17:51:53.826601+0000","last_became_active":"2024-09-13T17:51:49.814103+0000","last_became_peered":"2024-09-13T17:51:49.814103+0000","last_unstale":"2024-09-13T17:51:53.826601+0000","last_undegraded":"2024-09-13T17:51:53.826601+0000","last_fullsized":"2024-09-13T17:51:53.826601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:19.843619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T17:51:53.885722+0000","last_change":"2024-09-13T17:51:49.827858+0000","last_active":"2024-09-13T17:51:53.885722+0000","last_peered":"2024-09-13T17:51:53.885722+0000","last_clean":"2024-09-13T17:51:53.885722+0000","last_became_active":"2024-09-13T17:51:49.827613+0000","last_became_peered":"2024-09-13T17:51:49.827613+0000","last_unstale":"2024-09-13T17:51:53.885722+0000","last_undegraded":"2024-09-13T17:51:53.885722+0000","last_fullsized":"2024-09-13T17:51:53.885722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:49.389336+0000","last_clean_scrub_stamp":"2024-09-13T17:51:49.389336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:03.945317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:52:19.102 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T17:52:19.102 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T17:52:19.102 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T17:52:19.102 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T17:52:19.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f0586200640 1 Processor -- start 2024-09-13T17:52:19.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f0586200640 1 -- start start 2024-09-13T17:52:19.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f0586200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f058015e7c0 0x7f05801653e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:19.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f0586200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05800ce540 con 0x7f05800ce0b0 2024-09-13T17:52:19.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f0586200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05800ce820 con 0x7f058015a650 2024-09-13T17:52:19.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f0586200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058015ba40 con 0x7f058015e7c0 2024-09-13T17:52:19.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f057ea00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f05800ce0b0 0x7f058015e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33426/0 (socket says 172.21.15.114:33426) 2024-09-13T17:52:19.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f057ea00640 1 -- 172.21.15.114:0/331819903 learned_addr learned my addr 172.21.15.114:0/331819903 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:19.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f057fe00640 1 --2- 172.21.15.114:0/331819903 >> v2:172.21.15.134:3300/0 conn(0x7f058015e7c0 0x7f05801653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:19.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f057e000640 1 -- 172.21.15.114:0/331819903 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672368236 0 0) 0x7f05800ce540 con 0x7f05800ce0b0 2024-09-13T17:52:19.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f057e000640 1 -- 172.21.15.114:0/331819903 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0564003530 con 0x7f05800ce0b0 2024-09-13T17:52:19.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f057e000640 1 -- 172.21.15.114:0/331819903 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2084972026 0 0) 0x7f0564003530 con 0x7f05800ce0b0 2024-09-13T17:52:19.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f057e000640 1 -- 172.21.15.114:0/331819903 >> v2:172.21.15.134:3300/0 conn(0x7f058015e7c0 msgr2=0x7f05801653e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:19.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f057e000640 1 --2- 172.21.15.114:0/331819903 >> v2:172.21.15.134:3300/0 conn(0x7f058015e7c0 0x7f05801653e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f057e000640 1 -- 172.21.15.114:0/331819903 >> v1:172.21.15.134:6789/0 conn(0x7f058015a650 legacy=0x7f0580099480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:19.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f057e000640 1 -- 172.21.15.114:0/331819903 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05800ceb00 con 0x7f05800ce0b0 2024-09-13T17:52:19.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f057e000640 1 -- 172.21.15.114:0/331819903 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7f056c001680 con 0x7f05800ce0b0 2024-09-13T17:52:19.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f057e000640 1 -- 172.21.15.114:0/331819903 >> v1:172.21.15.114:6789/0 conn(0x7f05800ce0b0 legacy=0x7f058015e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:19.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f057e000640 1 --2- 172.21.15.114:0/331819903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0564003980 0x7f0564003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:19.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f057e000640 1 --2- 172.21.15.114:0/331819903 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05640047d0 0x7f0564004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:19.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f057e000640 1 --2- 172.21.15.114:0/331819903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0564005190 0x7f056400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:19.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f057e000640 1 -- 172.21.15.114:0/331819903 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058015ba40 con 0x7f0564005190 2024-09-13T17:52:19.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f057e000640 1 -- 172.21.15.114:0/331819903 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056400c030 con 0x7f0564003980 2024-09-13T17:52:19.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f057e000640 1 -- 172.21.15.114:0/331819903 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056400c1f0 con 0x7f05640047d0 2024-09-13T17:52:19.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f057fe00640 1 --2- 172.21.15.114:0/331819903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0564005190 0x7f056400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:19.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f057f400640 1 --2- 172.21.15.114:0/331819903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0564003980 0x7f0564003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:19.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f057ea00640 1 --2- 172.21.15.114:0/331819903 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05640047d0 0x7f0564004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:19.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f057fe00640 1 -- 172.21.15.114:0/331819903 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05640047d0 msgr2=0x7f0564004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:19.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f057fe00640 1 --2- 172.21.15.114:0/331819903 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f05640047d0 0x7f0564004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f057fe00640 1 -- 172.21.15.114:0/331819903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0564003980 msgr2=0x7f0564003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:19.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f057fe00640 1 --2- 172.21.15.114:0/331819903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0564003980 0x7f0564003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.268+0000 7f057fe00640 1 -- 172.21.15.114:0/331819903 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0564003530 con 0x7f0564005190 2024-09-13T17:52:19.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.272+0000 7f057fe00640 1 -- 172.21.15.114:0/331819903 reap_dead start 2024-09-13T17:52:19.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.272+0000 7f057fe00640 1 --2- 172.21.15.114:0/331819903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0564005190 0x7f056400b990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0578009ae0 tx=0x7f057801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c397c449373ea2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:19.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.272+0000 7f057e000640 1 -- 172.21.15.114:0/331819903 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0578004020 con 0x7f0564005190 2024-09-13T17:52:19.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.272+0000 7f057e000640 1 -- 172.21.15.114:0/331819903 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0578004180 con 0x7f0564005190 2024-09-13T17:52:19.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.272+0000 7f057e000640 1 -- 172.21.15.114:0/331819903 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05780a56a0 con 0x7f0564005190 2024-09-13T17:52:19.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.272+0000 7f0586200640 1 -- 172.21.15.114:0/331819903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0564005190 msgr2=0x7f056400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:19.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.272+0000 7f0586200640 1 --2- 172.21.15.114:0/331819903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0564005190 0x7f056400b990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0578009ae0 tx=0x7f057801cab0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.272+0000 7f0586200640 1 -- 172.21.15.114:0/331819903 shutdown_connections 2024-09-13T17:52:19.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.272+0000 7f0586200640 1 --2- 172.21.15.114:0/331819903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0564005190 0x7f056400b990 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.272+0000 7f0586200640 1 -- 172.21.15.114:0/331819903 >> 172.21.15.114:0/331819903 conn(0x7f05800d04e0 msgr2=0x7f05800d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:19.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.272+0000 7f0586200640 1 -- 172.21.15.114:0/331819903 shutdown_connections 2024-09-13T17:52:19.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.272+0000 7f0586200640 1 -- 172.21.15.114:0/331819903 wait complete. 2024-09-13T17:52:19.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.276+0000 7f0586200640 1 Processor -- start 2024-09-13T17:52:19.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.276+0000 7f0586200640 1 -- start start 2024-09-13T17:52:19.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.276+0000 7f0586200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0564005190 0x7f05800af590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:19.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.276+0000 7f0586200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05800b4c50 0x7f05800ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:19.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.276+0000 7f0586200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05800b3cd0 0x7f05800b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:19.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.276+0000 7f0586200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05800c67a0 con 0x7f05800b3cd0 2024-09-13T17:52:19.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.276+0000 7f0586200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05800c61e0 con 0x7f05800b4c50 2024-09-13T17:52:19.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.276+0000 7f0586200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05800c64c0 con 0x7f0564005190 2024-09-13T17:52:19.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.276+0000 7f057fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05800b3cd0 0x7f05800b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:19.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.276+0000 7f057fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05800b3cd0 0x7f05800b4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50502/0 (socket says 172.21.15.114:50502) 2024-09-13T17:52:19.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.276+0000 7f057fe00640 1 -- 172.21.15.114:0/4212148207 learned_addr learned my addr 172.21.15.114:0/4212148207 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:19.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.276+0000 7f057f400640 1 --2- 172.21.15.114:0/4212148207 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0564005190 0x7f05800af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:19.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.276+0000 7f057ea00640 1 --2- 172.21.15.114:0/4212148207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05800b4c50 0x7f05800ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:19.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.276+0000 7f057fe00640 1 -- 172.21.15.114:0/4212148207 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0564005190 msgr2=0x7f05800af590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:19.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.276+0000 7f057fe00640 1 --2- 172.21.15.114:0/4212148207 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0564005190 0x7f05800af590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.276+0000 7f057fe00640 1 -- 172.21.15.114:0/4212148207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05800b4c50 msgr2=0x7f05800ad2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:19.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.276+0000 7f057fe00640 1 --2- 172.21.15.114:0/4212148207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05800b4c50 0x7f05800ad2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.276+0000 7f057fe00640 1 -- 172.21.15.114:0/4212148207 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05800b34d0 con 0x7f05800b3cd0 2024-09-13T17:52:19.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.276+0000 7f057f400640 1 --2- 172.21.15.114:0/4212148207 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0564005190 0x7f05800af590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:52:19.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.276+0000 7f057ea00640 1 --2- 172.21.15.114:0/4212148207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05800b4c50 0x7f05800ad2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:52:19.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.276+0000 7f057fe00640 1 --2- 172.21.15.114:0/4212148207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05800b3cd0 0x7f05800b4160 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f057801d350 tx=0x7f0578019850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:19.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.276+0000 7f0577400640 1 -- 172.21.15.114:0/4212148207 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05780044f0 con 0x7f05800b3cd0 2024-09-13T17:52:19.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.276+0000 7f0577400640 1 -- 172.21.15.114:0/4212148207 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0578003620 con 0x7f05800b3cd0 2024-09-13T17:52:19.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.276+0000 7f0586200640 1 -- 172.21.15.114:0/4212148207 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05800b37b0 con 0x7f05800b3cd0 2024-09-13T17:52:19.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.276+0000 7f0577400640 1 -- 172.21.15.114:0/4212148207 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05780039b0 con 0x7f05800b3cd0 2024-09-13T17:52:19.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.276+0000 7f0586200640 1 -- 172.21.15.114:0/4212148207 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05800c5e20 con 0x7f05800b3cd0 2024-09-13T17:52:19.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.280+0000 7f0586200640 1 -- 172.21.15.114:0/4212148207 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05800b3330 con 0x7f05800b3cd0 2024-09-13T17:52:19.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.280+0000 7f0577400640 1 -- 172.21.15.114:0/4212148207 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0578003b10 con 0x7f05800b3cd0 2024-09-13T17:52:19.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.280+0000 7f0577400640 1 --2- 172.21.15.114:0/4212148207 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0560066690 0x7f0560068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:19.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.280+0000 7f0577400640 1 -- 172.21.15.114:0/4212148207 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f057811df20 con 0x7f05800b3cd0 2024-09-13T17:52:19.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.280+0000 7f057f400640 1 --2- 172.21.15.114:0/4212148207 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0560066690 0x7f0560068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:19.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.280+0000 7f057f400640 1 --2- 172.21.15.114:0/4212148207 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0560066690 0x7f0560068b50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0570000f90 tx=0x7f0570009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:19.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.284+0000 7f0577400640 1 -- 172.21.15.114:0/4212148207 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f05800b3330 con 0x7f05800b3cd0 2024-09-13T17:52:19.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.468+0000 7f0586200640 1 -- 172.21.15.114:0/4212148207 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f05800b3330 con 0x7f05800b3cd0 2024-09-13T17:52:19.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.468+0000 7f0577400640 1 -- 172.21.15.114:0/4212148207 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f05800b3330 con 0x7f05800b3cd0 2024-09-13T17:52:19.473 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:19.473 INFO:teuthology.orchestra.run.smithi114.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T17:52:19.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.472+0000 7f0586200640 1 -- 172.21.15.114:0/4212148207 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0560066690 msgr2=0x7f0560068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:19.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.472+0000 7f0586200640 1 --2- 172.21.15.114:0/4212148207 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0560066690 0x7f0560068b50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0570000f90 tx=0x7f0570009040 comp rx=0 tx=0).stop 2024-09-13T17:52:19.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.472+0000 7f0586200640 1 -- 172.21.15.114:0/4212148207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05800b3cd0 msgr2=0x7f05800b4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:19.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.472+0000 7f0586200640 1 --2- 172.21.15.114:0/4212148207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05800b3cd0 0x7f05800b4160 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f057801d350 tx=0x7f0578019850 comp rx=0 tx=0).stop 2024-09-13T17:52:19.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.472+0000 7f0586200640 1 -- 172.21.15.114:0/4212148207 shutdown_connections 2024-09-13T17:52:19.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.472+0000 7f0586200640 1 --2- 172.21.15.114:0/4212148207 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0560066690 0x7f0560068b50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.472+0000 7f0586200640 1 --2- 172.21.15.114:0/4212148207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f05800b3cd0 0x7f05800b4160 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.472+0000 7f0586200640 1 --2- 172.21.15.114:0/4212148207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05800b4c50 0x7f05800ad2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.472+0000 7f0586200640 1 --2- 172.21.15.114:0/4212148207 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0564005190 0x7f05800af590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.472+0000 7f0586200640 1 -- 172.21.15.114:0/4212148207 >> 172.21.15.114:0/4212148207 conn(0x7f05800d04e0 msgr2=0x7f058006f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:19.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.472+0000 7f0586200640 1 -- 172.21.15.114:0/4212148207 shutdown_connections 2024-09-13T17:52:19.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.472+0000 7f0586200640 1 -- 172.21.15.114:0/4212148207 wait complete. 2024-09-13T17:52:19.493 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T17:52:19.493 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:52:19.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.624+0000 7f55b6a00640 1 Processor -- start 2024-09-13T17:52:19.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.624+0000 7f55b6a00640 1 -- start start 2024-09-13T17:52:19.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.628+0000 7f55b6a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f55b006b6d0 0x7f55b006cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:19.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.628+0000 7f55b6a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55b0069f80 con 0x7f55b006b270 2024-09-13T17:52:19.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.628+0000 7f55b6a00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55b006ade0 con 0x7f55b0140860 2024-09-13T17:52:19.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.628+0000 7f55b6a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b006a1d0 con 0x7f55b006b6d0 2024-09-13T17:52:19.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.628+0000 7f55b4a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f55b006b6d0 0x7f55b006cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:19.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.628+0000 7f55b4a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f55b006b6d0 0x7f55b006cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50510/0 (socket says 172.21.15.114:50510) 2024-09-13T17:52:19.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.628+0000 7f55b4a00640 1 -- 172.21.15.114:0/2709354883 learned_addr learned my addr 172.21.15.114:0/2709354883 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:19.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.628+0000 7f55b4a00640 1 -- 172.21.15.114:0/2709354883 >> v1:172.21.15.134:6789/0 conn(0x7f55b0140860 legacy=0x7f55b00ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:19.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.628+0000 7f55b4a00640 1 -- 172.21.15.114:0/2709354883 >> v1:172.21.15.114:6789/0 conn(0x7f55b006b270 legacy=0x7f55b00abdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:19.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.628+0000 7f55b4a00640 1 -- 172.21.15.114:0/2709354883 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b006a4b0 con 0x7f55b006b6d0 2024-09-13T17:52:19.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.628+0000 7f55b4a00640 1 --2- 172.21.15.114:0/2709354883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55b006b6d0 0x7f55b006cd60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f55a8009e50 tx=0x7f55a801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a43d2214c244bf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:19.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.632+0000 7f55af400640 1 -- 172.21.15.114:0/2709354883 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a80a5880 con 0x7f55b006b6d0 2024-09-13T17:52:19.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.632+0000 7f55af400640 1 -- 172.21.15.114:0/2709354883 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a80a59e0 con 0x7f55b006b6d0 2024-09-13T17:52:19.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.632+0000 7f55af400640 1 -- 172.21.15.114:0/2709354883 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a80a5d70 con 0x7f55b006b6d0 2024-09-13T17:52:19.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.632+0000 7f55b6a00640 1 -- 172.21.15.114:0/2709354883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55b006b6d0 msgr2=0x7f55b006cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:19.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.632+0000 7f55b6a00640 1 --2- 172.21.15.114:0/2709354883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55b006b6d0 0x7f55b006cd60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f55a8009e50 tx=0x7f55a801c9c0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.632+0000 7f55b6a00640 1 -- 172.21.15.114:0/2709354883 shutdown_connections 2024-09-13T17:52:19.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.632+0000 7f55b6a00640 1 --2- 172.21.15.114:0/2709354883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55b006b6d0 0x7f55b006cd60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.632+0000 7f55b6a00640 1 -- 172.21.15.114:0/2709354883 >> 172.21.15.114:0/2709354883 conn(0x7f55b00b0f60 msgr2=0x7f55b00cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:19.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.632+0000 7f55b6a00640 1 -- 172.21.15.114:0/2709354883 shutdown_connections 2024-09-13T17:52:19.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.632+0000 7f55b6a00640 1 -- 172.21.15.114:0/2709354883 wait complete. 2024-09-13T17:52:19.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.632+0000 7f55b6a00640 1 Processor -- start 2024-09-13T17:52:19.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.632+0000 7f55b6a00640 1 -- start start 2024-09-13T17:52:19.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.632+0000 7f55b6a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f55b006b270 0x7f55b0127b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:19.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.632+0000 7f55b6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55b0140860 0x7f55b0141580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:19.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.632+0000 7f55b6a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55b013b220 0x7f55b013b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:19.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.632+0000 7f55b6a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b013bc10 con 0x7f55b0140860 2024-09-13T17:52:19.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.632+0000 7f55b6a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b0139d00 con 0x7f55b013b220 2024-09-13T17:52:19.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.632+0000 7f55b6a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b01281a0 con 0x7f55b006b270 2024-09-13T17:52:19.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.632+0000 7f55a7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55b0140860 0x7f55b0141580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:19.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.632+0000 7f55a7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55b0140860 0x7f55b0141580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50518/0 (socket says 172.21.15.114:50518) 2024-09-13T17:52:19.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.632+0000 7f55a7400640 1 -- 172.21.15.114:0/2716693472 learned_addr learned my addr 172.21.15.114:0/2716693472 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:19.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.632+0000 7f55b4a00640 1 --2- 172.21.15.114:0/2716693472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55b013b220 0x7f55b013b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:19.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.632+0000 7f55afe00640 1 --2- 172.21.15.114:0/2716693472 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f55b006b270 0x7f55b0127b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:19.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.636+0000 7f55a7400640 1 -- 172.21.15.114:0/2716693472 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f55b006b270 msgr2=0x7f55b0127b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:19.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.636+0000 7f55a7400640 1 --2- 172.21.15.114:0/2716693472 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f55b006b270 0x7f55b0127b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.636+0000 7f55a7400640 1 -- 172.21.15.114:0/2716693472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55b013b220 msgr2=0x7f55b013b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:19.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.636+0000 7f55a7400640 1 --2- 172.21.15.114:0/2716693472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55b013b220 0x7f55b013b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.636+0000 7f55a7400640 1 -- 172.21.15.114:0/2716693472 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a8009b30 con 0x7f55b0140860 2024-09-13T17:52:19.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.636+0000 7f55afe00640 1 --2- 172.21.15.114:0/2716693472 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f55b006b270 0x7f55b0127b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:19.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.636+0000 7f55a7400640 1 --2- 172.21.15.114:0/2716693472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55b0140860 0x7f55b0141580 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f559800c500 tx=0x7f559800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:19.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.636+0000 7f55acc00640 1 -- 172.21.15.114:0/2716693472 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5598005220 con 0x7f55b0140860 2024-09-13T17:52:19.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.636+0000 7f55acc00640 1 -- 172.21.15.114:0/2716693472 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5598005380 con 0x7f55b0140860 2024-09-13T17:52:19.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.636+0000 7f55b6a00640 1 -- 172.21.15.114:0/2716693472 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b0128480 con 0x7f55b0140860 2024-09-13T17:52:19.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.636+0000 7f55acc00640 1 -- 172.21.15.114:0/2716693472 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5598007270 con 0x7f55b0140860 2024-09-13T17:52:19.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.636+0000 7f55b6a00640 1 -- 172.21.15.114:0/2716693472 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b0128a40 con 0x7f55b0140860 2024-09-13T17:52:19.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.636+0000 7f55b6a00640 1 -- 172.21.15.114:0/2716693472 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55b006d660 con 0x7f55b0140860 2024-09-13T17:52:19.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.636+0000 7f55acc00640 1 -- 172.21.15.114:0/2716693472 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f55980073d0 con 0x7f55b0140860 2024-09-13T17:52:19.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.636+0000 7f55acc00640 1 --2- 172.21.15.114:0/2716693472 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f558c0666c0 0x7f558c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:19.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.636+0000 7f55acc00640 1 -- 172.21.15.114:0/2716693472 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5598083cc0 con 0x7f55b0140860 2024-09-13T17:52:19.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.636+0000 7f55afe00640 1 --2- 172.21.15.114:0/2716693472 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f558c0666c0 0x7f558c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:19.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.640+0000 7f55afe00640 1 --2- 172.21.15.114:0/2716693472 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f558c0666c0 0x7f558c068b80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f55a00098b0 tx=0x7f55a0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:19.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.640+0000 7f55acc00640 1 -- 172.21.15.114:0/2716693472 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5598050d50 con 0x7f55b0140860 2024-09-13T17:52:19.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.796+0000 7f55b6a00640 1 -- 172.21.15.114:0/2716693472 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55b0139e40 con 0x7f55b0140860 2024-09-13T17:52:19.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.796+0000 7f55acc00640 1 -- 172.21.15.114:0/2716693472 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18394 (secure 0 0 0) 0x7f5598054370 con 0x7f55b0140860 2024-09-13T17:52:19.801 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:19.802 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:51:54.213439+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:51:48.278220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:51:48.773888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:51:51.856300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:52:19.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.800+0000 7f55b6a00640 1 -- 172.21.15.114:0/2716693472 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f558c0666c0 msgr2=0x7f558c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:19.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.800+0000 7f55b6a00640 1 --2- 172.21.15.114:0/2716693472 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f558c0666c0 0x7f558c068b80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f55a00098b0 tx=0x7f55a0008040 comp rx=0 tx=0).stop 2024-09-13T17:52:19.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.800+0000 7f55b6a00640 1 -- 172.21.15.114:0/2716693472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55b0140860 msgr2=0x7f55b0141580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:19.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.800+0000 7f55b6a00640 1 --2- 172.21.15.114:0/2716693472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55b0140860 0x7f55b0141580 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f559800c500 tx=0x7f559800c9c0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.800+0000 7f55b6a00640 1 -- 172.21.15.114:0/2716693472 shutdown_connections 2024-09-13T17:52:19.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.800+0000 7f55b6a00640 1 --2- 172.21.15.114:0/2716693472 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f558c0666c0 0x7f558c068b80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.800+0000 7f55b6a00640 1 --2- 172.21.15.114:0/2716693472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55b013b220 0x7f55b013b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.800+0000 7f55b6a00640 1 --2- 172.21.15.114:0/2716693472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55b0140860 0x7f55b0141580 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.800+0000 7f55b6a00640 1 --2- 172.21.15.114:0/2716693472 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f55b006b270 0x7f55b0127b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.800+0000 7f55b6a00640 1 -- 172.21.15.114:0/2716693472 >> 172.21.15.114:0/2716693472 conn(0x7f55b00b0f60 msgr2=0x7f55b013f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:19.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.800+0000 7f55b6a00640 1 -- 172.21.15.114:0/2716693472 shutdown_connections 2024-09-13T17:52:19.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.800+0000 7f55b6a00640 1 -- 172.21.15.114:0/2716693472 wait complete. 2024-09-13T17:52:19.825 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:51:37.996254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:51:48.278220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:51:48.773888+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:51:51.856300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:52:19.825 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:52:19.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.960+0000 7f3756000640 1 Processor -- start 2024-09-13T17:52:19.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.960+0000 7f3756000640 1 -- start start 2024-09-13T17:52:19.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.960+0000 7f3756000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3750151420 0x7f37500cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:19.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.960+0000 7f3756000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f37500ccba0 0x7f3750070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:19.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.960+0000 7f3756000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3750070db0 con 0x7f3750070960 2024-09-13T17:52:19.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.960+0000 7f3756000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37500cbc30 con 0x7f37500ccba0 2024-09-13T17:52:19.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.960+0000 7f3756000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3750151800 con 0x7f3750151420 2024-09-13T17:52:19.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.960+0000 7f374fe00640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f3750070960 0x7f375015df20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:51352/0 (socket says 172.21.15.114:51352) 2024-09-13T17:52:19.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.960+0000 7f374fe00640 1 -- 172.21.15.114:0/1746146730 learned_addr learned my addr 172.21.15.114:0/1746146730 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:19.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.960+0000 7f374f400640 1 --2- 172.21.15.114:0/1746146730 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3750151420 0x7f37500cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:19.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.960+0000 7f374ea00640 1 --2- 172.21.15.114:0/1746146730 >> v2:172.21.15.134:3300/0 conn(0x7f37500ccba0 0x7f3750070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:19.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.960+0000 7f374e000640 1 -- 172.21.15.114:0/1746146730 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1726818334 0 0) 0x7f3748001120 con 0x7f3750070960 2024-09-13T17:52:19.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.960+0000 7f374e000640 1 -- 172.21.15.114:0/1746146730 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3734003530 con 0x7f3750070960 2024-09-13T17:52:19.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.960+0000 7f374f400640 1 -- 172.21.15.114:0/1746146730 >> v2:172.21.15.134:3300/0 conn(0x7f37500ccba0 msgr2=0x7f3750070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:19.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.960+0000 7f374f400640 1 --2- 172.21.15.114:0/1746146730 >> v2:172.21.15.134:3300/0 conn(0x7f37500ccba0 0x7f3750070420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.960+0000 7f374f400640 1 -- 172.21.15.114:0/1746146730 >> v1:172.21.15.134:6789/0 conn(0x7f3750070960 legacy=0x7f375015df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:19.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.964+0000 7f374f400640 1 -- 172.21.15.114:0/1746146730 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37500cafb0 con 0x7f3750151420 2024-09-13T17:52:19.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.964+0000 7f374f400640 1 --2- 172.21.15.114:0/1746146730 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3750151420 0x7f37500cc660 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3740009d90 tx=0x7f374001c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb7f276023eb4572 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:19.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.964+0000 7f374e000640 1 -- 172.21.15.114:0/1746146730 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37400a58e0 con 0x7f3750151420 2024-09-13T17:52:19.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.964+0000 7f374e000640 1 -- 172.21.15.114:0/1746146730 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37400a5a40 con 0x7f3750151420 2024-09-13T17:52:19.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.964+0000 7f374e000640 1 -- 172.21.15.114:0/1746146730 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37400a5dd0 con 0x7f3750151420 2024-09-13T17:52:19.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.964+0000 7f3756000640 1 -- 172.21.15.114:0/1746146730 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3750151420 msgr2=0x7f37500cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:19.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.964+0000 7f3756000640 1 --2- 172.21.15.114:0/1746146730 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3750151420 0x7f37500cc660 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3740009d90 tx=0x7f374001c820 comp rx=0 tx=0).stop 2024-09-13T17:52:19.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.964+0000 7f3756000640 1 -- 172.21.15.114:0/1746146730 shutdown_connections 2024-09-13T17:52:19.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.964+0000 7f3756000640 1 --2- 172.21.15.114:0/1746146730 >> v2:172.21.15.134:3300/0 conn(0x7f37500ccba0 0x7f3750070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.964+0000 7f3756000640 1 --2- 172.21.15.114:0/1746146730 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3750151420 0x7f37500cc660 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.964+0000 7f3756000640 1 -- 172.21.15.114:0/1746146730 >> 172.21.15.114:0/1746146730 conn(0x7f37500660b0 msgr2=0x7f3750069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:19.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.964+0000 7f3756000640 1 -- 172.21.15.114:0/1746146730 shutdown_connections 2024-09-13T17:52:19.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.964+0000 7f3756000640 1 -- 172.21.15.114:0/1746146730 wait complete. 2024-09-13T17:52:19.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.968+0000 7f3756000640 1 Processor -- start 2024-09-13T17:52:19.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.968+0000 7f3756000640 1 -- start start 2024-09-13T17:52:19.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.968+0000 7f3756000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3750070960 0x7f3750148e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:19.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.968+0000 7f3756000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37500ccba0 0x7f3750160010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:19.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.968+0000 7f3756000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3750151420 0x7f3750160550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:19.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.968+0000 7f3756000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375014b430 con 0x7f3750070960 2024-09-13T17:52:19.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.968+0000 7f3756000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37501497d0 con 0x7f37500ccba0 2024-09-13T17:52:19.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.968+0000 7f3756000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3750149ab0 con 0x7f3750151420 2024-09-13T17:52:19.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.968+0000 7f374f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3750070960 0x7f3750148e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:19.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.968+0000 7f374f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3750070960 0x7f3750148e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50530/0 (socket says 172.21.15.114:50530) 2024-09-13T17:52:19.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.968+0000 7f374f400640 1 -- 172.21.15.114:0/2549865961 learned_addr learned my addr 172.21.15.114:0/2549865961 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:19.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.968+0000 7f374ea00640 1 --2- 172.21.15.114:0/2549865961 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37500ccba0 0x7f3750160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:19.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.968+0000 7f374fe00640 1 --2- 172.21.15.114:0/2549865961 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3750151420 0x7f3750160550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:19.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.968+0000 7f374f400640 1 -- 172.21.15.114:0/2549865961 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3750151420 msgr2=0x7f3750160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:19.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.968+0000 7f374f400640 1 --2- 172.21.15.114:0/2549865961 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3750151420 0x7f3750160550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.968+0000 7f374f400640 1 -- 172.21.15.114:0/2549865961 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37500ccba0 msgr2=0x7f3750160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:19.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.968+0000 7f374f400640 1 --2- 172.21.15.114:0/2549865961 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37500ccba0 0x7f3750160010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:19.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.968+0000 7f374f400640 1 -- 172.21.15.114:0/2549865961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3740009a70 con 0x7f3750070960 2024-09-13T17:52:19.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.968+0000 7f374f400640 1 --2- 172.21.15.114:0/2549865961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3750070960 0x7f3750148e50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f374001a450 tx=0x7f37400195c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:19.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.968+0000 7f3747400640 1 -- 172.21.15.114:0/2549865961 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37400a58e0 con 0x7f3750070960 2024-09-13T17:52:19.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.968+0000 7f3747400640 1 -- 172.21.15.114:0/2549865961 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37400ad850 con 0x7f3750070960 2024-09-13T17:52:19.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.968+0000 7f3747400640 1 -- 172.21.15.114:0/2549865961 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37400adbe0 con 0x7f3750070960 2024-09-13T17:52:19.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.968+0000 7f3756000640 1 -- 172.21.15.114:0/2549865961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3750149d90 con 0x7f3750070960 2024-09-13T17:52:19.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.968+0000 7f3756000640 1 -- 172.21.15.114:0/2549865961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375014a350 con 0x7f3750070960 2024-09-13T17:52:19.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.972+0000 7f3756000640 1 -- 172.21.15.114:0/2549865961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3750149bf0 con 0x7f3750070960 2024-09-13T17:52:19.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.972+0000 7f3747400640 1 -- 172.21.15.114:0/2549865961 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f37400b4050 con 0x7f3750070960 2024-09-13T17:52:19.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.972+0000 7f3747400640 1 --2- 172.21.15.114:0/2549865961 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3730066690 0x7f3730068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:19.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.972+0000 7f3747400640 1 -- 172.21.15.114:0/2549865961 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f374011f6a0 con 0x7f3750070960 2024-09-13T17:52:19.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.972+0000 7f374ea00640 1 --2- 172.21.15.114:0/2549865961 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3730066690 0x7f3730068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:19.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.972+0000 7f374ea00640 1 --2- 172.21.15.114:0/2549865961 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3730066690 0x7f3730068b50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f375014e6c0 tx=0x7f373c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:19.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:19.976+0000 7f3747400640 1 -- 172.21.15.114:0/2549865961 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3750149bf0 con 0x7f3750070960 2024-09-13T17:52:20.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.136+0000 7f3756000640 1 -- 172.21.15.114:0/2549865961 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3750149bf0 con 0x7f3750070960 2024-09-13T17:52:20.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.136+0000 7f3747400640 1 -- 172.21.15.114:0/2549865961 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3750149bf0 con 0x7f3750070960 2024-09-13T17:52:20.138 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-13T17:52:20.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.136+0000 7f3756000640 1 -- 172.21.15.114:0/2549865961 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3730066690 msgr2=0x7f3730068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:20.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.136+0000 7f3756000640 1 --2- 172.21.15.114:0/2549865961 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3730066690 0x7f3730068b50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f375014e6c0 tx=0x7f373c009190 comp rx=0 tx=0).stop 2024-09-13T17:52:20.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.136+0000 7f3756000640 1 -- 172.21.15.114:0/2549865961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3750070960 msgr2=0x7f3750148e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:20.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.136+0000 7f3756000640 1 --2- 172.21.15.114:0/2549865961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3750070960 0x7f3750148e50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f374001a450 tx=0x7f37400195c0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.136+0000 7f3756000640 1 -- 172.21.15.114:0/2549865961 shutdown_connections 2024-09-13T17:52:20.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.136+0000 7f3756000640 1 --2- 172.21.15.114:0/2549865961 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3730066690 0x7f3730068b50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.136+0000 7f3756000640 1 --2- 172.21.15.114:0/2549865961 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3750151420 0x7f3750160550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.136+0000 7f3756000640 1 --2- 172.21.15.114:0/2549865961 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37500ccba0 0x7f3750160010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.136+0000 7f3756000640 1 --2- 172.21.15.114:0/2549865961 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3750070960 0x7f3750148e50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.136+0000 7f3756000640 1 -- 172.21.15.114:0/2549865961 >> 172.21.15.114:0/2549865961 conn(0x7f37500660b0 msgr2=0x7f375015a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:20.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.136+0000 7f3756000640 1 -- 172.21.15.114:0/2549865961 shutdown_connections 2024-09-13T17:52:20.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.136+0000 7f3756000640 1 -- 172.21.15.114:0/2549865961 wait complete. 2024-09-13T17:52:20.159 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:52:20.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.292+0000 7feb25c00640 1 Processor -- start 2024-09-13T17:52:20.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.292+0000 7feb25c00640 1 -- start start 2024-09-13T17:52:20.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.292+0000 7feb25c00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7feb2006dc60 0x7feb200cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:20.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.292+0000 7feb25c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb200cd220 con 0x7feb2013c240 2024-09-13T17:52:20.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.292+0000 7feb25c00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb2015a740 con 0x7feb2013f420 2024-09-13T17:52:20.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.292+0000 7feb25c00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb20159bc0 con 0x7feb2006dc60 2024-09-13T17:52:20.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.296+0000 7feb1ea00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7feb2013c240 0x7feb2013c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33432/0 (socket says 172.21.15.114:33432) 2024-09-13T17:52:20.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.296+0000 7feb1ea00640 1 -- 172.21.15.114:0/3811247566 learned_addr learned my addr 172.21.15.114:0/3811247566 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:20.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.296+0000 7feb1f400640 1 --2- 172.21.15.114:0/3811247566 >> v2:172.21.15.134:3300/0 conn(0x7feb2006dc60 0x7feb200cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:20.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.296+0000 7feb1e000640 1 -- 172.21.15.114:0/3811247566 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963865871 0 0) 0x7feb200cd220 con 0x7feb2013c240 2024-09-13T17:52:20.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.296+0000 7feb1e000640 1 -- 172.21.15.114:0/3811247566 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb04003530 con 0x7feb2013c240 2024-09-13T17:52:20.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.296+0000 7feb1e000640 1 -- 172.21.15.114:0/3811247566 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2309110404 0 0) 0x7feb04003530 con 0x7feb2013c240 2024-09-13T17:52:20.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.296+0000 7feb1e000640 1 -- 172.21.15.114:0/3811247566 >> v2:172.21.15.134:3300/0 conn(0x7feb2006dc60 msgr2=0x7feb200cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:20.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.296+0000 7feb1e000640 1 --2- 172.21.15.114:0/3811247566 >> v2:172.21.15.134:3300/0 conn(0x7feb2006dc60 0x7feb200cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.296+0000 7feb1e000640 1 -- 172.21.15.114:0/3811247566 >> v1:172.21.15.134:6789/0 conn(0x7feb2013f420 legacy=0x7feb2006d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:20.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.296+0000 7feb1e000640 1 -- 172.21.15.114:0/3811247566 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb20159ea0 con 0x7feb2013c240 2024-09-13T17:52:20.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.296+0000 7feb1e000640 1 -- 172.21.15.114:0/3811247566 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7feb10001680 con 0x7feb2013c240 2024-09-13T17:52:20.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.296+0000 7feb1e000640 1 -- 172.21.15.114:0/3811247566 >> v1:172.21.15.114:6789/0 conn(0x7feb2013c240 legacy=0x7feb2013c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:20.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.296+0000 7feb1e000640 1 --2- 172.21.15.114:0/3811247566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb04003980 0x7feb04003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:20.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.296+0000 7feb1e000640 1 --2- 172.21.15.114:0/3811247566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb040047d0 0x7feb04004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:20.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.296+0000 7feb1e000640 1 --2- 172.21.15.114:0/3811247566 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb04005190 0x7feb0400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:20.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.296+0000 7feb1e000640 1 -- 172.21.15.114:0/3811247566 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb20159bc0 con 0x7feb04003980 2024-09-13T17:52:20.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.296+0000 7feb1e000640 1 -- 172.21.15.114:0/3811247566 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0400c130 con 0x7feb040047d0 2024-09-13T17:52:20.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.296+0000 7feb1e000640 1 -- 172.21.15.114:0/3811247566 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb0400e500 con 0x7feb04005190 2024-09-13T17:52:20.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.296+0000 7feb1ea00640 1 --2- 172.21.15.114:0/3811247566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb04003980 0x7feb04003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:20.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.296+0000 7feb16000640 1 --2- 172.21.15.114:0/3811247566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb040047d0 0x7feb04004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:20.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.296+0000 7feb1f400640 1 --2- 172.21.15.114:0/3811247566 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb04005190 0x7feb0400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:20.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.296+0000 7feb1ea00640 1 -- 172.21.15.114:0/3811247566 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb04005190 msgr2=0x7feb0400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:20.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.296+0000 7feb1ea00640 1 --2- 172.21.15.114:0/3811247566 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb04005190 0x7feb0400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.296+0000 7feb1ea00640 1 -- 172.21.15.114:0/3811247566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb040047d0 msgr2=0x7feb04004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:20.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.296+0000 7feb1ea00640 1 --2- 172.21.15.114:0/3811247566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb040047d0 0x7feb04004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.296+0000 7feb1ea00640 1 -- 172.21.15.114:0/3811247566 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb04003530 con 0x7feb04003980 2024-09-13T17:52:20.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.296+0000 7feb1f400640 1 -- 172.21.15.114:0/3811247566 reap_dead start 2024-09-13T17:52:20.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.300+0000 7feb1ea00640 1 --2- 172.21.15.114:0/3811247566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb04003980 0x7feb04003da0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feb1000c240 tx=0x7feb1001cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db51cd6041da10c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:20.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.300+0000 7feb1e000640 1 -- 172.21.15.114:0/3811247566 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb10005ae0 con 0x7feb04003980 2024-09-13T17:52:20.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.300+0000 7feb1e000640 1 -- 172.21.15.114:0/3811247566 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb10005c40 con 0x7feb04003980 2024-09-13T17:52:20.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.300+0000 7feb1e000640 1 -- 172.21.15.114:0/3811247566 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb100a5ad0 con 0x7feb04003980 2024-09-13T17:52:20.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.300+0000 7feb25c00640 1 -- 172.21.15.114:0/3811247566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb04003980 msgr2=0x7feb04003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:20.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.300+0000 7feb25c00640 1 --2- 172.21.15.114:0/3811247566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb04003980 0x7feb04003da0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feb1000c240 tx=0x7feb1001cbb0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.300+0000 7feb25c00640 1 -- 172.21.15.114:0/3811247566 shutdown_connections 2024-09-13T17:52:20.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.300+0000 7feb25c00640 1 --2- 172.21.15.114:0/3811247566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb04003980 0x7feb04003da0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.300+0000 7feb25c00640 1 -- 172.21.15.114:0/3811247566 >> 172.21.15.114:0/3811247566 conn(0x7feb200660b0 msgr2=0x7feb20069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:20.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.300+0000 7feb25c00640 1 -- 172.21.15.114:0/3811247566 shutdown_connections 2024-09-13T17:52:20.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.300+0000 7feb25c00640 1 -- 172.21.15.114:0/3811247566 wait complete. 2024-09-13T17:52:20.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.300+0000 7feb25c00640 1 Processor -- start 2024-09-13T17:52:20.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.300+0000 7feb25c00640 1 -- start start 2024-09-13T17:52:20.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.300+0000 7feb25c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb04003980 0x7feb200ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:20.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.300+0000 7feb25c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb200c5bb0 0x7feb2015bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:20.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.300+0000 7feb25c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb2013a420 0x7feb2013a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:20.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.300+0000 7feb25c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2013ae10 con 0x7feb200c5bb0 2024-09-13T17:52:20.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.300+0000 7feb25c00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb200c6390 con 0x7feb04003980 2024-09-13T17:52:20.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.300+0000 7feb25c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb200c6670 con 0x7feb2013a420 2024-09-13T17:52:20.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.304+0000 7feb16000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb200c5bb0 0x7feb2015bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:20.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.304+0000 7feb16000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb200c5bb0 0x7feb2015bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50556/0 (socket says 172.21.15.114:50556) 2024-09-13T17:52:20.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.304+0000 7feb16000640 1 -- 172.21.15.114:0/107470554 learned_addr learned my addr 172.21.15.114:0/107470554 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:20.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.304+0000 7feb1ea00640 1 --2- 172.21.15.114:0/107470554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb04003980 0x7feb200ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:20.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.304+0000 7feb1f400640 1 --2- 172.21.15.114:0/107470554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb2013a420 0x7feb2013a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:20.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.304+0000 7feb16000640 1 -- 172.21.15.114:0/107470554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb2013a420 msgr2=0x7feb2013a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:20.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.304+0000 7feb16000640 1 --2- 172.21.15.114:0/107470554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb2013a420 0x7feb2013a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.304+0000 7feb16000640 1 -- 172.21.15.114:0/107470554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb04003980 msgr2=0x7feb200ca8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:20.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.304+0000 7feb16000640 1 --2- 172.21.15.114:0/107470554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb04003980 0x7feb200ca8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.304+0000 7feb16000640 1 -- 172.21.15.114:0/107470554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb200c6950 con 0x7feb200c5bb0 2024-09-13T17:52:20.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.304+0000 7feb1ea00640 1 --2- 172.21.15.114:0/107470554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb04003980 0x7feb200ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:20.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.304+0000 7feb16000640 1 --2- 172.21.15.114:0/107470554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb200c5bb0 0x7feb2015bf60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feb0800e4b0 tx=0x7feb0800e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:20.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.304+0000 7feb17400640 1 -- 172.21.15.114:0/107470554 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb080052e0 con 0x7feb200c5bb0 2024-09-13T17:52:20.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.304+0000 7feb17400640 1 -- 172.21.15.114:0/107470554 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb08005440 con 0x7feb200c5bb0 2024-09-13T17:52:20.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.304+0000 7feb17400640 1 -- 172.21.15.114:0/107470554 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb08003840 con 0x7feb200c5bb0 2024-09-13T17:52:20.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.304+0000 7feb25c00640 1 -- 172.21.15.114:0/107470554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb200c6c30 con 0x7feb200c5bb0 2024-09-13T17:52:20.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.304+0000 7feb25c00640 1 -- 172.21.15.114:0/107470554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb200c6030 con 0x7feb200c5bb0 2024-09-13T17:52:20.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.304+0000 7feb25c00640 1 -- 172.21.15.114:0/107470554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb20159790 con 0x7feb200c5bb0 2024-09-13T17:52:20.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.304+0000 7feb17400640 1 -- 172.21.15.114:0/107470554 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feb080039a0 con 0x7feb200c5bb0 2024-09-13T17:52:20.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.304+0000 7feb17400640 1 --2- 172.21.15.114:0/107470554 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7feafc0666c0 0x7feafc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:20.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.304+0000 7feb17400640 1 -- 172.21.15.114:0/107470554 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feb080842b0 con 0x7feb200c5bb0 2024-09-13T17:52:20.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.304+0000 7feb1ea00640 1 --2- 172.21.15.114:0/107470554 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7feafc0666c0 0x7feafc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:20.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.308+0000 7feb1ea00640 1 --2- 172.21.15.114:0/107470554 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7feafc0666c0 0x7feafc068b80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7feb100ab000 tx=0x7feb100b1040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:20.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.308+0000 7feb17400640 1 -- 172.21.15.114:0/107470554 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feb08051290 con 0x7feb200c5bb0 2024-09-13T17:52:20.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.460+0000 7feb25c00640 1 -- 172.21.15.114:0/107470554 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feb2013b750 con 0x7feb200c5bb0 2024-09-13T17:52:20.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.464+0000 7feb17400640 1 -- 172.21.15.114:0/107470554 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7feb080548b0 con 0x7feb200c5bb0 2024-09-13T17:52:20.466 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:52:20.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.464+0000 7feb25c00640 1 -- 172.21.15.114:0/107470554 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7feafc0666c0 msgr2=0x7feafc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:20.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.464+0000 7feb25c00640 1 --2- 172.21.15.114:0/107470554 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7feafc0666c0 0x7feafc068b80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7feb100ab000 tx=0x7feb100b1040 comp rx=0 tx=0).stop 2024-09-13T17:52:20.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.464+0000 7feb25c00640 1 -- 172.21.15.114:0/107470554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb200c5bb0 msgr2=0x7feb2015bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:20.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.464+0000 7feb25c00640 1 --2- 172.21.15.114:0/107470554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb200c5bb0 0x7feb2015bf60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feb0800e4b0 tx=0x7feb0800e970 comp rx=0 tx=0).stop 2024-09-13T17:52:20.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.464+0000 7feb25c00640 1 -- 172.21.15.114:0/107470554 shutdown_connections 2024-09-13T17:52:20.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.464+0000 7feb25c00640 1 --2- 172.21.15.114:0/107470554 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7feafc0666c0 0x7feafc068b80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.464+0000 7feb25c00640 1 --2- 172.21.15.114:0/107470554 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb2013a420 0x7feb2013a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.464+0000 7feb25c00640 1 --2- 172.21.15.114:0/107470554 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb200c5bb0 0x7feb2015bf60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.464+0000 7feb25c00640 1 --2- 172.21.15.114:0/107470554 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb04003980 0x7feb200ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.464+0000 7feb25c00640 1 -- 172.21.15.114:0/107470554 >> 172.21.15.114:0/107470554 conn(0x7feb200660b0 msgr2=0x7feb200b2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:20.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.464+0000 7feb25c00640 1 -- 172.21.15.114:0/107470554 shutdown_connections 2024-09-13T17:52:20.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.464+0000 7feb25c00640 1 -- 172.21.15.114:0/107470554 wait complete. 2024-09-13T17:52:20.487 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:52:20.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.620+0000 7f7de0400640 1 Processor -- start 2024-09-13T17:52:20.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.620+0000 7f7de0400640 1 -- start start 2024-09-13T17:52:20.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.620+0000 7f7de0400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7dd8151420 0x7f7dd80cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:20.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.620+0000 7f7de0400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7dd80ccba0 0x7f7dd8070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:20.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.620+0000 7f7de0400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7dd8070960 0x7f7dd815df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:20.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.620+0000 7f7de0400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd80cbc30 con 0x7f7dd8151420 2024-09-13T17:52:20.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.620+0000 7f7de0400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd8151800 con 0x7f7dd8070960 2024-09-13T17:52:20.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.620+0000 7f7de0400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd8070d90 con 0x7f7dd80ccba0 2024-09-13T17:52:20.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.620+0000 7f7ddda00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7dd8151420 0x7f7dd80cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:20.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.620+0000 7f7ddda00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7dd8151420 0x7f7dd80cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50560/0 (socket says 172.21.15.114:50560) 2024-09-13T17:52:20.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.620+0000 7f7ddda00640 1 -- 172.21.15.114:0/4276854772 learned_addr learned my addr 172.21.15.114:0/4276854772 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:20.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.624+0000 7f7dde400640 1 --2- 172.21.15.114:0/4276854772 >> v2:172.21.15.134:3300/0 conn(0x7f7dd8070960 0x7f7dd815df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:20.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.624+0000 7f7ddd000640 1 --2- 172.21.15.114:0/4276854772 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7dd80ccba0 0x7f7dd8070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:20.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.624+0000 7f7ddda00640 1 -- 172.21.15.114:0/4276854772 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7dd80ccba0 msgr2=0x7f7dd8070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:20.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.624+0000 7f7ddda00640 1 --2- 172.21.15.114:0/4276854772 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7dd80ccba0 0x7f7dd8070420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.624+0000 7f7ddda00640 1 -- 172.21.15.114:0/4276854772 >> v2:172.21.15.134:3300/0 conn(0x7f7dd8070960 msgr2=0x7f7dd815df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:20.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.624+0000 7f7ddda00640 1 --2- 172.21.15.114:0/4276854772 >> v2:172.21.15.134:3300/0 conn(0x7f7dd8070960 0x7f7dd815df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.624+0000 7f7ddda00640 1 -- 172.21.15.114:0/4276854772 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd80cafb0 con 0x7f7dd8151420 2024-09-13T17:52:20.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.624+0000 7f7ddda00640 1 --2- 172.21.15.114:0/4276854772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7dd8151420 0x7f7dd80cc660 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7dd806e510 tx=0x7f7dcc01c110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9587fbe3cf36e0d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:20.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.624+0000 7f7dd7e00640 1 -- 172.21.15.114:0/4276854772 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0ab600 con 0x7f7dd8151420 2024-09-13T17:52:20.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.624+0000 7f7dd7e00640 1 -- 172.21.15.114:0/4276854772 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dcc0a7050 con 0x7f7dd8151420 2024-09-13T17:52:20.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.624+0000 7f7dd7e00640 1 -- 172.21.15.114:0/4276854772 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0ab980 con 0x7f7dd8151420 2024-09-13T17:52:20.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.628+0000 7f7de0400640 1 -- 172.21.15.114:0/4276854772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7dd8151420 msgr2=0x7f7dd80cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:20.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.628+0000 7f7de0400640 1 --2- 172.21.15.114:0/4276854772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7dd8151420 0x7f7dd80cc660 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7dd806e510 tx=0x7f7dcc01c110 comp rx=0 tx=0).stop 2024-09-13T17:52:20.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.628+0000 7f7de0400640 1 -- 172.21.15.114:0/4276854772 shutdown_connections 2024-09-13T17:52:20.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.628+0000 7f7de0400640 1 --2- 172.21.15.114:0/4276854772 >> v2:172.21.15.134:3300/0 conn(0x7f7dd8070960 0x7f7dd815df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.628+0000 7f7de0400640 1 --2- 172.21.15.114:0/4276854772 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7dd80ccba0 0x7f7dd8070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.628+0000 7f7de0400640 1 --2- 172.21.15.114:0/4276854772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7dd8151420 0x7f7dd80cc660 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.628+0000 7f7de0400640 1 -- 172.21.15.114:0/4276854772 >> 172.21.15.114:0/4276854772 conn(0x7f7dd80660b0 msgr2=0x7f7dd8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:20.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.628+0000 7f7de0400640 1 -- 172.21.15.114:0/4276854772 shutdown_connections 2024-09-13T17:52:20.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.628+0000 7f7de0400640 1 -- 172.21.15.114:0/4276854772 wait complete. 2024-09-13T17:52:20.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.628+0000 7f7de0400640 1 Processor -- start 2024-09-13T17:52:20.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.628+0000 7f7de0400640 1 -- start start 2024-09-13T17:52:20.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.628+0000 7f7de0400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7dd8070960 0x7f7dd8149750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:20.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.628+0000 7f7de0400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7dd80ccba0 0x7f7dd80b2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:20.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.628+0000 7f7de0400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7dd8151420 0x7f7dd80b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:20.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.628+0000 7f7de0400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd80aefd0 con 0x7f7dd8151420 2024-09-13T17:52:20.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.628+0000 7f7de0400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd814a230 con 0x7f7dd8070960 2024-09-13T17:52:20.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.628+0000 7f7de0400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd80ae630 con 0x7f7dd80ccba0 2024-09-13T17:52:20.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.628+0000 7f7dde400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7dd8151420 0x7f7dd80b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:20.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.628+0000 7f7dde400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7dd8151420 0x7f7dd80b2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50574/0 (socket says 172.21.15.114:50574) 2024-09-13T17:52:20.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.628+0000 7f7dde400640 1 -- 172.21.15.114:0/4200486787 learned_addr learned my addr 172.21.15.114:0/4200486787 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:20.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.628+0000 7f7ddd000640 1 --2- 172.21.15.114:0/4200486787 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7dd80ccba0 0x7f7dd80b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:20.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.628+0000 7f7ddda00640 1 --2- 172.21.15.114:0/4200486787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7dd8070960 0x7f7dd8149750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:20.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.628+0000 7f7dde400640 1 -- 172.21.15.114:0/4200486787 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7dd80ccba0 msgr2=0x7f7dd80b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:20.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.628+0000 7f7dde400640 1 --2- 172.21.15.114:0/4200486787 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7dd80ccba0 0x7f7dd80b2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.628+0000 7f7dde400640 1 -- 172.21.15.114:0/4200486787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7dd8070960 msgr2=0x7f7dd8149750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:20.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.628+0000 7f7dde400640 1 --2- 172.21.15.114:0/4200486787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7dd8070960 0x7f7dd8149750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.628+0000 7f7dde400640 1 -- 172.21.15.114:0/4200486787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dcc0094d0 con 0x7f7dd8151420 2024-09-13T17:52:20.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.632+0000 7f7dde400640 1 --2- 172.21.15.114:0/4200486787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7dd8151420 0x7f7dd80b2cd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0007e60 tx=0x7f7dd000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:20.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.632+0000 7f7dd5600640 1 -- 172.21.15.114:0/4200486787 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0014620 con 0x7f7dd8151420 2024-09-13T17:52:20.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.632+0000 7f7dd5600640 1 -- 172.21.15.114:0/4200486787 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd000ee90 con 0x7f7dd8151420 2024-09-13T17:52:20.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.632+0000 7f7de0400640 1 -- 172.21.15.114:0/4200486787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd80ae910 con 0x7f7dd8151420 2024-09-13T17:52:20.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.632+0000 7f7dd5600640 1 -- 172.21.15.114:0/4200486787 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd00149e0 con 0x7f7dd8151420 2024-09-13T17:52:20.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.632+0000 7f7de0400640 1 -- 172.21.15.114:0/4200486787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd8149c90 con 0x7f7dd8151420 2024-09-13T17:52:20.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.632+0000 7f7de0400640 1 -- 172.21.15.114:0/4200486787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd8070420 con 0x7f7dd8151420 2024-09-13T17:52:20.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.632+0000 7f7dd5600640 1 -- 172.21.15.114:0/4200486787 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7dd0014b40 con 0x7f7dd8151420 2024-09-13T17:52:20.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.632+0000 7f7dd5600640 1 --2- 172.21.15.114:0/4200486787 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7db8066690 0x7f7db8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:20.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.632+0000 7f7dd5600640 1 -- 172.21.15.114:0/4200486787 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7dd0084be0 con 0x7f7dd8151420 2024-09-13T17:52:20.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.632+0000 7f7ddda00640 1 --2- 172.21.15.114:0/4200486787 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7db8066690 0x7f7db8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:20.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.636+0000 7f7ddda00640 1 --2- 172.21.15.114:0/4200486787 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7db8066690 0x7f7db8068b50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc0ad000 tx=0x7f7dcc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:20.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.636+0000 7f7dd5600640 1 -- 172.21.15.114:0/4200486787 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7dd0051da0 con 0x7f7dd8151420 2024-09-13T17:52:20.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.788+0000 7f7de0400640 1 -- 172.21.15.114:0/4200486787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7dd8157e80 con 0x7f7dd8151420 2024-09-13T17:52:20.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.788+0000 7f7dd5600640 1 -- 172.21.15.114:0/4200486787 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7dd00553c0 con 0x7f7dd8151420 2024-09-13T17:52:20.793 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-09-13T17:52:20.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.792+0000 7f7de0400640 1 -- 172.21.15.114:0/4200486787 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7db8066690 msgr2=0x7f7db8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:20.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.792+0000 7f7de0400640 1 --2- 172.21.15.114:0/4200486787 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7db8066690 0x7f7db8068b50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc0ad000 tx=0x7f7dcc008040 comp rx=0 tx=0).stop 2024-09-13T17:52:20.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.792+0000 7f7de0400640 1 -- 172.21.15.114:0/4200486787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7dd8151420 msgr2=0x7f7dd80b2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:20.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.792+0000 7f7de0400640 1 --2- 172.21.15.114:0/4200486787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7dd8151420 0x7f7dd80b2cd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0007e60 tx=0x7f7dd000e4b0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.792+0000 7f7de0400640 1 -- 172.21.15.114:0/4200486787 shutdown_connections 2024-09-13T17:52:20.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.792+0000 7f7de0400640 1 --2- 172.21.15.114:0/4200486787 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7db8066690 0x7f7db8068b50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.792+0000 7f7de0400640 1 --2- 172.21.15.114:0/4200486787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7dd8151420 0x7f7dd80b2cd0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.792+0000 7f7de0400640 1 --2- 172.21.15.114:0/4200486787 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7dd80ccba0 0x7f7dd80b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.792+0000 7f7de0400640 1 --2- 172.21.15.114:0/4200486787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7dd8070960 0x7f7dd8149750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.792+0000 7f7de0400640 1 -- 172.21.15.114:0/4200486787 >> 172.21.15.114:0/4200486787 conn(0x7f7dd80660b0 msgr2=0x7f7dd8158ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:20.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.792+0000 7f7de0400640 1 -- 172.21.15.114:0/4200486787 shutdown_connections 2024-09-13T17:52:20.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.792+0000 7f7de0400640 1 -- 172.21.15.114:0/4200486787 wait complete. 2024-09-13T17:52:20.813 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:52:20.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.948+0000 7fde8c800640 1 Processor -- start 2024-09-13T17:52:20.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.948+0000 7fde8c800640 1 -- start start 2024-09-13T17:52:20.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.948+0000 7fde8c800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde8406b270 0x7fde840abdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:20.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.948+0000 7fde8c800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fde8406b6d0 0x7fde840ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:20.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.948+0000 7fde8c800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde84069f80 con 0x7fde84140860 2024-09-13T17:52:20.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.948+0000 7fde8c800640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde8406ade0 con 0x7fde8406b6d0 2024-09-13T17:52:20.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.948+0000 7fde8c800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde8406a1d0 con 0x7fde8406b270 2024-09-13T17:52:20.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.948+0000 7fde8a800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fde8406b6d0 0x7fde840ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:20.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.948+0000 7fde89400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde8406b270 0x7fde840abdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:20.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.952+0000 7fde8a800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fde8406b6d0 0x7fde840ac2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:49736/0 (socket says 172.21.15.114:49736) 2024-09-13T17:52:20.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.952+0000 7fde8a800640 1 -- 172.21.15.114:0/494496732 learned_addr learned my addr 172.21.15.114:0/494496732 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:20.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.952+0000 7fde89e00640 1 --1- 172.21.15.114:0/494496732 >> v1:172.21.15.134:6789/0 conn(0x7fde84140860 0x7fde840ae110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:39844/0 (socket says 172.21.15.114:39844) 2024-09-13T17:52:20.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.952+0000 7fde8a800640 1 -- 172.21.15.114:0/494496732 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde8406b270 msgr2=0x7fde840abdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:20.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.952+0000 7fde8a800640 1 --2- 172.21.15.114:0/494496732 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde8406b270 0x7fde840abdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.952+0000 7fde8a800640 1 -- 172.21.15.114:0/494496732 >> v1:172.21.15.134:6789/0 conn(0x7fde84140860 legacy=0x7fde840ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:20.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.952+0000 7fde8a800640 1 -- 172.21.15.114:0/494496732 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8406a4b0 con 0x7fde8406b6d0 2024-09-13T17:52:20.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.952+0000 7fde8a800640 1 --2- 172.21.15.114:0/494496732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde8406b6d0 0x7fde840ac2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fde80009e50 tx=0x7fde8001ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f369b595f47e0b2d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:20.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.952+0000 7fde88a00640 1 -- 172.21.15.114:0/494496732 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde800a58d0 con 0x7fde8406b6d0 2024-09-13T17:52:20.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.952+0000 7fde88a00640 1 -- 172.21.15.114:0/494496732 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde800a5a30 con 0x7fde8406b6d0 2024-09-13T17:52:20.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.952+0000 7fde88a00640 1 -- 172.21.15.114:0/494496732 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde800a5dc0 con 0x7fde8406b6d0 2024-09-13T17:52:20.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.956+0000 7fde8c800640 1 -- 172.21.15.114:0/494496732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde8406b6d0 msgr2=0x7fde840ac2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:20.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.956+0000 7fde8c800640 1 --2- 172.21.15.114:0/494496732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde8406b6d0 0x7fde840ac2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fde80009e50 tx=0x7fde8001ca00 comp rx=0 tx=0).stop 2024-09-13T17:52:20.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.956+0000 7fde8c800640 1 -- 172.21.15.114:0/494496732 shutdown_connections 2024-09-13T17:52:20.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.956+0000 7fde8c800640 1 --2- 172.21.15.114:0/494496732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde8406b6d0 0x7fde840ac2f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.956+0000 7fde8c800640 1 --2- 172.21.15.114:0/494496732 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde8406b270 0x7fde840abdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.956+0000 7fde8c800640 1 -- 172.21.15.114:0/494496732 >> 172.21.15.114:0/494496732 conn(0x7fde840b0f60 msgr2=0x7fde840cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:20.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.956+0000 7fde8c800640 1 -- 172.21.15.114:0/494496732 shutdown_connections 2024-09-13T17:52:20.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.956+0000 7fde8c800640 1 -- 172.21.15.114:0/494496732 wait complete. 2024-09-13T17:52:20.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.956+0000 7fde8c800640 1 Processor -- start 2024-09-13T17:52:20.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.956+0000 7fde8c800640 1 -- start start 2024-09-13T17:52:20.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.956+0000 7fde8c800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde8406b270 0x7fde840b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:20.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.956+0000 7fde8c800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde84140860 0x7fde840af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:20.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.956+0000 7fde8c800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde840b3b00 0x7fde8413e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:20.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.956+0000 7fde8c800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde840b36e0 con 0x7fde840b3b00 2024-09-13T17:52:20.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.956+0000 7fde8c800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde840afb40 con 0x7fde8406b270 2024-09-13T17:52:20.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.956+0000 7fde8c800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde840b2a60 con 0x7fde84140860 2024-09-13T17:52:20.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.956+0000 7fde8a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde840b3b00 0x7fde8413e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:20.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.956+0000 7fde8a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde840b3b00 0x7fde8413e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49480/0 (socket says 172.21.15.114:49480) 2024-09-13T17:52:20.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.956+0000 7fde8a800640 1 -- 172.21.15.114:0/3479744700 learned_addr learned my addr 172.21.15.114:0/3479744700 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:20.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.956+0000 7fde89e00640 1 --2- 172.21.15.114:0/3479744700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde8406b270 0x7fde840b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:20.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.956+0000 7fde89400640 1 --2- 172.21.15.114:0/3479744700 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde84140860 0x7fde840af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:20.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.956+0000 7fde8a800640 1 -- 172.21.15.114:0/3479744700 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde84140860 msgr2=0x7fde840af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:20.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.956+0000 7fde8a800640 1 --2- 172.21.15.114:0/3479744700 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde84140860 0x7fde840af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.956+0000 7fde8a800640 1 -- 172.21.15.114:0/3479744700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde8406b270 msgr2=0x7fde840b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:20.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.956+0000 7fde8a800640 1 --2- 172.21.15.114:0/3479744700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde8406b270 0x7fde840b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:20.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.956+0000 7fde8a800640 1 -- 172.21.15.114:0/3479744700 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde80009b30 con 0x7fde840b3b00 2024-09-13T17:52:20.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.960+0000 7fde8a800640 1 --2- 172.21.15.114:0/3479744700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde840b3b00 0x7fde8413e210 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fde800af040 tx=0x7fde800197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:20.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.960+0000 7fde7e000640 1 -- 172.21.15.114:0/3479744700 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde800b8670 con 0x7fde840b3b00 2024-09-13T17:52:20.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.960+0000 7fde7e000640 1 -- 172.21.15.114:0/3479744700 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde800b87f0 con 0x7fde840b3b00 2024-09-13T17:52:20.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.960+0000 7fde8c800640 1 -- 172.21.15.114:0/3479744700 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde840b2d40 con 0x7fde840b3b00 2024-09-13T17:52:20.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.960+0000 7fde7e000640 1 -- 172.21.15.114:0/3479744700 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde800b8ba0 con 0x7fde840b3b00 2024-09-13T17:52:20.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.960+0000 7fde8c800640 1 -- 172.21.15.114:0/3479744700 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde840b3300 con 0x7fde840b3b00 2024-09-13T17:52:20.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.960+0000 7fde8c800640 1 -- 172.21.15.114:0/3479744700 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde840b3820 con 0x7fde840b3b00 2024-09-13T17:52:20.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.960+0000 7fde7e000640 1 -- 172.21.15.114:0/3479744700 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fde800b8d00 con 0x7fde840b3b00 2024-09-13T17:52:20.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.960+0000 7fde7e000640 1 --2- 172.21.15.114:0/3479744700 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fde68066690 0x7fde68068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:20.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.960+0000 7fde7e000640 1 -- 172.21.15.114:0/3479744700 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fde8011f8d0 con 0x7fde840b3b00 2024-09-13T17:52:20.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.960+0000 7fde89e00640 1 --2- 172.21.15.114:0/3479744700 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fde68066690 0x7fde68068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:20.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.960+0000 7fde89e00640 1 --2- 172.21.15.114:0/3479744700 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fde68066690 0x7fde68068b50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fde78000f70 tx=0x7fde78007e50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:20.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:20.964+0000 7fde7e000640 1 -- 172.21.15.114:0/3479744700 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fde800ec9f0 con 0x7fde840b3b00 2024-09-13T17:52:21.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.120+0000 7fde8c800640 1 -- 172.21.15.114:0/3479744700 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fde840ae110 con 0x7fde840b3b00 2024-09-13T17:52:21.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.120+0000 7fde7e000640 1 -- 172.21.15.114:0/3479744700 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fde800bc0a0 con 0x7fde840b3b00 2024-09-13T17:52:21.122 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:52:21.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.120+0000 7fde8c800640 1 -- 172.21.15.114:0/3479744700 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fde68066690 msgr2=0x7fde68068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:21.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.120+0000 7fde8c800640 1 --2- 172.21.15.114:0/3479744700 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fde68066690 0x7fde68068b50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fde78000f70 tx=0x7fde78007e50 comp rx=0 tx=0).stop 2024-09-13T17:52:21.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.120+0000 7fde8c800640 1 -- 172.21.15.114:0/3479744700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde840b3b00 msgr2=0x7fde8413e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:21.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.120+0000 7fde8c800640 1 --2- 172.21.15.114:0/3479744700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde840b3b00 0x7fde8413e210 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fde800af040 tx=0x7fde800197a0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.120+0000 7fde8c800640 1 -- 172.21.15.114:0/3479744700 shutdown_connections 2024-09-13T17:52:21.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.120+0000 7fde8c800640 1 --2- 172.21.15.114:0/3479744700 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fde68066690 0x7fde68068b50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.120+0000 7fde8c800640 1 --2- 172.21.15.114:0/3479744700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde840b3b00 0x7fde8413e210 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.120+0000 7fde8c800640 1 --2- 172.21.15.114:0/3479744700 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fde84140860 0x7fde840af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.120+0000 7fde8c800640 1 --2- 172.21.15.114:0/3479744700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde8406b270 0x7fde840b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.120+0000 7fde8c800640 1 -- 172.21.15.114:0/3479744700 >> 172.21.15.114:0/3479744700 conn(0x7fde840b0f60 msgr2=0x7fde8415b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:21.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.120+0000 7fde8c800640 1 -- 172.21.15.114:0/3479744700 shutdown_connections 2024-09-13T17:52:21.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.120+0000 7fde8c800640 1 -- 172.21.15.114:0/3479744700 wait complete. 2024-09-13T17:52:21.143 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:52:21.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.272+0000 7f0669a00640 1 Processor -- start 2024-09-13T17:52:21.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.272+0000 7f0669a00640 1 -- start start 2024-09-13T17:52:21.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f0669a00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f066406a690 0x7f06640b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:21.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f0669a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06640b28c0 con 0x7f066415c360 2024-09-13T17:52:21.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f0669a00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06640b2320 con 0x7f0664098a70 2024-09-13T17:52:21.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f0669a00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06640b0450 con 0x7f066406a690 2024-09-13T17:52:21.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f0663e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f066415c360 0x7f0664069f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42464/0 (socket says 172.21.15.114:42464) 2024-09-13T17:52:21.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f0663e00640 1 -- 172.21.15.114:0/4062667465 learned_addr learned my addr 172.21.15.114:0/4062667465 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:21.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f065b400640 1 --2- 172.21.15.114:0/4062667465 >> v2:172.21.15.134:3300/0 conn(0x7f066406a690 0x7f06640b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:21.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f0663400640 1 -- 172.21.15.114:0/4062667465 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2844546018 0 0) 0x7f06640b28c0 con 0x7f066415c360 2024-09-13T17:52:21.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f0663400640 1 -- 172.21.15.114:0/4062667465 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0648003530 con 0x7f066415c360 2024-09-13T17:52:21.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f0663400640 1 -- 172.21.15.114:0/4062667465 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4020894382 0 0) 0x7f0648003530 con 0x7f066415c360 2024-09-13T17:52:21.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f0663400640 1 -- 172.21.15.114:0/4062667465 >> v2:172.21.15.134:3300/0 conn(0x7f066406a690 msgr2=0x7f06640b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:21.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f0663400640 1 --2- 172.21.15.114:0/4062667465 >> v2:172.21.15.134:3300/0 conn(0x7f066406a690 0x7f06640b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f0663400640 1 -- 172.21.15.114:0/4062667465 >> v1:172.21.15.134:6789/0 conn(0x7f0664098a70 legacy=0x7f06640cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:21.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f0663400640 1 -- 172.21.15.114:0/4062667465 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06640b25e0 con 0x7f066415c360 2024-09-13T17:52:21.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f0663400640 1 -- 172.21.15.114:0/4062667465 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7f06540016a0 con 0x7f066415c360 2024-09-13T17:52:21.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f0663400640 1 -- 172.21.15.114:0/4062667465 >> v1:172.21.15.114:6789/0 conn(0x7f066415c360 legacy=0x7f0664069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:21.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f0663400640 1 --2- 172.21.15.114:0/4062667465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0648003980 0x7f0648003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:21.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f0663400640 1 --2- 172.21.15.114:0/4062667465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0648004380 0x7f0648004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:21.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f0663400640 1 --2- 172.21.15.114:0/4062667465 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06480050f0 0x7f064800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:21.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f0663400640 1 -- 172.21.15.114:0/4062667465 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06640b0450 con 0x7f0648004380 2024-09-13T17:52:21.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f0663400640 1 -- 172.21.15.114:0/4062667465 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064800c030 con 0x7f0648003980 2024-09-13T17:52:21.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f0663400640 1 -- 172.21.15.114:0/4062667465 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064800c1f0 con 0x7f06480050f0 2024-09-13T17:52:21.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f065b400640 1 --2- 172.21.15.114:0/4062667465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0648004380 0x7f0648004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:21.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f0663e00640 1 --2- 172.21.15.114:0/4062667465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0648003980 0x7f0648003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:21.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f0669000640 1 --2- 172.21.15.114:0/4062667465 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06480050f0 0x7f064800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:21.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f065b400640 1 -- 172.21.15.114:0/4062667465 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06480050f0 msgr2=0x7f064800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:21.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f065b400640 1 --2- 172.21.15.114:0/4062667465 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06480050f0 0x7f064800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f065b400640 1 -- 172.21.15.114:0/4062667465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0648003980 msgr2=0x7f0648003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:21.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f065b400640 1 --2- 172.21.15.114:0/4062667465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0648003980 0x7f0648003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f065b400640 1 -- 172.21.15.114:0/4062667465 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0648003530 con 0x7f0648004380 2024-09-13T17:52:21.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.276+0000 7f0669000640 1 -- 172.21.15.114:0/4062667465 reap_dead start 2024-09-13T17:52:21.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.280+0000 7f065b400640 1 --2- 172.21.15.114:0/4062667465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0648004380 0x7f0648004850 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f064c009ab0 tx=0x7f064c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588ab21a913c6c94 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:21.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.280+0000 7f0663400640 1 -- 172.21.15.114:0/4062667465 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c0a6410 con 0x7f0648004380 2024-09-13T17:52:21.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.280+0000 7f0663400640 1 -- 172.21.15.114:0/4062667465 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064c0a6570 con 0x7f0648004380 2024-09-13T17:52:21.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.280+0000 7f0663400640 1 -- 172.21.15.114:0/4062667465 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c0a6920 con 0x7f0648004380 2024-09-13T17:52:21.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.280+0000 7f0669a00640 1 -- 172.21.15.114:0/4062667465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0648004380 msgr2=0x7f0648004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:21.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.280+0000 7f0669a00640 1 --2- 172.21.15.114:0/4062667465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0648004380 0x7f0648004850 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f064c009ab0 tx=0x7f064c01ca50 comp rx=0 tx=0).stop 2024-09-13T17:52:21.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.280+0000 7f0669a00640 1 -- 172.21.15.114:0/4062667465 shutdown_connections 2024-09-13T17:52:21.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.280+0000 7f0669a00640 1 --2- 172.21.15.114:0/4062667465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0648004380 0x7f0648004850 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.280+0000 7f0669a00640 1 -- 172.21.15.114:0/4062667465 >> 172.21.15.114:0/4062667465 conn(0x7f06640b48e0 msgr2=0x7f06640b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:21.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.280+0000 7f0669a00640 1 -- 172.21.15.114:0/4062667465 shutdown_connections 2024-09-13T17:52:21.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.280+0000 7f0669a00640 1 -- 172.21.15.114:0/4062667465 wait complete. 2024-09-13T17:52:21.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.284+0000 7f0669a00640 1 Processor -- start 2024-09-13T17:52:21.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.284+0000 7f0669a00640 1 -- start start 2024-09-13T17:52:21.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.284+0000 7f0669a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0648004380 0x7f066414f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:21.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.284+0000 7f0669a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0664150f60 0x7f0664141cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:21.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.284+0000 7f0669a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06640cb100 0x7f066406d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:21.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.284+0000 7f0669a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0664150b40 con 0x7f0664150f60 2024-09-13T17:52:21.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.284+0000 7f0669a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06641421f0 con 0x7f0648004380 2024-09-13T17:52:21.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.284+0000 7f0669a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06641513e0 con 0x7f06640cb100 2024-09-13T17:52:21.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.284+0000 7f065b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0664150f60 0x7f0664141cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:21.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.284+0000 7f065b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0664150f60 0x7f0664141cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49510/0 (socket says 172.21.15.114:49510) 2024-09-13T17:52:21.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.284+0000 7f065b400640 1 -- 172.21.15.114:0/1804278382 learned_addr learned my addr 172.21.15.114:0/1804278382 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:21.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.284+0000 7f0663e00640 1 --2- 172.21.15.114:0/1804278382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0648004380 0x7f066414f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:21.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.284+0000 7f0669000640 1 --2- 172.21.15.114:0/1804278382 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06640cb100 0x7f066406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:21.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.284+0000 7f065b400640 1 -- 172.21.15.114:0/1804278382 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06640cb100 msgr2=0x7f066406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:21.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.284+0000 7f065b400640 1 --2- 172.21.15.114:0/1804278382 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06640cb100 0x7f066406d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.284+0000 7f065b400640 1 -- 172.21.15.114:0/1804278382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0648004380 msgr2=0x7f066414f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:21.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.284+0000 7f065b400640 1 --2- 172.21.15.114:0/1804278382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0648004380 0x7f066414f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.284+0000 7f065b400640 1 -- 172.21.15.114:0/1804278382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066414fec0 con 0x7f0664150f60 2024-09-13T17:52:21.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.284+0000 7f0663e00640 1 --2- 172.21.15.114:0/1804278382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0648004380 0x7f066414f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:21.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.284+0000 7f065b400640 1 --2- 172.21.15.114:0/1804278382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0664150f60 0x7f0664141cb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f064c01c880 tx=0x7f064c0197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:21.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.284+0000 7f0660c00640 1 -- 172.21.15.114:0/1804278382 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c0b03f0 con 0x7f0664150f60 2024-09-13T17:52:21.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.284+0000 7f0660c00640 1 -- 172.21.15.114:0/1804278382 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064c0b0550 con 0x7f0664150f60 2024-09-13T17:52:21.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.284+0000 7f0660c00640 1 -- 172.21.15.114:0/1804278382 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c0b08e0 con 0x7f0664150f60 2024-09-13T17:52:21.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.284+0000 7f0669a00640 1 -- 172.21.15.114:0/1804278382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06641501a0 con 0x7f0664150f60 2024-09-13T17:52:21.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.284+0000 7f0669a00640 1 -- 172.21.15.114:0/1804278382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0664150760 con 0x7f0664150f60 2024-09-13T17:52:21.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.284+0000 7f0669a00640 1 -- 172.21.15.114:0/1804278382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f066406a280 con 0x7f0664150f60 2024-09-13T17:52:21.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.288+0000 7f0660c00640 1 -- 172.21.15.114:0/1804278382 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f064c0b0a40 con 0x7f0664150f60 2024-09-13T17:52:21.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.288+0000 7f0660c00640 1 --2- 172.21.15.114:0/1804278382 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0640066690 0x7f0640068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:21.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.288+0000 7f0660c00640 1 -- 172.21.15.114:0/1804278382 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f064c11e1e0 con 0x7f0664150f60 2024-09-13T17:52:21.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.288+0000 7f0663e00640 1 --2- 172.21.15.114:0/1804278382 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0640066690 0x7f0640068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:21.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.288+0000 7f0663e00640 1 --2- 172.21.15.114:0/1804278382 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0640066690 0x7f0640068b50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0654001230 tx=0x7f065400a040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:21.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.292+0000 7f0660c00640 1 -- 172.21.15.114:0/1804278382 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f064c0eb250 con 0x7f0664150f60 2024-09-13T17:52:21.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.480+0000 7f0669a00640 1 -- 172.21.15.114:0/1804278382 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06641594e0 con 0x7f0664150f60 2024-09-13T17:52:21.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.480+0000 7f0660c00640 1 -- 172.21.15.114:0/1804278382 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4739 (secure 0 0 0) 0x7f064c0ee870 con 0x7f0664150f60 2024-09-13T17:52:21.482 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:21.483 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/534634081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":534634081},{"type":"v1","addr":"172.21.15.134:6835","nonce":534634081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1773366615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1773366615},{"type":"v1","addr":"172.21.15.114:6836","nonce":1773366615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4122490085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":4122490085},{"type":"v1","addr":"172.21.15.114:6837","nonce":4122490085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:51:49.789079+0000","modified":"2024-09-13T17:52:13.041461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/1863104078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1863104078},{"type":"v1","addr":"172.21.15.134:6834","nonce":1863104078}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:52:21.483 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 9 2024-09-13T17:52:21.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.480+0000 7f0669a00640 1 -- 172.21.15.114:0/1804278382 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0640066690 msgr2=0x7f0640068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:21.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.480+0000 7f0669a00640 1 --2- 172.21.15.114:0/1804278382 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0640066690 0x7f0640068b50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0654001230 tx=0x7f065400a040 comp rx=0 tx=0).stop 2024-09-13T17:52:21.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.480+0000 7f0669a00640 1 -- 172.21.15.114:0/1804278382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0664150f60 msgr2=0x7f0664141cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:21.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.480+0000 7f0669a00640 1 --2- 172.21.15.114:0/1804278382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0664150f60 0x7f0664141cb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f064c01c880 tx=0x7f064c0197f0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.480+0000 7f0669a00640 1 -- 172.21.15.114:0/1804278382 shutdown_connections 2024-09-13T17:52:21.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.480+0000 7f0669a00640 1 --2- 172.21.15.114:0/1804278382 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0640066690 0x7f0640068b50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.480+0000 7f0669a00640 1 --2- 172.21.15.114:0/1804278382 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06640cb100 0x7f066406d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.480+0000 7f0669a00640 1 --2- 172.21.15.114:0/1804278382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0664150f60 0x7f0664141cb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.480+0000 7f0669a00640 1 --2- 172.21.15.114:0/1804278382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0648004380 0x7f066414f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.480+0000 7f0669a00640 1 -- 172.21.15.114:0/1804278382 >> 172.21.15.114:0/1804278382 conn(0x7f06640b48e0 msgr2=0x7f06640ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:21.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.480+0000 7f0669a00640 1 -- 172.21.15.114:0/1804278382 shutdown_connections 2024-09-13T17:52:21.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.480+0000 7f0669a00640 1 -- 172.21.15.114:0/1804278382 wait complete. 2024-09-13T17:52:21.503 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:52:21.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.636+0000 7ff56a400640 1 Processor -- start 2024-09-13T17:52:21.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.636+0000 7ff56a400640 1 -- start start 2024-09-13T17:52:21.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.636+0000 7ff56a400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff5640ceed0 0x7ff5640b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:21.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.636+0000 7ff56a400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5640cdee0 0x7ff5640cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:21.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.636+0000 7ff56a400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff5640d0eb0 0x7ff5640b2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:21.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.636+0000 7ff56a400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5640cdac0 con 0x7ff5640d0eb0 2024-09-13T17:52:21.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.636+0000 7ff56a400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5640b2090 con 0x7ff5640ceed0 2024-09-13T17:52:21.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.636+0000 7ff56a400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5640cd400 con 0x7ff5640cdee0 2024-09-13T17:52:21.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.636+0000 7ff569a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff5640d0eb0 0x7ff5640b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:21.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.636+0000 7ff569a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff5640d0eb0 0x7ff5640b2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49518/0 (socket says 172.21.15.114:49518) 2024-09-13T17:52:21.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.636+0000 7ff569a00640 1 -- 172.21.15.114:0/372744313 learned_addr learned my addr 172.21.15.114:0/372744313 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:21.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.636+0000 7ff55be00640 1 --2- 172.21.15.114:0/372744313 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5640cdee0 0x7ff5640cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:21.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.636+0000 7ff569000640 1 --2- 172.21.15.114:0/372744313 >> v2:172.21.15.134:3300/0 conn(0x7ff5640ceed0 0x7ff5640b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:21.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.636+0000 7ff569a00640 1 -- 172.21.15.114:0/372744313 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5640cdee0 msgr2=0x7ff5640cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:21.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.636+0000 7ff569a00640 1 --2- 172.21.15.114:0/372744313 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5640cdee0 0x7ff5640cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.636+0000 7ff569a00640 1 -- 172.21.15.114:0/372744313 >> v2:172.21.15.134:3300/0 conn(0x7ff5640ceed0 msgr2=0x7ff5640b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:21.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.636+0000 7ff569a00640 1 --2- 172.21.15.114:0/372744313 >> v2:172.21.15.134:3300/0 conn(0x7ff5640ceed0 0x7ff5640b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.636+0000 7ff569a00640 1 -- 172.21.15.114:0/372744313 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5640cd6e0 con 0x7ff5640d0eb0 2024-09-13T17:52:21.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.636+0000 7ff569000640 1 --2- 172.21.15.114:0/372744313 >> v2:172.21.15.134:3300/0 conn(0x7ff5640ceed0 0x7ff5640b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:21.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.640+0000 7ff569a00640 1 --2- 172.21.15.114:0/372744313 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5640d0eb0 0x7ff5640b2440 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff56408a9a0 tx=0x7ff55c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae7cec605d1c68b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:21.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.640+0000 7ff563e00640 1 -- 172.21.15.114:0/372744313 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c0a5790 con 0x7ff5640d0eb0 2024-09-13T17:52:21.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.640+0000 7ff563e00640 1 -- 172.21.15.114:0/372744313 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c0a58f0 con 0x7ff5640d0eb0 2024-09-13T17:52:21.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.640+0000 7ff563e00640 1 -- 172.21.15.114:0/372744313 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c0a5c80 con 0x7ff5640d0eb0 2024-09-13T17:52:21.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.640+0000 7ff56a400640 1 -- 172.21.15.114:0/372744313 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5640d0eb0 msgr2=0x7ff5640b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:21.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.640+0000 7ff56a400640 1 --2- 172.21.15.114:0/372744313 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5640d0eb0 0x7ff5640b2440 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff56408a9a0 tx=0x7ff55c01c930 comp rx=0 tx=0).stop 2024-09-13T17:52:21.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.640+0000 7ff56a400640 1 -- 172.21.15.114:0/372744313 shutdown_connections 2024-09-13T17:52:21.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.640+0000 7ff56a400640 1 --2- 172.21.15.114:0/372744313 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5640d0eb0 0x7ff5640b2440 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.640+0000 7ff56a400640 1 --2- 172.21.15.114:0/372744313 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5640cdee0 0x7ff5640cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.640+0000 7ff56a400640 1 --2- 172.21.15.114:0/372744313 >> v2:172.21.15.134:3300/0 conn(0x7ff5640ceed0 0x7ff5640b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.640+0000 7ff56a400640 1 -- 172.21.15.114:0/372744313 >> 172.21.15.114:0/372744313 conn(0x7ff56409b850 msgr2=0x7ff56408a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:21.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.640+0000 7ff56a400640 1 -- 172.21.15.114:0/372744313 shutdown_connections 2024-09-13T17:52:21.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.640+0000 7ff56a400640 1 -- 172.21.15.114:0/372744313 wait complete. 2024-09-13T17:52:21.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.640+0000 7ff56a400640 1 Processor -- start 2024-09-13T17:52:21.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.640+0000 7ff56a400640 1 -- start start 2024-09-13T17:52:21.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.644+0000 7ff56a400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5640cdee0 0x7ff5641510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:21.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.644+0000 7ff56a400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5640ceed0 0x7ff564152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:21.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.644+0000 7ff56a400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5640d0eb0 0x7ff5640b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:21.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.644+0000 7ff56a400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5640cb2b0 con 0x7ff5640d0eb0 2024-09-13T17:52:21.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.644+0000 7ff56a400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5640cb590 con 0x7ff5640cdee0 2024-09-13T17:52:21.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.644+0000 7ff56a400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5640cb870 con 0x7ff5640ceed0 2024-09-13T17:52:21.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.644+0000 7ff569a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5640d0eb0 0x7ff5640b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:21.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.644+0000 7ff569a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5640d0eb0 0x7ff5640b0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49526/0 (socket says 172.21.15.114:49526) 2024-09-13T17:52:21.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.644+0000 7ff569a00640 1 -- 172.21.15.114:0/2087639365 learned_addr learned my addr 172.21.15.114:0/2087639365 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:21.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.644+0000 7ff569000640 1 --2- 172.21.15.114:0/2087639365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5640cdee0 0x7ff5641510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:21.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.644+0000 7ff55be00640 1 --2- 172.21.15.114:0/2087639365 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5640ceed0 0x7ff564152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:21.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.644+0000 7ff569a00640 1 -- 172.21.15.114:0/2087639365 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5640ceed0 msgr2=0x7ff564152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:21.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.644+0000 7ff569a00640 1 --2- 172.21.15.114:0/2087639365 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5640ceed0 0x7ff564152430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.644+0000 7ff569a00640 1 -- 172.21.15.114:0/2087639365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5640cdee0 msgr2=0x7ff5641510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:21.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.644+0000 7ff569a00640 1 --2- 172.21.15.114:0/2087639365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5640cdee0 0x7ff5641510b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.644+0000 7ff569a00640 1 -- 172.21.15.114:0/2087639365 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55c009b30 con 0x7ff5640d0eb0 2024-09-13T17:52:21.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.644+0000 7ff569a00640 1 --2- 172.21.15.114:0/2087639365 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5640d0eb0 0x7ff5640b0440 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff55c01d1d0 tx=0x7ff55c0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:21.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.644+0000 7ff561600640 1 -- 172.21.15.114:0/2087639365 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c0b8670 con 0x7ff5640d0eb0 2024-09-13T17:52:21.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.644+0000 7ff561600640 1 -- 172.21.15.114:0/2087639365 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c0b87d0 con 0x7ff5640d0eb0 2024-09-13T17:52:21.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.644+0000 7ff561600640 1 -- 172.21.15.114:0/2087639365 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c0b8b80 con 0x7ff5640d0eb0 2024-09-13T17:52:21.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.644+0000 7ff56a400640 1 -- 172.21.15.114:0/2087639365 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5640cbb50 con 0x7ff5640d0eb0 2024-09-13T17:52:21.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.644+0000 7ff56a400640 1 -- 172.21.15.114:0/2087639365 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5641515f0 con 0x7ff5640d0eb0 2024-09-13T17:52:21.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.644+0000 7ff56a400640 1 -- 172.21.15.114:0/2087639365 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5640b1ab0 con 0x7ff5640d0eb0 2024-09-13T17:52:21.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.644+0000 7ff561600640 1 -- 172.21.15.114:0/2087639365 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff55c0b8ce0 con 0x7ff5640d0eb0 2024-09-13T17:52:21.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.648+0000 7ff561600640 1 --2- 172.21.15.114:0/2087639365 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff5400666c0 0x7ff540068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:21.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.648+0000 7ff561600640 1 -- 172.21.15.114:0/2087639365 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff55c11f670 con 0x7ff5640d0eb0 2024-09-13T17:52:21.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.648+0000 7ff569000640 1 --2- 172.21.15.114:0/2087639365 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff5400666c0 0x7ff540068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:21.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.648+0000 7ff569000640 1 --2- 172.21.15.114:0/2087639365 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff5400666c0 0x7ff540068b80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff554009950 tx=0x7ff554008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:21.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.652+0000 7ff561600640 1 -- 172.21.15.114:0/2087639365 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff55c0ec820 con 0x7ff5640d0eb0 2024-09-13T17:52:21.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.804+0000 7ff56a400640 1 -- 172.21.15.114:0/2087639365 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5640d0c60 con 0x7ff5640d0eb0 2024-09-13T17:52:21.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.808+0000 7ff561600640 1 -- 172.21.15.114:0/2087639365 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18394 (secure 0 0 0) 0x7ff55c0efe40 con 0x7ff5640d0eb0 2024-09-13T17:52:21.810 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:21.810 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:51:54.213439+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:51:48.278220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:51:48.773888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:51:51.856300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:52:21.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.808+0000 7ff56a400640 1 -- 172.21.15.114:0/2087639365 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff5400666c0 msgr2=0x7ff540068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:21.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.808+0000 7ff56a400640 1 --2- 172.21.15.114:0/2087639365 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff5400666c0 0x7ff540068b80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff554009950 tx=0x7ff554008040 comp rx=0 tx=0).stop 2024-09-13T17:52:21.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.808+0000 7ff56a400640 1 -- 172.21.15.114:0/2087639365 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5640d0eb0 msgr2=0x7ff5640b0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:21.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.808+0000 7ff56a400640 1 --2- 172.21.15.114:0/2087639365 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5640d0eb0 0x7ff5640b0440 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff55c01d1d0 tx=0x7ff55c0196d0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.808+0000 7ff56a400640 1 -- 172.21.15.114:0/2087639365 shutdown_connections 2024-09-13T17:52:21.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.808+0000 7ff56a400640 1 --2- 172.21.15.114:0/2087639365 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff5400666c0 0x7ff540068b80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.808+0000 7ff56a400640 1 --2- 172.21.15.114:0/2087639365 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5640d0eb0 0x7ff5640b0440 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.808+0000 7ff56a400640 1 --2- 172.21.15.114:0/2087639365 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5640ceed0 0x7ff564152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.808+0000 7ff56a400640 1 --2- 172.21.15.114:0/2087639365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5640cdee0 0x7ff5641510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.808+0000 7ff56a400640 1 -- 172.21.15.114:0/2087639365 >> 172.21.15.114:0/2087639365 conn(0x7ff56409b850 msgr2=0x7ff56408a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:21.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.808+0000 7ff56a400640 1 -- 172.21.15.114:0/2087639365 shutdown_connections 2024-09-13T17:52:21.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.808+0000 7ff56a400640 1 -- 172.21.15.114:0/2087639365 wait complete. 2024-09-13T17:52:21.832 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:51:37.996254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:51:48.278220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:51:48.773888+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:51:51.856300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:52:21.833 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:52:21.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.968+0000 7f4c55400640 1 Processor -- start 2024-09-13T17:52:21.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.968+0000 7f4c55400640 1 -- start start 2024-09-13T17:52:21.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.968+0000 7f4c55400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c501548e0 0x7f4c5015a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:21.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.968+0000 7f4c55400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4c500ab2a0 0x7f4c500acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:21.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.968+0000 7f4c55400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4c500ad280 0x7f4c5015dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:21.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.968+0000 7f4c55400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c50154cc0 con 0x7f4c500ad280 2024-09-13T17:52:21.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.968+0000 7f4c55400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c5015b700 con 0x7f4c500ab2a0 2024-09-13T17:52:21.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.968+0000 7f4c55400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c50070320 con 0x7f4c501548e0 2024-09-13T17:52:21.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.968+0000 7f4c54a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4c500ad280 0x7f4c5015dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:21.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.968+0000 7f4c54a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4c500ad280 0x7f4c5015dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49532/0 (socket says 172.21.15.114:49532) 2024-09-13T17:52:21.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.968+0000 7f4c54a00640 1 -- 172.21.15.114:0/1969795841 learned_addr learned my addr 172.21.15.114:0/1969795841 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:21.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.968+0000 7f4c47400640 1 --2- 172.21.15.114:0/1969795841 >> v2:172.21.15.134:3300/0 conn(0x7f4c500ab2a0 0x7f4c500acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:21.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.968+0000 7f4c4fe00640 1 --2- 172.21.15.114:0/1969795841 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c501548e0 0x7f4c5015a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:21.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.968+0000 7f4c54a00640 1 -- 172.21.15.114:0/1969795841 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c501548e0 msgr2=0x7f4c5015a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:21.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.968+0000 7f4c54a00640 1 --2- 172.21.15.114:0/1969795841 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c501548e0 0x7f4c5015a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.968+0000 7f4c54a00640 1 -- 172.21.15.114:0/1969795841 >> v2:172.21.15.134:3300/0 conn(0x7f4c500ab2a0 msgr2=0x7f4c500acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:21.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.968+0000 7f4c54a00640 1 --2- 172.21.15.114:0/1969795841 >> v2:172.21.15.134:3300/0 conn(0x7f4c500ab2a0 0x7f4c500acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.968+0000 7f4c54a00640 1 -- 172.21.15.114:0/1969795841 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5015ae60 con 0x7f4c500ad280 2024-09-13T17:52:21.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.972+0000 7f4c54a00640 1 --2- 172.21.15.114:0/1969795841 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c500ad280 0x7f4c5015dd50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4c5006be70 tx=0x7f4c4801c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=701fb470a28405d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:21.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.972+0000 7f4c4f400640 1 -- 172.21.15.114:0/1969795841 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c480a5520 con 0x7f4c500ad280 2024-09-13T17:52:21.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.972+0000 7f4c4f400640 1 -- 172.21.15.114:0/1969795841 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c480a5680 con 0x7f4c500ad280 2024-09-13T17:52:21.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.972+0000 7f4c4f400640 1 -- 172.21.15.114:0/1969795841 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c480a5a10 con 0x7f4c500ad280 2024-09-13T17:52:21.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.972+0000 7f4c55400640 1 -- 172.21.15.114:0/1969795841 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c500ad280 msgr2=0x7f4c5015dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:21.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.972+0000 7f4c55400640 1 --2- 172.21.15.114:0/1969795841 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c500ad280 0x7f4c5015dd50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4c5006be70 tx=0x7f4c4801c6a0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.972+0000 7f4c55400640 1 -- 172.21.15.114:0/1969795841 shutdown_connections 2024-09-13T17:52:21.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.972+0000 7f4c55400640 1 --2- 172.21.15.114:0/1969795841 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c500ad280 0x7f4c5015dd50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.972+0000 7f4c55400640 1 --2- 172.21.15.114:0/1969795841 >> v2:172.21.15.134:3300/0 conn(0x7f4c500ab2a0 0x7f4c500acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.972+0000 7f4c55400640 1 --2- 172.21.15.114:0/1969795841 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c501548e0 0x7f4c5015a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.972+0000 7f4c55400640 1 -- 172.21.15.114:0/1969795841 >> 172.21.15.114:0/1969795841 conn(0x7f4c500ce0d0 msgr2=0x7f4c500ce4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:21.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.972+0000 7f4c55400640 1 -- 172.21.15.114:0/1969795841 shutdown_connections 2024-09-13T17:52:21.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.972+0000 7f4c55400640 1 -- 172.21.15.114:0/1969795841 wait complete. 2024-09-13T17:52:21.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.976+0000 7f4c55400640 1 Processor -- start 2024-09-13T17:52:21.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.976+0000 7f4c55400640 1 -- start start 2024-09-13T17:52:21.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.976+0000 7f4c55400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c500ab2a0 0x7f4c5006d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:21.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.976+0000 7f4c55400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c500ad280 0x7f4c500af080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:21.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.976+0000 7f4c55400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c501548e0 0x7f4c50149010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:21.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.976+0000 7f4c55400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c50146fb0 con 0x7f4c501548e0 2024-09-13T17:52:21.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.976+0000 7f4c55400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c50147440 con 0x7f4c500ab2a0 2024-09-13T17:52:21.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.976+0000 7f4c55400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5006db60 con 0x7f4c500ad280 2024-09-13T17:52:21.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.976+0000 7f4c54a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c501548e0 0x7f4c50149010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:21.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.976+0000 7f4c54a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c501548e0 0x7f4c50149010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49540/0 (socket says 172.21.15.114:49540) 2024-09-13T17:52:21.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.976+0000 7f4c54a00640 1 -- 172.21.15.114:0/2832992279 learned_addr learned my addr 172.21.15.114:0/2832992279 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:21.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.976+0000 7f4c4fe00640 1 --2- 172.21.15.114:0/2832992279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c500ab2a0 0x7f4c5006d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:21.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.976+0000 7f4c47400640 1 --2- 172.21.15.114:0/2832992279 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c500ad280 0x7f4c500af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:21.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.976+0000 7f4c54a00640 1 -- 172.21.15.114:0/2832992279 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c500ad280 msgr2=0x7f4c500af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:21.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.976+0000 7f4c54a00640 1 --2- 172.21.15.114:0/2832992279 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c500ad280 0x7f4c500af080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.976+0000 7f4c54a00640 1 -- 172.21.15.114:0/2832992279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c500ab2a0 msgr2=0x7f4c5006d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:21.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.976+0000 7f4c54a00640 1 --2- 172.21.15.114:0/2832992279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c500ab2a0 0x7f4c5006d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:21.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.976+0000 7f4c54a00640 1 -- 172.21.15.114:0/2832992279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c48009b30 con 0x7f4c501548e0 2024-09-13T17:52:21.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.976+0000 7f4c54a00640 1 --2- 172.21.15.114:0/2832992279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c501548e0 0x7f4c50149010 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4c4801ad50 tx=0x7f4c48019440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:21.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.976+0000 7f4c4cc00640 1 -- 172.21.15.114:0/2832992279 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c480a5520 con 0x7f4c501548e0 2024-09-13T17:52:21.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.976+0000 7f4c4cc00640 1 -- 172.21.15.114:0/2832992279 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c480b8690 con 0x7f4c501548e0 2024-09-13T17:52:21.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.976+0000 7f4c55400640 1 -- 172.21.15.114:0/2832992279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c50159fa0 con 0x7f4c501548e0 2024-09-13T17:52:21.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.976+0000 7f4c4cc00640 1 -- 172.21.15.114:0/2832992279 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c480b8a40 con 0x7f4c501548e0 2024-09-13T17:52:21.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.976+0000 7f4c55400640 1 -- 172.21.15.114:0/2832992279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c50146c40 con 0x7f4c501548e0 2024-09-13T17:52:21.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.980+0000 7f4c55400640 1 -- 172.21.15.114:0/2832992279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c50147160 con 0x7f4c501548e0 2024-09-13T17:52:21.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.980+0000 7f4c4cc00640 1 -- 172.21.15.114:0/2832992279 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4c480b8ba0 con 0x7f4c501548e0 2024-09-13T17:52:21.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.980+0000 7f4c4cc00640 1 --2- 172.21.15.114:0/2832992279 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4c2c0666c0 0x7f4c2c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:21.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.980+0000 7f4c4cc00640 1 -- 172.21.15.114:0/2832992279 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4c4811f4b0 con 0x7f4c501548e0 2024-09-13T17:52:21.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.980+0000 7f4c4fe00640 1 --2- 172.21.15.114:0/2832992279 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4c2c0666c0 0x7f4c2c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:21.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.980+0000 7f4c4fe00640 1 --2- 172.21.15.114:0/2832992279 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4c2c0666c0 0x7f4c2c068b80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4c40007940 tx=0x7f4c40008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:21.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:21.984+0000 7f4c4cc00640 1 -- 172.21.15.114:0/2832992279 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4c50147160 con 0x7f4c501548e0 2024-09-13T17:52:22.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.140+0000 7f4c55400640 1 -- 172.21.15.114:0/2832992279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4c50147160 con 0x7f4c501548e0 2024-09-13T17:52:22.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.140+0000 7f4c4cc00640 1 -- 172.21.15.114:0/2832992279 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4c50147160 con 0x7f4c501548e0 2024-09-13T17:52:22.143 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-13T17:52:22.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.140+0000 7f4c55400640 1 -- 172.21.15.114:0/2832992279 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4c2c0666c0 msgr2=0x7f4c2c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:22.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.140+0000 7f4c55400640 1 --2- 172.21.15.114:0/2832992279 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4c2c0666c0 0x7f4c2c068b80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4c40007940 tx=0x7f4c40008040 comp rx=0 tx=0).stop 2024-09-13T17:52:22.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.140+0000 7f4c55400640 1 -- 172.21.15.114:0/2832992279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c501548e0 msgr2=0x7f4c50149010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:22.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.140+0000 7f4c55400640 1 --2- 172.21.15.114:0/2832992279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c501548e0 0x7f4c50149010 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4c4801ad50 tx=0x7f4c48019440 comp rx=0 tx=0).stop 2024-09-13T17:52:22.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.140+0000 7f4c55400640 1 -- 172.21.15.114:0/2832992279 shutdown_connections 2024-09-13T17:52:22.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.140+0000 7f4c55400640 1 --2- 172.21.15.114:0/2832992279 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4c2c0666c0 0x7f4c2c068b80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:22.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.140+0000 7f4c55400640 1 --2- 172.21.15.114:0/2832992279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4c501548e0 0x7f4c50149010 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:22.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.140+0000 7f4c55400640 1 --2- 172.21.15.114:0/2832992279 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4c500ad280 0x7f4c500af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:22.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.140+0000 7f4c55400640 1 --2- 172.21.15.114:0/2832992279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c500ab2a0 0x7f4c5006d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:22.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.140+0000 7f4c55400640 1 -- 172.21.15.114:0/2832992279 >> 172.21.15.114:0/2832992279 conn(0x7f4c500ce0d0 msgr2=0x7f4c50070b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:22.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.140+0000 7f4c55400640 1 -- 172.21.15.114:0/2832992279 shutdown_connections 2024-09-13T17:52:22.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.140+0000 7f4c55400640 1 -- 172.21.15.114:0/2832992279 wait complete. 2024-09-13T17:52:22.163 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:52:22.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.296+0000 7fdfc8e00640 1 Processor -- start 2024-09-13T17:52:22.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.296+0000 7fdfc8e00640 1 -- start start 2024-09-13T17:52:22.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.296+0000 7fdfc8e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfc40cdad0 0x7fdfc40ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:22.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.296+0000 7fdfc8e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc40adfb0 con 0x7fdfc406d740 2024-09-13T17:52:22.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.296+0000 7fdfc8e00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc40adcd0 con 0x7fdfc4070420 2024-09-13T17:52:22.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.296+0000 7fdfc8e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc406cc10 con 0x7fdfc40cdad0 2024-09-13T17:52:22.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.296+0000 7fdfc2800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fdfc406d740 0x7fdfc415d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42480/0 (socket says 172.21.15.114:42480) 2024-09-13T17:52:22.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.296+0000 7fdfc2800640 1 -- 172.21.15.114:0/669371384 learned_addr learned my addr 172.21.15.114:0/669371384 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:22.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.300+0000 7fdfc1e00640 1 --2- 172.21.15.114:0/669371384 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfc40cdad0 0x7fdfc40ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:22.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.300+0000 7fdfc1400640 1 -- 172.21.15.114:0/669371384 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4264165966 0 0) 0x7fdfc40adfb0 con 0x7fdfc406d740 2024-09-13T17:52:22.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.300+0000 7fdfc1400640 1 -- 172.21.15.114:0/669371384 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfa8003530 con 0x7fdfc406d740 2024-09-13T17:52:22.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.300+0000 7fdfc1400640 1 -- 172.21.15.114:0/669371384 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867420985 0 0) 0x7fdfc40adcd0 con 0x7fdfc4070420 2024-09-13T17:52:22.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.300+0000 7fdfc1400640 1 -- 172.21.15.114:0/669371384 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfc40adfb0 con 0x7fdfc4070420 2024-09-13T17:52:22.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.300+0000 7fdfc1400640 1 -- 172.21.15.114:0/669371384 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3972660583 0 0) 0x7fdfa8003530 con 0x7fdfc406d740 2024-09-13T17:52:22.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.300+0000 7fdfc1400640 1 -- 172.21.15.114:0/669371384 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfc40cdad0 msgr2=0x7fdfc40ad4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:22.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.300+0000 7fdfc1400640 1 --2- 172.21.15.114:0/669371384 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfc40cdad0 0x7fdfc40ad4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:22.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.300+0000 7fdfc1400640 1 -- 172.21.15.114:0/669371384 >> v1:172.21.15.134:6789/0 conn(0x7fdfc4070420 legacy=0x7fdfc406d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:22.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.300+0000 7fdfc1400640 1 -- 172.21.15.114:0/669371384 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc406c550 con 0x7fdfc406d740 2024-09-13T17:52:22.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.300+0000 7fdfc1400640 1 -- 172.21.15.114:0/669371384 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7fdfbc001a00 con 0x7fdfc406d740 2024-09-13T17:52:22.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.300+0000 7fdfc1400640 1 -- 172.21.15.114:0/669371384 >> v1:172.21.15.114:6789/0 conn(0x7fdfc406d740 legacy=0x7fdfc415d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:22.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.300+0000 7fdfc1400640 1 --2- 172.21.15.114:0/669371384 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfa8003b40 0x7fdfa8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:22.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.300+0000 7fdfc1400640 1 --2- 172.21.15.114:0/669371384 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfc40cdad0 0x7fdfa80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:22.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.300+0000 7fdfc1400640 1 --2- 172.21.15.114:0/669371384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa8004d10 0x7fdfa8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:22.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.300+0000 7fdfc1400640 1 -- 172.21.15.114:0/669371384 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc406cc10 con 0x7fdfa8003b40 2024-09-13T17:52:22.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.300+0000 7fdfc1400640 1 -- 172.21.15.114:0/669371384 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa800ba90 con 0x7fdfa8004d10 2024-09-13T17:52:22.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.300+0000 7fdfc1400640 1 -- 172.21.15.114:0/669371384 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa800bc50 con 0x7fdfc40cdad0 2024-09-13T17:52:22.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.300+0000 7fdfc1e00640 1 --2- 172.21.15.114:0/669371384 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfa8003b40 0x7fdfa8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:22.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.300+0000 7fdfc2800640 1 --2- 172.21.15.114:0/669371384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa8004d10 0x7fdfa8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:22.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.300+0000 7fdfb9400640 1 --2- 172.21.15.114:0/669371384 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfc40cdad0 0x7fdfa80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:22.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.300+0000 7fdfc1e00640 1 -- 172.21.15.114:0/669371384 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfc40cdad0 msgr2=0x7fdfa80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:22.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.300+0000 7fdfc1e00640 1 --2- 172.21.15.114:0/669371384 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfc40cdad0 0x7fdfa80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:22.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.300+0000 7fdfc1e00640 1 -- 172.21.15.114:0/669371384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa8004d10 msgr2=0x7fdfa8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:22.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.300+0000 7fdfc1e00640 1 --2- 172.21.15.114:0/669371384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa8004d10 0x7fdfa8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:22.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.300+0000 7fdfc1e00640 1 -- 172.21.15.114:0/669371384 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa8003530 con 0x7fdfa8003b40 2024-09-13T17:52:22.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.300+0000 7fdfc2800640 1 --2- 172.21.15.114:0/669371384 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfa8004d10 0x7fdfa8005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:22.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.304+0000 7fdfc1e00640 1 --2- 172.21.15.114:0/669371384 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfa8003b40 0x7fdfa8003f40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4009ae0 tx=0x7fdfb401ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e75ca3cf4bcc39 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:22.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.304+0000 7fdfc1400640 1 -- 172.21.15.114:0/669371384 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb40a5520 con 0x7fdfa8003b40 2024-09-13T17:52:22.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.304+0000 7fdfc1400640 1 -- 172.21.15.114:0/669371384 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb40a5680 con 0x7fdfa8003b40 2024-09-13T17:52:22.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.304+0000 7fdfc1400640 1 -- 172.21.15.114:0/669371384 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb40a5a30 con 0x7fdfa8003b40 2024-09-13T17:52:22.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.304+0000 7fdfc8e00640 1 -- 172.21.15.114:0/669371384 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfa8003b40 msgr2=0x7fdfa8003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:22.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.304+0000 7fdfc8e00640 1 --2- 172.21.15.114:0/669371384 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfa8003b40 0x7fdfa8003f40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4009ae0 tx=0x7fdfb401ca40 comp rx=0 tx=0).stop 2024-09-13T17:52:22.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.304+0000 7fdfc2800640 1 -- 172.21.15.114:0/669371384 reap_dead start 2024-09-13T17:52:22.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.304+0000 7fdfc8e00640 1 -- 172.21.15.114:0/669371384 shutdown_connections 2024-09-13T17:52:22.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.304+0000 7fdfc8e00640 1 -- 172.21.15.114:0/669371384 >> 172.21.15.114:0/669371384 conn(0x7fdfc40660b0 msgr2=0x7fdfc4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:22.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.304+0000 7fdfc8e00640 1 -- 172.21.15.114:0/669371384 shutdown_connections 2024-09-13T17:52:22.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.304+0000 7fdfc8e00640 1 -- 172.21.15.114:0/669371384 wait complete. 2024-09-13T17:52:22.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.304+0000 7fdfc8e00640 1 Processor -- start 2024-09-13T17:52:22.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.304+0000 7fdfc8e00640 1 -- start start 2024-09-13T17:52:22.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.304+0000 7fdfc8e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa8003b40 0x7fdfc4147e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:22.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.304+0000 7fdfc8e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfc414cf80 0x7fdfc40af460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:22.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.304+0000 7fdfc8e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfc415c220 0x7fdfc40af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:22.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.304+0000 7fdfc8e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc4148f80 con 0x7fdfc414cf80 2024-09-13T17:52:22.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.304+0000 7fdfc8e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc41490f0 con 0x7fdfc415c220 2024-09-13T17:52:22.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.304+0000 7fdfc8e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc4148380 con 0x7fdfa8003b40 2024-09-13T17:52:22.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.304+0000 7fdfb9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfc414cf80 0x7fdfc40af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:22.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.304+0000 7fdfb9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfc414cf80 0x7fdfc40af460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49560/0 (socket says 172.21.15.114:49560) 2024-09-13T17:52:22.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.304+0000 7fdfb9400640 1 -- 172.21.15.114:0/3167554298 learned_addr learned my addr 172.21.15.114:0/3167554298 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:22.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.308+0000 7fdfc2800640 1 --2- 172.21.15.114:0/3167554298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfc415c220 0x7fdfc40af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:22.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.308+0000 7fdfc1e00640 1 --2- 172.21.15.114:0/3167554298 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa8003b40 0x7fdfc4147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:22.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.308+0000 7fdfb9400640 1 -- 172.21.15.114:0/3167554298 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa8003b40 msgr2=0x7fdfc4147e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:22.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.308+0000 7fdfb9400640 1 --2- 172.21.15.114:0/3167554298 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa8003b40 0x7fdfc4147e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:22.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.308+0000 7fdfb9400640 1 -- 172.21.15.114:0/3167554298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfc415c220 msgr2=0x7fdfc40af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:22.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.308+0000 7fdfb9400640 1 --2- 172.21.15.114:0/3167554298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfc415c220 0x7fdfc40af9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:22.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.308+0000 7fdfb9400640 1 -- 172.21.15.114:0/3167554298 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc415c7c0 con 0x7fdfc414cf80 2024-09-13T17:52:22.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.308+0000 7fdfb9400640 1 --2- 172.21.15.114:0/3167554298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfc414cf80 0x7fdfc40af460 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00e7b0 tx=0x7fdfac00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:22.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.308+0000 7fdfbaa00640 1 -- 172.21.15.114:0/3167554298 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac00ee60 con 0x7fdfc414cf80 2024-09-13T17:52:22.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.308+0000 7fdfbaa00640 1 -- 172.21.15.114:0/3167554298 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfac0052e0 con 0x7fdfc414cf80 2024-09-13T17:52:22.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.308+0000 7fdfbaa00640 1 -- 172.21.15.114:0/3167554298 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac00c900 con 0x7fdfc414cf80 2024-09-13T17:52:22.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.308+0000 7fdfc8e00640 1 -- 172.21.15.114:0/3167554298 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc415caa0 con 0x7fdfc414cf80 2024-09-13T17:52:22.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.308+0000 7fdfc8e00640 1 -- 172.21.15.114:0/3167554298 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc415d060 con 0x7fdfc414cf80 2024-09-13T17:52:22.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.308+0000 7fdfc8e00640 1 -- 172.21.15.114:0/3167554298 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc4149260 con 0x7fdfc414cf80 2024-09-13T17:52:22.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.308+0000 7fdfbaa00640 1 -- 172.21.15.114:0/3167554298 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdfac00ca60 con 0x7fdfc414cf80 2024-09-13T17:52:22.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.308+0000 7fdfbaa00640 1 --2- 172.21.15.114:0/3167554298 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdfa00666c0 0x7fdfa0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:22.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.308+0000 7fdfbaa00640 1 -- 172.21.15.114:0/3167554298 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdfac0840a0 con 0x7fdfc414cf80 2024-09-13T17:52:22.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.308+0000 7fdfc1e00640 1 --2- 172.21.15.114:0/3167554298 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdfa00666c0 0x7fdfa0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:22.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.312+0000 7fdfc1e00640 1 --2- 172.21.15.114:0/3167554298 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdfa00666c0 0x7fdfa0068b80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40af000 tx=0x7fdfb40046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:22.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.312+0000 7fdfbaa00640 1 -- 172.21.15.114:0/3167554298 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdfc4149260 con 0x7fdfc414cf80 2024-09-13T17:52:22.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.468+0000 7fdfc8e00640 1 -- 172.21.15.114:0/3167554298 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdfc4149260 con 0x7fdfc414cf80 2024-09-13T17:52:22.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.468+0000 7fdfbaa00640 1 -- 172.21.15.114:0/3167554298 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdfac051110 con 0x7fdfc414cf80 2024-09-13T17:52:22.470 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:52:22.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.468+0000 7fdfc8e00640 1 -- 172.21.15.114:0/3167554298 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdfa00666c0 msgr2=0x7fdfa0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:22.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.468+0000 7fdfc8e00640 1 --2- 172.21.15.114:0/3167554298 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdfa00666c0 0x7fdfa0068b80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40af000 tx=0x7fdfb40046d0 comp rx=0 tx=0).stop 2024-09-13T17:52:22.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.468+0000 7fdfc8e00640 1 -- 172.21.15.114:0/3167554298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfc414cf80 msgr2=0x7fdfc40af460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:22.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.468+0000 7fdfc8e00640 1 --2- 172.21.15.114:0/3167554298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfc414cf80 0x7fdfc40af460 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00e7b0 tx=0x7fdfac00ec70 comp rx=0 tx=0).stop 2024-09-13T17:52:22.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.468+0000 7fdfc8e00640 1 -- 172.21.15.114:0/3167554298 shutdown_connections 2024-09-13T17:52:22.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.468+0000 7fdfc8e00640 1 --2- 172.21.15.114:0/3167554298 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdfa00666c0 0x7fdfa0068b80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:22.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.468+0000 7fdfc8e00640 1 --2- 172.21.15.114:0/3167554298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdfc415c220 0x7fdfc40af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:22.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.468+0000 7fdfc8e00640 1 --2- 172.21.15.114:0/3167554298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdfc414cf80 0x7fdfc40af460 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:22.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.468+0000 7fdfc8e00640 1 --2- 172.21.15.114:0/3167554298 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdfa8003b40 0x7fdfc4147e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:22.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.468+0000 7fdfc8e00640 1 -- 172.21.15.114:0/3167554298 >> 172.21.15.114:0/3167554298 conn(0x7fdfc40660b0 msgr2=0x7fdfc415a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:22.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.468+0000 7fdfc8e00640 1 -- 172.21.15.114:0/3167554298 shutdown_connections 2024-09-13T17:52:22.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.468+0000 7fdfc8e00640 1 -- 172.21.15.114:0/3167554298 wait complete. 2024-09-13T17:52:22.491 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:52:22.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.624+0000 7f23fd400640 1 Processor -- start 2024-09-13T17:52:22.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.628+0000 7f23fd400640 1 -- start start 2024-09-13T17:52:22.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.628+0000 7f23fd400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23f81602e0 0x7f23f81606c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:22.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.628+0000 7f23fd400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f8160c00 con 0x7f23f80ce650 2024-09-13T17:52:22.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.628+0000 7f23fd400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f80cebe0 con 0x7f23f806e680 2024-09-13T17:52:22.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.628+0000 7f23fd400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f80ceec0 con 0x7f23f81602e0 2024-09-13T17:52:22.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.628+0000 7f23f5e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f23f80ce650 0x7f23f8099480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42486/0 (socket says 172.21.15.114:42486) 2024-09-13T17:52:22.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.628+0000 7f23f5e00640 1 -- 172.21.15.114:0/925786890 learned_addr learned my addr 172.21.15.114:0/925786890 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:22.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.628+0000 7f23f6800640 1 --2- 172.21.15.114:0/925786890 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23f81602e0 0x7f23f81606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:22.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.628+0000 7f23f5400640 1 -- 172.21.15.114:0/925786890 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3686665866 0 0) 0x7f23f8160c00 con 0x7f23f80ce650 2024-09-13T17:52:22.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.628+0000 7f23f5400640 1 -- 172.21.15.114:0/925786890 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23dc003530 con 0x7f23f80ce650 2024-09-13T17:52:22.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.628+0000 7f23f5400640 1 -- 172.21.15.114:0/925786890 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2108444262 0 0) 0x7f23f80cebe0 con 0x7f23f806e680 2024-09-13T17:52:22.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.628+0000 7f23f6800640 1 -- 172.21.15.114:0/925786890 >> v1:172.21.15.134:6789/0 conn(0x7f23f806e680 legacy=0x7f23f806eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:22.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.628+0000 7f23f6800640 1 -- 172.21.15.114:0/925786890 >> v1:172.21.15.114:6789/0 conn(0x7f23f80ce650 legacy=0x7f23f8099480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:22.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.628+0000 7f23f6800640 1 -- 172.21.15.114:0/925786890 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f80cf1a0 con 0x7f23f81602e0 2024-09-13T17:52:22.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.632+0000 7f23f6800640 1 --2- 172.21.15.114:0/925786890 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23f81602e0 0x7f23f81606c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f23e8009dc0 tx=0x7f23e801c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4579c04562ce183 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:22.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.632+0000 7f23f5400640 1 -- 172.21.15.114:0/925786890 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e80a59c0 con 0x7f23f81602e0 2024-09-13T17:52:22.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.632+0000 7f23f5400640 1 -- 172.21.15.114:0/925786890 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e80a5b20 con 0x7f23f81602e0 2024-09-13T17:52:22.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.632+0000 7f23f5400640 1 -- 172.21.15.114:0/925786890 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e80ad440 con 0x7f23f81602e0 2024-09-13T17:52:22.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.632+0000 7f23fd400640 1 -- 172.21.15.114:0/925786890 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23f81602e0 msgr2=0x7f23f81606c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:22.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.632+0000 7f23fd400640 1 --2- 172.21.15.114:0/925786890 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23f81602e0 0x7f23f81606c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f23e8009dc0 tx=0x7f23e801c900 comp rx=0 tx=0).stop 2024-09-13T17:52:22.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.632+0000 7f23fd400640 1 -- 172.21.15.114:0/925786890 shutdown_connections 2024-09-13T17:52:22.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.632+0000 7f23fd400640 1 --2- 172.21.15.114:0/925786890 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23f81602e0 0x7f23f81606c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:22.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.632+0000 7f23fd400640 1 -- 172.21.15.114:0/925786890 >> 172.21.15.114:0/925786890 conn(0x7f23f80d04e0 msgr2=0x7f23f80d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:22.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.632+0000 7f23fd400640 1 -- 172.21.15.114:0/925786890 shutdown_connections 2024-09-13T17:52:22.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.632+0000 7f23fd400640 1 -- 172.21.15.114:0/925786890 wait complete. 2024-09-13T17:52:22.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.632+0000 7f23fd400640 1 Processor -- start 2024-09-13T17:52:22.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.632+0000 7f23fd400640 1 -- start start 2024-09-13T17:52:22.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.636+0000 7f23fd400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23f806e680 0x7f23f8159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:22.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.636+0000 7f23fd400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23f80ce650 0x7f23f81588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:22.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.636+0000 7f23fd400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23f81602e0 0x7f23f806b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:22.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.636+0000 7f23fd400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f80b5350 con 0x7f23f806e680 2024-09-13T17:52:22.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.636+0000 7f23fd400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f815be70 con 0x7f23f80ce650 2024-09-13T17:52:22.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.636+0000 7f23fd400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f80b4740 con 0x7f23f81602e0 2024-09-13T17:52:22.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.636+0000 7f23f6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23f806e680 0x7f23f8159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:22.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.636+0000 7f23f6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23f806e680 0x7f23f8159190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49572/0 (socket says 172.21.15.114:49572) 2024-09-13T17:52:22.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.636+0000 7f23f6800640 1 -- 172.21.15.114:0/1650890627 learned_addr learned my addr 172.21.15.114:0/1650890627 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:22.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.636+0000 7f23f5e00640 1 --2- 172.21.15.114:0/1650890627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23f80ce650 0x7f23f81588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:22.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.636+0000 7f23f7200640 1 --2- 172.21.15.114:0/1650890627 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23f81602e0 0x7f23f806b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:22.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.636+0000 7f23f6800640 1 -- 172.21.15.114:0/1650890627 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23f81602e0 msgr2=0x7f23f806b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:22.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.636+0000 7f23f6800640 1 --2- 172.21.15.114:0/1650890627 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23f81602e0 0x7f23f806b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:22.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.636+0000 7f23f6800640 1 -- 172.21.15.114:0/1650890627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23f80ce650 msgr2=0x7f23f81588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:22.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.636+0000 7f23f6800640 1 --2- 172.21.15.114:0/1650890627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23f80ce650 0x7f23f81588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:22.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.636+0000 7f23f6800640 1 -- 172.21.15.114:0/1650890627 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e8009a70 con 0x7f23f806e680 2024-09-13T17:52:22.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.636+0000 7f23f6800640 1 --2- 172.21.15.114:0/1650890627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23f806e680 0x7f23f8159190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f23e801a530 tx=0x7f23e80196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:22.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.636+0000 7f23eea00640 1 -- 172.21.15.114:0/1650890627 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e80add50 con 0x7f23f806e680 2024-09-13T17:52:22.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.636+0000 7f23eea00640 1 -- 172.21.15.114:0/1650890627 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e8009450 con 0x7f23f806e680 2024-09-13T17:52:22.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.636+0000 7f23eea00640 1 -- 172.21.15.114:0/1650890627 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e80b7650 con 0x7f23f806e680 2024-09-13T17:52:22.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.636+0000 7f23fd400640 1 -- 172.21.15.114:0/1650890627 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f80b4a20 con 0x7f23f806e680 2024-09-13T17:52:22.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.636+0000 7f23fd400640 1 -- 172.21.15.114:0/1650890627 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f80b4fe0 con 0x7f23f806e680 2024-09-13T17:52:22.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.636+0000 7f23fd400640 1 -- 172.21.15.114:0/1650890627 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f81606c0 con 0x7f23f806e680 2024-09-13T17:52:22.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.636+0000 7f23eea00640 1 -- 172.21.15.114:0/1650890627 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f23e80b4050 con 0x7f23f806e680 2024-09-13T17:52:22.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.640+0000 7f23eea00640 1 --2- 172.21.15.114:0/1650890627 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f23d8066690 0x7f23d8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:22.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.640+0000 7f23eea00640 1 -- 172.21.15.114:0/1650890627 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f23e811f6a0 con 0x7f23f806e680 2024-09-13T17:52:22.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.640+0000 7f23f5e00640 1 --2- 172.21.15.114:0/1650890627 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f23d8066690 0x7f23d8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:22.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.640+0000 7f23f5e00640 1 --2- 172.21.15.114:0/1650890627 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f23d8066690 0x7f23d8068b50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f23f809e620 tx=0x7f23e4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:22.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.644+0000 7f23eea00640 1 -- 172.21.15.114:0/1650890627 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f23e80ec7b0 con 0x7f23f806e680 2024-09-13T17:52:22.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.796+0000 7f23fd400640 1 -- 172.21.15.114:0/1650890627 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f23f80d1380 con 0x7f23f806e680 2024-09-13T17:52:22.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.796+0000 7f23eea00640 1 -- 172.21.15.114:0/1650890627 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f23e80b2020 con 0x7f23f806e680 2024-09-13T17:52:22.799 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-09-13T17:52:22.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.796+0000 7f23fd400640 1 -- 172.21.15.114:0/1650890627 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f23d8066690 msgr2=0x7f23d8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:22.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.796+0000 7f23fd400640 1 --2- 172.21.15.114:0/1650890627 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f23d8066690 0x7f23d8068b50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f23f809e620 tx=0x7f23e4009040 comp rx=0 tx=0).stop 2024-09-13T17:52:22.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.796+0000 7f23fd400640 1 -- 172.21.15.114:0/1650890627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23f806e680 msgr2=0x7f23f8159190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:22.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.796+0000 7f23fd400640 1 --2- 172.21.15.114:0/1650890627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23f806e680 0x7f23f8159190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f23e801a530 tx=0x7f23e80196a0 comp rx=0 tx=0).stop 2024-09-13T17:52:22.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.796+0000 7f23fd400640 1 -- 172.21.15.114:0/1650890627 shutdown_connections 2024-09-13T17:52:22.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.796+0000 7f23fd400640 1 --2- 172.21.15.114:0/1650890627 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f23d8066690 0x7f23d8068b50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:22.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.796+0000 7f23fd400640 1 --2- 172.21.15.114:0/1650890627 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f23f81602e0 0x7f23f806b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:22.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.796+0000 7f23fd400640 1 --2- 172.21.15.114:0/1650890627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23f80ce650 0x7f23f81588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:22.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.796+0000 7f23fd400640 1 --2- 172.21.15.114:0/1650890627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23f806e680 0x7f23f8159190 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:22.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.796+0000 7f23fd400640 1 -- 172.21.15.114:0/1650890627 >> 172.21.15.114:0/1650890627 conn(0x7f23f80d04e0 msgr2=0x7f23f806eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:22.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.796+0000 7f23fd400640 1 -- 172.21.15.114:0/1650890627 shutdown_connections 2024-09-13T17:52:22.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.796+0000 7f23fd400640 1 -- 172.21.15.114:0/1650890627 wait complete. 2024-09-13T17:52:22.819 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:52:22.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.952+0000 7f9e21a00640 1 Processor -- start 2024-09-13T17:52:22.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.952+0000 7f9e21a00640 1 -- start start 2024-09-13T17:52:22.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.956+0000 7f9e21a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9e1c156c30 0x7f9e1c06d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:22.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.956+0000 7f9e21a00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9e1c15d770 0x7f9e1c0ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:22.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.956+0000 7f9e21a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e1c0ac220 con 0x7f9e1c0abe20 2024-09-13T17:52:22.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.956+0000 7f9e21a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e1c157010 con 0x7f9e1c156c30 2024-09-13T17:52:22.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.956+0000 7f9e21a00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e1c06e320 con 0x7f9e1c15d770 2024-09-13T17:52:22.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.956+0000 7f9e1aa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9e1c156c30 0x7f9e1c06d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:22.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.956+0000 7f9e1aa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9e1c156c30 0x7f9e1c06d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49582/0 (socket says 172.21.15.114:49582) 2024-09-13T17:52:22.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.956+0000 7f9e1aa00640 1 -- 172.21.15.114:0/3925798988 learned_addr learned my addr 172.21.15.114:0/3925798988 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:22.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.956+0000 7f9e1a000640 1 --2- 172.21.15.114:0/3925798988 >> v2:172.21.15.134:3300/0 conn(0x7f9e1c15d770 0x7f9e1c0ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:22.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.956+0000 7f9e1aa00640 1 -- 172.21.15.114:0/3925798988 >> v2:172.21.15.134:3300/0 conn(0x7f9e1c15d770 msgr2=0x7f9e1c0ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:22.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.956+0000 7f9e1aa00640 1 --2- 172.21.15.114:0/3925798988 >> v2:172.21.15.134:3300/0 conn(0x7f9e1c15d770 0x7f9e1c0ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:22.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.956+0000 7f9e1aa00640 1 -- 172.21.15.114:0/3925798988 >> v1:172.21.15.114:6789/0 conn(0x7f9e1c0abe20 legacy=0x7f9e1c0ad1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:22.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.956+0000 7f9e1aa00640 1 -- 172.21.15.114:0/3925798988 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e1c06e600 con 0x7f9e1c156c30 2024-09-13T17:52:22.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.960+0000 7f9e1aa00640 1 --2- 172.21.15.114:0/3925798988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e1c156c30 0x7f9e1c06d9f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c067950 tx=0x7f9e0c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a7c9530a8600ce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:22.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.960+0000 7f9e19600640 1 -- 172.21.15.114:0/3925798988 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c0a5880 con 0x7f9e1c156c30 2024-09-13T17:52:22.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.960+0000 7f9e19600640 1 -- 172.21.15.114:0/3925798988 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0c0a59e0 con 0x7f9e1c156c30 2024-09-13T17:52:22.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.960+0000 7f9e19600640 1 -- 172.21.15.114:0/3925798988 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c0a5d70 con 0x7f9e1c156c30 2024-09-13T17:52:22.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.960+0000 7f9e21a00640 1 -- 172.21.15.114:0/3925798988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e1c156c30 msgr2=0x7f9e1c06d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:22.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.960+0000 7f9e21a00640 1 --2- 172.21.15.114:0/3925798988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e1c156c30 0x7f9e1c06d9f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c067950 tx=0x7f9e0c01c9c0 comp rx=0 tx=0).stop 2024-09-13T17:52:22.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.960+0000 7f9e21a00640 1 -- 172.21.15.114:0/3925798988 shutdown_connections 2024-09-13T17:52:22.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.960+0000 7f9e21a00640 1 --2- 172.21.15.114:0/3925798988 >> v2:172.21.15.134:3300/0 conn(0x7f9e1c15d770 0x7f9e1c0ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:22.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.960+0000 7f9e21a00640 1 --2- 172.21.15.114:0/3925798988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e1c156c30 0x7f9e1c06d9f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:22.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.960+0000 7f9e21a00640 1 -- 172.21.15.114:0/3925798988 >> 172.21.15.114:0/3925798988 conn(0x7f9e1c069f80 msgr2=0x7f9e1c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:22.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.960+0000 7f9e21a00640 1 -- 172.21.15.114:0/3925798988 shutdown_connections 2024-09-13T17:52:22.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.960+0000 7f9e21a00640 1 -- 172.21.15.114:0/3925798988 wait complete. 2024-09-13T17:52:22.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.960+0000 7f9e21a00640 1 Processor -- start 2024-09-13T17:52:22.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.960+0000 7f9e21a00640 1 -- start start 2024-09-13T17:52:22.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.960+0000 7f9e21a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e1c0abe20 0x7f9e1c147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:22.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.960+0000 7f9e21a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9e1c156c30 0x7f9e1c15c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:22.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.960+0000 7f9e21a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e1c15d770 0x7f9e1c14db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:22.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.960+0000 7f9e21a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c147500 con 0x7f9e1c0abe20 2024-09-13T17:52:22.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.960+0000 7f9e21a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c15c800 con 0x7f9e1c15d770 2024-09-13T17:52:22.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.960+0000 7f9e21a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c15a570 con 0x7f9e1c156c30 2024-09-13T17:52:22.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.960+0000 7f9e1aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e1c0abe20 0x7f9e1c147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:22.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.960+0000 7f9e1aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e1c0abe20 0x7f9e1c147990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49590/0 (socket says 172.21.15.114:49590) 2024-09-13T17:52:22.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.960+0000 7f9e1aa00640 1 -- 172.21.15.114:0/382797764 learned_addr learned my addr 172.21.15.114:0/382797764 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:22.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.964+0000 7f9e1a000640 1 --2- 172.21.15.114:0/382797764 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9e1c156c30 0x7f9e1c15c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:22.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.964+0000 7f9e1b400640 1 --2- 172.21.15.114:0/382797764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e1c15d770 0x7f9e1c14db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:22.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.964+0000 7f9e1aa00640 1 -- 172.21.15.114:0/382797764 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9e1c156c30 msgr2=0x7f9e1c15c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:22.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.964+0000 7f9e1aa00640 1 --2- 172.21.15.114:0/382797764 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9e1c156c30 0x7f9e1c15c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:22.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.964+0000 7f9e1aa00640 1 -- 172.21.15.114:0/382797764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e1c15d770 msgr2=0x7f9e1c14db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:22.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.964+0000 7f9e1aa00640 1 --2- 172.21.15.114:0/382797764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e1c15d770 0x7f9e1c14db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:22.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.964+0000 7f9e1aa00640 1 -- 172.21.15.114:0/382797764 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c009b30 con 0x7f9e1c0abe20 2024-09-13T17:52:22.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.964+0000 7f9e1aa00640 1 --2- 172.21.15.114:0/382797764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e1c0abe20 0x7f9e1c147990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c0195d0 tx=0x7f9e0c019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:22.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.964+0000 7f9e12a00640 1 -- 172.21.15.114:0/382797764 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c0b8670 con 0x7f9e1c0abe20 2024-09-13T17:52:22.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.964+0000 7f9e12a00640 1 -- 172.21.15.114:0/382797764 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0c0b8810 con 0x7f9e1c0abe20 2024-09-13T17:52:22.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.964+0000 7f9e21a00640 1 -- 172.21.15.114:0/382797764 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e1c15a850 con 0x7f9e1c0abe20 2024-09-13T17:52:22.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.964+0000 7f9e12a00640 1 -- 172.21.15.114:0/382797764 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c0b8bc0 con 0x7f9e1c0abe20 2024-09-13T17:52:22.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.964+0000 7f9e21a00640 1 -- 172.21.15.114:0/382797764 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e1c14e0d0 con 0x7f9e1c0abe20 2024-09-13T17:52:22.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.964+0000 7f9e21a00640 1 -- 172.21.15.114:0/382797764 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e1c06d9f0 con 0x7f9e1c0abe20 2024-09-13T17:52:22.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.964+0000 7f9e12a00640 1 -- 172.21.15.114:0/382797764 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9e0c0b8d20 con 0x7f9e1c0abe20 2024-09-13T17:52:22.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.964+0000 7f9e12a00640 1 --2- 172.21.15.114:0/382797764 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9dfc0666c0 0x7f9dfc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:22.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.964+0000 7f9e12a00640 1 -- 172.21.15.114:0/382797764 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9e0c11faf0 con 0x7f9e1c0abe20 2024-09-13T17:52:22.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.964+0000 7f9e1a000640 1 --2- 172.21.15.114:0/382797764 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9dfc0666c0 0x7f9dfc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:22.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.968+0000 7f9e1a000640 1 --2- 172.21.15.114:0/382797764 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9dfc0666c0 0x7f9dfc068b80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c14f430 tx=0x7f9e08008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:22.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:22.968+0000 7f9e12a00640 1 -- 172.21.15.114:0/382797764 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9e0c0ecc10 con 0x7f9e1c0abe20 2024-09-13T17:52:23.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.124+0000 7f9e21a00640 1 -- 172.21.15.114:0/382797764 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9e1c0afde0 con 0x7f9e1c0abe20 2024-09-13T17:52:23.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.124+0000 7f9e12a00640 1 -- 172.21.15.114:0/382797764 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9e0c0f0230 con 0x7f9e1c0abe20 2024-09-13T17:52:23.129 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:52:23.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.128+0000 7f9e21a00640 1 -- 172.21.15.114:0/382797764 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9dfc0666c0 msgr2=0x7f9dfc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:23.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.128+0000 7f9e21a00640 1 --2- 172.21.15.114:0/382797764 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9dfc0666c0 0x7f9dfc068b80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c14f430 tx=0x7f9e08008040 comp rx=0 tx=0).stop 2024-09-13T17:52:23.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.128+0000 7f9e21a00640 1 -- 172.21.15.114:0/382797764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e1c0abe20 msgr2=0x7f9e1c147990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:23.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.128+0000 7f9e21a00640 1 --2- 172.21.15.114:0/382797764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e1c0abe20 0x7f9e1c147990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c0195d0 tx=0x7f9e0c019760 comp rx=0 tx=0).stop 2024-09-13T17:52:23.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.128+0000 7f9e21a00640 1 -- 172.21.15.114:0/382797764 shutdown_connections 2024-09-13T17:52:23.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.128+0000 7f9e21a00640 1 --2- 172.21.15.114:0/382797764 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9dfc0666c0 0x7f9dfc068b80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:23.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.128+0000 7f9e21a00640 1 --2- 172.21.15.114:0/382797764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e1c15d770 0x7f9e1c14db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:23.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.128+0000 7f9e21a00640 1 --2- 172.21.15.114:0/382797764 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9e1c156c30 0x7f9e1c15c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:23.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.128+0000 7f9e21a00640 1 --2- 172.21.15.114:0/382797764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e1c0abe20 0x7f9e1c147990 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:23.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.128+0000 7f9e21a00640 1 -- 172.21.15.114:0/382797764 >> 172.21.15.114:0/382797764 conn(0x7f9e1c069f80 msgr2=0x7f9e1c15dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:23.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.128+0000 7f9e21a00640 1 -- 172.21.15.114:0/382797764 shutdown_connections 2024-09-13T17:52:23.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.128+0000 7f9e21a00640 1 -- 172.21.15.114:0/382797764 wait complete. 2024-09-13T17:52:23.149 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:52:23.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.280+0000 7ff6a2000640 1 Processor -- start 2024-09-13T17:52:23.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.280+0000 7ff6a2000640 1 -- start start 2024-09-13T17:52:23.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.280+0000 7ff6a2000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff69c099180 0x7ff69c1642d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:23.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.280+0000 7ff6a2000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff69c0b5110 0x7ff69c166820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:23.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.280+0000 7ff6a2000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff69c15dcc0 con 0x7ff69c15c7b0 2024-09-13T17:52:23.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.280+0000 7ff6a2000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff69c0b3c20 con 0x7ff69c0b5110 2024-09-13T17:52:23.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.280+0000 7ff6a2000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff69c06fbc0 con 0x7ff69c099180 2024-09-13T17:52:23.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.280+0000 7ff69be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff69c0b5110 0x7ff69c166820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:23.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.280+0000 7ff69be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff69c0b5110 0x7ff69c166820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49606/0 (socket says 172.21.15.114:49606) 2024-09-13T17:52:23.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.280+0000 7ff69be00640 1 -- 172.21.15.114:0/2265900768 learned_addr learned my addr 172.21.15.114:0/2265900768 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:23.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.280+0000 7ff69aa00640 1 --2- 172.21.15.114:0/2265900768 >> v2:172.21.15.134:3300/0 conn(0x7ff69c099180 0x7ff69c1642d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:23.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.284+0000 7ff69be00640 1 -- 172.21.15.114:0/2265900768 >> v2:172.21.15.134:3300/0 conn(0x7ff69c099180 msgr2=0x7ff69c1642d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:23.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.284+0000 7ff69be00640 1 --2- 172.21.15.114:0/2265900768 >> v2:172.21.15.134:3300/0 conn(0x7ff69c099180 0x7ff69c1642d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:23.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.284+0000 7ff69be00640 1 -- 172.21.15.114:0/2265900768 >> v1:172.21.15.114:6789/0 conn(0x7ff69c15c7b0 legacy=0x7ff69c098a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:23.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.284+0000 7ff69be00640 1 -- 172.21.15.114:0/2265900768 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c15d160 con 0x7ff69c0b5110 2024-09-13T17:52:23.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.284+0000 7ff69be00640 1 --2- 172.21.15.114:0/2265900768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff69c0b5110 0x7ff69c166820 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff69c099ba0 tx=0x7ff69401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6081870c30536a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:23.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.284+0000 7ff69a000640 1 -- 172.21.15.114:0/2265900768 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6940a57f0 con 0x7ff69c0b5110 2024-09-13T17:52:23.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.284+0000 7ff69a000640 1 -- 172.21.15.114:0/2265900768 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6940a5950 con 0x7ff69c0b5110 2024-09-13T17:52:23.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.284+0000 7ff69a000640 1 -- 172.21.15.114:0/2265900768 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6940a5ce0 con 0x7ff69c0b5110 2024-09-13T17:52:23.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.284+0000 7ff6a2000640 1 -- 172.21.15.114:0/2265900768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff69c0b5110 msgr2=0x7ff69c166820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:23.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.284+0000 7ff6a2000640 1 --2- 172.21.15.114:0/2265900768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff69c0b5110 0x7ff69c166820 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff69c099ba0 tx=0x7ff69401c930 comp rx=0 tx=0).stop 2024-09-13T17:52:23.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.284+0000 7ff6a2000640 1 -- 172.21.15.114:0/2265900768 shutdown_connections 2024-09-13T17:52:23.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.284+0000 7ff6a2000640 1 --2- 172.21.15.114:0/2265900768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff69c0b5110 0x7ff69c166820 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:23.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.284+0000 7ff6a2000640 1 --2- 172.21.15.114:0/2265900768 >> v2:172.21.15.134:3300/0 conn(0x7ff69c099180 0x7ff69c1642d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:23.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.284+0000 7ff6a2000640 1 -- 172.21.15.114:0/2265900768 >> 172.21.15.114:0/2265900768 conn(0x7ff69c0b2080 msgr2=0x7ff69c0b2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:23.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.288+0000 7ff6a2000640 1 -- 172.21.15.114:0/2265900768 shutdown_connections 2024-09-13T17:52:23.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.288+0000 7ff6a2000640 1 -- 172.21.15.114:0/2265900768 wait complete. 2024-09-13T17:52:23.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.288+0000 7ff6a2000640 1 Processor -- start 2024-09-13T17:52:23.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.288+0000 7ff6a2000640 1 -- start start 2024-09-13T17:52:23.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.288+0000 7ff6a2000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff69c099180 0x7ff69c14e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:23.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.288+0000 7ff6a2000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff69c0b5110 0x7ff69c15b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:23.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.288+0000 7ff6a2000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff69c15c7b0 0x7ff69c15a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:23.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.288+0000 7ff6a2000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c14e610 con 0x7ff69c15c7b0 2024-09-13T17:52:23.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.288+0000 7ff6a2000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c147dc0 con 0x7ff69c099180 2024-09-13T17:52:23.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.288+0000 7ff6a2000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c15b400 con 0x7ff69c0b5110 2024-09-13T17:52:23.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.288+0000 7ff69be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff69c15c7b0 0x7ff69c15a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:23.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.288+0000 7ff69be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff69c15c7b0 0x7ff69c15a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49622/0 (socket says 172.21.15.114:49622) 2024-09-13T17:52:23.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.288+0000 7ff69be00640 1 -- 172.21.15.114:0/715071906 learned_addr learned my addr 172.21.15.114:0/715071906 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:23.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.288+0000 7ff69b400640 1 --2- 172.21.15.114:0/715071906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff69c099180 0x7ff69c14e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:23.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.288+0000 7ff69aa00640 1 --2- 172.21.15.114:0/715071906 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff69c0b5110 0x7ff69c15b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:23.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.288+0000 7ff69be00640 1 -- 172.21.15.114:0/715071906 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff69c0b5110 msgr2=0x7ff69c15b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:23.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.288+0000 7ff69be00640 1 --2- 172.21.15.114:0/715071906 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff69c0b5110 0x7ff69c15b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:23.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.288+0000 7ff69be00640 1 -- 172.21.15.114:0/715071906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff69c099180 msgr2=0x7ff69c14e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:23.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.288+0000 7ff69be00640 1 --2- 172.21.15.114:0/715071906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff69c099180 0x7ff69c14e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:23.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.288+0000 7ff69be00640 1 -- 172.21.15.114:0/715071906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff694009b30 con 0x7ff69c15c7b0 2024-09-13T17:52:23.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.288+0000 7ff69aa00640 1 --2- 172.21.15.114:0/715071906 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff69c0b5110 0x7ff69c15b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:23.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.288+0000 7ff69be00640 1 --2- 172.21.15.114:0/715071906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff69c15c7b0 0x7ff69c15a0f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff6940af040 tx=0x7ff6940196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:23.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.288+0000 7ff693400640 1 -- 172.21.15.114:0/715071906 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6940b8670 con 0x7ff69c15c7b0 2024-09-13T17:52:23.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.288+0000 7ff693400640 1 -- 172.21.15.114:0/715071906 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6940b87d0 con 0x7ff69c15c7b0 2024-09-13T17:52:23.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.288+0000 7ff6a2000640 1 -- 172.21.15.114:0/715071906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff69c14ee40 con 0x7ff69c15c7b0 2024-09-13T17:52:23.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.288+0000 7ff693400640 1 -- 172.21.15.114:0/715071906 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6940b8b80 con 0x7ff69c15c7b0 2024-09-13T17:52:23.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.292+0000 7ff6a2000640 1 -- 172.21.15.114:0/715071906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff69c15b120 con 0x7ff69c15c7b0 2024-09-13T17:52:23.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.292+0000 7ff6a2000640 1 -- 172.21.15.114:0/715071906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff69c14efd0 con 0x7ff69c15c7b0 2024-09-13T17:52:23.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.292+0000 7ff693400640 1 -- 172.21.15.114:0/715071906 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff6940b8ce0 con 0x7ff69c15c7b0 2024-09-13T17:52:23.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.292+0000 7ff693400640 1 --2- 172.21.15.114:0/715071906 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff67c066690 0x7ff67c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:23.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.292+0000 7ff693400640 1 -- 172.21.15.114:0/715071906 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff69411fa80 con 0x7ff69c15c7b0 2024-09-13T17:52:23.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.292+0000 7ff69b400640 1 --2- 172.21.15.114:0/715071906 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff67c066690 0x7ff67c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:23.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.292+0000 7ff69b400640 1 --2- 172.21.15.114:0/715071906 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff67c066690 0x7ff67c068b50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff68c007fd0 tx=0x7ff68c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:23.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.296+0000 7ff693400640 1 -- 172.21.15.114:0/715071906 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff6940ecc40 con 0x7ff69c15c7b0 2024-09-13T17:52:23.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.484+0000 7ff6a2000640 1 -- 172.21.15.114:0/715071906 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff69c098a70 con 0x7ff69c15c7b0 2024-09-13T17:52:23.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.484+0000 7ff693400640 1 -- 172.21.15.114:0/715071906 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4739 (secure 0 0 0) 0x7ff6940f0260 con 0x7ff69c15c7b0 2024-09-13T17:52:23.486 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:23.487 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/534634081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":534634081},{"type":"v1","addr":"172.21.15.134:6835","nonce":534634081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1773366615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1773366615},{"type":"v1","addr":"172.21.15.114:6836","nonce":1773366615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4122490085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":4122490085},{"type":"v1","addr":"172.21.15.114:6837","nonce":4122490085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:51:49.789079+0000","modified":"2024-09-13T17:52:13.041461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/1863104078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1863104078},{"type":"v1","addr":"172.21.15.134:6834","nonce":1863104078}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:52:23.487 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 9 2024-09-13T17:52:23.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.484+0000 7ff6a2000640 1 -- 172.21.15.114:0/715071906 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff67c066690 msgr2=0x7ff67c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:23.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.484+0000 7ff6a2000640 1 --2- 172.21.15.114:0/715071906 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff67c066690 0x7ff67c068b50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff68c007fd0 tx=0x7ff68c009040 comp rx=0 tx=0).stop 2024-09-13T17:52:23.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.484+0000 7ff6a2000640 1 -- 172.21.15.114:0/715071906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff69c15c7b0 msgr2=0x7ff69c15a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:23.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.484+0000 7ff6a2000640 1 --2- 172.21.15.114:0/715071906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff69c15c7b0 0x7ff69c15a0f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff6940af040 tx=0x7ff6940196d0 comp rx=0 tx=0).stop 2024-09-13T17:52:23.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.484+0000 7ff6a2000640 1 -- 172.21.15.114:0/715071906 shutdown_connections 2024-09-13T17:52:23.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.484+0000 7ff6a2000640 1 --2- 172.21.15.114:0/715071906 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff67c066690 0x7ff67c068b50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:23.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.484+0000 7ff6a2000640 1 --2- 172.21.15.114:0/715071906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff69c15c7b0 0x7ff69c15a0f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:23.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.484+0000 7ff6a2000640 1 --2- 172.21.15.114:0/715071906 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff69c0b5110 0x7ff69c15b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:23.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.484+0000 7ff6a2000640 1 --2- 172.21.15.114:0/715071906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff69c099180 0x7ff69c14e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:23.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.484+0000 7ff6a2000640 1 -- 172.21.15.114:0/715071906 >> 172.21.15.114:0/715071906 conn(0x7ff69c0b2080 msgr2=0x7ff69c0d04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:23.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.484+0000 7ff6a2000640 1 -- 172.21.15.114:0/715071906 shutdown_connections 2024-09-13T17:52:23.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.484+0000 7ff6a2000640 1 -- 172.21.15.114:0/715071906 wait complete. 2024-09-13T17:52:23.507 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:52:23.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.640+0000 7efea6600640 1 Processor -- start 2024-09-13T17:52:23.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.640+0000 7efea6600640 1 -- start start 2024-09-13T17:52:23.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.640+0000 7efea6600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efea015a4a0 0x7efea00ce230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:23.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.640+0000 7efea6600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efea00cbdb0 0x7efea00cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:23.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.640+0000 7efea6600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea0099d70 con 0x7efea00ce770 2024-09-13T17:52:23.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.640+0000 7efea6600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea00997b0 con 0x7efea00cbdb0 2024-09-13T17:52:23.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.640+0000 7efea6600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea0099a90 con 0x7efea015a4a0 2024-09-13T17:52:23.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.640+0000 7efea5c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efea00cbdb0 0x7efea00cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:23.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.640+0000 7efea5c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efea00cbdb0 0x7efea00cebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49634/0 (socket says 172.21.15.114:49634) 2024-09-13T17:52:23.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.640+0000 7efea5c00640 1 -- 172.21.15.114:0/1645249767 learned_addr learned my addr 172.21.15.114:0/1645249767 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:23.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.640+0000 7efea5200640 1 --2- 172.21.15.114:0/1645249767 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efea015a4a0 0x7efea00ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:23.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.640+0000 7efea5c00640 1 -- 172.21.15.114:0/1645249767 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efea015a4a0 msgr2=0x7efea00ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:23.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.640+0000 7efea5c00640 1 --2- 172.21.15.114:0/1645249767 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efea015a4a0 0x7efea00ce230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:23.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.640+0000 7efea5c00640 1 -- 172.21.15.114:0/1645249767 >> v1:172.21.15.134:6789/0 conn(0x7efea00ce770 legacy=0x7efea00b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:23.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.640+0000 7efea5c00640 1 -- 172.21.15.114:0/1645249767 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea00b32a0 con 0x7efea00cbdb0 2024-09-13T17:52:23.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.644+0000 7efea5c00640 1 --2- 172.21.15.114:0/1645249767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efea00cbdb0 0x7efea00cebd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efe98009e50 tx=0x7efe9801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d755f51f3c3712 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:23.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.644+0000 7efe9fe00640 1 -- 172.21.15.114:0/1645249767 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe980a5700 con 0x7efea00cbdb0 2024-09-13T17:52:23.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.644+0000 7efe9fe00640 1 -- 172.21.15.114:0/1645249767 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe980a5860 con 0x7efea00cbdb0 2024-09-13T17:52:23.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.644+0000 7efe9fe00640 1 -- 172.21.15.114:0/1645249767 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe980a5bf0 con 0x7efea00cbdb0 2024-09-13T17:52:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.644+0000 7efea6600640 1 -- 172.21.15.114:0/1645249767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efea00cbdb0 msgr2=0x7efea00cebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.644+0000 7efea6600640 1 --2- 172.21.15.114:0/1645249767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efea00cbdb0 0x7efea00cebd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efe98009e50 tx=0x7efe9801ca30 comp rx=0 tx=0).stop 2024-09-13T17:52:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.644+0000 7efea6600640 1 -- 172.21.15.114:0/1645249767 shutdown_connections 2024-09-13T17:52:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.644+0000 7efea6600640 1 --2- 172.21.15.114:0/1645249767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efea00cbdb0 0x7efea00cebd0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.644+0000 7efea6600640 1 --2- 172.21.15.114:0/1645249767 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efea015a4a0 0x7efea00ce230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.644+0000 7efea6600640 1 -- 172.21.15.114:0/1645249767 >> 172.21.15.114:0/1645249767 conn(0x7efea00d0330 msgr2=0x7efea00d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.644+0000 7efea6600640 1 -- 172.21.15.114:0/1645249767 shutdown_connections 2024-09-13T17:52:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.644+0000 7efea6600640 1 -- 172.21.15.114:0/1645249767 wait complete. 2024-09-13T17:52:23.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.648+0000 7efea6600640 1 Processor -- start 2024-09-13T17:52:23.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.648+0000 7efea6600640 1 -- start start 2024-09-13T17:52:23.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.648+0000 7efea6600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efea00cbdb0 0x7efea0150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:23.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.648+0000 7efea6600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efea00ce770 0x7efea014db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.648+0000 7efea6600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efea015a4a0 0x7efea014e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.648+0000 7efea6600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea00ca610 con 0x7efea00cbdb0 2024-09-13T17:52:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.648+0000 7efea6600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea00c9a00 con 0x7efea00ce770 2024-09-13T17:52:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.648+0000 7efea6600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea00c9ce0 con 0x7efea015a4a0 2024-09-13T17:52:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.648+0000 7efea5200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efea00cbdb0 0x7efea0150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.648+0000 7efea5200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efea00cbdb0 0x7efea0150460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49636/0 (socket says 172.21.15.114:49636) 2024-09-13T17:52:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.648+0000 7efea5200640 1 -- 172.21.15.114:0/3140628602 learned_addr learned my addr 172.21.15.114:0/3140628602 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.648+0000 7efe97e00640 1 --2- 172.21.15.114:0/3140628602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efea00ce770 0x7efea014db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.648+0000 7efea5c00640 1 --2- 172.21.15.114:0/3140628602 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efea015a4a0 0x7efea014e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.648+0000 7efea5200640 1 -- 172.21.15.114:0/3140628602 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efea015a4a0 msgr2=0x7efea014e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.648+0000 7efea5200640 1 --2- 172.21.15.114:0/3140628602 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efea015a4a0 0x7efea014e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.648+0000 7efea5200640 1 -- 172.21.15.114:0/3140628602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efea00ce770 msgr2=0x7efea014db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.648+0000 7efea5200640 1 --2- 172.21.15.114:0/3140628602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efea00ce770 0x7efea014db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.648+0000 7efea5200640 1 -- 172.21.15.114:0/3140628602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe98009b30 con 0x7efea00cbdb0 2024-09-13T17:52:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.648+0000 7efea5200640 1 --2- 172.21.15.114:0/3140628602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efea00cbdb0 0x7efea0150460 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efe9000e930 tx=0x7efe9000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.648+0000 7efe9d600640 1 -- 172.21.15.114:0/3140628602 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe90009690 con 0x7efea00cbdb0 2024-09-13T17:52:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.648+0000 7efe9d600640 1 -- 172.21.15.114:0/3140628602 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9000ca00 con 0x7efea00cbdb0 2024-09-13T17:52:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.648+0000 7efe9d600640 1 -- 172.21.15.114:0/3140628602 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9000cd70 con 0x7efea00cbdb0 2024-09-13T17:52:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.648+0000 7efea6600640 1 -- 172.21.15.114:0/3140628602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea00c9fc0 con 0x7efea00cbdb0 2024-09-13T17:52:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.648+0000 7efea6600640 1 -- 172.21.15.114:0/3140628602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea01509a0 con 0x7efea00cbdb0 2024-09-13T17:52:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.652+0000 7efea6600640 1 -- 172.21.15.114:0/3140628602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efea00cfad0 con 0x7efea00cbdb0 2024-09-13T17:52:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.652+0000 7efe9d600640 1 -- 172.21.15.114:0/3140628602 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efe90013470 con 0x7efea00cbdb0 2024-09-13T17:52:23.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.652+0000 7efe9d600640 1 --2- 172.21.15.114:0/3140628602 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7efe7c066690 0x7efe7c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:23.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.652+0000 7efe9d600640 1 -- 172.21.15.114:0/3140628602 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efe90084720 con 0x7efea00cbdb0 2024-09-13T17:52:23.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.652+0000 7efe97e00640 1 --2- 172.21.15.114:0/3140628602 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7efe7c066690 0x7efe7c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:23.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.652+0000 7efe97e00640 1 --2- 172.21.15.114:0/3140628602 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7efe7c066690 0x7efe7c068b50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efea0153280 tx=0x7efe88009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:23.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.656+0000 7efe9d600640 1 -- 172.21.15.114:0/3140628602 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efe90051870 con 0x7efea00cbdb0 2024-09-13T17:52:23.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.812+0000 7efea6600640 1 -- 172.21.15.114:0/3140628602 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efea00cebd0 con 0x7efea00cbdb0 2024-09-13T17:52:23.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.812+0000 7efe9d600640 1 -- 172.21.15.114:0/3140628602 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18394 (secure 0 0 0) 0x7efe90054e90 con 0x7efea00cbdb0 2024-09-13T17:52:23.816 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:23.816 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":24,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:51:54.213439+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:51:48.278220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:51:48.773888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:51:51.856300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:52:23.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.816+0000 7efea6600640 1 -- 172.21.15.114:0/3140628602 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7efe7c066690 msgr2=0x7efe7c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:23.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.816+0000 7efea6600640 1 --2- 172.21.15.114:0/3140628602 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7efe7c066690 0x7efe7c068b50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efea0153280 tx=0x7efe88009040 comp rx=0 tx=0).stop 2024-09-13T17:52:23.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.816+0000 7efea6600640 1 -- 172.21.15.114:0/3140628602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efea00cbdb0 msgr2=0x7efea0150460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:23.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.816+0000 7efea6600640 1 --2- 172.21.15.114:0/3140628602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efea00cbdb0 0x7efea0150460 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efe9000e930 tx=0x7efe9000edf0 comp rx=0 tx=0).stop 2024-09-13T17:52:23.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.816+0000 7efea6600640 1 -- 172.21.15.114:0/3140628602 shutdown_connections 2024-09-13T17:52:23.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.816+0000 7efea6600640 1 --2- 172.21.15.114:0/3140628602 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7efe7c066690 0x7efe7c068b50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:23.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.816+0000 7efea6600640 1 --2- 172.21.15.114:0/3140628602 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efea015a4a0 0x7efea014e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:23.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.816+0000 7efea6600640 1 --2- 172.21.15.114:0/3140628602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efea00ce770 0x7efea014db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:23.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.816+0000 7efea6600640 1 --2- 172.21.15.114:0/3140628602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efea00cbdb0 0x7efea0150460 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:23.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.816+0000 7efea6600640 1 -- 172.21.15.114:0/3140628602 >> 172.21.15.114:0/3140628602 conn(0x7efea00d0330 msgr2=0x7efea0067cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:23.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.816+0000 7efea6600640 1 -- 172.21.15.114:0/3140628602 shutdown_connections 2024-09-13T17:52:23.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.816+0000 7efea6600640 1 -- 172.21.15.114:0/3140628602 wait complete. 2024-09-13T17:52:23.838 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:52:23.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.972+0000 7f77c0e00640 1 Processor -- start 2024-09-13T17:52:24.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.972+0000 7f77c0e00640 1 -- start start 2024-09-13T17:52:24.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.972+0000 7f77c0e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f77bc15a650 0x7f77bc099480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:24.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.972+0000 7f77c0e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f77bc15e7c0 0x7f77bc0cb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:24.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.972+0000 7f77c0e00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77bc0ce540 con 0x7f77bc0ce0b0 2024-09-13T17:52:24.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.972+0000 7f77c0e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77bc15ba40 con 0x7f77bc15a650 2024-09-13T17:52:24.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.972+0000 7f77c0e00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77bc0ce820 con 0x7f77bc15e7c0 2024-09-13T17:52:24.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.972+0000 7f77b9e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f77bc15a650 0x7f77bc099480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:24.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.972+0000 7f77b9e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f77bc15a650 0x7f77bc099480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49642/0 (socket says 172.21.15.114:49642) 2024-09-13T17:52:24.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.972+0000 7f77b9e00640 1 -- 172.21.15.114:0/3375504723 learned_addr learned my addr 172.21.15.114:0/3375504723 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:24.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.972+0000 7f77ba800640 1 --2- 172.21.15.114:0/3375504723 >> v2:172.21.15.134:3300/0 conn(0x7f77bc15e7c0 0x7f77bc0cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:24.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.972+0000 7f77b9e00640 1 -- 172.21.15.114:0/3375504723 >> v2:172.21.15.134:3300/0 conn(0x7f77bc15e7c0 msgr2=0x7f77bc0cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:24.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.972+0000 7f77b9e00640 1 --2- 172.21.15.114:0/3375504723 >> v2:172.21.15.134:3300/0 conn(0x7f77bc15e7c0 0x7f77bc0cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:24.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.972+0000 7f77b9e00640 1 -- 172.21.15.114:0/3375504723 >> v1:172.21.15.134:6789/0 conn(0x7f77bc0ce0b0 legacy=0x7f77bc15e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:24.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.972+0000 7f77b9e00640 1 -- 172.21.15.114:0/3375504723 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77bc0ceb00 con 0x7f77bc15a650 2024-09-13T17:52:24.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.976+0000 7f77b9e00640 1 --2- 172.21.15.114:0/3375504723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77bc15a650 0x7f77bc099480 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f77bc099dd0 tx=0x7f77ac01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd463ef248aee8e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:24.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.976+0000 7f77b8a00640 1 -- 172.21.15.114:0/3375504723 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac0aa610 con 0x7f77bc15a650 2024-09-13T17:52:24.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.976+0000 7f77b8a00640 1 -- 172.21.15.114:0/3375504723 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ac0a6040 con 0x7f77bc15a650 2024-09-13T17:52:24.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.976+0000 7f77b8a00640 1 -- 172.21.15.114:0/3375504723 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac0aa990 con 0x7f77bc15a650 2024-09-13T17:52:24.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.976+0000 7f77c0e00640 1 -- 172.21.15.114:0/3375504723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77bc15a650 msgr2=0x7f77bc099480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:24.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.976+0000 7f77c0e00640 1 --2- 172.21.15.114:0/3375504723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77bc15a650 0x7f77bc099480 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f77bc099dd0 tx=0x7f77ac01c4b0 comp rx=0 tx=0).stop 2024-09-13T17:52:24.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.976+0000 7f77c0e00640 1 -- 172.21.15.114:0/3375504723 shutdown_connections 2024-09-13T17:52:24.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.976+0000 7f77c0e00640 1 --2- 172.21.15.114:0/3375504723 >> v2:172.21.15.134:3300/0 conn(0x7f77bc15e7c0 0x7f77bc0cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:24.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.976+0000 7f77c0e00640 1 --2- 172.21.15.114:0/3375504723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77bc15a650 0x7f77bc099480 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:24.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.976+0000 7f77c0e00640 1 -- 172.21.15.114:0/3375504723 >> 172.21.15.114:0/3375504723 conn(0x7f77bc0d04e0 msgr2=0x7f77bc0d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:24.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.976+0000 7f77c0e00640 1 -- 172.21.15.114:0/3375504723 shutdown_connections 2024-09-13T17:52:24.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.976+0000 7f77c0e00640 1 -- 172.21.15.114:0/3375504723 wait complete. 2024-09-13T17:52:24.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.976+0000 7f77c0e00640 1 Processor -- start 2024-09-13T17:52:24.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.976+0000 7f77c0e00640 1 -- start start 2024-09-13T17:52:24.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.980+0000 7f77c0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77bc15a650 0x7f77bc159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:24.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.980+0000 7f77c0e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77bc15e7c0 0x7f77bc0c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:24.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.980+0000 7f77c0e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77bc1597e0 0x7f77bc0c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:24.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.980+0000 7f77c0e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc0c8e50 con 0x7f77bc15a650 2024-09-13T17:52:24.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.980+0000 7f77c0e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc0c9130 con 0x7f77bc1597e0 2024-09-13T17:52:24.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.980+0000 7f77c0e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc0c9410 con 0x7f77bc15e7c0 2024-09-13T17:52:24.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.980+0000 7f77b9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77bc15a650 0x7f77bc159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:24.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.980+0000 7f77b9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77bc15a650 0x7f77bc159040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49654/0 (socket says 172.21.15.114:49654) 2024-09-13T17:52:24.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.980+0000 7f77b9e00640 1 -- 172.21.15.114:0/4042211913 learned_addr learned my addr 172.21.15.114:0/4042211913 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:24.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.980+0000 7f77ba800640 1 --2- 172.21.15.114:0/4042211913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77bc1597e0 0x7f77bc0c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:24.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.980+0000 7f77b9400640 1 --2- 172.21.15.114:0/4042211913 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77bc15e7c0 0x7f77bc0c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:24.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.980+0000 7f77b9e00640 1 -- 172.21.15.114:0/4042211913 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77bc15e7c0 msgr2=0x7f77bc0c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:24.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.980+0000 7f77b9e00640 1 --2- 172.21.15.114:0/4042211913 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77bc15e7c0 0x7f77bc0c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:24.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.980+0000 7f77b9e00640 1 -- 172.21.15.114:0/4042211913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77bc1597e0 msgr2=0x7f77bc0c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:24.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.980+0000 7f77b9e00640 1 --2- 172.21.15.114:0/4042211913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77bc1597e0 0x7f77bc0c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:24.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.980+0000 7f77b9e00640 1 -- 172.21.15.114:0/4042211913 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ac0094d0 con 0x7f77bc15a650 2024-09-13T17:52:24.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.980+0000 7f77b9e00640 1 --2- 172.21.15.114:0/4042211913 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77bc15a650 0x7f77bc159040 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f77ac01a0e0 tx=0x7f77ac01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:24.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.980+0000 7f77b2000640 1 -- 172.21.15.114:0/4042211913 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac0bd5f0 con 0x7f77bc15a650 2024-09-13T17:52:24.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.980+0000 7f77b2000640 1 -- 172.21.15.114:0/4042211913 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ac0bd750 con 0x7f77bc15a650 2024-09-13T17:52:24.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.980+0000 7f77b2000640 1 -- 172.21.15.114:0/4042211913 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac0bdb00 con 0x7f77bc15a650 2024-09-13T17:52:24.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.980+0000 7f77c0e00640 1 -- 172.21.15.114:0/4042211913 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77bc0c96f0 con 0x7f77bc15a650 2024-09-13T17:52:24.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.980+0000 7f77c0e00640 1 -- 172.21.15.114:0/4042211913 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77bc159580 con 0x7f77bc15a650 2024-09-13T17:52:24.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.980+0000 7f77c0e00640 1 -- 172.21.15.114:0/4042211913 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77bc099480 con 0x7f77bc15a650 2024-09-13T17:52:24.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.980+0000 7f77b2000640 1 -- 172.21.15.114:0/4042211913 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f77ac0b33f0 con 0x7f77bc15a650 2024-09-13T17:52:24.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.984+0000 7f77b2000640 1 --2- 172.21.15.114:0/4042211913 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f779c066690 0x7f779c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:24.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.984+0000 7f77b2000640 1 -- 172.21.15.114:0/4042211913 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f77ac11eff0 con 0x7f77bc15a650 2024-09-13T17:52:24.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.984+0000 7f77b9400640 1 --2- 172.21.15.114:0/4042211913 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f779c066690 0x7f779c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:24.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.984+0000 7f77b9400640 1 --2- 172.21.15.114:0/4042211913 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f779c066690 0x7f779c068b50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f77bc0b0d00 tx=0x7f77a8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:24.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:23.988+0000 7f77b2000640 1 -- 172.21.15.114:0/4042211913 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f77ac0ec0e0 con 0x7f77bc15a650 2024-09-13T17:52:24.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.172+0000 7f77c0e00640 1 -- 172.21.15.114:0/4042211913 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77bc0d1380 con 0x7f77bc15a650 2024-09-13T17:52:24.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.172+0000 7f77b2000640 1 -- 172.21.15.114:0/4042211913 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4739 (secure 0 0 0) 0x7f77ac0c3090 con 0x7f77bc15a650 2024-09-13T17:52:24.441 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:24.441 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/534634081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":534634081},{"type":"v1","addr":"172.21.15.134:6835","nonce":534634081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1773366615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1773366615},{"type":"v1","addr":"172.21.15.114:6836","nonce":1773366615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4122490085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":4122490085},{"type":"v1","addr":"172.21.15.114:6837","nonce":4122490085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:51:49.789079+0000","modified":"2024-09-13T17:52:13.041461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/1863104078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1863104078},{"type":"v1","addr":"172.21.15.134:6834","nonce":1863104078}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:52:24.442 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 9 2024-09-13T17:52:24.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.176+0000 7f77c0e00640 1 -- 172.21.15.114:0/4042211913 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f779c066690 msgr2=0x7f779c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:24.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.176+0000 7f77c0e00640 1 --2- 172.21.15.114:0/4042211913 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f779c066690 0x7f779c068b50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f77bc0b0d00 tx=0x7f77a8009040 comp rx=0 tx=0).stop 2024-09-13T17:52:24.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.176+0000 7f77c0e00640 1 -- 172.21.15.114:0/4042211913 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77bc15a650 msgr2=0x7f77bc159040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:24.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.176+0000 7f77c0e00640 1 --2- 172.21.15.114:0/4042211913 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77bc15a650 0x7f77bc159040 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f77ac01a0e0 tx=0x7f77ac01acf0 comp rx=0 tx=0).stop 2024-09-13T17:52:24.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.176+0000 7f77c0e00640 1 -- 172.21.15.114:0/4042211913 shutdown_connections 2024-09-13T17:52:24.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.176+0000 7f77c0e00640 1 --2- 172.21.15.114:0/4042211913 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f779c066690 0x7f779c068b50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:24.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.176+0000 7f77c0e00640 1 --2- 172.21.15.114:0/4042211913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77bc1597e0 0x7f77bc0c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:24.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.176+0000 7f77c0e00640 1 --2- 172.21.15.114:0/4042211913 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f77bc15e7c0 0x7f77bc0c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:24.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.176+0000 7f77c0e00640 1 --2- 172.21.15.114:0/4042211913 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77bc15a650 0x7f77bc159040 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:24.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.176+0000 7f77c0e00640 1 -- 172.21.15.114:0/4042211913 >> 172.21.15.114:0/4042211913 conn(0x7f77bc0d04e0 msgr2=0x7f77bc0cafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:24.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.176+0000 7f77c0e00640 1 -- 172.21.15.114:0/4042211913 shutdown_connections 2024-09-13T17:52:24.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.176+0000 7f77c0e00640 1 -- 172.21.15.114:0/4042211913 wait complete. 2024-09-13T17:52:24.847 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:51:49.789079+0000', 'modified': '2024-09-13T17:52:13.041461+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4273': {'gid': 4273, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.134:6834/1863104078', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6832', 'nonce': 1863104078}, {'type': 'v1', 'addr': '172.21.15.134:6834', 'nonce': 1863104078}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:52:24.847 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T17:52:24.847 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-13T17:52:24.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.984+0000 7f7a81c00640 1 Processor -- start 2024-09-13T17:52:24.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.984+0000 7f7a81c00640 1 -- start start 2024-09-13T17:52:24.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.988+0000 7f7a81c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a7c15a650 0x7f7a7c099480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:24.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.988+0000 7f7a81c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7a7c0ce0b0 0x7f7a7c15e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:24.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.988+0000 7f7a81c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7c15ea40 con 0x7f7a7c15e5f0 2024-09-13T17:52:24.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.988+0000 7f7a81c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a7c0ce540 con 0x7f7a7c0ce0b0 2024-09-13T17:52:24.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.988+0000 7f7a81c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c0ce820 con 0x7f7a7c15a650 2024-09-13T17:52:24.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.988+0000 7f7a7a000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7a7c0ce0b0 0x7f7a7c15e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:24.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.988+0000 7f7a7b400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7a7c15e5f0 0x7f7a7c15aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42506/0 (socket says 172.21.15.114:42506) 2024-09-13T17:52:24.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.988+0000 7f7a7b400640 1 -- 172.21.15.114:0/1039222431 learned_addr learned my addr 172.21.15.114:0/1039222431 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:24.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.988+0000 7f7a7aa00640 1 --2- 172.21.15.114:0/1039222431 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a7c15a650 0x7f7a7c099480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:24.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.988+0000 7f7a79600640 1 -- 172.21.15.114:0/1039222431 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3407238936 0 0) 0x7f7a740014a0 con 0x7f7a7c15e5f0 2024-09-13T17:52:24.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.988+0000 7f7a79600640 1 -- 172.21.15.114:0/1039222431 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a60003530 con 0x7f7a7c15e5f0 2024-09-13T17:52:24.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.988+0000 7f7a7a000640 1 -- 172.21.15.114:0/1039222431 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a7c15a650 msgr2=0x7f7a7c099480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:24.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.988+0000 7f7a7a000640 1 --2- 172.21.15.114:0/1039222431 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a7c15a650 0x7f7a7c099480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:24.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.988+0000 7f7a7a000640 1 -- 172.21.15.114:0/1039222431 >> v1:172.21.15.114:6789/0 conn(0x7f7a7c15e5f0 legacy=0x7f7a7c15aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:24.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.988+0000 7f7a7a000640 1 -- 172.21.15.114:0/1039222431 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7c0ceb00 con 0x7f7a7c0ce0b0 2024-09-13T17:52:24.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.992+0000 7f7a7a000640 1 --2- 172.21.15.114:0/1039222431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a7c0ce0b0 0x7f7a7c15e0b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7a680097c0 tx=0x7f7a6801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc520a5deb07e788 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:24.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.992+0000 7f7a79600640 1 -- 172.21.15.114:0/1039222431 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a680ab670 con 0x7f7a7c0ce0b0 2024-09-13T17:52:24.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.992+0000 7f7a79600640 1 -- 172.21.15.114:0/1039222431 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a680ab7d0 con 0x7f7a7c0ce0b0 2024-09-13T17:52:24.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.992+0000 7f7a79600640 1 -- 172.21.15.114:0/1039222431 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a680abb60 con 0x7f7a7c0ce0b0 2024-09-13T17:52:24.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.992+0000 7f7a81c00640 1 -- 172.21.15.114:0/1039222431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a7c0ce0b0 msgr2=0x7f7a7c15e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:24.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.992+0000 7f7a81c00640 1 --2- 172.21.15.114:0/1039222431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a7c0ce0b0 0x7f7a7c15e0b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7a680097c0 tx=0x7f7a6801c470 comp rx=0 tx=0).stop 2024-09-13T17:52:24.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.992+0000 7f7a81c00640 1 -- 172.21.15.114:0/1039222431 shutdown_connections 2024-09-13T17:52:24.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.992+0000 7f7a81c00640 1 --2- 172.21.15.114:0/1039222431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a7c0ce0b0 0x7f7a7c15e0b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:24.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.992+0000 7f7a81c00640 1 --2- 172.21.15.114:0/1039222431 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a7c15a650 0x7f7a7c099480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:24.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.992+0000 7f7a81c00640 1 -- 172.21.15.114:0/1039222431 >> 172.21.15.114:0/1039222431 conn(0x7f7a7c0d04e0 msgr2=0x7f7a7c0d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:24.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.992+0000 7f7a81c00640 1 -- 172.21.15.114:0/1039222431 shutdown_connections 2024-09-13T17:52:24.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.992+0000 7f7a81c00640 1 -- 172.21.15.114:0/1039222431 wait complete. 2024-09-13T17:52:24.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.992+0000 7f7a81c00640 1 Processor -- start 2024-09-13T17:52:24.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.992+0000 7f7a81c00640 1 -- start start 2024-09-13T17:52:24.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.992+0000 7f7a81c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a7c15a650 0x7f7a7c0b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:24.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.992+0000 7f7a81c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a7c15e5f0 0x7f7a7c15da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:24.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.992+0000 7f7a81c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a7c0c6560 0x7f7a7c0c4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:24.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.992+0000 7f7a81c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c15d080 con 0x7f7a7c15e5f0 2024-09-13T17:52:24.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.992+0000 7f7a81c00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c0c6dd0 con 0x7f7a7c15a650 2024-09-13T17:52:24.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.992+0000 7f7a81c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c15c750 con 0x7f7a7c0c6560 2024-09-13T17:52:24.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.992+0000 7f7a7a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a7c15e5f0 0x7f7a7c15da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:24.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.992+0000 7f7a7a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a7c15e5f0 0x7f7a7c15da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49672/0 (socket says 172.21.15.114:49672) 2024-09-13T17:52:24.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.992+0000 7f7a7a000640 1 -- 172.21.15.114:0/493032559 learned_addr learned my addr 172.21.15.114:0/493032559 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:24.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.996+0000 7f7a7b400640 1 --2- 172.21.15.114:0/493032559 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a7c0c6560 0x7f7a7c0c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:24.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.996+0000 7f7a7aa00640 1 --2- 172.21.15.114:0/493032559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a7c15a650 0x7f7a7c0b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:24.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.996+0000 7f7a7a000640 1 -- 172.21.15.114:0/493032559 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a7c0c6560 msgr2=0x7f7a7c0c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:24.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.996+0000 7f7a7a000640 1 --2- 172.21.15.114:0/493032559 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a7c0c6560 0x7f7a7c0c4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:24.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.996+0000 7f7a7a000640 1 -- 172.21.15.114:0/493032559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a7c15a650 msgr2=0x7f7a7c0b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:24.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.996+0000 7f7a7a000640 1 --2- 172.21.15.114:0/493032559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a7c15a650 0x7f7a7c0b5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:24.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.996+0000 7f7a7a000640 1 -- 172.21.15.114:0/493032559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a68009420 con 0x7f7a7c15e5f0 2024-09-13T17:52:24.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.996+0000 7f7a7aa00640 1 --2- 172.21.15.114:0/493032559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a7c15a650 0x7f7a7c0b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:24.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.996+0000 7f7a7a000640 1 --2- 172.21.15.114:0/493032559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a7c15e5f0 0x7f7a7c15da10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7a680ad040 tx=0x7f7a6801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:25.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.996+0000 7f7a72a00640 1 -- 172.21.15.114:0/493032559 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a680bf610 con 0x7f7a7c15e5f0 2024-09-13T17:52:25.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.996+0000 7f7a72a00640 1 -- 172.21.15.114:0/493032559 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a680bf7b0 con 0x7f7a7c15e5f0 2024-09-13T17:52:25.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.996+0000 7f7a81c00640 1 -- 172.21.15.114:0/493032559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a7c15ca30 con 0x7f7a7c15e5f0 2024-09-13T17:52:25.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.996+0000 7f7a72a00640 1 -- 172.21.15.114:0/493032559 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a680bfb60 con 0x7f7a7c15e5f0 2024-09-13T17:52:25.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.996+0000 7f7a81c00640 1 -- 172.21.15.114:0/493032559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a7c0c69f0 con 0x7f7a7c15e5f0 2024-09-13T17:52:25.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.996+0000 7f7a72a00640 1 -- 172.21.15.114:0/493032559 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7a680bfcc0 con 0x7f7a7c15e5f0 2024-09-13T17:52:25.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.996+0000 7f7a72a00640 1 --2- 172.21.15.114:0/493032559 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7a5c066690 0x7f7a5c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:25.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:24.996+0000 7f7a72a00640 1 -- 172.21.15.114:0/493032559 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7a6811f120 con 0x7f7a7c15e5f0 2024-09-13T17:52:25.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a7aa00640 1 --2- 172.21.15.114:0/493032559 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7a5c066690 0x7f7a5c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:25.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a84fa1000 1 Processor -- start 2024-09-13T17:52:25.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a84fa1000 1 -- start start 2024-09-13T17:52:25.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a7aa00640 1 --2- 172.21.15.114:0/493032559 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7a5c066690 0x7f7a5c068b50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c1593f0 tx=0x7f7a6c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:25.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a84fa1000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea443b41f0 0x55ea443b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:25.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a84fa1000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ea443b4b10 0x55ea4436a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:25.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a84fa1000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ea4436a770 0x55ea4436ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:25.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a84fa1000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea44232e80 con 0x55ea4436a770 2024-09-13T17:52:25.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a84fa1000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea441c0af0 con 0x55ea443b41f0 2024-09-13T17:52:25.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a84fa1000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea441be0c0 con 0x55ea443b4b10 2024-09-13T17:52:25.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a7b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ea4436a770 0x55ea4436ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:25.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a7b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ea4436a770 0x55ea4436ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49678/0 (socket says 172.21.15.114:49678) 2024-09-13T17:52:25.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a7b400640 1 -- 172.21.15.114:0/3046773015 learned_addr learned my addr 172.21.15.114:0/3046773015 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:25.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a7aa00640 1 --2- 172.21.15.114:0/3046773015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea443b41f0 0x55ea443b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:25.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a7a000640 1 --2- 172.21.15.114:0/3046773015 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ea443b4b10 0x55ea4436a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:25.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a7b400640 1 -- 172.21.15.114:0/3046773015 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ea443b4b10 msgr2=0x55ea4436a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:25.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a7b400640 1 --2- 172.21.15.114:0/3046773015 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ea443b4b10 0x55ea4436a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:25.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a7b400640 1 -- 172.21.15.114:0/3046773015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea443b41f0 msgr2=0x55ea443b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:25.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a7b400640 1 --2- 172.21.15.114:0/3046773015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea443b41f0 0x55ea443b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:25.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a7b400640 1 -- 172.21.15.114:0/3046773015 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea43eb5890 con 0x55ea4436a770 2024-09-13T17:52:25.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a7a000640 1 --2- 172.21.15.114:0/3046773015 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ea443b4b10 0x55ea4436a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:25.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a7b400640 1 --2- 172.21.15.114:0/3046773015 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ea4436a770 0x55ea4436ab50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7a74001fb0 tx=0x7f7a7400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f44e4346ab939f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:25.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a67400640 1 -- 172.21.15.114:0/3046773015 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7400ee50 con 0x55ea4436a770 2024-09-13T17:52:25.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a67400640 1 -- 172.21.15.114:0/3046773015 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a74014480 con 0x55ea4436a770 2024-09-13T17:52:25.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a67400640 1 -- 172.21.15.114:0/3046773015 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a74014830 con 0x55ea4436a770 2024-09-13T17:52:25.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a84fa1000 1 -- 172.21.15.114:0/3046773015 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ea4436a770 msgr2=0x55ea4436ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:25.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a84fa1000 1 --2- 172.21.15.114:0/3046773015 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ea4436a770 0x55ea4436ab50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7a74001fb0 tx=0x7f7a7400e530 comp rx=0 tx=0).stop 2024-09-13T17:52:25.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a84fa1000 1 -- 172.21.15.114:0/3046773015 shutdown_connections 2024-09-13T17:52:25.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a84fa1000 1 --2- 172.21.15.114:0/3046773015 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ea4436a770 0x55ea4436ab50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:25.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a84fa1000 1 --2- 172.21.15.114:0/3046773015 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ea443b4b10 0x55ea4436a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:25.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a84fa1000 1 --2- 172.21.15.114:0/3046773015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea443b41f0 0x55ea443b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:25.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a84fa1000 1 -- 172.21.15.114:0/3046773015 >> 172.21.15.114:0/3046773015 conn(0x55ea44370fe0 msgr2=0x55ea443713c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:25.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a84fa1000 1 -- 172.21.15.114:0/3046773015 shutdown_connections 2024-09-13T17:52:25.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a84fa1000 1 -- 172.21.15.114:0/3046773015 wait complete. 2024-09-13T17:52:25.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.000+0000 7f7a84fa1000 1 -- start start 2024-09-13T17:52:25.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a84fa1000 1 Processor -- start 2024-09-13T17:52:25.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a84fa1000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea4436a770 0x55ea443b3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:25.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a84fa1000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ea443b41f0 0x55ea4436fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:25.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a84fa1000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ea443b4b10 0x55ea44370290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:25.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a84fa1000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea441b99b0 con 0x55ea443b41f0 2024-09-13T17:52:25.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a84fa1000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea44158c00 con 0x55ea4436a770 2024-09-13T17:52:25.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a84fa1000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea44177070 con 0x55ea443b4b10 2024-09-13T17:52:25.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a84fa1000 10 client.0 _ll_register_callbacks cb 0x55ea44356ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:52:25.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a7a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ea443b41f0 0x55ea4436fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:25.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a7a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ea443b41f0 0x55ea4436fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49692/0 (socket says 172.21.15.114:49692) 2024-09-13T17:52:25.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a7a000640 1 -- 172.21.15.114:0/162636017 learned_addr learned my addr 172.21.15.114:0/162636017 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:25.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a7aa00640 1 --2- 172.21.15.114:0/162636017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea4436a770 0x55ea443b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:25.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a7b400640 1 --2- 172.21.15.114:0/162636017 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ea443b4b10 0x55ea44370290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:25.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a7a000640 1 -- 172.21.15.114:0/162636017 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ea443b4b10 msgr2=0x55ea44370290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:25.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a7a000640 1 --2- 172.21.15.114:0/162636017 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ea443b4b10 0x55ea44370290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:25.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a7a000640 1 -- 172.21.15.114:0/162636017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea4436a770 msgr2=0x55ea443b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:25.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a7a000640 1 --2- 172.21.15.114:0/162636017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea4436a770 0x55ea443b3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:25.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a7a000640 1 -- 172.21.15.114:0/162636017 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a7400f040 con 0x55ea443b41f0 2024-09-13T17:52:25.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a7a000640 1 --2- 172.21.15.114:0/162636017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ea443b41f0 0x55ea4436fd50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7a680abfd0 tx=0x7f7a680ef980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0539de221fa0191 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:25.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a5be00640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-13T17:52:25.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a5be00640 1 -- 172.21.15.114:0/162636017 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a680f8080 con 0x55ea443b41f0 2024-09-13T17:52:25.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a5be00640 1 -- 172.21.15.114:0/162636017 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7a680f8310 con 0x55ea443b41f0 2024-09-13T17:52:25.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a84fa1000 1 -- 172.21.15.114:0/162636017 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ea441765f0 con 0x55ea443b41f0 2024-09-13T17:52:25.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a5be00640 1 -- 172.21.15.114:0/162636017 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a680f6070 con 0x55ea443b41f0 2024-09-13T17:52:25.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a84fa1000 10 client.4809 fetch_fsmap learned FSMap version 9 2024-09-13T17:52:25.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a84fa1000 1 -- 172.21.15.114:0/162636017 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55ea4417eab0 con 0x55ea443b41f0 2024-09-13T17:52:25.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a5be00640 1 -- 172.21.15.114:0/162636017 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ea441765f0 con 0x55ea443b41f0 2024-09-13T17:52:25.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a5be00640 1 -- 172.21.15.114:0/162636017 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f7a680ebd10 con 0x55ea443b41f0 2024-09-13T17:52:25.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a84fa1000 10 client.4809 fetch_fsmap finished waiting for FSMap version 9 2024-09-13T17:52:25.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a84fa1000 10 client.4809 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T17:52:25.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a84fa1000 20 client.4809 populate_metadata read hostname 'smithi114' 2024-09-13T17:52:25.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a84fa1000 1 --2- 172.21.15.114:0/162636017 >> [v2:172.21.15.134:6832/1863104078,v1:172.21.15.134:6834/1863104078] conn(0x55ea443b53c0 0x55ea443b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:25.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a84fa1000 4 client.4809 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:52:25.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a84fa1000 1 -- 172.21.15.114:0/162636017 --> [v2:172.21.15.134:6832/1863104078,v1:172.21.15.134:6834/1863104078] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ea441b6790 con 0x55ea443b53c0 2024-09-13T17:52:25.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a7aa00640 1 --2- 172.21.15.114:0/162636017 >> [v2:172.21.15.134:6832/1863104078,v1:172.21.15.134:6834/1863104078] conn(0x55ea443b53c0 0x55ea443b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:25.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a5be00640 10 client.4809 ms_handle_connect on v2:172.21.15.134:6832/1863104078 2024-09-13T17:52:25.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.004+0000 7f7a7aa00640 1 --2- 172.21.15.114:0/162636017 >> [v2:172.21.15.134:6832/1863104078,v1:172.21.15.134:6834/1863104078] conn(0x55ea443b53c0 0x55ea443b57a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfa6fc6bd9730cff server_cookie=2169f08edeb91a43 in_seq=0 out_seq=0 2024-09-13T17:52:25.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.008+0000 7f7a5be00640 1 -- 172.21.15.114:0/162636017 <== mds.0 v2:172.21.15.134:6832/1863104078 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55ea441b6790 con 0x55ea443b53c0 2024-09-13T17:52:25.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.008+0000 7f7a5be00640 10 client.4809 handle_command_reply: tid=0 2024-09-13T17:52:25.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.008+0000 7f7a84fa1000 1 client.4809 shutdown 2024-09-13T17:52:25.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.008+0000 7f7a84fa1000 1 -- 172.21.15.114:0/162636017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ea443b41f0 msgr2=0x55ea4436fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:25.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.008+0000 7f7a84fa1000 1 --2- 172.21.15.114:0/162636017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ea443b41f0 0x55ea4436fd50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7a680abfd0 tx=0x7f7a680ef980 comp rx=0 tx=0).stop 2024-09-13T17:52:25.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.008+0000 7f7a84fa1000 1 -- 172.21.15.114:0/162636017 shutdown_connections 2024-09-13T17:52:25.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.008+0000 7f7a84fa1000 1 --2- 172.21.15.114:0/162636017 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ea443b4b10 0x55ea44370290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:25.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.008+0000 7f7a84fa1000 1 --2- 172.21.15.114:0/162636017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ea443b41f0 0x55ea4436fd50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:25.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.008+0000 7f7a84fa1000 1 --2- 172.21.15.114:0/162636017 >> [v2:172.21.15.134:6832/1863104078,v1:172.21.15.134:6834/1863104078] conn(0x55ea443b53c0 0x55ea443b57a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:25.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.008+0000 7f7a84fa1000 1 --2- 172.21.15.114:0/162636017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea4436a770 0x55ea443b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:25.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.008+0000 7f7a84fa1000 1 -- 172.21.15.114:0/162636017 >> 172.21.15.114:0/162636017 conn(0x55ea44370fe0 msgr2=0x55ea44369220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:25.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.008+0000 7f7a5be00640 0 client.4809 ms_handle_reset on v2:172.21.15.134:6832/1863104078 2024-09-13T17:52:25.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.008+0000 7f7a84fa1000 1 -- 172.21.15.114:0/162636017 shutdown_connections 2024-09-13T17:52:25.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.008+0000 7f7a84fa1000 1 -- 172.21.15.114:0/162636017 wait complete. 2024-09-13T17:52:25.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.008+0000 7f7a84fa1000 20 client.4809 trim_cache size 0 max 16384 2024-09-13T17:52:25.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a84fa1000 1 Processor -- start 2024-09-13T17:52:25.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a84fa1000 1 -- start start 2024-09-13T17:52:25.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a84fa1000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ea4436a770 0x55ea4440fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:25.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a84fa1000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ea443b41f0 0x55ea44410320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:25.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a84fa1000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea443b4b10 0x55ea44410860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:25.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a84fa1000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea43e76940 con 0x55ea443b41f0 2024-09-13T17:52:25.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a84fa1000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea443c1650 con 0x55ea443b4b10 2024-09-13T17:52:25.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a84fa1000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea441b8840 con 0x55ea4436a770 2024-09-13T17:52:25.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a7a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ea443b41f0 0x55ea44410320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:25.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a7a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ea443b41f0 0x55ea44410320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49694/0 (socket says 172.21.15.114:49694) 2024-09-13T17:52:25.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a7a000640 1 -- 172.21.15.114:0/483944044 learned_addr learned my addr 172.21.15.114:0/483944044 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:25.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a7aa00640 1 --2- 172.21.15.114:0/483944044 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ea4436a770 0x55ea4440fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:25.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a7b400640 1 --2- 172.21.15.114:0/483944044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea443b4b10 0x55ea44410860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:25.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a7a000640 1 -- 172.21.15.114:0/483944044 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ea4436a770 msgr2=0x55ea4440fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:25.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a7a000640 1 --2- 172.21.15.114:0/483944044 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ea4436a770 0x55ea4440fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:25.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a7a000640 1 -- 172.21.15.114:0/483944044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea443b4b10 msgr2=0x55ea44410860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:25.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a7a000640 1 --2- 172.21.15.114:0/483944044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea443b4b10 0x55ea44410860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:25.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a7a000640 1 -- 172.21.15.114:0/483944044 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea44164c00 con 0x55ea443b41f0 2024-09-13T17:52:25.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a7a000640 1 --2- 172.21.15.114:0/483944044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ea443b41f0 0x55ea44410320 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7a680ec420 tx=0x7f7a680f2000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e194c19254272fe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:25.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a67e00640 1 -- 172.21.15.114:0/483944044 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a680f6070 con 0x55ea443b41f0 2024-09-13T17:52:25.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a67e00640 1 -- 172.21.15.114:0/483944044 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a680efa60 con 0x55ea443b41f0 2024-09-13T17:52:25.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a67e00640 1 -- 172.21.15.114:0/483944044 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a680f80a0 con 0x55ea443b41f0 2024-09-13T17:52:25.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a84fa1000 1 -- 172.21.15.114:0/483944044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ea443b41f0 msgr2=0x55ea44410320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:25.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a84fa1000 1 --2- 172.21.15.114:0/483944044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ea443b41f0 0x55ea44410320 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7a680ec420 tx=0x7f7a680f2000 comp rx=0 tx=0).stop 2024-09-13T17:52:25.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a84fa1000 1 -- 172.21.15.114:0/483944044 shutdown_connections 2024-09-13T17:52:25.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a84fa1000 1 --2- 172.21.15.114:0/483944044 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea443b4b10 0x55ea44410860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:25.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a84fa1000 1 --2- 172.21.15.114:0/483944044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ea443b41f0 0x55ea44410320 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:25.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a84fa1000 1 --2- 172.21.15.114:0/483944044 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ea4436a770 0x55ea4440fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:25.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a84fa1000 1 -- 172.21.15.114:0/483944044 >> 172.21.15.114:0/483944044 conn(0x55ea44370fe0 msgr2=0x55ea44368a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:25.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a84fa1000 1 -- 172.21.15.114:0/483944044 shutdown_connections 2024-09-13T17:52:25.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a84fa1000 1 -- 172.21.15.114:0/483944044 wait complete. 2024-09-13T17:52:25.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.024+0000 7f7a84fa1000 1 -- start start 2024-09-13T17:52:25.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a84fa1000 1 Processor -- start 2024-09-13T17:52:25.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a84fa1000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ea4436a770 0x55ea44414dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:25.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a84fa1000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ea443b41f0 0x55ea44415310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:25.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a84fa1000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea443b4b10 0x55ea443c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a84fa1000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea443715f0 con 0x55ea443b41f0 2024-09-13T17:52:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a84fa1000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea4415e2b0 con 0x55ea443b4b10 2024-09-13T17:52:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a84fa1000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea44182ef0 con 0x55ea4436a770 2024-09-13T17:52:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a84fa1000 10 client.0 _ll_register_callbacks cb 0x7f7a74001a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:52:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a7a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ea443b41f0 0x55ea44415310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a7a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ea443b41f0 0x55ea44415310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49698/0 (socket says 172.21.15.114:49698) 2024-09-13T17:52:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a7a000640 1 -- 172.21.15.114:0/2103092581 learned_addr learned my addr 172.21.15.114:0/2103092581 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a7aa00640 1 --2- 172.21.15.114:0/2103092581 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ea4436a770 0x55ea44414dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a7b400640 1 --2- 172.21.15.114:0/2103092581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea443b4b10 0x55ea443c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a7a000640 1 -- 172.21.15.114:0/2103092581 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ea4436a770 msgr2=0x55ea44414dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a7a000640 1 --2- 172.21.15.114:0/2103092581 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ea4436a770 0x55ea44414dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a7a000640 1 -- 172.21.15.114:0/2103092581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea443b4b10 msgr2=0x55ea443c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a7a000640 1 --2- 172.21.15.114:0/2103092581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea443b4b10 0x55ea443c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:25.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a7a000640 1 -- 172.21.15.114:0/2103092581 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ea4417eab0 con 0x55ea443b41f0 2024-09-13T17:52:25.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a7b400640 1 --2- 172.21.15.114:0/2103092581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea443b4b10 0x55ea443c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:25.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a7a000640 1 --2- 172.21.15.114:0/2103092581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ea443b41f0 0x55ea44415310 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7a6811f380 tx=0x7f7a6811d1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52415a83b8371121 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:25.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a5be00640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-13T17:52:25.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a5be00640 1 -- 172.21.15.114:0/2103092581 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a680ec090 con 0x55ea443b41f0 2024-09-13T17:52:25.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a5be00640 1 -- 172.21.15.114:0/2103092581 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7a680f8310 con 0x55ea443b41f0 2024-09-13T17:52:25.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a84fa1000 1 -- 172.21.15.114:0/2103092581 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ea44189460 con 0x55ea443b41f0 2024-09-13T17:52:25.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a5be00640 1 -- 172.21.15.114:0/2103092581 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a680eff20 con 0x55ea443b41f0 2024-09-13T17:52:25.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a84fa1000 10 client.4815 fetch_fsmap learned FSMap version 9 2024-09-13T17:52:25.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a84fa1000 1 -- 172.21.15.114:0/2103092581 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55ea43eb5cc0 con 0x55ea443b41f0 2024-09-13T17:52:25.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a5be00640 1 -- 172.21.15.114:0/2103092581 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ea44189460 con 0x55ea443b41f0 2024-09-13T17:52:25.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a5be00640 1 -- 172.21.15.114:0/2103092581 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f7a6810f020 con 0x55ea443b41f0 2024-09-13T17:52:25.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a84fa1000 10 client.4815 fetch_fsmap finished waiting for FSMap version 9 2024-09-13T17:52:25.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a84fa1000 10 client.4815 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T17:52:25.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a84fa1000 20 client.4815 populate_metadata read hostname 'smithi114' 2024-09-13T17:52:25.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a84fa1000 1 --2- 172.21.15.114:0/2103092581 >> [v2:172.21.15.134:6832/1863104078,v1:172.21.15.134:6834/1863104078] conn(0x55ea443c8b20 0x55ea443c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:25.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a84fa1000 4 client.4815 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:52:25.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a84fa1000 1 -- 172.21.15.114:0/2103092581 --> [v2:172.21.15.134:6832/1863104078,v1:172.21.15.134:6834/1863104078] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ea441829c0 con 0x55ea443c8b20 2024-09-13T17:52:25.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a7aa00640 1 --2- 172.21.15.114:0/2103092581 >> [v2:172.21.15.134:6832/1863104078,v1:172.21.15.134:6834/1863104078] conn(0x55ea443c8b20 0x55ea443c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:25.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a7aa00640 1 --2- 172.21.15.114:0/2103092581 >> [v2:172.21.15.134:6832/1863104078,v1:172.21.15.134:6834/1863104078] conn(0x55ea443c8b20 0x55ea443c8f00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c203621a50310103 server_cookie=20413aa333dd0080 in_seq=0 out_seq=0 2024-09-13T17:52:25.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.028+0000 7f7a5be00640 10 client.4815 ms_handle_connect on v2:172.21.15.134:6832/1863104078 2024-09-13T17:52:25.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.032+0000 7f7a5be00640 1 -- 172.21.15.114:0/2103092581 <== mds.0 v2:172.21.15.134:6832/1863104078 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55ea441829c0 con 0x55ea443c8b20 2024-09-13T17:52:25.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.032+0000 7f7a5be00640 10 client.4815 handle_command_reply: tid=0 2024-09-13T17:52:25.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.032+0000 7f7a84fa1000 1 client.4815 shutdown 2024-09-13T17:52:25.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.032+0000 7f7a84fa1000 1 -- 172.21.15.114:0/2103092581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ea443b41f0 msgr2=0x55ea44415310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:25.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.032+0000 7f7a84fa1000 1 --2- 172.21.15.114:0/2103092581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ea443b41f0 0x55ea44415310 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7a6811f380 tx=0x7f7a6811d1d0 comp rx=0 tx=0).stop 2024-09-13T17:52:25.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.032+0000 7f7a84fa1000 1 -- 172.21.15.114:0/2103092581 shutdown_connections 2024-09-13T17:52:25.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.032+0000 7f7a84fa1000 1 --2- 172.21.15.114:0/2103092581 >> [v2:172.21.15.134:6832/1863104078,v1:172.21.15.134:6834/1863104078] conn(0x55ea443c8b20 0x55ea443c8f00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:25.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.032+0000 7f7a84fa1000 1 --2- 172.21.15.114:0/2103092581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea443b4b10 0x55ea443c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:25.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.032+0000 7f7a84fa1000 1 --2- 172.21.15.114:0/2103092581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55ea443b41f0 0x55ea44415310 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:25.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.032+0000 7f7a84fa1000 1 --2- 172.21.15.114:0/2103092581 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55ea4436a770 0x55ea44414dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:25.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.032+0000 7f7a5be00640 0 client.4815 ms_handle_reset on v2:172.21.15.134:6832/1863104078 2024-09-13T17:52:25.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.032+0000 7f7a84fa1000 1 -- 172.21.15.114:0/2103092581 >> 172.21.15.114:0/2103092581 conn(0x55ea44370fe0 msgr2=0x55ea44369220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:25.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.032+0000 7f7a84fa1000 1 -- 172.21.15.114:0/2103092581 shutdown_connections 2024-09-13T17:52:25.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.032+0000 7f7a84fa1000 1 -- 172.21.15.114:0/2103092581 wait complete. 2024-09-13T17:52:25.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.032+0000 7f7a84fa1000 20 client.4815 trim_cache size 0 max 16384 2024-09-13T17:52:25.038 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-13T17:52:25.039 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d730423f-882d-4061-b746-f6a7dc2544e0", 2024-09-13T17:52:25.039 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2024-09-13T17:52:25.039 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4273, 2024-09-13T17:52:25.039 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2024-09-13T17:52:25.039 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2024-09-13T17:52:25.039 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2024-09-13T17:52:25.039 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 35.240663329, 2024-09-13T17:52:25.039 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 9, 2024-09-13T17:52:25.039 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 24, 2024-09-13T17:52:25.039 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 24, 2024-09-13T17:52:25.039 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 41.443206891999999 2024-09-13T17:52:25.039 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-13T17:52:25.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.032+0000 7f7a81c00640 1 -- 172.21.15.114:0/493032559 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7a5c066690 msgr2=0x7f7a5c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:25.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.032+0000 7f7a81c00640 1 --2- 172.21.15.114:0/493032559 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7a5c066690 0x7f7a5c068b50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c1593f0 tx=0x7f7a6c008040 comp rx=0 tx=0).stop 2024-09-13T17:52:25.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.032+0000 7f7a81c00640 1 -- 172.21.15.114:0/493032559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a7c15e5f0 msgr2=0x7f7a7c15da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:25.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.032+0000 7f7a81c00640 1 --2- 172.21.15.114:0/493032559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a7c15e5f0 0x7f7a7c15da10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7a680ad040 tx=0x7f7a6801acb0 comp rx=0 tx=0).stop 2024-09-13T17:52:25.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.032+0000 7f7a81c00640 1 -- 172.21.15.114:0/493032559 shutdown_connections 2024-09-13T17:52:25.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.032+0000 7f7a81c00640 1 --2- 172.21.15.114:0/493032559 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7a5c066690 0x7f7a5c068b50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:25.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.032+0000 7f7a81c00640 1 --2- 172.21.15.114:0/493032559 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7a7c0c6560 0x7f7a7c0c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:25.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.032+0000 7f7a81c00640 1 --2- 172.21.15.114:0/493032559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a7c15e5f0 0x7f7a7c15da10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:25.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.032+0000 7f7a81c00640 1 --2- 172.21.15.114:0/493032559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a7c15a650 0x7f7a7c0b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:25.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.032+0000 7f7a81c00640 1 -- 172.21.15.114:0/493032559 >> 172.21.15.114:0/493032559 conn(0x7f7a7c0d04e0 msgr2=0x7f7a7c15aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:25.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.032+0000 7f7a81c00640 1 -- 172.21.15.114:0/493032559 shutdown_connections 2024-09-13T17:52:25.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:25.032+0000 7f7a81c00640 1 -- 172.21.15.114:0/493032559 wait complete. 2024-09-13T17:52:25.054 INFO:teuthology.run_tasks:Running task sequential... 2024-09-13T17:52:25.063 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-13T17:52:25.064 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-13T17:52:25.064 INFO:teuthology.task.print:Enabling mgr modules 2024-09-13T17:52:25.064 INFO:teuthology.run_tasks:Running task kclient... 2024-09-13T17:52:25.163 INFO:tasks.kclient:Mounting kernel clients... 2024-09-13T17:52:25.163 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-13T17:52:25.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:25.164 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-13T17:52:25.173 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-13T17:52:25.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:25.174 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-13T17:52:25.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:25.238 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-09-13T17:52:25.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:25.816 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-13T17:52:25.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:25.825 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-09-13T17:52:25.896 INFO:teuthology.orchestra.run.smithi114.stderr:Cannot find device "ceph-brx" 2024-09-13T17:52:25.898 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:52:25.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:25.898 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-09-13T17:52:25.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:25.908 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2024-09-13T17:52:25.973 INFO:teuthology.orchestra.run.smithi134.stderr:Cannot find device "ceph-brx" 2024-09-13T17:52:25.975 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:52:25.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:25.976 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-09-13T17:52:26.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:26.027 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2024-09-13T17:52:26.093 INFO:teuthology.orchestra.run.smithi134.stderr:Cannot find device "ceph-brx" 2024-09-13T17:52:26.095 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:52:26.095 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-09-13T17:52:26.095 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T17:52:26.095 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:52:26.095 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:52:26.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.228+0000 7fecbb400640 1 Processor -- start 2024-09-13T17:52:26.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.228+0000 7fecbb400640 1 -- start start 2024-09-13T17:52:26.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.228+0000 7fecbb400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecb413c240 0x7fecb413f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:26.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.228+0000 7fecbb400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fecb413c980 0x7fecb406d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:26.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.228+0000 7fecbb400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb40cd220 con 0x7fecb406da90 2024-09-13T17:52:26.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.228+0000 7fecbb400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb406df00 con 0x7fecb413c980 2024-09-13T17:52:26.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.228+0000 7fecbb400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb413f960 con 0x7fecb413c240 2024-09-13T17:52:26.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.228+0000 7fecabe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fecb413c980 0x7fecb406d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:26.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.228+0000 7fecabe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fecb413c980 0x7fecb406d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49714/0 (socket says 172.21.15.114:49714) 2024-09-13T17:52:26.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.228+0000 7fecabe00640 1 -- 172.21.15.114:0/3863528647 learned_addr learned my addr 172.21.15.114:0/3863528647 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:26.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.228+0000 7fecb8a00640 1 --2- 172.21.15.114:0/3863528647 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecb413c240 0x7fecb413f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:26.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.228+0000 7fecabe00640 1 -- 172.21.15.114:0/3863528647 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecb413c240 msgr2=0x7fecb413f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:26.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.228+0000 7fecabe00640 1 --2- 172.21.15.114:0/3863528647 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecb413c240 0x7fecb413f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:26.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.228+0000 7fecabe00640 1 -- 172.21.15.114:0/3863528647 >> v1:172.21.15.134:6789/0 conn(0x7fecb406da90 legacy=0x7fecb40cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:26.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.228+0000 7fecabe00640 1 -- 172.21.15.114:0/3863528647 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb415a740 con 0x7fecb413c980 2024-09-13T17:52:26.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.228+0000 7fecb8a00640 1 --2- 172.21.15.114:0/3863528647 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecb413c240 0x7fecb413f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:52:26.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.232+0000 7fecabe00640 1 --2- 172.21.15.114:0/3863528647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecb413c980 0x7fecb406d550 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fec9c009870 tx=0x7fec9c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28bfe238783afaee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:26.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.232+0000 7fecb3e00640 1 -- 172.21.15.114:0/3863528647 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c0aa610 con 0x7fecb413c980 2024-09-13T17:52:26.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.232+0000 7fecb3e00640 1 -- 172.21.15.114:0/3863528647 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9c0a6040 con 0x7fecb413c980 2024-09-13T17:52:26.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.232+0000 7fecb3e00640 1 -- 172.21.15.114:0/3863528647 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c0aa990 con 0x7fecb413c980 2024-09-13T17:52:26.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.232+0000 7fecbb400640 1 -- 172.21.15.114:0/3863528647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecb413c980 msgr2=0x7fecb406d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:26.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.232+0000 7fecbb400640 1 --2- 172.21.15.114:0/3863528647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecb413c980 0x7fecb406d550 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fec9c009870 tx=0x7fec9c01c4f0 comp rx=0 tx=0).stop 2024-09-13T17:52:26.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.232+0000 7fecbb400640 1 -- 172.21.15.114:0/3863528647 shutdown_connections 2024-09-13T17:52:26.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.232+0000 7fecbb400640 1 --2- 172.21.15.114:0/3863528647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecb413c980 0x7fecb406d550 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:26.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.232+0000 7fecbb400640 1 --2- 172.21.15.114:0/3863528647 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecb413c240 0x7fecb413f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:26.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.232+0000 7fecbb400640 1 -- 172.21.15.114:0/3863528647 >> 172.21.15.114:0/3863528647 conn(0x7fecb40660b0 msgr2=0x7fecb4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:26.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.232+0000 7fecbb400640 1 -- 172.21.15.114:0/3863528647 shutdown_connections 2024-09-13T17:52:26.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.232+0000 7fecbb400640 1 -- 172.21.15.114:0/3863528647 wait complete. 2024-09-13T17:52:26.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.236+0000 7fecbb400640 1 Processor -- start 2024-09-13T17:52:26.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.236+0000 7fecbb400640 1 -- start start 2024-09-13T17:52:26.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.236+0000 7fecbb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecb406da90 0x7fecb4154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:26.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.236+0000 7fecbb400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecb413c240 0x7fecb41521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:26.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.236+0000 7fecbb400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecb413c980 0x7fecb4152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:26.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.236+0000 7fecbb400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40ad960 con 0x7fecb406da90 2024-09-13T17:52:26.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.236+0000 7fecbb400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40ac950 con 0x7fecb413c980 2024-09-13T17:52:26.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.236+0000 7fecbb400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40ad4d0 con 0x7fecb413c240 2024-09-13T17:52:26.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.236+0000 7fecb8a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecb406da90 0x7fecb4154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:26.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.236+0000 7fecb8a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecb406da90 0x7fecb4154e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49728/0 (socket says 172.21.15.114:49728) 2024-09-13T17:52:26.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.236+0000 7fecb8a00640 1 -- 172.21.15.114:0/174661762 learned_addr learned my addr 172.21.15.114:0/174661762 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:26.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.236+0000 7fecb9400640 1 --2- 172.21.15.114:0/174661762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecb413c980 0x7fecb4152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:26.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.236+0000 7fecabe00640 1 --2- 172.21.15.114:0/174661762 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecb413c240 0x7fecb41521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:26.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.236+0000 7fecb8a00640 1 -- 172.21.15.114:0/174661762 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecb413c240 msgr2=0x7fecb41521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:26.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.236+0000 7fecb8a00640 1 --2- 172.21.15.114:0/174661762 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecb413c240 0x7fecb41521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:26.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.236+0000 7fecb8a00640 1 -- 172.21.15.114:0/174661762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecb413c980 msgr2=0x7fecb4152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:26.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.236+0000 7fecb8a00640 1 --2- 172.21.15.114:0/174661762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecb413c980 0x7fecb4152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:26.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.236+0000 7fecb8a00640 1 -- 172.21.15.114:0/174661762 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9c0094d0 con 0x7fecb406da90 2024-09-13T17:52:26.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.236+0000 7fecb9400640 1 --2- 172.21.15.114:0/174661762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecb413c980 0x7fecb4152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:26.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.236+0000 7fecb8a00640 1 --2- 172.21.15.114:0/174661762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecb406da90 0x7fecb4154e40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7feca400c7c0 tx=0x7feca400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:26.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.236+0000 7fecb1600640 1 -- 172.21.15.114:0/174661762 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca4007a30 con 0x7fecb406da90 2024-09-13T17:52:26.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.236+0000 7fecb1600640 1 -- 172.21.15.114:0/174661762 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca4007b90 con 0x7fecb406da90 2024-09-13T17:52:26.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.236+0000 7fecbb400640 1 -- 172.21.15.114:0/174661762 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb40acba0 con 0x7fecb406da90 2024-09-13T17:52:26.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.236+0000 7fecb1600640 1 -- 172.21.15.114:0/174661762 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca400ce70 con 0x7fecb406da90 2024-09-13T17:52:26.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.236+0000 7fecbb400640 1 -- 172.21.15.114:0/174661762 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb40ad160 con 0x7fecb406da90 2024-09-13T17:52:26.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.240+0000 7fecbb400640 1 -- 172.21.15.114:0/174661762 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb40667b0 con 0x7fecb406da90 2024-09-13T17:52:26.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.240+0000 7fecb1600640 1 -- 172.21.15.114:0/174661762 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feca40113f0 con 0x7fecb406da90 2024-09-13T17:52:26.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.240+0000 7fecb1600640 1 --2- 172.21.15.114:0/174661762 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fec900666c0 0x7fec90068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:26.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.240+0000 7fecb1600640 1 -- 172.21.15.114:0/174661762 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feca4084840 con 0x7fecb406da90 2024-09-13T17:52:26.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.240+0000 7fecabe00640 1 --2- 172.21.15.114:0/174661762 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fec900666c0 0x7fec90068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:26.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.240+0000 7fecabe00640 1 --2- 172.21.15.114:0/174661762 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fec900666c0 0x7fec90068b80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fec9c0ae000 tx=0x7fec9c0b5040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:26.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.244+0000 7fecb1600640 1 -- 172.21.15.114:0/174661762 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feca4051960 con 0x7fecb406da90 2024-09-13T17:52:26.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.432+0000 7fecbb400640 1 -- 172.21.15.114:0/174661762 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fecb40706b0 con 0x7fecb406da90 2024-09-13T17:52:26.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.432+0000 7fecb1600640 1 -- 172.21.15.114:0/174661762 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7feca4054f80 con 0x7fecb406da90 2024-09-13T17:52:26.434 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T17:52:26.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.432+0000 7fecbb400640 1 -- 172.21.15.114:0/174661762 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fec900666c0 msgr2=0x7fec90068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:26.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.432+0000 7fecbb400640 1 --2- 172.21.15.114:0/174661762 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fec900666c0 0x7fec90068b80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fec9c0ae000 tx=0x7fec9c0b5040 comp rx=0 tx=0).stop 2024-09-13T17:52:26.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.432+0000 7fecbb400640 1 -- 172.21.15.114:0/174661762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecb406da90 msgr2=0x7fecb4154e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:26.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.432+0000 7fecbb400640 1 --2- 172.21.15.114:0/174661762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecb406da90 0x7fecb4154e40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7feca400c7c0 tx=0x7feca400cc80 comp rx=0 tx=0).stop 2024-09-13T17:52:26.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.432+0000 7fecbb400640 1 -- 172.21.15.114:0/174661762 shutdown_connections 2024-09-13T17:52:26.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.432+0000 7fecbb400640 1 --2- 172.21.15.114:0/174661762 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fec900666c0 0x7fec90068b80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:26.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.432+0000 7fecbb400640 1 --2- 172.21.15.114:0/174661762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecb413c980 0x7fecb4152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:26.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.432+0000 7fecbb400640 1 --2- 172.21.15.114:0/174661762 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fecb413c240 0x7fecb41521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:26.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.432+0000 7fecbb400640 1 --2- 172.21.15.114:0/174661762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fecb406da90 0x7fecb4154e40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:26.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.432+0000 7fecbb400640 1 -- 172.21.15.114:0/174661762 >> 172.21.15.114:0/174661762 conn(0x7fecb40660b0 msgr2=0x7fecb41576a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:26.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.432+0000 7fecbb400640 1 -- 172.21.15.114:0/174661762 shutdown_connections 2024-09-13T17:52:26.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:26.432+0000 7fecbb400640 1 -- 172.21.15.114:0/174661762 wait complete. 2024-09-13T17:52:26.457 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:52:26.457 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:52:26.458 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-09-13T17:52:26.458 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T17:52:26.458 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:52:26.458 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:52:26.458 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:52:26.458 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:52:26.459 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:52:26.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:26.459 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-09-13T17:52:26.470 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:52:26.470 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:52:26.470 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:52:26.470 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:26.470 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-09-13T17:52:26.470 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:26.470 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:52:26.470 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:52:26.470 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-09-13T17:52:26.471 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:52:26.471 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:52:26.471 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-09-13T17:52:26.471 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:52:26.471 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:52:26.471 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:52:26.471 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:52:26.471 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:52:26.471 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42424sec preferred_lft 42424sec 2024-09-13T17:52:26.471 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-09-13T17:52:26.472 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:26.472 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:52:26.472 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:0f:6c:f2:fc brd ff:ff:ff:ff:ff:ff 2024-09-13T17:52:26.472 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:52:26.472 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:26.472 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T17:52:26.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:26.472 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2024-09-13T17:52:26.473 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-13T17:52:26.473 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add name ceph-brx type bridge 2024-09-13T17:52:26.473 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr flush dev ceph-brx 2024-09-13T17:52:26.473 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set ceph-brx up 2024-09-13T17:52:26.473 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T17:52:26.473 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-13T17:52:26.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:26.583 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:52:26.601 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-09-13T17:52:26.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:26.603 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-09-13T17:52:26.661 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-09-13T17:52:26.661 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:52:26.661 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:52:26.661 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:52:26.661 INFO:teuthology.orchestra.run.smithi114.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-13T17:52:26.661 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:52:26.661 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T17:52:26.661 INFO:teuthology.orchestra.run.smithi114.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:52:26.661 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:52:26.661 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:52:26.661 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:52:26.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:26.662 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2024-09-13T17:52:26.662 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-13T17:52:26.662 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:52:26.662 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:52:26.662 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:52:26.662 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-13T17:52:26.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:26.753 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-13T17:52:26.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:26.806 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list-id 2024-09-13T17:52:26.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:26.861 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2024-09-13T17:52:26.862 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-13T17:52:26.862 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:52:26.862 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T17:52:26.862 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-13T17:52:26.942 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T17:52:26.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:26.943 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2024-09-13T17:52:26.943 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-13T17:52:26.943 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T17:52:26.943 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T17:52:26.943 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T17:52:26.943 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T17:52:26.943 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T17:52:26.943 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-13T17:52:27.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:27.076 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2024-09-13T17:52:27.076 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-13T17:52:27.076 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-09-13T17:52:27.076 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T17:52:27.076 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-13T17:52:27.114 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:52:27.114 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T17:52:27.169 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:52:27.169 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:52:27.169 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:52:27.221 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T17:52:27.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:27.221 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T17:52:27.313 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T17:52:27.313 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T17:52:27.937 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T17:52:27.937 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T17:52:27.937 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.134:3300,172.21.15.134:3301" 2024-09-13T17:52:27.938 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with new device syntax: 0@d730423f-882d-4061-b746-f6a7dc2544e0.cephfs=/ 2024-09-13T17:52:27.938 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.114:3300/172.21.15.134:3300/172.21.15.134:3301" will pass to kernel 2024-09-13T17:52:27.941 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T17:52:27.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:27.941 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:52:27.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:27.962 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:52:28.016 INFO:teuthology.orchestra.run.smithi114.stdout:client4824 2024-09-13T17:52:28.016 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:52:28.016 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:52:28.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:28.065 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:52:28.116 INFO:teuthology.orchestra.run.smithi114.stdout:client4824 2024-09-13T17:52:28.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:28.116 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:52:28.168 INFO:teuthology.orchestra.run.smithi114.stdout:client4824 2024-09-13T17:52:28.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:28.169 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/d730423f-882d-4061-b746-f6a7dc2544e0.client4824/status') 2024-09-13T17:52:28.232 INFO:teuthology.orchestra.run.smithi114.stdout:instance: client.4824 (3)192.168.0.1:0/16724127 2024-09-13T17:52:28.232 INFO:teuthology.orchestra.run.smithi114.stdout:blocklisted: false 2024-09-13T17:52:28.232 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records in 2024-09-13T17:52:28.232 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records out 2024-09-13T17:52:28.232 INFO:teuthology.orchestra.run.smithi114.stderr:67 bytes copied, 5.042e-05 s, 1.3 MB/s 2024-09-13T17:52:28.234 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-09-13T17:52:28.234 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T17:52:28.234 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-13T17:52:28.235 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:52:28.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.412+0000 7f95a1800640 1 Processor -- start 2024-09-13T17:52:28.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.412+0000 7f95a1800640 1 -- start start 2024-09-13T17:52:28.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.412+0000 7f95a1800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f959c13c240 0x7f959c13f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:28.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.412+0000 7f95a1800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f959c06dc60 0x7f959c0cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:28.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.412+0000 7f95a1800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f959c0cd220 con 0x7f959c13c980 2024-09-13T17:52:28.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.412+0000 7f95a1800640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f959c13f960 con 0x7f959c13c240 2024-09-13T17:52:28.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.412+0000 7f95a1800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959c15a740 con 0x7f959c06dc60 2024-09-13T17:52:28.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.412+0000 7f959a000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f959c13c980 0x7f959c06d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:42518/0 (socket says 172.21.15.114:42518) 2024-09-13T17:52:28.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.412+0000 7f959a000640 1 -- 172.21.15.114:0/2757674680 learned_addr learned my addr 172.21.15.114:0/2757674680 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:28.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.412+0000 7f959b400640 1 --2- 172.21.15.114:0/2757674680 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f959c06dc60 0x7f959c0cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:28.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.412+0000 7f959aa00640 1 --2- 172.21.15.114:0/2757674680 >> v2:172.21.15.134:3300/0 conn(0x7f959c13c240 0x7f959c13f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:28.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.412+0000 7f9599600640 1 -- 172.21.15.114:0/2757674680 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680454602 0 0) 0x7f959c0cd220 con 0x7f959c13c980 2024-09-13T17:52:28.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.412+0000 7f9599600640 1 -- 172.21.15.114:0/2757674680 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9580003530 con 0x7f959c13c980 2024-09-13T17:52:28.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.412+0000 7f959aa00640 1 -- 172.21.15.114:0/2757674680 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f959c06dc60 msgr2=0x7f959c0cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:28.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.412+0000 7f959aa00640 1 --2- 172.21.15.114:0/2757674680 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f959c06dc60 0x7f959c0cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:28.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.412+0000 7f959aa00640 1 -- 172.21.15.114:0/2757674680 >> v1:172.21.15.114:6789/0 conn(0x7f959c13c980 legacy=0x7f959c06d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:28.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.412+0000 7f959aa00640 1 -- 172.21.15.114:0/2757674680 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c159bc0 con 0x7f959c13c240 2024-09-13T17:52:28.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.412+0000 7f959b400640 1 --2- 172.21.15.114:0/2757674680 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f959c06dc60 0x7f959c0cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:52:28.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.416+0000 7f959aa00640 1 --2- 172.21.15.114:0/2757674680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f959c13c240 0x7f959c13f420 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f958c009d90 tx=0x7f958c01c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5287cde7d9a09851 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:28.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.416+0000 7f9599600640 1 -- 172.21.15.114:0/2757674680 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c0a5a00 con 0x7f959c13c240 2024-09-13T17:52:28.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.416+0000 7f9599600640 1 -- 172.21.15.114:0/2757674680 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958c0a5b60 con 0x7f959c13c240 2024-09-13T17:52:28.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.416+0000 7f9599600640 1 -- 172.21.15.114:0/2757674680 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c0ad440 con 0x7f959c13c240 2024-09-13T17:52:28.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.416+0000 7f95a1800640 1 -- 172.21.15.114:0/2757674680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f959c13c240 msgr2=0x7f959c13f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:28.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.416+0000 7f95a1800640 1 --2- 172.21.15.114:0/2757674680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f959c13c240 0x7f959c13f420 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f958c009d90 tx=0x7f958c01c940 comp rx=0 tx=0).stop 2024-09-13T17:52:28.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.416+0000 7f95a1800640 1 -- 172.21.15.114:0/2757674680 shutdown_connections 2024-09-13T17:52:28.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.416+0000 7f95a1800640 1 --2- 172.21.15.114:0/2757674680 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f959c06dc60 0x7f959c0cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:28.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.416+0000 7f95a1800640 1 --2- 172.21.15.114:0/2757674680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f959c13c240 0x7f959c13f420 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:28.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.416+0000 7f95a1800640 1 -- 172.21.15.114:0/2757674680 >> 172.21.15.114:0/2757674680 conn(0x7f959c0660b0 msgr2=0x7f959c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:28.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.416+0000 7f95a1800640 1 -- 172.21.15.114:0/2757674680 shutdown_connections 2024-09-13T17:52:28.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.416+0000 7f95a1800640 1 -- 172.21.15.114:0/2757674680 wait complete. 2024-09-13T17:52:28.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.420+0000 7f95a1800640 1 Processor -- start 2024-09-13T17:52:28.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.420+0000 7f95a1800640 1 -- start start 2024-09-13T17:52:28.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.420+0000 7f95a1800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f959c06dc60 0x7f959c154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:28.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.420+0000 7f95a1800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f959c13c240 0x7f959c0acf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:28.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.420+0000 7f95a1800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f959c13c980 0x7f959c0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:28.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.420+0000 7f95a1800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c154b60 con 0x7f959c06dc60 2024-09-13T17:52:28.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.420+0000 7f95a1800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c0ac980 con 0x7f959c13c980 2024-09-13T17:52:28.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.420+0000 7f95a1800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959c0abd70 con 0x7f959c13c240 2024-09-13T17:52:28.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.420+0000 7f959aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f959c06dc60 0x7f959c154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:28.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.420+0000 7f959aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f959c06dc60 0x7f959c154620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49744/0 (socket says 172.21.15.114:49744) 2024-09-13T17:52:28.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.420+0000 7f959aa00640 1 -- 172.21.15.114:0/1099534486 learned_addr learned my addr 172.21.15.114:0/1099534486 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:28.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.420+0000 7f959a000640 1 --2- 172.21.15.114:0/1099534486 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f959c13c240 0x7f959c0acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:28.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.420+0000 7f959b400640 1 --2- 172.21.15.114:0/1099534486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f959c13c980 0x7f959c0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:28.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.420+0000 7f959aa00640 1 -- 172.21.15.114:0/1099534486 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f959c13c240 msgr2=0x7f959c0acf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:28.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.420+0000 7f959aa00640 1 --2- 172.21.15.114:0/1099534486 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f959c13c240 0x7f959c0acf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:28.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.420+0000 7f959aa00640 1 -- 172.21.15.114:0/1099534486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f959c13c980 msgr2=0x7f959c0ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:28.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.420+0000 7f959aa00640 1 --2- 172.21.15.114:0/1099534486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f959c13c980 0x7f959c0ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:28.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.420+0000 7f959aa00640 1 -- 172.21.15.114:0/1099534486 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9594009420 con 0x7f959c06dc60 2024-09-13T17:52:28.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.420+0000 7f959a000640 1 --2- 172.21.15.114:0/1099534486 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f959c13c240 0x7f959c0acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:52:28.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.420+0000 7f959b400640 1 --2- 172.21.15.114:0/1099534486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f959c13c980 0x7f959c0ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:52:28.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.420+0000 7f959aa00640 1 --2- 172.21.15.114:0/1099534486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f959c06dc60 0x7f959c154620 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f958c01aff0 tx=0x7f959c0ce3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:28.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.420+0000 7f9592a00640 1 -- 172.21.15.114:0/1099534486 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c0bf070 con 0x7f959c06dc60 2024-09-13T17:52:28.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.420+0000 7f9592a00640 1 -- 172.21.15.114:0/1099534486 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958c009450 con 0x7f959c06dc60 2024-09-13T17:52:28.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.420+0000 7f9592a00640 1 -- 172.21.15.114:0/1099534486 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c0adda0 con 0x7f959c06dc60 2024-09-13T17:52:28.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.420+0000 7f95a1800640 1 -- 172.21.15.114:0/1099534486 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f958c009a70 con 0x7f959c06dc60 2024-09-13T17:52:28.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.420+0000 7f95a1800640 1 -- 172.21.15.114:0/1099534486 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f959c0ac330 con 0x7f959c06dc60 2024-09-13T17:52:28.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.424+0000 7f95a1800640 1 -- 172.21.15.114:0/1099534486 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f959c159790 con 0x7f959c06dc60 2024-09-13T17:52:28.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.424+0000 7f9592a00640 1 -- 172.21.15.114:0/1099534486 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f958c0b4050 con 0x7f959c06dc60 2024-09-13T17:52:28.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.424+0000 7f9592a00640 1 --2- 172.21.15.114:0/1099534486 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f957c066690 0x7f957c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:28.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.424+0000 7f9592a00640 1 -- 172.21.15.114:0/1099534486 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f958c11ee10 con 0x7f959c06dc60 2024-09-13T17:52:28.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.424+0000 7f959a000640 1 --2- 172.21.15.114:0/1099534486 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f957c066690 0x7f957c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:28.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.424+0000 7f959a000640 1 --2- 172.21.15.114:0/1099534486 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f957c066690 0x7f957c068b50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f959c13e520 tx=0x7f9588009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:28.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.428+0000 7f9592a00640 1 -- 172.21.15.114:0/1099534486 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f958c122030 con 0x7f959c06dc60 2024-09-13T17:52:28.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.616+0000 7f95a1800640 1 -- 172.21.15.114:0/1099534486 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f959c06b400 con 0x7f959c06dc60 2024-09-13T17:52:28.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.616+0000 7f9592a00640 1 -- 172.21.15.114:0/1099534486 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f958c0ebf10 con 0x7f959c06dc60 2024-09-13T17:52:28.620 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T17:52:28.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.616+0000 7f95a1800640 1 -- 172.21.15.114:0/1099534486 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f957c066690 msgr2=0x7f957c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:28.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.616+0000 7f95a1800640 1 --2- 172.21.15.114:0/1099534486 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f957c066690 0x7f957c068b50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f959c13e520 tx=0x7f9588009040 comp rx=0 tx=0).stop 2024-09-13T17:52:28.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.616+0000 7f95a1800640 1 -- 172.21.15.114:0/1099534486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f959c06dc60 msgr2=0x7f959c154620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:28.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.616+0000 7f95a1800640 1 --2- 172.21.15.114:0/1099534486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f959c06dc60 0x7f959c154620 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f958c01aff0 tx=0x7f959c0ce3a0 comp rx=0 tx=0).stop 2024-09-13T17:52:28.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.616+0000 7f95a1800640 1 -- 172.21.15.114:0/1099534486 shutdown_connections 2024-09-13T17:52:28.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.616+0000 7f95a1800640 1 --2- 172.21.15.114:0/1099534486 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f957c066690 0x7f957c068b50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:28.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.616+0000 7f95a1800640 1 --2- 172.21.15.114:0/1099534486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f959c13c980 0x7f959c0ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:28.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.616+0000 7f95a1800640 1 --2- 172.21.15.114:0/1099534486 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f959c13c240 0x7f959c0acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:28.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.616+0000 7f95a1800640 1 --2- 172.21.15.114:0/1099534486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f959c06dc60 0x7f959c154620 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:28.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.616+0000 7f95a1800640 1 -- 172.21.15.114:0/1099534486 >> 172.21.15.114:0/1099534486 conn(0x7f959c0660b0 msgr2=0x7f959c156020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:28.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.616+0000 7f95a1800640 1 -- 172.21.15.114:0/1099534486 shutdown_connections 2024-09-13T17:52:28.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:28.616+0000 7f95a1800640 1 -- 172.21.15.114:0/1099534486 wait complete. 2024-09-13T17:52:28.639 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:52:28.640 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:52:28.640 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-09-13T17:52:28.640 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-13T17:52:28.640 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-13T17:52:28.640 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:52:28.640 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:52:28.640 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:52:28.640 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-13T17:52:28.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:28.640 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-09-13T17:52:28.649 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:52:28.649 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:52:28.649 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:52:28.649 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:28.650 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-09-13T17:52:28.650 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:28.650 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:52:28.650 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:52:28.650 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-09-13T17:52:28.650 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:52:28.650 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:52:28.650 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-09-13T17:52:28.650 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:52:28.650 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:52:28.650 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:52:28.650 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:52:28.650 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:52:28.651 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42422sec preferred_lft 42422sec 2024-09-13T17:52:28.651 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-09-13T17:52:28.651 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:28.651 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:52:28.651 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:0f:6c:f2:fc brd ff:ff:ff:ff:ff:ff 2024-09-13T17:52:28.651 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:52:28.651 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:28.651 INFO:teuthology.orchestra.run.smithi114.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:52:28.651 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T17:52:28.651 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:52:28.651 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:28.651 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2024-09-13T17:52:28.652 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:28.652 INFO:teuthology.orchestra.run.smithi114.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:52:28.652 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:52:28.652 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T17:52:28.652 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:28.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:28.653 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:52:28.715 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-09-13T17:52:28.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:28.717 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-09-13T17:52:28.772 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-09-13T17:52:28.772 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:52:28.772 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:52:28.772 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:52:28.772 INFO:teuthology.orchestra.run.smithi114.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-13T17:52:28.772 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:52:28.773 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T17:52:28.773 INFO:teuthology.orchestra.run.smithi114.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:52:28.773 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:52:28.773 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:52:28.773 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:52:28.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:28.773 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2024-09-13T17:52:28.773 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-13T17:52:28.773 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:52:28.773 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:52:28.773 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:52:28.774 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-13T17:52:28.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:28.865 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-13T17:52:28.921 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:52:28.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:28.922 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list-id 2024-09-13T17:52:28.977 INFO:teuthology.orchestra.run.smithi114.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-13T17:52:28.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:28.978 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2024-09-13T17:52:28.978 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-13T17:52:28.978 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T17:52:28.978 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-13T17:52:28.978 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-13T17:52:29.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:29.062 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-13T17:52:29.125 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:52:29.125 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:52:29.125 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:52:29.125 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:29.125 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-09-13T17:52:29.125 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:29.125 INFO:teuthology.orchestra.run.smithi114.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:52:29.125 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether de:e7:00:d8:59:a7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T17:52:29.125 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T17:52:29.125 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:29.125 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::dce7:ff:fed8:59a7/64 scope link 2024-09-13T17:52:29.125 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:29.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:29.127 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-13T17:52:29.188 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:52:29.188 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:52:29.189 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:52:29.189 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:29.189 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-09-13T17:52:29.189 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:29.189 INFO:teuthology.orchestra.run.smithi114.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:52:29.189 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether de:e7:00:d8:59:a7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T17:52:29.189 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T17:52:29.189 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:29.189 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::dce7:ff:fed8:59a7/64 scope link 2024-09-13T17:52:29.189 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:29.190 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-13T17:52:29.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:29.191 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2024-09-13T17:52:29.191 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-13T17:52:29.191 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-13T17:52:29.191 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-13T17:52:29.191 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-13T17:52:29.191 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-13T17:52:29.191 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-13T17:52:29.191 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-13T17:52:29.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:29.324 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2024-09-13T17:52:29.324 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-13T17:52:29.324 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.1 up 2024-09-13T17:52:29.324 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set dev brx.1 master ceph-brx 2024-09-13T17:52:29.324 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-13T17:52:29.361 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:52:29.362 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-13T17:52:29.417 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-13T17:52:29.418 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:52:29.418 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-13T17:52:29.468 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-09-13T17:52:29.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:29.469 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T17:52:29.557 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T17:52:29.557 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T17:52:29.571 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T17:52:29.571 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T17:52:29.572 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.134:3300,172.21.15.134:3301" 2024-09-13T17:52:29.572 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with new device syntax: 2@d730423f-882d-4061-b746-f6a7dc2544e0.cephfs=/ 2024-09-13T17:52:29.572 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.114:3300/172.21.15.134:3300/172.21.15.134:3301" will pass to kernel 2024-09-13T17:52:29.575 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T17:52:29.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:29.575 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-13T17:52:29.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:29.594 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:52:29.648 INFO:teuthology.orchestra.run.smithi114.stdout:client4637 2024-09-13T17:52:29.649 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:52:29.649 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:52:29.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:29.701 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:52:29.759 INFO:teuthology.orchestra.run.smithi114.stdout:client4637 2024-09-13T17:52:29.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:29.760 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:52:29.812 INFO:teuthology.orchestra.run.smithi114.stdout:client4637 2024-09-13T17:52:29.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:29.813 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/d730423f-882d-4061-b746-f6a7dc2544e0.client4637/status') 2024-09-13T17:52:29.872 INFO:teuthology.orchestra.run.smithi114.stdout:instance: client.4637 (3)172.21.15.114:0/2196315107 2024-09-13T17:52:29.872 INFO:teuthology.orchestra.run.smithi114.stdout:blocklisted: false 2024-09-13T17:52:29.872 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records in 2024-09-13T17:52:29.873 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records out 2024-09-13T17:52:29.873 INFO:teuthology.orchestra.run.smithi114.stderr:71 bytes copied, 6.1544e-05 s, 1.2 MB/s 2024-09-13T17:52:29.874 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-09-13T17:52:29.874 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T17:52:29.874 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T17:52:29.874 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:52:30.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.056+0000 7fcb12600640 1 Processor -- start 2024-09-13T17:52:30.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.056+0000 7fcb12600640 1 -- start start 2024-09-13T17:52:30.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.060+0000 7fcb12600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcb0c0ce0b0 0x7fcb0c15e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:30.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.060+0000 7fcb12600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb0c15e9f0 con 0x7fcb0c15a650 2024-09-13T17:52:30.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.060+0000 7fcb12600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb0c0ce540 con 0x7fcb0c15e5f0 2024-09-13T17:52:30.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.060+0000 7fcb12600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb0c15ba40 con 0x7fcb0c0ce0b0 2024-09-13T17:52:30.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.060+0000 7fcb02a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcb0c0ce0b0 0x7fcb0c15e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:30.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.060+0000 7fcb02a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcb0c0ce0b0 0x7fcb0c15e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49758/0 (socket says 172.21.15.114:49758) 2024-09-13T17:52:30.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.060+0000 7fcb02a00640 1 -- 172.21.15.114:0/2160929833 learned_addr learned my addr 172.21.15.114:0/2160929833 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:30.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.060+0000 7fcb02a00640 1 -- 172.21.15.114:0/2160929833 >> v1:172.21.15.134:6789/0 conn(0x7fcb0c15e5f0 legacy=0x7fcb0c0cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:30.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.060+0000 7fcb02a00640 1 -- 172.21.15.114:0/2160929833 >> v1:172.21.15.114:6789/0 conn(0x7fcb0c15a650 legacy=0x7fcb0c099480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:30.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.060+0000 7fcb02a00640 1 -- 172.21.15.114:0/2160929833 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0c0ce820 con 0x7fcb0c0ce0b0 2024-09-13T17:52:30.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.064+0000 7fcb02a00640 1 --2- 172.21.15.114:0/2160929833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb0c0ce0b0 0x7fcb0c15e0b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4009870 tx=0x7fcaf401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc4c1881dea9643 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:30.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.064+0000 7fcb0aa00640 1 -- 172.21.15.114:0/2160929833 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf40aa5f0 con 0x7fcb0c0ce0b0 2024-09-13T17:52:30.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.064+0000 7fcb0aa00640 1 -- 172.21.15.114:0/2160929833 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf40aa750 con 0x7fcb0c0ce0b0 2024-09-13T17:52:30.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.064+0000 7fcb0aa00640 1 -- 172.21.15.114:0/2160929833 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf40aaae0 con 0x7fcb0c0ce0b0 2024-09-13T17:52:30.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.064+0000 7fcb12600640 1 -- 172.21.15.114:0/2160929833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb0c0ce0b0 msgr2=0x7fcb0c15e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:30.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.064+0000 7fcb12600640 1 --2- 172.21.15.114:0/2160929833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb0c0ce0b0 0x7fcb0c15e0b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4009870 tx=0x7fcaf401c490 comp rx=0 tx=0).stop 2024-09-13T17:52:30.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.064+0000 7fcb12600640 1 -- 172.21.15.114:0/2160929833 shutdown_connections 2024-09-13T17:52:30.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.064+0000 7fcb12600640 1 --2- 172.21.15.114:0/2160929833 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb0c0ce0b0 0x7fcb0c15e0b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:30.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.064+0000 7fcb12600640 1 -- 172.21.15.114:0/2160929833 >> 172.21.15.114:0/2160929833 conn(0x7fcb0c0d04e0 msgr2=0x7fcb0c0d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:30.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.064+0000 7fcb12600640 1 -- 172.21.15.114:0/2160929833 shutdown_connections 2024-09-13T17:52:30.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.064+0000 7fcb12600640 1 -- 172.21.15.114:0/2160929833 wait complete. 2024-09-13T17:52:30.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.064+0000 7fcb12600640 1 Processor -- start 2024-09-13T17:52:30.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.064+0000 7fcb12600640 1 -- start start 2024-09-13T17:52:30.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.068+0000 7fcb12600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb0c15a650 0x7fcb0c156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:30.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.068+0000 7fcb12600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb0c15e5f0 0x7fcb0c06b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:30.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.068+0000 7fcb12600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb0c06b5d0 0x7fcb0c0b1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:30.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.068+0000 7fcb12600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c158dd0 con 0x7fcb0c15a650 2024-09-13T17:52:30.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.068+0000 7fcb12600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c06bac0 con 0x7fcb0c06b5d0 2024-09-13T17:52:30.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.068+0000 7fcb12600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c158430 con 0x7fcb0c15e5f0 2024-09-13T17:52:30.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.068+0000 7fcb0b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb0c15a650 0x7fcb0c156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:30.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.068+0000 7fcb0b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb0c15a650 0x7fcb0c156b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49774/0 (socket says 172.21.15.114:49774) 2024-09-13T17:52:30.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.068+0000 7fcb0b400640 1 -- 172.21.15.114:0/796167792 learned_addr learned my addr 172.21.15.114:0/796167792 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:30.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.068+0000 7fcb0be00640 1 --2- 172.21.15.114:0/796167792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb0c06b5d0 0x7fcb0c0b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:30.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.068+0000 7fcb02a00640 1 --2- 172.21.15.114:0/796167792 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb0c15e5f0 0x7fcb0c06b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:30.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.068+0000 7fcb0b400640 1 -- 172.21.15.114:0/796167792 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb0c15e5f0 msgr2=0x7fcb0c06b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:30.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.068+0000 7fcb0b400640 1 --2- 172.21.15.114:0/796167792 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb0c15e5f0 0x7fcb0c06b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:30.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.068+0000 7fcb0b400640 1 -- 172.21.15.114:0/796167792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb0c06b5d0 msgr2=0x7fcb0c0b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:30.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.068+0000 7fcb0b400640 1 --2- 172.21.15.114:0/796167792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb0c06b5d0 0x7fcb0c0b1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:30.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.068+0000 7fcb0b400640 1 -- 172.21.15.114:0/796167792 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf40094d0 con 0x7fcb0c15a650 2024-09-13T17:52:30.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.068+0000 7fcb0b400640 1 --2- 172.21.15.114:0/796167792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb0c15a650 0x7fcb0c156b60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcafc00c500 tx=0x7fcafc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:30.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.068+0000 7fcb03e00640 1 -- 172.21.15.114:0/796167792 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc005220 con 0x7fcb0c15a650 2024-09-13T17:52:30.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.068+0000 7fcb03e00640 1 -- 172.21.15.114:0/796167792 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcafc005380 con 0x7fcb0c15a650 2024-09-13T17:52:30.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.068+0000 7fcb12600640 1 -- 172.21.15.114:0/796167792 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb0c158710 con 0x7fcb0c15a650 2024-09-13T17:52:30.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.068+0000 7fcb03e00640 1 -- 172.21.15.114:0/796167792 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc007270 con 0x7fcb0c15a650 2024-09-13T17:52:30.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.068+0000 7fcb12600640 1 -- 172.21.15.114:0/796167792 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb0c1570a0 con 0x7fcb0c15a650 2024-09-13T17:52:30.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.068+0000 7fcb12600640 1 -- 172.21.15.114:0/796167792 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb0c15e0b0 con 0x7fcb0c15a650 2024-09-13T17:52:30.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.068+0000 7fcb03e00640 1 -- 172.21.15.114:0/796167792 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcafc0073d0 con 0x7fcb0c15a650 2024-09-13T17:52:30.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.068+0000 7fcb03e00640 1 --2- 172.21.15.114:0/796167792 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fcae8066690 0x7fcae8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:30.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.072+0000 7fcb03e00640 1 -- 172.21.15.114:0/796167792 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcafc083e10 con 0x7fcb0c15a650 2024-09-13T17:52:30.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.072+0000 7fcb02a00640 1 --2- 172.21.15.114:0/796167792 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fcae8066690 0x7fcae8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:30.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.072+0000 7fcb02a00640 1 --2- 172.21.15.114:0/796167792 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fcae8066690 0x7fcae8068b50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcaf40ae000 tx=0x7fcaf40a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:30.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.076+0000 7fcb03e00640 1 -- 172.21.15.114:0/796167792 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcafc087030 con 0x7fcb0c15a650 2024-09-13T17:52:30.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.268+0000 7fcb12600640 1 -- 172.21.15.114:0/796167792 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcb0c0d10c0 con 0x7fcb0c15a650 2024-09-13T17:52:30.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.272+0000 7fcb03e00640 1 -- 172.21.15.114:0/796167792 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fcafc050e00 con 0x7fcb0c15a650 2024-09-13T17:52:30.274 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T17:52:30.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.272+0000 7fcb12600640 1 -- 172.21.15.114:0/796167792 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fcae8066690 msgr2=0x7fcae8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:30.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.272+0000 7fcb12600640 1 --2- 172.21.15.114:0/796167792 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fcae8066690 0x7fcae8068b50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcaf40ae000 tx=0x7fcaf40a7000 comp rx=0 tx=0).stop 2024-09-13T17:52:30.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.272+0000 7fcb12600640 1 -- 172.21.15.114:0/796167792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb0c15a650 msgr2=0x7fcb0c156b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:30.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.272+0000 7fcb12600640 1 --2- 172.21.15.114:0/796167792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb0c15a650 0x7fcb0c156b60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcafc00c500 tx=0x7fcafc00c9c0 comp rx=0 tx=0).stop 2024-09-13T17:52:30.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.272+0000 7fcb12600640 1 -- 172.21.15.114:0/796167792 shutdown_connections 2024-09-13T17:52:30.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.272+0000 7fcb12600640 1 --2- 172.21.15.114:0/796167792 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fcae8066690 0x7fcae8068b50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:30.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.272+0000 7fcb12600640 1 --2- 172.21.15.114:0/796167792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb0c06b5d0 0x7fcb0c0b1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:30.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.272+0000 7fcb12600640 1 --2- 172.21.15.114:0/796167792 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcb0c15e5f0 0x7fcb0c06b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:30.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.272+0000 7fcb12600640 1 --2- 172.21.15.114:0/796167792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcb0c15a650 0x7fcb0c156b60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:30.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.272+0000 7fcb12600640 1 -- 172.21.15.114:0/796167792 >> 172.21.15.114:0/796167792 conn(0x7fcb0c0d04e0 msgr2=0x7fcb0c0d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:30.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.272+0000 7fcb12600640 1 -- 172.21.15.114:0/796167792 shutdown_connections 2024-09-13T17:52:30.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:30.272+0000 7fcb12600640 1 -- 172.21.15.114:0/796167792 wait complete. 2024-09-13T17:52:30.295 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:52:30.295 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:52:30.295 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2024-09-13T17:52:30.295 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T17:52:30.295 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T17:52:30.295 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:52:30.295 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:52:30.295 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:52:30.295 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:52:30.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:30.295 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2024-09-13T17:52:30.305 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:52:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:52:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:52:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-09-13T17:52:30.305 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:30.305 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:52:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:52:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2024-09-13T17:52:30.306 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:52:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:52:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2024-09-13T17:52:30.306 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:52:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:52:30.306 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:52:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:52:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:52:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42414sec preferred_lft 42414sec 2024-09-13T17:52:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link 2024-09-13T17:52:30.306 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:30.306 INFO:teuthology.orchestra.run.smithi134.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:52:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 02:42:ca:4e:17:43 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:52:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:52:30.307 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:30.307 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T17:52:30.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:30.308 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-09-13T17:52:30.308 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-13T17:52:30.308 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add name ceph-brx type bridge 2024-09-13T17:52:30.308 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip addr flush dev ceph-brx 2024-09-13T17:52:30.308 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set ceph-brx up 2024-09-13T17:52:30.308 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T17:52:30.308 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-13T17:52:30.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:30.422 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:52:30.441 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-09-13T17:52:30.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:30.443 DEBUG:teuthology.orchestra.run.smithi134:> route 2024-09-13T17:52:30.518 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2024-09-13T17:52:30.518 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:52:30.518 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:52:30.518 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:52:30.518 INFO:teuthology.orchestra.run.smithi134.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-13T17:52:30.518 INFO:teuthology.orchestra.run.smithi134.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:52:30.518 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T17:52:30.518 INFO:teuthology.orchestra.run.smithi134.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:52:30.518 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:52:30.518 INFO:teuthology.orchestra.run.smithi134.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:52:30.518 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:52:30.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:30.519 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-09-13T17:52:30.519 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-13T17:52:30.519 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:52:30.519 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:52:30.519 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:52:30.519 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-13T17:52:30.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:30.611 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-09-13T17:52:30.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:30.621 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list-id 2024-09-13T17:52:30.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:30.674 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-09-13T17:52:30.674 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-13T17:52:30.674 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:52:30.674 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-13T17:52:30.674 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-13T17:52:30.759 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-13T17:52:30.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:30.760 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-09-13T17:52:30.760 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-13T17:52:30.760 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-13T17:52:30.760 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T17:52:30.760 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-13T17:52:30.760 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-13T17:52:30.760 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-13T17:52:30.760 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-13T17:52:30.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:30.928 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-09-13T17:52:30.929 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-13T17:52:30.929 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2024-09-13T17:52:30.929 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T17:52:30.929 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-13T17:52:30.969 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:52:30.969 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T17:52:31.017 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T17:52:31.018 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:52:31.018 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:52:31.068 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-13T17:52:31.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:31.069 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T17:52:31.165 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T17:52:31.165 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T17:52:31.877 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T17:52:31.878 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T17:52:31.878 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.134:3300,172.21.15.134:3301" 2024-09-13T17:52:31.878 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with new device syntax: 1@d730423f-882d-4061-b746-f6a7dc2544e0.cephfs=/ 2024-09-13T17:52:31.878 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.114:3300/172.21.15.134:3300/172.21.15.134:3301" will pass to kernel 2024-09-13T17:52:31.881 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T17:52:31.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:31.882 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T17:52:31.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:31.901 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:52:31.967 INFO:teuthology.orchestra.run.smithi134.stdout:client4643 2024-09-13T17:52:31.967 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:52:31.967 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:52:32.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:32.021 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:52:32.079 INFO:teuthology.orchestra.run.smithi134.stdout:client4643 2024-09-13T17:52:32.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:32.080 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:52:32.131 INFO:teuthology.orchestra.run.smithi134.stdout:client4643 2024-09-13T17:52:32.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:32.132 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/d730423f-882d-4061-b746-f6a7dc2544e0.client4643/status') 2024-09-13T17:52:32.196 INFO:teuthology.orchestra.run.smithi134.stdout:instance: client.4643 (3)192.168.0.1:0/4016208327 2024-09-13T17:52:32.196 INFO:teuthology.orchestra.run.smithi134.stdout:blocklisted: false 2024-09-13T17:52:32.197 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records in 2024-09-13T17:52:32.197 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records out 2024-09-13T17:52:32.197 INFO:teuthology.orchestra.run.smithi134.stderr:69 bytes copied, 5.4508e-05 s, 1.3 MB/s 2024-09-13T17:52:32.198 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-09-13T17:52:32.198 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T17:52:32.199 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-13T17:52:32.199 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:52:32.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.340+0000 7fb4ee000640 1 Processor -- start 2024-09-13T17:52:32.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.340+0000 7fb4ee000640 1 -- start start 2024-09-13T17:52:32.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.344+0000 7fb4ee000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb4e813c240 0x7fb4e813f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:32.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.344+0000 7fb4ee000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4e806dc60 0x7fb4e80cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:32.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.344+0000 7fb4ee000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e80cd220 con 0x7fb4e813c980 2024-09-13T17:52:32.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.344+0000 7fb4ee000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e813f960 con 0x7fb4e813c240 2024-09-13T17:52:32.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.344+0000 7fb4ee000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e815a740 con 0x7fb4e806dc60 2024-09-13T17:52:32.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.344+0000 7fb4dea00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb4e813c980 0x7fb4e806d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46206/0 (socket says 172.21.15.114:46206) 2024-09-13T17:52:32.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.344+0000 7fb4dea00640 1 -- 172.21.15.114:0/1077851540 learned_addr learned my addr 172.21.15.114:0/1077851540 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:32.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.344+0000 7fb4e7e00640 1 --2- 172.21.15.114:0/1077851540 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4e806dc60 0x7fb4e80cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:32.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.344+0000 7fb4e7400640 1 --2- 172.21.15.114:0/1077851540 >> v2:172.21.15.134:3300/0 conn(0x7fb4e813c240 0x7fb4e813f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:32.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.344+0000 7fb4e6a00640 1 -- 172.21.15.114:0/1077851540 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2413303877 0 0) 0x7fb4e80cd220 con 0x7fb4e813c980 2024-09-13T17:52:32.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.344+0000 7fb4e6a00640 1 -- 172.21.15.114:0/1077851540 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4cc005740 con 0x7fb4e813c980 2024-09-13T17:52:32.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.344+0000 7fb4e7e00640 1 -- 172.21.15.114:0/1077851540 >> v2:172.21.15.134:3300/0 conn(0x7fb4e813c240 msgr2=0x7fb4e813f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:32.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.344+0000 7fb4e7e00640 1 --2- 172.21.15.114:0/1077851540 >> v2:172.21.15.134:3300/0 conn(0x7fb4e813c240 0x7fb4e813f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:32.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.344+0000 7fb4e7e00640 1 -- 172.21.15.114:0/1077851540 >> v1:172.21.15.114:6789/0 conn(0x7fb4e813c980 legacy=0x7fb4e806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:32.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.344+0000 7fb4e7e00640 1 -- 172.21.15.114:0/1077851540 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e8159bc0 con 0x7fb4e806dc60 2024-09-13T17:52:32.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.348+0000 7fb4e7e00640 1 --2- 172.21.15.114:0/1077851540 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4e806dc60 0x7fb4e80cd650 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0009d90 tx=0x7fb4e001c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d6a2c6d956de418 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:32.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.348+0000 7fb4e6a00640 1 -- 172.21.15.114:0/1077851540 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e00a5a00 con 0x7fb4e806dc60 2024-09-13T17:52:32.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.348+0000 7fb4e6a00640 1 -- 172.21.15.114:0/1077851540 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e00a5b60 con 0x7fb4e806dc60 2024-09-13T17:52:32.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.348+0000 7fb4e6a00640 1 -- 172.21.15.114:0/1077851540 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e00ad440 con 0x7fb4e806dc60 2024-09-13T17:52:32.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.348+0000 7fb4ee000640 1 -- 172.21.15.114:0/1077851540 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4e806dc60 msgr2=0x7fb4e80cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:32.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.348+0000 7fb4ee000640 1 --2- 172.21.15.114:0/1077851540 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4e806dc60 0x7fb4e80cd650 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0009d90 tx=0x7fb4e001c940 comp rx=0 tx=0).stop 2024-09-13T17:52:32.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.348+0000 7fb4ee000640 1 -- 172.21.15.114:0/1077851540 shutdown_connections 2024-09-13T17:52:32.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.348+0000 7fb4ee000640 1 --2- 172.21.15.114:0/1077851540 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4e806dc60 0x7fb4e80cd650 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:32.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.348+0000 7fb4ee000640 1 --2- 172.21.15.114:0/1077851540 >> v2:172.21.15.134:3300/0 conn(0x7fb4e813c240 0x7fb4e813f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:32.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.348+0000 7fb4ee000640 1 -- 172.21.15.114:0/1077851540 >> 172.21.15.114:0/1077851540 conn(0x7fb4e80660b0 msgr2=0x7fb4e8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:32.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.348+0000 7fb4ee000640 1 -- 172.21.15.114:0/1077851540 shutdown_connections 2024-09-13T17:52:32.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.348+0000 7fb4ee000640 1 -- 172.21.15.114:0/1077851540 wait complete. 2024-09-13T17:52:32.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.348+0000 7fb4ee000640 1 Processor -- start 2024-09-13T17:52:32.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.348+0000 7fb4ee000640 1 -- start start 2024-09-13T17:52:32.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.352+0000 7fb4ee000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4e806dc60 0x7fb4e80ac3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:32.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.352+0000 7fb4ee000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4e813c240 0x7fb4e81563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:32.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.352+0000 7fb4ee000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4e813c980 0x7fb4e80af200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:32.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.352+0000 7fb4ee000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80ac8f0 con 0x7fb4e813c240 2024-09-13T17:52:32.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.352+0000 7fb4ee000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e8155070 con 0x7fb4e813c980 2024-09-13T17:52:32.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.352+0000 7fb4ee000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e8155350 con 0x7fb4e806dc60 2024-09-13T17:52:32.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.352+0000 7fb4e7400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4e806dc60 0x7fb4e80ac3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:32.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.352+0000 7fb4dea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4e813c240 0x7fb4e81563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:32.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.352+0000 7fb4e7e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4e813c980 0x7fb4e80af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:32.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.352+0000 7fb4e7400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4e806dc60 0x7fb4e80ac3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:59426/0 (socket says 172.21.15.114:59426) 2024-09-13T17:52:32.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.352+0000 7fb4dea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4e813c240 0x7fb4e81563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55770/0 (socket says 172.21.15.114:55770) 2024-09-13T17:52:32.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.352+0000 7fb4dea00640 1 -- 172.21.15.114:0/1345357302 learned_addr learned my addr 172.21.15.114:0/1345357302 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:32.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.352+0000 7fb4dea00640 1 -- 172.21.15.114:0/1345357302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4e806dc60 msgr2=0x7fb4e80ac3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:32.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.352+0000 7fb4dea00640 1 --2- 172.21.15.114:0/1345357302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4e806dc60 0x7fb4e80ac3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:32.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.352+0000 7fb4dea00640 1 -- 172.21.15.114:0/1345357302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4e813c980 msgr2=0x7fb4e80af200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:32.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.352+0000 7fb4dea00640 1 --2- 172.21.15.114:0/1345357302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4e813c980 0x7fb4e80af200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:32.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.352+0000 7fb4dea00640 1 -- 172.21.15.114:0/1345357302 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e0009a70 con 0x7fb4e813c240 2024-09-13T17:52:32.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.352+0000 7fb4e7400640 1 --2- 172.21.15.114:0/1345357302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4e806dc60 0x7fb4e80ac3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:52:32.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.352+0000 7fb4dea00640 1 --2- 172.21.15.114:0/1345357302 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4e813c240 0x7fb4e81563f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb4d000c4d0 tx=0x7fb4d000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:32.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.352+0000 7fb4dfe00640 1 -- 172.21.15.114:0/1345357302 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0005cf0 con 0x7fb4e813c240 2024-09-13T17:52:32.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.352+0000 7fb4dfe00640 1 -- 172.21.15.114:0/1345357302 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d0005e50 con 0x7fb4e813c240 2024-09-13T17:52:32.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.352+0000 7fb4dfe00640 1 -- 172.21.15.114:0/1345357302 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0007270 con 0x7fb4e813c240 2024-09-13T17:52:32.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.352+0000 7fb4ee000640 1 -- 172.21.15.114:0/1345357302 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e8155630 con 0x7fb4e813c240 2024-09-13T17:52:32.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.352+0000 7fb4ee000640 1 -- 172.21.15.114:0/1345357302 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e8155bf0 con 0x7fb4e813c240 2024-09-13T17:52:32.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.352+0000 7fb4ee000640 1 -- 172.21.15.114:0/1345357302 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e81573b0 con 0x7fb4e813c240 2024-09-13T17:52:32.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.352+0000 7fb4dfe00640 1 -- 172.21.15.114:0/1345357302 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb4d00073d0 con 0x7fb4e813c240 2024-09-13T17:52:32.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.356+0000 7fb4dfe00640 1 --2- 172.21.15.114:0/1345357302 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb4c4066690 0x7fb4c4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:32.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.356+0000 7fb4dfe00640 1 -- 172.21.15.114:0/1345357302 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb4d0083a60 con 0x7fb4e813c240 2024-09-13T17:52:32.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.356+0000 7fb4e7400640 1 --2- 172.21.15.114:0/1345357302 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb4c4066690 0x7fb4c4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:32.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.356+0000 7fb4e7400640 1 --2- 172.21.15.114:0/1345357302 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb4c4066690 0x7fb4c4068b50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8009f50 tx=0x7fb4d8009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:32.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.360+0000 7fb4dfe00640 1 -- 172.21.15.114:0/1345357302 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb4d0050ab0 con 0x7fb4e813c240 2024-09-13T17:52:32.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.544+0000 7fb4ee000640 1 -- 172.21.15.114:0/1345357302 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb4e8159820 con 0x7fb4e813c240 2024-09-13T17:52:32.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.544+0000 7fb4dfe00640 1 -- 172.21.15.114:0/1345357302 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fb4d00540d0 con 0x7fb4e813c240 2024-09-13T17:52:32.548 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T17:52:32.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.548+0000 7fb4ee000640 1 -- 172.21.15.114:0/1345357302 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb4c4066690 msgr2=0x7fb4c4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:32.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.548+0000 7fb4ee000640 1 --2- 172.21.15.114:0/1345357302 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb4c4066690 0x7fb4c4068b50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8009f50 tx=0x7fb4d8009190 comp rx=0 tx=0).stop 2024-09-13T17:52:32.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.548+0000 7fb4ee000640 1 -- 172.21.15.114:0/1345357302 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4e813c240 msgr2=0x7fb4e81563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:32.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.548+0000 7fb4ee000640 1 --2- 172.21.15.114:0/1345357302 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4e813c240 0x7fb4e81563f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb4d000c4d0 tx=0x7fb4d000c990 comp rx=0 tx=0).stop 2024-09-13T17:52:32.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.548+0000 7fb4ee000640 1 -- 172.21.15.114:0/1345357302 shutdown_connections 2024-09-13T17:52:32.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.548+0000 7fb4ee000640 1 --2- 172.21.15.114:0/1345357302 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb4c4066690 0x7fb4c4068b50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:32.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.548+0000 7fb4ee000640 1 --2- 172.21.15.114:0/1345357302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4e813c980 0x7fb4e80af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:32.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.548+0000 7fb4ee000640 1 --2- 172.21.15.114:0/1345357302 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb4e813c240 0x7fb4e81563f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:32.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.548+0000 7fb4ee000640 1 --2- 172.21.15.114:0/1345357302 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb4e806dc60 0x7fb4e80ac3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:32.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.548+0000 7fb4ee000640 1 -- 172.21.15.114:0/1345357302 >> 172.21.15.114:0/1345357302 conn(0x7fb4e80660b0 msgr2=0x7fb4e8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:32.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.548+0000 7fb4ee000640 1 -- 172.21.15.114:0/1345357302 shutdown_connections 2024-09-13T17:52:32.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:32.548+0000 7fb4ee000640 1 -- 172.21.15.114:0/1345357302 wait complete. 2024-09-13T17:52:32.569 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T17:52:32.569 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:52:32.569 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2024-09-13T17:52:32.569 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-13T17:52:32.570 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-13T17:52:32.570 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T17:52:32.570 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T17:52:32.570 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:52:32.570 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-13T17:52:32.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:32.570 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2024-09-13T17:52:32.579 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:52:32.579 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:52:32.579 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:52:32.579 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:32.579 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-09-13T17:52:32.580 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:32.580 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:52:32.580 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:52:32.580 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2024-09-13T17:52:32.580 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:52:32.580 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:52:32.580 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2024-09-13T17:52:32.580 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:52:32.580 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:52:32.580 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:52:32.581 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:52:32.581 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:52:32.581 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42412sec preferred_lft 42412sec 2024-09-13T17:52:32.581 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link 2024-09-13T17:52:32.581 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:32.581 INFO:teuthology.orchestra.run.smithi134.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:52:32.581 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 02:42:ca:4e:17:43 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:52:32.581 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:52:32.581 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:32.581 INFO:teuthology.orchestra.run.smithi134.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:52:32.581 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T17:52:32.582 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:52:32.582 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:32.582 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2024-09-13T17:52:32.582 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:32.582 INFO:teuthology.orchestra.run.smithi134.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:52:32.582 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:52:32.582 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T17:52:32.582 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:32.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:32.583 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:52:32.643 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-09-13T17:52:32.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:32.645 DEBUG:teuthology.orchestra.run.smithi134:> route 2024-09-13T17:52:32.701 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2024-09-13T17:52:32.701 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:52:32.701 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:52:32.701 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:52:32.701 INFO:teuthology.orchestra.run.smithi134.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-13T17:52:32.701 INFO:teuthology.orchestra.run.smithi134.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:52:32.702 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T17:52:32.702 INFO:teuthology.orchestra.run.smithi134.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:52:32.702 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:52:32.702 INFO:teuthology.orchestra.run.smithi134.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:52:32.702 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:52:32.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:32.702 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-09-13T17:52:32.703 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-13T17:52:32.703 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:52:32.703 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:52:32.703 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:52:32.703 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-13T17:52:32.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:32.797 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-09-13T17:52:32.845 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T17:52:32.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:32.846 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list-id 2024-09-13T17:52:32.897 INFO:teuthology.orchestra.run.smithi134.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-13T17:52:32.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:32.898 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-09-13T17:52:32.898 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-13T17:52:32.898 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T17:52:32.898 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-13T17:52:32.898 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-13T17:52:32.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:32.979 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-13T17:52:33.045 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:52:33.046 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:52:33.046 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:52:33.046 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:33.046 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-09-13T17:52:33.046 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:33.046 INFO:teuthology.orchestra.run.smithi134.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:52:33.047 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 1e:4f:3a:e3:42:67 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T17:52:33.047 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T17:52:33.047 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:33.047 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::1c4f:3aff:fee3:4267/64 scope link 2024-09-13T17:52:33.047 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:33.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:33.049 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-13T17:52:33.108 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:52:33.109 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:52:33.109 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:52:33.109 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:33.109 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-09-13T17:52:33.109 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:33.109 INFO:teuthology.orchestra.run.smithi134.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:52:33.109 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 1e:4f:3a:e3:42:67 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T17:52:33.109 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T17:52:33.109 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:33.109 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::1c4f:3aff:fee3:4267/64 scope link 2024-09-13T17:52:33.109 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:52:33.111 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-13T17:52:33.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:33.111 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-09-13T17:52:33.111 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-13T17:52:33.111 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-13T17:52:33.111 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-13T17:52:33.111 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-13T17:52:33.111 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-13T17:52:33.112 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-13T17:52:33.112 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-13T17:52:33.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:33.246 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-09-13T17:52:33.246 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-09-13T17:52:33.246 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.1 up 2024-09-13T17:52:33.246 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set dev brx.1 master ceph-brx 2024-09-13T17:52:33.246 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-09-13T17:52:33.284 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:52:33.284 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-13T17:52:33.333 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-13T17:52:33.334 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:52:33.334 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-13T17:52:33.384 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-09-13T17:52:33.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:33.384 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T17:52:33.473 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T17:52:33.473 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T17:52:33.486 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T17:52:33.486 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T17:52:33.486 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.134:3300,172.21.15.134:3301" 2024-09-13T17:52:33.486 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with new device syntax: 3@d730423f-882d-4061-b746-f6a7dc2544e0.cephfs=/ 2024-09-13T17:52:33.486 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.114:3300/172.21.15.134:3300/172.21.15.134:3301" will pass to kernel 2024-09-13T17:52:33.490 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T17:52:33.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:33.490 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-13T17:52:33.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:33.509 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:52:33.564 INFO:teuthology.orchestra.run.smithi134.stdout:client4652 2024-09-13T17:52:33.564 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:52:33.564 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:52:33.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:33.618 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:52:33.672 INFO:teuthology.orchestra.run.smithi134.stdout:client4652 2024-09-13T17:52:33.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:33.672 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:52:33.723 INFO:teuthology.orchestra.run.smithi134.stdout:client4652 2024-09-13T17:52:33.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:33.724 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/d730423f-882d-4061-b746-f6a7dc2544e0.client4652/status') 2024-09-13T17:52:33.788 INFO:teuthology.orchestra.run.smithi134.stdout:instance: client.4652 (3)192.168.0.2:0/3263986831 2024-09-13T17:52:33.788 INFO:teuthology.orchestra.run.smithi134.stdout:blocklisted: false 2024-09-13T17:52:33.788 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records in 2024-09-13T17:52:33.788 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records out 2024-09-13T17:52:33.788 INFO:teuthology.orchestra.run.smithi134.stderr:69 bytes copied, 5.2609e-05 s, 1.3 MB/s 2024-09-13T17:52:33.790 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-13T17:52:33.809 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:52:33.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.956+0000 7f4eb2800640 1 Processor -- start 2024-09-13T17:52:33.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.956+0000 7f4eb2800640 1 -- start start 2024-09-13T17:52:33.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.956+0000 7f4eb2800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eac070420 0x7f4eac070860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:33.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.956+0000 7f4eb2800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4eac06c540 0x7f4eac06c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:33.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.956+0000 7f4eb2800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eac070da0 con 0x7f4eac151420 2024-09-13T17:52:33.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.956+0000 7f4eb2800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eac0cbc30 con 0x7f4eac06c540 2024-09-13T17:52:33.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.956+0000 7f4eb2800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac151800 con 0x7f4eac070420 2024-09-13T17:52:33.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.956+0000 7f4eabe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4eac06c540 0x7f4eac06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:33.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.956+0000 7f4eab400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4eac151420 0x7f4eac0cc660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46222/0 (socket says 172.21.15.114:46222) 2024-09-13T17:52:33.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.956+0000 7f4eabe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4eac06c540 0x7f4eac06c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55786/0 (socket says 172.21.15.114:55786) 2024-09-13T17:52:33.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.956+0000 7f4eab400640 1 -- 172.21.15.114:0/3455963900 learned_addr learned my addr 172.21.15.114:0/3455963900 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:33.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.956+0000 7f4eaaa00640 1 --2- 172.21.15.114:0/3455963900 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eac070420 0x7f4eac070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:33.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.956+0000 7f4eabe00640 1 -- 172.21.15.114:0/3455963900 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eac070420 msgr2=0x7f4eac070860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:33.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.956+0000 7f4eabe00640 1 --2- 172.21.15.114:0/3455963900 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eac070420 0x7f4eac070860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:33.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.956+0000 7f4eabe00640 1 -- 172.21.15.114:0/3455963900 >> v1:172.21.15.114:6789/0 conn(0x7f4eac151420 legacy=0x7f4eac0cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:33.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.956+0000 7f4eabe00640 1 -- 172.21.15.114:0/3455963900 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eac0cafb0 con 0x7f4eac06c540 2024-09-13T17:52:33.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.956+0000 7f4eaa000640 1 -- 172.21.15.114:0/3455963900 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1063669930 0 0) 0x7f4eac070da0 con 0x7f4eac151420 2024-09-13T17:52:33.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.960+0000 7f4eabe00640 1 --2- 172.21.15.114:0/3455963900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4eac06c540 0x7f4eac06c990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4009d90 tx=0x7f4ea401c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba979daf85c1e95 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:33.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.960+0000 7f4eaa000640 1 -- 172.21.15.114:0/3455963900 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea40a58e0 con 0x7f4eac06c540 2024-09-13T17:52:33.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.960+0000 7f4eaa000640 1 -- 172.21.15.114:0/3455963900 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea40a5a40 con 0x7f4eac06c540 2024-09-13T17:52:33.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.960+0000 7f4eaa000640 1 -- 172.21.15.114:0/3455963900 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea40a5dd0 con 0x7f4eac06c540 2024-09-13T17:52:33.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.960+0000 7f4eb2800640 1 -- 172.21.15.114:0/3455963900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4eac06c540 msgr2=0x7f4eac06c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:33.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.960+0000 7f4eb2800640 1 --2- 172.21.15.114:0/3455963900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4eac06c540 0x7f4eac06c990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4009d90 tx=0x7f4ea401c820 comp rx=0 tx=0).stop 2024-09-13T17:52:33.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.960+0000 7f4eb2800640 1 -- 172.21.15.114:0/3455963900 shutdown_connections 2024-09-13T17:52:33.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.960+0000 7f4eb2800640 1 --2- 172.21.15.114:0/3455963900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4eac06c540 0x7f4eac06c990 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:33.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.960+0000 7f4eb2800640 1 --2- 172.21.15.114:0/3455963900 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eac070420 0x7f4eac070860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:33.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.960+0000 7f4eb2800640 1 -- 172.21.15.114:0/3455963900 >> 172.21.15.114:0/3455963900 conn(0x7f4eac0660b0 msgr2=0x7f4eac069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:33.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.960+0000 7f4eb2800640 1 -- 172.21.15.114:0/3455963900 shutdown_connections 2024-09-13T17:52:33.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.960+0000 7f4eb2800640 1 -- 172.21.15.114:0/3455963900 wait complete. 2024-09-13T17:52:33.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.964+0000 7f4eb2800640 1 Processor -- start 2024-09-13T17:52:33.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.964+0000 7f4eb2800640 1 -- start start 2024-09-13T17:52:33.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.964+0000 7f4eb2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4eac06c540 0x7f4eac0b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:33.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.964+0000 7f4eb2800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eac070420 0x7f4eac1591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:33.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.964+0000 7f4eb2800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4eac151420 0x7f4eac163470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:33.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.964+0000 7f4eb2800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac0b2730 con 0x7f4eac06c540 2024-09-13T17:52:33.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.964+0000 7f4eb2800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac14fce0 con 0x7f4eac151420 2024-09-13T17:52:33.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.964+0000 7f4eb2800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac0b1e00 con 0x7f4eac070420 2024-09-13T17:52:33.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.964+0000 7f4eab400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4eac06c540 0x7f4eac0b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:33.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.964+0000 7f4eab400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4eac06c540 0x7f4eac0b2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55798/0 (socket says 172.21.15.114:55798) 2024-09-13T17:52:33.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.964+0000 7f4eab400640 1 -- 172.21.15.114:0/4052489829 learned_addr learned my addr 172.21.15.114:0/4052489829 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:33.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.964+0000 7f4eaaa00640 1 --2- 172.21.15.114:0/4052489829 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eac070420 0x7f4eac1591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:33.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.964+0000 7f4eabe00640 1 --2- 172.21.15.114:0/4052489829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4eac151420 0x7f4eac163470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:33.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.964+0000 7f4eab400640 1 -- 172.21.15.114:0/4052489829 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eac070420 msgr2=0x7f4eac1591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:33.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.964+0000 7f4eab400640 1 --2- 172.21.15.114:0/4052489829 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eac070420 0x7f4eac1591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:33.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.964+0000 7f4eab400640 1 -- 172.21.15.114:0/4052489829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4eac151420 msgr2=0x7f4eac163470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:33.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.964+0000 7f4eab400640 1 --2- 172.21.15.114:0/4052489829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4eac151420 0x7f4eac163470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:33.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.964+0000 7f4eab400640 1 -- 172.21.15.114:0/4052489829 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea4009a70 con 0x7f4eac06c540 2024-09-13T17:52:33.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.964+0000 7f4eab400640 1 --2- 172.21.15.114:0/4052489829 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4eac06c540 0x7f4eac0b2bc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c0011f0 tx=0x7f4e9c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:33.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.964+0000 7f4ea3400640 1 -- 172.21.15.114:0/4052489829 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c0074e0 con 0x7f4eac06c540 2024-09-13T17:52:33.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.964+0000 7f4ea3400640 1 -- 172.21.15.114:0/4052489829 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9c007640 con 0x7f4eac06c540 2024-09-13T17:52:33.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.964+0000 7f4eb2800640 1 -- 172.21.15.114:0/4052489829 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eac0b20e0 con 0x7f4eac06c540 2024-09-13T17:52:33.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.964+0000 7f4ea3400640 1 -- 172.21.15.114:0/4052489829 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c004a10 con 0x7f4eac06c540 2024-09-13T17:52:33.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.964+0000 7f4eb2800640 1 -- 172.21.15.114:0/4052489829 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eac14bdb0 con 0x7f4eac06c540 2024-09-13T17:52:33.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.968+0000 7f4eb2800640 1 -- 172.21.15.114:0/4052489829 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eac06c990 con 0x7f4eac06c540 2024-09-13T17:52:33.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.968+0000 7f4ea3400640 1 -- 172.21.15.114:0/4052489829 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4e9c004b70 con 0x7f4eac06c540 2024-09-13T17:52:33.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.968+0000 7f4ea3400640 1 --2- 172.21.15.114:0/4052489829 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4e8c0666c0 0x7f4e8c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:33.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.968+0000 7f4ea3400640 1 -- 172.21.15.114:0/4052489829 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4e9c083a10 con 0x7f4eac06c540 2024-09-13T17:52:33.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.968+0000 7f4eaaa00640 1 --2- 172.21.15.114:0/4052489829 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4e8c0666c0 0x7f4e8c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:33.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.968+0000 7f4eaaa00640 1 --2- 172.21.15.114:0/4052489829 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4e8c0666c0 0x7f4e8c068b80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4eac1f8480 tx=0x7f4e98009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:33.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:33.972+0000 7f4ea3400640 1 -- 172.21.15.114:0/4052489829 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4e9c050a60 con 0x7f4eac06c540 2024-09-13T17:52:34.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.128+0000 7f4eb2800640 1 -- 172.21.15.114:0/4052489829 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4eac0713e0 con 0x7f4eac06c540 2024-09-13T17:52:34.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.128+0000 7f4ea3400640 1 -- 172.21.15.114:0/4052489829 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18784 (secure 0 0 0) 0x7f4e9c018090 con 0x7f4eac06c540 2024-09-13T17:52:34.131 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:34.132 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:52:31.139000+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:51:48.278220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:51:48.773888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:51:51.856300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:52:34.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.128+0000 7f4eb2800640 1 -- 172.21.15.114:0/4052489829 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4e8c0666c0 msgr2=0x7f4e8c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:34.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.128+0000 7f4eb2800640 1 --2- 172.21.15.114:0/4052489829 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4e8c0666c0 0x7f4e8c068b80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4eac1f8480 tx=0x7f4e98009190 comp rx=0 tx=0).stop 2024-09-13T17:52:34.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.128+0000 7f4eb2800640 1 -- 172.21.15.114:0/4052489829 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4eac06c540 msgr2=0x7f4eac0b2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:34.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.128+0000 7f4eb2800640 1 --2- 172.21.15.114:0/4052489829 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4eac06c540 0x7f4eac0b2bc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c0011f0 tx=0x7f4e9c00c9b0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.132+0000 7f4eb2800640 1 -- 172.21.15.114:0/4052489829 shutdown_connections 2024-09-13T17:52:34.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.132+0000 7f4eb2800640 1 --2- 172.21.15.114:0/4052489829 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4e8c0666c0 0x7f4e8c068b80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.132+0000 7f4eb2800640 1 --2- 172.21.15.114:0/4052489829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4eac151420 0x7f4eac163470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.132+0000 7f4eb2800640 1 --2- 172.21.15.114:0/4052489829 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eac070420 0x7f4eac1591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.132+0000 7f4eb2800640 1 --2- 172.21.15.114:0/4052489829 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4eac06c540 0x7f4eac0b2bc0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.132+0000 7f4eb2800640 1 -- 172.21.15.114:0/4052489829 >> 172.21.15.114:0/4052489829 conn(0x7f4eac0660b0 msgr2=0x7f4eac164330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:34.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.132+0000 7f4eb2800640 1 -- 172.21.15.114:0/4052489829 shutdown_connections 2024-09-13T17:52:34.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.132+0000 7f4eb2800640 1 -- 172.21.15.114:0/4052489829 wait complete. 2024-09-13T17:52:34.153 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:51:37.996254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:51:48.278220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:51:48.773888+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:51:51.856300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:52:34.153 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:52:34.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.288+0000 7f5c73c00640 1 Processor -- start 2024-09-13T17:52:34.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.288+0000 7f5c73c00640 1 -- start start 2024-09-13T17:52:34.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.288+0000 7f5c73c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5c6c13c240 0x7f5c6c13f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:34.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.288+0000 7f5c73c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c6c0cd220 con 0x7f5c6c13c980 2024-09-13T17:52:34.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.288+0000 7f5c73c00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c6c13f960 con 0x7f5c6c06dc60 2024-09-13T17:52:34.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.288+0000 7f5c73c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c6c15a740 con 0x7f5c6c13c240 2024-09-13T17:52:34.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.288+0000 7f5c71200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5c6c13c240 0x7f5c6c13f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:34.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.288+0000 7f5c71200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5c6c13c240 0x7f5c6c13f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55810/0 (socket says 172.21.15.114:55810) 2024-09-13T17:52:34.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.288+0000 7f5c71200640 1 -- 172.21.15.114:0/2479483273 learned_addr learned my addr 172.21.15.114:0/2479483273 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:34.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.292+0000 7f5c71200640 1 -- 172.21.15.114:0/2479483273 >> v1:172.21.15.134:6789/0 conn(0x7f5c6c06dc60 legacy=0x7f5c6c0cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:34.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.292+0000 7f5c71200640 1 -- 172.21.15.114:0/2479483273 >> v1:172.21.15.114:6789/0 conn(0x7f5c6c13c980 legacy=0x7f5c6c06d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:34.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.292+0000 7f5c71200640 1 -- 172.21.15.114:0/2479483273 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6c159bc0 con 0x7f5c6c13c240 2024-09-13T17:52:34.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.292+0000 7f5c6be00640 1 -- 172.21.15.114:0/2479483273 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3742540948 0 0) 0x7f5c6c0cd220 con 0x7f5c6c13c980 2024-09-13T17:52:34.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.292+0000 7f5c71200640 1 --2- 172.21.15.114:0/2479483273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c6c13c240 0x7f5c6c13f420 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c009870 tx=0x7f5c5c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a3c5d7c3962958 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:34.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.292+0000 7f5c6be00640 1 -- 172.21.15.114:0/2479483273 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c0a6040 con 0x7f5c6c13c240 2024-09-13T17:52:34.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.292+0000 7f5c6be00640 1 -- 172.21.15.114:0/2479483273 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5c0aa600 con 0x7f5c6c13c240 2024-09-13T17:52:34.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.292+0000 7f5c6be00640 1 -- 172.21.15.114:0/2479483273 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c0aa990 con 0x7f5c6c13c240 2024-09-13T17:52:34.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.292+0000 7f5c73c00640 1 -- 172.21.15.114:0/2479483273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c6c13c240 msgr2=0x7f5c6c13f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:34.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.292+0000 7f5c73c00640 1 --2- 172.21.15.114:0/2479483273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c6c13c240 0x7f5c6c13f420 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c009870 tx=0x7f5c5c01c4a0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.292+0000 7f5c73c00640 1 -- 172.21.15.114:0/2479483273 shutdown_connections 2024-09-13T17:52:34.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.292+0000 7f5c73c00640 1 --2- 172.21.15.114:0/2479483273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c6c13c240 0x7f5c6c13f420 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.292+0000 7f5c73c00640 1 -- 172.21.15.114:0/2479483273 >> 172.21.15.114:0/2479483273 conn(0x7f5c6c0660b0 msgr2=0x7f5c6c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:34.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.292+0000 7f5c73c00640 1 -- 172.21.15.114:0/2479483273 shutdown_connections 2024-09-13T17:52:34.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.292+0000 7f5c73c00640 1 -- 172.21.15.114:0/2479483273 wait complete. 2024-09-13T17:52:34.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.296+0000 7f5c73c00640 1 Processor -- start 2024-09-13T17:52:34.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.296+0000 7f5c73c00640 1 -- start start 2024-09-13T17:52:34.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.296+0000 7f5c73c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c6c06dc60 0x7f5c6c13e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:34.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.296+0000 7f5c73c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c6c13c240 0x7f5c6c13e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:34.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.296+0000 7f5c73c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c6c13c980 0x7f5c6c14f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:34.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.296+0000 7f5c73c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c15a8e0 con 0x7f5c6c06dc60 2024-09-13T17:52:34.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.296+0000 7f5c73c00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c0ad770 con 0x7f5c6c13c240 2024-09-13T17:52:34.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.296+0000 7f5c73c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c0acb60 con 0x7f5c6c13c980 2024-09-13T17:52:34.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.296+0000 7f5c71200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c6c06dc60 0x7f5c6c13e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:34.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.296+0000 7f5c71200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c6c06dc60 0x7f5c6c13e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55818/0 (socket says 172.21.15.114:55818) 2024-09-13T17:52:34.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.296+0000 7f5c71200640 1 -- 172.21.15.114:0/178505876 learned_addr learned my addr 172.21.15.114:0/178505876 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:34.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.296+0000 7f5c63e00640 1 --2- 172.21.15.114:0/178505876 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c6c13c240 0x7f5c6c13e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:34.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.296+0000 7f5c71c00640 1 --2- 172.21.15.114:0/178505876 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c6c13c980 0x7f5c6c14f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:34.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.296+0000 7f5c71200640 1 -- 172.21.15.114:0/178505876 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c6c13c980 msgr2=0x7f5c6c14f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:34.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.296+0000 7f5c71200640 1 --2- 172.21.15.114:0/178505876 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c6c13c980 0x7f5c6c14f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.296+0000 7f5c71200640 1 -- 172.21.15.114:0/178505876 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c6c13c240 msgr2=0x7f5c6c13e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:34.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.296+0000 7f5c71200640 1 --2- 172.21.15.114:0/178505876 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c6c13c240 0x7f5c6c13e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.296+0000 7f5c71200640 1 -- 172.21.15.114:0/178505876 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5c0094d0 con 0x7f5c6c06dc60 2024-09-13T17:52:34.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.296+0000 7f5c71c00640 1 --2- 172.21.15.114:0/178505876 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c6c13c980 0x7f5c6c14f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:34.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.296+0000 7f5c63e00640 1 --2- 172.21.15.114:0/178505876 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c6c13c240 0x7f5c6c13e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:34.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.296+0000 7f5c71200640 1 --2- 172.21.15.114:0/178505876 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c6c06dc60 0x7f5c6c13e030 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c01a0d0 tx=0x7f5c5c01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:34.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.296+0000 7f5c69600640 1 -- 172.21.15.114:0/178505876 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c004030 con 0x7f5c6c06dc60 2024-09-13T17:52:34.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.296+0000 7f5c69600640 1 -- 172.21.15.114:0/178505876 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5c0a6030 con 0x7f5c6c06dc60 2024-09-13T17:52:34.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.296+0000 7f5c73c00640 1 -- 172.21.15.114:0/178505876 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c6c0ace40 con 0x7f5c6c06dc60 2024-09-13T17:52:34.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.296+0000 7f5c69600640 1 -- 172.21.15.114:0/178505876 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c004390 con 0x7f5c6c06dc60 2024-09-13T17:52:34.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.296+0000 7f5c73c00640 1 -- 172.21.15.114:0/178505876 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c6c0ad400 con 0x7f5c6c06dc60 2024-09-13T17:52:34.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.300+0000 7f5c73c00640 1 -- 172.21.15.114:0/178505876 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c6c159790 con 0x7f5c6c06dc60 2024-09-13T17:52:34.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.300+0000 7f5c69600640 1 -- 172.21.15.114:0/178505876 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5c5c003620 con 0x7f5c6c06dc60 2024-09-13T17:52:34.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.300+0000 7f5c69600640 1 --2- 172.21.15.114:0/178505876 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5c48066690 0x7f5c48068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:34.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.300+0000 7f5c69600640 1 -- 172.21.15.114:0/178505876 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5c5c11eae0 con 0x7f5c6c06dc60 2024-09-13T17:52:34.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.300+0000 7f5c63e00640 1 --2- 172.21.15.114:0/178505876 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5c48066690 0x7f5c48068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:34.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.300+0000 7f5c63e00640 1 --2- 172.21.15.114:0/178505876 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5c48066690 0x7f5c48068b50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c150390 tx=0x7f5c54009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:34.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.304+0000 7f5c69600640 1 -- 172.21.15.114:0/178505876 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5c5c0eb9f0 con 0x7f5c6c06dc60 2024-09-13T17:52:34.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.456+0000 7f5c73c00640 1 -- 172.21.15.114:0/178505876 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5c6c15a4f0 con 0x7f5c6c06dc60 2024-09-13T17:52:34.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.456+0000 7f5c69600640 1 -- 172.21.15.114:0/178505876 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5c5c0b9020 con 0x7f5c6c06dc60 2024-09-13T17:52:34.462 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-13T17:52:34.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.460+0000 7f5c73c00640 1 -- 172.21.15.114:0/178505876 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5c48066690 msgr2=0x7f5c48068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:34.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.460+0000 7f5c73c00640 1 --2- 172.21.15.114:0/178505876 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5c48066690 0x7f5c48068b50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c150390 tx=0x7f5c54009040 comp rx=0 tx=0).stop 2024-09-13T17:52:34.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.460+0000 7f5c73c00640 1 -- 172.21.15.114:0/178505876 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c6c06dc60 msgr2=0x7f5c6c13e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:34.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.460+0000 7f5c73c00640 1 --2- 172.21.15.114:0/178505876 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c6c06dc60 0x7f5c6c13e030 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c01a0d0 tx=0x7f5c5c01ace0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.460+0000 7f5c73c00640 1 -- 172.21.15.114:0/178505876 shutdown_connections 2024-09-13T17:52:34.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.460+0000 7f5c73c00640 1 --2- 172.21.15.114:0/178505876 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5c48066690 0x7f5c48068b50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.460+0000 7f5c73c00640 1 --2- 172.21.15.114:0/178505876 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5c6c13c980 0x7f5c6c14f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.460+0000 7f5c73c00640 1 --2- 172.21.15.114:0/178505876 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c6c13c240 0x7f5c6c13e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.460+0000 7f5c73c00640 1 --2- 172.21.15.114:0/178505876 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c6c06dc60 0x7f5c6c13e030 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.460+0000 7f5c73c00640 1 -- 172.21.15.114:0/178505876 >> 172.21.15.114:0/178505876 conn(0x7f5c6c0660b0 msgr2=0x7f5c6c0ad9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:34.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.460+0000 7f5c73c00640 1 -- 172.21.15.114:0/178505876 shutdown_connections 2024-09-13T17:52:34.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.460+0000 7f5c73c00640 1 -- 172.21.15.114:0/178505876 wait complete. 2024-09-13T17:52:34.483 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:52:34.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.616+0000 7f172ce00640 1 Processor -- start 2024-09-13T17:52:34.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.616+0000 7f172ce00640 1 -- start start 2024-09-13T17:52:34.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.616+0000 7f172ce00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1728151420 0x7f17280cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:34.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.616+0000 7f172ce00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1728070b30 0x7f172806c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:34.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.616+0000 7f172ce00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1728151800 con 0x7f17280ccba0 2024-09-13T17:52:34.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.616+0000 7f172ce00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17280cbc30 con 0x7f1728070b30 2024-09-13T17:52:34.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.616+0000 7f172ce00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17280cafb0 con 0x7f1728151420 2024-09-13T17:52:34.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.620+0000 7f1726800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1728070b30 0x7f172806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:34.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.620+0000 7f1725e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1728151420 0x7f17280cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:34.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.620+0000 7f171d400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f17280ccba0 0x7f1728070420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46234/0 (socket says 172.21.15.114:46234) 2024-09-13T17:52:34.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.620+0000 7f171d400640 1 -- 172.21.15.114:0/1803089767 learned_addr learned my addr 172.21.15.114:0/1803089767 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:34.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.620+0000 7f1725400640 1 -- 172.21.15.114:0/1803089767 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1658585486 0 0) 0x7f1728151800 con 0x7f17280ccba0 2024-09-13T17:52:34.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.620+0000 7f1725400640 1 -- 172.21.15.114:0/1803089767 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f170c003530 con 0x7f17280ccba0 2024-09-13T17:52:34.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.620+0000 7f1726800640 1 -- 172.21.15.114:0/1803089767 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1728151420 msgr2=0x7f17280cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:34.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.620+0000 7f1726800640 1 --2- 172.21.15.114:0/1803089767 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1728151420 0x7f17280cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.620+0000 7f1726800640 1 -- 172.21.15.114:0/1803089767 >> v1:172.21.15.114:6789/0 conn(0x7f17280ccba0 legacy=0x7f1728070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:34.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.620+0000 7f1726800640 1 -- 172.21.15.114:0/1803089767 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17280cb290 con 0x7f1728070b30 2024-09-13T17:52:34.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.620+0000 7f1726800640 1 --2- 172.21.15.114:0/1803089767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1728070b30 0x7f172806c540 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1720009d90 tx=0x7f172001c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87af9e4316c25f17 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:34.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.620+0000 7f1725400640 1 -- 172.21.15.114:0/1803089767 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17200a58e0 con 0x7f1728070b30 2024-09-13T17:52:34.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.620+0000 7f1725400640 1 -- 172.21.15.114:0/1803089767 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17200a5a40 con 0x7f1728070b30 2024-09-13T17:52:34.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.620+0000 7f1725400640 1 -- 172.21.15.114:0/1803089767 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17200a5dd0 con 0x7f1728070b30 2024-09-13T17:52:34.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.624+0000 7f172ce00640 1 -- 172.21.15.114:0/1803089767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1728070b30 msgr2=0x7f172806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:34.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.624+0000 7f172ce00640 1 --2- 172.21.15.114:0/1803089767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1728070b30 0x7f172806c540 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1720009d90 tx=0x7f172001c820 comp rx=0 tx=0).stop 2024-09-13T17:52:34.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.624+0000 7f172ce00640 1 -- 172.21.15.114:0/1803089767 shutdown_connections 2024-09-13T17:52:34.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.624+0000 7f172ce00640 1 --2- 172.21.15.114:0/1803089767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1728070b30 0x7f172806c540 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.624+0000 7f172ce00640 1 --2- 172.21.15.114:0/1803089767 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1728151420 0x7f17280cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.624+0000 7f172ce00640 1 -- 172.21.15.114:0/1803089767 >> 172.21.15.114:0/1803089767 conn(0x7f17280660b0 msgr2=0x7f1728069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:34.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.624+0000 7f172ce00640 1 -- 172.21.15.114:0/1803089767 shutdown_connections 2024-09-13T17:52:34.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.624+0000 7f172ce00640 1 -- 172.21.15.114:0/1803089767 wait complete. 2024-09-13T17:52:34.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.624+0000 7f172ce00640 1 Processor -- start 2024-09-13T17:52:34.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.624+0000 7f172ce00640 1 -- start start 2024-09-13T17:52:34.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.624+0000 7f172ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1728070b30 0x7f172814b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:34.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.624+0000 7f172ce00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17280ccba0 0x7f17281f8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:34.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.624+0000 7f172ce00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1728151420 0x7f172815bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:34.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.624+0000 7f172ce00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17280b1610 con 0x7f1728070b30 2024-09-13T17:52:34.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.624+0000 7f172ce00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17280b1db0 con 0x7f1728151420 2024-09-13T17:52:34.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.624+0000 7f172ce00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17280b17f0 con 0x7f17280ccba0 2024-09-13T17:52:34.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.624+0000 7f1725e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1728070b30 0x7f172814b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:34.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.624+0000 7f1725e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1728070b30 0x7f172814b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55844/0 (socket says 172.21.15.114:55844) 2024-09-13T17:52:34.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.624+0000 7f1725e00640 1 -- 172.21.15.114:0/3880439519 learned_addr learned my addr 172.21.15.114:0/3880439519 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:34.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.624+0000 7f1726800640 1 --2- 172.21.15.114:0/3880439519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1728151420 0x7f172815bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:34.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.624+0000 7f171d400640 1 --2- 172.21.15.114:0/3880439519 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17280ccba0 0x7f17281f8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:34.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.624+0000 7f1725e00640 1 -- 172.21.15.114:0/3880439519 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17280ccba0 msgr2=0x7f17281f8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:34.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.624+0000 7f1725e00640 1 --2- 172.21.15.114:0/3880439519 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17280ccba0 0x7f17281f8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.624+0000 7f1725e00640 1 -- 172.21.15.114:0/3880439519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1728151420 msgr2=0x7f172815bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:34.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.624+0000 7f1725e00640 1 --2- 172.21.15.114:0/3880439519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1728151420 0x7f172815bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.624+0000 7f1725e00640 1 -- 172.21.15.114:0/3880439519 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1720009a70 con 0x7f1728070b30 2024-09-13T17:52:34.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.628+0000 7f1725e00640 1 --2- 172.21.15.114:0/3880439519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1728070b30 0x7f172814b090 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f171800e930 tx=0x7f171800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:34.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.628+0000 7f171ea00640 1 -- 172.21.15.114:0/3880439519 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718009690 con 0x7f1728070b30 2024-09-13T17:52:34.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.628+0000 7f171ea00640 1 -- 172.21.15.114:0/3880439519 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171800ca00 con 0x7f1728070b30 2024-09-13T17:52:34.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.628+0000 7f171ea00640 1 -- 172.21.15.114:0/3880439519 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171800cd70 con 0x7f1728070b30 2024-09-13T17:52:34.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.628+0000 7f172ce00640 1 -- 172.21.15.114:0/3880439519 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17280b1ad0 con 0x7f1728070b30 2024-09-13T17:52:34.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.628+0000 7f172ce00640 1 -- 172.21.15.114:0/3880439519 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f172814b5d0 con 0x7f1728070b30 2024-09-13T17:52:34.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.628+0000 7f172ce00640 1 -- 172.21.15.114:0/3880439519 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17281f84e0 con 0x7f1728070b30 2024-09-13T17:52:34.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.628+0000 7f171ea00640 1 -- 172.21.15.114:0/3880439519 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1718013470 con 0x7f1728070b30 2024-09-13T17:52:34.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.628+0000 7f171ea00640 1 --2- 172.21.15.114:0/3880439519 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1704066690 0x7f1704068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:34.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.628+0000 7f171ea00640 1 -- 172.21.15.114:0/3880439519 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f17180848a0 con 0x7f1728070b30 2024-09-13T17:52:34.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.628+0000 7f171d400640 1 --2- 172.21.15.114:0/3880439519 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1704066690 0x7f1704068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:34.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.628+0000 7f171d400640 1 --2- 172.21.15.114:0/3880439519 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1704066690 0x7f1704068b50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f17280ad590 tx=0x7f1710009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:34.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.632+0000 7f171ea00640 1 -- 172.21.15.114:0/3880439519 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f17281f84e0 con 0x7f1728070b30 2024-09-13T17:52:34.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.784+0000 7f172ce00640 1 -- 172.21.15.114:0/3880439519 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f17281f84e0 con 0x7f1728070b30 2024-09-13T17:52:34.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.784+0000 7f171ea00640 1 -- 172.21.15.114:0/3880439519 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f17281f84e0 con 0x7f1728070b30 2024-09-13T17:52:34.788 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:52:34.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.788+0000 7f172ce00640 1 -- 172.21.15.114:0/3880439519 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1704066690 msgr2=0x7f1704068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:34.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.788+0000 7f172ce00640 1 --2- 172.21.15.114:0/3880439519 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1704066690 0x7f1704068b50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f17280ad590 tx=0x7f1710009040 comp rx=0 tx=0).stop 2024-09-13T17:52:34.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.788+0000 7f172ce00640 1 -- 172.21.15.114:0/3880439519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1728070b30 msgr2=0x7f172814b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:34.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.788+0000 7f172ce00640 1 --2- 172.21.15.114:0/3880439519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1728070b30 0x7f172814b090 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f171800e930 tx=0x7f171800edf0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.788+0000 7f172ce00640 1 -- 172.21.15.114:0/3880439519 shutdown_connections 2024-09-13T17:52:34.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.788+0000 7f172ce00640 1 --2- 172.21.15.114:0/3880439519 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1704066690 0x7f1704068b50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.788+0000 7f172ce00640 1 --2- 172.21.15.114:0/3880439519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1728151420 0x7f172815bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.788+0000 7f172ce00640 1 --2- 172.21.15.114:0/3880439519 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f17280ccba0 0x7f17281f8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.788+0000 7f172ce00640 1 --2- 172.21.15.114:0/3880439519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1728070b30 0x7f172814b090 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.788+0000 7f172ce00640 1 -- 172.21.15.114:0/3880439519 >> 172.21.15.114:0/3880439519 conn(0x7f17280660b0 msgr2=0x7f17280cd010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:34.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.788+0000 7f172ce00640 1 -- 172.21.15.114:0/3880439519 shutdown_connections 2024-09-13T17:52:34.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.788+0000 7f172ce00640 1 -- 172.21.15.114:0/3880439519 wait complete. 2024-09-13T17:52:34.810 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:52:34.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.944+0000 7f3107600640 1 Processor -- start 2024-09-13T17:52:34.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.944+0000 7f3107600640 1 -- start start 2024-09-13T17:52:34.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.948+0000 7f3107600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f310013c240 0x7f310013f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:34.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.948+0000 7f3107600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f310013c980 0x7f310006d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:34.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.948+0000 7f3107600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31000cd220 con 0x7f310006da90 2024-09-13T17:52:34.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.948+0000 7f3107600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f310013f960 con 0x7f310013c240 2024-09-13T17:52:34.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.948+0000 7f3107600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f310006ded0 con 0x7f310013c980 2024-09-13T17:52:34.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.948+0000 7f3104c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f310013c240 0x7f310013f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:34.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.948+0000 7f3104c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f310013c240 0x7f310013f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55846/0 (socket says 172.21.15.114:55846) 2024-09-13T17:52:34.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.948+0000 7f3104c00640 1 -- 172.21.15.114:0/996658426 learned_addr learned my addr 172.21.15.114:0/996658426 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:34.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.948+0000 7f30f7e00640 1 --2- 172.21.15.114:0/996658426 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f310013c980 0x7f310006d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:34.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.948+0000 7f3104c00640 1 -- 172.21.15.114:0/996658426 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f310013c980 msgr2=0x7f310006d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:34.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.948+0000 7f3104c00640 1 --2- 172.21.15.114:0/996658426 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f310013c980 0x7f310006d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.948+0000 7f3104c00640 1 -- 172.21.15.114:0/996658426 >> v1:172.21.15.134:6789/0 conn(0x7f310006da90 legacy=0x7f31000cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:34.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.948+0000 7f3104c00640 1 -- 172.21.15.114:0/996658426 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310015a740 con 0x7f310013c240 2024-09-13T17:52:34.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.952+0000 7f3104c00640 1 --2- 172.21.15.114:0/996658426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f310013c240 0x7f310013f420 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f30f0009870 tx=0x7f30f001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=213943a8682d2bf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:34.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.952+0000 7f30ffe00640 1 -- 172.21.15.114:0/996658426 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f00a95f0 con 0x7f310013c240 2024-09-13T17:52:34.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.952+0000 7f30ffe00640 1 -- 172.21.15.114:0/996658426 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f00a9750 con 0x7f310013c240 2024-09-13T17:52:34.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.952+0000 7f30ffe00640 1 -- 172.21.15.114:0/996658426 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f00a9ae0 con 0x7f310013c240 2024-09-13T17:52:34.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.952+0000 7f3107600640 1 -- 172.21.15.114:0/996658426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f310013c240 msgr2=0x7f310013f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:34.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.952+0000 7f3107600640 1 --2- 172.21.15.114:0/996658426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f310013c240 0x7f310013f420 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f30f0009870 tx=0x7f30f001c530 comp rx=0 tx=0).stop 2024-09-13T17:52:34.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.952+0000 7f3107600640 1 -- 172.21.15.114:0/996658426 shutdown_connections 2024-09-13T17:52:34.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.952+0000 7f3107600640 1 --2- 172.21.15.114:0/996658426 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f310013c980 0x7f310006d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.952+0000 7f3107600640 1 --2- 172.21.15.114:0/996658426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f310013c240 0x7f310013f420 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.952+0000 7f3107600640 1 -- 172.21.15.114:0/996658426 >> 172.21.15.114:0/996658426 conn(0x7f31000660b0 msgr2=0x7f3100069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:34.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.952+0000 7f3107600640 1 -- 172.21.15.114:0/996658426 shutdown_connections 2024-09-13T17:52:34.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.952+0000 7f3107600640 1 -- 172.21.15.114:0/996658426 wait complete. 2024-09-13T17:52:34.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.952+0000 7f3107600640 1 Processor -- start 2024-09-13T17:52:34.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.952+0000 7f3107600640 1 -- start start 2024-09-13T17:52:34.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.956+0000 7f3107600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f310006da90 0x7f31001549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:34.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.956+0000 7f3107600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f310013c240 0x7f310015c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:34.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.956+0000 7f3107600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f310013c980 0x7f3100139b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:34.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.956+0000 7f3107600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310013cd90 con 0x7f310013c240 2024-09-13T17:52:34.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.956+0000 7f3107600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31001f5870 con 0x7f310006da90 2024-09-13T17:52:34.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.956+0000 7f3107600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3100154f20 con 0x7f310013c980 2024-09-13T17:52:34.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.956+0000 7f30f7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f310013c240 0x7f310015c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:34.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.956+0000 7f30f7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f310013c240 0x7f310015c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55860/0 (socket says 172.21.15.114:55860) 2024-09-13T17:52:34.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.956+0000 7f30f7e00640 1 -- 172.21.15.114:0/1207943980 learned_addr learned my addr 172.21.15.114:0/1207943980 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:34.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.956+0000 7f3105600640 1 --2- 172.21.15.114:0/1207943980 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f310013c980 0x7f3100139b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:34.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.956+0000 7f3104c00640 1 --2- 172.21.15.114:0/1207943980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f310006da90 0x7f31001549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:34.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.956+0000 7f30f7e00640 1 -- 172.21.15.114:0/1207943980 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f310013c980 msgr2=0x7f3100139b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:34.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.956+0000 7f30f7e00640 1 --2- 172.21.15.114:0/1207943980 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f310013c980 0x7f3100139b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.956+0000 7f30f7e00640 1 -- 172.21.15.114:0/1207943980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f310006da90 msgr2=0x7f31001549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:34.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.956+0000 7f30f7e00640 1 --2- 172.21.15.114:0/1207943980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f310006da90 0x7f31001549e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:34.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.956+0000 7f30f7e00640 1 -- 172.21.15.114:0/1207943980 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f00094d0 con 0x7f310013c240 2024-09-13T17:52:34.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.956+0000 7f30f7e00640 1 --2- 172.21.15.114:0/1207943980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f310013c240 0x7f310015c270 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f30e800e870 tx=0x7f30e800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:34.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.956+0000 7f30fd600640 1 -- 172.21.15.114:0/1207943980 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8009510 con 0x7f310013c240 2024-09-13T17:52:34.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.956+0000 7f30fd600640 1 -- 172.21.15.114:0/1207943980 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e800eec0 con 0x7f310013c240 2024-09-13T17:52:34.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.956+0000 7f30fd600640 1 -- 172.21.15.114:0/1207943980 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e800cb40 con 0x7f310013c240 2024-09-13T17:52:34.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.956+0000 7f3107600640 1 -- 172.21.15.114:0/1207943980 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3100168430 con 0x7f310013c240 2024-09-13T17:52:34.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.956+0000 7f3107600640 1 -- 172.21.15.114:0/1207943980 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f310015ca70 con 0x7f310013c240 2024-09-13T17:52:34.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.956+0000 7f3107600640 1 -- 172.21.15.114:0/1207943980 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31000667b0 con 0x7f310013c240 2024-09-13T17:52:34.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.956+0000 7f30fd600640 1 -- 172.21.15.114:0/1207943980 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f30e800cca0 con 0x7f310013c240 2024-09-13T17:52:34.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.960+0000 7f30fd600640 1 --2- 172.21.15.114:0/1207943980 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f30dc0666c0 0x7f30dc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:34.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.960+0000 7f30fd600640 1 -- 172.21.15.114:0/1207943980 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f30e8084670 con 0x7f310013c240 2024-09-13T17:52:34.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.960+0000 7f3104c00640 1 --2- 172.21.15.114:0/1207943980 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f30dc0666c0 0x7f30dc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:34.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.960+0000 7f3104c00640 1 --2- 172.21.15.114:0/1207943980 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f30dc0666c0 0x7f30dc068b80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f30f00ae000 tx=0x7f30f00b3040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:34.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:34.964+0000 7f30fd600640 1 -- 172.21.15.114:0/1207943980 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f30e8051630 con 0x7f310013c240 2024-09-13T17:52:35.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.116+0000 7f3107600640 1 -- 172.21.15.114:0/1207943980 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f31000706b0 con 0x7f310013c240 2024-09-13T17:52:35.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.116+0000 7f30fd600640 1 -- 172.21.15.114:0/1207943980 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f30e8054c50 con 0x7f310013c240 2024-09-13T17:52:35.121 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-09-13T17:52:35.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.120+0000 7f3107600640 1 -- 172.21.15.114:0/1207943980 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f30dc0666c0 msgr2=0x7f30dc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:35.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.120+0000 7f3107600640 1 --2- 172.21.15.114:0/1207943980 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f30dc0666c0 0x7f30dc068b80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f30f00ae000 tx=0x7f30f00b3040 comp rx=0 tx=0).stop 2024-09-13T17:52:35.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.120+0000 7f3107600640 1 -- 172.21.15.114:0/1207943980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f310013c240 msgr2=0x7f310015c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:35.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.120+0000 7f3107600640 1 --2- 172.21.15.114:0/1207943980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f310013c240 0x7f310015c270 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f30e800e870 tx=0x7f30e800ec70 comp rx=0 tx=0).stop 2024-09-13T17:52:35.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.120+0000 7f3107600640 1 -- 172.21.15.114:0/1207943980 shutdown_connections 2024-09-13T17:52:35.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.120+0000 7f3107600640 1 --2- 172.21.15.114:0/1207943980 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f30dc0666c0 0x7f30dc068b80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:35.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.120+0000 7f3107600640 1 --2- 172.21.15.114:0/1207943980 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f310013c980 0x7f3100139b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:35.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.120+0000 7f3107600640 1 --2- 172.21.15.114:0/1207943980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f310013c240 0x7f310015c270 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:35.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.120+0000 7f3107600640 1 --2- 172.21.15.114:0/1207943980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f310006da90 0x7f31001549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:35.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.120+0000 7f3107600640 1 -- 172.21.15.114:0/1207943980 >> 172.21.15.114:0/1207943980 conn(0x7f31000660b0 msgr2=0x7f31000cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:35.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.120+0000 7f3107600640 1 -- 172.21.15.114:0/1207943980 shutdown_connections 2024-09-13T17:52:35.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.120+0000 7f3107600640 1 -- 172.21.15.114:0/1207943980 wait complete. 2024-09-13T17:52:35.142 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:52:35.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.276+0000 7f9608200640 1 Processor -- start 2024-09-13T17:52:35.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.276+0000 7f9608200640 1 -- start start 2024-09-13T17:52:35.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.276+0000 7f9608200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f960013c240 0x7f960013f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:35.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.276+0000 7f9608200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f960013c980 0x7f960006d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:35.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.276+0000 7f9608200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96000cd220 con 0x7f960006da90 2024-09-13T17:52:35.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.276+0000 7f9608200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f960006df40 con 0x7f960013c240 2024-09-13T17:52:35.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.276+0000 7f9608200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f960013f960 con 0x7f960013c980 2024-09-13T17:52:35.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.280+0000 7f9605800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f960013c240 0x7f960013f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:35.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.280+0000 7f9605800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f960013c240 0x7f960013f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55868/0 (socket says 172.21.15.114:55868) 2024-09-13T17:52:35.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.280+0000 7f9605800640 1 -- 172.21.15.114:0/657217010 learned_addr learned my addr 172.21.15.114:0/657217010 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:35.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.280+0000 7f9604e00640 1 --2- 172.21.15.114:0/657217010 >> v2:172.21.15.134:3300/0 conn(0x7f960013c980 0x7f960006d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:35.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.280+0000 7f9605800640 1 -- 172.21.15.114:0/657217010 >> v2:172.21.15.134:3300/0 conn(0x7f960013c980 msgr2=0x7f960006d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:35.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.280+0000 7f9605800640 1 --2- 172.21.15.114:0/657217010 >> v2:172.21.15.134:3300/0 conn(0x7f960013c980 0x7f960006d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:35.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.280+0000 7f9605800640 1 -- 172.21.15.114:0/657217010 >> v1:172.21.15.134:6789/0 conn(0x7f960006da90 legacy=0x7f96000cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:35.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.280+0000 7f9605800640 1 -- 172.21.15.114:0/657217010 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960015a740 con 0x7f960013c240 2024-09-13T17:52:35.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.280+0000 7f9605800640 1 --2- 172.21.15.114:0/657217010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f960013c240 0x7f960013f420 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f96000ae130 tx=0x7f95f401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa24747c5627db8e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:35.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.280+0000 7f95ffe00640 1 -- 172.21.15.114:0/657217010 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f40a5880 con 0x7f960013c240 2024-09-13T17:52:35.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.280+0000 7f95ffe00640 1 -- 172.21.15.114:0/657217010 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f40a59e0 con 0x7f960013c240 2024-09-13T17:52:35.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.280+0000 7f95ffe00640 1 -- 172.21.15.114:0/657217010 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f40a5d70 con 0x7f960013c240 2024-09-13T17:52:35.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.284+0000 7f9608200640 1 -- 172.21.15.114:0/657217010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f960013c240 msgr2=0x7f960013f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:35.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.284+0000 7f9608200640 1 --2- 172.21.15.114:0/657217010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f960013c240 0x7f960013f420 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f96000ae130 tx=0x7f95f401c9c0 comp rx=0 tx=0).stop 2024-09-13T17:52:35.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.284+0000 7f9608200640 1 -- 172.21.15.114:0/657217010 shutdown_connections 2024-09-13T17:52:35.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.284+0000 7f9608200640 1 --2- 172.21.15.114:0/657217010 >> v2:172.21.15.134:3300/0 conn(0x7f960013c980 0x7f960006d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:35.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.284+0000 7f9608200640 1 --2- 172.21.15.114:0/657217010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f960013c240 0x7f960013f420 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:35.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.284+0000 7f9608200640 1 -- 172.21.15.114:0/657217010 >> 172.21.15.114:0/657217010 conn(0x7f96000660b0 msgr2=0x7f9600069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:35.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.284+0000 7f9608200640 1 -- 172.21.15.114:0/657217010 shutdown_connections 2024-09-13T17:52:35.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.284+0000 7f9608200640 1 -- 172.21.15.114:0/657217010 wait complete. 2024-09-13T17:52:35.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.284+0000 7f9608200640 1 Processor -- start 2024-09-13T17:52:35.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.284+0000 7f9608200640 1 -- start start 2024-09-13T17:52:35.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.284+0000 7f9608200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f960006da90 0x7f96000acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:35.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.284+0000 7f9608200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f960013c240 0x7f96001519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:35.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.284+0000 7f9608200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f960013c980 0x7f9600152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:35.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.284+0000 7f9608200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96000ae180 con 0x7f960013c240 2024-09-13T17:52:35.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.284+0000 7f9608200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96000ae740 con 0x7f960013c980 2024-09-13T17:52:35.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.284+0000 7f9608200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96001523a0 con 0x7f960006da90 2024-09-13T17:52:35.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.284+0000 7f9604e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f960013c240 0x7f96001519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:35.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.284+0000 7f9604e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f960013c240 0x7f96001519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55882/0 (socket says 172.21.15.114:55882) 2024-09-13T17:52:35.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.284+0000 7f9604e00640 1 -- 172.21.15.114:0/1750370465 learned_addr learned my addr 172.21.15.114:0/1750370465 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:35.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.284+0000 7f9605800640 1 --2- 172.21.15.114:0/1750370465 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f960006da90 0x7f96000acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:35.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.284+0000 7f9606200640 1 --2- 172.21.15.114:0/1750370465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f960013c980 0x7f9600152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:35.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.288+0000 7f9604e00640 1 -- 172.21.15.114:0/1750370465 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f960006da90 msgr2=0x7f96000acdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:35.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.288+0000 7f9604e00640 1 --2- 172.21.15.114:0/1750370465 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f960006da90 0x7f96000acdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:35.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.288+0000 7f9604e00640 1 -- 172.21.15.114:0/1750370465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f960013c980 msgr2=0x7f9600152a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:35.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.288+0000 7f9604e00640 1 --2- 172.21.15.114:0/1750370465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f960013c980 0x7f9600152a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:35.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.288+0000 7f9604e00640 1 -- 172.21.15.114:0/1750370465 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f4009b30 con 0x7f960013c240 2024-09-13T17:52:35.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.288+0000 7f9604e00640 1 --2- 172.21.15.114:0/1750370465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f960013c240 0x7f96001519c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00e8a0 tx=0x7f95ec00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:35.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.288+0000 7f95fd600640 1 -- 172.21.15.114:0/1750370465 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec009510 con 0x7f960013c240 2024-09-13T17:52:35.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.288+0000 7f95fd600640 1 -- 172.21.15.114:0/1750370465 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ec00c940 con 0x7f960013c240 2024-09-13T17:52:35.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.288+0000 7f9608200640 1 -- 172.21.15.114:0/1750370465 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9600152680 con 0x7f960013c240 2024-09-13T17:52:35.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.288+0000 7f95fd600640 1 -- 172.21.15.114:0/1750370465 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec00ccb0 con 0x7f960013c240 2024-09-13T17:52:35.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.288+0000 7f9608200640 1 -- 172.21.15.114:0/1750370465 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96001f2bb0 con 0x7f960013c240 2024-09-13T17:52:35.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.288+0000 7f9608200640 1 -- 172.21.15.114:0/1750370465 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9600070620 con 0x7f960013c240 2024-09-13T17:52:35.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.288+0000 7f95fd600640 1 -- 172.21.15.114:0/1750370465 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f95ec013470 con 0x7f960013c240 2024-09-13T17:52:35.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.288+0000 7f95fd600640 1 --2- 172.21.15.114:0/1750370465 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f95e0066690 0x7f95e0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:35.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.288+0000 7f95fd600640 1 -- 172.21.15.114:0/1750370465 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f95ec084920 con 0x7f960013c240 2024-09-13T17:52:35.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.288+0000 7f9605800640 1 --2- 172.21.15.114:0/1750370465 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f95e0066690 0x7f95e0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:35.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.292+0000 7f9605800640 1 --2- 172.21.15.114:0/1750370465 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f95e0066690 0x7f95e0068b50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f95f40ae000 tx=0x7f95f40a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:35.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.292+0000 7f95fd600640 1 -- 172.21.15.114:0/1750370465 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f95ec051970 con 0x7f960013c240 2024-09-13T17:52:35.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.448+0000 7f9608200640 1 -- 172.21.15.114:0/1750370465 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9600152810 con 0x7f960013c240 2024-09-13T17:52:35.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.448+0000 7f95fd600640 1 -- 172.21.15.114:0/1750370465 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f95ec054f90 con 0x7f960013c240 2024-09-13T17:52:35.452 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:52:35.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.448+0000 7f9608200640 1 -- 172.21.15.114:0/1750370465 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f95e0066690 msgr2=0x7f95e0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:35.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.448+0000 7f9608200640 1 --2- 172.21.15.114:0/1750370465 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f95e0066690 0x7f95e0068b50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f95f40ae000 tx=0x7f95f40a7070 comp rx=0 tx=0).stop 2024-09-13T17:52:35.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.448+0000 7f9608200640 1 -- 172.21.15.114:0/1750370465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f960013c240 msgr2=0x7f96001519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:35.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.448+0000 7f9608200640 1 --2- 172.21.15.114:0/1750370465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f960013c240 0x7f96001519c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00e8a0 tx=0x7f95ec00eca0 comp rx=0 tx=0).stop 2024-09-13T17:52:35.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.452+0000 7f9608200640 1 -- 172.21.15.114:0/1750370465 shutdown_connections 2024-09-13T17:52:35.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.452+0000 7f9608200640 1 --2- 172.21.15.114:0/1750370465 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f95e0066690 0x7f95e0068b50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:35.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.452+0000 7f9608200640 1 --2- 172.21.15.114:0/1750370465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f960013c980 0x7f9600152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:35.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.452+0000 7f9608200640 1 --2- 172.21.15.114:0/1750370465 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f960013c240 0x7f96001519c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:35.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.452+0000 7f9608200640 1 --2- 172.21.15.114:0/1750370465 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f960006da90 0x7f96000acdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:35.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.452+0000 7f9608200640 1 -- 172.21.15.114:0/1750370465 >> 172.21.15.114:0/1750370465 conn(0x7f96000660b0 msgr2=0x7f960006c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:35.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.452+0000 7f9608200640 1 -- 172.21.15.114:0/1750370465 shutdown_connections 2024-09-13T17:52:35.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.452+0000 7f9608200640 1 -- 172.21.15.114:0/1750370465 wait complete. 2024-09-13T17:52:35.472 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:52:35.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.604+0000 7f0db8c00640 1 Processor -- start 2024-09-13T17:52:35.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.604+0000 7f0db8c00640 1 -- start start 2024-09-13T17:52:35.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.608+0000 7f0db8c00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0db413c240 0x7f0db413f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:35.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.608+0000 7f0db8c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0db413c980 0x7f0db406d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:35.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.608+0000 7f0db8c00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db40cd220 con 0x7f0db406da90 2024-09-13T17:52:35.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.608+0000 7f0db8c00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db413f960 con 0x7f0db413c240 2024-09-13T17:52:35.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.608+0000 7f0db8c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db406ded0 con 0x7f0db413c980 2024-09-13T17:52:35.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.608+0000 7f0db1e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0db413c240 0x7f0db413f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:35.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.608+0000 7f0da9400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0db413c980 0x7f0db406d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:35.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.608+0000 7f0db1e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0db413c240 0x7f0db413f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:51408/0 (socket says 172.21.15.114:51408) 2024-09-13T17:52:35.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.608+0000 7f0db1e00640 1 -- 172.21.15.114:0/1424629130 learned_addr learned my addr 172.21.15.114:0/1424629130 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:35.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.608+0000 7f0db1e00640 1 -- 172.21.15.114:0/1424629130 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0db413c980 msgr2=0x7f0db406d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:35.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.608+0000 7f0db1e00640 1 --2- 172.21.15.114:0/1424629130 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0db413c980 0x7f0db406d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:35.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.608+0000 7f0db1e00640 1 -- 172.21.15.114:0/1424629130 >> v1:172.21.15.134:6789/0 conn(0x7f0db406da90 legacy=0x7f0db40cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:35.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.608+0000 7f0db1e00640 1 -- 172.21.15.114:0/1424629130 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db415a740 con 0x7f0db413c240 2024-09-13T17:52:35.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.608+0000 7f0db1400640 1 -- 172.21.15.114:0/1424629130 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685229773 0 0) 0x7f0db40cd220 con 0x7f0db406da90 2024-09-13T17:52:35.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.612+0000 7f0db1e00640 1 --2- 172.21.15.114:0/1424629130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0db413c240 0x7f0db413f420 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0da4009e50 tx=0x7f0da401ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8e426b4f1c53e49 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:35.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.612+0000 7f0db1400640 1 -- 172.21.15.114:0/1424629130 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da40a58d0 con 0x7f0db413c240 2024-09-13T17:52:35.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.612+0000 7f0db1400640 1 -- 172.21.15.114:0/1424629130 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da40a5a30 con 0x7f0db413c240 2024-09-13T17:52:35.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.612+0000 7f0db1400640 1 -- 172.21.15.114:0/1424629130 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da40a5dc0 con 0x7f0db413c240 2024-09-13T17:52:35.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.612+0000 7f0db8c00640 1 -- 172.21.15.114:0/1424629130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0db413c240 msgr2=0x7f0db413f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:35.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.612+0000 7f0db8c00640 1 --2- 172.21.15.114:0/1424629130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0db413c240 0x7f0db413f420 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0da4009e50 tx=0x7f0da401ca00 comp rx=0 tx=0).stop 2024-09-13T17:52:35.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.612+0000 7f0db8c00640 1 -- 172.21.15.114:0/1424629130 shutdown_connections 2024-09-13T17:52:35.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.612+0000 7f0db8c00640 1 --2- 172.21.15.114:0/1424629130 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0db413c980 0x7f0db406d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:35.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.612+0000 7f0db8c00640 1 --2- 172.21.15.114:0/1424629130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0db413c240 0x7f0db413f420 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:35.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.612+0000 7f0db8c00640 1 -- 172.21.15.114:0/1424629130 >> 172.21.15.114:0/1424629130 conn(0x7f0db40660b0 msgr2=0x7f0db4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:35.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.612+0000 7f0db8c00640 1 -- 172.21.15.114:0/1424629130 shutdown_connections 2024-09-13T17:52:35.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.612+0000 7f0db8c00640 1 -- 172.21.15.114:0/1424629130 wait complete. 2024-09-13T17:52:35.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.612+0000 7f0db8c00640 1 Processor -- start 2024-09-13T17:52:35.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.612+0000 7f0db8c00640 1 -- start start 2024-09-13T17:52:35.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.612+0000 7f0db8c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0db406da90 0x7f0db413ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:35.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.612+0000 7f0db8c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0db413c240 0x7f0db413d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:35.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.612+0000 7f0db8c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0db413c980 0x7f0db413db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:35.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.616+0000 7f0db8c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db413b060 con 0x7f0db413c980 2024-09-13T17:52:35.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.616+0000 7f0db8c00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db40ab980 con 0x7f0db413c240 2024-09-13T17:52:35.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.616+0000 7f0db8c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db40abc60 con 0x7f0db406da90 2024-09-13T17:52:35.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.616+0000 7f0db2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0db413c980 0x7f0db413db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:35.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.616+0000 7f0db2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0db413c980 0x7f0db413db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55884/0 (socket says 172.21.15.114:55884) 2024-09-13T17:52:35.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.616+0000 7f0db2800640 1 -- 172.21.15.114:0/3716002845 learned_addr learned my addr 172.21.15.114:0/3716002845 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:35.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.616+0000 7f0db1e00640 1 --2- 172.21.15.114:0/3716002845 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0db406da90 0x7f0db413ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:35.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.616+0000 7f0da9400640 1 --2- 172.21.15.114:0/3716002845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0db413c240 0x7f0db413d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:35.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.616+0000 7f0db2800640 1 -- 172.21.15.114:0/3716002845 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0db406da90 msgr2=0x7f0db413ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:35.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.616+0000 7f0db2800640 1 --2- 172.21.15.114:0/3716002845 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0db406da90 0x7f0db413ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:35.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.616+0000 7f0db2800640 1 -- 172.21.15.114:0/3716002845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0db413c240 msgr2=0x7f0db413d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:35.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.616+0000 7f0db2800640 1 --2- 172.21.15.114:0/3716002845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0db413c240 0x7f0db413d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:35.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.616+0000 7f0db2800640 1 -- 172.21.15.114:0/3716002845 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da4009b30 con 0x7f0db413c980 2024-09-13T17:52:35.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.616+0000 7f0db1e00640 1 --2- 172.21.15.114:0/3716002845 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0db406da90 0x7f0db413ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:35.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.616+0000 7f0db2800640 1 --2- 172.21.15.114:0/3716002845 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0db413c980 0x7f0db413db40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00c450 tx=0x7f0dac00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:35.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.616+0000 7f0daaa00640 1 -- 172.21.15.114:0/3716002845 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac005480 con 0x7f0db413c980 2024-09-13T17:52:35.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.616+0000 7f0daaa00640 1 -- 172.21.15.114:0/3716002845 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac003600 con 0x7f0db413c980 2024-09-13T17:52:35.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.616+0000 7f0daaa00640 1 -- 172.21.15.114:0/3716002845 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac0039b0 con 0x7f0db413c980 2024-09-13T17:52:35.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.616+0000 7f0db8c00640 1 -- 172.21.15.114:0/3716002845 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db40abf40 con 0x7f0db413c980 2024-09-13T17:52:35.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.616+0000 7f0db8c00640 1 -- 172.21.15.114:0/3716002845 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db40ac500 con 0x7f0db413c980 2024-09-13T17:52:35.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.616+0000 7f0db8c00640 1 -- 172.21.15.114:0/3716002845 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db40ac6f0 con 0x7f0db413c980 2024-09-13T17:52:35.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.616+0000 7f0daaa00640 1 -- 172.21.15.114:0/3716002845 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0dac003b10 con 0x7f0db413c980 2024-09-13T17:52:35.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.620+0000 7f0daaa00640 1 --2- 172.21.15.114:0/3716002845 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0d90066690 0x7f0d90068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:35.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.620+0000 7f0daaa00640 1 -- 172.21.15.114:0/3716002845 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0dac083b70 con 0x7f0db413c980 2024-09-13T17:52:35.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.620+0000 7f0db1e00640 1 --2- 172.21.15.114:0/3716002845 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0d90066690 0x7f0d90068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:35.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.620+0000 7f0db1e00640 1 --2- 172.21.15.114:0/3716002845 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0d90066690 0x7f0d90068b50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0da40ae000 tx=0x7f0da40a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:35.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.624+0000 7f0daaa00640 1 -- 172.21.15.114:0/3716002845 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0dac050b60 con 0x7f0db413c980 2024-09-13T17:52:35.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.780+0000 7f0db8c00640 1 -- 172.21.15.114:0/3716002845 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0db40667b0 con 0x7f0db413c980 2024-09-13T17:52:35.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.780+0000 7f0daaa00640 1 -- 172.21.15.114:0/3716002845 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18784 (secure 0 0 0) 0x7f0dac017030 con 0x7f0db413c980 2024-09-13T17:52:35.783 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:35.783 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:52:31.139000+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:51:48.278220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:51:48.773888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:51:51.856300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:52:35.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.780+0000 7f0db8c00640 1 -- 172.21.15.114:0/3716002845 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0d90066690 msgr2=0x7f0d90068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:35.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.780+0000 7f0db8c00640 1 --2- 172.21.15.114:0/3716002845 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0d90066690 0x7f0d90068b50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0da40ae000 tx=0x7f0da40a7070 comp rx=0 tx=0).stop 2024-09-13T17:52:35.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.780+0000 7f0db8c00640 1 -- 172.21.15.114:0/3716002845 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0db413c980 msgr2=0x7f0db413db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:35.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.780+0000 7f0db8c00640 1 --2- 172.21.15.114:0/3716002845 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0db413c980 0x7f0db413db40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00c450 tx=0x7f0dac00c910 comp rx=0 tx=0).stop 2024-09-13T17:52:35.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.780+0000 7f0db8c00640 1 -- 172.21.15.114:0/3716002845 shutdown_connections 2024-09-13T17:52:35.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.780+0000 7f0db8c00640 1 --2- 172.21.15.114:0/3716002845 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0d90066690 0x7f0d90068b50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:35.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.780+0000 7f0db8c00640 1 --2- 172.21.15.114:0/3716002845 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0db413c980 0x7f0db413db40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:35.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.780+0000 7f0db8c00640 1 --2- 172.21.15.114:0/3716002845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0db413c240 0x7f0db413d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:35.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.780+0000 7f0db8c00640 1 --2- 172.21.15.114:0/3716002845 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0db406da90 0x7f0db413ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:35.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.780+0000 7f0db8c00640 1 -- 172.21.15.114:0/3716002845 >> 172.21.15.114:0/3716002845 conn(0x7f0db40660b0 msgr2=0x7f0db40b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:35.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.780+0000 7f0db8c00640 1 -- 172.21.15.114:0/3716002845 shutdown_connections 2024-09-13T17:52:35.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.780+0000 7f0db8c00640 1 -- 172.21.15.114:0/3716002845 wait complete. 2024-09-13T17:52:35.804 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:51:37.996254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:51:48.278220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:51:48.773888+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:51:51.856300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:52:35.804 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:52:35.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.940+0000 7f91a4800640 1 Processor -- start 2024-09-13T17:52:35.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.940+0000 7f91a4800640 1 -- start start 2024-09-13T17:52:35.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.940+0000 7f91a4800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f919c06dc60 0x7f919c0cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:35.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.940+0000 7f91a4800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f919c0cd220 con 0x7f919c13c240 2024-09-13T17:52:35.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.940+0000 7f91a4800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f919c15a740 con 0x7f919c13f420 2024-09-13T17:52:35.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.940+0000 7f91a4800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f919c159bc0 con 0x7f919c06dc60 2024-09-13T17:52:35.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.940+0000 7f91a1e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f919c13c240 0x7f919c13c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46238/0 (socket says 172.21.15.114:46238) 2024-09-13T17:52:35.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.940+0000 7f91a1e00640 1 -- 172.21.15.114:0/1309387454 learned_addr learned my addr 172.21.15.114:0/1309387454 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:35.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.940+0000 7f91a2800640 1 --2- 172.21.15.114:0/1309387454 >> v2:172.21.15.114:3300/0 conn(0x7f919c06dc60 0x7f919c0cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:35.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.940+0000 7f91a0a00640 1 -- 172.21.15.114:0/1309387454 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703831175 0 0) 0x7f919c0cd220 con 0x7f919c13c240 2024-09-13T17:52:35.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.940+0000 7f91a0a00640 1 -- 172.21.15.114:0/1309387454 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9184003530 con 0x7f919c13c240 2024-09-13T17:52:35.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.940+0000 7f91a2800640 1 -- 172.21.15.114:0/1309387454 >> v1:172.21.15.134:6789/0 conn(0x7f919c13f420 legacy=0x7f919c06d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:35.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.940+0000 7f91a2800640 1 -- 172.21.15.114:0/1309387454 >> v1:172.21.15.114:6789/0 conn(0x7f919c13c240 legacy=0x7f919c13c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:35.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.940+0000 7f91a2800640 1 -- 172.21.15.114:0/1309387454 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919c159ea0 con 0x7f919c06dc60 2024-09-13T17:52:35.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.944+0000 7f91a2800640 1 --2- 172.21.15.114:0/1309387454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f919c06dc60 0x7f919c0cd650 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9198009d90 tx=0x7f919801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e13d68bb887c41a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:35.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.944+0000 7f91a0a00640 1 -- 172.21.15.114:0/1309387454 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91980a5970 con 0x7f919c06dc60 2024-09-13T17:52:35.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.944+0000 7f91a0a00640 1 -- 172.21.15.114:0/1309387454 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91980a5ad0 con 0x7f919c06dc60 2024-09-13T17:52:35.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.944+0000 7f91a0a00640 1 -- 172.21.15.114:0/1309387454 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91980a5e60 con 0x7f919c06dc60 2024-09-13T17:52:35.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.944+0000 7f91a4800640 1 -- 172.21.15.114:0/1309387454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f919c06dc60 msgr2=0x7f919c0cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:35.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.944+0000 7f91a4800640 1 --2- 172.21.15.114:0/1309387454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f919c06dc60 0x7f919c0cd650 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9198009d90 tx=0x7f919801c8b0 comp rx=0 tx=0).stop 2024-09-13T17:52:35.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.944+0000 7f91a4800640 1 -- 172.21.15.114:0/1309387454 shutdown_connections 2024-09-13T17:52:35.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.944+0000 7f91a4800640 1 --2- 172.21.15.114:0/1309387454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f919c06dc60 0x7f919c0cd650 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:35.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.944+0000 7f91a4800640 1 -- 172.21.15.114:0/1309387454 >> 172.21.15.114:0/1309387454 conn(0x7f919c0660b0 msgr2=0x7f919c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:35.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.944+0000 7f91a4800640 1 -- 172.21.15.114:0/1309387454 shutdown_connections 2024-09-13T17:52:35.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.944+0000 7f91a4800640 1 -- 172.21.15.114:0/1309387454 wait complete. 2024-09-13T17:52:35.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.948+0000 7f91a4800640 1 Processor -- start 2024-09-13T17:52:35.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.948+0000 7f91a4800640 1 -- start start 2024-09-13T17:52:35.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.948+0000 7f91a4800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f919c06dc60 0x7f919c152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:35.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.948+0000 7f91a4800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f919c13c240 0x7f919c0afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:35.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.948+0000 7f91a4800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f919c13f420 0x7f919c13d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:35.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.948+0000 7f91a4800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c0a9220 con 0x7f919c13c240 2024-09-13T17:52:35.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.948+0000 7f91a4800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c1f2f80 con 0x7f919c06dc60 2024-09-13T17:52:35.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.948+0000 7f91a4800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f919c1f3260 con 0x7f919c13f420 2024-09-13T17:52:35.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.948+0000 7f91a1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f919c13c240 0x7f919c0afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:35.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.948+0000 7f91a1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f919c13c240 0x7f919c0afaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55908/0 (socket says 172.21.15.114:55908) 2024-09-13T17:52:35.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.948+0000 7f91a1400640 1 -- 172.21.15.114:0/1029352780 learned_addr learned my addr 172.21.15.114:0/1029352780 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:35.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.948+0000 7f91a1e00640 1 --2- 172.21.15.114:0/1029352780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f919c06dc60 0x7f919c152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:35.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.948+0000 7f91a2800640 1 --2- 172.21.15.114:0/1029352780 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f919c13f420 0x7f919c13d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:35.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.948+0000 7f91a1400640 1 -- 172.21.15.114:0/1029352780 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f919c13f420 msgr2=0x7f919c13d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:35.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.948+0000 7f91a1400640 1 --2- 172.21.15.114:0/1029352780 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f919c13f420 0x7f919c13d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:35.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.948+0000 7f91a1400640 1 -- 172.21.15.114:0/1029352780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f919c06dc60 msgr2=0x7f919c152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:35.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.948+0000 7f91a1400640 1 --2- 172.21.15.114:0/1029352780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f919c06dc60 0x7f919c152ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:35.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.948+0000 7f91a1400640 1 -- 172.21.15.114:0/1029352780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9198009a70 con 0x7f919c13c240 2024-09-13T17:52:35.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.948+0000 7f91a1400640 1 --2- 172.21.15.114:0/1029352780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f919c13c240 0x7f919c0afaf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f918c00c3c0 tx=0x7f918c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:35.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.948+0000 7f9196000640 1 -- 172.21.15.114:0/1029352780 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c0052d0 con 0x7f919c13c240 2024-09-13T17:52:35.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.948+0000 7f9196000640 1 -- 172.21.15.114:0/1029352780 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918c005430 con 0x7f919c13c240 2024-09-13T17:52:35.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.948+0000 7f91a4800640 1 -- 172.21.15.114:0/1029352780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f919c1f3540 con 0x7f919c13c240 2024-09-13T17:52:35.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.948+0000 7f9196000640 1 -- 172.21.15.114:0/1029352780 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c003840 con 0x7f919c13c240 2024-09-13T17:52:35.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.948+0000 7f91a4800640 1 -- 172.21.15.114:0/1029352780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919c1f3b00 con 0x7f919c13c240 2024-09-13T17:52:35.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.948+0000 7f91a4800640 1 -- 172.21.15.114:0/1029352780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f919c1f3c90 con 0x7f919c13c240 2024-09-13T17:52:35.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.952+0000 7f9196000640 1 -- 172.21.15.114:0/1029352780 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f918c0039a0 con 0x7f919c13c240 2024-09-13T17:52:35.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.952+0000 7f9196000640 1 --2- 172.21.15.114:0/1029352780 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9180066690 0x7f9180068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:35.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.952+0000 7f9196000640 1 -- 172.21.15.114:0/1029352780 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f918c0839e0 con 0x7f919c13c240 2024-09-13T17:52:35.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.952+0000 7f91a1e00640 1 --2- 172.21.15.114:0/1029352780 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9180066690 0x7f9180068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:35.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.952+0000 7f91a1e00640 1 --2- 172.21.15.114:0/1029352780 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9180066690 0x7f9180068b50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f91900011f0 tx=0x7f9190007d40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:35.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:35.956+0000 7f9196000640 1 -- 172.21.15.114:0/1029352780 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f918c050a30 con 0x7f919c13c240 2024-09-13T17:52:36.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.108+0000 7f91a4800640 1 -- 172.21.15.114:0/1029352780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f919c0cd650 con 0x7f919c13c240 2024-09-13T17:52:36.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.108+0000 7f9196000640 1 -- 172.21.15.114:0/1029352780 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f918c017020 con 0x7f919c13c240 2024-09-13T17:52:36.113 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-13T17:52:36.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.112+0000 7f91a4800640 1 -- 172.21.15.114:0/1029352780 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9180066690 msgr2=0x7f9180068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:36.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.112+0000 7f91a4800640 1 --2- 172.21.15.114:0/1029352780 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9180066690 0x7f9180068b50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f91900011f0 tx=0x7f9190007d40 comp rx=0 tx=0).stop 2024-09-13T17:52:36.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.112+0000 7f91a4800640 1 -- 172.21.15.114:0/1029352780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f919c13c240 msgr2=0x7f919c0afaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:36.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.112+0000 7f91a4800640 1 --2- 172.21.15.114:0/1029352780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f919c13c240 0x7f919c0afaf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f918c00c3c0 tx=0x7f918c00c880 comp rx=0 tx=0).stop 2024-09-13T17:52:36.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.112+0000 7f91a4800640 1 -- 172.21.15.114:0/1029352780 shutdown_connections 2024-09-13T17:52:36.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.112+0000 7f91a4800640 1 --2- 172.21.15.114:0/1029352780 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9180066690 0x7f9180068b50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:36.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.112+0000 7f91a4800640 1 --2- 172.21.15.114:0/1029352780 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f919c13f420 0x7f919c13d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:36.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.112+0000 7f91a4800640 1 --2- 172.21.15.114:0/1029352780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f919c13c240 0x7f919c0afaf0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:36.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.112+0000 7f91a4800640 1 --2- 172.21.15.114:0/1029352780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f919c06dc60 0x7f919c152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:36.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.112+0000 7f91a4800640 1 -- 172.21.15.114:0/1029352780 >> 172.21.15.114:0/1029352780 conn(0x7f919c0660b0 msgr2=0x7f919c157c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:36.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.112+0000 7f91a4800640 1 -- 172.21.15.114:0/1029352780 shutdown_connections 2024-09-13T17:52:36.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.112+0000 7f91a4800640 1 -- 172.21.15.114:0/1029352780 wait complete. 2024-09-13T17:52:36.134 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:52:36.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.268+0000 7fa02fc00640 1 Processor -- start 2024-09-13T17:52:36.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.272+0000 7fa02fc00640 1 -- start start 2024-09-13T17:52:36.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.272+0000 7fa02fc00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa028151420 0x7fa0280cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:36.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.272+0000 7fa02fc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa0280ccba0 0x7fa028070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:36.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.272+0000 7fa02fc00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa028151800 con 0x7fa028070960 2024-09-13T17:52:36.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.272+0000 7fa02fc00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0280cbc30 con 0x7fa0280ccba0 2024-09-13T17:52:36.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.272+0000 7fa02fc00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa028070d80 con 0x7fa028151420 2024-09-13T17:52:36.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.272+0000 7fa01fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa0280ccba0 0x7fa028070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:36.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.272+0000 7fa02dc00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa028070960 0x7fa02815df20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46244/0 (socket says 172.21.15.114:46244) 2024-09-13T17:52:36.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.272+0000 7fa01fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa0280ccba0 0x7fa028070420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55912/0 (socket says 172.21.15.114:55912) 2024-09-13T17:52:36.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.272+0000 7fa02dc00640 1 -- 172.21.15.114:0/3804316476 learned_addr learned my addr 172.21.15.114:0/3804316476 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:36.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.272+0000 7fa02d200640 1 --2- 172.21.15.114:0/3804316476 >> v2:172.21.15.134:3300/0 conn(0x7fa028151420 0x7fa0280cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:36.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.272+0000 7fa01fe00640 1 -- 172.21.15.114:0/3804316476 >> v2:172.21.15.134:3300/0 conn(0x7fa028151420 msgr2=0x7fa0280cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:36.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.272+0000 7fa01fe00640 1 --2- 172.21.15.114:0/3804316476 >> v2:172.21.15.134:3300/0 conn(0x7fa028151420 0x7fa0280cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:36.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.272+0000 7fa01fe00640 1 -- 172.21.15.114:0/3804316476 >> v1:172.21.15.114:6789/0 conn(0x7fa028070960 legacy=0x7fa02815df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:36.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.272+0000 7fa01fe00640 1 -- 172.21.15.114:0/3804316476 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0280cafb0 con 0x7fa0280ccba0 2024-09-13T17:52:36.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.276+0000 7fa01fe00640 1 --2- 172.21.15.114:0/3804316476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0280ccba0 0x7fa028070420 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa0280b3980 tx=0x7fa01001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32368ee96ee782cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:36.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.276+0000 7fa027e00640 1 -- 172.21.15.114:0/3804316476 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0100ab600 con 0x7fa0280ccba0 2024-09-13T17:52:36.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.276+0000 7fa027e00640 1 -- 172.21.15.114:0/3804316476 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0100a7050 con 0x7fa0280ccba0 2024-09-13T17:52:36.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.276+0000 7fa027e00640 1 -- 172.21.15.114:0/3804316476 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0100ab980 con 0x7fa0280ccba0 2024-09-13T17:52:36.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.276+0000 7fa02fc00640 1 -- 172.21.15.114:0/3804316476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0280ccba0 msgr2=0x7fa028070420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:36.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.276+0000 7fa02fc00640 1 --2- 172.21.15.114:0/3804316476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0280ccba0 0x7fa028070420 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa0280b3980 tx=0x7fa01001c330 comp rx=0 tx=0).stop 2024-09-13T17:52:36.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.276+0000 7fa02fc00640 1 -- 172.21.15.114:0/3804316476 shutdown_connections 2024-09-13T17:52:36.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.276+0000 7fa02fc00640 1 --2- 172.21.15.114:0/3804316476 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0280ccba0 0x7fa028070420 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:36.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.276+0000 7fa02fc00640 1 --2- 172.21.15.114:0/3804316476 >> v2:172.21.15.134:3300/0 conn(0x7fa028151420 0x7fa0280cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:36.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.276+0000 7fa02fc00640 1 -- 172.21.15.114:0/3804316476 >> 172.21.15.114:0/3804316476 conn(0x7fa0280660b0 msgr2=0x7fa028069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:36.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.276+0000 7fa02fc00640 1 -- 172.21.15.114:0/3804316476 shutdown_connections 2024-09-13T17:52:36.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.276+0000 7fa02fc00640 1 -- 172.21.15.114:0/3804316476 wait complete. 2024-09-13T17:52:36.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.276+0000 7fa02fc00640 1 Processor -- start 2024-09-13T17:52:36.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.276+0000 7fa02fc00640 1 -- start start 2024-09-13T17:52:36.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.280+0000 7fa02fc00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa028070960 0x7fa028149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:36.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.280+0000 7fa02fc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa0280ccba0 0x7fa028163440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:36.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.280+0000 7fa02fc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa028151420 0x7fa028163980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:36.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.280+0000 7fa02fc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0280b2660 con 0x7fa028151420 2024-09-13T17:52:36.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.280+0000 7fa02fc00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0280b2870 con 0x7fa028070960 2024-09-13T17:52:36.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.280+0000 7fa02fc00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0280b2b50 con 0x7fa0280ccba0 2024-09-13T17:52:36.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.280+0000 7fa02dc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa028151420 0x7fa028163980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:36.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.280+0000 7fa02dc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa028151420 0x7fa028163980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55928/0 (socket says 172.21.15.114:55928) 2024-09-13T17:52:36.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.280+0000 7fa02dc00640 1 -- 172.21.15.114:0/2819726405 learned_addr learned my addr 172.21.15.114:0/2819726405 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:36.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.280+0000 7fa02d200640 1 --2- 172.21.15.114:0/2819726405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa028070960 0x7fa028149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:36.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.280+0000 7fa01fe00640 1 --2- 172.21.15.114:0/2819726405 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa0280ccba0 0x7fa028163440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:36.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.280+0000 7fa02dc00640 1 -- 172.21.15.114:0/2819726405 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa0280ccba0 msgr2=0x7fa028163440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:36.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.280+0000 7fa02dc00640 1 --2- 172.21.15.114:0/2819726405 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa0280ccba0 0x7fa028163440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:36.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.280+0000 7fa02dc00640 1 -- 172.21.15.114:0/2819726405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa028070960 msgr2=0x7fa028149d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:36.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.280+0000 7fa02dc00640 1 --2- 172.21.15.114:0/2819726405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa028070960 0x7fa028149d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:36.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.280+0000 7fa02dc00640 1 -- 172.21.15.114:0/2819726405 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa010009420 con 0x7fa028151420 2024-09-13T17:52:36.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.280+0000 7fa02dc00640 1 --2- 172.21.15.114:0/2819726405 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa028151420 0x7fa028163980 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa020002240 tx=0x7fa02000cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:36.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.280+0000 7fa025600640 1 -- 172.21.15.114:0/2819726405 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02000abd0 con 0x7fa028151420 2024-09-13T17:52:36.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.280+0000 7fa025600640 1 -- 172.21.15.114:0/2819726405 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02000ad30 con 0x7fa028151420 2024-09-13T17:52:36.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.280+0000 7fa025600640 1 -- 172.21.15.114:0/2819726405 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02000aea0 con 0x7fa028151420 2024-09-13T17:52:36.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.280+0000 7fa02fc00640 1 -- 172.21.15.114:0/2819726405 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0280b2e30 con 0x7fa028151420 2024-09-13T17:52:36.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.280+0000 7fa02fc00640 1 -- 172.21.15.114:0/2819726405 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa02814a2a0 con 0x7fa028151420 2024-09-13T17:52:36.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.280+0000 7fa02fc00640 1 -- 172.21.15.114:0/2819726405 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0280b3350 con 0x7fa028151420 2024-09-13T17:52:36.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.280+0000 7fa025600640 1 -- 172.21.15.114:0/2819726405 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa020007070 con 0x7fa028151420 2024-09-13T17:52:36.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.284+0000 7fa025600640 1 --2- 172.21.15.114:0/2819726405 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa004066690 0x7fa004068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:36.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.284+0000 7fa025600640 1 -- 172.21.15.114:0/2819726405 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa020084410 con 0x7fa028151420 2024-09-13T17:52:36.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.284+0000 7fa02d200640 1 --2- 172.21.15.114:0/2819726405 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa004066690 0x7fa004068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:36.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.284+0000 7fa02d200640 1 --2- 172.21.15.114:0/2819726405 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa004066690 0x7fa004068b50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa018007a60 tx=0x7fa018008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:36.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.288+0000 7fa025600640 1 -- 172.21.15.114:0/2819726405 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa0280b3350 con 0x7fa028151420 2024-09-13T17:52:36.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.440+0000 7fa02fc00640 1 -- 172.21.15.114:0/2819726405 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa0280b3350 con 0x7fa028151420 2024-09-13T17:52:36.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.440+0000 7fa025600640 1 -- 172.21.15.114:0/2819726405 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa0280b3350 con 0x7fa028151420 2024-09-13T17:52:36.443 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:52:36.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.440+0000 7fa02fc00640 1 -- 172.21.15.114:0/2819726405 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa004066690 msgr2=0x7fa004068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:36.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.440+0000 7fa02fc00640 1 --2- 172.21.15.114:0/2819726405 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa004066690 0x7fa004068b50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa018007a60 tx=0x7fa018008040 comp rx=0 tx=0).stop 2024-09-13T17:52:36.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.440+0000 7fa02fc00640 1 -- 172.21.15.114:0/2819726405 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa028151420 msgr2=0x7fa028163980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:36.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.440+0000 7fa02fc00640 1 --2- 172.21.15.114:0/2819726405 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa028151420 0x7fa028163980 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa020002240 tx=0x7fa02000cf00 comp rx=0 tx=0).stop 2024-09-13T17:52:36.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.440+0000 7fa02fc00640 1 -- 172.21.15.114:0/2819726405 shutdown_connections 2024-09-13T17:52:36.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.440+0000 7fa02fc00640 1 --2- 172.21.15.114:0/2819726405 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa004066690 0x7fa004068b50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:36.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.440+0000 7fa02fc00640 1 --2- 172.21.15.114:0/2819726405 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa028151420 0x7fa028163980 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:36.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.440+0000 7fa02fc00640 1 --2- 172.21.15.114:0/2819726405 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa0280ccba0 0x7fa028163440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:36.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.440+0000 7fa02fc00640 1 --2- 172.21.15.114:0/2819726405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa028070960 0x7fa028149d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:36.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.440+0000 7fa02fc00640 1 -- 172.21.15.114:0/2819726405 >> 172.21.15.114:0/2819726405 conn(0x7fa0280660b0 msgr2=0x7fa02815ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:36.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.440+0000 7fa02fc00640 1 -- 172.21.15.114:0/2819726405 shutdown_connections 2024-09-13T17:52:36.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.440+0000 7fa02fc00640 1 -- 172.21.15.114:0/2819726405 wait complete. 2024-09-13T17:52:36.464 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:52:36.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.600+0000 7f221fe00640 1 Processor -- start 2024-09-13T17:52:36.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.600+0000 7f221fe00640 1 -- start start 2024-09-13T17:52:36.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.600+0000 7f221fe00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f222006dd70 0x7f22200b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:36.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.600+0000 7f221fe00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2220071990 0x7f22200acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:36.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.600+0000 7f221fe00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222015a6c0 con 0x7f22201538d0 2024-09-13T17:52:36.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.600+0000 7f221fe00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2220153cb0 con 0x7f222006dd70 2024-09-13T17:52:36.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.600+0000 7f221fe00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22200abe30 con 0x7f2220071990 2024-09-13T17:52:36.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.600+0000 7f221f400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2220071990 0x7f22200acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:36.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.600+0000 7f221e000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f222006dd70 0x7f22200b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:36.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.600+0000 7f221e000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f222006dd70 0x7f22200b1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:51438/0 (socket says 172.21.15.114:51438) 2024-09-13T17:52:36.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.600+0000 7f221ea00640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f22201538d0 0x7f2220071280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:36120/0 (socket says 172.21.15.114:36120) 2024-09-13T17:52:36.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.600+0000 7f221e000640 1 -- 172.21.15.114:0/891329345 learned_addr learned my addr 172.21.15.114:0/891329345 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:36.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.600+0000 7f221e000640 1 -- 172.21.15.114:0/891329345 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2220071990 msgr2=0x7f22200acbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:36.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.600+0000 7f221e000640 1 --2- 172.21.15.114:0/891329345 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2220071990 0x7f22200acbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:36.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.600+0000 7f221e000640 1 -- 172.21.15.114:0/891329345 >> v1:172.21.15.134:6789/0 conn(0x7f22201538d0 legacy=0x7f2220071280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:36.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.600+0000 7f221e000640 1 -- 172.21.15.114:0/891329345 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22200ac110 con 0x7f222006dd70 2024-09-13T17:52:36.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.600+0000 7f221f400640 1 --2- 172.21.15.114:0/891329345 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2220071990 0x7f22200acbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:52:36.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.600+0000 7f221d600640 1 -- 172.21.15.114:0/891329345 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2550674181 0 0) 0x7f222015a6c0 con 0x7f22201538d0 2024-09-13T17:52:36.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.604+0000 7f221e000640 1 --2- 172.21.15.114:0/891329345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f222006dd70 0x7f22200b1080 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f220c009870 tx=0x7f220c01c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb02ddc6e654b3b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:36.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.604+0000 7f221d600640 1 -- 172.21.15.114:0/891329345 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220c0a95f0 con 0x7f222006dd70 2024-09-13T17:52:36.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.604+0000 7f221d600640 1 -- 172.21.15.114:0/891329345 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220c0a9750 con 0x7f222006dd70 2024-09-13T17:52:36.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.604+0000 7f221d600640 1 -- 172.21.15.114:0/891329345 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220c0a9ae0 con 0x7f222006dd70 2024-09-13T17:52:36.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.604+0000 7f221fe00640 1 -- 172.21.15.114:0/891329345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f222006dd70 msgr2=0x7f22200b1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:36.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.604+0000 7f221fe00640 1 --2- 172.21.15.114:0/891329345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f222006dd70 0x7f22200b1080 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f220c009870 tx=0x7f220c01c530 comp rx=0 tx=0).stop 2024-09-13T17:52:36.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.604+0000 7f221fe00640 1 -- 172.21.15.114:0/891329345 shutdown_connections 2024-09-13T17:52:36.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.604+0000 7f221fe00640 1 --2- 172.21.15.114:0/891329345 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2220071990 0x7f22200acbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:36.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.604+0000 7f221fe00640 1 --2- 172.21.15.114:0/891329345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f222006dd70 0x7f22200b1080 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:36.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.604+0000 7f221fe00640 1 -- 172.21.15.114:0/891329345 >> 172.21.15.114:0/891329345 conn(0x7f22200ce0d0 msgr2=0x7f22200ce4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:36.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.604+0000 7f221fe00640 1 -- 172.21.15.114:0/891329345 shutdown_connections 2024-09-13T17:52:36.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.604+0000 7f221fe00640 1 -- 172.21.15.114:0/891329345 wait complete. 2024-09-13T17:52:36.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.604+0000 7f221fe00640 1 Processor -- start 2024-09-13T17:52:36.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.608+0000 7f221fe00640 1 -- start start 2024-09-13T17:52:36.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.608+0000 7f221fe00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f222006dd70 0x7f2220150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:36.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.608+0000 7f221fe00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2220071990 0x7f22200ae830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:36.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.608+0000 7f221fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22201538d0 0x7f22200cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:36.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.608+0000 7f221fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22200cb3d0 con 0x7f22201538d0 2024-09-13T17:52:36.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.608+0000 7f221fe00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22200caae0 con 0x7f222006dd70 2024-09-13T17:52:36.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.608+0000 7f221fe00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22200af240 con 0x7f2220071990 2024-09-13T17:52:36.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.608+0000 7f221f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22201538d0 0x7f22200cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:36.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.608+0000 7f221f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22201538d0 0x7f22200cd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55932/0 (socket says 172.21.15.114:55932) 2024-09-13T17:52:36.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.608+0000 7f221f400640 1 -- 172.21.15.114:0/1382543457 learned_addr learned my addr 172.21.15.114:0/1382543457 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:36.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.608+0000 7f221e000640 1 --2- 172.21.15.114:0/1382543457 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2220071990 0x7f22200ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:36.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.608+0000 7f221ea00640 1 --2- 172.21.15.114:0/1382543457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f222006dd70 0x7f2220150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:36.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.608+0000 7f221f400640 1 -- 172.21.15.114:0/1382543457 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2220071990 msgr2=0x7f22200ae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:36.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.608+0000 7f221f400640 1 --2- 172.21.15.114:0/1382543457 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2220071990 0x7f22200ae830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:36.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.608+0000 7f221f400640 1 -- 172.21.15.114:0/1382543457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f222006dd70 msgr2=0x7f2220150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:36.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.608+0000 7f221f400640 1 --2- 172.21.15.114:0/1382543457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f222006dd70 0x7f2220150610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:36.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.608+0000 7f221f400640 1 -- 172.21.15.114:0/1382543457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2218009a70 con 0x7f22201538d0 2024-09-13T17:52:36.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.608+0000 7f221f400640 1 --2- 172.21.15.114:0/1382543457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22201538d0 0x7f22200cd1f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f221800efc0 tx=0x7f221800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:36.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.608+0000 7f2216a00640 1 -- 172.21.15.114:0/1382543457 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2218009cc0 con 0x7f22201538d0 2024-09-13T17:52:36.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.608+0000 7f2216a00640 1 -- 172.21.15.114:0/1382543457 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221800f040 con 0x7f22201538d0 2024-09-13T17:52:36.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.608+0000 7f221fe00640 1 -- 172.21.15.114:0/1382543457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f220c0094d0 con 0x7f22201538d0 2024-09-13T17:52:36.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.608+0000 7f2216a00640 1 -- 172.21.15.114:0/1382543457 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22180039a0 con 0x7f22201538d0 2024-09-13T17:52:36.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.608+0000 7f221fe00640 1 -- 172.21.15.114:0/1382543457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22200cb060 con 0x7f22201538d0 2024-09-13T17:52:36.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.608+0000 7f221fe00640 1 -- 172.21.15.114:0/1382543457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22200cb580 con 0x7f22201538d0 2024-09-13T17:52:36.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.612+0000 7f2216a00640 1 -- 172.21.15.114:0/1382543457 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2218014480 con 0x7f22201538d0 2024-09-13T17:52:36.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.612+0000 7f2216a00640 1 --2- 172.21.15.114:0/1382543457 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2200066690 0x7f2200068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:36.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.612+0000 7f2216a00640 1 -- 172.21.15.114:0/1382543457 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f22180852a0 con 0x7f22201538d0 2024-09-13T17:52:36.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.612+0000 7f221ea00640 1 --2- 172.21.15.114:0/1382543457 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2200066690 0x7f2200068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:36.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.612+0000 7f221ea00640 1 --2- 172.21.15.114:0/1382543457 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2200066690 0x7f2200068b50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2210000f70 tx=0x7f2210007c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:36.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.616+0000 7f2216a00640 1 -- 172.21.15.114:0/1382543457 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f22200cb580 con 0x7f22201538d0 2024-09-13T17:52:36.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.768+0000 7f221fe00640 1 -- 172.21.15.114:0/1382543457 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f22200cb580 con 0x7f22201538d0 2024-09-13T17:52:36.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.772+0000 7f2216a00640 1 -- 172.21.15.114:0/1382543457 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f22200cb580 con 0x7f22201538d0 2024-09-13T17:52:36.774 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-09-13T17:52:36.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.772+0000 7f221fe00640 1 -- 172.21.15.114:0/1382543457 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2200066690 msgr2=0x7f2200068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:36.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.772+0000 7f221fe00640 1 --2- 172.21.15.114:0/1382543457 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2200066690 0x7f2200068b50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2210000f70 tx=0x7f2210007c10 comp rx=0 tx=0).stop 2024-09-13T17:52:36.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.772+0000 7f221fe00640 1 -- 172.21.15.114:0/1382543457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22201538d0 msgr2=0x7f22200cd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:36.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.772+0000 7f221fe00640 1 --2- 172.21.15.114:0/1382543457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22201538d0 0x7f22200cd1f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f221800efc0 tx=0x7f221800c490 comp rx=0 tx=0).stop 2024-09-13T17:52:36.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.772+0000 7f221fe00640 1 -- 172.21.15.114:0/1382543457 shutdown_connections 2024-09-13T17:52:36.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.772+0000 7f221fe00640 1 --2- 172.21.15.114:0/1382543457 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2200066690 0x7f2200068b50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:36.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.772+0000 7f221fe00640 1 --2- 172.21.15.114:0/1382543457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22201538d0 0x7f22200cd1f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:36.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.772+0000 7f221fe00640 1 --2- 172.21.15.114:0/1382543457 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2220071990 0x7f22200ae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:36.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.772+0000 7f221fe00640 1 --2- 172.21.15.114:0/1382543457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f222006dd70 0x7f2220150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:36.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.772+0000 7f221fe00640 1 -- 172.21.15.114:0/1382543457 >> 172.21.15.114:0/1382543457 conn(0x7f22200ce0d0 msgr2=0x7f22200b2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:36.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.772+0000 7f221fe00640 1 -- 172.21.15.114:0/1382543457 shutdown_connections 2024-09-13T17:52:36.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.772+0000 7f221fe00640 1 -- 172.21.15.114:0/1382543457 wait complete. 2024-09-13T17:52:36.795 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:52:36.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.928+0000 7f2df8a00640 1 Processor -- start 2024-09-13T17:52:36.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.928+0000 7f2df8a00640 1 -- start start 2024-09-13T17:52:36.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.928+0000 7f2df8a00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2df4151420 0x7f2df40cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:36.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.928+0000 7f2df8a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2df40ccba0 0x7f2df4070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:36.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.928+0000 7f2df8a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df4151800 con 0x7f2df4070960 2024-09-13T17:52:36.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.928+0000 7f2df8a00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df40cbc30 con 0x7f2df4151420 2024-09-13T17:52:36.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.928+0000 7f2df8a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df4070d90 con 0x7f2df40ccba0 2024-09-13T17:52:36.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.928+0000 7f2df2800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2df4070960 0x7f2df415df20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46254/0 (socket says 172.21.15.114:46254) 2024-09-13T17:52:36.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.928+0000 7f2df2800640 1 -- 172.21.15.114:0/3705628143 learned_addr learned my addr 172.21.15.114:0/3705628143 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:36.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.932+0000 7f2df1e00640 1 --2- 172.21.15.114:0/3705628143 >> v2:172.21.15.134:3300/0 conn(0x7f2df4151420 0x7f2df40cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:36.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.932+0000 7f2de9400640 1 --2- 172.21.15.114:0/3705628143 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2df40ccba0 0x7f2df4070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:36.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.932+0000 7f2df1400640 1 -- 172.21.15.114:0/3705628143 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1300816723 0 0) 0x7f2df4151800 con 0x7f2df4070960 2024-09-13T17:52:36.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.932+0000 7f2df1400640 1 -- 172.21.15.114:0/3705628143 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dd8003530 con 0x7f2df4070960 2024-09-13T17:52:36.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.932+0000 7f2df1400640 1 -- 172.21.15.114:0/3705628143 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3746928561 0 0) 0x7f2dd8003530 con 0x7f2df4070960 2024-09-13T17:52:36.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.932+0000 7f2df1e00640 1 -- 172.21.15.114:0/3705628143 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2df40ccba0 msgr2=0x7f2df4070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:36.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.932+0000 7f2df1e00640 1 --2- 172.21.15.114:0/3705628143 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2df40ccba0 0x7f2df4070420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:36.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.932+0000 7f2df1e00640 1 -- 172.21.15.114:0/3705628143 >> v1:172.21.15.114:6789/0 conn(0x7f2df4070960 legacy=0x7f2df415df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:36.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.932+0000 7f2df1e00640 1 -- 172.21.15.114:0/3705628143 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df40cafb0 con 0x7f2df4151420 2024-09-13T17:52:36.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.932+0000 7f2df1e00640 1 --2- 172.21.15.114:0/3705628143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df4151420 0x7f2df40cc660 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2de40097c0 tx=0x7f2de401c270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f390868cdca4d7bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:36.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.932+0000 7f2df1400640 1 -- 172.21.15.114:0/3705628143 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec001a20 con 0x7f2df4151420 2024-09-13T17:52:36.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.932+0000 7f2df1400640 1 -- 172.21.15.114:0/3705628143 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de40a7050 con 0x7f2df4151420 2024-09-13T17:52:36.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.932+0000 7f2df1400640 1 -- 172.21.15.114:0/3705628143 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de40ab600 con 0x7f2df4151420 2024-09-13T17:52:36.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.936+0000 7f2df8a00640 1 -- 172.21.15.114:0/3705628143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df4151420 msgr2=0x7f2df40cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:36.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.936+0000 7f2df8a00640 1 --2- 172.21.15.114:0/3705628143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df4151420 0x7f2df40cc660 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2de40097c0 tx=0x7f2de401c270 comp rx=0 tx=0).stop 2024-09-13T17:52:36.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.936+0000 7f2df8a00640 1 -- 172.21.15.114:0/3705628143 shutdown_connections 2024-09-13T17:52:36.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.936+0000 7f2df8a00640 1 --2- 172.21.15.114:0/3705628143 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2df40ccba0 0x7f2df4070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:36.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.936+0000 7f2df8a00640 1 --2- 172.21.15.114:0/3705628143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df4151420 0x7f2df40cc660 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:36.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.936+0000 7f2df8a00640 1 -- 172.21.15.114:0/3705628143 >> 172.21.15.114:0/3705628143 conn(0x7f2df40660b0 msgr2=0x7f2df4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:36.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.936+0000 7f2df8a00640 1 -- 172.21.15.114:0/3705628143 shutdown_connections 2024-09-13T17:52:36.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.936+0000 7f2df8a00640 1 -- 172.21.15.114:0/3705628143 wait complete. 2024-09-13T17:52:36.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.936+0000 7f2df8a00640 1 Processor -- start 2024-09-13T17:52:36.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.936+0000 7f2df8a00640 1 -- start start 2024-09-13T17:52:36.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.936+0000 7f2df8a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2df4070960 0x7f2df414c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:36.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.936+0000 7f2df8a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df40ccba0 0x7f2df41591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:36.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.936+0000 7f2df8a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2df4151420 0x7f2df4153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:36.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.936+0000 7f2df8a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df4162090 con 0x7f2df4151420 2024-09-13T17:52:36.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.936+0000 7f2df8a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df4162370 con 0x7f2df40ccba0 2024-09-13T17:52:36.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.936+0000 7f2df8a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df4162650 con 0x7f2df4070960 2024-09-13T17:52:36.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.936+0000 7f2df2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2df4151420 0x7f2df4153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:36.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.936+0000 7f2df2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2df4151420 0x7f2df4153a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55936/0 (socket says 172.21.15.114:55936) 2024-09-13T17:52:36.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.936+0000 7f2df2800640 1 -- 172.21.15.114:0/2922207403 learned_addr learned my addr 172.21.15.114:0/2922207403 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:36.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.936+0000 7f2de9400640 1 --2- 172.21.15.114:0/2922207403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df40ccba0 0x7f2df41591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:36.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.936+0000 7f2df2800640 1 -- 172.21.15.114:0/2922207403 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2df4070960 msgr2=0x7f2df414c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:36.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.936+0000 7f2df2800640 1 --2- 172.21.15.114:0/2922207403 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2df4070960 0x7f2df414c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:36.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.936+0000 7f2df2800640 1 -- 172.21.15.114:0/2922207403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df40ccba0 msgr2=0x7f2df41591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:36.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.940+0000 7f2df2800640 1 --2- 172.21.15.114:0/2922207403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df40ccba0 0x7f2df41591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:36.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.940+0000 7f2df2800640 1 -- 172.21.15.114:0/2922207403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de4009420 con 0x7f2df4151420 2024-09-13T17:52:36.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.940+0000 7f2de9400640 1 --2- 172.21.15.114:0/2922207403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df40ccba0 0x7f2df41591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:52:36.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.940+0000 7f2df2800640 1 --2- 172.21.15.114:0/2922207403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2df4151420 0x7f2df4153a80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00c8c0 tx=0x7f2dec00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:36.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.940+0000 7f2deaa00640 1 -- 172.21.15.114:0/2922207403 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec00a640 con 0x7f2df4151420 2024-09-13T17:52:36.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.940+0000 7f2deaa00640 1 -- 172.21.15.114:0/2922207403 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dec00a7c0 con 0x7f2df4151420 2024-09-13T17:52:36.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.940+0000 7f2deaa00640 1 -- 172.21.15.114:0/2922207403 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec00ab70 con 0x7f2df4151420 2024-09-13T17:52:36.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.940+0000 7f2df8a00640 1 -- 172.21.15.114:0/2922207403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df4162930 con 0x7f2df4151420 2024-09-13T17:52:36.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.940+0000 7f2df8a00640 1 -- 172.21.15.114:0/2922207403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df4159710 con 0x7f2df4151420 2024-09-13T17:52:36.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.940+0000 7f2df8a00640 1 -- 172.21.15.114:0/2922207403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df41f6010 con 0x7f2df4151420 2024-09-13T17:52:36.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.940+0000 7f2deaa00640 1 -- 172.21.15.114:0/2922207403 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2dec00acd0 con 0x7f2df4151420 2024-09-13T17:52:36.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.940+0000 7f2deaa00640 1 --2- 172.21.15.114:0/2922207403 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2dd0066690 0x7f2dd0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:36.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.940+0000 7f2deaa00640 1 -- 172.21.15.114:0/2922207403 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2dec083ba0 con 0x7f2df4151420 2024-09-13T17:52:36.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.944+0000 7f2df1e00640 1 --2- 172.21.15.114:0/2922207403 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2dd0066690 0x7f2dd0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:36.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.944+0000 7f2df1e00640 1 --2- 172.21.15.114:0/2922207403 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2dd0066690 0x7f2dd0068b50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2de40ad000 tx=0x7f2de4004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:36.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:36.944+0000 7f2deaa00640 1 -- 172.21.15.114:0/2922207403 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2df41f6010 con 0x7f2df4151420 2024-09-13T17:52:37.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.100+0000 7f2df8a00640 1 -- 172.21.15.114:0/2922207403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2df41f6010 con 0x7f2df4151420 2024-09-13T17:52:37.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.100+0000 7f2deaa00640 1 -- 172.21.15.114:0/2922207403 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2df41f6010 con 0x7f2df4151420 2024-09-13T17:52:37.103 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:52:37.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.100+0000 7f2df8a00640 1 -- 172.21.15.114:0/2922207403 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2dd0066690 msgr2=0x7f2dd0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:37.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.100+0000 7f2df8a00640 1 --2- 172.21.15.114:0/2922207403 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2dd0066690 0x7f2dd0068b50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2de40ad000 tx=0x7f2de4004740 comp rx=0 tx=0).stop 2024-09-13T17:52:37.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.100+0000 7f2df8a00640 1 -- 172.21.15.114:0/2922207403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2df4151420 msgr2=0x7f2df4153a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:37.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.100+0000 7f2df8a00640 1 --2- 172.21.15.114:0/2922207403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2df4151420 0x7f2df4153a80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00c8c0 tx=0x7f2dec00cd80 comp rx=0 tx=0).stop 2024-09-13T17:52:37.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.100+0000 7f2df8a00640 1 -- 172.21.15.114:0/2922207403 shutdown_connections 2024-09-13T17:52:37.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.100+0000 7f2df8a00640 1 --2- 172.21.15.114:0/2922207403 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2dd0066690 0x7f2dd0068b50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:37.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.100+0000 7f2df8a00640 1 --2- 172.21.15.114:0/2922207403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2df4151420 0x7f2df4153a80 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:37.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.100+0000 7f2df8a00640 1 --2- 172.21.15.114:0/2922207403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df40ccba0 0x7f2df41591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:37.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.100+0000 7f2df8a00640 1 --2- 172.21.15.114:0/2922207403 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2df4070960 0x7f2df414c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:37.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.100+0000 7f2df8a00640 1 -- 172.21.15.114:0/2922207403 >> 172.21.15.114:0/2922207403 conn(0x7f2df40660b0 msgr2=0x7f2df415b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:37.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.100+0000 7f2df8a00640 1 -- 172.21.15.114:0/2922207403 shutdown_connections 2024-09-13T17:52:37.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.100+0000 7f2df8a00640 1 -- 172.21.15.114:0/2922207403 wait complete. 2024-09-13T17:52:37.125 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:52:37.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.256+0000 7f61a8600640 1 Processor -- start 2024-09-13T17:52:37.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.256+0000 7f61a8600640 1 -- start start 2024-09-13T17:52:37.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.260+0000 7f61a8600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61a0151420 0x7f61a00cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:37.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.260+0000 7f61a8600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f61a00ccba0 0x7f61a0070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:37.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.260+0000 7f61a8600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a0070db0 con 0x7f61a0070960 2024-09-13T17:52:37.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.260+0000 7f61a8600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61a00cbc30 con 0x7f61a00ccba0 2024-09-13T17:52:37.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.260+0000 7f61a8600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a0151800 con 0x7f61a0151420 2024-09-13T17:52:37.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.260+0000 7f61a6600640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f61a0070960 0x7f61a015df20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46264/0 (socket says 172.21.15.114:46264) 2024-09-13T17:52:37.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.260+0000 7f61a6600640 1 -- 172.21.15.114:0/3058084011 learned_addr learned my addr 172.21.15.114:0/3058084011 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:37.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.260+0000 7f61a5c00640 1 --2- 172.21.15.114:0/3058084011 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61a0151420 0x7f61a00cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:37.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.260+0000 7f61a5200640 1 --2- 172.21.15.114:0/3058084011 >> v2:172.21.15.134:3300/0 conn(0x7f61a00ccba0 0x7f61a0070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:37.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.260+0000 7f619fe00640 1 -- 172.21.15.114:0/3058084011 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3073541330 0 0) 0x7f61980014a0 con 0x7f61a0070960 2024-09-13T17:52:37.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.260+0000 7f619fe00640 1 -- 172.21.15.114:0/3058084011 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6188003530 con 0x7f61a0070960 2024-09-13T17:52:37.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.260+0000 7f61a5200640 1 -- 172.21.15.114:0/3058084011 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61a0151420 msgr2=0x7f61a00cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:37.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.260+0000 7f61a5200640 1 --2- 172.21.15.114:0/3058084011 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61a0151420 0x7f61a00cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:37.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.260+0000 7f61a5200640 1 -- 172.21.15.114:0/3058084011 >> v1:172.21.15.114:6789/0 conn(0x7f61a0070960 legacy=0x7f61a015df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:37.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.260+0000 7f61a5200640 1 -- 172.21.15.114:0/3058084011 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a00cafb0 con 0x7f61a00ccba0 2024-09-13T17:52:37.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.264+0000 7f61a5200640 1 --2- 172.21.15.114:0/3058084011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a00ccba0 0x7f61a0070420 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f618c0097c0 tx=0x7f618c01c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46246c736a07c26f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:37.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.264+0000 7f619fe00640 1 -- 172.21.15.114:0/3058084011 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c004230 con 0x7f61a00ccba0 2024-09-13T17:52:37.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.264+0000 7f619fe00640 1 -- 172.21.15.114:0/3058084011 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618c0a7050 con 0x7f61a00ccba0 2024-09-13T17:52:37.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.264+0000 7f619fe00640 1 -- 172.21.15.114:0/3058084011 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c003620 con 0x7f61a00ccba0 2024-09-13T17:52:37.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.264+0000 7f61a8600640 1 -- 172.21.15.114:0/3058084011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a00ccba0 msgr2=0x7f61a0070420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:37.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.264+0000 7f61a8600640 1 --2- 172.21.15.114:0/3058084011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a00ccba0 0x7f61a0070420 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f618c0097c0 tx=0x7f618c01c350 comp rx=0 tx=0).stop 2024-09-13T17:52:37.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.264+0000 7f61a8600640 1 -- 172.21.15.114:0/3058084011 shutdown_connections 2024-09-13T17:52:37.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.264+0000 7f61a8600640 1 --2- 172.21.15.114:0/3058084011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a00ccba0 0x7f61a0070420 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:37.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.264+0000 7f61a8600640 1 --2- 172.21.15.114:0/3058084011 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61a0151420 0x7f61a00cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:37.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.264+0000 7f61a8600640 1 -- 172.21.15.114:0/3058084011 >> 172.21.15.114:0/3058084011 conn(0x7f61a00660b0 msgr2=0x7f61a0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:37.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.264+0000 7f61a8600640 1 -- 172.21.15.114:0/3058084011 shutdown_connections 2024-09-13T17:52:37.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.264+0000 7f61a8600640 1 -- 172.21.15.114:0/3058084011 wait complete. 2024-09-13T17:52:37.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.264+0000 7f61a8600640 1 Processor -- start 2024-09-13T17:52:37.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.264+0000 7f61a8600640 1 -- start start 2024-09-13T17:52:37.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.264+0000 7f61a8600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61a0070960 0x7f61a00b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:37.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.264+0000 7f61a8600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61a00ccba0 0x7f61a015ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:37.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.264+0000 7f61a8600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a0151420 0x7f61a01636a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:37.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.264+0000 7f61a8600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a015bfa0 con 0x7f61a00ccba0 2024-09-13T17:52:37.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.264+0000 7f61a8600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a0148e70 con 0x7f61a0151420 2024-09-13T17:52:37.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.264+0000 7f61a8600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a00afe60 con 0x7f61a0070960 2024-09-13T17:52:37.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.268+0000 7f61a5200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61a00ccba0 0x7f61a015ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:37.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.268+0000 7f61a5200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61a00ccba0 0x7f61a015ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55946/0 (socket says 172.21.15.114:55946) 2024-09-13T17:52:37.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.268+0000 7f61a5200640 1 -- 172.21.15.114:0/4074855812 learned_addr learned my addr 172.21.15.114:0/4074855812 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:37.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.268+0000 7f61a6600640 1 --2- 172.21.15.114:0/4074855812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a0151420 0x7f61a01636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:37.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.268+0000 7f61a5c00640 1 --2- 172.21.15.114:0/4074855812 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61a0070960 0x7f61a00b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:37.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.268+0000 7f61a5200640 1 -- 172.21.15.114:0/4074855812 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61a0070960 msgr2=0x7f61a00b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:37.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.268+0000 7f61a5200640 1 --2- 172.21.15.114:0/4074855812 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61a0070960 0x7f61a00b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:37.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.268+0000 7f61a5200640 1 -- 172.21.15.114:0/4074855812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a0151420 msgr2=0x7f61a01636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:37.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.268+0000 7f61a5200640 1 --2- 172.21.15.114:0/4074855812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a0151420 0x7f61a01636a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:37.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.268+0000 7f61a5200640 1 -- 172.21.15.114:0/4074855812 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618c009420 con 0x7f61a00ccba0 2024-09-13T17:52:37.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.268+0000 7f61a6600640 1 --2- 172.21.15.114:0/4074855812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a0151420 0x7f61a01636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:52:37.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.268+0000 7f61a5c00640 1 --2- 172.21.15.114:0/4074855812 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61a0070960 0x7f61a00b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:52:37.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.268+0000 7f61a5200640 1 --2- 172.21.15.114:0/4074855812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61a00ccba0 0x7f61a015ba60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f618c019f80 tx=0x7f618c0190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:37.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.268+0000 7f619d600640 1 -- 172.21.15.114:0/4074855812 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c003af0 con 0x7f61a00ccba0 2024-09-13T17:52:37.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.268+0000 7f619d600640 1 -- 172.21.15.114:0/4074855812 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618c003c50 con 0x7f61a00ccba0 2024-09-13T17:52:37.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.268+0000 7f619d600640 1 -- 172.21.15.114:0/4074855812 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c0ab440 con 0x7f61a00ccba0 2024-09-13T17:52:37.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.268+0000 7f61a8600640 1 -- 172.21.15.114:0/4074855812 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a00b0140 con 0x7f61a00ccba0 2024-09-13T17:52:37.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.268+0000 7f61a8600640 1 -- 172.21.15.114:0/4074855812 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a00b21f0 con 0x7f61a00ccba0 2024-09-13T17:52:37.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.268+0000 7f61a8600640 1 -- 172.21.15.114:0/4074855812 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a00683d0 con 0x7f61a00ccba0 2024-09-13T17:52:37.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.268+0000 7f619d600640 1 -- 172.21.15.114:0/4074855812 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f618c0b2040 con 0x7f61a00ccba0 2024-09-13T17:52:37.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.268+0000 7f619d600640 1 --2- 172.21.15.114:0/4074855812 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6180066690 0x7f6180068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:37.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.268+0000 7f619d600640 1 -- 172.21.15.114:0/4074855812 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f618c11e3e0 con 0x7f61a00ccba0 2024-09-13T17:52:37.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.272+0000 7f61a5c00640 1 --2- 172.21.15.114:0/4074855812 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6180066690 0x7f6180068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:37.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.272+0000 7f61a5c00640 1 --2- 172.21.15.114:0/4074855812 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6180066690 0x7f6180068b50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f61a01494c0 tx=0x7f6194008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:37.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.272+0000 7f619d600640 1 -- 172.21.15.114:0/4074855812 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f618c0eb380 con 0x7f61a00ccba0 2024-09-13T17:52:37.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.432+0000 7f61a8600640 1 -- 172.21.15.114:0/4074855812 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61a0070400 con 0x7f61a00ccba0 2024-09-13T17:52:37.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.436+0000 7f619d600640 1 -- 172.21.15.114:0/4074855812 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18784 (secure 0 0 0) 0x7f618c0ee9a0 con 0x7f61a00ccba0 2024-09-13T17:52:37.438 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:37.438 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:52:31.139000+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:51:48.278220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:51:48.773888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:51:51.856300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:52:37.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.436+0000 7f61a8600640 1 -- 172.21.15.114:0/4074855812 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6180066690 msgr2=0x7f6180068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:37.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.436+0000 7f61a8600640 1 --2- 172.21.15.114:0/4074855812 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6180066690 0x7f6180068b50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f61a01494c0 tx=0x7f6194008040 comp rx=0 tx=0).stop 2024-09-13T17:52:37.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.436+0000 7f61a8600640 1 -- 172.21.15.114:0/4074855812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61a00ccba0 msgr2=0x7f61a015ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:37.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.436+0000 7f61a8600640 1 --2- 172.21.15.114:0/4074855812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61a00ccba0 0x7f61a015ba60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f618c019f80 tx=0x7f618c0190f0 comp rx=0 tx=0).stop 2024-09-13T17:52:37.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.436+0000 7f61a8600640 1 -- 172.21.15.114:0/4074855812 shutdown_connections 2024-09-13T17:52:37.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.436+0000 7f61a8600640 1 --2- 172.21.15.114:0/4074855812 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6180066690 0x7f6180068b50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:37.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.436+0000 7f61a8600640 1 --2- 172.21.15.114:0/4074855812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a0151420 0x7f61a01636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:37.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.436+0000 7f61a8600640 1 --2- 172.21.15.114:0/4074855812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61a00ccba0 0x7f61a015ba60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:37.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.436+0000 7f61a8600640 1 --2- 172.21.15.114:0/4074855812 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61a0070960 0x7f61a00b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:37.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.436+0000 7f61a8600640 1 -- 172.21.15.114:0/4074855812 >> 172.21.15.114:0/4074855812 conn(0x7f61a00660b0 msgr2=0x7f61a006d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:37.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.436+0000 7f61a8600640 1 -- 172.21.15.114:0/4074855812 shutdown_connections 2024-09-13T17:52:37.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.436+0000 7f61a8600640 1 -- 172.21.15.114:0/4074855812 wait complete. 2024-09-13T17:52:37.459 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:51:37.996254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:51:48.278220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:51:48.773888+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:51:51.856300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:52:37.459 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:52:37.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.596+0000 7feb23200640 1 Processor -- start 2024-09-13T17:52:37.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.596+0000 7feb23200640 1 -- start start 2024-09-13T17:52:37.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.596+0000 7feb23200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7feb2406bfc0 0x7feb240d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:37.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.596+0000 7feb23200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb240ca980 con 0x7feb2415c880 2024-09-13T17:52:37.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.596+0000 7feb23200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb2406c450 con 0x7feb24099180 2024-09-13T17:52:37.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.596+0000 7feb23200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb2415cc60 con 0x7feb2406bfc0 2024-09-13T17:52:37.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.596+0000 7feb21e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7feb2415c880 0x7feb24098a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46280/0 (socket says 172.21.15.114:46280) 2024-09-13T17:52:37.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.596+0000 7feb21e00640 1 -- 172.21.15.114:0/2754830222 learned_addr learned my addr 172.21.15.114:0/2754830222 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:37.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.596+0000 7feb1be00640 1 --2- 172.21.15.114:0/2754830222 >> v2:172.21.15.134:3300/0 conn(0x7feb2406bfc0 0x7feb240d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:37.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.596+0000 7feb21400640 1 -- 172.21.15.114:0/2754830222 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4249180311 0 0) 0x7feb240ca980 con 0x7feb2415c880 2024-09-13T17:52:37.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.596+0000 7feb21400640 1 -- 172.21.15.114:0/2754830222 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb08003530 con 0x7feb2415c880 2024-09-13T17:52:37.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.596+0000 7feb21400640 1 -- 172.21.15.114:0/2754830222 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3723728995 0 0) 0x7feb08003530 con 0x7feb2415c880 2024-09-13T17:52:37.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.596+0000 7feb1be00640 1 -- 172.21.15.114:0/2754830222 >> v1:172.21.15.134:6789/0 conn(0x7feb24099180 legacy=0x7feb240cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:37.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.596+0000 7feb1be00640 1 -- 172.21.15.114:0/2754830222 >> v1:172.21.15.114:6789/0 conn(0x7feb2415c880 legacy=0x7feb24098a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:37.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.596+0000 7feb1be00640 1 -- 172.21.15.114:0/2754830222 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2406c730 con 0x7feb2406bfc0 2024-09-13T17:52:37.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.600+0000 7feb1be00640 1 --2- 172.21.15.114:0/2754830222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb2406bfc0 0x7feb240d0e50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feb0c0097c0 tx=0x7feb0c01c300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57c93a3c58f92ba2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:37.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.600+0000 7feb21400640 1 -- 172.21.15.114:0/2754830222 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb14001680 con 0x7feb2406bfc0 2024-09-13T17:52:37.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.600+0000 7feb21400640 1 -- 172.21.15.114:0/2754830222 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0c0a7050 con 0x7feb2406bfc0 2024-09-13T17:52:37.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.600+0000 7feb21400640 1 -- 172.21.15.114:0/2754830222 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c0ab620 con 0x7feb2406bfc0 2024-09-13T17:52:37.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.600+0000 7feb23200640 1 -- 172.21.15.114:0/2754830222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb2406bfc0 msgr2=0x7feb240d0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:37.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.600+0000 7feb23200640 1 --2- 172.21.15.114:0/2754830222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb2406bfc0 0x7feb240d0e50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feb0c0097c0 tx=0x7feb0c01c300 comp rx=0 tx=0).stop 2024-09-13T17:52:37.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.600+0000 7feb23200640 1 -- 172.21.15.114:0/2754830222 shutdown_connections 2024-09-13T17:52:37.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.600+0000 7feb23200640 1 --2- 172.21.15.114:0/2754830222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb2406bfc0 0x7feb240d0e50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:37.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.600+0000 7feb23200640 1 -- 172.21.15.114:0/2754830222 >> 172.21.15.114:0/2754830222 conn(0x7feb240d0330 msgr2=0x7feb240d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:37.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.600+0000 7feb23200640 1 -- 172.21.15.114:0/2754830222 shutdown_connections 2024-09-13T17:52:37.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.600+0000 7feb23200640 1 -- 172.21.15.114:0/2754830222 wait complete. 2024-09-13T17:52:37.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.600+0000 7feb23200640 1 Processor -- start 2024-09-13T17:52:37.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.604+0000 7feb23200640 1 -- start start 2024-09-13T17:52:37.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.604+0000 7feb23200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb24099180 0x7feb24155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:37.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.604+0000 7feb23200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb2415c880 0x7feb24154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:37.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.604+0000 7feb23200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb24151ba0 0x7feb24154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:37.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.604+0000 7feb23200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb24157a50 con 0x7feb2415c880 2024-09-13T17:52:37.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.604+0000 7feb23200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb241569f0 con 0x7feb24099180 2024-09-13T17:52:37.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.604+0000 7feb23200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb24156c90 con 0x7feb24151ba0 2024-09-13T17:52:37.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.604+0000 7feb1be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb2415c880 0x7feb24154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:37.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.604+0000 7feb1be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb2415c880 0x7feb24154670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55956/0 (socket says 172.21.15.114:55956) 2024-09-13T17:52:37.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.604+0000 7feb1be00640 1 -- 172.21.15.114:0/1823124211 learned_addr learned my addr 172.21.15.114:0/1823124211 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:37.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.604+0000 7feb21e00640 1 --2- 172.21.15.114:0/1823124211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb24099180 0x7feb24155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:37.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.604+0000 7feb1be00640 1 -- 172.21.15.114:0/1823124211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb24151ba0 msgr2=0x7feb24154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:37.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.604+0000 7feb22800640 1 --2- 172.21.15.114:0/1823124211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb24151ba0 0x7feb24154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:37.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.604+0000 7feb1be00640 1 --2- 172.21.15.114:0/1823124211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb24151ba0 0x7feb24154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:37.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.604+0000 7feb1be00640 1 -- 172.21.15.114:0/1823124211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb24099180 msgr2=0x7feb24155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:37.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.604+0000 7feb1be00640 1 --2- 172.21.15.114:0/1823124211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb24099180 0x7feb24155ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:37.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.604+0000 7feb1be00640 1 -- 172.21.15.114:0/1823124211 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0c009420 con 0x7feb2415c880 2024-09-13T17:52:37.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.604+0000 7feb21e00640 1 --2- 172.21.15.114:0/1823124211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb24099180 0x7feb24155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:52:37.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.604+0000 7feb22800640 1 --2- 172.21.15.114:0/1823124211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb24151ba0 0x7feb24154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:52:37.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.604+0000 7feb1be00640 1 --2- 172.21.15.114:0/1823124211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb2415c880 0x7feb24154670 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7feb0c0ae040 tx=0x7feb0c01ab40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:37.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.604+0000 7feb1a000640 1 -- 172.21.15.114:0/1823124211 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c0abda0 con 0x7feb2415c880 2024-09-13T17:52:37.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.604+0000 7feb1a000640 1 -- 172.21.15.114:0/1823124211 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0c004020 con 0x7feb2415c880 2024-09-13T17:52:37.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.604+0000 7feb23200640 1 -- 172.21.15.114:0/1823124211 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb24156f70 con 0x7feb2415c880 2024-09-13T17:52:37.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.604+0000 7feb1a000640 1 -- 172.21.15.114:0/1823124211 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c004390 con 0x7feb2415c880 2024-09-13T17:52:37.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.604+0000 7feb23200640 1 -- 172.21.15.114:0/1823124211 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb24157530 con 0x7feb2415c880 2024-09-13T17:52:37.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.604+0000 7feb23200640 1 -- 172.21.15.114:0/1823124211 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb24157720 con 0x7feb2415c880 2024-09-13T17:52:37.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.608+0000 7feb1a000640 1 -- 172.21.15.114:0/1823124211 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feb0c003620 con 0x7feb2415c880 2024-09-13T17:52:37.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.608+0000 7feb1a000640 1 --2- 172.21.15.114:0/1823124211 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7feb00066690 0x7feb00068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:37.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.608+0000 7feb1a000640 1 -- 172.21.15.114:0/1823124211 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7feb0c11ed50 con 0x7feb2415c880 2024-09-13T17:52:37.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.608+0000 7feb21e00640 1 --2- 172.21.15.114:0/1823124211 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7feb00066690 0x7feb00068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:37.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.608+0000 7feb21e00640 1 --2- 172.21.15.114:0/1823124211 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7feb00066690 0x7feb00068b50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7feb14005890 tx=0x7feb14009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:37.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.612+0000 7feb1a000640 1 -- 172.21.15.114:0/1823124211 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feb0c0ebe10 con 0x7feb2415c880 2024-09-13T17:52:37.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.764+0000 7feb23200640 1 -- 172.21.15.114:0/1823124211 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feb240d0e50 con 0x7feb2415c880 2024-09-13T17:52:37.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.764+0000 7feb1a000640 1 -- 172.21.15.114:0/1823124211 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7feb0c0ef430 con 0x7feb2415c880 2024-09-13T17:52:37.769 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-13T17:52:37.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.768+0000 7feb23200640 1 -- 172.21.15.114:0/1823124211 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7feb00066690 msgr2=0x7feb00068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:37.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.768+0000 7feb23200640 1 --2- 172.21.15.114:0/1823124211 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7feb00066690 0x7feb00068b50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7feb14005890 tx=0x7feb14009040 comp rx=0 tx=0).stop 2024-09-13T17:52:37.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.768+0000 7feb23200640 1 -- 172.21.15.114:0/1823124211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb2415c880 msgr2=0x7feb24154670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:37.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.768+0000 7feb23200640 1 --2- 172.21.15.114:0/1823124211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb2415c880 0x7feb24154670 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7feb0c0ae040 tx=0x7feb0c01ab40 comp rx=0 tx=0).stop 2024-09-13T17:52:37.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.768+0000 7feb23200640 1 -- 172.21.15.114:0/1823124211 shutdown_connections 2024-09-13T17:52:37.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.768+0000 7feb23200640 1 --2- 172.21.15.114:0/1823124211 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7feb00066690 0x7feb00068b50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:37.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.768+0000 7feb23200640 1 --2- 172.21.15.114:0/1823124211 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7feb24151ba0 0x7feb24154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:37.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.768+0000 7feb23200640 1 --2- 172.21.15.114:0/1823124211 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb2415c880 0x7feb24154670 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:37.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.768+0000 7feb23200640 1 --2- 172.21.15.114:0/1823124211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb24099180 0x7feb24155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:37.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.768+0000 7feb23200640 1 -- 172.21.15.114:0/1823124211 >> 172.21.15.114:0/1823124211 conn(0x7feb240d0330 msgr2=0x7feb24098a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:37.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.768+0000 7feb23200640 1 -- 172.21.15.114:0/1823124211 shutdown_connections 2024-09-13T17:52:37.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.768+0000 7feb23200640 1 -- 172.21.15.114:0/1823124211 wait complete. 2024-09-13T17:52:37.790 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:52:37.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4cd800640 1 Processor -- start 2024-09-13T17:52:37.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4cd800640 1 -- start start 2024-09-13T17:52:37.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4cd800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc4c8151420 0x7fc4c80cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:37.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4cd800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4c8151800 con 0x7fc4c8070b30 2024-09-13T17:52:37.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4cd800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4c80cafb0 con 0x7fc4c80ccba0 2024-09-13T17:52:37.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4cd800640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c80cbc30 con 0x7fc4c8151420 2024-09-13T17:52:37.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4c7400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc4c8070b30 0x7fc4c806c540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46292/0 (socket says 172.21.15.114:46292) 2024-09-13T17:52:37.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4c7400640 1 -- 172.21.15.114:0/3856150195 learned_addr learned my addr 172.21.15.114:0/3856150195 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:37.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4c6a00640 1 --2- 172.21.15.114:0/3856150195 >> v2:172.21.15.134:3300/0 conn(0x7fc4c8151420 0x7fc4c80cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:37.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4c5600640 1 -- 172.21.15.114:0/3856150195 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247787834 0 0) 0x7fc4c8151800 con 0x7fc4c8070b30 2024-09-13T17:52:37.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4c5600640 1 -- 172.21.15.114:0/3856150195 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4ac003530 con 0x7fc4c8070b30 2024-09-13T17:52:37.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4c5600640 1 -- 172.21.15.114:0/3856150195 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2740752660 0 0) 0x7fc4ac003530 con 0x7fc4c8070b30 2024-09-13T17:52:37.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4c5600640 1 -- 172.21.15.114:0/3856150195 >> v2:172.21.15.134:3300/0 conn(0x7fc4c8151420 msgr2=0x7fc4c80cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:37.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4c5600640 1 --2- 172.21.15.114:0/3856150195 >> v2:172.21.15.134:3300/0 conn(0x7fc4c8151420 0x7fc4c80cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:37.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4c5600640 1 -- 172.21.15.114:0/3856150195 >> v1:172.21.15.134:6789/0 conn(0x7fc4c80ccba0 legacy=0x7fc4c8070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:37.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4c5600640 1 -- 172.21.15.114:0/3856150195 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c80cb290 con 0x7fc4c8070b30 2024-09-13T17:52:37.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4c5600640 1 -- 172.21.15.114:0/3856150195 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7fc4c0001a20 con 0x7fc4c8070b30 2024-09-13T17:52:37.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4c5600640 1 -- 172.21.15.114:0/3856150195 >> v1:172.21.15.114:6789/0 conn(0x7fc4c8070b30 legacy=0x7fc4c806c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:37.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4c5600640 1 --2- 172.21.15.114:0/3856150195 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4ac003980 0x7fc4ac003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:37.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4c5600640 1 --2- 172.21.15.114:0/3856150195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4ac0047d0 0x7fc4ac004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:37.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4c5600640 1 --2- 172.21.15.114:0/3856150195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4ac005190 0x7fc4ac00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:37.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4c5600640 1 -- 172.21.15.114:0/3856150195 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c80cbc30 con 0x7fc4ac005190 2024-09-13T17:52:37.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4c5600640 1 -- 172.21.15.114:0/3856150195 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac00c0e0 con 0x7fc4ac0047d0 2024-09-13T17:52:37.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4c5600640 1 -- 172.21.15.114:0/3856150195 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac00c2a0 con 0x7fc4ac003980 2024-09-13T17:52:37.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4c7400640 1 --2- 172.21.15.114:0/3856150195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4ac005190 0x7fc4ac00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:37.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4c6a00640 1 --2- 172.21.15.114:0/3856150195 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4ac003980 0x7fc4ac003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:37.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4c6000640 1 --2- 172.21.15.114:0/3856150195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4ac0047d0 0x7fc4ac004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:37.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4c7400640 1 -- 172.21.15.114:0/3856150195 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4ac003980 msgr2=0x7fc4ac003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:37.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4c7400640 1 --2- 172.21.15.114:0/3856150195 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4ac003980 0x7fc4ac003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:37.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4c7400640 1 -- 172.21.15.114:0/3856150195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4ac0047d0 msgr2=0x7fc4ac004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:37.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4c7400640 1 --2- 172.21.15.114:0/3856150195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4ac0047d0 0x7fc4ac004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:37.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.928+0000 7fc4c7400640 1 -- 172.21.15.114:0/3856150195 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac003530 con 0x7fc4ac005190 2024-09-13T17:52:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.932+0000 7fc4c7400640 1 -- 172.21.15.114:0/3856150195 reap_dead start 2024-09-13T17:52:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.932+0000 7fc4c7400640 1 --2- 172.21.15.114:0/3856150195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4ac005190 0x7fc4ac00b990 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8151990 tx=0x7fc4c001d2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f1fb59b795306 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.932+0000 7fc4c5600640 1 -- 172.21.15.114:0/3856150195 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c00ad630 con 0x7fc4ac005190 2024-09-13T17:52:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.932+0000 7fc4c5600640 1 -- 172.21.15.114:0/3856150195 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c00a8070 con 0x7fc4ac005190 2024-09-13T17:52:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.932+0000 7fc4c5600640 1 -- 172.21.15.114:0/3856150195 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c00ad9f0 con 0x7fc4ac005190 2024-09-13T17:52:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.932+0000 7fc4cd800640 1 -- 172.21.15.114:0/3856150195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4ac005190 msgr2=0x7fc4ac00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.932+0000 7fc4cd800640 1 --2- 172.21.15.114:0/3856150195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4ac005190 0x7fc4ac00b990 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8151990 tx=0x7fc4c001d2a0 comp rx=0 tx=0).stop 2024-09-13T17:52:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.932+0000 7fc4cd800640 1 -- 172.21.15.114:0/3856150195 shutdown_connections 2024-09-13T17:52:37.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.932+0000 7fc4cd800640 1 --2- 172.21.15.114:0/3856150195 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4ac005190 0x7fc4ac00b990 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:37.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.932+0000 7fc4cd800640 1 -- 172.21.15.114:0/3856150195 >> 172.21.15.114:0/3856150195 conn(0x7fc4c80660b0 msgr2=0x7fc4c8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:37.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.932+0000 7fc4cd800640 1 -- 172.21.15.114:0/3856150195 shutdown_connections 2024-09-13T17:52:37.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.932+0000 7fc4cd800640 1 -- 172.21.15.114:0/3856150195 wait complete. 2024-09-13T17:52:37.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.936+0000 7fc4cd800640 1 Processor -- start 2024-09-13T17:52:37.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.936+0000 7fc4cd800640 1 -- start start 2024-09-13T17:52:37.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.936+0000 7fc4cd800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4ac005190 0x7fc4c80b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:37.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.936+0000 7fc4cd800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4c80b30f0 0x7fc4c814eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:37.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.936+0000 7fc4cd800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4c815e080 0x7fc4c815e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:37.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.936+0000 7fc4cd800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c815ea40 con 0x7fc4c80b30f0 2024-09-13T17:52:37.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.936+0000 7fc4cd800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c80b25f0 con 0x7fc4ac005190 2024-09-13T17:52:37.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.936+0000 7fc4cd800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c80ca390 con 0x7fc4c815e080 2024-09-13T17:52:37.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.936+0000 7fc4c6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4c80b30f0 0x7fc4c814eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:37.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.936+0000 7fc4c6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4c80b30f0 0x7fc4c814eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55986/0 (socket says 172.21.15.114:55986) 2024-09-13T17:52:37.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.936+0000 7fc4c6000640 1 -- 172.21.15.114:0/2240557292 learned_addr learned my addr 172.21.15.114:0/2240557292 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:37.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.936+0000 7fc4c6a00640 1 --2- 172.21.15.114:0/2240557292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4ac005190 0x7fc4c80b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:37.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.936+0000 7fc4c7400640 1 --2- 172.21.15.114:0/2240557292 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4c815e080 0x7fc4c815e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:37.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.936+0000 7fc4c6000640 1 -- 172.21.15.114:0/2240557292 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4c815e080 msgr2=0x7fc4c815e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:37.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.936+0000 7fc4c6000640 1 --2- 172.21.15.114:0/2240557292 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4c815e080 0x7fc4c815e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:37.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.936+0000 7fc4c6000640 1 -- 172.21.15.114:0/2240557292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4ac005190 msgr2=0x7fc4c80b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:37.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.936+0000 7fc4c6000640 1 --2- 172.21.15.114:0/2240557292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4ac005190 0x7fc4c80b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:37.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.936+0000 7fc4c6000640 1 -- 172.21.15.114:0/2240557292 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c80b1610 con 0x7fc4c80b30f0 2024-09-13T17:52:37.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.936+0000 7fc4c6000640 1 --2- 172.21.15.114:0/2240557292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4c80b30f0 0x7fc4c814eed0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4011c60 tx=0x7fc4b400f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:37.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.936+0000 7fc4bea00640 1 -- 172.21.15.114:0/2240557292 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4011c90 con 0x7fc4c80b30f0 2024-09-13T17:52:37.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.936+0000 7fc4bea00640 1 -- 172.21.15.114:0/2240557292 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b4011e10 con 0x7fc4c80b30f0 2024-09-13T17:52:37.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.936+0000 7fc4bea00640 1 -- 172.21.15.114:0/2240557292 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4005310 con 0x7fc4c80b30f0 2024-09-13T17:52:37.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.936+0000 7fc4cd800640 1 -- 172.21.15.114:0/2240557292 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c80ca5e0 con 0x7fc4c80b30f0 2024-09-13T17:52:37.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.936+0000 7fc4cd800640 1 -- 172.21.15.114:0/2240557292 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c80b18b0 con 0x7fc4c80b30f0 2024-09-13T17:52:37.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.940+0000 7fc4cd800640 1 -- 172.21.15.114:0/2240557292 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c80caf10 con 0x7fc4c80b30f0 2024-09-13T17:52:37.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.940+0000 7fc4bea00640 1 -- 172.21.15.114:0/2240557292 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc4b4003600 con 0x7fc4c80b30f0 2024-09-13T17:52:37.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.940+0000 7fc4bea00640 1 --2- 172.21.15.114:0/2240557292 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc4a8066690 0x7fc4a8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:37.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.940+0000 7fc4bea00640 1 -- 172.21.15.114:0/2240557292 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc4b4087c70 con 0x7fc4c80b30f0 2024-09-13T17:52:37.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.940+0000 7fc4c6a00640 1 --2- 172.21.15.114:0/2240557292 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc4a8066690 0x7fc4a8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:37.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.940+0000 7fc4c6a00640 1 --2- 172.21.15.114:0/2240557292 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc4a8066690 0x7fc4a8068b50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8009b60 tx=0x7fc4b8009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:37.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:37.944+0000 7fc4bea00640 1 -- 172.21.15.114:0/2240557292 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc4b4054c20 con 0x7fc4c80b30f0 2024-09-13T17:52:38.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.100+0000 7fc4cd800640 1 -- 172.21.15.114:0/2240557292 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc4c80cd6d0 con 0x7fc4c80b30f0 2024-09-13T17:52:38.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.100+0000 7fc4bea00640 1 -- 172.21.15.114:0/2240557292 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc4b40190a0 con 0x7fc4c80b30f0 2024-09-13T17:52:38.103 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:52:38.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.100+0000 7fc4cd800640 1 -- 172.21.15.114:0/2240557292 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc4a8066690 msgr2=0x7fc4a8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:38.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.100+0000 7fc4cd800640 1 --2- 172.21.15.114:0/2240557292 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc4a8066690 0x7fc4a8068b50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8009b60 tx=0x7fc4b8009190 comp rx=0 tx=0).stop 2024-09-13T17:52:38.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.100+0000 7fc4cd800640 1 -- 172.21.15.114:0/2240557292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4c80b30f0 msgr2=0x7fc4c814eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:38.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.100+0000 7fc4cd800640 1 --2- 172.21.15.114:0/2240557292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4c80b30f0 0x7fc4c814eed0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4011c60 tx=0x7fc4b400f5a0 comp rx=0 tx=0).stop 2024-09-13T17:52:38.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.100+0000 7fc4cd800640 1 -- 172.21.15.114:0/2240557292 shutdown_connections 2024-09-13T17:52:38.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.100+0000 7fc4cd800640 1 --2- 172.21.15.114:0/2240557292 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc4a8066690 0x7fc4a8068b50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:38.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.100+0000 7fc4cd800640 1 --2- 172.21.15.114:0/2240557292 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc4c815e080 0x7fc4c815e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:38.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.100+0000 7fc4cd800640 1 --2- 172.21.15.114:0/2240557292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4c80b30f0 0x7fc4c814eed0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:38.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.100+0000 7fc4cd800640 1 --2- 172.21.15.114:0/2240557292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4ac005190 0x7fc4c80b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:38.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.100+0000 7fc4cd800640 1 -- 172.21.15.114:0/2240557292 >> 172.21.15.114:0/2240557292 conn(0x7fc4c80660b0 msgr2=0x7fc4c81584c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:38.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.100+0000 7fc4cd800640 1 -- 172.21.15.114:0/2240557292 shutdown_connections 2024-09-13T17:52:38.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.100+0000 7fc4cd800640 1 -- 172.21.15.114:0/2240557292 wait complete. 2024-09-13T17:52:38.125 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:52:38.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.260+0000 7f3e74e00640 1 Processor -- start 2024-09-13T17:52:38.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.260+0000 7f3e74e00640 1 -- start start 2024-09-13T17:52:38.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.260+0000 7f3e74e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3e7013c240 0x7f3e7013f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:38.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.260+0000 7f3e74e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3e7013c980 0x7f3e7006d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:38.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.260+0000 7f3e74e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e700cd220 con 0x7f3e7006da90 2024-09-13T17:52:38.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.260+0000 7f3e74e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e7006df40 con 0x7f3e7013c980 2024-09-13T17:52:38.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.260+0000 7f3e74e00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e7013f960 con 0x7f3e7013c240 2024-09-13T17:52:38.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.260+0000 7f3e65400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3e7013c980 0x7f3e7006d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:38.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.264+0000 7f3e65400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3e7013c980 0x7f3e7006d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:55998/0 (socket says 172.21.15.114:55998) 2024-09-13T17:52:38.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.264+0000 7f3e65400640 1 -- 172.21.15.114:0/3922186340 learned_addr learned my addr 172.21.15.114:0/3922186340 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:38.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.264+0000 7f3e6e800640 1 --1- 172.21.15.114:0/3922186340 >> v1:172.21.15.114:6789/0 conn(0x7f3e7006da90 0x7f3e700cd650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46294/0 (socket says 172.21.15.114:46294) 2024-09-13T17:52:38.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.264+0000 7f3e6de00640 1 --2- 172.21.15.114:0/3922186340 >> v2:172.21.15.134:3300/0 conn(0x7f3e7013c240 0x7f3e7013f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:38.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.264+0000 7f3e65400640 1 -- 172.21.15.114:0/3922186340 >> v2:172.21.15.134:3300/0 conn(0x7f3e7013c240 msgr2=0x7f3e7013f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:38.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.264+0000 7f3e65400640 1 --2- 172.21.15.114:0/3922186340 >> v2:172.21.15.134:3300/0 conn(0x7f3e7013c240 0x7f3e7013f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:38.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.264+0000 7f3e65400640 1 -- 172.21.15.114:0/3922186340 >> v1:172.21.15.114:6789/0 conn(0x7f3e7006da90 legacy=0x7f3e700cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:38.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.264+0000 7f3e65400640 1 -- 172.21.15.114:0/3922186340 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7015a740 con 0x7f3e7013c980 2024-09-13T17:52:38.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.264+0000 7f3e6d400640 1 -- 172.21.15.114:0/3922186340 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1025960378 0 0) 0x7f3e700cd220 con 0x7f3e7006da90 2024-09-13T17:52:38.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.264+0000 7f3e65400640 1 --2- 172.21.15.114:0/3922186340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e7013c980 0x7f3e7006d550 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3e7006e720 tx=0x7f3e5801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da325176523ea00f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:38.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.264+0000 7f3e6d400640 1 -- 172.21.15.114:0/3922186340 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e580aa650 con 0x7f3e7013c980 2024-09-13T17:52:38.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.264+0000 7f3e6d400640 1 -- 172.21.15.114:0/3922186340 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e580aa7b0 con 0x7f3e7013c980 2024-09-13T17:52:38.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.264+0000 7f3e6d400640 1 -- 172.21.15.114:0/3922186340 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e580aab40 con 0x7f3e7013c980 2024-09-13T17:52:38.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.268+0000 7f3e74e00640 1 -- 172.21.15.114:0/3922186340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e7013c980 msgr2=0x7f3e7006d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:38.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.268+0000 7f3e74e00640 1 --2- 172.21.15.114:0/3922186340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e7013c980 0x7f3e7006d550 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3e7006e720 tx=0x7f3e5801c4f0 comp rx=0 tx=0).stop 2024-09-13T17:52:38.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.268+0000 7f3e74e00640 1 -- 172.21.15.114:0/3922186340 shutdown_connections 2024-09-13T17:52:38.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.268+0000 7f3e74e00640 1 --2- 172.21.15.114:0/3922186340 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e7013c980 0x7f3e7006d550 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:38.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.268+0000 7f3e74e00640 1 --2- 172.21.15.114:0/3922186340 >> v2:172.21.15.134:3300/0 conn(0x7f3e7013c240 0x7f3e7013f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:38.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.268+0000 7f3e74e00640 1 -- 172.21.15.114:0/3922186340 >> 172.21.15.114:0/3922186340 conn(0x7f3e700660b0 msgr2=0x7f3e70069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:38.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.268+0000 7f3e74e00640 1 -- 172.21.15.114:0/3922186340 shutdown_connections 2024-09-13T17:52:38.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.268+0000 7f3e74e00640 1 -- 172.21.15.114:0/3922186340 wait complete. 2024-09-13T17:52:38.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.268+0000 7f3e74e00640 1 Processor -- start 2024-09-13T17:52:38.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.268+0000 7f3e74e00640 1 -- start start 2024-09-13T17:52:38.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.268+0000 7f3e74e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e7006da90 0x7f3e700acef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:38.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.268+0000 7f3e74e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e7013c240 0x7f3e7013df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:38.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.268+0000 7f3e74e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e7013c980 0x7f3e70155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:38.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.268+0000 7f3e74e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e700aca60 con 0x7f3e7006da90 2024-09-13T17:52:38.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.268+0000 7f3e74e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e700abe50 con 0x7f3e7013c980 2024-09-13T17:52:38.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.268+0000 7f3e74e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e700ac130 con 0x7f3e7013c240 2024-09-13T17:52:38.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.268+0000 7f3e6de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e7006da90 0x7f3e700acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:38.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.268+0000 7f3e6de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e7006da90 0x7f3e700acef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56006/0 (socket says 172.21.15.114:56006) 2024-09-13T17:52:38.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.268+0000 7f3e6de00640 1 -- 172.21.15.114:0/2313686598 learned_addr learned my addr 172.21.15.114:0/2313686598 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:38.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.268+0000 7f3e65400640 1 --2- 172.21.15.114:0/2313686598 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e7013c240 0x7f3e7013df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:38.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.268+0000 7f3e6e800640 1 --2- 172.21.15.114:0/2313686598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e7013c980 0x7f3e70155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:38.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.268+0000 7f3e6de00640 1 -- 172.21.15.114:0/2313686598 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e7013c240 msgr2=0x7f3e7013df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:38.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.268+0000 7f3e6de00640 1 --2- 172.21.15.114:0/2313686598 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e7013c240 0x7f3e7013df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:38.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.268+0000 7f3e6de00640 1 -- 172.21.15.114:0/2313686598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e7013c980 msgr2=0x7f3e70155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:38.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.268+0000 7f3e6de00640 1 --2- 172.21.15.114:0/2313686598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e7013c980 0x7f3e70155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:38.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.268+0000 7f3e6de00640 1 -- 172.21.15.114:0/2313686598 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e580094d0 con 0x7f3e7006da90 2024-09-13T17:52:38.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.268+0000 7f3e6de00640 1 --2- 172.21.15.114:0/2313686598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e7006da90 0x7f3e700acef0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000d800 tx=0x7f3e6000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:38.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.272+0000 7f3e66a00640 1 -- 172.21.15.114:0/2313686598 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6000b6c0 con 0x7f3e7006da90 2024-09-13T17:52:38.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.272+0000 7f3e66a00640 1 -- 172.21.15.114:0/2313686598 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6000b820 con 0x7f3e7006da90 2024-09-13T17:52:38.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.272+0000 7f3e74e00640 1 -- 172.21.15.114:0/2313686598 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e700ac410 con 0x7f3e7006da90 2024-09-13T17:52:38.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.272+0000 7f3e66a00640 1 -- 172.21.15.114:0/2313686598 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6000bb90 con 0x7f3e7006da90 2024-09-13T17:52:38.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.272+0000 7f3e74e00640 1 -- 172.21.15.114:0/2313686598 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e7013e4a0 con 0x7f3e7006da90 2024-09-13T17:52:38.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.272+0000 7f3e74e00640 1 -- 172.21.15.114:0/2313686598 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e700667b0 con 0x7f3e7006da90 2024-09-13T17:52:38.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.272+0000 7f3e66a00640 1 -- 172.21.15.114:0/2313686598 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3e6000bcf0 con 0x7f3e7006da90 2024-09-13T17:52:38.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.272+0000 7f3e66a00640 1 --2- 172.21.15.114:0/2313686598 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3e4c0666c0 0x7f3e4c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:38.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.272+0000 7f3e66a00640 1 -- 172.21.15.114:0/2313686598 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3e60084b90 con 0x7f3e7006da90 2024-09-13T17:52:38.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.272+0000 7f3e65400640 1 --2- 172.21.15.114:0/2313686598 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3e4c0666c0 0x7f3e4c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:38.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.276+0000 7f3e65400640 1 --2- 172.21.15.114:0/2313686598 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3e4c0666c0 0x7f3e4c068b80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3e580ae000 tx=0x7f3e580a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:38.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.276+0000 7f3e66a00640 1 -- 172.21.15.114:0/2313686598 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3e60051aa0 con 0x7f3e7006da90 2024-09-13T17:52:38.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.432+0000 7f3e74e00640 1 -- 172.21.15.114:0/2313686598 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3e7015a210 con 0x7f3e7006da90 2024-09-13T17:52:38.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.432+0000 7f3e66a00640 1 -- 172.21.15.114:0/2313686598 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3e600550c0 con 0x7f3e7006da90 2024-09-13T17:52:38.435 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-09-13T17:52:38.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.432+0000 7f3e74e00640 1 -- 172.21.15.114:0/2313686598 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3e4c0666c0 msgr2=0x7f3e4c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:38.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.432+0000 7f3e74e00640 1 --2- 172.21.15.114:0/2313686598 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3e4c0666c0 0x7f3e4c068b80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3e580ae000 tx=0x7f3e580a7000 comp rx=0 tx=0).stop 2024-09-13T17:52:38.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.432+0000 7f3e74e00640 1 -- 172.21.15.114:0/2313686598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e7006da90 msgr2=0x7f3e700acef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:38.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.432+0000 7f3e74e00640 1 --2- 172.21.15.114:0/2313686598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e7006da90 0x7f3e700acef0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000d800 tx=0x7f3e6000dcc0 comp rx=0 tx=0).stop 2024-09-13T17:52:38.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.432+0000 7f3e74e00640 1 -- 172.21.15.114:0/2313686598 shutdown_connections 2024-09-13T17:52:38.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.432+0000 7f3e74e00640 1 --2- 172.21.15.114:0/2313686598 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3e4c0666c0 0x7f3e4c068b80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:38.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.432+0000 7f3e74e00640 1 --2- 172.21.15.114:0/2313686598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e7013c980 0x7f3e70155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:38.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.432+0000 7f3e74e00640 1 --2- 172.21.15.114:0/2313686598 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3e7013c240 0x7f3e7013df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:38.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.432+0000 7f3e74e00640 1 --2- 172.21.15.114:0/2313686598 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3e7006da90 0x7f3e700acef0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:38.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.432+0000 7f3e74e00640 1 -- 172.21.15.114:0/2313686598 >> 172.21.15.114:0/2313686598 conn(0x7f3e700660b0 msgr2=0x7f3e70158760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:38.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.432+0000 7f3e74e00640 1 -- 172.21.15.114:0/2313686598 shutdown_connections 2024-09-13T17:52:38.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.432+0000 7f3e74e00640 1 -- 172.21.15.114:0/2313686598 wait complete. 2024-09-13T17:52:38.456 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:52:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.588+0000 7fcd57200640 1 Processor -- start 2024-09-13T17:52:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.588+0000 7fcd57200640 1 -- start start 2024-09-13T17:52:38.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.592+0000 7fcd57200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcd58099180 0x7fcd580d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:38.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.592+0000 7fcd57200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd580ca980 con 0x7fcd5806bfc0 2024-09-13T17:52:38.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.592+0000 7fcd57200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd5806c450 con 0x7fcd5815c880 2024-09-13T17:52:38.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.592+0000 7fcd57200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5815cc60 con 0x7fcd58099180 2024-09-13T17:52:38.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.592+0000 7fcd56800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcd58099180 0x7fcd580d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:38.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.592+0000 7fcd56800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcd58099180 0x7fcd580d0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56016/0 (socket says 172.21.15.114:56016) 2024-09-13T17:52:38.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.592+0000 7fcd56800640 1 -- 172.21.15.114:0/197490571 learned_addr learned my addr 172.21.15.114:0/197490571 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:38.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.592+0000 7fcd4d400640 1 --1- 172.21.15.114:0/197490571 >> v1:172.21.15.114:6789/0 conn(0x7fcd5806bfc0 0x7fcd580cb3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46304/0 (socket says 172.21.15.114:46304) 2024-09-13T17:52:38.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.592+0000 7fcd56800640 1 -- 172.21.15.114:0/197490571 >> v1:172.21.15.134:6789/0 conn(0x7fcd5815c880 legacy=0x7fcd58098a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:38.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.592+0000 7fcd56800640 1 -- 172.21.15.114:0/197490571 >> v1:172.21.15.114:6789/0 conn(0x7fcd5806bfc0 legacy=0x7fcd580cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:38.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.592+0000 7fcd56800640 1 -- 172.21.15.114:0/197490571 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5806c730 con 0x7fcd58099180 2024-09-13T17:52:38.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.596+0000 7fcd56800640 1 --2- 172.21.15.114:0/197490571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd58099180 0x7fcd580d0e50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009e50 tx=0x7fcd5001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80cfc78d8f5aff5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:38.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.596+0000 7fcd55400640 1 -- 172.21.15.114:0/197490571 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd500a5830 con 0x7fcd58099180 2024-09-13T17:52:38.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.596+0000 7fcd55400640 1 -- 172.21.15.114:0/197490571 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd500a5990 con 0x7fcd58099180 2024-09-13T17:52:38.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.596+0000 7fcd55400640 1 -- 172.21.15.114:0/197490571 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd500a5d20 con 0x7fcd58099180 2024-09-13T17:52:38.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.596+0000 7fcd57200640 1 -- 172.21.15.114:0/197490571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd58099180 msgr2=0x7fcd580d0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:38.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.596+0000 7fcd57200640 1 --2- 172.21.15.114:0/197490571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd58099180 0x7fcd580d0e50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009e50 tx=0x7fcd5001c970 comp rx=0 tx=0).stop 2024-09-13T17:52:38.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.596+0000 7fcd57200640 1 -- 172.21.15.114:0/197490571 shutdown_connections 2024-09-13T17:52:38.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.596+0000 7fcd57200640 1 --2- 172.21.15.114:0/197490571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd58099180 0x7fcd580d0e50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:38.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.596+0000 7fcd57200640 1 -- 172.21.15.114:0/197490571 >> 172.21.15.114:0/197490571 conn(0x7fcd580d0330 msgr2=0x7fcd580d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:38.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.596+0000 7fcd57200640 1 -- 172.21.15.114:0/197490571 shutdown_connections 2024-09-13T17:52:38.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.596+0000 7fcd57200640 1 -- 172.21.15.114:0/197490571 wait complete. 2024-09-13T17:52:38.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.596+0000 7fcd57200640 1 Processor -- start 2024-09-13T17:52:38.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.596+0000 7fcd57200640 1 -- start start 2024-09-13T17:52:38.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.596+0000 7fcd57200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcd58099180 0x7fcd580aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:38.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.596+0000 7fcd57200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd5815c880 0x7fcd58153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:38.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.596+0000 7fcd57200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd58157920 0x7fcd58158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:38.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.596+0000 7fcd57200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd580af370 con 0x7fcd58157920 2024-09-13T17:52:38.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.596+0000 7fcd57200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd580add90 con 0x7fcd5815c880 2024-09-13T17:52:38.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.596+0000 7fcd57200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd580ae070 con 0x7fcd58099180 2024-09-13T17:52:38.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.600+0000 7fcd56800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd58157920 0x7fcd58158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:38.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.600+0000 7fcd56800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd58157920 0x7fcd58158c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56030/0 (socket says 172.21.15.114:56030) 2024-09-13T17:52:38.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.600+0000 7fcd56800640 1 -- 172.21.15.114:0/1520562089 learned_addr learned my addr 172.21.15.114:0/1520562089 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:38.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.600+0000 7fcd4d400640 1 --2- 172.21.15.114:0/1520562089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd5815c880 0x7fcd58153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:38.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.600+0000 7fcd55e00640 1 --2- 172.21.15.114:0/1520562089 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcd58099180 0x7fcd580aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:38.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.600+0000 7fcd56800640 1 -- 172.21.15.114:0/1520562089 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcd58099180 msgr2=0x7fcd580aee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:38.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.600+0000 7fcd56800640 1 --2- 172.21.15.114:0/1520562089 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcd58099180 0x7fcd580aee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:38.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.600+0000 7fcd56800640 1 -- 172.21.15.114:0/1520562089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd5815c880 msgr2=0x7fcd58153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:38.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.600+0000 7fcd56800640 1 --2- 172.21.15.114:0/1520562089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd5815c880 0x7fcd58153170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:38.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.600+0000 7fcd56800640 1 -- 172.21.15.114:0/1520562089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd50009b30 con 0x7fcd58157920 2024-09-13T17:52:38.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.600+0000 7fcd56800640 1 --2- 172.21.15.114:0/1520562089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd58157920 0x7fcd58158c20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcd50019580 tx=0x7fcd50019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:38.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.600+0000 7fcd4ea00640 1 -- 172.21.15.114:0/1520562089 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd500b8670 con 0x7fcd58157920 2024-09-13T17:52:38.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.600+0000 7fcd4ea00640 1 -- 172.21.15.114:0/1520562089 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd500b87f0 con 0x7fcd58157920 2024-09-13T17:52:38.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.600+0000 7fcd57200640 1 -- 172.21.15.114:0/1520562089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd580ae350 con 0x7fcd58157920 2024-09-13T17:52:38.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.600+0000 7fcd4ea00640 1 -- 172.21.15.114:0/1520562089 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd500b8ba0 con 0x7fcd58157920 2024-09-13T17:52:38.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.600+0000 7fcd57200640 1 -- 172.21.15.114:0/1520562089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd580ae910 con 0x7fcd58157920 2024-09-13T17:52:38.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.600+0000 7fcd57200640 1 -- 172.21.15.114:0/1520562089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd580ae1b0 con 0x7fcd58157920 2024-09-13T17:52:38.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.600+0000 7fcd4ea00640 1 -- 172.21.15.114:0/1520562089 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcd500b8d00 con 0x7fcd58157920 2024-09-13T17:52:38.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.600+0000 7fcd4ea00640 1 --2- 172.21.15.114:0/1520562089 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fcd34066690 0x7fcd34068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:38.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.604+0000 7fcd4ea00640 1 -- 172.21.15.114:0/1520562089 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcd5011fb40 con 0x7fcd58157920 2024-09-13T17:52:38.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.604+0000 7fcd55e00640 1 --2- 172.21.15.114:0/1520562089 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fcd34066690 0x7fcd34068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:38.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.604+0000 7fcd55e00640 1 --2- 172.21.15.114:0/1520562089 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fcd34066690 0x7fcd34068b50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcd48007fd0 tx=0x7fcd48009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:38.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.604+0000 7fcd4ea00640 1 -- 172.21.15.114:0/1520562089 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcd580ae1b0 con 0x7fcd58157920 2024-09-13T17:52:38.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.760+0000 7fcd57200640 1 -- 172.21.15.114:0/1520562089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fcd580ae1b0 con 0x7fcd58157920 2024-09-13T17:52:38.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.760+0000 7fcd4ea00640 1 -- 172.21.15.114:0/1520562089 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fcd500bc020 con 0x7fcd58157920 2024-09-13T17:52:38.764 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:52:38.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.764+0000 7fcd57200640 1 -- 172.21.15.114:0/1520562089 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fcd34066690 msgr2=0x7fcd34068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:38.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.764+0000 7fcd57200640 1 --2- 172.21.15.114:0/1520562089 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fcd34066690 0x7fcd34068b50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcd48007fd0 tx=0x7fcd48009040 comp rx=0 tx=0).stop 2024-09-13T17:52:38.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.764+0000 7fcd57200640 1 -- 172.21.15.114:0/1520562089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd58157920 msgr2=0x7fcd58158c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:38.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.764+0000 7fcd57200640 1 --2- 172.21.15.114:0/1520562089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd58157920 0x7fcd58158c20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcd50019580 tx=0x7fcd50019710 comp rx=0 tx=0).stop 2024-09-13T17:52:38.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.764+0000 7fcd57200640 1 -- 172.21.15.114:0/1520562089 shutdown_connections 2024-09-13T17:52:38.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.764+0000 7fcd57200640 1 --2- 172.21.15.114:0/1520562089 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fcd34066690 0x7fcd34068b50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:38.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.764+0000 7fcd57200640 1 --2- 172.21.15.114:0/1520562089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcd58157920 0x7fcd58158c20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:38.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.764+0000 7fcd57200640 1 --2- 172.21.15.114:0/1520562089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd5815c880 0x7fcd58153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:38.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.764+0000 7fcd57200640 1 --2- 172.21.15.114:0/1520562089 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcd58099180 0x7fcd580aee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:38.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.764+0000 7fcd57200640 1 -- 172.21.15.114:0/1520562089 >> 172.21.15.114:0/1520562089 conn(0x7fcd580d0330 msgr2=0x7fcd580d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:38.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.764+0000 7fcd57200640 1 -- 172.21.15.114:0/1520562089 shutdown_connections 2024-09-13T17:52:38.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.764+0000 7fcd57200640 1 -- 172.21.15.114:0/1520562089 wait complete. 2024-09-13T17:52:38.786 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:52:38.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.916+0000 7fe60d800640 1 Processor -- start 2024-09-13T17:52:38.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.916+0000 7fe60d800640 1 -- start start 2024-09-13T17:52:38.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe60d800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe60806dc60 0x7fe6080cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:38.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe60d800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6080cd220 con 0x7fe60813c240 2024-09-13T17:52:38.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe60d800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe60815a740 con 0x7fe60813f420 2024-09-13T17:52:38.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe60d800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe608159bc0 con 0x7fe60806dc60 2024-09-13T17:52:38.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe606a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe60813c240 0x7fe60813c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46320/0 (socket says 172.21.15.114:46320) 2024-09-13T17:52:38.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe606a00640 1 -- 172.21.15.114:0/1832118985 learned_addr learned my addr 172.21.15.114:0/1832118985 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:38.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe605600640 1 -- 172.21.15.114:0/1832118985 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4165410108 0 0) 0x7fe6080cd220 con 0x7fe60813c240 2024-09-13T17:52:38.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe607400640 1 --2- 172.21.15.114:0/1832118985 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe60806dc60 0x7fe6080cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:38.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe605600640 1 -- 172.21.15.114:0/1832118985 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5ec005740 con 0x7fe60813c240 2024-09-13T17:52:38.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe605600640 1 -- 172.21.15.114:0/1832118985 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3725359701 0 0) 0x7fe5ec005740 con 0x7fe60813c240 2024-09-13T17:52:38.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe605600640 1 -- 172.21.15.114:0/1832118985 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe60806dc60 msgr2=0x7fe6080cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:38.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe605600640 1 --2- 172.21.15.114:0/1832118985 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe60806dc60 0x7fe6080cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:38.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe605600640 1 -- 172.21.15.114:0/1832118985 >> v1:172.21.15.134:6789/0 conn(0x7fe60813f420 legacy=0x7fe60806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:38.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe605600640 1 -- 172.21.15.114:0/1832118985 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe608159ea0 con 0x7fe60813c240 2024-09-13T17:52:38.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe605600640 1 -- 172.21.15.114:0/1832118985 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7fe5f8001a00 con 0x7fe60813c240 2024-09-13T17:52:38.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe605600640 1 -- 172.21.15.114:0/1832118985 >> v1:172.21.15.114:6789/0 conn(0x7fe60813c240 legacy=0x7fe60813c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:38.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe605600640 1 --2- 172.21.15.114:0/1832118985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ec005bc0 0x7fe5ec005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:38.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe605600640 1 --2- 172.21.15.114:0/1832118985 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe60806dc60 0x7fe5ec0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:38.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe605600640 1 --2- 172.21.15.114:0/1832118985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5ec006f20 0x7fe5ec0073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:38.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe605600640 1 -- 172.21.15.114:0/1832118985 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe608159bc0 con 0x7fe5ec006f20 2024-09-13T17:52:38.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe605600640 1 -- 172.21.15.114:0/1832118985 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec00dc80 con 0x7fe5ec005bc0 2024-09-13T17:52:38.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe605600640 1 -- 172.21.15.114:0/1832118985 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec00de40 con 0x7fe60806dc60 2024-09-13T17:52:38.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe607400640 1 --2- 172.21.15.114:0/1832118985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5ec006f20 0x7fe5ec0073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:38.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe606a00640 1 --2- 172.21.15.114:0/1832118985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ec005bc0 0x7fe5ec005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:38.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe606000640 1 --2- 172.21.15.114:0/1832118985 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe60806dc60 0x7fe5ec0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:38.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe607400640 1 -- 172.21.15.114:0/1832118985 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe60806dc60 msgr2=0x7fe5ec0069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:38.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe607400640 1 --2- 172.21.15.114:0/1832118985 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe60806dc60 0x7fe5ec0069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:38.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe607400640 1 -- 172.21.15.114:0/1832118985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ec005bc0 msgr2=0x7fe5ec005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:38.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe607400640 1 --2- 172.21.15.114:0/1832118985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ec005bc0 0x7fe5ec005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:38.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.920+0000 7fe607400640 1 -- 172.21.15.114:0/1832118985 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ec005740 con 0x7fe5ec006f20 2024-09-13T17:52:38.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.924+0000 7fe607400640 1 --2- 172.21.15.114:0/1832118985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5ec006f20 0x7fe5ec0073a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe600009ab0 tx=0x7fe60001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea5cb8a331516a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:38.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.924+0000 7fe605600640 1 -- 172.21.15.114:0/1832118985 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6000a5640 con 0x7fe5ec006f20 2024-09-13T17:52:38.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.924+0000 7fe605600640 1 -- 172.21.15.114:0/1832118985 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6000a57a0 con 0x7fe5ec006f20 2024-09-13T17:52:38.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.924+0000 7fe605600640 1 -- 172.21.15.114:0/1832118985 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6000a5b50 con 0x7fe5ec006f20 2024-09-13T17:52:38.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.924+0000 7fe60d800640 1 -- 172.21.15.114:0/1832118985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5ec006f20 msgr2=0x7fe5ec0073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:38.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.924+0000 7fe60d800640 1 --2- 172.21.15.114:0/1832118985 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5ec006f20 0x7fe5ec0073a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe600009ab0 tx=0x7fe60001ca50 comp rx=0 tx=0).stop 2024-09-13T17:52:38.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.924+0000 7fe607400640 1 -- 172.21.15.114:0/1832118985 reap_dead start 2024-09-13T17:52:38.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.924+0000 7fe60d800640 1 -- 172.21.15.114:0/1832118985 shutdown_connections 2024-09-13T17:52:38.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.924+0000 7fe60d800640 1 -- 172.21.15.114:0/1832118985 >> 172.21.15.114:0/1832118985 conn(0x7fe6080660b0 msgr2=0x7fe608069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:38.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.924+0000 7fe60d800640 1 -- 172.21.15.114:0/1832118985 shutdown_connections 2024-09-13T17:52:38.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.924+0000 7fe60d800640 1 -- 172.21.15.114:0/1832118985 wait complete. 2024-09-13T17:52:38.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.928+0000 7fe60d800640 1 Processor -- start 2024-09-13T17:52:38.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.928+0000 7fe60d800640 1 -- start start 2024-09-13T17:52:38.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.928+0000 7fe60d800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5ec006f20 0x7fe60815bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:38.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.928+0000 7fe60d800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6081f1920 0x7fe6080ac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:38.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.928+0000 7fe60d800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6080acde0 0x7fe6081ed6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:38.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.928+0000 7fe60d800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6080a9190 con 0x7fe6081f1920 2024-09-13T17:52:38.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.928+0000 7fe60d800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6080ad270 con 0x7fe6080acde0 2024-09-13T17:52:38.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.928+0000 7fe60d800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6081ee400 con 0x7fe5ec006f20 2024-09-13T17:52:38.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.928+0000 7fe606000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6081f1920 0x7fe6080ac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:38.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.928+0000 7fe606000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6081f1920 0x7fe6080ac8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56062/0 (socket says 172.21.15.114:56062) 2024-09-13T17:52:38.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.928+0000 7fe606000640 1 -- 172.21.15.114:0/3492844396 learned_addr learned my addr 172.21.15.114:0/3492844396 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:38.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.928+0000 7fe606a00640 1 --2- 172.21.15.114:0/3492844396 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5ec006f20 0x7fe60815bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:38.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.928+0000 7fe607400640 1 --2- 172.21.15.114:0/3492844396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6080acde0 0x7fe6081ed6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:38.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.928+0000 7fe606000640 1 -- 172.21.15.114:0/3492844396 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5ec006f20 msgr2=0x7fe60815bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:38.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.928+0000 7fe606000640 1 --2- 172.21.15.114:0/3492844396 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5ec006f20 0x7fe60815bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:38.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.928+0000 7fe606000640 1 -- 172.21.15.114:0/3492844396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6080acde0 msgr2=0x7fe6081ed6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:38.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.928+0000 7fe606000640 1 --2- 172.21.15.114:0/3492844396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6080acde0 0x7fe6081ed6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:38.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.928+0000 7fe606000640 1 -- 172.21.15.114:0/3492844396 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6081f0e40 con 0x7fe6081f1920 2024-09-13T17:52:38.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.928+0000 7fe606000640 1 --2- 172.21.15.114:0/3492844396 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6081f1920 0x7fe6080ac8a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400f7f0 tx=0x7fe5f400fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:38.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.928+0000 7fe5fea00640 1 -- 172.21.15.114:0/3492844396 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f40050d0 con 0x7fe6081f1920 2024-09-13T17:52:38.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.928+0000 7fe5fea00640 1 -- 172.21.15.114:0/3492844396 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f4005230 con 0x7fe6081f1920 2024-09-13T17:52:38.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.928+0000 7fe5fea00640 1 -- 172.21.15.114:0/3492844396 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f400d730 con 0x7fe6081f1920 2024-09-13T17:52:38.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.928+0000 7fe60d800640 1 -- 172.21.15.114:0/3492844396 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6081f1120 con 0x7fe6081f1920 2024-09-13T17:52:38.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.928+0000 7fe60d800640 1 -- 172.21.15.114:0/3492844396 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe60815c120 con 0x7fe6081f1920 2024-09-13T17:52:38.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.928+0000 7fe60d800640 1 -- 172.21.15.114:0/3492844396 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe608070620 con 0x7fe6081f1920 2024-09-13T17:52:38.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.932+0000 7fe5fea00640 1 -- 172.21.15.114:0/3492844396 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe5f400d890 con 0x7fe6081f1920 2024-09-13T17:52:38.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.932+0000 7fe5fea00640 1 --2- 172.21.15.114:0/3492844396 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe5e80666c0 0x7fe5e8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:38.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.932+0000 7fe5fea00640 1 -- 172.21.15.114:0/3492844396 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe5f4084370 con 0x7fe6081f1920 2024-09-13T17:52:38.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.932+0000 7fe606a00640 1 --2- 172.21.15.114:0/3492844396 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe5e80666c0 0x7fe5e8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:38.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.932+0000 7fe606a00640 1 --2- 172.21.15.114:0/3492844396 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe5e80666c0 0x7fe5e8068b80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8002020 tx=0x7fe5f8006040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:38.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:38.936+0000 7fe5fea00640 1 -- 172.21.15.114:0/3492844396 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe5f4051310 con 0x7fe6081f1920 2024-09-13T17:52:39.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.092+0000 7fe60d800640 1 -- 172.21.15.114:0/3492844396 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6080712d0 con 0x7fe6081f1920 2024-09-13T17:52:39.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.092+0000 7fe5fea00640 1 -- 172.21.15.114:0/3492844396 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18784 (secure 0 0 0) 0x7fe5f4054930 con 0x7fe6081f1920 2024-09-13T17:52:39.097 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:39.097 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:52:31.139000+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:51:48.278220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:51:48.773888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:51:51.856300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:52:39.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.096+0000 7fe60d800640 1 -- 172.21.15.114:0/3492844396 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe5e80666c0 msgr2=0x7fe5e8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:39.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.096+0000 7fe60d800640 1 --2- 172.21.15.114:0/3492844396 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe5e80666c0 0x7fe5e8068b80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8002020 tx=0x7fe5f8006040 comp rx=0 tx=0).stop 2024-09-13T17:52:39.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.096+0000 7fe60d800640 1 -- 172.21.15.114:0/3492844396 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6081f1920 msgr2=0x7fe6080ac8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:39.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.096+0000 7fe60d800640 1 --2- 172.21.15.114:0/3492844396 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6081f1920 0x7fe6080ac8a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400f7f0 tx=0x7fe5f400fbf0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.096+0000 7fe60d800640 1 -- 172.21.15.114:0/3492844396 shutdown_connections 2024-09-13T17:52:39.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.096+0000 7fe60d800640 1 --2- 172.21.15.114:0/3492844396 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe5e80666c0 0x7fe5e8068b80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.096+0000 7fe60d800640 1 --2- 172.21.15.114:0/3492844396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6080acde0 0x7fe6081ed6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.096+0000 7fe60d800640 1 --2- 172.21.15.114:0/3492844396 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6081f1920 0x7fe6080ac8a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.096+0000 7fe60d800640 1 --2- 172.21.15.114:0/3492844396 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe5ec006f20 0x7fe60815bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.096+0000 7fe60d800640 1 -- 172.21.15.114:0/3492844396 >> 172.21.15.114:0/3492844396 conn(0x7fe6080660b0 msgr2=0x7fe6080cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:39.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.096+0000 7fe60d800640 1 -- 172.21.15.114:0/3492844396 shutdown_connections 2024-09-13T17:52:39.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.096+0000 7fe60d800640 1 -- 172.21.15.114:0/3492844396 wait complete. 2024-09-13T17:52:39.119 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:51:37.996254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:51:48.278220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:51:48.773888+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:51:51.856300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:52:39.120 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:52:39.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.256+0000 7f45c7200640 1 Processor -- start 2024-09-13T17:52:39.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.256+0000 7f45c7200640 1 -- start start 2024-09-13T17:52:39.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.256+0000 7f45c7200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f45c0151420 0x7f45c00cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:39.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.256+0000 7f45c7200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c0151800 con 0x7f45c0070b30 2024-09-13T17:52:39.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.256+0000 7f45c7200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c00cafb0 con 0x7f45c00ccba0 2024-09-13T17:52:39.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.256+0000 7f45c7200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c00cbc30 con 0x7f45c0151420 2024-09-13T17:52:39.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.256+0000 7f45bfe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f45c0151420 0x7f45c00cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:39.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.256+0000 7f45c5200640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f45c0070b30 0x7f45c006c540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46326/0 (socket says 172.21.15.114:46326) 2024-09-13T17:52:39.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.256+0000 7f45c5200640 1 -- 172.21.15.114:0/2066550154 learned_addr learned my addr 172.21.15.114:0/2066550154 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:39.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.256+0000 7f45bfe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f45c0151420 0x7f45c00cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56078/0 (socket says 172.21.15.114:56078) 2024-09-13T17:52:39.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.260+0000 7f45bfe00640 1 -- 172.21.15.114:0/2066550154 >> v1:172.21.15.134:6789/0 conn(0x7f45c00ccba0 legacy=0x7f45c0070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:39.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.260+0000 7f45bfe00640 1 -- 172.21.15.114:0/2066550154 >> v1:172.21.15.114:6789/0 conn(0x7f45c0070b30 legacy=0x7f45c006c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:39.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.260+0000 7f45bfe00640 1 -- 172.21.15.114:0/2066550154 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c00cb290 con 0x7f45c0151420 2024-09-13T17:52:39.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.260+0000 7f45bf400640 1 -- 172.21.15.114:0/2066550154 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2423573529 0 0) 0x7f45c0151800 con 0x7f45c0070b30 2024-09-13T17:52:39.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.260+0000 7f45bfe00640 1 --2- 172.21.15.114:0/2066550154 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45c0151420 0x7f45c00cc660 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f45b00097c0 tx=0x7f45b001c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db64ad466fc89b69 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:39.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.260+0000 7f45bf400640 1 -- 172.21.15.114:0/2066550154 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b0004230 con 0x7f45c0151420 2024-09-13T17:52:39.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.260+0000 7f45bf400640 1 -- 172.21.15.114:0/2066550154 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b00a7050 con 0x7f45c0151420 2024-09-13T17:52:39.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.260+0000 7f45bf400640 1 -- 172.21.15.114:0/2066550154 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b0003620 con 0x7f45c0151420 2024-09-13T17:52:39.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.260+0000 7f45c7200640 1 -- 172.21.15.114:0/2066550154 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45c0151420 msgr2=0x7f45c00cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:39.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.260+0000 7f45c7200640 1 --2- 172.21.15.114:0/2066550154 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45c0151420 0x7f45c00cc660 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f45b00097c0 tx=0x7f45b001c350 comp rx=0 tx=0).stop 2024-09-13T17:52:39.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.260+0000 7f45c7200640 1 -- 172.21.15.114:0/2066550154 shutdown_connections 2024-09-13T17:52:39.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.260+0000 7f45c7200640 1 --2- 172.21.15.114:0/2066550154 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45c0151420 0x7f45c00cc660 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.260+0000 7f45c7200640 1 -- 172.21.15.114:0/2066550154 >> 172.21.15.114:0/2066550154 conn(0x7f45c00660b0 msgr2=0x7f45c0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:39.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.260+0000 7f45c7200640 1 -- 172.21.15.114:0/2066550154 shutdown_connections 2024-09-13T17:52:39.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.260+0000 7f45c7200640 1 -- 172.21.15.114:0/2066550154 wait complete. 2024-09-13T17:52:39.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.264+0000 7f45c7200640 1 Processor -- start 2024-09-13T17:52:39.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.264+0000 7f45c7200640 1 -- start start 2024-09-13T17:52:39.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.264+0000 7f45c7200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45c0070b30 0x7f45c01544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:39.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.264+0000 7f45c7200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45c00ccba0 0x7f45c014c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:39.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.264+0000 7f45c7200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45c0151420 0x7f45c00b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:39.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.264+0000 7f45c7200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c0154a00 con 0x7f45c0070b30 2024-09-13T17:52:39.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.264+0000 7f45c7200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c014ccc0 con 0x7f45c0151420 2024-09-13T17:52:39.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.264+0000 7f45c7200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c0153420 con 0x7f45c00ccba0 2024-09-13T17:52:39.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.264+0000 7f45bfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45c0070b30 0x7f45c01544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:39.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.264+0000 7f45bfe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45c0070b30 0x7f45c01544c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56092/0 (socket says 172.21.15.114:56092) 2024-09-13T17:52:39.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.264+0000 7f45bfe00640 1 -- 172.21.15.114:0/2935376134 learned_addr learned my addr 172.21.15.114:0/2935376134 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:39.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.264+0000 7f45bfe00640 1 -- 172.21.15.114:0/2935376134 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45c00ccba0 msgr2=0x7f45c014c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:39.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.264+0000 7f45bfe00640 1 --2- 172.21.15.114:0/2935376134 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45c00ccba0 0x7f45c014c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.264+0000 7f45bfe00640 1 -- 172.21.15.114:0/2935376134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45c0151420 msgr2=0x7f45c00b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:39.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.264+0000 7f45bfe00640 1 --2- 172.21.15.114:0/2935376134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45c0151420 0x7f45c00b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.264+0000 7f45bfe00640 1 -- 172.21.15.114:0/2935376134 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b0009420 con 0x7f45c0070b30 2024-09-13T17:52:39.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.264+0000 7f45bfe00640 1 --2- 172.21.15.114:0/2935376134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45c0070b30 0x7f45c01544c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f45b00ae040 tx=0x7f45b00190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:39.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.264+0000 7f45bcc00640 1 -- 172.21.15.114:0/2935376134 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b0003d10 con 0x7f45c0070b30 2024-09-13T17:52:39.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.264+0000 7f45bcc00640 1 -- 172.21.15.114:0/2935376134 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b0003e70 con 0x7f45c0070b30 2024-09-13T17:52:39.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.264+0000 7f45c7200640 1 -- 172.21.15.114:0/2935376134 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c0153700 con 0x7f45c0070b30 2024-09-13T17:52:39.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.264+0000 7f45bcc00640 1 -- 172.21.15.114:0/2935376134 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b00ab660 con 0x7f45c0070b30 2024-09-13T17:52:39.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.264+0000 7f45c7200640 1 -- 172.21.15.114:0/2935376134 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c0153cc0 con 0x7f45c0070b30 2024-09-13T17:52:39.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.268+0000 7f45c7200640 1 -- 172.21.15.114:0/2935376134 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c0070400 con 0x7f45c0070b30 2024-09-13T17:52:39.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.268+0000 7f45bcc00640 1 -- 172.21.15.114:0/2935376134 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f45b00b2040 con 0x7f45c0070b30 2024-09-13T17:52:39.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.268+0000 7f45bcc00640 1 --2- 172.21.15.114:0/2935376134 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f459c0666c0 0x7f459c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:39.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.268+0000 7f45bcc00640 1 -- 172.21.15.114:0/2935376134 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f45b011e6a0 con 0x7f45c0070b30 2024-09-13T17:52:39.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.268+0000 7f45b7e00640 1 --2- 172.21.15.114:0/2935376134 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f459c0666c0 0x7f459c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:39.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.268+0000 7f45b7e00640 1 --2- 172.21.15.114:0/2935376134 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f459c0666c0 0x7f459c068b80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f45a8000f70 tx=0x7f45a80079c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:39.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.272+0000 7f45bcc00640 1 -- 172.21.15.114:0/2935376134 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f45b00eb640 con 0x7f45c0070b30 2024-09-13T17:52:39.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.424+0000 7f45c7200640 1 -- 172.21.15.114:0/2935376134 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f45c00cc660 con 0x7f45c0070b30 2024-09-13T17:52:39.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.424+0000 7f45bcc00640 1 -- 172.21.15.114:0/2935376134 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f45b00eec60 con 0x7f45c0070b30 2024-09-13T17:52:39.429 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-13T17:52:39.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.428+0000 7f45c7200640 1 -- 172.21.15.114:0/2935376134 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f459c0666c0 msgr2=0x7f459c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:39.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.428+0000 7f45c7200640 1 --2- 172.21.15.114:0/2935376134 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f459c0666c0 0x7f459c068b80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f45a8000f70 tx=0x7f45a80079c0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.428+0000 7f45c7200640 1 -- 172.21.15.114:0/2935376134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45c0070b30 msgr2=0x7f45c01544c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:39.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.428+0000 7f45c7200640 1 --2- 172.21.15.114:0/2935376134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45c0070b30 0x7f45c01544c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f45b00ae040 tx=0x7f45b00190f0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.428+0000 7f45c7200640 1 -- 172.21.15.114:0/2935376134 shutdown_connections 2024-09-13T17:52:39.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.428+0000 7f45c7200640 1 --2- 172.21.15.114:0/2935376134 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f459c0666c0 0x7f459c068b80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.428+0000 7f45c7200640 1 --2- 172.21.15.114:0/2935376134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45c0151420 0x7f45c00b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.428+0000 7f45c7200640 1 --2- 172.21.15.114:0/2935376134 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f45c00ccba0 0x7f45c014c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.428+0000 7f45c7200640 1 --2- 172.21.15.114:0/2935376134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45c0070b30 0x7f45c01544c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.428+0000 7f45c7200640 1 -- 172.21.15.114:0/2935376134 >> 172.21.15.114:0/2935376134 conn(0x7f45c00660b0 msgr2=0x7f45c015deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:39.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.428+0000 7f45c7200640 1 -- 172.21.15.114:0/2935376134 shutdown_connections 2024-09-13T17:52:39.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.428+0000 7f45c7200640 1 -- 172.21.15.114:0/2935376134 wait complete. 2024-09-13T17:52:39.451 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:52:39.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.584+0000 7f3504600640 1 Processor -- start 2024-09-13T17:52:39.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.584+0000 7f3504600640 1 -- start start 2024-09-13T17:52:39.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.584+0000 7f3504600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f34fc13c240 0x7f34fc13f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:39.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.584+0000 7f3504600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f34fc13c980 0x7f34fc06d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:39.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.584+0000 7f3504600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34fc0cd220 con 0x7f34fc06da90 2024-09-13T17:52:39.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.584+0000 7f3504600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34fc06df40 con 0x7f34fc13c980 2024-09-13T17:52:39.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.584+0000 7f3504600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34fc13f960 con 0x7f34fc13c240 2024-09-13T17:52:39.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.584+0000 7f3501200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f34fc13c980 0x7f34fc06d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:39.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.584+0000 7f3502600640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f34fc06da90 0x7f34fc0cd650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46330/0 (socket says 172.21.15.114:46330) 2024-09-13T17:52:39.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.584+0000 7f3502600640 1 -- 172.21.15.114:0/94397638 learned_addr learned my addr 172.21.15.114:0/94397638 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:39.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.584+0000 7f3501c00640 1 --2- 172.21.15.114:0/94397638 >> v2:172.21.15.134:3300/0 conn(0x7f34fc13c240 0x7f34fc13f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:39.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.588+0000 7f34fbe00640 1 -- 172.21.15.114:0/94397638 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2856323197 0 0) 0x7f34fc0cd220 con 0x7f34fc06da90 2024-09-13T17:52:39.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.588+0000 7f34fbe00640 1 -- 172.21.15.114:0/94397638 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34e4003530 con 0x7f34fc06da90 2024-09-13T17:52:39.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.588+0000 7f3501200640 1 -- 172.21.15.114:0/94397638 >> v2:172.21.15.134:3300/0 conn(0x7f34fc13c240 msgr2=0x7f34fc13f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:39.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.588+0000 7f3501200640 1 --2- 172.21.15.114:0/94397638 >> v2:172.21.15.134:3300/0 conn(0x7f34fc13c240 0x7f34fc13f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.588+0000 7f3501200640 1 -- 172.21.15.114:0/94397638 >> v1:172.21.15.114:6789/0 conn(0x7f34fc06da90 legacy=0x7f34fc0cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:39.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.588+0000 7f3501200640 1 -- 172.21.15.114:0/94397638 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34fc15a740 con 0x7f34fc13c980 2024-09-13T17:52:39.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.588+0000 7f3501200640 1 --2- 172.21.15.114:0/94397638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34fc13c980 0x7f34fc06d550 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f34fc06e720 tx=0x7f34e801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49889e6daa91262d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:39.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.588+0000 7f34fbe00640 1 -- 172.21.15.114:0/94397638 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e80ab650 con 0x7f34fc13c980 2024-09-13T17:52:39.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.588+0000 7f34fbe00640 1 -- 172.21.15.114:0/94397638 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e80ab7b0 con 0x7f34fc13c980 2024-09-13T17:52:39.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.588+0000 7f34fbe00640 1 -- 172.21.15.114:0/94397638 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e80abb40 con 0x7f34fc13c980 2024-09-13T17:52:39.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.588+0000 7f3504600640 1 -- 172.21.15.114:0/94397638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34fc13c980 msgr2=0x7f34fc06d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:39.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.588+0000 7f3504600640 1 --2- 172.21.15.114:0/94397638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34fc13c980 0x7f34fc06d550 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f34fc06e720 tx=0x7f34e801c450 comp rx=0 tx=0).stop 2024-09-13T17:52:39.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.592+0000 7f3504600640 1 -- 172.21.15.114:0/94397638 shutdown_connections 2024-09-13T17:52:39.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.592+0000 7f3504600640 1 --2- 172.21.15.114:0/94397638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34fc13c980 0x7f34fc06d550 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.592+0000 7f3504600640 1 --2- 172.21.15.114:0/94397638 >> v2:172.21.15.134:3300/0 conn(0x7f34fc13c240 0x7f34fc13f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.592+0000 7f3504600640 1 -- 172.21.15.114:0/94397638 >> 172.21.15.114:0/94397638 conn(0x7f34fc0660b0 msgr2=0x7f34fc069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:39.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.592+0000 7f3504600640 1 -- 172.21.15.114:0/94397638 shutdown_connections 2024-09-13T17:52:39.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.592+0000 7f3504600640 1 -- 172.21.15.114:0/94397638 wait complete. 2024-09-13T17:52:39.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.592+0000 7f3504600640 1 Processor -- start 2024-09-13T17:52:39.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.592+0000 7f3504600640 1 -- start start 2024-09-13T17:52:39.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.592+0000 7f3504600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34fc06da90 0x7f34fc156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:39.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.592+0000 7f3504600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34fc13c240 0x7f34fc0b2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:39.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.592+0000 7f3504600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34fc13c980 0x7f34fc0b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:39.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.592+0000 7f3504600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc0ad500 con 0x7f34fc13c980 2024-09-13T17:52:39.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.592+0000 7f3504600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc0acbd0 con 0x7f34fc06da90 2024-09-13T17:52:39.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.592+0000 7f3504600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc0aceb0 con 0x7f34fc13c240 2024-09-13T17:52:39.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.592+0000 7f3502600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34fc13c980 0x7f34fc0b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:39.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.592+0000 7f3502600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34fc13c980 0x7f34fc0b0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56112/0 (socket says 172.21.15.114:56112) 2024-09-13T17:52:39.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.592+0000 7f3502600640 1 -- 172.21.15.114:0/1879031482 learned_addr learned my addr 172.21.15.114:0/1879031482 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:39.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.592+0000 7f3501200640 1 --2- 172.21.15.114:0/1879031482 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34fc13c240 0x7f34fc0b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:39.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.592+0000 7f3501c00640 1 --2- 172.21.15.114:0/1879031482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34fc06da90 0x7f34fc156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:39.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.592+0000 7f3502600640 1 -- 172.21.15.114:0/1879031482 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34fc13c240 msgr2=0x7f34fc0b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:39.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.592+0000 7f3502600640 1 --2- 172.21.15.114:0/1879031482 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34fc13c240 0x7f34fc0b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.592+0000 7f3502600640 1 -- 172.21.15.114:0/1879031482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34fc06da90 msgr2=0x7f34fc156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:39.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.592+0000 7f3502600640 1 --2- 172.21.15.114:0/1879031482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34fc06da90 0x7f34fc156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.592+0000 7f3502600640 1 -- 172.21.15.114:0/1879031482 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e8009420 con 0x7f34fc13c980 2024-09-13T17:52:39.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.592+0000 7f3502600640 1 --2- 172.21.15.114:0/1879031482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34fc13c980 0x7f34fc0b0350 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f34f400cb40 tx=0x7f34f400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:39.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.592+0000 7f34f9600640 1 -- 172.21.15.114:0/1879031482 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f400aca0 con 0x7f34fc13c980 2024-09-13T17:52:39.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.596+0000 7f34f9600640 1 -- 172.21.15.114:0/1879031482 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f400ae00 con 0x7f34fc13c980 2024-09-13T17:52:39.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.596+0000 7f3504600640 1 -- 172.21.15.114:0/1879031482 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34fc0ad190 con 0x7f34fc13c980 2024-09-13T17:52:39.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.596+0000 7f34f9600640 1 -- 172.21.15.114:0/1879031482 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f4012620 con 0x7f34fc13c980 2024-09-13T17:52:39.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.596+0000 7f3504600640 1 -- 172.21.15.114:0/1879031482 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34fc15bd70 con 0x7f34fc13c980 2024-09-13T17:52:39.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.596+0000 7f3504600640 1 -- 172.21.15.114:0/1879031482 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34fc0ad670 con 0x7f34fc13c980 2024-09-13T17:52:39.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.596+0000 7f34f9600640 1 -- 172.21.15.114:0/1879031482 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f34f4007070 con 0x7f34fc13c980 2024-09-13T17:52:39.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.596+0000 7f34f9600640 1 --2- 172.21.15.114:0/1879031482 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f34dc066690 0x7f34dc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:39.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.596+0000 7f34f9600640 1 -- 172.21.15.114:0/1879031482 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f34f4084570 con 0x7f34fc13c980 2024-09-13T17:52:39.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.596+0000 7f3501c00640 1 --2- 172.21.15.114:0/1879031482 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f34dc066690 0x7f34dc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:39.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.596+0000 7f3501c00640 1 --2- 172.21.15.114:0/1879031482 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f34dc066690 0x7f34dc068b50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f34f0009b60 tx=0x7f34f0009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:39.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.600+0000 7f34f9600640 1 -- 172.21.15.114:0/1879031482 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f34f4051530 con 0x7f34fc13c980 2024-09-13T17:52:39.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.756+0000 7f3504600640 1 -- 172.21.15.114:0/1879031482 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f34fc159030 con 0x7f34fc13c980 2024-09-13T17:52:39.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.756+0000 7f34f9600640 1 -- 172.21.15.114:0/1879031482 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f34f4054b50 con 0x7f34fc13c980 2024-09-13T17:52:39.760 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:52:39.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.756+0000 7f3504600640 1 -- 172.21.15.114:0/1879031482 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f34dc066690 msgr2=0x7f34dc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:39.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.756+0000 7f3504600640 1 --2- 172.21.15.114:0/1879031482 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f34dc066690 0x7f34dc068b50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f34f0009b60 tx=0x7f34f0009190 comp rx=0 tx=0).stop 2024-09-13T17:52:39.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.756+0000 7f3504600640 1 -- 172.21.15.114:0/1879031482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34fc13c980 msgr2=0x7f34fc0b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:39.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.756+0000 7f3504600640 1 --2- 172.21.15.114:0/1879031482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34fc13c980 0x7f34fc0b0350 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f34f400cb40 tx=0x7f34f400a060 comp rx=0 tx=0).stop 2024-09-13T17:52:39.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.760+0000 7f3504600640 1 -- 172.21.15.114:0/1879031482 shutdown_connections 2024-09-13T17:52:39.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.760+0000 7f3504600640 1 --2- 172.21.15.114:0/1879031482 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f34dc066690 0x7f34dc068b50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.760+0000 7f3504600640 1 --2- 172.21.15.114:0/1879031482 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34fc13c980 0x7f34fc0b0350 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.760+0000 7f3504600640 1 --2- 172.21.15.114:0/1879031482 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34fc13c240 0x7f34fc0b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.760+0000 7f3504600640 1 --2- 172.21.15.114:0/1879031482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34fc06da90 0x7f34fc156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.760+0000 7f3504600640 1 -- 172.21.15.114:0/1879031482 >> 172.21.15.114:0/1879031482 conn(0x7f34fc0660b0 msgr2=0x7f34fc070420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:39.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.760+0000 7f3504600640 1 -- 172.21.15.114:0/1879031482 shutdown_connections 2024-09-13T17:52:39.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.760+0000 7f3504600640 1 -- 172.21.15.114:0/1879031482 wait complete. 2024-09-13T17:52:39.782 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:52:39.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.916+0000 7fc086c00640 1 Processor -- start 2024-09-13T17:52:39.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.916+0000 7fc086c00640 1 -- start start 2024-09-13T17:52:39.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.916+0000 7fc086c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0800ce750 0x7fc08015d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:39.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.916+0000 7fc086c00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc0800b1c60 0x7fc0800b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:39.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.916+0000 7fc086c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc08006cd60 0x7fc08006d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:39.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.916+0000 7fc086c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0800b25e0 con 0x7fc08006cd60 2024-09-13T17:52:39.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.916+0000 7fc086c00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc08015dbb0 con 0x7fc0800b1c60 2024-09-13T17:52:39.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.916+0000 7fc086c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc080160630 con 0x7fc0800ce750 2024-09-13T17:52:39.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.916+0000 7fc084c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc08006cd60 0x7fc08006d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:39.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.916+0000 7fc084c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc08006cd60 0x7fc08006d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56122/0 (socket says 172.21.15.114:56122) 2024-09-13T17:52:39.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.916+0000 7fc084c00640 1 -- 172.21.15.114:0/3857976854 learned_addr learned my addr 172.21.15.114:0/3857976854 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:39.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.920+0000 7fc084c00640 1 -- 172.21.15.114:0/3857976854 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0800ce750 msgr2=0x7fc08015d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:39.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.920+0000 7fc084c00640 1 --2- 172.21.15.114:0/3857976854 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0800ce750 0x7fc08015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.920+0000 7fc084c00640 1 -- 172.21.15.114:0/3857976854 >> v2:172.21.15.134:3300/0 conn(0x7fc0800b1c60 msgr2=0x7fc0800b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:39.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.920+0000 7fc084c00640 1 --2- 172.21.15.114:0/3857976854 >> v2:172.21.15.134:3300/0 conn(0x7fc0800b1c60 0x7fc0800b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.920+0000 7fc084c00640 1 -- 172.21.15.114:0/3857976854 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc080160910 con 0x7fc08006cd60 2024-09-13T17:52:39.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.920+0000 7fc084c00640 1 --2- 172.21.15.114:0/3857976854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc08006cd60 0x7fc08006d210 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc0800b42d0 tx=0x7fc07801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4373e24fce1e45 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:39.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.920+0000 7fc07f400640 1 -- 172.21.15.114:0/3857976854 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0780aa430 con 0x7fc08006cd60 2024-09-13T17:52:39.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.920+0000 7fc07f400640 1 -- 172.21.15.114:0/3857976854 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0780aa590 con 0x7fc08006cd60 2024-09-13T17:52:39.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.920+0000 7fc07f400640 1 -- 172.21.15.114:0/3857976854 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0780aa920 con 0x7fc08006cd60 2024-09-13T17:52:39.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.920+0000 7fc086c00640 1 -- 172.21.15.114:0/3857976854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc08006cd60 msgr2=0x7fc08006d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:39.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.920+0000 7fc086c00640 1 --2- 172.21.15.114:0/3857976854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc08006cd60 0x7fc08006d210 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc0800b42d0 tx=0x7fc07801c4f0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.924+0000 7fc086c00640 1 -- 172.21.15.114:0/3857976854 shutdown_connections 2024-09-13T17:52:39.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.924+0000 7fc086c00640 1 --2- 172.21.15.114:0/3857976854 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc08006cd60 0x7fc08006d210 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.924+0000 7fc086c00640 1 --2- 172.21.15.114:0/3857976854 >> v2:172.21.15.134:3300/0 conn(0x7fc0800b1c60 0x7fc0800b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.924+0000 7fc086c00640 1 --2- 172.21.15.114:0/3857976854 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0800ce750 0x7fc08015d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.924+0000 7fc086c00640 1 -- 172.21.15.114:0/3857976854 >> 172.21.15.114:0/3857976854 conn(0x7fc0800b0f60 msgr2=0x7fc0800cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:39.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.924+0000 7fc086c00640 1 -- 172.21.15.114:0/3857976854 shutdown_connections 2024-09-13T17:52:39.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.924+0000 7fc086c00640 1 -- 172.21.15.114:0/3857976854 wait complete. 2024-09-13T17:52:39.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.924+0000 7fc086c00640 1 Processor -- start 2024-09-13T17:52:39.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.924+0000 7fc086c00640 1 -- start start 2024-09-13T17:52:39.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.924+0000 7fc086c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc08006cd60 0x7fc080152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:39.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.924+0000 7fc086c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0800b1c60 0x7fc0801f8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:39.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.924+0000 7fc086c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0800ce750 0x7fc080151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:39.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.924+0000 7fc086c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc080149b00 con 0x7fc0800ce750 2024-09-13T17:52:39.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.924+0000 7fc086c00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0801494d0 con 0x7fc0800b1c60 2024-09-13T17:52:39.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.924+0000 7fc086c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0801f9870 con 0x7fc08006cd60 2024-09-13T17:52:39.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.924+0000 7fc084c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0800ce750 0x7fc080151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:39.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.924+0000 7fc084c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0800ce750 0x7fc080151d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56134/0 (socket says 172.21.15.114:56134) 2024-09-13T17:52:39.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.924+0000 7fc084c00640 1 -- 172.21.15.114:0/241516462 learned_addr learned my addr 172.21.15.114:0/241516462 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:39.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.924+0000 7fc077400640 1 --2- 172.21.15.114:0/241516462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0800b1c60 0x7fc0801f8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:39.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.924+0000 7fc07fe00640 1 --2- 172.21.15.114:0/241516462 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc08006cd60 0x7fc080152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:39.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.924+0000 7fc084c00640 1 -- 172.21.15.114:0/241516462 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc08006cd60 msgr2=0x7fc080152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:39.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.924+0000 7fc084c00640 1 --2- 172.21.15.114:0/241516462 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc08006cd60 0x7fc080152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.924+0000 7fc084c00640 1 -- 172.21.15.114:0/241516462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0800b1c60 msgr2=0x7fc0801f8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:39.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.924+0000 7fc084c00640 1 --2- 172.21.15.114:0/241516462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0800b1c60 0x7fc0801f8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:39.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.924+0000 7fc084c00640 1 -- 172.21.15.114:0/241516462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0780094d0 con 0x7fc0800ce750 2024-09-13T17:52:39.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.924+0000 7fc084c00640 1 --2- 172.21.15.114:0/241516462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0800ce750 0x7fc080151d60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc0780ac040 tx=0x7fc07801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:39.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.928+0000 7fc07cc00640 1 -- 172.21.15.114:0/241516462 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0780b3800 con 0x7fc0800ce750 2024-09-13T17:52:39.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.928+0000 7fc07cc00640 1 -- 172.21.15.114:0/241516462 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0780b3980 con 0x7fc0800ce750 2024-09-13T17:52:39.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.928+0000 7fc086c00640 1 -- 172.21.15.114:0/241516462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0801f9b50 con 0x7fc0800ce750 2024-09-13T17:52:39.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.928+0000 7fc07cc00640 1 -- 172.21.15.114:0/241516462 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0780b3d30 con 0x7fc0800ce750 2024-09-13T17:52:39.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.928+0000 7fc086c00640 1 -- 172.21.15.114:0/241516462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0800adfa0 con 0x7fc0800ce750 2024-09-13T17:52:39.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.928+0000 7fc086c00640 1 -- 172.21.15.114:0/241516462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc080149cb0 con 0x7fc0800ce750 2024-09-13T17:52:39.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.928+0000 7fc07cc00640 1 -- 172.21.15.114:0/241516462 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc0780c6390 con 0x7fc0800ce750 2024-09-13T17:52:39.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.928+0000 7fc07cc00640 1 --2- 172.21.15.114:0/241516462 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc05c066690 0x7fc05c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:39.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.928+0000 7fc07cc00640 1 -- 172.21.15.114:0/241516462 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc07811ee90 con 0x7fc0800ce750 2024-09-13T17:52:39.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.928+0000 7fc07fe00640 1 --2- 172.21.15.114:0/241516462 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc05c066690 0x7fc05c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:39.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.928+0000 7fc07fe00640 1 --2- 172.21.15.114:0/241516462 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc05c066690 0x7fc05c068b50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc07000a400 tx=0x7fc07000d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:39.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:39.932+0000 7fc07cc00640 1 -- 172.21.15.114:0/241516462 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc080149cb0 con 0x7fc0800ce750 2024-09-13T17:52:40.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.088+0000 7fc086c00640 1 -- 172.21.15.114:0/241516462 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc080149c40 con 0x7fc0800ce750 2024-09-13T17:52:40.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.092+0000 7fc07cc00640 1 -- 172.21.15.114:0/241516462 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc0781200a0 con 0x7fc0800ce750 2024-09-13T17:52:40.094 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-09-13T17:52:40.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.092+0000 7fc086c00640 1 -- 172.21.15.114:0/241516462 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc05c066690 msgr2=0x7fc05c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:40.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.092+0000 7fc086c00640 1 --2- 172.21.15.114:0/241516462 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc05c066690 0x7fc05c068b50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc07000a400 tx=0x7fc07000d040 comp rx=0 tx=0).stop 2024-09-13T17:52:40.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.092+0000 7fc086c00640 1 -- 172.21.15.114:0/241516462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0800ce750 msgr2=0x7fc080151d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:40.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.092+0000 7fc086c00640 1 --2- 172.21.15.114:0/241516462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0800ce750 0x7fc080151d60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc0780ac040 tx=0x7fc07801ad30 comp rx=0 tx=0).stop 2024-09-13T17:52:40.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.092+0000 7fc086c00640 1 -- 172.21.15.114:0/241516462 shutdown_connections 2024-09-13T17:52:40.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.092+0000 7fc086c00640 1 --2- 172.21.15.114:0/241516462 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc05c066690 0x7fc05c068b50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:40.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.092+0000 7fc086c00640 1 --2- 172.21.15.114:0/241516462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0800ce750 0x7fc080151d60 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:40.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.092+0000 7fc086c00640 1 --2- 172.21.15.114:0/241516462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0800b1c60 0x7fc0801f8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:40.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.092+0000 7fc086c00640 1 --2- 172.21.15.114:0/241516462 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc08006cd60 0x7fc080152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:40.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.092+0000 7fc086c00640 1 -- 172.21.15.114:0/241516462 >> 172.21.15.114:0/241516462 conn(0x7fc0800b0f60 msgr2=0x7fc08006ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:40.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.092+0000 7fc086c00640 1 -- 172.21.15.114:0/241516462 shutdown_connections 2024-09-13T17:52:40.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.092+0000 7fc086c00640 1 -- 172.21.15.114:0/241516462 wait complete. 2024-09-13T17:52:40.115 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:52:40.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.252+0000 7f8463400640 1 Processor -- start 2024-09-13T17:52:40.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.252+0000 7f8463400640 1 -- start start 2024-09-13T17:52:40.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.252+0000 7f8463400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f845c13c240 0x7f845c13f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:40.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.252+0000 7f8463400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f845c06dc60 0x7f845c0cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:40.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.252+0000 7f8463400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845c0cd220 con 0x7f845c13c980 2024-09-13T17:52:40.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.252+0000 7f8463400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845c13f960 con 0x7f845c13c240 2024-09-13T17:52:40.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.252+0000 7f8463400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845c15a740 con 0x7f845c06dc60 2024-09-13T17:52:40.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.252+0000 7f8460a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f845c13c240 0x7f845c13f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:40.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.252+0000 7f8460a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f845c13c240 0x7f845c13f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56148/0 (socket says 172.21.15.114:56148) 2024-09-13T17:52:40.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.252+0000 7f8460a00640 1 -- 172.21.15.114:0/3910814584 learned_addr learned my addr 172.21.15.114:0/3910814584 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:40.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.252+0000 7f8461400640 1 --2- 172.21.15.114:0/3910814584 >> v2:172.21.15.134:3300/0 conn(0x7f845c06dc60 0x7f845c0cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:40.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.252+0000 7f8460a00640 1 -- 172.21.15.114:0/3910814584 >> v2:172.21.15.134:3300/0 conn(0x7f845c06dc60 msgr2=0x7f845c0cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:40.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.252+0000 7f8460a00640 1 --2- 172.21.15.114:0/3910814584 >> v2:172.21.15.134:3300/0 conn(0x7f845c06dc60 0x7f845c0cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:40.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.252+0000 7f8460a00640 1 -- 172.21.15.114:0/3910814584 >> v1:172.21.15.134:6789/0 conn(0x7f845c13c980 legacy=0x7f845c06d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:40.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.252+0000 7f8460a00640 1 -- 172.21.15.114:0/3910814584 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845c159bc0 con 0x7f845c13c240 2024-09-13T17:52:40.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.256+0000 7f8460a00640 1 --2- 172.21.15.114:0/3910814584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f845c13c240 0x7f845c13f420 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f845c0cc210 tx=0x7f844c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f3c81885dc8a96d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:40.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.256+0000 7f845be00640 1 -- 172.21.15.114:0/3910814584 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c0ab660 con 0x7f845c13c240 2024-09-13T17:52:40.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.256+0000 7f845be00640 1 -- 172.21.15.114:0/3910814584 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844c0ab7c0 con 0x7f845c13c240 2024-09-13T17:52:40.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.256+0000 7f845be00640 1 -- 172.21.15.114:0/3910814584 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c0abb50 con 0x7f845c13c240 2024-09-13T17:52:40.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.256+0000 7f8463400640 1 -- 172.21.15.114:0/3910814584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f845c13c240 msgr2=0x7f845c13f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:40.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.256+0000 7f8463400640 1 --2- 172.21.15.114:0/3910814584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f845c13c240 0x7f845c13f420 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f845c0cc210 tx=0x7f844c01c460 comp rx=0 tx=0).stop 2024-09-13T17:52:40.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.256+0000 7f8463400640 1 -- 172.21.15.114:0/3910814584 shutdown_connections 2024-09-13T17:52:40.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.256+0000 7f8463400640 1 --2- 172.21.15.114:0/3910814584 >> v2:172.21.15.134:3300/0 conn(0x7f845c06dc60 0x7f845c0cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:40.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.256+0000 7f8463400640 1 --2- 172.21.15.114:0/3910814584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f845c13c240 0x7f845c13f420 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:40.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.256+0000 7f8463400640 1 -- 172.21.15.114:0/3910814584 >> 172.21.15.114:0/3910814584 conn(0x7f845c0660b0 msgr2=0x7f845c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:40.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.256+0000 7f8463400640 1 -- 172.21.15.114:0/3910814584 shutdown_connections 2024-09-13T17:52:40.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.256+0000 7f8463400640 1 -- 172.21.15.114:0/3910814584 wait complete. 2024-09-13T17:52:40.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.260+0000 7f8463400640 1 Processor -- start 2024-09-13T17:52:40.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.260+0000 7f8463400640 1 -- start start 2024-09-13T17:52:40.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.260+0000 7f8463400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f845c06dc60 0x7f845c13b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:40.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.260+0000 7f8463400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f845c13c240 0x7f845c1631e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:40.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.260+0000 7f8463400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f845c13c980 0x7f845c0b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:40.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.260+0000 7f8463400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c0ab8e0 con 0x7f845c13c240 2024-09-13T17:52:40.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.260+0000 7f8463400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c0abbc0 con 0x7f845c06dc60 2024-09-13T17:52:40.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.260+0000 7f8463400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845c0b0910 con 0x7f845c13c980 2024-09-13T17:52:40.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.260+0000 7f8453e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f845c13c240 0x7f845c1631e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:40.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.260+0000 7f8453e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f845c13c240 0x7f845c1631e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56150/0 (socket says 172.21.15.114:56150) 2024-09-13T17:52:40.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.260+0000 7f8453e00640 1 -- 172.21.15.114:0/3123031793 learned_addr learned my addr 172.21.15.114:0/3123031793 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:40.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.260+0000 7f8460a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f845c06dc60 0x7f845c13b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:40.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.260+0000 7f8461400640 1 --2- 172.21.15.114:0/3123031793 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f845c13c980 0x7f845c0b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:40.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.260+0000 7f8453e00640 1 -- 172.21.15.114:0/3123031793 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f845c13c980 msgr2=0x7f845c0b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:40.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.260+0000 7f8453e00640 1 --2- 172.21.15.114:0/3123031793 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f845c13c980 0x7f845c0b0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:40.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.260+0000 7f8453e00640 1 -- 172.21.15.114:0/3123031793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f845c06dc60 msgr2=0x7f845c13b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:40.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.260+0000 7f8453e00640 1 --2- 172.21.15.114:0/3123031793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f845c06dc60 0x7f845c13b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:40.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.260+0000 7f8453e00640 1 -- 172.21.15.114:0/3123031793 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844c0094d0 con 0x7f845c13c240 2024-09-13T17:52:40.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.260+0000 7f8460a00640 1 --2- 172.21.15.114:0/3123031793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f845c06dc60 0x7f845c13b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:52:40.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.260+0000 7f8453e00640 1 --2- 172.21.15.114:0/3123031793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f845c13c240 0x7f845c1631e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f844400c3f0 tx=0x7f844400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:40.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.260+0000 7f8459600640 1 -- 172.21.15.114:0/3123031793 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84440052d0 con 0x7f845c13c240 2024-09-13T17:52:40.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.260+0000 7f8459600640 1 -- 172.21.15.114:0/3123031793 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8444005430 con 0x7f845c13c240 2024-09-13T17:52:40.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.260+0000 7f8459600640 1 -- 172.21.15.114:0/3123031793 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8444003840 con 0x7f845c13c240 2024-09-13T17:52:40.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.260+0000 7f8463400640 1 -- 172.21.15.114:0/3123031793 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845c0b0bf0 con 0x7f845c13c240 2024-09-13T17:52:40.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.260+0000 7f8463400640 1 -- 172.21.15.114:0/3123031793 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845c163720 con 0x7f845c13c240 2024-09-13T17:52:40.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.264+0000 7f8463400640 1 -- 172.21.15.114:0/3123031793 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845c159790 con 0x7f845c13c240 2024-09-13T17:52:40.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.264+0000 7f8459600640 1 -- 172.21.15.114:0/3123031793 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f84440039a0 con 0x7f845c13c240 2024-09-13T17:52:40.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.264+0000 7f8459600640 1 --2- 172.21.15.114:0/3123031793 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f84380666c0 0x7f8438068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:40.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.264+0000 7f8459600640 1 -- 172.21.15.114:0/3123031793 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8444083a80 con 0x7f845c13c240 2024-09-13T17:52:40.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.264+0000 7f8460a00640 1 --2- 172.21.15.114:0/3123031793 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f84380666c0 0x7f8438068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:40.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.264+0000 7f8460a00640 1 --2- 172.21.15.114:0/3123031793 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f84380666c0 0x7f8438068b80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f844c0af000 tx=0x7f844c0b6040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:40.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.268+0000 7f8459600640 1 -- 172.21.15.114:0/3123031793 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8444050a80 con 0x7f845c13c240 2024-09-13T17:52:40.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.424+0000 7f8463400640 1 -- 172.21.15.114:0/3123031793 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f845c0abd00 con 0x7f845c13c240 2024-09-13T17:52:40.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.424+0000 7f8459600640 1 -- 172.21.15.114:0/3123031793 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8444017020 con 0x7f845c13c240 2024-09-13T17:52:40.428 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:52:40.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.424+0000 7f8463400640 1 -- 172.21.15.114:0/3123031793 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f84380666c0 msgr2=0x7f8438068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:40.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.424+0000 7f8463400640 1 --2- 172.21.15.114:0/3123031793 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f84380666c0 0x7f8438068b80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f844c0af000 tx=0x7f844c0b6040 comp rx=0 tx=0).stop 2024-09-13T17:52:40.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.424+0000 7f8463400640 1 -- 172.21.15.114:0/3123031793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f845c13c240 msgr2=0x7f845c1631e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:40.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.424+0000 7f8463400640 1 --2- 172.21.15.114:0/3123031793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f845c13c240 0x7f845c1631e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f844400c3f0 tx=0x7f844400c8b0 comp rx=0 tx=0).stop 2024-09-13T17:52:40.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.424+0000 7f8463400640 1 -- 172.21.15.114:0/3123031793 shutdown_connections 2024-09-13T17:52:40.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.424+0000 7f8463400640 1 --2- 172.21.15.114:0/3123031793 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f84380666c0 0x7f8438068b80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:40.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.428+0000 7f8463400640 1 --2- 172.21.15.114:0/3123031793 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f845c13c980 0x7f845c0b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:40.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.428+0000 7f8463400640 1 --2- 172.21.15.114:0/3123031793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f845c13c240 0x7f845c1631e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:40.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.428+0000 7f8463400640 1 --2- 172.21.15.114:0/3123031793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f845c06dc60 0x7f845c13b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:40.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.428+0000 7f8463400640 1 -- 172.21.15.114:0/3123031793 >> 172.21.15.114:0/3123031793 conn(0x7f845c0660b0 msgr2=0x7f845c0b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:40.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.428+0000 7f8463400640 1 -- 172.21.15.114:0/3123031793 shutdown_connections 2024-09-13T17:52:40.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.428+0000 7f8463400640 1 -- 172.21.15.114:0/3123031793 wait complete. 2024-09-13T17:52:40.463 INFO:tasks.cephfs_test_runner:Starting test: test_rebuild_simple (tasks.cephfs.test_recovery_pool.TestRecoveryPool) 2024-09-13T17:52:40.464 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:52:40.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.596+0000 7fb71a800640 1 Processor -- start 2024-09-13T17:52:40.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.596+0000 7fb71a800640 1 -- start start 2024-09-13T17:52:40.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.596+0000 7fb71a800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb71415e7c0 0x7fb7141653e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:40.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.596+0000 7fb71a800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7140ce540 con 0x7fb71415a650 2024-09-13T17:52:40.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.596+0000 7fb71a800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7140ce820 con 0x7fb7140ce0b0 2024-09-13T17:52:40.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.596+0000 7fb71a800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb71415ba40 con 0x7fb71415e7c0 2024-09-13T17:52:40.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.596+0000 7fb713e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb71415e7c0 0x7fb7141653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:40.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.596+0000 7fb713e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb71415e7c0 0x7fb7141653e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56154/0 (socket says 172.21.15.114:56154) 2024-09-13T17:52:40.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.596+0000 7fb713e00640 1 -- 172.21.15.114:0/3962098631 learned_addr learned my addr 172.21.15.114:0/3962098631 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:40.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.596+0000 7fb713e00640 1 -- 172.21.15.114:0/3962098631 >> v1:172.21.15.134:6789/0 conn(0x7fb7140ce0b0 legacy=0x7fb71415e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:40.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.596+0000 7fb713e00640 1 -- 172.21.15.114:0/3962098631 >> v1:172.21.15.114:6789/0 conn(0x7fb71415a650 legacy=0x7fb714099480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:40.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.596+0000 7fb713e00640 1 -- 172.21.15.114:0/3962098631 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7140ceb00 con 0x7fb71415e7c0 2024-09-13T17:52:40.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.596+0000 7fb712a00640 1 -- 172.21.15.114:0/3962098631 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3125090675 0 0) 0x7fb7140ce540 con 0x7fb71415a650 2024-09-13T17:52:40.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.600+0000 7fb713e00640 1 --2- 172.21.15.114:0/3962098631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb71415e7c0 0x7fb7141653e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb70c009870 tx=0x7fb70c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2798bdac9b74929 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:40.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.600+0000 7fb712a00640 1 -- 172.21.15.114:0/3962098631 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c0aa680 con 0x7fb71415e7c0 2024-09-13T17:52:40.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.600+0000 7fb712a00640 1 -- 172.21.15.114:0/3962098631 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70c0aa7e0 con 0x7fb71415e7c0 2024-09-13T17:52:40.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.600+0000 7fb712a00640 1 -- 172.21.15.114:0/3962098631 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c0aab70 con 0x7fb71415e7c0 2024-09-13T17:52:40.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.600+0000 7fb71a800640 1 -- 172.21.15.114:0/3962098631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb71415e7c0 msgr2=0x7fb7141653e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:40.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.600+0000 7fb71a800640 1 --2- 172.21.15.114:0/3962098631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb71415e7c0 0x7fb7141653e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb70c009870 tx=0x7fb70c01c520 comp rx=0 tx=0).stop 2024-09-13T17:52:40.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.600+0000 7fb71a800640 1 -- 172.21.15.114:0/3962098631 shutdown_connections 2024-09-13T17:52:40.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.600+0000 7fb71a800640 1 --2- 172.21.15.114:0/3962098631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb71415e7c0 0x7fb7141653e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:40.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.600+0000 7fb71a800640 1 -- 172.21.15.114:0/3962098631 >> 172.21.15.114:0/3962098631 conn(0x7fb7140d04e0 msgr2=0x7fb7140d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:40.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.600+0000 7fb71a800640 1 -- 172.21.15.114:0/3962098631 shutdown_connections 2024-09-13T17:52:40.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.600+0000 7fb71a800640 1 -- 172.21.15.114:0/3962098631 wait complete. 2024-09-13T17:52:40.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.604+0000 7fb71a800640 1 Processor -- start 2024-09-13T17:52:40.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.604+0000 7fb71a800640 1 -- start start 2024-09-13T17:52:40.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.604+0000 7fb71a800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb71415a650 0x7fb71415d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:40.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.604+0000 7fb71a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb71415e7c0 0x7fb71415bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:40.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.604+0000 7fb71a800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb71415c0c0 0x7fb7140ae320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:40.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.604+0000 7fb71a800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb714156160 con 0x7fb71415e7c0 2024-09-13T17:52:40.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.604+0000 7fb71a800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb714156440 con 0x7fb71415c0c0 2024-09-13T17:52:40.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.604+0000 7fb71a800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb714156720 con 0x7fb71415a650 2024-09-13T17:52:40.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.604+0000 7fb70aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb71415e7c0 0x7fb71415bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:40.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.604+0000 7fb70aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb71415e7c0 0x7fb71415bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56164/0 (socket says 172.21.15.114:56164) 2024-09-13T17:52:40.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.604+0000 7fb70aa00640 1 -- 172.21.15.114:0/668243736 learned_addr learned my addr 172.21.15.114:0/668243736 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:40.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.604+0000 7fb713e00640 1 --2- 172.21.15.114:0/668243736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb71415c0c0 0x7fb7140ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:40.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.604+0000 7fb713400640 1 --2- 172.21.15.114:0/668243736 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb71415a650 0x7fb71415d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:40.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.604+0000 7fb70aa00640 1 -- 172.21.15.114:0/668243736 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb71415a650 msgr2=0x7fb71415d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:40.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.604+0000 7fb70aa00640 1 --2- 172.21.15.114:0/668243736 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb71415a650 0x7fb71415d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:40.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.604+0000 7fb70aa00640 1 -- 172.21.15.114:0/668243736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb71415c0c0 msgr2=0x7fb7140ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:40.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.604+0000 7fb70aa00640 1 --2- 172.21.15.114:0/668243736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb71415c0c0 0x7fb7140ae320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:40.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.604+0000 7fb70aa00640 1 -- 172.21.15.114:0/668243736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70c0094d0 con 0x7fb71415e7c0 2024-09-13T17:52:40.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.604+0000 7fb713400640 1 --2- 172.21.15.114:0/668243736 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb71415a650 0x7fb71415d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:40.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.604+0000 7fb70aa00640 1 --2- 172.21.15.114:0/668243736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb71415e7c0 0x7fb71415bb80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00c450 tx=0x7fb6fc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:40.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.604+0000 7fb70be00640 1 -- 172.21.15.114:0/668243736 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc012830 con 0x7fb71415e7c0 2024-09-13T17:52:40.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.604+0000 7fb70be00640 1 -- 172.21.15.114:0/668243736 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6fc0129b0 con 0x7fb71415e7c0 2024-09-13T17:52:40.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.604+0000 7fb71a800640 1 -- 172.21.15.114:0/668243736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb71415dd50 con 0x7fb71415e7c0 2024-09-13T17:52:40.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.604+0000 7fb70be00640 1 -- 172.21.15.114:0/668243736 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc012d60 con 0x7fb71415e7c0 2024-09-13T17:52:40.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.604+0000 7fb71a800640 1 -- 172.21.15.114:0/668243736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7140ae860 con 0x7fb71415e7c0 2024-09-13T17:52:40.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.604+0000 7fb71a800640 1 -- 172.21.15.114:0/668243736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71415e0b0 con 0x7fb71415e7c0 2024-09-13T17:52:40.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.608+0000 7fb70be00640 1 -- 172.21.15.114:0/668243736 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb6fc01c460 con 0x7fb71415e7c0 2024-09-13T17:52:40.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.608+0000 7fb70be00640 1 --2- 172.21.15.114:0/668243736 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb6f0066690 0x7fb6f0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:40.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.608+0000 7fb70be00640 1 -- 172.21.15.114:0/668243736 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb6fc0843e0 con 0x7fb71415e7c0 2024-09-13T17:52:40.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.608+0000 7fb713400640 1 --2- 172.21.15.114:0/668243736 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb6f0066690 0x7fb6f0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:40.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.608+0000 7fb713400640 1 --2- 172.21.15.114:0/668243736 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb6f0066690 0x7fb6f0068b50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb7040012f0 tx=0x7fb704009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:40.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.612+0000 7fb70be00640 1 -- 172.21.15.114:0/668243736 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb6fc051380 con 0x7fb71415e7c0 2024-09-13T17:52:40.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.764+0000 7fb71a800640 1 -- 172.21.15.114:0/668243736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7141562a0 con 0x7fb71415e7c0 2024-09-13T17:52:40.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.768+0000 7fb70be00640 1 -- 172.21.15.114:0/668243736 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18784 (secure 0 0 0) 0x7fb7141562a0 con 0x7fb71415e7c0 2024-09-13T17:52:40.770 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:40.770 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:52:31.139000+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:51:48.278220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:51:48.773888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:51:51.856300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:52:40.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.768+0000 7fb71a800640 1 -- 172.21.15.114:0/668243736 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb6f0066690 msgr2=0x7fb6f0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:40.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.768+0000 7fb71a800640 1 --2- 172.21.15.114:0/668243736 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb6f0066690 0x7fb6f0068b50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb7040012f0 tx=0x7fb704009040 comp rx=0 tx=0).stop 2024-09-13T17:52:40.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.768+0000 7fb71a800640 1 -- 172.21.15.114:0/668243736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb71415e7c0 msgr2=0x7fb71415bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:40.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.768+0000 7fb71a800640 1 --2- 172.21.15.114:0/668243736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb71415e7c0 0x7fb71415bb80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00c450 tx=0x7fb6fc00c910 comp rx=0 tx=0).stop 2024-09-13T17:52:40.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.768+0000 7fb71a800640 1 -- 172.21.15.114:0/668243736 shutdown_connections 2024-09-13T17:52:40.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.768+0000 7fb71a800640 1 --2- 172.21.15.114:0/668243736 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb6f0066690 0x7fb6f0068b50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:40.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.768+0000 7fb71a800640 1 --2- 172.21.15.114:0/668243736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb71415c0c0 0x7fb7140ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:40.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.768+0000 7fb71a800640 1 --2- 172.21.15.114:0/668243736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb71415e7c0 0x7fb71415bb80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:40.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.768+0000 7fb71a800640 1 --2- 172.21.15.114:0/668243736 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb71415a650 0x7fb71415d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:40.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.768+0000 7fb71a800640 1 -- 172.21.15.114:0/668243736 >> 172.21.15.114:0/668243736 conn(0x7fb7140d04e0 msgr2=0x7fb714099050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:40.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.768+0000 7fb71a800640 1 -- 172.21.15.114:0/668243736 shutdown_connections 2024-09-13T17:52:40.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.768+0000 7fb71a800640 1 -- 172.21.15.114:0/668243736 wait complete. 2024-09-13T17:52:40.790 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:51:37.996254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:51:48.278220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:51:48.773888+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:51:51.856300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:52:40.791 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:52:40.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.924+0000 7f8945c00640 1 Processor -- start 2024-09-13T17:52:40.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.924+0000 7f8945c00640 1 -- start start 2024-09-13T17:52:40.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.924+0000 7f8945c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f894013f420 0x7f894006d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:40.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.924+0000 7f8945c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f894006da90 0x7f89400cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:40.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.924+0000 7f8945c00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89400cd220 con 0x7f894013c240 2024-09-13T17:52:40.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.924+0000 7f8945c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f894006ded0 con 0x7f894006da90 2024-09-13T17:52:40.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.924+0000 7f8945c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894015a740 con 0x7f894013f420 2024-09-13T17:52:40.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.924+0000 7f893f400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f894006da90 0x7f89400cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:40.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.924+0000 7f893f400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f894006da90 0x7f89400cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50196/0 (socket says 172.21.15.114:50196) 2024-09-13T17:52:40.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.924+0000 7f893f400640 1 -- 172.21.15.114:0/2896001364 learned_addr learned my addr 172.21.15.114:0/2896001364 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:40.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.924+0000 7f8936000640 1 --2- 172.21.15.114:0/2896001364 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f894013f420 0x7f894006d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:40.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.928+0000 7f893f400640 1 -- 172.21.15.114:0/2896001364 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f894013f420 msgr2=0x7f894006d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:40.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.928+0000 7f893f400640 1 --2- 172.21.15.114:0/2896001364 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f894013f420 0x7f894006d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:40.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.928+0000 7f893f400640 1 -- 172.21.15.114:0/2896001364 >> v1:172.21.15.134:6789/0 conn(0x7f894013c240 legacy=0x7f894013c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:40.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.928+0000 7f893f400640 1 -- 172.21.15.114:0/2896001364 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8940159bc0 con 0x7f894006da90 2024-09-13T17:52:40.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.928+0000 7f893f400640 1 --2- 172.21.15.114:0/2896001364 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f894006da90 0x7f89400cd650 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8938009e50 tx=0x7f893801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf969d9f746786 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:40.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.928+0000 7f893e000640 1 -- 172.21.15.114:0/2896001364 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89380a58d0 con 0x7f894006da90 2024-09-13T17:52:40.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.928+0000 7f893e000640 1 -- 172.21.15.114:0/2896001364 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89380a5a30 con 0x7f894006da90 2024-09-13T17:52:40.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.928+0000 7f893e000640 1 -- 172.21.15.114:0/2896001364 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89380a5dc0 con 0x7f894006da90 2024-09-13T17:52:40.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.928+0000 7f8945c00640 1 -- 172.21.15.114:0/2896001364 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f894006da90 msgr2=0x7f89400cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:40.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.928+0000 7f8945c00640 1 --2- 172.21.15.114:0/2896001364 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f894006da90 0x7f89400cd650 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8938009e50 tx=0x7f893801ca00 comp rx=0 tx=0).stop 2024-09-13T17:52:40.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.928+0000 7f8945c00640 1 -- 172.21.15.114:0/2896001364 shutdown_connections 2024-09-13T17:52:40.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.928+0000 7f8945c00640 1 --2- 172.21.15.114:0/2896001364 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f894013f420 0x7f894006d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:40.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.928+0000 7f8945c00640 1 --2- 172.21.15.114:0/2896001364 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f894006da90 0x7f89400cd650 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:40.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.928+0000 7f8945c00640 1 -- 172.21.15.114:0/2896001364 >> 172.21.15.114:0/2896001364 conn(0x7f89400660b0 msgr2=0x7f8940069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:40.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.928+0000 7f8945c00640 1 -- 172.21.15.114:0/2896001364 shutdown_connections 2024-09-13T17:52:40.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.932+0000 7f8945c00640 1 -- 172.21.15.114:0/2896001364 wait complete. 2024-09-13T17:52:40.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.932+0000 7f8945c00640 1 Processor -- start 2024-09-13T17:52:40.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.932+0000 7f8945c00640 1 -- start start 2024-09-13T17:52:40.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.932+0000 7f8945c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f894006da90 0x7f89400af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:40.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.932+0000 7f8945c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f894013c240 0x7f89401572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:40.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.932+0000 7f8945c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f894013f420 0x7f89400b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:40.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.932+0000 7f8945c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89400b11b0 con 0x7f894013f420 2024-09-13T17:52:40.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.932+0000 7f8945c00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89400afbb0 con 0x7f894013c240 2024-09-13T17:52:40.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.932+0000 7f8945c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89400afeb0 con 0x7f894006da90 2024-09-13T17:52:40.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.932+0000 7f893f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f894013f420 0x7f89400b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:40.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.932+0000 7f893f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f894013f420 0x7f89400b0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50200/0 (socket says 172.21.15.114:50200) 2024-09-13T17:52:40.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.932+0000 7f893f400640 1 -- 172.21.15.114:0/1096898641 learned_addr learned my addr 172.21.15.114:0/1096898641 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:40.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.932+0000 7f8936000640 1 --2- 172.21.15.114:0/1096898641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f894013c240 0x7f89401572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:40.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.932+0000 7f893ea00640 1 --2- 172.21.15.114:0/1096898641 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f894006da90 0x7f89400af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:40.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.932+0000 7f893f400640 1 -- 172.21.15.114:0/1096898641 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f894006da90 msgr2=0x7f89400af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:40.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.932+0000 7f893f400640 1 --2- 172.21.15.114:0/1096898641 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f894006da90 0x7f89400af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:40.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.932+0000 7f893f400640 1 -- 172.21.15.114:0/1096898641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f894013c240 msgr2=0x7f89401572a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:40.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.932+0000 7f893f400640 1 --2- 172.21.15.114:0/1096898641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f894013c240 0x7f89401572a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:40.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.932+0000 7f893f400640 1 -- 172.21.15.114:0/1096898641 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8938009b30 con 0x7f894013f420 2024-09-13T17:52:40.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.932+0000 7f893f400640 1 --2- 172.21.15.114:0/1096898641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f894013f420 0x7f89400b0c70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f89380af040 tx=0x7f89400ce3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:40.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.932+0000 7f8937400640 1 -- 172.21.15.114:0/1096898641 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89380b8670 con 0x7f894013f420 2024-09-13T17:52:40.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.932+0000 7f8937400640 1 -- 172.21.15.114:0/1096898641 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89380b87f0 con 0x7f894013f420 2024-09-13T17:52:40.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.932+0000 7f8937400640 1 -- 172.21.15.114:0/1096898641 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89380b8ba0 con 0x7f894013f420 2024-09-13T17:52:40.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.932+0000 7f8945c00640 1 -- 172.21.15.114:0/1096898641 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89400b0190 con 0x7f894013f420 2024-09-13T17:52:40.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.932+0000 7f8945c00640 1 -- 172.21.15.114:0/1096898641 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89400b0750 con 0x7f894013f420 2024-09-13T17:52:40.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.936+0000 7f8945c00640 1 -- 172.21.15.114:0/1096898641 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8940159790 con 0x7f894013f420 2024-09-13T17:52:40.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.936+0000 7f8937400640 1 -- 172.21.15.114:0/1096898641 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f89380b8d00 con 0x7f894013f420 2024-09-13T17:52:40.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.936+0000 7f8937400640 1 --2- 172.21.15.114:0/1096898641 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f891c0666c0 0x7f891c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:40.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.936+0000 7f8937400640 1 -- 172.21.15.114:0/1096898641 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f893811fb40 con 0x7f894013f420 2024-09-13T17:52:40.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.936+0000 7f893ea00640 1 --2- 172.21.15.114:0/1096898641 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f891c0666c0 0x7f891c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:40.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.940+0000 7f893ea00640 1 --2- 172.21.15.114:0/1096898641 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f891c0666c0 0x7f891c068b80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f894013bbb0 tx=0x7f8930009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:40.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:40.940+0000 7f8937400640 1 -- 172.21.15.114:0/1096898641 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f89380ecae0 con 0x7f894013f420 2024-09-13T17:52:41.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.092+0000 7f8945c00640 1 -- 172.21.15.114:0/1096898641 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f89400afff0 con 0x7f894013f420 2024-09-13T17:52:41.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.096+0000 7f8937400640 1 -- 172.21.15.114:0/1096898641 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f89400afff0 con 0x7f894013f420 2024-09-13T17:52:41.098 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-13T17:52:41.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.096+0000 7f8945c00640 1 -- 172.21.15.114:0/1096898641 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f891c0666c0 msgr2=0x7f891c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:41.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.096+0000 7f8945c00640 1 --2- 172.21.15.114:0/1096898641 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f891c0666c0 0x7f891c068b80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f894013bbb0 tx=0x7f8930009040 comp rx=0 tx=0).stop 2024-09-13T17:52:41.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.096+0000 7f8945c00640 1 -- 172.21.15.114:0/1096898641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f894013f420 msgr2=0x7f89400b0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:41.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.096+0000 7f8945c00640 1 --2- 172.21.15.114:0/1096898641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f894013f420 0x7f89400b0c70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f89380af040 tx=0x7f89400ce3a0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.096+0000 7f8945c00640 1 -- 172.21.15.114:0/1096898641 shutdown_connections 2024-09-13T17:52:41.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.096+0000 7f8945c00640 1 --2- 172.21.15.114:0/1096898641 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f891c0666c0 0x7f891c068b80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.096+0000 7f8945c00640 1 --2- 172.21.15.114:0/1096898641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f894013f420 0x7f89400b0c70 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.096+0000 7f8945c00640 1 --2- 172.21.15.114:0/1096898641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f894013c240 0x7f89401572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.096+0000 7f8945c00640 1 --2- 172.21.15.114:0/1096898641 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f894006da90 0x7f89400af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.096+0000 7f8945c00640 1 -- 172.21.15.114:0/1096898641 >> 172.21.15.114:0/1096898641 conn(0x7f89400660b0 msgr2=0x7f894006c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:41.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.096+0000 7f8945c00640 1 -- 172.21.15.114:0/1096898641 shutdown_connections 2024-09-13T17:52:41.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.096+0000 7f8945c00640 1 -- 172.21.15.114:0/1096898641 wait complete. 2024-09-13T17:52:41.119 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:52:41.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.256+0000 7fe4d4800640 1 Processor -- start 2024-09-13T17:52:41.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.256+0000 7fe4d4800640 1 -- start start 2024-09-13T17:52:41.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.256+0000 7fe4d4800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe4cc0cdad0 0x7fe4cc0ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:41.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.256+0000 7fe4d4800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe4cc06d740 0x7fe4cc0708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:41.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.256+0000 7fe4d4800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4cc0adfb0 con 0x7fe4cc070420 2024-09-13T17:52:41.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.256+0000 7fe4d4800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4cc06cc10 con 0x7fe4cc0cdad0 2024-09-13T17:52:41.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.256+0000 7fe4d4800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc070df0 con 0x7fe4cc06d740 2024-09-13T17:52:41.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.256+0000 7fe4d1e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe4cc0cdad0 0x7fe4cc0ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:41.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.256+0000 7fe4d1e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe4cc0cdad0 0x7fe4cc0ad4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50206/0 (socket says 172.21.15.114:50206) 2024-09-13T17:52:41.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.256+0000 7fe4d1e00640 1 -- 172.21.15.114:0/567925665 learned_addr learned my addr 172.21.15.114:0/567925665 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:41.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.256+0000 7fe4d2800640 1 --2- 172.21.15.114:0/567925665 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe4cc06d740 0x7fe4cc0708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:41.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.256+0000 7fe4d1e00640 1 -- 172.21.15.114:0/567925665 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe4cc06d740 msgr2=0x7fe4cc0708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:41.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.256+0000 7fe4d1e00640 1 --2- 172.21.15.114:0/567925665 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe4cc06d740 0x7fe4cc0708b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.256+0000 7fe4d1e00640 1 -- 172.21.15.114:0/567925665 >> v1:172.21.15.134:6789/0 conn(0x7fe4cc070420 legacy=0x7fe4cc06d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:41.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.256+0000 7fe4d1e00640 1 -- 172.21.15.114:0/567925665 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc0adcd0 con 0x7fe4cc0cdad0 2024-09-13T17:52:41.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.260+0000 7fe4d1e00640 1 --2- 172.21.15.114:0/567925665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4cc0cdad0 0x7fe4cc0ad4a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe4c00098a0 tx=0x7fe4c001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3787d51b8f5168b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:41.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.260+0000 7fe4d0a00640 1 -- 172.21.15.114:0/567925665 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c00ab620 con 0x7fe4cc0cdad0 2024-09-13T17:52:41.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.260+0000 7fe4d0a00640 1 -- 172.21.15.114:0/567925665 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c00ab780 con 0x7fe4cc0cdad0 2024-09-13T17:52:41.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.260+0000 7fe4d0a00640 1 -- 172.21.15.114:0/567925665 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c00abb10 con 0x7fe4cc0cdad0 2024-09-13T17:52:41.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.260+0000 7fe4d4800640 1 -- 172.21.15.114:0/567925665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4cc0cdad0 msgr2=0x7fe4cc0ad4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:41.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.260+0000 7fe4d4800640 1 --2- 172.21.15.114:0/567925665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4cc0cdad0 0x7fe4cc0ad4a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe4c00098a0 tx=0x7fe4c001c440 comp rx=0 tx=0).stop 2024-09-13T17:52:41.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.260+0000 7fe4d4800640 1 -- 172.21.15.114:0/567925665 shutdown_connections 2024-09-13T17:52:41.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.260+0000 7fe4d4800640 1 --2- 172.21.15.114:0/567925665 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe4cc06d740 0x7fe4cc0708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.260+0000 7fe4d4800640 1 --2- 172.21.15.114:0/567925665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4cc0cdad0 0x7fe4cc0ad4a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.260+0000 7fe4d4800640 1 -- 172.21.15.114:0/567925665 >> 172.21.15.114:0/567925665 conn(0x7fe4cc0660b0 msgr2=0x7fe4cc069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:41.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.260+0000 7fe4d4800640 1 -- 172.21.15.114:0/567925665 shutdown_connections 2024-09-13T17:52:41.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.260+0000 7fe4d4800640 1 -- 172.21.15.114:0/567925665 wait complete. 2024-09-13T17:52:41.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.260+0000 7fe4d4800640 1 Processor -- start 2024-09-13T17:52:41.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.264+0000 7fe4d4800640 1 -- start start 2024-09-13T17:52:41.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.264+0000 7fe4d4800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4cc06d740 0x7fe4cc14c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:41.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.264+0000 7fe4d4800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe4cc070420 0x7fe4cc158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:41.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.264+0000 7fe4d4800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4cc0cdad0 0x7fe4cc158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:41.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.264+0000 7fe4d4800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc14d9c0 con 0x7fe4cc0cdad0 2024-09-13T17:52:41.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.264+0000 7fe4d4800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc14c5e0 con 0x7fe4cc06d740 2024-09-13T17:52:41.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.264+0000 7fe4d4800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc14cd40 con 0x7fe4cc070420 2024-09-13T17:52:41.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.264+0000 7fe4d2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4cc0cdad0 0x7fe4cc158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:41.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.264+0000 7fe4d2800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4cc0cdad0 0x7fe4cc158a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50212/0 (socket says 172.21.15.114:50212) 2024-09-13T17:52:41.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.264+0000 7fe4d2800640 1 -- 172.21.15.114:0/1184383559 learned_addr learned my addr 172.21.15.114:0/1184383559 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:41.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.264+0000 7fe4d1e00640 1 --2- 172.21.15.114:0/1184383559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4cc06d740 0x7fe4cc14c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:41.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.264+0000 7fe4d1400640 1 --2- 172.21.15.114:0/1184383559 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe4cc070420 0x7fe4cc158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:41.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.264+0000 7fe4d2800640 1 -- 172.21.15.114:0/1184383559 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe4cc070420 msgr2=0x7fe4cc158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:41.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.264+0000 7fe4d2800640 1 --2- 172.21.15.114:0/1184383559 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe4cc070420 0x7fe4cc158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.264+0000 7fe4d2800640 1 -- 172.21.15.114:0/1184383559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4cc06d740 msgr2=0x7fe4cc14c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:41.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.264+0000 7fe4d2800640 1 --2- 172.21.15.114:0/1184383559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4cc06d740 0x7fe4cc14c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.264+0000 7fe4d2800640 1 -- 172.21.15.114:0/1184383559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c00094d0 con 0x7fe4cc0cdad0 2024-09-13T17:52:41.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.264+0000 7fe4d1400640 1 --2- 172.21.15.114:0/1184383559 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe4cc070420 0x7fe4cc158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:52:41.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.264+0000 7fe4d2800640 1 --2- 172.21.15.114:0/1184383559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4cc0cdad0 0x7fe4cc158a70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8007e70 tx=0x7fe4c800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:41.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.264+0000 7fe4c6000640 1 -- 172.21.15.114:0/1184383559 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8014620 con 0x7fe4cc0cdad0 2024-09-13T17:52:41.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.264+0000 7fe4c6000640 1 -- 172.21.15.114:0/1184383559 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c80147a0 con 0x7fe4cc0cdad0 2024-09-13T17:52:41.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.264+0000 7fe4d4800640 1 -- 172.21.15.114:0/1184383559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4cc14d020 con 0x7fe4cc0cdad0 2024-09-13T17:52:41.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.264+0000 7fe4c6000640 1 -- 172.21.15.114:0/1184383559 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8014b50 con 0x7fe4cc0cdad0 2024-09-13T17:52:41.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.264+0000 7fe4d4800640 1 -- 172.21.15.114:0/1184383559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4cc14d5e0 con 0x7fe4cc0cdad0 2024-09-13T17:52:41.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.264+0000 7fe4d4800640 1 -- 172.21.15.114:0/1184383559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4cc14db00 con 0x7fe4cc0cdad0 2024-09-13T17:52:41.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.264+0000 7fe4c6000640 1 -- 172.21.15.114:0/1184383559 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe4c8014cb0 con 0x7fe4cc0cdad0 2024-09-13T17:52:41.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.268+0000 7fe4c6000640 1 --2- 172.21.15.114:0/1184383559 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe4b0066690 0x7fe4b0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:41.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.268+0000 7fe4c6000640 1 -- 172.21.15.114:0/1184383559 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe4c8084f30 con 0x7fe4cc0cdad0 2024-09-13T17:52:41.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.268+0000 7fe4d1e00640 1 --2- 172.21.15.114:0/1184383559 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe4b0066690 0x7fe4b0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:41.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.268+0000 7fe4d1e00640 1 --2- 172.21.15.114:0/1184383559 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe4b0066690 0x7fe4b0068b50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe4c00af000 tx=0x7fe4c00a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:41.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.272+0000 7fe4c6000640 1 -- 172.21.15.114:0/1184383559 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe4c8051ed0 con 0x7fe4cc0cdad0 2024-09-13T17:52:41.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.424+0000 7fe4d4800640 1 -- 172.21.15.114:0/1184383559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe4cc0ce1d0 con 0x7fe4cc0cdad0 2024-09-13T17:52:41.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.424+0000 7fe4c6000640 1 -- 172.21.15.114:0/1184383559 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe4c80554f0 con 0x7fe4cc0cdad0 2024-09-13T17:52:41.429 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:52:41.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.428+0000 7fe4d4800640 1 -- 172.21.15.114:0/1184383559 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe4b0066690 msgr2=0x7fe4b0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:41.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.428+0000 7fe4d4800640 1 --2- 172.21.15.114:0/1184383559 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe4b0066690 0x7fe4b0068b50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe4c00af000 tx=0x7fe4c00a7000 comp rx=0 tx=0).stop 2024-09-13T17:52:41.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.428+0000 7fe4d4800640 1 -- 172.21.15.114:0/1184383559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4cc0cdad0 msgr2=0x7fe4cc158a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:41.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.428+0000 7fe4d4800640 1 --2- 172.21.15.114:0/1184383559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4cc0cdad0 0x7fe4cc158a70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8007e70 tx=0x7fe4c800e4b0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.428+0000 7fe4d4800640 1 -- 172.21.15.114:0/1184383559 shutdown_connections 2024-09-13T17:52:41.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.428+0000 7fe4d4800640 1 --2- 172.21.15.114:0/1184383559 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe4b0066690 0x7fe4b0068b50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.428+0000 7fe4d4800640 1 --2- 172.21.15.114:0/1184383559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4cc0cdad0 0x7fe4cc158a70 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.428+0000 7fe4d4800640 1 --2- 172.21.15.114:0/1184383559 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe4cc070420 0x7fe4cc158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.428+0000 7fe4d4800640 1 --2- 172.21.15.114:0/1184383559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4cc06d740 0x7fe4cc14c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.428+0000 7fe4d4800640 1 -- 172.21.15.114:0/1184383559 >> 172.21.15.114:0/1184383559 conn(0x7fe4cc0660b0 msgr2=0x7fe4cc15f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:41.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.428+0000 7fe4d4800640 1 -- 172.21.15.114:0/1184383559 shutdown_connections 2024-09-13T17:52:41.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.428+0000 7fe4d4800640 1 -- 172.21.15.114:0/1184383559 wait complete. 2024-09-13T17:52:41.449 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:52:41.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f62a00640 1 Processor -- start 2024-09-13T17:52:41.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f62a00640 1 -- start start 2024-09-13T17:52:41.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f62a00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0f5c070420 0x7f0f5c070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:41.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f62a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f5c06c540 0x7f0f5c06c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:41.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f62a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f5c151800 con 0x7f0f5c151420 2024-09-13T17:52:41.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f62a00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f5c0cbc30 con 0x7f0f5c070420 2024-09-13T17:52:41.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f62a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c070dd0 con 0x7f0f5c06c540 2024-09-13T17:52:41.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f5be00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0f5c151420 0x7f0f5c0cc660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46544/0 (socket says 172.21.15.114:46544) 2024-09-13T17:52:41.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f5be00640 1 -- 172.21.15.114:0/4086034501 learned_addr learned my addr 172.21.15.114:0/4086034501 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:41.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f53400640 1 --2- 172.21.15.114:0/4086034501 >> v2:172.21.15.134:3300/0 conn(0x7f0f5c070420 0x7f0f5c070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:41.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f60a00640 1 --2- 172.21.15.114:0/4086034501 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f5c06c540 0x7f0f5c06c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:41.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f5b400640 1 -- 172.21.15.114:0/4086034501 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342231271 0 0) 0x7f0f5c151800 con 0x7f0f5c151420 2024-09-13T17:52:41.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f5b400640 1 -- 172.21.15.114:0/4086034501 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f40003530 con 0x7f0f5c151420 2024-09-13T17:52:41.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f5b400640 1 -- 172.21.15.114:0/4086034501 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3058266498 0 0) 0x7f0f40003530 con 0x7f0f5c151420 2024-09-13T17:52:41.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f5b400640 1 -- 172.21.15.114:0/4086034501 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f5c06c540 msgr2=0x7f0f5c06c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:41.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f5b400640 1 --2- 172.21.15.114:0/4086034501 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f5c06c540 0x7f0f5c06c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f5b400640 1 -- 172.21.15.114:0/4086034501 >> v2:172.21.15.134:3300/0 conn(0x7f0f5c070420 msgr2=0x7f0f5c070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:41.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f5b400640 1 --2- 172.21.15.114:0/4086034501 >> v2:172.21.15.134:3300/0 conn(0x7f0f5c070420 0x7f0f5c070890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f5b400640 1 -- 172.21.15.114:0/4086034501 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5c0cafb0 con 0x7f0f5c151420 2024-09-13T17:52:41.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f5b400640 1 -- 172.21.15.114:0/4086034501 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7f0f4c0016a0 con 0x7f0f5c151420 2024-09-13T17:52:41.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f60a00640 1 --2- 172.21.15.114:0/4086034501 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f5c06c540 0x7f0f5c06c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:52:41.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f53400640 1 --2- 172.21.15.114:0/4086034501 >> v2:172.21.15.134:3300/0 conn(0x7f0f5c070420 0x7f0f5c070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:52:41.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f5b400640 1 -- 172.21.15.114:0/4086034501 >> v1:172.21.15.114:6789/0 conn(0x7f0f5c151420 legacy=0x7f0f5c0cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:41.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f5b400640 1 --2- 172.21.15.114:0/4086034501 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f5c06c540 0x7f0f40003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:41.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f5b400640 1 --2- 172.21.15.114:0/4086034501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f40003ec0 0x7f0f400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:41.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f5b400640 1 --2- 172.21.15.114:0/4086034501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f40004d10 0x7f0f40005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:41.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f5b400640 1 -- 172.21.15.114:0/4086034501 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c0cbc30 con 0x7f0f40004d10 2024-09-13T17:52:41.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f5b400640 1 -- 172.21.15.114:0/4086034501 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c070dd0 con 0x7f0f40003ec0 2024-09-13T17:52:41.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f5b400640 1 -- 172.21.15.114:0/4086034501 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4000ba40 con 0x7f0f5c06c540 2024-09-13T17:52:41.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f60a00640 1 --2- 172.21.15.114:0/4086034501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f40004d10 0x7f0f40005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:41.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f53400640 1 --2- 172.21.15.114:0/4086034501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f40003ec0 0x7f0f400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:41.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f5be00640 1 --2- 172.21.15.114:0/4086034501 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f5c06c540 0x7f0f40003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:41.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f60a00640 1 -- 172.21.15.114:0/4086034501 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f5c06c540 msgr2=0x7f0f40003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:41.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f60a00640 1 --2- 172.21.15.114:0/4086034501 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f5c06c540 0x7f0f40003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f60a00640 1 -- 172.21.15.114:0/4086034501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f40003ec0 msgr2=0x7f0f400047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:41.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.584+0000 7f0f60a00640 1 --2- 172.21.15.114:0/4086034501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f40003ec0 0x7f0f400047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.588+0000 7f0f60a00640 1 -- 172.21.15.114:0/4086034501 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f54009420 con 0x7f0f40004d10 2024-09-13T17:52:41.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.588+0000 7f0f60a00640 1 --2- 172.21.15.114:0/4086034501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f40004d10 0x7f0f40005190 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009cb0 tx=0x7f0f5401cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49c763b65bdb837 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:41.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.588+0000 7f0f5b400640 1 -- 172.21.15.114:0/4086034501 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f540a5880 con 0x7f0f40004d10 2024-09-13T17:52:41.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.588+0000 7f0f5b400640 1 -- 172.21.15.114:0/4086034501 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f540a59e0 con 0x7f0f40004d10 2024-09-13T17:52:41.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.588+0000 7f0f5b400640 1 -- 172.21.15.114:0/4086034501 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f540a5dd0 con 0x7f0f40004d10 2024-09-13T17:52:41.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.588+0000 7f0f62a00640 1 -- 172.21.15.114:0/4086034501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f40004d10 msgr2=0x7f0f40005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:41.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.588+0000 7f0f62a00640 1 --2- 172.21.15.114:0/4086034501 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f40004d10 0x7f0f40005190 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009cb0 tx=0x7f0f5401cbe0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.588+0000 7f0f60a00640 1 -- 172.21.15.114:0/4086034501 reap_dead start 2024-09-13T17:52:41.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.588+0000 7f0f62a00640 1 -- 172.21.15.114:0/4086034501 shutdown_connections 2024-09-13T17:52:41.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.588+0000 7f0f62a00640 1 -- 172.21.15.114:0/4086034501 >> 172.21.15.114:0/4086034501 conn(0x7f0f5c0660b0 msgr2=0x7f0f5c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:41.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.588+0000 7f0f62a00640 1 -- 172.21.15.114:0/4086034501 shutdown_connections 2024-09-13T17:52:41.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.588+0000 7f0f62a00640 1 -- 172.21.15.114:0/4086034501 wait complete. 2024-09-13T17:52:41.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.592+0000 7f0f62a00640 1 Processor -- start 2024-09-13T17:52:41.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.592+0000 7f0f62a00640 1 -- start start 2024-09-13T17:52:41.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.592+0000 7f0f62a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f40004d10 0x7f0f5c15a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:41.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.592+0000 7f0f62a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f5c146560 0x7f0f5c142c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:41.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.592+0000 7f0f62a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f5c143920 0x7f0f5c0afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:41.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.592+0000 7f0f62a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c15af30 con 0x7f0f40004d10 2024-09-13T17:52:41.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.592+0000 7f0f62a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c15b210 con 0x7f0f5c143920 2024-09-13T17:52:41.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.592+0000 7f0f62a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c15b4f0 con 0x7f0f5c146560 2024-09-13T17:52:41.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.592+0000 7f0f5be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f40004d10 0x7f0f5c15a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:41.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.592+0000 7f0f5be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f40004d10 0x7f0f5c15a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50236/0 (socket says 172.21.15.114:50236) 2024-09-13T17:52:41.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.592+0000 7f0f5be00640 1 -- 172.21.15.114:0/1300742728 learned_addr learned my addr 172.21.15.114:0/1300742728 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:41.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.592+0000 7f0f5be00640 1 -- 172.21.15.114:0/1300742728 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f5c146560 msgr2=0x7f0f5c142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:41.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.592+0000 7f0f5be00640 1 --2- 172.21.15.114:0/1300742728 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f5c146560 0x7f0f5c142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.592+0000 7f0f5be00640 1 -- 172.21.15.114:0/1300742728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f5c143920 msgr2=0x7f0f5c0afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:41.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.592+0000 7f0f60a00640 1 --2- 172.21.15.114:0/1300742728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f5c143920 0x7f0f5c0afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:41.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.592+0000 7f0f5be00640 1 --2- 172.21.15.114:0/1300742728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f5c143920 0x7f0f5c0afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.592+0000 7f0f5be00640 1 -- 172.21.15.114:0/1300742728 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5c15b7d0 con 0x7f0f40004d10 2024-09-13T17:52:41.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.592+0000 7f0f60a00640 1 --2- 172.21.15.114:0/1300742728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f5c143920 0x7f0f5c0afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:52:41.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.592+0000 7f0f5be00640 1 --2- 172.21.15.114:0/1300742728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f40004d10 0x7f0f5c15a8a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0010f0 tx=0x7f0f4c00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:41.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.592+0000 7f0f58c00640 1 -- 172.21.15.114:0/1300742728 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c00c8d0 con 0x7f0f40004d10 2024-09-13T17:52:41.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.592+0000 7f0f58c00640 1 -- 172.21.15.114:0/1300742728 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c00ca50 con 0x7f0f40004d10 2024-09-13T17:52:41.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.592+0000 7f0f58c00640 1 -- 172.21.15.114:0/1300742728 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c00ce00 con 0x7f0f40004d10 2024-09-13T17:52:41.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.592+0000 7f0f62a00640 1 -- 172.21.15.114:0/1300742728 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5c15bab0 con 0x7f0f40004d10 2024-09-13T17:52:41.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.592+0000 7f0f62a00640 1 -- 172.21.15.114:0/1300742728 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5c143190 con 0x7f0f40004d10 2024-09-13T17:52:41.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.596+0000 7f0f62a00640 1 -- 172.21.15.114:0/1300742728 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f5c15bca0 con 0x7f0f40004d10 2024-09-13T17:52:41.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.596+0000 7f0f58c00640 1 -- 172.21.15.114:0/1300742728 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0f4c01d460 con 0x7f0f40004d10 2024-09-13T17:52:41.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.596+0000 7f0f58c00640 1 --2- 172.21.15.114:0/1300742728 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0f380666c0 0x7f0f38068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:41.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.596+0000 7f0f58c00640 1 -- 172.21.15.114:0/1300742728 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0f4c084660 con 0x7f0f40004d10 2024-09-13T17:52:41.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.596+0000 7f0f53400640 1 --2- 172.21.15.114:0/1300742728 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0f380666c0 0x7f0f38068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:41.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.596+0000 7f0f53400640 1 --2- 172.21.15.114:0/1300742728 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0f380666c0 0x7f0f38068b80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0ade40 tx=0x7f0f44009750 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:41.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.600+0000 7f0f58c00640 1 -- 172.21.15.114:0/1300742728 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0f4c051570 con 0x7f0f40004d10 2024-09-13T17:52:41.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.764+0000 7f0f62a00640 1 -- 172.21.15.114:0/1300742728 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0f5c06d4f0 con 0x7f0f40004d10 2024-09-13T17:52:41.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.764+0000 7f0f58c00640 1 -- 172.21.15.114:0/1300742728 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0f4c054b90 con 0x7f0f40004d10 2024-09-13T17:52:41.767 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-09-13T17:52:41.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.764+0000 7f0f62a00640 1 -- 172.21.15.114:0/1300742728 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0f380666c0 msgr2=0x7f0f38068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:41.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.764+0000 7f0f62a00640 1 --2- 172.21.15.114:0/1300742728 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0f380666c0 0x7f0f38068b80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0ade40 tx=0x7f0f44009750 comp rx=0 tx=0).stop 2024-09-13T17:52:41.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.764+0000 7f0f62a00640 1 -- 172.21.15.114:0/1300742728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f40004d10 msgr2=0x7f0f5c15a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:41.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.764+0000 7f0f62a00640 1 --2- 172.21.15.114:0/1300742728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f40004d10 0x7f0f5c15a8a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0010f0 tx=0x7f0f4c00ed50 comp rx=0 tx=0).stop 2024-09-13T17:52:41.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.764+0000 7f0f62a00640 1 -- 172.21.15.114:0/1300742728 shutdown_connections 2024-09-13T17:52:41.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.764+0000 7f0f62a00640 1 --2- 172.21.15.114:0/1300742728 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0f380666c0 0x7f0f38068b80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.764+0000 7f0f62a00640 1 --2- 172.21.15.114:0/1300742728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f5c143920 0x7f0f5c0afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.764+0000 7f0f62a00640 1 --2- 172.21.15.114:0/1300742728 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0f5c146560 0x7f0f5c142c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.764+0000 7f0f62a00640 1 --2- 172.21.15.114:0/1300742728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f40004d10 0x7f0f5c15a8a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.764+0000 7f0f62a00640 1 -- 172.21.15.114:0/1300742728 >> 172.21.15.114:0/1300742728 conn(0x7f0f5c0660b0 msgr2=0x7f0f5c149230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:41.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.764+0000 7f0f62a00640 1 -- 172.21.15.114:0/1300742728 shutdown_connections 2024-09-13T17:52:41.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.764+0000 7f0f62a00640 1 -- 172.21.15.114:0/1300742728 wait complete. 2024-09-13T17:52:41.789 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:52:41.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.927+0000 7fc7f6000640 1 Processor -- start 2024-09-13T17:52:41.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.927+0000 7fc7f6000640 1 -- start start 2024-09-13T17:52:41.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.927+0000 7fc7f6000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc7f00ccb20 0x7fc7f00ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:41.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.927+0000 7fc7f6000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc7f006d270 0x7fc7f006d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:41.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.927+0000 7fc7f6000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f00cd4c0 con 0x7fc7f015a3e0 2024-09-13T17:52:41.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.927+0000 7fc7f6000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f00ae6d0 con 0x7fc7f006d270 2024-09-13T17:52:41.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.927+0000 7fc7f6000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f00cbf90 con 0x7fc7f00ccb20 2024-09-13T17:52:41.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.927+0000 7fc7f5600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc7f006d270 0x7fc7f006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:41.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.927+0000 7fc7f5600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc7f006d270 0x7fc7f006d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50238/0 (socket says 172.21.15.114:50238) 2024-09-13T17:52:41.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.927+0000 7fc7f5600640 1 -- 172.21.15.114:0/4227470534 learned_addr learned my addr 172.21.15.114:0/4227470534 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:41.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.927+0000 7fc7efe00640 1 --2- 172.21.15.114:0/4227470534 >> v2:172.21.15.134:3300/0 conn(0x7fc7f00ccb20 0x7fc7f00ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:41.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.927+0000 7fc7f5600640 1 -- 172.21.15.114:0/4227470534 >> v2:172.21.15.134:3300/0 conn(0x7fc7f00ccb20 msgr2=0x7fc7f00ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:41.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.927+0000 7fc7f5600640 1 --2- 172.21.15.114:0/4227470534 >> v2:172.21.15.134:3300/0 conn(0x7fc7f00ccb20 0x7fc7f00ccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.927+0000 7fc7f5600640 1 -- 172.21.15.114:0/4227470534 >> v1:172.21.15.134:6789/0 conn(0x7fc7f015a3e0 legacy=0x7fc7f00adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:41.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.927+0000 7fc7f5600640 1 -- 172.21.15.114:0/4227470534 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f006cb00 con 0x7fc7f006d270 2024-09-13T17:52:41.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.931+0000 7fc7f5600640 1 --2- 172.21.15.114:0/4227470534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7f006d270 0x7fc7f006d700 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc7f015dcc0 tx=0x7fc7e801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b3e32d6b40a9ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:41.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.931+0000 7fc7ef400640 1 -- 172.21.15.114:0/4227470534 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e80a57f0 con 0x7fc7f006d270 2024-09-13T17:52:41.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.931+0000 7fc7ef400640 1 -- 172.21.15.114:0/4227470534 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e80a5950 con 0x7fc7f006d270 2024-09-13T17:52:41.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.931+0000 7fc7ef400640 1 -- 172.21.15.114:0/4227470534 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e80a5ce0 con 0x7fc7f006d270 2024-09-13T17:52:41.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.931+0000 7fc7f6000640 1 -- 172.21.15.114:0/4227470534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7f006d270 msgr2=0x7fc7f006d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:41.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.931+0000 7fc7f6000640 1 --2- 172.21.15.114:0/4227470534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7f006d270 0x7fc7f006d700 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc7f015dcc0 tx=0x7fc7e801c930 comp rx=0 tx=0).stop 2024-09-13T17:52:41.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.931+0000 7fc7f6000640 1 -- 172.21.15.114:0/4227470534 shutdown_connections 2024-09-13T17:52:41.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.931+0000 7fc7f6000640 1 --2- 172.21.15.114:0/4227470534 >> v2:172.21.15.134:3300/0 conn(0x7fc7f00ccb20 0x7fc7f00ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.931+0000 7fc7f6000640 1 --2- 172.21.15.114:0/4227470534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7f006d270 0x7fc7f006d700 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.931+0000 7fc7f6000640 1 -- 172.21.15.114:0/4227470534 >> 172.21.15.114:0/4227470534 conn(0x7fc7f00718f0 msgr2=0x7fc7f0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:41.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.931+0000 7fc7f6000640 1 -- 172.21.15.114:0/4227470534 shutdown_connections 2024-09-13T17:52:41.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.931+0000 7fc7f6000640 1 -- 172.21.15.114:0/4227470534 wait complete. 2024-09-13T17:52:41.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.935+0000 7fc7f6000640 1 Processor -- start 2024-09-13T17:52:41.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.935+0000 7fc7f6000640 1 -- start start 2024-09-13T17:52:41.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.935+0000 7fc7f6000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc7f006d270 0x7fc7f01457e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:41.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.935+0000 7fc7f6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7f00ccb20 0x7fc7f0136340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:41.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.935+0000 7fc7f6000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7f01442a0 0x7fc7f0144730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:41.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.935+0000 7fc7f6000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f014b570 con 0x7fc7f00ccb20 2024-09-13T17:52:41.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.935+0000 7fc7f6000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f014a9d0 con 0x7fc7f01442a0 2024-09-13T17:52:41.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.935+0000 7fc7f6000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f0136880 con 0x7fc7f006d270 2024-09-13T17:52:41.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.935+0000 7fc7efe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7f00ccb20 0x7fc7f0136340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:41.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.935+0000 7fc7f4c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc7f006d270 0x7fc7f01457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:41.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.935+0000 7fc7efe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7f00ccb20 0x7fc7f0136340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50250/0 (socket says 172.21.15.114:50250) 2024-09-13T17:52:41.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.935+0000 7fc7efe00640 1 -- 172.21.15.114:0/3390875264 learned_addr learned my addr 172.21.15.114:0/3390875264 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:41.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.935+0000 7fc7f5600640 1 --2- 172.21.15.114:0/3390875264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7f01442a0 0x7fc7f0144730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:41.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.935+0000 7fc7efe00640 1 -- 172.21.15.114:0/3390875264 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc7f006d270 msgr2=0x7fc7f01457e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:41.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.935+0000 7fc7efe00640 1 --2- 172.21.15.114:0/3390875264 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc7f006d270 0x7fc7f01457e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.935+0000 7fc7efe00640 1 -- 172.21.15.114:0/3390875264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7f01442a0 msgr2=0x7fc7f0144730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:41.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.935+0000 7fc7efe00640 1 --2- 172.21.15.114:0/3390875264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7f01442a0 0x7fc7f0144730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:41.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.935+0000 7fc7efe00640 1 -- 172.21.15.114:0/3390875264 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e8009b30 con 0x7fc7f00ccb20 2024-09-13T17:52:41.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.935+0000 7fc7efe00640 1 --2- 172.21.15.114:0/3390875264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7f00ccb20 0x7fc7f0136340 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc00e8a0 tx=0x7fc7dc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:41.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.935+0000 7fc7ecc00640 1 -- 172.21.15.114:0/3390875264 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc009510 con 0x7fc7f00ccb20 2024-09-13T17:52:41.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.935+0000 7fc7ecc00640 1 -- 172.21.15.114:0/3390875264 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc00c940 con 0x7fc7f00ccb20 2024-09-13T17:52:41.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.935+0000 7fc7f6000640 1 -- 172.21.15.114:0/3390875264 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f0066000 con 0x7fc7f00ccb20 2024-09-13T17:52:41.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.935+0000 7fc7ecc00640 1 -- 172.21.15.114:0/3390875264 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc00ccb0 con 0x7fc7f00ccb20 2024-09-13T17:52:41.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.935+0000 7fc7f6000640 1 -- 172.21.15.114:0/3390875264 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f014af20 con 0x7fc7f00ccb20 2024-09-13T17:52:41.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.939+0000 7fc7f6000640 1 -- 172.21.15.114:0/3390875264 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f006d700 con 0x7fc7f00ccb20 2024-09-13T17:52:41.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.939+0000 7fc7ecc00640 1 -- 172.21.15.114:0/3390875264 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc7dc013470 con 0x7fc7f00ccb20 2024-09-13T17:52:41.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.939+0000 7fc7ecc00640 1 --2- 172.21.15.114:0/3390875264 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc7d0066690 0x7fc7d0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:41.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.939+0000 7fc7ecc00640 1 -- 172.21.15.114:0/3390875264 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc7dc0845d0 con 0x7fc7f00ccb20 2024-09-13T17:52:41.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.939+0000 7fc7f4c00640 1 --2- 172.21.15.114:0/3390875264 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc7d0066690 0x7fc7d0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:41.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.939+0000 7fc7f4c00640 1 --2- 172.21.15.114:0/3390875264 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc7d0066690 0x7fc7d0068b50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0156350 tx=0x7fc7e0007e40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:41.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:41.943+0000 7fc7ecc00640 1 -- 172.21.15.114:0/3390875264 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc7dc051620 con 0x7fc7f00ccb20 2024-09-13T17:52:42.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.103+0000 7fc7f6000640 1 -- 172.21.15.114:0/3390875264 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc7f006b7a0 con 0x7fc7f00ccb20 2024-09-13T17:52:42.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.103+0000 7fc7ecc00640 1 -- 172.21.15.114:0/3390875264 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc7dc054c40 con 0x7fc7f00ccb20 2024-09-13T17:52:42.109 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:52:42.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.107+0000 7fc7f6000640 1 -- 172.21.15.114:0/3390875264 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc7d0066690 msgr2=0x7fc7d0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:42.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.107+0000 7fc7f6000640 1 --2- 172.21.15.114:0/3390875264 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc7d0066690 0x7fc7d0068b50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0156350 tx=0x7fc7e0007e40 comp rx=0 tx=0).stop 2024-09-13T17:52:42.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.107+0000 7fc7f6000640 1 -- 172.21.15.114:0/3390875264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7f00ccb20 msgr2=0x7fc7f0136340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:42.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.107+0000 7fc7f6000640 1 --2- 172.21.15.114:0/3390875264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7f00ccb20 0x7fc7f0136340 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc00e8a0 tx=0x7fc7dc00eca0 comp rx=0 tx=0).stop 2024-09-13T17:52:42.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.107+0000 7fc7f6000640 1 -- 172.21.15.114:0/3390875264 shutdown_connections 2024-09-13T17:52:42.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.107+0000 7fc7f6000640 1 --2- 172.21.15.114:0/3390875264 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc7d0066690 0x7fc7d0068b50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:42.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.107+0000 7fc7f6000640 1 --2- 172.21.15.114:0/3390875264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7f01442a0 0x7fc7f0144730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:42.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.107+0000 7fc7f6000640 1 --2- 172.21.15.114:0/3390875264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7f00ccb20 0x7fc7f0136340 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:42.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.107+0000 7fc7f6000640 1 --2- 172.21.15.114:0/3390875264 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc7f006d270 0x7fc7f01457e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:42.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.107+0000 7fc7f6000640 1 -- 172.21.15.114:0/3390875264 >> 172.21.15.114:0/3390875264 conn(0x7fc7f00718f0 msgr2=0x7fc7f0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:42.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.107+0000 7fc7f6000640 1 -- 172.21.15.114:0/3390875264 shutdown_connections 2024-09-13T17:52:42.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.107+0000 7fc7f6000640 1 -- 172.21.15.114:0/3390875264 wait complete. 2024-09-13T17:52:42.130 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple' 2024-09-13T17:52:42.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.259+0000 7f2446c00640 1 Processor -- start 2024-09-13T17:52:42.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.259+0000 7f2446c00640 1 -- start start 2024-09-13T17:52:42.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.263+0000 7f2446c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f244013f420 0x7f244006d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:42.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.263+0000 7f2446c00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f244006da90 0x7f24400cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:42.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.263+0000 7f2446c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24400cd220 con 0x7f244013c240 2024-09-13T17:52:42.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.263+0000 7f2446c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f244006df40 con 0x7f244013f420 2024-09-13T17:52:42.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.263+0000 7f2446c00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f244015a740 con 0x7f244006da90 2024-09-13T17:52:42.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.263+0000 7f2437400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f244013f420 0x7f244006d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:42.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.263+0000 7f2437400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f244013f420 0x7f244006d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50260/0 (socket says 172.21.15.114:50260) 2024-09-13T17:52:42.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.263+0000 7f2437400640 1 -- 172.21.15.114:0/3663810472 learned_addr learned my addr 172.21.15.114:0/3663810472 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:42.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.263+0000 7f243fe00640 1 --1- 172.21.15.114:0/3663810472 >> v1:172.21.15.114:6789/0 conn(0x7f244013c240 0x7f244013c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46554/0 (socket says 172.21.15.114:46554) 2024-09-13T17:52:42.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.263+0000 7f2444c00640 1 --2- 172.21.15.114:0/3663810472 >> v2:172.21.15.134:3300/0 conn(0x7f244006da90 0x7f24400cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:42.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.263+0000 7f2437400640 1 -- 172.21.15.114:0/3663810472 >> v2:172.21.15.134:3300/0 conn(0x7f244006da90 msgr2=0x7f24400cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:42.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.263+0000 7f2437400640 1 --2- 172.21.15.114:0/3663810472 >> v2:172.21.15.134:3300/0 conn(0x7f244006da90 0x7f24400cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:42.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.263+0000 7f2437400640 1 -- 172.21.15.114:0/3663810472 >> v1:172.21.15.114:6789/0 conn(0x7f244013c240 legacy=0x7f244013c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:42.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.263+0000 7f2437400640 1 -- 172.21.15.114:0/3663810472 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2440159bc0 con 0x7f244013f420 2024-09-13T17:52:42.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.263+0000 7f2444c00640 1 --2- 172.21.15.114:0/3663810472 >> v2:172.21.15.134:3300/0 conn(0x7f244006da90 0x7f24400cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:52:42.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.267+0000 7f2437400640 1 --2- 172.21.15.114:0/3663810472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f244013f420 0x7f244006d550 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f24400cc4f0 tx=0x7f242801ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d053d4cd1e2e126 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:42.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.267+0000 7f243f400640 1 -- 172.21.15.114:0/3663810472 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24280a7c90 con 0x7f244013f420 2024-09-13T17:52:42.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.267+0000 7f243f400640 1 -- 172.21.15.114:0/3663810472 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24280a7df0 con 0x7f244013f420 2024-09-13T17:52:42.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.267+0000 7f243f400640 1 -- 172.21.15.114:0/3663810472 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24280af660 con 0x7f244013f420 2024-09-13T17:52:42.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.267+0000 7f2446c00640 1 -- 172.21.15.114:0/3663810472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f244013f420 msgr2=0x7f244006d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:42.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.267+0000 7f2446c00640 1 --2- 172.21.15.114:0/3663810472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f244013f420 0x7f244006d550 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f24400cc4f0 tx=0x7f242801ebc0 comp rx=0 tx=0).stop 2024-09-13T17:52:42.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.267+0000 7f2446c00640 1 -- 172.21.15.114:0/3663810472 shutdown_connections 2024-09-13T17:52:42.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.267+0000 7f2446c00640 1 --2- 172.21.15.114:0/3663810472 >> v2:172.21.15.134:3300/0 conn(0x7f244006da90 0x7f24400cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:42.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.267+0000 7f2446c00640 1 --2- 172.21.15.114:0/3663810472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f244013f420 0x7f244006d550 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:42.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.267+0000 7f2446c00640 1 -- 172.21.15.114:0/3663810472 >> 172.21.15.114:0/3663810472 conn(0x7f24400660b0 msgr2=0x7f2440069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:42.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.267+0000 7f2446c00640 1 -- 172.21.15.114:0/3663810472 shutdown_connections 2024-09-13T17:52:42.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.267+0000 7f2446c00640 1 -- 172.21.15.114:0/3663810472 wait complete. 2024-09-13T17:52:42.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.267+0000 7f2446c00640 1 Processor -- start 2024-09-13T17:52:42.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.267+0000 7f2446c00640 1 -- start start 2024-09-13T17:52:42.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.271+0000 7f2446c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f244006da90 0x7f24400b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:42.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.271+0000 7f2446c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f244013c240 0x7f2440156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:42.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.271+0000 7f2446c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f244013f420 0x7f244013db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:42.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.271+0000 7f2446c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244013c830 con 0x7f244013f420 2024-09-13T17:52:42.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.271+0000 7f2446c00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244014da00 con 0x7f244006da90 2024-09-13T17:52:42.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.271+0000 7f2446c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244013ca80 con 0x7f244013c240 2024-09-13T17:52:42.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.271+0000 7f2444c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f244013f420 0x7f244013db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:42.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.271+0000 7f2444c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f244013f420 0x7f244013db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50268/0 (socket says 172.21.15.114:50268) 2024-09-13T17:52:42.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.271+0000 7f2444c00640 1 -- 172.21.15.114:0/1911863456 learned_addr learned my addr 172.21.15.114:0/1911863456 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:42.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.271+0000 7f243fe00640 1 --2- 172.21.15.114:0/1911863456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f244006da90 0x7f24400b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:42.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.271+0000 7f2437400640 1 --2- 172.21.15.114:0/1911863456 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f244013c240 0x7f2440156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:42.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.271+0000 7f2444c00640 1 -- 172.21.15.114:0/1911863456 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f244013c240 msgr2=0x7f2440156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:42.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.271+0000 7f2444c00640 1 --2- 172.21.15.114:0/1911863456 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f244013c240 0x7f2440156ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:42.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.271+0000 7f2444c00640 1 -- 172.21.15.114:0/1911863456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f244006da90 msgr2=0x7f24400b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:42.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.271+0000 7f2444c00640 1 --2- 172.21.15.114:0/1911863456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f244006da90 0x7f24400b0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:42.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.271+0000 7f2444c00640 1 -- 172.21.15.114:0/1911863456 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242800b770 con 0x7f244013f420 2024-09-13T17:52:42.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.271+0000 7f243fe00640 1 --2- 172.21.15.114:0/1911863456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f244006da90 0x7f24400b0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:52:42.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.271+0000 7f2444c00640 1 --2- 172.21.15.114:0/1911863456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f244013f420 0x7f244013db20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f243800c7f0 tx=0x7f243800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:42.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.271+0000 7f243cc00640 1 -- 172.21.15.114:0/1911863456 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438007820 con 0x7f244013f420 2024-09-13T17:52:42.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.271+0000 7f243cc00640 1 -- 172.21.15.114:0/1911863456 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24380079c0 con 0x7f244013f420 2024-09-13T17:52:42.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.271+0000 7f243cc00640 1 -- 172.21.15.114:0/1911863456 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438007d70 con 0x7f244013f420 2024-09-13T17:52:42.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.271+0000 7f2446c00640 1 -- 172.21.15.114:0/1911863456 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f244013cd60 con 0x7f244013f420 2024-09-13T17:52:42.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.271+0000 7f2446c00640 1 -- 172.21.15.114:0/1911863456 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f244013d320 con 0x7f244013f420 2024-09-13T17:52:42.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.271+0000 7f2446c00640 1 -- 172.21.15.114:0/1911863456 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2440159790 con 0x7f244013f420 2024-09-13T17:52:42.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.271+0000 7f243cc00640 1 -- 172.21.15.114:0/1911863456 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f24380113f0 con 0x7f244013f420 2024-09-13T17:52:42.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.275+0000 7f243cc00640 1 --2- 172.21.15.114:0/1911863456 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f241c066690 0x7f241c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:42.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.275+0000 7f243cc00640 1 -- 172.21.15.114:0/1911863456 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2438084930 con 0x7f244013f420 2024-09-13T17:52:42.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.275+0000 7f243fe00640 1 --2- 172.21.15.114:0/1911863456 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f241c066690 0x7f241c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:42.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.275+0000 7f243fe00640 1 --2- 172.21.15.114:0/1911863456 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f241c066690 0x7f241c068b50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f24300012f0 tx=0x7f2430001700 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:42.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.279+0000 7f243cc00640 1 -- 172.21.15.114:0/1911863456 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f24380518f0 con 0x7f244013f420 2024-09-13T17:52:42.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:42.483+0000 7f2446c00640 1 -- 172.21.15.114:0/1911863456 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple"]} v 0) v1 -- 0x7f24400b0fe0 con 0x7f244013f420 2024-09-13T17:52:43.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.195+0000 7f243cc00640 1 -- 172.21.15.114:0/1911863456 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple"]}]=0 v75) v1 ==== 150+0+0 (secure 0 0 0) 0x7f2438054f10 con 0x7f244013f420 2024-09-13T17:52:43.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.195+0000 7f2446c00640 1 -- 172.21.15.114:0/1911863456 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f241c066690 msgr2=0x7f241c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:43.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.195+0000 7f2446c00640 1 --2- 172.21.15.114:0/1911863456 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f241c066690 0x7f241c068b50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f24300012f0 tx=0x7f2430001700 comp rx=0 tx=0).stop 2024-09-13T17:52:43.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.195+0000 7f2446c00640 1 -- 172.21.15.114:0/1911863456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f244013f420 msgr2=0x7f244013db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:43.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.195+0000 7f2446c00640 1 --2- 172.21.15.114:0/1911863456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f244013f420 0x7f244013db20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f243800c7f0 tx=0x7f243800ccb0 comp rx=0 tx=0).stop 2024-09-13T17:52:43.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.195+0000 7f2446c00640 1 -- 172.21.15.114:0/1911863456 shutdown_connections 2024-09-13T17:52:43.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.195+0000 7f2446c00640 1 --2- 172.21.15.114:0/1911863456 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f241c066690 0x7f241c068b50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:43.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.195+0000 7f2446c00640 1 --2- 172.21.15.114:0/1911863456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f244013f420 0x7f244013db20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:43.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.195+0000 7f2446c00640 1 --2- 172.21.15.114:0/1911863456 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f244013c240 0x7f2440156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:43.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.195+0000 7f2446c00640 1 --2- 172.21.15.114:0/1911863456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f244006da90 0x7f24400b0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:43.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.195+0000 7f2446c00640 1 -- 172.21.15.114:0/1911863456 >> 172.21.15.114:0/1911863456 conn(0x7f24400660b0 msgr2=0x7f244013a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:43.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.195+0000 7f2446c00640 1 -- 172.21.15.114:0/1911863456 shutdown_connections 2024-09-13T17:52:43.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.195+0000 7f2446c00640 1 -- 172.21.15.114:0/1911863456 wait complete. 2024-09-13T17:52:43.221 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T17:52:43.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.355+0000 7fccec200640 1 Processor -- start 2024-09-13T17:52:43.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.355+0000 7fccec200640 1 -- start start 2024-09-13T17:52:43.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.355+0000 7fccec200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcce4070420 0x7fcce4070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:43.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.355+0000 7fccec200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcce406c540 0x7fcce406c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:43.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.355+0000 7fccec200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce4151800 con 0x7fcce4151420 2024-09-13T17:52:43.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.355+0000 7fccec200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce40cbc30 con 0x7fcce4070420 2024-09-13T17:52:43.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.355+0000 7fccec200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce4070dd0 con 0x7fcce406c540 2024-09-13T17:52:43.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.355+0000 7fcce8e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcce4070420 0x7fcce4070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:43.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.359+0000 7fcce8e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcce4070420 0x7fcce4070890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50284/0 (socket says 172.21.15.114:50284) 2024-09-13T17:52:43.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.359+0000 7fcce8e00640 1 -- 172.21.15.114:0/3880730453 learned_addr learned my addr 172.21.15.114:0/3880730453 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:43.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.359+0000 7fcce9800640 1 --1- 172.21.15.114:0/3880730453 >> v1:172.21.15.114:6789/0 conn(0x7fcce4151420 0x7fcce40cc660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46570/0 (socket says 172.21.15.114:46570) 2024-09-13T17:52:43.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.359+0000 7fccea200640 1 --2- 172.21.15.114:0/3880730453 >> v2:172.21.15.134:3300/0 conn(0x7fcce406c540 0x7fcce406c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:43.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.359+0000 7fcce8e00640 1 -- 172.21.15.114:0/3880730453 >> v2:172.21.15.134:3300/0 conn(0x7fcce406c540 msgr2=0x7fcce406c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:43.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.359+0000 7fcce8e00640 1 --2- 172.21.15.114:0/3880730453 >> v2:172.21.15.134:3300/0 conn(0x7fcce406c540 0x7fcce406c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:43.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.359+0000 7fcce8e00640 1 -- 172.21.15.114:0/3880730453 >> v1:172.21.15.114:6789/0 conn(0x7fcce4151420 legacy=0x7fcce40cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:43.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.359+0000 7fcce8e00640 1 -- 172.21.15.114:0/3880730453 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce40cafb0 con 0x7fcce4070420 2024-09-13T17:52:43.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.359+0000 7fcce8e00640 1 --2- 172.21.15.114:0/3880730453 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcce4070420 0x7fcce4070890 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcce406dbf0 tx=0x7fccd001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f97607938208217 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:43.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.359+0000 7fcce3e00640 1 -- 172.21.15.114:0/3880730453 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd00ac630 con 0x7fcce4070420 2024-09-13T17:52:43.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.359+0000 7fcce3e00640 1 -- 172.21.15.114:0/3880730453 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd00ac790 con 0x7fcce4070420 2024-09-13T17:52:43.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.359+0000 7fcce3e00640 1 -- 172.21.15.114:0/3880730453 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd00acb20 con 0x7fcce4070420 2024-09-13T17:52:43.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.363+0000 7fccec200640 1 -- 172.21.15.114:0/3880730453 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcce4070420 msgr2=0x7fcce4070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:43.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.363+0000 7fccec200640 1 --2- 172.21.15.114:0/3880730453 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcce4070420 0x7fcce4070890 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcce406dbf0 tx=0x7fccd001c3d0 comp rx=0 tx=0).stop 2024-09-13T17:52:43.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.363+0000 7fccec200640 1 -- 172.21.15.114:0/3880730453 shutdown_connections 2024-09-13T17:52:43.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.363+0000 7fccec200640 1 --2- 172.21.15.114:0/3880730453 >> v2:172.21.15.134:3300/0 conn(0x7fcce406c540 0x7fcce406c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:43.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.363+0000 7fccec200640 1 --2- 172.21.15.114:0/3880730453 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcce4070420 0x7fcce4070890 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:43.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.363+0000 7fccec200640 1 -- 172.21.15.114:0/3880730453 >> 172.21.15.114:0/3880730453 conn(0x7fcce40660b0 msgr2=0x7fcce4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:43.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.363+0000 7fccec200640 1 -- 172.21.15.114:0/3880730453 shutdown_connections 2024-09-13T17:52:43.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.363+0000 7fccec200640 1 -- 172.21.15.114:0/3880730453 wait complete. 2024-09-13T17:52:43.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.363+0000 7fccec200640 1 Processor -- start 2024-09-13T17:52:43.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.363+0000 7fccec200640 1 -- start start 2024-09-13T17:52:43.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.363+0000 7fccec200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcce406c540 0x7fcce4147270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:43.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.363+0000 7fccec200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcce4070420 0x7fcce4145d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:43.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.363+0000 7fccec200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcce4151420 0x7fcce4142000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:43.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.363+0000 7fccec200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce4146540 con 0x7fcce4070420 2024-09-13T17:52:43.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.363+0000 7fccec200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce4146280 con 0x7fcce406c540 2024-09-13T17:52:43.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.363+0000 7fccec200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce4147df0 con 0x7fcce4151420 2024-09-13T17:52:43.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.363+0000 7fcce8e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcce4070420 0x7fcce4145d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:43.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.363+0000 7fcce8e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcce4070420 0x7fcce4145d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50294/0 (socket says 172.21.15.114:50294) 2024-09-13T17:52:43.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.363+0000 7fcce8e00640 1 -- 172.21.15.114:0/1839782208 learned_addr learned my addr 172.21.15.114:0/1839782208 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:43.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.363+0000 7fcce9800640 1 --2- 172.21.15.114:0/1839782208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcce406c540 0x7fcce4147270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:43.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.363+0000 7fccea200640 1 --2- 172.21.15.114:0/1839782208 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcce4151420 0x7fcce4142000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:43.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.363+0000 7fcce8e00640 1 -- 172.21.15.114:0/1839782208 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcce4151420 msgr2=0x7fcce4142000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:43.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.363+0000 7fcce8e00640 1 --2- 172.21.15.114:0/1839782208 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcce4151420 0x7fcce4142000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:43.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.363+0000 7fcce8e00640 1 -- 172.21.15.114:0/1839782208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcce406c540 msgr2=0x7fcce4147270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:43.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.363+0000 7fcce8e00640 1 --2- 172.21.15.114:0/1839782208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcce406c540 0x7fcce4147270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:43.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.363+0000 7fcce8e00640 1 -- 172.21.15.114:0/1839782208 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd00094d0 con 0x7fcce4070420 2024-09-13T17:52:43.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.363+0000 7fcce8e00640 1 --2- 172.21.15.114:0/1839782208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcce4070420 0x7fcce4145d40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fccd00af040 tx=0x7fccd0019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:43.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.367+0000 7fcce1600640 1 -- 172.21.15.114:0/1839782208 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd00b5640 con 0x7fcce4070420 2024-09-13T17:52:43.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.367+0000 7fcce1600640 1 -- 172.21.15.114:0/1839782208 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd00b57a0 con 0x7fcce4070420 2024-09-13T17:52:43.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.367+0000 7fccec200640 1 -- 172.21.15.114:0/1839782208 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce414f8a0 con 0x7fcce4070420 2024-09-13T17:52:43.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.367+0000 7fcce1600640 1 -- 172.21.15.114:0/1839782208 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd00b5b50 con 0x7fcce4070420 2024-09-13T17:52:43.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.367+0000 7fccec200640 1 -- 172.21.15.114:0/1839782208 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce4146a70 con 0x7fcce4070420 2024-09-13T17:52:43.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.367+0000 7fccec200640 1 -- 172.21.15.114:0/1839782208 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce406c970 con 0x7fcce4070420 2024-09-13T17:52:43.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.367+0000 7fcce1600640 1 -- 172.21.15.114:0/1839782208 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fccd00b3070 con 0x7fcce4070420 2024-09-13T17:52:43.372 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:52:43.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.367+0000 7fcce1600640 1 --2- 172.21.15.114:0/1839782208 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fccc40666c0 0x7fccc4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:43.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.367+0000 7fcce1600640 1 -- 172.21.15.114:0/1839782208 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fccd011e560 con 0x7fcce4070420 2024-09-13T17:52:43.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.367+0000 7fcce9800640 1 --2- 172.21.15.114:0/1839782208 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fccc40666c0 0x7fccc4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:43.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.367+0000 7fcce9800640 1 --2- 172.21.15.114:0/1839782208 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fccc40666c0 0x7fccc4068b80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fccd8000f70 tx=0x7fccd8007c30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:43.376 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:52:43.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.371+0000 7fcce1600640 1 -- 172.21.15.114:0/1839782208 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fccd00eb500 con 0x7fcce4070420 2024-09-13T17:52:43.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.531+0000 7fccec200640 1 -- 172.21.15.114:0/1839782208 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fcce4164110 con 0x7fcce4070420 2024-09-13T17:52:43.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.535+0000 7fcce1600640 1 -- 172.21.15.114:0/1839782208 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fccd00eeb20 con 0x7fcce4070420 2024-09-13T17:52:43.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.535+0000 7fccec200640 1 -- 172.21.15.114:0/1839782208 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fccc40666c0 msgr2=0x7fccc4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:43.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.535+0000 7fccec200640 1 --2- 172.21.15.114:0/1839782208 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fccc40666c0 0x7fccc4068b80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fccd8000f70 tx=0x7fccd8007c30 comp rx=0 tx=0).stop 2024-09-13T17:52:43.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.535+0000 7fccec200640 1 -- 172.21.15.114:0/1839782208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcce4070420 msgr2=0x7fcce4145d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:43.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.535+0000 7fccec200640 1 --2- 172.21.15.114:0/1839782208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcce4070420 0x7fcce4145d40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fccd00af040 tx=0x7fccd0019170 comp rx=0 tx=0).stop 2024-09-13T17:52:43.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.535+0000 7fccec200640 1 -- 172.21.15.114:0/1839782208 shutdown_connections 2024-09-13T17:52:43.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.535+0000 7fccec200640 1 --2- 172.21.15.114:0/1839782208 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fccc40666c0 0x7fccc4068b80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:43.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.535+0000 7fccec200640 1 --2- 172.21.15.114:0/1839782208 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcce4151420 0x7fcce4142000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:43.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.535+0000 7fccec200640 1 --2- 172.21.15.114:0/1839782208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcce4070420 0x7fcce4145d40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:43.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.535+0000 7fccec200640 1 --2- 172.21.15.114:0/1839782208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcce406c540 0x7fcce4147270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:43.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.535+0000 7fccec200640 1 -- 172.21.15.114:0/1839782208 >> 172.21.15.114:0/1839782208 conn(0x7fcce40660b0 msgr2=0x7fcce40cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:43.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.535+0000 7fccec200640 1 -- 172.21.15.114:0/1839782208 shutdown_connections 2024-09-13T17:52:43.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:43.535+0000 7fccec200640 1 -- 172.21.15.114:0/1839782208 wait complete. 2024-09-13T17:52:43.559 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T17:52:43.560 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:52:43.684 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:52:43.772 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T17:52:43.773 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:52:43.773 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:52:43.782 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:52:43.782 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:52:43.838 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:52:43.838 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:52:43.889 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:52:44.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.071+0000 7ffad7e00640 1 Processor -- start 2024-09-13T17:52:44.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.071+0000 7ffad7e00640 1 -- start start 2024-09-13T17:52:44.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.071+0000 7ffad7e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ffad80b4ab0 0x7ffad80ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:44.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.071+0000 7ffad7e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffad80cada0 0x7ffad80cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:44.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.071+0000 7ffad7e00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad8099d70 con 0x7ffad815a4a0 2024-09-13T17:52:44.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.071+0000 7ffad7e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad80997b0 con 0x7ffad80b4ab0 2024-09-13T17:52:44.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.071+0000 7ffad7e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad8099a90 con 0x7ffad80cada0 2024-09-13T17:52:44.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.071+0000 7fface000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ffad80b4ab0 0x7ffad80ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:44.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.071+0000 7fface000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ffad80b4ab0 0x7ffad80ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50304/0 (socket says 172.21.15.114:50304) 2024-09-13T17:52:44.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.071+0000 7fface000640 1 -- 172.21.15.114:0/3735778748 learned_addr learned my addr 172.21.15.114:0/3735778748 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:44.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.071+0000 7fface000640 1 -- 172.21.15.114:0/3735778748 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffad80cada0 msgr2=0x7ffad80cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:44.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.071+0000 7ffad7400640 1 --2- 172.21.15.114:0/3735778748 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffad80cada0 0x7ffad80cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:44.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.071+0000 7fface000640 1 --2- 172.21.15.114:0/3735778748 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffad80cada0 0x7ffad80cb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.071+0000 7fface000640 1 -- 172.21.15.114:0/3735778748 >> v1:172.21.15.134:6789/0 conn(0x7ffad815a4a0 legacy=0x7ffad80ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:44.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.071+0000 7fface000640 1 -- 172.21.15.114:0/3735778748 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad80b32a0 con 0x7ffad80b4ab0 2024-09-13T17:52:44.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.071+0000 7ffad7400640 1 --2- 172.21.15.114:0/3735778748 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffad80cada0 0x7ffad80cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:52:44.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.075+0000 7fface000640 1 --2- 172.21.15.114:0/3735778748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffad80b4ab0 0x7ffad80ce940 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffac0009870 tx=0x7ffac001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97213029ab3fd0b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:44.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.075+0000 7ffad6000640 1 -- 172.21.15.114:0/3735778748 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac00ab650 con 0x7ffad80b4ab0 2024-09-13T17:52:44.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.075+0000 7ffad6000640 1 -- 172.21.15.114:0/3735778748 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac00ab7b0 con 0x7ffad80b4ab0 2024-09-13T17:52:44.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.075+0000 7ffad6000640 1 -- 172.21.15.114:0/3735778748 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac00abb40 con 0x7ffad80b4ab0 2024-09-13T17:52:44.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.075+0000 7ffad7e00640 1 -- 172.21.15.114:0/3735778748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffad80b4ab0 msgr2=0x7ffad80ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:44.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.075+0000 7ffad7e00640 1 --2- 172.21.15.114:0/3735778748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffad80b4ab0 0x7ffad80ce940 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffac0009870 tx=0x7ffac001c4f0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.075+0000 7ffad7e00640 1 -- 172.21.15.114:0/3735778748 shutdown_connections 2024-09-13T17:52:44.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.075+0000 7ffad7e00640 1 --2- 172.21.15.114:0/3735778748 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffad80cada0 0x7ffad80cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.075+0000 7ffad7e00640 1 --2- 172.21.15.114:0/3735778748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffad80b4ab0 0x7ffad80ce940 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.075+0000 7ffad7e00640 1 -- 172.21.15.114:0/3735778748 >> 172.21.15.114:0/3735778748 conn(0x7ffad80d0330 msgr2=0x7ffad80d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:44.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.075+0000 7ffad7e00640 1 -- 172.21.15.114:0/3735778748 shutdown_connections 2024-09-13T17:52:44.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.075+0000 7ffad7e00640 1 -- 172.21.15.114:0/3735778748 wait complete. 2024-09-13T17:52:44.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.075+0000 7ffad7e00640 1 Processor -- start 2024-09-13T17:52:44.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.075+0000 7ffad7e00640 1 -- start start 2024-09-13T17:52:44.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.079+0000 7ffad7e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad80b4ab0 0x7ffad81f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:44.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.079+0000 7ffad7e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffad80cada0 0x7ffad8159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:44.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.079+0000 7ffad7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffad815a4a0 0x7ffad806c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:44.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.079+0000 7ffad7e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad80c9f00 con 0x7ffad815a4a0 2024-09-13T17:52:44.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.079+0000 7ffad7e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad80c92f0 con 0x7ffad80b4ab0 2024-09-13T17:52:44.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.079+0000 7ffad7e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad80c95d0 con 0x7ffad80cada0 2024-09-13T17:52:44.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.079+0000 7ffad7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffad815a4a0 0x7ffad806c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:44.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.079+0000 7ffad7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffad815a4a0 0x7ffad806c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50320/0 (socket says 172.21.15.114:50320) 2024-09-13T17:52:44.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.079+0000 7ffad7400640 1 -- 172.21.15.114:0/1045943229 learned_addr learned my addr 172.21.15.114:0/1045943229 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:44.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.079+0000 7ffad6a00640 1 --2- 172.21.15.114:0/1045943229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad80b4ab0 0x7ffad81f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:44.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.079+0000 7fface000640 1 --2- 172.21.15.114:0/1045943229 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffad80cada0 0x7ffad8159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:44.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.079+0000 7ffad7400640 1 -- 172.21.15.114:0/1045943229 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffad80cada0 msgr2=0x7ffad8159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:44.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.079+0000 7ffad7400640 1 --2- 172.21.15.114:0/1045943229 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffad80cada0 0x7ffad8159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.079+0000 7ffad7400640 1 -- 172.21.15.114:0/1045943229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad80b4ab0 msgr2=0x7ffad81f4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:44.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.079+0000 7ffad7400640 1 --2- 172.21.15.114:0/1045943229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad80b4ab0 0x7ffad81f4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.079+0000 7ffad7400640 1 -- 172.21.15.114:0/1045943229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac00094d0 con 0x7ffad815a4a0 2024-09-13T17:52:44.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.079+0000 7ffad7400640 1 --2- 172.21.15.114:0/1045943229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffad815a4a0 0x7ffad806c210 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ffad000c7f0 tx=0x7ffad000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:44.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.079+0000 7ffacf400640 1 -- 172.21.15.114:0/1045943229 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad0004230 con 0x7ffad815a4a0 2024-09-13T17:52:44.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.079+0000 7ffacf400640 1 -- 172.21.15.114:0/1045943229 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad00043b0 con 0x7ffad815a4a0 2024-09-13T17:52:44.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.079+0000 7ffad7e00640 1 -- 172.21.15.114:0/1045943229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad80c98b0 con 0x7ffad815a4a0 2024-09-13T17:52:44.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.079+0000 7ffacf400640 1 -- 172.21.15.114:0/1045943229 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad0003860 con 0x7ffad815a4a0 2024-09-13T17:52:44.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.079+0000 7ffad7e00640 1 -- 172.21.15.114:0/1045943229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad81f4aa0 con 0x7ffad815a4a0 2024-09-13T17:52:44.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.079+0000 7ffad7e00640 1 -- 172.21.15.114:0/1045943229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad80ca070 con 0x7ffad815a4a0 2024-09-13T17:52:44.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.079+0000 7ffacf400640 1 -- 172.21.15.114:0/1045943229 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffad0003bd0 con 0x7ffad815a4a0 2024-09-13T17:52:44.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.083+0000 7ffacf400640 1 --2- 172.21.15.114:0/1045943229 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ffab4066690 0x7ffab4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:44.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.083+0000 7ffacf400640 1 -- 172.21.15.114:0/1045943229 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffad0084920 con 0x7ffad815a4a0 2024-09-13T17:52:44.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.083+0000 7ffad6a00640 1 --2- 172.21.15.114:0/1045943229 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ffab4066690 0x7ffab4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:44.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.083+0000 7ffad6a00640 1 --2- 172.21.15.114:0/1045943229 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ffab4066690 0x7ffab4068b50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffac800b450 tx=0x7ffac800d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:44.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.087+0000 7ffacf400640 1 -- 172.21.15.114:0/1045943229 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffad00518e0 con 0x7ffad815a4a0 2024-09-13T17:52:44.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.243+0000 7ffad7e00640 1 -- 172.21.15.114:0/1045943229 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffad80cb230 con 0x7ffad815a4a0 2024-09-13T17:52:44.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.243+0000 7ffacf400640 1 -- 172.21.15.114:0/1045943229 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18784 (secure 0 0 0) 0x7ffad0054f00 con 0x7ffad815a4a0 2024-09-13T17:52:44.247 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:44.247 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:52:31.139000+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:51:48.278220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:51:48.773888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:51:51.856300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:52:44.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.243+0000 7ffad7e00640 1 -- 172.21.15.114:0/1045943229 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ffab4066690 msgr2=0x7ffab4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:44.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.243+0000 7ffad7e00640 1 --2- 172.21.15.114:0/1045943229 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ffab4066690 0x7ffab4068b50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffac800b450 tx=0x7ffac800d040 comp rx=0 tx=0).stop 2024-09-13T17:52:44.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.243+0000 7ffad7e00640 1 -- 172.21.15.114:0/1045943229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffad815a4a0 msgr2=0x7ffad806c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:44.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.243+0000 7ffad7e00640 1 --2- 172.21.15.114:0/1045943229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffad815a4a0 0x7ffad806c210 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ffad000c7f0 tx=0x7ffad000ccb0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.243+0000 7ffad7e00640 1 -- 172.21.15.114:0/1045943229 shutdown_connections 2024-09-13T17:52:44.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.243+0000 7ffad7e00640 1 --2- 172.21.15.114:0/1045943229 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ffab4066690 0x7ffab4068b50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.243+0000 7ffad7e00640 1 --2- 172.21.15.114:0/1045943229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffad815a4a0 0x7ffad806c210 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.243+0000 7ffad7e00640 1 --2- 172.21.15.114:0/1045943229 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffad80cada0 0x7ffad8159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.243+0000 7ffad7e00640 1 --2- 172.21.15.114:0/1045943229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad80b4ab0 0x7ffad81f4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.243+0000 7ffad7e00640 1 -- 172.21.15.114:0/1045943229 >> 172.21.15.114:0/1045943229 conn(0x7ffad80d0330 msgr2=0x7ffad806f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:44.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.243+0000 7ffad7e00640 1 -- 172.21.15.114:0/1045943229 shutdown_connections 2024-09-13T17:52:44.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.243+0000 7ffad7e00640 1 -- 172.21.15.114:0/1045943229 wait complete. 2024-09-13T17:52:44.268 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:51:37.996254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:51:48.278220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:51:48.773888+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:51:51.856300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:52:44.269 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:52:44.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.403+0000 7f5edc800640 1 Processor -- start 2024-09-13T17:52:44.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.403+0000 7f5edc800640 1 -- start start 2024-09-13T17:52:44.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.403+0000 7f5edc800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5ed413c240 0x7f5ed413f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:44.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.403+0000 7f5edc800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed40cd220 con 0x7f5ed406dc60 2024-09-13T17:52:44.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.403+0000 7f5edc800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed413f960 con 0x7f5ed413c980 2024-09-13T17:52:44.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.403+0000 7f5edc800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed415a740 con 0x7f5ed413c240 2024-09-13T17:52:44.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.403+0000 7f5eda800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5ed406dc60 0x7f5ed40cd650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46576/0 (socket says 172.21.15.114:46576) 2024-09-13T17:52:44.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.403+0000 7f5eda800640 1 -- 172.21.15.114:0/3336812440 learned_addr learned my addr 172.21.15.114:0/3336812440 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:44.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.403+0000 7f5ed9e00640 1 --2- 172.21.15.114:0/3336812440 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5ed413c240 0x7f5ed413f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:44.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.407+0000 7f5ed8a00640 1 -- 172.21.15.114:0/3336812440 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1483208059 0 0) 0x7f5ed40cd220 con 0x7f5ed406dc60 2024-09-13T17:52:44.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.407+0000 7f5ed8a00640 1 -- 172.21.15.114:0/3336812440 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ebc003530 con 0x7f5ed406dc60 2024-09-13T17:52:44.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.407+0000 7f5ed8a00640 1 -- 172.21.15.114:0/3336812440 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 805500549 0 0) 0x7f5ec4001120 con 0x7f5ed413c980 2024-09-13T17:52:44.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.407+0000 7f5ed8a00640 1 -- 172.21.15.114:0/3336812440 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ed40cd220 con 0x7f5ed413c980 2024-09-13T17:52:44.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.407+0000 7f5ed9e00640 1 -- 172.21.15.114:0/3336812440 >> v1:172.21.15.134:6789/0 conn(0x7f5ed413c980 legacy=0x7f5ed406d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:44.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.407+0000 7f5ed9e00640 1 -- 172.21.15.114:0/3336812440 >> v1:172.21.15.114:6789/0 conn(0x7f5ed406dc60 legacy=0x7f5ed40cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:44.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.407+0000 7f5ed9e00640 1 -- 172.21.15.114:0/3336812440 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed4159bc0 con 0x7f5ed413c240 2024-09-13T17:52:44.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.407+0000 7f5ed9e00640 1 --2- 172.21.15.114:0/3336812440 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5ed413c240 0x7f5ed413f420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5ec80097f0 tx=0x7f5ec801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68552a4b3d444df1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:44.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.407+0000 7f5ed8a00640 1 -- 172.21.15.114:0/3336812440 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec80ac410 con 0x7f5ed413c240 2024-09-13T17:52:44.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.407+0000 7f5ed8a00640 1 -- 172.21.15.114:0/3336812440 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec80ac570 con 0x7f5ed413c240 2024-09-13T17:52:44.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.407+0000 7f5ed8a00640 1 -- 172.21.15.114:0/3336812440 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec80ac900 con 0x7f5ed413c240 2024-09-13T17:52:44.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.407+0000 7f5edc800640 1 -- 172.21.15.114:0/3336812440 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5ed413c240 msgr2=0x7f5ed413f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:44.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.407+0000 7f5edc800640 1 --2- 172.21.15.114:0/3336812440 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5ed413c240 0x7f5ed413f420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5ec80097f0 tx=0x7f5ec801c4b0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.411+0000 7f5edc800640 1 -- 172.21.15.114:0/3336812440 shutdown_connections 2024-09-13T17:52:44.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.411+0000 7f5edc800640 1 --2- 172.21.15.114:0/3336812440 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5ed413c240 0x7f5ed413f420 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.411+0000 7f5edc800640 1 -- 172.21.15.114:0/3336812440 >> 172.21.15.114:0/3336812440 conn(0x7f5ed40660b0 msgr2=0x7f5ed4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:44.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.411+0000 7f5edc800640 1 -- 172.21.15.114:0/3336812440 shutdown_connections 2024-09-13T17:52:44.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.411+0000 7f5edc800640 1 -- 172.21.15.114:0/3336812440 wait complete. 2024-09-13T17:52:44.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.411+0000 7f5edc800640 1 Processor -- start 2024-09-13T17:52:44.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.411+0000 7f5edc800640 1 -- start start 2024-09-13T17:52:44.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.411+0000 7f5edc800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5ed406dc60 0x7f5ed40ae160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:44.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.411+0000 7f5edc800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ed413c240 0x7f5ed40c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:44.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.411+0000 7f5edc800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ed413c980 0x7f5ed40af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:44.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.411+0000 7f5edc800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed40c62e0 con 0x7f5ed413c980 2024-09-13T17:52:44.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.411+0000 7f5edc800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed40c5400 con 0x7f5ed413c240 2024-09-13T17:52:44.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.411+0000 7f5edc800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed40af550 con 0x7f5ed406dc60 2024-09-13T17:52:44.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.411+0000 7f5eda800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ed413c980 0x7f5ed40af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:44.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.411+0000 7f5ed9e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5ed406dc60 0x7f5ed40ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:44.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.411+0000 7f5ed9400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ed413c240 0x7f5ed40c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:44.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.411+0000 7f5ed9400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ed413c240 0x7f5ed40c68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:50994/0 (socket says 172.21.15.114:50994) 2024-09-13T17:52:44.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.411+0000 7f5eda800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ed413c980 0x7f5ed40af9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50322/0 (socket says 172.21.15.114:50322) 2024-09-13T17:52:44.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.411+0000 7f5ed9400640 1 -- 172.21.15.114:0/589573938 learned_addr learned my addr 172.21.15.114:0/589573938 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:44.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.411+0000 7f5eda800640 1 -- 172.21.15.114:0/589573938 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5ed406dc60 msgr2=0x7f5ed40ae160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:44.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.411+0000 7f5eda800640 1 --2- 172.21.15.114:0/589573938 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5ed406dc60 0x7f5ed40ae160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.411+0000 7f5eda800640 1 -- 172.21.15.114:0/589573938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ed413c240 msgr2=0x7f5ed40c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:44.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.411+0000 7f5eda800640 1 --2- 172.21.15.114:0/589573938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ed413c240 0x7f5ed40c68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.411+0000 7f5eda800640 1 -- 172.21.15.114:0/589573938 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec8009420 con 0x7f5ed413c980 2024-09-13T17:52:44.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.411+0000 7f5eda800640 1 --2- 172.21.15.114:0/589573938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ed413c980 0x7f5ed40af9e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000caf0 tx=0x7f5ed000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:44.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.415+0000 7f5ece000640 1 -- 172.21.15.114:0/589573938 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed000aca0 con 0x7f5ed413c980 2024-09-13T17:52:44.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.415+0000 7f5ece000640 1 -- 172.21.15.114:0/589573938 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed000ae00 con 0x7f5ed413c980 2024-09-13T17:52:44.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.415+0000 7f5ece000640 1 -- 172.21.15.114:0/589573938 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0012620 con 0x7f5ed413c980 2024-09-13T17:52:44.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.415+0000 7f5edc800640 1 -- 172.21.15.114:0/589573938 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed40ae700 con 0x7f5ed413c980 2024-09-13T17:52:44.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.415+0000 7f5edc800640 1 -- 172.21.15.114:0/589573938 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed40aef00 con 0x7f5ed413c980 2024-09-13T17:52:44.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.415+0000 7f5edc800640 1 -- 172.21.15.114:0/589573938 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed40ae9a0 con 0x7f5ed413c980 2024-09-13T17:52:44.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.415+0000 7f5ece000640 1 -- 172.21.15.114:0/589573938 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5ed0007070 con 0x7f5ed413c980 2024-09-13T17:52:44.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.415+0000 7f5ece000640 1 --2- 172.21.15.114:0/589573938 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5eb8066690 0x7f5eb8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:44.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.415+0000 7f5ece000640 1 -- 172.21.15.114:0/589573938 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5ed0084240 con 0x7f5ed413c980 2024-09-13T17:52:44.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.415+0000 7f5ed9e00640 1 --2- 172.21.15.114:0/589573938 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5eb8066690 0x7f5eb8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:44.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.415+0000 7f5ed9e00640 1 --2- 172.21.15.114:0/589573938 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5eb8066690 0x7f5eb8068b50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5ec80ae000 tx=0x7f5ec8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:44.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.419+0000 7f5ece000640 1 -- 172.21.15.114:0/589573938 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5ed00512a0 con 0x7f5ed413c980 2024-09-13T17:52:44.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.575+0000 7f5edc800640 1 -- 172.21.15.114:0/589573938 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ed40ae6d0 con 0x7f5ed413c980 2024-09-13T17:52:44.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.575+0000 7f5ece000640 1 -- 172.21.15.114:0/589573938 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5ed00548c0 con 0x7f5ed413c980 2024-09-13T17:52:44.582 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-13T17:52:44.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.579+0000 7f5edc800640 1 -- 172.21.15.114:0/589573938 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5eb8066690 msgr2=0x7f5eb8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:44.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.579+0000 7f5edc800640 1 --2- 172.21.15.114:0/589573938 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5eb8066690 0x7f5eb8068b50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5ec80ae000 tx=0x7f5ec8008040 comp rx=0 tx=0).stop 2024-09-13T17:52:44.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.579+0000 7f5edc800640 1 -- 172.21.15.114:0/589573938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ed413c980 msgr2=0x7f5ed40af9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:44.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.579+0000 7f5edc800640 1 --2- 172.21.15.114:0/589573938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ed413c980 0x7f5ed40af9e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000caf0 tx=0x7f5ed000a060 comp rx=0 tx=0).stop 2024-09-13T17:52:44.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.579+0000 7f5edc800640 1 -- 172.21.15.114:0/589573938 shutdown_connections 2024-09-13T17:52:44.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.579+0000 7f5edc800640 1 --2- 172.21.15.114:0/589573938 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5eb8066690 0x7f5eb8068b50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.579+0000 7f5edc800640 1 --2- 172.21.15.114:0/589573938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ed413c980 0x7f5ed40af9e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.579+0000 7f5edc800640 1 --2- 172.21.15.114:0/589573938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ed413c240 0x7f5ed40c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.579+0000 7f5edc800640 1 --2- 172.21.15.114:0/589573938 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5ed406dc60 0x7f5ed40ae160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.579+0000 7f5edc800640 1 -- 172.21.15.114:0/589573938 >> 172.21.15.114:0/589573938 conn(0x7f5ed40660b0 msgr2=0x7f5ed40ad8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:44.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.579+0000 7f5edc800640 1 -- 172.21.15.114:0/589573938 shutdown_connections 2024-09-13T17:52:44.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.579+0000 7f5edc800640 1 -- 172.21.15.114:0/589573938 wait complete. 2024-09-13T17:52:44.603 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:52:44.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.735+0000 7f75ff400640 1 Processor -- start 2024-09-13T17:52:44.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.735+0000 7f75ff400640 1 -- start start 2024-09-13T17:52:44.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.735+0000 7f75ff400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f75f8151420 0x7f75f80cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:44.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.735+0000 7f75ff400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f75f80ccba0 0x7f75f8070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:44.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.735+0000 7f75ff400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f75f8070960 0x7f75f815df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:44.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.735+0000 7f75ff400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f80cbc30 con 0x7f75f8070960 2024-09-13T17:52:44.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.735+0000 7f75ff400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f8070db0 con 0x7f75f80ccba0 2024-09-13T17:52:44.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.735+0000 7f75ff400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f8151800 con 0x7f75f8151420 2024-09-13T17:52:44.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.735+0000 7f75fd400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f75f8070960 0x7f75f815df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:44.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.735+0000 7f75fd400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f75f8070960 0x7f75f815df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50336/0 (socket says 172.21.15.114:50336) 2024-09-13T17:52:44.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.735+0000 7f75fd400640 1 -- 172.21.15.114:0/3407177801 learned_addr learned my addr 172.21.15.114:0/3407177801 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:44.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.739+0000 7f75fca00640 1 --2- 172.21.15.114:0/3407177801 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f75f8151420 0x7f75f80cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:44.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.739+0000 7f75f7e00640 1 --2- 172.21.15.114:0/3407177801 >> v2:172.21.15.134:3300/0 conn(0x7f75f80ccba0 0x7f75f8070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:44.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.739+0000 7f75fd400640 1 -- 172.21.15.114:0/3407177801 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f75f8151420 msgr2=0x7f75f80cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:44.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.739+0000 7f75fd400640 1 --2- 172.21.15.114:0/3407177801 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f75f8151420 0x7f75f80cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.739+0000 7f75fd400640 1 -- 172.21.15.114:0/3407177801 >> v2:172.21.15.134:3300/0 conn(0x7f75f80ccba0 msgr2=0x7f75f8070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:44.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.739+0000 7f75fd400640 1 --2- 172.21.15.114:0/3407177801 >> v2:172.21.15.134:3300/0 conn(0x7f75f80ccba0 0x7f75f8070420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.739+0000 7f75fd400640 1 -- 172.21.15.114:0/3407177801 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f80cafb0 con 0x7f75f8070960 2024-09-13T17:52:44.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.739+0000 7f75fd400640 1 --2- 172.21.15.114:0/3407177801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75f8070960 0x7f75f815df20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f75f806e6a0 tx=0x7f75f001c110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f7368d8c605144b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:44.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.739+0000 7f75f7400640 1 -- 172.21.15.114:0/3407177801 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f00ab600 con 0x7f75f8070960 2024-09-13T17:52:44.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.739+0000 7f75f7400640 1 -- 172.21.15.114:0/3407177801 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f00a7050 con 0x7f75f8070960 2024-09-13T17:52:44.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.739+0000 7f75f7400640 1 -- 172.21.15.114:0/3407177801 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f00ab980 con 0x7f75f8070960 2024-09-13T17:52:44.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.739+0000 7f75ff400640 1 -- 172.21.15.114:0/3407177801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75f8070960 msgr2=0x7f75f815df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:44.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.739+0000 7f75ff400640 1 --2- 172.21.15.114:0/3407177801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75f8070960 0x7f75f815df20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f75f806e6a0 tx=0x7f75f001c110 comp rx=0 tx=0).stop 2024-09-13T17:52:44.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75ff400640 1 -- 172.21.15.114:0/3407177801 shutdown_connections 2024-09-13T17:52:44.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75ff400640 1 --2- 172.21.15.114:0/3407177801 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75f8070960 0x7f75f815df20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75ff400640 1 --2- 172.21.15.114:0/3407177801 >> v2:172.21.15.134:3300/0 conn(0x7f75f80ccba0 0x7f75f8070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75ff400640 1 --2- 172.21.15.114:0/3407177801 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f75f8151420 0x7f75f80cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75ff400640 1 -- 172.21.15.114:0/3407177801 >> 172.21.15.114:0/3407177801 conn(0x7f75f80660b0 msgr2=0x7f75f8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:44.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75ff400640 1 -- 172.21.15.114:0/3407177801 shutdown_connections 2024-09-13T17:52:44.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75ff400640 1 -- 172.21.15.114:0/3407177801 wait complete. 2024-09-13T17:52:44.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75ff400640 1 Processor -- start 2024-09-13T17:52:44.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75ff400640 1 -- start start 2024-09-13T17:52:44.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75ff400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75f8070960 0x7f75f8144140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:44.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75ff400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75f80ccba0 0x7f75f81498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:44.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75ff400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f75f8151420 0x7f75f8159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:44.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75ff400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f8144680 con 0x7f75f80ccba0 2024-09-13T17:52:44.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75ff400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f814cbb0 con 0x7f75f8070960 2024-09-13T17:52:44.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75ff400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f814ce20 con 0x7f75f8151420 2024-09-13T17:52:44.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75f7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75f80ccba0 0x7f75f81498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:44.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75f7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75f80ccba0 0x7f75f81498e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50346/0 (socket says 172.21.15.114:50346) 2024-09-13T17:52:44.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75f7e00640 1 -- 172.21.15.114:0/3268245262 learned_addr learned my addr 172.21.15.114:0/3268245262 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:44.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75fca00640 1 --2- 172.21.15.114:0/3268245262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75f8070960 0x7f75f8144140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75fd400640 1 --2- 172.21.15.114:0/3268245262 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f75f8151420 0x7f75f8159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75f7e00640 1 -- 172.21.15.114:0/3268245262 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f75f8151420 msgr2=0x7f75f8159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75f7e00640 1 --2- 172.21.15.114:0/3268245262 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f75f8151420 0x7f75f8159510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75f7e00640 1 -- 172.21.15.114:0/3268245262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75f8070960 msgr2=0x7f75f8144140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75f7e00640 1 --2- 172.21.15.114:0/3268245262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75f8070960 0x7f75f8144140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75f7e00640 1 -- 172.21.15.114:0/3268245262 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f00094d0 con 0x7f75f80ccba0 2024-09-13T17:52:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75f7e00640 1 --2- 172.21.15.114:0/3268245262 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75f80ccba0 0x7f75f81498e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f75e400d800 tx=0x7f75e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75f4c00640 1 -- 172.21.15.114:0/3268245262 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e40096a0 con 0x7f75f80ccba0 2024-09-13T17:52:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75f4c00640 1 -- 172.21.15.114:0/3268245262 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e4009800 con 0x7f75f80ccba0 2024-09-13T17:52:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75f4c00640 1 -- 172.21.15.114:0/3268245262 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e4009bb0 con 0x7f75f80ccba0 2024-09-13T17:52:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.743+0000 7f75ff400640 1 -- 172.21.15.114:0/3268245262 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f814d100 con 0x7f75f80ccba0 2024-09-13T17:52:44.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.747+0000 7f75ff400640 1 -- 172.21.15.114:0/3268245262 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f814d6c0 con 0x7f75f80ccba0 2024-09-13T17:52:44.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.747+0000 7f75ff400640 1 -- 172.21.15.114:0/3268245262 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f8067ec0 con 0x7f75f80ccba0 2024-09-13T17:52:44.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.747+0000 7f75f4c00640 1 -- 172.21.15.114:0/3268245262 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f75e4009d10 con 0x7f75f80ccba0 2024-09-13T17:52:44.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.747+0000 7f75f4c00640 1 --2- 172.21.15.114:0/3268245262 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f75d8066690 0x7f75d8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:44.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.747+0000 7f75f4c00640 1 -- 172.21.15.114:0/3268245262 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f75e40849a0 con 0x7f75f80ccba0 2024-09-13T17:52:44.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.747+0000 7f75fca00640 1 --2- 172.21.15.114:0/3268245262 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f75d8066690 0x7f75d8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:44.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.747+0000 7f75fca00640 1 --2- 172.21.15.114:0/3268245262 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f75d8066690 0x7f75d8068b50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f75e8003ab0 tx=0x7f75e8009830 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:44.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.751+0000 7f75f4c00640 1 -- 172.21.15.114:0/3268245262 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f75e4051940 con 0x7f75f80ccba0 2024-09-13T17:52:44.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.907+0000 7f75ff400640 1 -- 172.21.15.114:0/3268245262 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f75f8070400 con 0x7f75f80ccba0 2024-09-13T17:52:44.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.907+0000 7f75f4c00640 1 -- 172.21.15.114:0/3268245262 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f75e4054f60 con 0x7f75f80ccba0 2024-09-13T17:52:44.912 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:52:44.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.907+0000 7f75ff400640 1 -- 172.21.15.114:0/3268245262 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f75d8066690 msgr2=0x7f75d8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:44.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.907+0000 7f75ff400640 1 --2- 172.21.15.114:0/3268245262 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f75d8066690 0x7f75d8068b50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f75e8003ab0 tx=0x7f75e8009830 comp rx=0 tx=0).stop 2024-09-13T17:52:44.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.907+0000 7f75ff400640 1 -- 172.21.15.114:0/3268245262 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75f80ccba0 msgr2=0x7f75f81498e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:44.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.907+0000 7f75ff400640 1 --2- 172.21.15.114:0/3268245262 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75f80ccba0 0x7f75f81498e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f75e400d800 tx=0x7f75e400dcc0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.907+0000 7f75ff400640 1 -- 172.21.15.114:0/3268245262 shutdown_connections 2024-09-13T17:52:44.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.907+0000 7f75ff400640 1 --2- 172.21.15.114:0/3268245262 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f75d8066690 0x7f75d8068b50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.907+0000 7f75ff400640 1 --2- 172.21.15.114:0/3268245262 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f75f8151420 0x7f75f8159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.907+0000 7f75ff400640 1 --2- 172.21.15.114:0/3268245262 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75f80ccba0 0x7f75f81498e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.907+0000 7f75ff400640 1 --2- 172.21.15.114:0/3268245262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75f8070960 0x7f75f8144140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:44.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.907+0000 7f75ff400640 1 -- 172.21.15.114:0/3268245262 >> 172.21.15.114:0/3268245262 conn(0x7f75f80660b0 msgr2=0x7f75f815c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:44.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.907+0000 7f75ff400640 1 -- 172.21.15.114:0/3268245262 shutdown_connections 2024-09-13T17:52:44.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:44.907+0000 7f75ff400640 1 -- 172.21.15.114:0/3268245262 wait complete. 2024-09-13T17:52:44.931 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:52:45.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.075+0000 7f34de600640 1 Processor -- start 2024-09-13T17:52:45.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.075+0000 7f34de600640 1 -- start start 2024-09-13T17:52:45.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.075+0000 7f34de600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34d80713c0 0x7f34d80b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:45.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.075+0000 7f34de600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f34d8159be0 0x7f34d80b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:45.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.075+0000 7f34de600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d80b2490 con 0x7f34d8158a70 2024-09-13T17:52:45.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.075+0000 7f34de600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d80b1f90 con 0x7f34d8159be0 2024-09-13T17:52:45.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.075+0000 7f34de600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d8158e50 con 0x7f34d80713c0 2024-09-13T17:52:45.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.075+0000 7f34d7e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f34d8159be0 0x7f34d80b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:45.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.075+0000 7f34d6a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34d80713c0 0x7f34d80b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:45.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.075+0000 7f34d7e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f34d8159be0 0x7f34d80b1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:51012/0 (socket says 172.21.15.114:51012) 2024-09-13T17:52:45.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.075+0000 7f34d7e00640 1 -- 172.21.15.114:0/1053373848 learned_addr learned my addr 172.21.15.114:0/1053373848 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:45.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.075+0000 7f34d6000640 1 -- 172.21.15.114:0/1053373848 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2336537522 0 0) 0x7f34d80b2490 con 0x7f34d8158a70 2024-09-13T17:52:45.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.075+0000 7f34d6000640 1 -- 172.21.15.114:0/1053373848 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34bc003530 con 0x7f34d8158a70 2024-09-13T17:52:45.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.075+0000 7f34d6a00640 1 -- 172.21.15.114:0/1053373848 >> v2:172.21.15.134:3300/0 conn(0x7f34d8159be0 msgr2=0x7f34d80b1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:45.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.075+0000 7f34d6a00640 1 --2- 172.21.15.114:0/1053373848 >> v2:172.21.15.134:3300/0 conn(0x7f34d8159be0 0x7f34d80b1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.075+0000 7f34d6a00640 1 -- 172.21.15.114:0/1053373848 >> v1:172.21.15.134:6789/0 conn(0x7f34d8158a70 legacy=0x7f34d8070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:45.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.075+0000 7f34d6a00640 1 -- 172.21.15.114:0/1053373848 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d80b21b0 con 0x7f34d80713c0 2024-09-13T17:52:45.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.075+0000 7f34d7e00640 1 --2- 172.21.15.114:0/1053373848 >> v2:172.21.15.134:3300/0 conn(0x7f34d8159be0 0x7f34d80b1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:52:45.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.079+0000 7f34d6a00640 1 --2- 172.21.15.114:0/1053373848 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34d80713c0 0x7f34d80b1510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f34c400a960 tx=0x7f34c401d7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fddc15a080b3386d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:45.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.079+0000 7f34d6000640 1 -- 172.21.15.114:0/1053373848 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c40a67e0 con 0x7f34d80713c0 2024-09-13T17:52:45.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.079+0000 7f34d6000640 1 -- 172.21.15.114:0/1053373848 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c40a6940 con 0x7f34d80713c0 2024-09-13T17:52:45.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.079+0000 7f34d6000640 1 -- 172.21.15.114:0/1053373848 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c40a6cd0 con 0x7f34d80713c0 2024-09-13T17:52:45.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.079+0000 7f34de600640 1 -- 172.21.15.114:0/1053373848 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34d80713c0 msgr2=0x7f34d80b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:45.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.079+0000 7f34de600640 1 --2- 172.21.15.114:0/1053373848 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34d80713c0 0x7f34d80b1510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f34c400a960 tx=0x7f34c401d7b0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.079+0000 7f34de600640 1 -- 172.21.15.114:0/1053373848 shutdown_connections 2024-09-13T17:52:45.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.079+0000 7f34de600640 1 --2- 172.21.15.114:0/1053373848 >> v2:172.21.15.134:3300/0 conn(0x7f34d8159be0 0x7f34d80b1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.079+0000 7f34de600640 1 --2- 172.21.15.114:0/1053373848 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34d80713c0 0x7f34d80b1510 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.079+0000 7f34de600640 1 -- 172.21.15.114:0/1053373848 >> 172.21.15.114:0/1053373848 conn(0x7f34d80660b0 msgr2=0x7f34d8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:45.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.079+0000 7f34de600640 1 -- 172.21.15.114:0/1053373848 shutdown_connections 2024-09-13T17:52:45.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.079+0000 7f34de600640 1 -- 172.21.15.114:0/1053373848 wait complete. 2024-09-13T17:52:45.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.083+0000 7f34de600640 1 Processor -- start 2024-09-13T17:52:45.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.083+0000 7f34de600640 1 -- start start 2024-09-13T17:52:45.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.083+0000 7f34de600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34d80713c0 0x7f34d813b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:45.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.083+0000 7f34de600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34d8158a70 0x7f34d81f2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:45.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.083+0000 7f34de600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34d8159be0 0x7f34d814dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:45.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.083+0000 7f34de600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d814d5c0 con 0x7f34d8159be0 2024-09-13T17:52:45.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.083+0000 7f34de600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d814d8a0 con 0x7f34d80713c0 2024-09-13T17:52:45.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.083+0000 7f34de600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d814a060 con 0x7f34d8158a70 2024-09-13T17:52:45.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.083+0000 7f34d7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34d8159be0 0x7f34d814dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:45.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.083+0000 7f34d7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34d8159be0 0x7f34d814dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50354/0 (socket says 172.21.15.114:50354) 2024-09-13T17:52:45.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.083+0000 7f34d7e00640 1 -- 172.21.15.114:0/1069883692 learned_addr learned my addr 172.21.15.114:0/1069883692 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:45.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.083+0000 7f34d6a00640 1 --2- 172.21.15.114:0/1069883692 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34d8158a70 0x7f34d81f2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:45.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.083+0000 7f34d7400640 1 --2- 172.21.15.114:0/1069883692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34d80713c0 0x7f34d813b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:45.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.083+0000 7f34d7e00640 1 -- 172.21.15.114:0/1069883692 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34d8158a70 msgr2=0x7f34d81f2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:45.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.083+0000 7f34d7e00640 1 --2- 172.21.15.114:0/1069883692 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34d8158a70 0x7f34d81f2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.083+0000 7f34d7e00640 1 -- 172.21.15.114:0/1069883692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34d80713c0 msgr2=0x7f34d813b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:45.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.083+0000 7f34d7e00640 1 --2- 172.21.15.114:0/1069883692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34d80713c0 0x7f34d813b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.083+0000 7f34d7e00640 1 -- 172.21.15.114:0/1069883692 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d00094d0 con 0x7f34d8159be0 2024-09-13T17:52:45.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.083+0000 7f34d7e00640 1 --2- 172.21.15.114:0/1069883692 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34d8159be0 0x7f34d814dc30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f34d000e930 tx=0x7f34d000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:45.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.083+0000 7f34cf400640 1 -- 172.21.15.114:0/1069883692 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d0004020 con 0x7f34d8159be0 2024-09-13T17:52:45.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.083+0000 7f34cf400640 1 -- 172.21.15.114:0/1069883692 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d0004180 con 0x7f34d8159be0 2024-09-13T17:52:45.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.083+0000 7f34de600640 1 -- 172.21.15.114:0/1069883692 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34c400a5c0 con 0x7f34d8159be0 2024-09-13T17:52:45.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.083+0000 7f34cf400640 1 -- 172.21.15.114:0/1069883692 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d0004510 con 0x7f34d8159be0 2024-09-13T17:52:45.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.083+0000 7f34de600640 1 -- 172.21.15.114:0/1069883692 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d814a620 con 0x7f34d8159be0 2024-09-13T17:52:45.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.087+0000 7f34de600640 1 -- 172.21.15.114:0/1069883692 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d814a810 con 0x7f34d8159be0 2024-09-13T17:52:45.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.087+0000 7f34cf400640 1 -- 172.21.15.114:0/1069883692 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f34d000c940 con 0x7f34d8159be0 2024-09-13T17:52:45.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.087+0000 7f34cf400640 1 --2- 172.21.15.114:0/1069883692 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f34b8066690 0x7f34b8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:45.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.087+0000 7f34cf400640 1 -- 172.21.15.114:0/1069883692 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f34d0084510 con 0x7f34d8159be0 2024-09-13T17:52:45.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.087+0000 7f34d7400640 1 --2- 172.21.15.114:0/1069883692 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f34b8066690 0x7f34b8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:45.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.087+0000 7f34d7400640 1 --2- 172.21.15.114:0/1069883692 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f34b8066690 0x7f34b8068b50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f34c8001570 tx=0x7f34c8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:45.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.091+0000 7f34cf400640 1 -- 172.21.15.114:0/1069883692 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f34d0051440 con 0x7f34d8159be0 2024-09-13T17:52:45.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.247+0000 7f34de600640 1 -- 172.21.15.114:0/1069883692 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f34d8070cb0 con 0x7f34d8159be0 2024-09-13T17:52:45.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.247+0000 7f34cf400640 1 -- 172.21.15.114:0/1069883692 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f34d0054a60 con 0x7f34d8159be0 2024-09-13T17:52:45.251 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-09-13T17:52:45.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.247+0000 7f34de600640 1 -- 172.21.15.114:0/1069883692 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f34b8066690 msgr2=0x7f34b8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:45.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.247+0000 7f34de600640 1 --2- 172.21.15.114:0/1069883692 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f34b8066690 0x7f34b8068b50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f34c8001570 tx=0x7f34c8009040 comp rx=0 tx=0).stop 2024-09-13T17:52:45.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.247+0000 7f34de600640 1 -- 172.21.15.114:0/1069883692 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34d8159be0 msgr2=0x7f34d814dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:45.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.247+0000 7f34de600640 1 --2- 172.21.15.114:0/1069883692 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34d8159be0 0x7f34d814dc30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f34d000e930 tx=0x7f34d000edf0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.247+0000 7f34de600640 1 -- 172.21.15.114:0/1069883692 shutdown_connections 2024-09-13T17:52:45.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.247+0000 7f34de600640 1 --2- 172.21.15.114:0/1069883692 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f34b8066690 0x7f34b8068b50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.247+0000 7f34de600640 1 --2- 172.21.15.114:0/1069883692 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34d8159be0 0x7f34d814dc30 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.247+0000 7f34de600640 1 --2- 172.21.15.114:0/1069883692 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f34d8158a70 0x7f34d81f2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.247+0000 7f34de600640 1 --2- 172.21.15.114:0/1069883692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34d80713c0 0x7f34d813b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.247+0000 7f34de600640 1 -- 172.21.15.114:0/1069883692 >> 172.21.15.114:0/1069883692 conn(0x7f34d80660b0 msgr2=0x7f34d8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:45.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.247+0000 7f34de600640 1 -- 172.21.15.114:0/1069883692 shutdown_connections 2024-09-13T17:52:45.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.247+0000 7f34de600640 1 -- 172.21.15.114:0/1069883692 wait complete. 2024-09-13T17:52:45.272 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:52:45.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f9646000640 1 Processor -- start 2024-09-13T17:52:45.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f9646000640 1 -- start start 2024-09-13T17:52:45.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f9646000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f964013c240 0x7f964013f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:45.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f9646000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f964013c980 0x7f964006d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:45.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f9646000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96400cd220 con 0x7f964006da90 2024-09-13T17:52:45.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f9646000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f964013f960 con 0x7f964013c240 2024-09-13T17:52:45.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f9646000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f964006ded0 con 0x7f964013c980 2024-09-13T17:52:45.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f963fe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f964006da90 0x7f96400cd650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46588/0 (socket says 172.21.15.114:46588) 2024-09-13T17:52:45.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f963fe00640 1 -- 172.21.15.114:0/3961170253 learned_addr learned my addr 172.21.15.114:0/3961170253 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:45.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f963f400640 1 --2- 172.21.15.114:0/3961170253 >> v2:172.21.15.134:3300/0 conn(0x7f964013c240 0x7f964013f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:45.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f963e000640 1 -- 172.21.15.114:0/3961170253 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290259964 0 0) 0x7f96400cd220 con 0x7f964006da90 2024-09-13T17:52:45.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f963e000640 1 -- 172.21.15.114:0/3961170253 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9624005740 con 0x7f964006da90 2024-09-13T17:52:45.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f963ea00640 1 --2- 172.21.15.114:0/3961170253 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f964013c980 0x7f964006d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:45.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f963e000640 1 -- 172.21.15.114:0/3961170253 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1021198307 0 0) 0x7f9624005740 con 0x7f964006da90 2024-09-13T17:52:45.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f963e000640 1 -- 172.21.15.114:0/3961170253 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f964013c980 msgr2=0x7f964006d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:45.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f963e000640 1 --2- 172.21.15.114:0/3961170253 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f964013c980 0x7f964006d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f963e000640 1 -- 172.21.15.114:0/3961170253 >> v2:172.21.15.134:3300/0 conn(0x7f964013c240 msgr2=0x7f964013f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:45.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f963e000640 1 --2- 172.21.15.114:0/3961170253 >> v2:172.21.15.134:3300/0 conn(0x7f964013c240 0x7f964013f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f963e000640 1 -- 172.21.15.114:0/3961170253 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f964015a740 con 0x7f964006da90 2024-09-13T17:52:45.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f963e000640 1 -- 172.21.15.114:0/3961170253 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7f9638001a00 con 0x7f964006da90 2024-09-13T17:52:45.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f963e000640 1 -- 172.21.15.114:0/3961170253 >> v1:172.21.15.114:6789/0 conn(0x7f964006da90 legacy=0x7f96400cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:45.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f963e000640 1 --2- 172.21.15.114:0/3961170253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9624005b90 0x7f9624005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:45.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f963e000640 1 --2- 172.21.15.114:0/3961170253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96240069e0 0x7f9624006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:45.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f963e000640 1 --2- 172.21.15.114:0/3961170253 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f964013c980 0x7f96240073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:45.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f963e000640 1 -- 172.21.15.114:0/3961170253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964013f960 con 0x7f96240069e0 2024-09-13T17:52:45.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f963e000640 1 -- 172.21.15.114:0/3961170253 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964006ded0 con 0x7f9624005b90 2024-09-13T17:52:45.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f963e000640 1 -- 172.21.15.114:0/3961170253 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f962400dba0 con 0x7f964013c980 2024-09-13T17:52:45.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f963ea00640 1 --2- 172.21.15.114:0/3961170253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96240069e0 0x7f9624006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:45.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f963f400640 1 --2- 172.21.15.114:0/3961170253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9624005b90 0x7f9624005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:45.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f963fe00640 1 --2- 172.21.15.114:0/3961170253 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f964013c980 0x7f96240073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:45.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f963ea00640 1 -- 172.21.15.114:0/3961170253 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f964013c980 msgr2=0x7f96240073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:45.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f963ea00640 1 --2- 172.21.15.114:0/3961170253 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f964013c980 0x7f96240073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f963ea00640 1 -- 172.21.15.114:0/3961170253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9624005b90 msgr2=0x7f9624005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:45.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f963ea00640 1 --2- 172.21.15.114:0/3961170253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9624005b90 0x7f9624005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.407+0000 7f963ea00640 1 -- 172.21.15.114:0/3961170253 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9624005740 con 0x7f96240069e0 2024-09-13T17:52:45.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.411+0000 7f963ea00640 1 --2- 172.21.15.114:0/3961170253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96240069e0 0x7f9624006e60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f962c009ae0 tx=0x7f962c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520d2f0c76e459e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:45.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.411+0000 7f963e000640 1 -- 172.21.15.114:0/3961170253 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c0a6480 con 0x7f96240069e0 2024-09-13T17:52:45.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.411+0000 7f963e000640 1 -- 172.21.15.114:0/3961170253 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962c0a65e0 con 0x7f96240069e0 2024-09-13T17:52:45.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.411+0000 7f963e000640 1 -- 172.21.15.114:0/3961170253 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c0a6990 con 0x7f96240069e0 2024-09-13T17:52:45.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.411+0000 7f9646000640 1 -- 172.21.15.114:0/3961170253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96240069e0 msgr2=0x7f9624006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:45.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.411+0000 7f9646000640 1 --2- 172.21.15.114:0/3961170253 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96240069e0 0x7f9624006e60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f962c009ae0 tx=0x7f962c01ca70 comp rx=0 tx=0).stop 2024-09-13T17:52:45.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.411+0000 7f963fe00640 1 -- 172.21.15.114:0/3961170253 reap_dead start 2024-09-13T17:52:45.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.411+0000 7f9646000640 1 -- 172.21.15.114:0/3961170253 shutdown_connections 2024-09-13T17:52:45.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.411+0000 7f9646000640 1 -- 172.21.15.114:0/3961170253 >> 172.21.15.114:0/3961170253 conn(0x7f96400660b0 msgr2=0x7f9640069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:45.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.411+0000 7f9646000640 1 -- 172.21.15.114:0/3961170253 shutdown_connections 2024-09-13T17:52:45.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.411+0000 7f9646000640 1 -- 172.21.15.114:0/3961170253 wait complete. 2024-09-13T17:52:45.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.415+0000 7f9646000640 1 Processor -- start 2024-09-13T17:52:45.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.415+0000 7f9646000640 1 -- start start 2024-09-13T17:52:45.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.415+0000 7f9646000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96240069e0 0x7f96400aca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:45.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.415+0000 7f9646000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9640157b50 0x7f9640138d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:45.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.415+0000 7f9646000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f964014efb0 0x7f964013a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:45.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.415+0000 7f9646000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96400acf50 con 0x7f96240069e0 2024-09-13T17:52:45.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.415+0000 7f9646000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96400ad140 con 0x7f964014efb0 2024-09-13T17:52:45.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.415+0000 7f9646000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96400aec10 con 0x7f9640157b50 2024-09-13T17:52:45.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.415+0000 7f963f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96240069e0 0x7f96400aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:45.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.415+0000 7f963f400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96240069e0 0x7f96400aca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50366/0 (socket says 172.21.15.114:50366) 2024-09-13T17:52:45.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.415+0000 7f963f400640 1 -- 172.21.15.114:0/4259129228 learned_addr learned my addr 172.21.15.114:0/4259129228 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:45.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.415+0000 7f963ea00640 1 --2- 172.21.15.114:0/4259129228 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9640157b50 0x7f9640138d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:45.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.415+0000 7f963fe00640 1 --2- 172.21.15.114:0/4259129228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f964014efb0 0x7f964013a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:45.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.415+0000 7f963f400640 1 -- 172.21.15.114:0/4259129228 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9640157b50 msgr2=0x7f9640138d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:45.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.415+0000 7f963f400640 1 --2- 172.21.15.114:0/4259129228 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9640157b50 0x7f9640138d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.415+0000 7f963f400640 1 -- 172.21.15.114:0/4259129228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f964014efb0 msgr2=0x7f964013a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:45.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.415+0000 7f963f400640 1 --2- 172.21.15.114:0/4259129228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f964014efb0 0x7f964013a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.415+0000 7f963f400640 1 -- 172.21.15.114:0/4259129228 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96400ae320 con 0x7f96240069e0 2024-09-13T17:52:45.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.415+0000 7f963f400640 1 --2- 172.21.15.114:0/4259129228 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96240069e0 0x7f96400aca10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9630011a00 tx=0x7f9630011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:45.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.415+0000 7f9637400640 1 -- 172.21.15.114:0/4259129228 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963000fb50 con 0x7f96240069e0 2024-09-13T17:52:45.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.415+0000 7f9637400640 1 -- 172.21.15.114:0/4259129228 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963000fcb0 con 0x7f96240069e0 2024-09-13T17:52:45.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.415+0000 7f9646000640 1 -- 172.21.15.114:0/4259129228 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9640158360 con 0x7f96240069e0 2024-09-13T17:52:45.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.415+0000 7f9637400640 1 -- 172.21.15.114:0/4259129228 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9630014440 con 0x7f96240069e0 2024-09-13T17:52:45.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.415+0000 7f9646000640 1 -- 172.21.15.114:0/4259129228 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96400ae8a0 con 0x7f96240069e0 2024-09-13T17:52:45.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.419+0000 7f9646000640 1 -- 172.21.15.114:0/4259129228 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f964013cdf0 con 0x7f96240069e0 2024-09-13T17:52:45.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.419+0000 7f9637400640 1 -- 172.21.15.114:0/4259129228 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f963001d400 con 0x7f96240069e0 2024-09-13T17:52:45.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.419+0000 7f9637400640 1 --2- 172.21.15.114:0/4259129228 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f96200666c0 0x7f9620068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:45.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.419+0000 7f9637400640 1 -- 172.21.15.114:0/4259129228 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9630084db0 con 0x7f96240069e0 2024-09-13T17:52:45.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.419+0000 7f963ea00640 1 --2- 172.21.15.114:0/4259129228 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f96200666c0 0x7f9620068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:45.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.419+0000 7f963ea00640 1 --2- 172.21.15.114:0/4259129228 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f96200666c0 0x7f9620068b80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f962c0ad000 tx=0x7f962c0b3040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:45.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.423+0000 7f9637400640 1 -- 172.21.15.114:0/4259129228 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9630089070 con 0x7f96240069e0 2024-09-13T17:52:45.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.579+0000 7f9646000640 1 -- 172.21.15.114:0/4259129228 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f96401392b0 con 0x7f96240069e0 2024-09-13T17:52:45.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.579+0000 7f9637400640 1 -- 172.21.15.114:0/4259129228 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9630055830 con 0x7f96240069e0 2024-09-13T17:52:45.583 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:52:45.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.579+0000 7f9646000640 1 -- 172.21.15.114:0/4259129228 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f96200666c0 msgr2=0x7f9620068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:45.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.579+0000 7f9646000640 1 --2- 172.21.15.114:0/4259129228 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f96200666c0 0x7f9620068b80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f962c0ad000 tx=0x7f962c0b3040 comp rx=0 tx=0).stop 2024-09-13T17:52:45.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.579+0000 7f9646000640 1 -- 172.21.15.114:0/4259129228 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96240069e0 msgr2=0x7f96400aca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:45.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.579+0000 7f9646000640 1 --2- 172.21.15.114:0/4259129228 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96240069e0 0x7f96400aca10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9630011a00 tx=0x7f9630011ec0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.579+0000 7f9646000640 1 -- 172.21.15.114:0/4259129228 shutdown_connections 2024-09-13T17:52:45.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.579+0000 7f9646000640 1 --2- 172.21.15.114:0/4259129228 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f96200666c0 0x7f9620068b80 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.579+0000 7f9646000640 1 --2- 172.21.15.114:0/4259129228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f964014efb0 0x7f964013a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.579+0000 7f9646000640 1 --2- 172.21.15.114:0/4259129228 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9640157b50 0x7f9640138d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.579+0000 7f9646000640 1 --2- 172.21.15.114:0/4259129228 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96240069e0 0x7f96400aca10 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.579+0000 7f9646000640 1 -- 172.21.15.114:0/4259129228 >> 172.21.15.114:0/4259129228 conn(0x7f96400660b0 msgr2=0x7f96400cdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:45.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.579+0000 7f9646000640 1 -- 172.21.15.114:0/4259129228 shutdown_connections 2024-09-13T17:52:45.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.579+0000 7f9646000640 1 -- 172.21.15.114:0/4259129228 wait complete. 2024-09-13T17:52:45.605 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:52:45.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.735+0000 7f286ce00640 1 Processor -- start 2024-09-13T17:52:45.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.735+0000 7f286ce00640 1 -- start start 2024-09-13T17:52:45.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.735+0000 7f286ce00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f286815a650 0x7f2868099480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:45.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.735+0000 7f286ce00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f286815e7c0 0x7f28680cb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:45.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.735+0000 7f286ce00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28680ce540 con 0x7f28680ce0b0 2024-09-13T17:52:45.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.735+0000 7f286ce00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f286815ba40 con 0x7f286815e7c0 2024-09-13T17:52:45.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.735+0000 7f286ce00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28680ce820 con 0x7f286815a650 2024-09-13T17:52:45.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.735+0000 7f2866800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f286815e7c0 0x7f28680cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:45.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.735+0000 7f2866800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f286815e7c0 0x7f28680cb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50372/0 (socket says 172.21.15.114:50372) 2024-09-13T17:52:45.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.739+0000 7f2866800640 1 -- 172.21.15.114:0/623492982 learned_addr learned my addr 172.21.15.114:0/623492982 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:45.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.739+0000 7f2865e00640 1 --2- 172.21.15.114:0/623492982 >> v2:172.21.15.134:3300/0 conn(0x7f286815a650 0x7f2868099480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:45.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.739+0000 7f2866800640 1 -- 172.21.15.114:0/623492982 >> v2:172.21.15.134:3300/0 conn(0x7f286815a650 msgr2=0x7f2868099480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:45.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.739+0000 7f2866800640 1 --2- 172.21.15.114:0/623492982 >> v2:172.21.15.134:3300/0 conn(0x7f286815a650 0x7f2868099480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.739+0000 7f2866800640 1 -- 172.21.15.114:0/623492982 >> v1:172.21.15.134:6789/0 conn(0x7f28680ce0b0 legacy=0x7f286815e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:45.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.739+0000 7f2866800640 1 -- 172.21.15.114:0/623492982 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28680ceb00 con 0x7f286815e7c0 2024-09-13T17:52:45.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.739+0000 7f2865e00640 1 --2- 172.21.15.114:0/623492982 >> v2:172.21.15.134:3300/0 conn(0x7f286815a650 0x7f2868099480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:45.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.739+0000 7f2866800640 1 --2- 172.21.15.114:0/623492982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f286815e7c0 0x7f28680cb180 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2868071c10 tx=0x7f286001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff91474b37a3875 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:45.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.739+0000 7f2865400640 1 -- 172.21.15.114:0/623492982 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28600a5880 con 0x7f286815e7c0 2024-09-13T17:52:45.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.739+0000 7f2865400640 1 -- 172.21.15.114:0/623492982 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28600a59e0 con 0x7f286815e7c0 2024-09-13T17:52:45.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.739+0000 7f2865400640 1 -- 172.21.15.114:0/623492982 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28600a5d70 con 0x7f286815e7c0 2024-09-13T17:52:45.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.743+0000 7f286ce00640 1 -- 172.21.15.114:0/623492982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f286815e7c0 msgr2=0x7f28680cb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:45.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.743+0000 7f286ce00640 1 --2- 172.21.15.114:0/623492982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f286815e7c0 0x7f28680cb180 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2868071c10 tx=0x7f286001c9c0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.743+0000 7f286ce00640 1 -- 172.21.15.114:0/623492982 shutdown_connections 2024-09-13T17:52:45.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.743+0000 7f286ce00640 1 --2- 172.21.15.114:0/623492982 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f286815e7c0 0x7f28680cb180 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.743+0000 7f286ce00640 1 --2- 172.21.15.114:0/623492982 >> v2:172.21.15.134:3300/0 conn(0x7f286815a650 0x7f2868099480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.743+0000 7f286ce00640 1 -- 172.21.15.114:0/623492982 >> 172.21.15.114:0/623492982 conn(0x7f28680d04e0 msgr2=0x7f28680d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:45.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.743+0000 7f286ce00640 1 -- 172.21.15.114:0/623492982 shutdown_connections 2024-09-13T17:52:45.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.743+0000 7f286ce00640 1 -- 172.21.15.114:0/623492982 wait complete. 2024-09-13T17:52:45.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.743+0000 7f286ce00640 1 Processor -- start 2024-09-13T17:52:45.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.743+0000 7f286ce00640 1 -- start start 2024-09-13T17:52:45.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.743+0000 7f286ce00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f286815a650 0x7f2868158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:45.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.743+0000 7f286ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f286815e7c0 0x7f28680b5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:45.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.743+0000 7f286ce00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28680b5e80 0x7f28681585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:45.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.743+0000 7f286ce00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28680b6330 con 0x7f286815e7c0 2024-09-13T17:52:45.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.743+0000 7f286ce00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28680c81e0 con 0x7f28680b5e80 2024-09-13T17:52:45.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.743+0000 7f286ce00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28681591f0 con 0x7f286815a650 2024-09-13T17:52:45.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.743+0000 7f285d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f286815e7c0 0x7f28680b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:45.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.743+0000 7f285d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f286815e7c0 0x7f28680b5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50374/0 (socket says 172.21.15.114:50374) 2024-09-13T17:52:45.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.743+0000 7f2865e00640 1 --2- 172.21.15.114:0/1562472316 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f286815a650 0x7f2868158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:45.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.743+0000 7f285d400640 1 -- 172.21.15.114:0/1562472316 learned_addr learned my addr 172.21.15.114:0/1562472316 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:45.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.743+0000 7f2866800640 1 --2- 172.21.15.114:0/1562472316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28680b5e80 0x7f28681585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:45.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.743+0000 7f285d400640 1 -- 172.21.15.114:0/1562472316 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f286815a650 msgr2=0x7f2868158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:45.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.743+0000 7f285d400640 1 --2- 172.21.15.114:0/1562472316 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f286815a650 0x7f2868158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.743+0000 7f285d400640 1 -- 172.21.15.114:0/1562472316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28680b5e80 msgr2=0x7f28681585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:45.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.743+0000 7f285d400640 1 --2- 172.21.15.114:0/1562472316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28680b5e80 0x7f28681585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.743+0000 7f285d400640 1 -- 172.21.15.114:0/1562472316 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2860009b30 con 0x7f286815e7c0 2024-09-13T17:52:45.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.743+0000 7f2866800640 1 --2- 172.21.15.114:0/1562472316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28680b5e80 0x7f28681585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:52:45.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.743+0000 7f285d400640 1 --2- 172.21.15.114:0/1562472316 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f286815e7c0 0x7f28680b5940 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f285000c500 tx=0x7f285000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:45.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.747+0000 7f285ea00640 1 -- 172.21.15.114:0/1562472316 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2850005220 con 0x7f286815e7c0 2024-09-13T17:52:45.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.747+0000 7f285ea00640 1 -- 172.21.15.114:0/1562472316 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2850005380 con 0x7f286815e7c0 2024-09-13T17:52:45.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.747+0000 7f285ea00640 1 -- 172.21.15.114:0/1562472316 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2850007270 con 0x7f286815e7c0 2024-09-13T17:52:45.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.747+0000 7f286ce00640 1 -- 172.21.15.114:0/1562472316 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28681594d0 con 0x7f286815e7c0 2024-09-13T17:52:45.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.747+0000 7f286ce00640 1 -- 172.21.15.114:0/1562472316 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28680b3330 con 0x7f286815e7c0 2024-09-13T17:52:45.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.747+0000 7f286ce00640 1 -- 172.21.15.114:0/1562472316 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2868099480 con 0x7f286815e7c0 2024-09-13T17:52:45.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.747+0000 7f285ea00640 1 -- 172.21.15.114:0/1562472316 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f28500073d0 con 0x7f286815e7c0 2024-09-13T17:52:45.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.747+0000 7f285ea00640 1 --2- 172.21.15.114:0/1562472316 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2844066690 0x7f2844068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:45.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.747+0000 7f285ea00640 1 -- 172.21.15.114:0/1562472316 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2850083da0 con 0x7f286815e7c0 2024-09-13T17:52:45.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.747+0000 7f2865e00640 1 --2- 172.21.15.114:0/1562472316 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2844066690 0x7f2844068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:45.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.747+0000 7f2865e00640 1 --2- 172.21.15.114:0/1562472316 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2844066690 0x7f2844068b50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f28680b1f90 tx=0x7f2858008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:45.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.751+0000 7f285ea00640 1 -- 172.21.15.114:0/1562472316 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2850050d70 con 0x7f286815e7c0 2024-09-13T17:52:45.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.919+0000 7f286ce00640 1 -- 172.21.15.114:0/1562472316 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f28680c5c40 con 0x7f286815e7c0 2024-09-13T17:52:45.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.919+0000 7f285ea00640 1 -- 172.21.15.114:0/1562472316 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2850054390 con 0x7f286815e7c0 2024-09-13T17:52:45.925 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-13T17:52:45.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.923+0000 7f286ce00640 1 -- 172.21.15.114:0/1562472316 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2844066690 msgr2=0x7f2844068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:45.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.923+0000 7f286ce00640 1 --2- 172.21.15.114:0/1562472316 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2844066690 0x7f2844068b50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f28680b1f90 tx=0x7f2858008040 comp rx=0 tx=0).stop 2024-09-13T17:52:45.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.923+0000 7f286ce00640 1 -- 172.21.15.114:0/1562472316 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f286815e7c0 msgr2=0x7f28680b5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:45.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.923+0000 7f286ce00640 1 --2- 172.21.15.114:0/1562472316 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f286815e7c0 0x7f28680b5940 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f285000c500 tx=0x7f285000c9c0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.923+0000 7f286ce00640 1 -- 172.21.15.114:0/1562472316 shutdown_connections 2024-09-13T17:52:45.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.923+0000 7f286ce00640 1 --2- 172.21.15.114:0/1562472316 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2844066690 0x7f2844068b50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.923+0000 7f286ce00640 1 --2- 172.21.15.114:0/1562472316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28680b5e80 0x7f28681585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.923+0000 7f286ce00640 1 --2- 172.21.15.114:0/1562472316 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f286815e7c0 0x7f28680b5940 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.923+0000 7f286ce00640 1 --2- 172.21.15.114:0/1562472316 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f286815a650 0x7f2868158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:45.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.923+0000 7f286ce00640 1 -- 172.21.15.114:0/1562472316 >> 172.21.15.114:0/1562472316 conn(0x7f28680d04e0 msgr2=0x7f28680aff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:45.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.923+0000 7f286ce00640 1 -- 172.21.15.114:0/1562472316 shutdown_connections 2024-09-13T17:52:45.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:45.923+0000 7f286ce00640 1 -- 172.21.15.114:0/1562472316 wait complete. 2024-09-13T17:52:45.947 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T17:52:45.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:45.947 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-13T17:52:45.991 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-09-13T17:52:45.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:45.991 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:52:46.042 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:52:46.042 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:52:46.051 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:52:46.052 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:52:46.102 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:52:46.102 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:52:46.154 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:52:46.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f1742600640 1 Processor -- start 2024-09-13T17:52:46.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f1742600640 1 -- start start 2024-09-13T17:52:46.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f1742600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f173c13f420 0x7f173c06d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:46.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f1742600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f173c06da90 0x7f173c0cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:46.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f1742600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f173c0cd220 con 0x7f173c13c240 2024-09-13T17:52:46.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f1742600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f173c06df40 con 0x7f173c13f420 2024-09-13T17:52:46.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f1742600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f173c15a740 con 0x7f173c06da90 2024-09-13T17:52:46.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f173b400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f173c13c240 0x7f173c13c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46590/0 (socket says 172.21.15.114:46590) 2024-09-13T17:52:46.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f173b400640 1 -- 172.21.15.114:0/547483355 learned_addr learned my addr 172.21.15.114:0/547483355 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:46.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f1732a00640 1 --2- 172.21.15.114:0/547483355 >> v2:172.21.15.134:3300/0 conn(0x7f173c13f420 0x7f173c06d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:46.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f173be00640 1 --2- 172.21.15.114:0/547483355 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f173c06da90 0x7f173c0cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:46.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f173aa00640 1 -- 172.21.15.114:0/547483355 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1824466596 0 0) 0x7f173c0cd220 con 0x7f173c13c240 2024-09-13T17:52:46.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f173aa00640 1 -- 172.21.15.114:0/547483355 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1720003530 con 0x7f173c13c240 2024-09-13T17:52:46.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f173aa00640 1 -- 172.21.15.114:0/547483355 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3484514939 0 0) 0x7f1720003530 con 0x7f173c13c240 2024-09-13T17:52:46.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f173aa00640 1 -- 172.21.15.114:0/547483355 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f173c06da90 msgr2=0x7f173c0cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:46.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f173aa00640 1 --2- 172.21.15.114:0/547483355 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f173c06da90 0x7f173c0cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:46.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f173aa00640 1 -- 172.21.15.114:0/547483355 >> v2:172.21.15.134:3300/0 conn(0x7f173c13f420 msgr2=0x7f173c06d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:46.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f173aa00640 1 --2- 172.21.15.114:0/547483355 >> v2:172.21.15.134:3300/0 conn(0x7f173c13f420 0x7f173c06d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:46.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f173aa00640 1 -- 172.21.15.114:0/547483355 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173c159bc0 con 0x7f173c13c240 2024-09-13T17:52:46.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f173aa00640 1 -- 172.21.15.114:0/547483355 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7f172c001a00 con 0x7f173c13c240 2024-09-13T17:52:46.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f1732a00640 1 --2- 172.21.15.114:0/547483355 >> v2:172.21.15.134:3300/0 conn(0x7f173c13f420 0x7f173c06d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:52:46.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f173aa00640 1 -- 172.21.15.114:0/547483355 >> v1:172.21.15.114:6789/0 conn(0x7f173c13c240 legacy=0x7f173c13c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:46.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f173aa00640 1 --2- 172.21.15.114:0/547483355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1720003980 0x7f1720003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:46.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f173aa00640 1 --2- 172.21.15.114:0/547483355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17200047d0 0x7f1720004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:46.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f173aa00640 1 --2- 172.21.15.114:0/547483355 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f173c06da90 0x7f1720005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:46.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f173aa00640 1 -- 172.21.15.114:0/547483355 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173c06df40 con 0x7f1720003980 2024-09-13T17:52:46.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f173aa00640 1 -- 172.21.15.114:0/547483355 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173c15a740 con 0x7f17200047d0 2024-09-13T17:52:46.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f173aa00640 1 -- 172.21.15.114:0/547483355 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f172000b990 con 0x7f173c06da90 2024-09-13T17:52:46.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f173b400640 1 --2- 172.21.15.114:0/547483355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1720003980 0x7f1720003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:46.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f1732a00640 1 --2- 172.21.15.114:0/547483355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17200047d0 0x7f1720004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:46.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.287+0000 7f173be00640 1 --2- 172.21.15.114:0/547483355 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f173c06da90 0x7f1720005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:46.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.291+0000 7f173b400640 1 -- 172.21.15.114:0/547483355 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f173c06da90 msgr2=0x7f1720005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:46.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.291+0000 7f173b400640 1 --2- 172.21.15.114:0/547483355 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f173c06da90 0x7f1720005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:46.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.291+0000 7f173b400640 1 -- 172.21.15.114:0/547483355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17200047d0 msgr2=0x7f1720004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:46.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.291+0000 7f173b400640 1 --2- 172.21.15.114:0/547483355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17200047d0 0x7f1720004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:46.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.291+0000 7f173b400640 1 -- 172.21.15.114:0/547483355 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1720003530 con 0x7f1720003980 2024-09-13T17:52:46.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.291+0000 7f173b400640 1 --2- 172.21.15.114:0/547483355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1720003980 0x7f1720003da0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f172c00a860 tx=0x7f172c01d350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3b873f0b6cbef5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:46.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.291+0000 7f173aa00640 1 -- 172.21.15.114:0/547483355 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c0ad630 con 0x7f1720003980 2024-09-13T17:52:46.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.291+0000 7f173aa00640 1 -- 172.21.15.114:0/547483355 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172c0a8070 con 0x7f1720003980 2024-09-13T17:52:46.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.291+0000 7f173aa00640 1 -- 172.21.15.114:0/547483355 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172c0ada10 con 0x7f1720003980 2024-09-13T17:52:46.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.291+0000 7f1742600640 1 -- 172.21.15.114:0/547483355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1720003980 msgr2=0x7f1720003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:46.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.291+0000 7f1742600640 1 --2- 172.21.15.114:0/547483355 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1720003980 0x7f1720003da0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f172c00a860 tx=0x7f172c01d350 comp rx=0 tx=0).stop 2024-09-13T17:52:46.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.291+0000 7f173be00640 1 -- 172.21.15.114:0/547483355 reap_dead start 2024-09-13T17:52:46.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.291+0000 7f1742600640 1 -- 172.21.15.114:0/547483355 shutdown_connections 2024-09-13T17:52:46.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.291+0000 7f1742600640 1 -- 172.21.15.114:0/547483355 >> 172.21.15.114:0/547483355 conn(0x7f173c0660b0 msgr2=0x7f173c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:46.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.291+0000 7f1742600640 1 -- 172.21.15.114:0/547483355 shutdown_connections 2024-09-13T17:52:46.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.291+0000 7f1742600640 1 -- 172.21.15.114:0/547483355 wait complete. 2024-09-13T17:52:46.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.295+0000 7f1742600640 1 Processor -- start 2024-09-13T17:52:46.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.295+0000 7f1742600640 1 -- start start 2024-09-13T17:52:46.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.295+0000 7f1742600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1720003980 0x7f173c13a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:46.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.295+0000 7f1742600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f173c14fee0 0x7f173c150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:46.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.295+0000 7f1742600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f173c155ac0 0x7f173c155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:46.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.295+0000 7f1742600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173c156480 con 0x7f173c14fee0 2024-09-13T17:52:46.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.295+0000 7f1742600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173c13aee0 con 0x7f173c155ac0 2024-09-13T17:52:46.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.295+0000 7f1742600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f173c150a50 con 0x7f1720003980 2024-09-13T17:52:46.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.295+0000 7f1732a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f173c14fee0 0x7f173c150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:46.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.295+0000 7f1732a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f173c14fee0 0x7f173c150360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50380/0 (socket says 172.21.15.114:50380) 2024-09-13T17:52:46.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.295+0000 7f1732a00640 1 -- 172.21.15.114:0/108973757 learned_addr learned my addr 172.21.15.114:0/108973757 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:46.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.295+0000 7f173be00640 1 --2- 172.21.15.114:0/108973757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f173c155ac0 0x7f173c155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:46.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.295+0000 7f173b400640 1 --2- 172.21.15.114:0/108973757 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1720003980 0x7f173c13a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:46.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.295+0000 7f1732a00640 1 -- 172.21.15.114:0/108973757 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1720003980 msgr2=0x7f173c13a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:46.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.295+0000 7f1732a00640 1 --2- 172.21.15.114:0/108973757 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1720003980 0x7f173c13a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:46.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.295+0000 7f1732a00640 1 -- 172.21.15.114:0/108973757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f173c155ac0 msgr2=0x7f173c155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:46.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.295+0000 7f1732a00640 1 --2- 172.21.15.114:0/108973757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f173c155ac0 0x7f173c155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:46.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.295+0000 7f1732a00640 1 -- 172.21.15.114:0/108973757 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173c14e0f0 con 0x7f173c14fee0 2024-09-13T17:52:46.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.295+0000 7f1732a00640 1 --2- 172.21.15.114:0/108973757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f173c14fee0 0x7f173c150360 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1724011cd0 tx=0x7f172400f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:46.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.295+0000 7f1733e00640 1 -- 172.21.15.114:0/108973757 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1724011d00 con 0x7f173c14fee0 2024-09-13T17:52:46.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.295+0000 7f1733e00640 1 -- 172.21.15.114:0/108973757 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1724011e60 con 0x7f173c14fee0 2024-09-13T17:52:46.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.295+0000 7f1733e00640 1 -- 172.21.15.114:0/108973757 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1724004270 con 0x7f173c14fee0 2024-09-13T17:52:46.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.295+0000 7f1742600640 1 -- 172.21.15.114:0/108973757 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f173c14e3d0 con 0x7f173c14fee0 2024-09-13T17:52:46.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.295+0000 7f1742600640 1 -- 172.21.15.114:0/108973757 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f173c14e990 con 0x7f173c14fee0 2024-09-13T17:52:46.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.299+0000 7f1742600640 1 -- 172.21.15.114:0/108973757 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f173c14eb50 con 0x7f173c14fee0 2024-09-13T17:52:46.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.299+0000 7f1733e00640 1 -- 172.21.15.114:0/108973757 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f17240043d0 con 0x7f173c14fee0 2024-09-13T17:52:46.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.299+0000 7f1733e00640 1 --2- 172.21.15.114:0/108973757 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1718066690 0x7f1718068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:46.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.299+0000 7f1733e00640 1 -- 172.21.15.114:0/108973757 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1724084b80 con 0x7f173c14fee0 2024-09-13T17:52:46.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.299+0000 7f173b400640 1 --2- 172.21.15.114:0/108973757 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1718066690 0x7f1718068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:46.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.299+0000 7f173b400640 1 --2- 172.21.15.114:0/108973757 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1718066690 0x7f1718068b50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f172c0ad000 tx=0x7f172c001e00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:46.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.303+0000 7f1733e00640 1 -- 172.21.15.114:0/108973757 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1724051b40 con 0x7f173c14fee0 2024-09-13T17:52:46.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.459+0000 7f1742600640 1 -- 172.21.15.114:0/108973757 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f173c159790 con 0x7f173c14fee0 2024-09-13T17:52:46.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.459+0000 7f1733e00640 1 -- 172.21.15.114:0/108973757 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18784 (secure 0 0 0) 0x7f1724084e60 con 0x7f173c14fee0 2024-09-13T17:52:46.466 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:46.466 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:52:31.139000+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:51:48.278220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:51:48.773888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:51:51.856300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:52:46.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.463+0000 7f1742600640 1 -- 172.21.15.114:0/108973757 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1718066690 msgr2=0x7f1718068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:46.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.463+0000 7f1742600640 1 --2- 172.21.15.114:0/108973757 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1718066690 0x7f1718068b50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f172c0ad000 tx=0x7f172c001e00 comp rx=0 tx=0).stop 2024-09-13T17:52:46.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.463+0000 7f1742600640 1 -- 172.21.15.114:0/108973757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f173c14fee0 msgr2=0x7f173c150360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:46.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.463+0000 7f1742600640 1 --2- 172.21.15.114:0/108973757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f173c14fee0 0x7f173c150360 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1724011cd0 tx=0x7f172400f610 comp rx=0 tx=0).stop 2024-09-13T17:52:46.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.463+0000 7f1742600640 1 -- 172.21.15.114:0/108973757 shutdown_connections 2024-09-13T17:52:46.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.463+0000 7f1742600640 1 --2- 172.21.15.114:0/108973757 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1718066690 0x7f1718068b50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:46.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.463+0000 7f1742600640 1 --2- 172.21.15.114:0/108973757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f173c155ac0 0x7f173c155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:46.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.463+0000 7f1742600640 1 --2- 172.21.15.114:0/108973757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f173c14fee0 0x7f173c150360 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:46.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.463+0000 7f1742600640 1 --2- 172.21.15.114:0/108973757 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1720003980 0x7f173c13a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:46.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.463+0000 7f1742600640 1 -- 172.21.15.114:0/108973757 >> 172.21.15.114:0/108973757 conn(0x7f173c0660b0 msgr2=0x7f173c06c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:46.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.463+0000 7f1742600640 1 -- 172.21.15.114:0/108973757 shutdown_connections 2024-09-13T17:52:46.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.463+0000 7f1742600640 1 -- 172.21.15.114:0/108973757 wait complete. 2024-09-13T17:52:46.486 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:51:37.996254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:51:48.278220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:51:48.773888+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:51:51.856300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:52:46.487 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:52:46.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.619+0000 7fe986400640 1 Processor -- start 2024-09-13T17:52:46.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.619+0000 7fe986400640 1 -- start start 2024-09-13T17:52:46.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.619+0000 7fe986400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe980070420 0x7fe980070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:46.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.619+0000 7fe986400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe98006c540 0x7fe98006c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:46.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.619+0000 7fe986400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe980151800 con 0x7fe980151420 2024-09-13T17:52:46.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.619+0000 7fe986400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9800cbc30 con 0x7fe980070420 2024-09-13T17:52:46.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.623+0000 7fe986400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe980070dd0 con 0x7fe98006c540 2024-09-13T17:52:46.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.623+0000 7fe97ea00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe980070420 0x7fe980070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:46.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.623+0000 7fe97ea00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe980070420 0x7fe980070890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50386/0 (socket says 172.21.15.114:50386) 2024-09-13T17:52:46.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.623+0000 7fe97ea00640 1 -- 172.21.15.114:0/2141193646 learned_addr learned my addr 172.21.15.114:0/2141193646 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:46.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.623+0000 7fe97fe00640 1 --2- 172.21.15.114:0/2141193646 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe98006c540 0x7fe98006c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:46.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.623+0000 7fe97ea00640 1 -- 172.21.15.114:0/2141193646 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe98006c540 msgr2=0x7fe98006c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:46.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.623+0000 7fe97ea00640 1 --2- 172.21.15.114:0/2141193646 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe98006c540 0x7fe98006c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:46.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.623+0000 7fe97ea00640 1 -- 172.21.15.114:0/2141193646 >> v1:172.21.15.134:6789/0 conn(0x7fe980151420 legacy=0x7fe9800cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:46.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.623+0000 7fe97ea00640 1 -- 172.21.15.114:0/2141193646 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9800cafb0 con 0x7fe980070420 2024-09-13T17:52:46.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.623+0000 7fe97ea00640 1 --2- 172.21.15.114:0/2141193646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe980070420 0x7fe980070890 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009870 tx=0x7fe96c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17ced703ba0fddd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:46.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.623+0000 7fe97e000640 1 -- 172.21.15.114:0/2141193646 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c0ab610 con 0x7fe980070420 2024-09-13T17:52:46.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.623+0000 7fe97e000640 1 -- 172.21.15.114:0/2141193646 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96c0ab770 con 0x7fe980070420 2024-09-13T17:52:46.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.623+0000 7fe97e000640 1 -- 172.21.15.114:0/2141193646 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c0abb00 con 0x7fe980070420 2024-09-13T17:52:46.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.627+0000 7fe986400640 1 -- 172.21.15.114:0/2141193646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe980070420 msgr2=0x7fe980070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:46.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.627+0000 7fe986400640 1 --2- 172.21.15.114:0/2141193646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe980070420 0x7fe980070890 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009870 tx=0x7fe96c01c410 comp rx=0 tx=0).stop 2024-09-13T17:52:46.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.627+0000 7fe986400640 1 -- 172.21.15.114:0/2141193646 shutdown_connections 2024-09-13T17:52:46.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.627+0000 7fe986400640 1 --2- 172.21.15.114:0/2141193646 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe98006c540 0x7fe98006c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:46.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.627+0000 7fe986400640 1 --2- 172.21.15.114:0/2141193646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe980070420 0x7fe980070890 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:46.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.627+0000 7fe986400640 1 -- 172.21.15.114:0/2141193646 >> 172.21.15.114:0/2141193646 conn(0x7fe9800660b0 msgr2=0x7fe980069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:46.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.627+0000 7fe986400640 1 -- 172.21.15.114:0/2141193646 shutdown_connections 2024-09-13T17:52:46.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.627+0000 7fe986400640 1 -- 172.21.15.114:0/2141193646 wait complete. 2024-09-13T17:52:46.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.627+0000 7fe986400640 1 Processor -- start 2024-09-13T17:52:46.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.627+0000 7fe986400640 1 -- start start 2024-09-13T17:52:46.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.627+0000 7fe986400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe98006c540 0x7fe9800aa370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:46.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.627+0000 7fe986400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe980070420 0x7fe98015ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:46.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.627+0000 7fe986400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe980151420 0x7fe980163af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:46.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.627+0000 7fe986400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9800b19b0 con 0x7fe980070420 2024-09-13T17:52:46.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.627+0000 7fe986400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9800b1c90 con 0x7fe980151420 2024-09-13T17:52:46.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.627+0000 7fe986400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9800b1f70 con 0x7fe98006c540 2024-09-13T17:52:46.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.627+0000 7fe97ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe980070420 0x7fe98015ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:46.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.627+0000 7fe97ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe980070420 0x7fe98015ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50394/0 (socket says 172.21.15.114:50394) 2024-09-13T17:52:46.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.627+0000 7fe97ea00640 1 -- 172.21.15.114:0/3127014036 learned_addr learned my addr 172.21.15.114:0/3127014036 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:46.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.627+0000 7fe97f400640 1 --2- 172.21.15.114:0/3127014036 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe98006c540 0x7fe9800aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:46.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.627+0000 7fe97fe00640 1 --2- 172.21.15.114:0/3127014036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe980151420 0x7fe980163af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:46.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.631+0000 7fe97ea00640 1 -- 172.21.15.114:0/3127014036 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe98006c540 msgr2=0x7fe9800aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:46.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.631+0000 7fe97ea00640 1 --2- 172.21.15.114:0/3127014036 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe98006c540 0x7fe9800aa370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:46.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.631+0000 7fe97ea00640 1 -- 172.21.15.114:0/3127014036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe980151420 msgr2=0x7fe980163af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:46.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.631+0000 7fe97ea00640 1 --2- 172.21.15.114:0/3127014036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe980151420 0x7fe980163af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:46.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.631+0000 7fe97ea00640 1 -- 172.21.15.114:0/3127014036 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96c0094d0 con 0x7fe980070420 2024-09-13T17:52:46.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.631+0000 7fe97ea00640 1 --2- 172.21.15.114:0/3127014036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe980070420 0x7fe98015ab00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe96c01a040 tx=0x7fe96c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:46.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.631+0000 7fe977400640 1 -- 172.21.15.114:0/3127014036 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c0ab610 con 0x7fe980070420 2024-09-13T17:52:46.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.631+0000 7fe977400640 1 -- 172.21.15.114:0/3127014036 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96c0b4800 con 0x7fe980070420 2024-09-13T17:52:46.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.631+0000 7fe977400640 1 -- 172.21.15.114:0/3127014036 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c0b4bb0 con 0x7fe980070420 2024-09-13T17:52:46.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.631+0000 7fe986400640 1 -- 172.21.15.114:0/3127014036 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9800b2250 con 0x7fe980070420 2024-09-13T17:52:46.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.631+0000 7fe986400640 1 -- 172.21.15.114:0/3127014036 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9800aa8b0 con 0x7fe980070420 2024-09-13T17:52:46.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.631+0000 7fe986400640 1 -- 172.21.15.114:0/3127014036 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe98006c970 con 0x7fe980070420 2024-09-13T17:52:46.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.631+0000 7fe977400640 1 -- 172.21.15.114:0/3127014036 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe96c0b4d10 con 0x7fe980070420 2024-09-13T17:52:46.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.631+0000 7fe977400640 1 --2- 172.21.15.114:0/3127014036 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe960066690 0x7fe960068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:46.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.631+0000 7fe977400640 1 -- 172.21.15.114:0/3127014036 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe96c11f160 con 0x7fe980070420 2024-09-13T17:52:46.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.631+0000 7fe97f400640 1 --2- 172.21.15.114:0/3127014036 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe960066690 0x7fe960068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:46.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.635+0000 7fe97f400640 1 --2- 172.21.15.114:0/3127014036 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe960066690 0x7fe960068b50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe970007fd0 tx=0x7fe970009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:46.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.635+0000 7fe977400640 1 -- 172.21.15.114:0/3127014036 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe96c0ec120 con 0x7fe980070420 2024-09-13T17:52:46.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.791+0000 7fe986400640 1 -- 172.21.15.114:0/3127014036 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe9800cc7e0 con 0x7fe980070420 2024-09-13T17:52:46.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.791+0000 7fe977400640 1 -- 172.21.15.114:0/3127014036 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe96c0ef740 con 0x7fe980070420 2024-09-13T17:52:46.795 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-13T17:52:46.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.791+0000 7fe986400640 1 -- 172.21.15.114:0/3127014036 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe960066690 msgr2=0x7fe960068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:46.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.791+0000 7fe986400640 1 --2- 172.21.15.114:0/3127014036 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe960066690 0x7fe960068b50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe970007fd0 tx=0x7fe970009040 comp rx=0 tx=0).stop 2024-09-13T17:52:46.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.791+0000 7fe986400640 1 -- 172.21.15.114:0/3127014036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe980070420 msgr2=0x7fe98015ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:46.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.791+0000 7fe986400640 1 --2- 172.21.15.114:0/3127014036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe980070420 0x7fe98015ab00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe96c01a040 tx=0x7fe96c01ac50 comp rx=0 tx=0).stop 2024-09-13T17:52:46.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.791+0000 7fe986400640 1 -- 172.21.15.114:0/3127014036 shutdown_connections 2024-09-13T17:52:46.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.791+0000 7fe986400640 1 --2- 172.21.15.114:0/3127014036 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe960066690 0x7fe960068b50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:46.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.791+0000 7fe986400640 1 --2- 172.21.15.114:0/3127014036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe980151420 0x7fe980163af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:46.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.791+0000 7fe986400640 1 --2- 172.21.15.114:0/3127014036 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe980070420 0x7fe98015ab00 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:46.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.791+0000 7fe986400640 1 --2- 172.21.15.114:0/3127014036 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe98006c540 0x7fe9800aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:46.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.791+0000 7fe986400640 1 -- 172.21.15.114:0/3127014036 >> 172.21.15.114:0/3127014036 conn(0x7fe9800660b0 msgr2=0x7fe98015d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:46.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.791+0000 7fe986400640 1 -- 172.21.15.114:0/3127014036 shutdown_connections 2024-09-13T17:52:46.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.791+0000 7fe986400640 1 -- 172.21.15.114:0/3127014036 wait complete. 2024-09-13T17:52:46.816 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:52:46.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.951+0000 7f1095200640 1 Processor -- start 2024-09-13T17:52:46.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.951+0000 7f1095200640 1 -- start start 2024-09-13T17:52:46.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.951+0000 7f1095200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f109013c240 0x7f109013f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:46.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.951+0000 7f1095200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f109013c980 0x7f109006d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:46.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.951+0000 7f1095200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f109006da90 0x7f10900cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:46.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.951+0000 7f1095200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f109006df40 con 0x7f109013c240 2024-09-13T17:52:46.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.951+0000 7f1095200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10900cd220 con 0x7f109013c980 2024-09-13T17:52:46.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.951+0000 7f1095200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109013f960 con 0x7f109006da90 2024-09-13T17:52:46.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.951+0000 7f108de00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f109013c240 0x7f109013f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:46.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.951+0000 7f108de00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f109013c240 0x7f109013f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50400/0 (socket says 172.21.15.114:50400) 2024-09-13T17:52:46.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.951+0000 7f108de00640 1 -- 172.21.15.114:0/1737801460 learned_addr learned my addr 172.21.15.114:0/1737801460 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:46.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.951+0000 7f1085400640 1 --2- 172.21.15.114:0/1737801460 >> v2:172.21.15.134:3300/0 conn(0x7f109013c980 0x7f109006d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:46.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.951+0000 7f108de00640 1 -- 172.21.15.114:0/1737801460 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f109006da90 msgr2=0x7f10900cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:46.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.951+0000 7f108e800640 1 --2- 172.21.15.114:0/1737801460 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f109006da90 0x7f10900cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:46.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.951+0000 7f108de00640 1 --2- 172.21.15.114:0/1737801460 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f109006da90 0x7f10900cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:46.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.951+0000 7f108de00640 1 -- 172.21.15.114:0/1737801460 >> v2:172.21.15.134:3300/0 conn(0x7f109013c980 msgr2=0x7f109006d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:46.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.951+0000 7f108de00640 1 --2- 172.21.15.114:0/1737801460 >> v2:172.21.15.134:3300/0 conn(0x7f109013c980 0x7f109006d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:46.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.951+0000 7f108de00640 1 -- 172.21.15.114:0/1737801460 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109015a740 con 0x7f109013c240 2024-09-13T17:52:46.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.951+0000 7f1085400640 1 --2- 172.21.15.114:0/1737801460 >> v2:172.21.15.134:3300/0 conn(0x7f109013c980 0x7f109006d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:52:46.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.951+0000 7f108e800640 1 --2- 172.21.15.114:0/1737801460 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f109006da90 0x7f10900cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:52:46.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.955+0000 7f108de00640 1 --2- 172.21.15.114:0/1737801460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f109013c240 0x7f109013f420 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f10900ae130 tx=0x7f108001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcced99ced2a13d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:46.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.955+0000 7f108d400640 1 -- 172.21.15.114:0/1737801460 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10800aa610 con 0x7f109013c240 2024-09-13T17:52:46.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.955+0000 7f108d400640 1 -- 172.21.15.114:0/1737801460 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10800a6040 con 0x7f109013c240 2024-09-13T17:52:46.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.955+0000 7f108d400640 1 -- 172.21.15.114:0/1737801460 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10800aa990 con 0x7f109013c240 2024-09-13T17:52:46.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.955+0000 7f1095200640 1 -- 172.21.15.114:0/1737801460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f109013c240 msgr2=0x7f109013f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:46.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.955+0000 7f1095200640 1 --2- 172.21.15.114:0/1737801460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f109013c240 0x7f109013f420 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f10900ae130 tx=0x7f108001c4f0 comp rx=0 tx=0).stop 2024-09-13T17:52:46.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.955+0000 7f1095200640 1 -- 172.21.15.114:0/1737801460 shutdown_connections 2024-09-13T17:52:46.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.955+0000 7f1095200640 1 --2- 172.21.15.114:0/1737801460 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f109006da90 0x7f10900cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:46.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.955+0000 7f1095200640 1 --2- 172.21.15.114:0/1737801460 >> v2:172.21.15.134:3300/0 conn(0x7f109013c980 0x7f109006d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:46.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.955+0000 7f1095200640 1 --2- 172.21.15.114:0/1737801460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f109013c240 0x7f109013f420 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:46.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.955+0000 7f1095200640 1 -- 172.21.15.114:0/1737801460 >> 172.21.15.114:0/1737801460 conn(0x7f10900660b0 msgr2=0x7f1090069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:46.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.955+0000 7f1095200640 1 -- 172.21.15.114:0/1737801460 shutdown_connections 2024-09-13T17:52:46.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.955+0000 7f1095200640 1 -- 172.21.15.114:0/1737801460 wait complete. 2024-09-13T17:52:46.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.959+0000 7f1095200640 1 Processor -- start 2024-09-13T17:52:46.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.959+0000 7f1095200640 1 -- start start 2024-09-13T17:52:46.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.959+0000 7f1095200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f109006da90 0x7f109013ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:46.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.959+0000 7f1095200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f109013c240 0x7f10900ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:46.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.959+0000 7f1095200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f109013c980 0x7f109013e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:46.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.959+0000 7f1095200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10900afb00 con 0x7f109006da90 2024-09-13T17:52:46.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.959+0000 7f1095200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10900aef80 con 0x7f109013c980 2024-09-13T17:52:46.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.959+0000 7f1095200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10900af260 con 0x7f109013c240 2024-09-13T17:52:46.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.959+0000 7f108de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f109006da90 0x7f109013ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:46.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.959+0000 7f108de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f109006da90 0x7f109013ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50404/0 (socket says 172.21.15.114:50404) 2024-09-13T17:52:46.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.959+0000 7f108de00640 1 -- 172.21.15.114:0/1632558548 learned_addr learned my addr 172.21.15.114:0/1632558548 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:46.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.959+0000 7f1085400640 1 --2- 172.21.15.114:0/1632558548 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f109013c240 0x7f10900ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:46.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.959+0000 7f108e800640 1 --2- 172.21.15.114:0/1632558548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f109013c980 0x7f109013e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:46.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.959+0000 7f108de00640 1 -- 172.21.15.114:0/1632558548 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f109013c240 msgr2=0x7f10900ae180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:46.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.959+0000 7f108de00640 1 --2- 172.21.15.114:0/1632558548 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f109013c240 0x7f10900ae180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:46.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.959+0000 7f108de00640 1 -- 172.21.15.114:0/1632558548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f109013c980 msgr2=0x7f109013e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:46.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.959+0000 7f108de00640 1 --2- 172.21.15.114:0/1632558548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f109013c980 0x7f109013e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:46.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.959+0000 7f108de00640 1 -- 172.21.15.114:0/1632558548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10800094d0 con 0x7f109006da90 2024-09-13T17:52:46.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.959+0000 7f108de00640 1 --2- 172.21.15.114:0/1632558548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f109006da90 0x7f109013ab40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f10800ac040 tx=0x7f1080019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:46.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.959+0000 7f1086a00640 1 -- 172.21.15.114:0/1632558548 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10800b3600 con 0x7f109006da90 2024-09-13T17:52:46.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.959+0000 7f1086a00640 1 -- 172.21.15.114:0/1632558548 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10800b3780 con 0x7f109006da90 2024-09-13T17:52:46.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.959+0000 7f1095200640 1 -- 172.21.15.114:0/1632558548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f109015a230 con 0x7f109006da90 2024-09-13T17:52:46.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.959+0000 7f1086a00640 1 -- 172.21.15.114:0/1632558548 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10800b3b30 con 0x7f109006da90 2024-09-13T17:52:46.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.959+0000 7f1095200640 1 -- 172.21.15.114:0/1632558548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10900af820 con 0x7f109006da90 2024-09-13T17:52:46.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.959+0000 7f1095200640 1 -- 172.21.15.114:0/1632558548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1090159790 con 0x7f109006da90 2024-09-13T17:52:46.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.963+0000 7f1086a00640 1 -- 172.21.15.114:0/1632558548 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f10800b3c90 con 0x7f109006da90 2024-09-13T17:52:46.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.963+0000 7f1086a00640 1 --2- 172.21.15.114:0/1632558548 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f106c066690 0x7f106c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:46.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.963+0000 7f1086a00640 1 -- 172.21.15.114:0/1632558548 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f108011f060 con 0x7f109006da90 2024-09-13T17:52:46.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.963+0000 7f1085400640 1 --2- 172.21.15.114:0/1632558548 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f106c066690 0x7f106c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:46.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.963+0000 7f1085400640 1 --2- 172.21.15.114:0/1632558548 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f106c066690 0x7f106c068b50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1078006fd0 tx=0x7f1078008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:46.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:46.967+0000 7f1086a00640 1 -- 172.21.15.114:0/1632558548 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f10800ec000 con 0x7f109006da90 2024-09-13T17:52:47.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.119+0000 7f1095200640 1 -- 172.21.15.114:0/1632558548 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1090157f60 con 0x7f109006da90 2024-09-13T17:52:47.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.119+0000 7f1086a00640 1 -- 172.21.15.114:0/1632558548 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f10800ef620 con 0x7f109006da90 2024-09-13T17:52:47.126 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:52:47.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.123+0000 7f1095200640 1 -- 172.21.15.114:0/1632558548 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f106c066690 msgr2=0x7f106c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:47.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.123+0000 7f1095200640 1 --2- 172.21.15.114:0/1632558548 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f106c066690 0x7f106c068b50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1078006fd0 tx=0x7f1078008040 comp rx=0 tx=0).stop 2024-09-13T17:52:47.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.123+0000 7f1095200640 1 -- 172.21.15.114:0/1632558548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f109006da90 msgr2=0x7f109013ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:47.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.123+0000 7f1095200640 1 --2- 172.21.15.114:0/1632558548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f109006da90 0x7f109013ab40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f10800ac040 tx=0x7f1080019290 comp rx=0 tx=0).stop 2024-09-13T17:52:47.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.123+0000 7f1095200640 1 -- 172.21.15.114:0/1632558548 shutdown_connections 2024-09-13T17:52:47.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.123+0000 7f1095200640 1 --2- 172.21.15.114:0/1632558548 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f106c066690 0x7f106c068b50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.123+0000 7f1095200640 1 --2- 172.21.15.114:0/1632558548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f109013c980 0x7f109013e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.123+0000 7f1095200640 1 --2- 172.21.15.114:0/1632558548 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f109013c240 0x7f10900ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.123+0000 7f1095200640 1 --2- 172.21.15.114:0/1632558548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f109006da90 0x7f109013ab40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.123+0000 7f1095200640 1 -- 172.21.15.114:0/1632558548 >> 172.21.15.114:0/1632558548 conn(0x7f10900660b0 msgr2=0x7f109006c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:47.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.123+0000 7f1095200640 1 -- 172.21.15.114:0/1632558548 shutdown_connections 2024-09-13T17:52:47.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.123+0000 7f1095200640 1 -- 172.21.15.114:0/1632558548 wait complete. 2024-09-13T17:52:47.146 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:52:47.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.279+0000 7f791cc00640 1 Processor -- start 2024-09-13T17:52:47.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.279+0000 7f791cc00640 1 -- start start 2024-09-13T17:52:47.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.283+0000 7f791cc00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f79181538d0 0x7f79180b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:47.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.283+0000 7f791cc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f791806dd70 0x7f7918071280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:47.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.283+0000 7f791cc00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f791815a6c0 con 0x7f791815a1e0 2024-09-13T17:52:47.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.283+0000 7f791cc00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7918153cb0 con 0x7f79181538d0 2024-09-13T17:52:47.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.283+0000 7f791cc00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79180abe30 con 0x7f791806dd70 2024-09-13T17:52:47.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.283+0000 7f790fe00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f791806dd70 0x7f7918071280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:47.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.283+0000 7f7917400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f79181538d0 0x7f79180b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:47.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.283+0000 7f790fe00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f791806dd70 0x7f7918071280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:41848/0 (socket says 172.21.15.114:41848) 2024-09-13T17:52:47.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.283+0000 7f790fe00640 1 -- 172.21.15.114:0/47827190 learned_addr learned my addr 172.21.15.114:0/47827190 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:47.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.283+0000 7f7917400640 1 --2- 172.21.15.114:0/47827190 >> v2:172.21.15.134:3300/0 conn(0x7f79181538d0 0x7f79180b1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:51128/0 (socket says 172.21.15.114:51128) 2024-09-13T17:52:47.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.283+0000 7f7917400640 1 -- 172.21.15.114:0/47827190 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f791806dd70 msgr2=0x7f7918071280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:47.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.283+0000 7f7917400640 1 --2- 172.21.15.114:0/47827190 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f791806dd70 0x7f7918071280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.283+0000 7f7917400640 1 -- 172.21.15.114:0/47827190 >> v1:172.21.15.134:6789/0 conn(0x7f791815a1e0 legacy=0x7f79180acbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:47.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.283+0000 7f7917400640 1 -- 172.21.15.114:0/47827190 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79180ac110 con 0x7f79181538d0 2024-09-13T17:52:47.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.287+0000 7f7917400640 1 --2- 172.21.15.114:0/47827190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79181538d0 0x7f79180b1080 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f79080097c0 tx=0x7f790801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7419ada0b34752e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:47.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.287+0000 7f7916a00640 1 -- 172.21.15.114:0/47827190 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79080ab670 con 0x7f79181538d0 2024-09-13T17:52:47.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.287+0000 7f7916a00640 1 -- 172.21.15.114:0/47827190 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79080ab7d0 con 0x7f79181538d0 2024-09-13T17:52:47.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.287+0000 7f7916a00640 1 -- 172.21.15.114:0/47827190 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79080abb60 con 0x7f79181538d0 2024-09-13T17:52:47.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.287+0000 7f791cc00640 1 -- 172.21.15.114:0/47827190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79181538d0 msgr2=0x7f79180b1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:47.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.287+0000 7f791cc00640 1 --2- 172.21.15.114:0/47827190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79181538d0 0x7f79180b1080 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f79080097c0 tx=0x7f790801c470 comp rx=0 tx=0).stop 2024-09-13T17:52:47.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.287+0000 7f791cc00640 1 -- 172.21.15.114:0/47827190 shutdown_connections 2024-09-13T17:52:47.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.287+0000 7f791cc00640 1 --2- 172.21.15.114:0/47827190 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f791806dd70 0x7f7918071280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.287+0000 7f791cc00640 1 --2- 172.21.15.114:0/47827190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79181538d0 0x7f79180b1080 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.287+0000 7f791cc00640 1 -- 172.21.15.114:0/47827190 >> 172.21.15.114:0/47827190 conn(0x7f79180ce0d0 msgr2=0x7f79180ce4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:47.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.287+0000 7f791cc00640 1 -- 172.21.15.114:0/47827190 shutdown_connections 2024-09-13T17:52:47.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.287+0000 7f791cc00640 1 -- 172.21.15.114:0/47827190 wait complete. 2024-09-13T17:52:47.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.287+0000 7f791cc00640 1 Processor -- start 2024-09-13T17:52:47.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.287+0000 7f791cc00640 1 -- start start 2024-09-13T17:52:47.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.291+0000 7f791cc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f791806dd70 0x7f7918097a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:47.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.291+0000 7f791cc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79181538d0 0x7f791815b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:47.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.291+0000 7f791cc00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f791815a1e0 0x7f791815bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:47.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.291+0000 7f791cc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7918097f60 con 0x7f791806dd70 2024-09-13T17:52:47.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.291+0000 7f791cc00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79180cac60 con 0x7f791815a1e0 2024-09-13T17:52:47.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.291+0000 7f791cc00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79180caf40 con 0x7f79181538d0 2024-09-13T17:52:47.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.291+0000 7f7917400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f791806dd70 0x7f7918097a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:47.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.291+0000 7f7917400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f791806dd70 0x7f7918097a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50408/0 (socket says 172.21.15.114:50408) 2024-09-13T17:52:47.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.291+0000 7f7917400640 1 -- 172.21.15.114:0/3916908069 learned_addr learned my addr 172.21.15.114:0/3916908069 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:47.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.291+0000 7f790fe00640 1 --2- 172.21.15.114:0/3916908069 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79181538d0 0x7f791815b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:47.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.291+0000 7f7917e00640 1 --2- 172.21.15.114:0/3916908069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f791815a1e0 0x7f791815bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:47.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.291+0000 7f7917400640 1 -- 172.21.15.114:0/3916908069 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79181538d0 msgr2=0x7f791815b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:47.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.291+0000 7f7917400640 1 --2- 172.21.15.114:0/3916908069 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79181538d0 0x7f791815b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.291+0000 7f7917400640 1 -- 172.21.15.114:0/3916908069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f791815a1e0 msgr2=0x7f791815bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:47.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.291+0000 7f7917400640 1 --2- 172.21.15.114:0/3916908069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f791815a1e0 0x7f791815bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.291+0000 7f7917400640 1 -- 172.21.15.114:0/3916908069 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7908009420 con 0x7f791806dd70 2024-09-13T17:52:47.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.291+0000 7f7917e00640 1 --2- 172.21.15.114:0/3916908069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f791815a1e0 0x7f791815bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:47.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.291+0000 7f7917400640 1 --2- 172.21.15.114:0/3916908069 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f791806dd70 0x7f7918097a20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f790801a0a0 tx=0x7f790801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:47.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.291+0000 7f790f400640 1 -- 172.21.15.114:0/3916908069 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79080b5810 con 0x7f791806dd70 2024-09-13T17:52:47.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.291+0000 7f790f400640 1 -- 172.21.15.114:0/3916908069 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79080b5990 con 0x7f791806dd70 2024-09-13T17:52:47.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.291+0000 7f791cc00640 1 -- 172.21.15.114:0/3916908069 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79180cb220 con 0x7f791806dd70 2024-09-13T17:52:47.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.291+0000 7f790f400640 1 -- 172.21.15.114:0/3916908069 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79080b5d40 con 0x7f791806dd70 2024-09-13T17:52:47.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.291+0000 7f791cc00640 1 -- 172.21.15.114:0/3916908069 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79180cb7e0 con 0x7f791806dd70 2024-09-13T17:52:47.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.291+0000 7f791cc00640 1 -- 172.21.15.114:0/3916908069 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79180ca9d0 con 0x7f791806dd70 2024-09-13T17:52:47.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.291+0000 7f790f400640 1 -- 172.21.15.114:0/3916908069 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f79080b4390 con 0x7f791806dd70 2024-09-13T17:52:47.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.295+0000 7f790f400640 1 --2- 172.21.15.114:0/3916908069 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f78f4066690 0x7f78f4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:47.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.295+0000 7f790f400640 1 -- 172.21.15.114:0/3916908069 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f790811ec60 con 0x7f791806dd70 2024-09-13T17:52:47.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.295+0000 7f790fe00640 1 --2- 172.21.15.114:0/3916908069 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f78f4066690 0x7f78f4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:47.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.295+0000 7f790fe00640 1 --2- 172.21.15.114:0/3916908069 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f78f4066690 0x7f78f4068b50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f790000b240 tx=0x7f790000b450 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:47.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.299+0000 7f790f400640 1 -- 172.21.15.114:0/3916908069 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f79080ebc20 con 0x7f791806dd70 2024-09-13T17:52:47.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.451+0000 7f791cc00640 1 -- 172.21.15.114:0/3916908069 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f79181591a0 con 0x7f791806dd70 2024-09-13T17:52:47.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.451+0000 7f790f400640 1 -- 172.21.15.114:0/3916908069 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f79080ef240 con 0x7f791806dd70 2024-09-13T17:52:47.457 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-09-13T17:52:47.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.455+0000 7f791cc00640 1 -- 172.21.15.114:0/3916908069 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f78f4066690 msgr2=0x7f78f4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:47.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.455+0000 7f791cc00640 1 --2- 172.21.15.114:0/3916908069 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f78f4066690 0x7f78f4068b50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f790000b240 tx=0x7f790000b450 comp rx=0 tx=0).stop 2024-09-13T17:52:47.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.455+0000 7f791cc00640 1 -- 172.21.15.114:0/3916908069 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f791806dd70 msgr2=0x7f7918097a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:47.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.455+0000 7f791cc00640 1 --2- 172.21.15.114:0/3916908069 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f791806dd70 0x7f7918097a20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f790801a0a0 tx=0x7f790801acb0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.455+0000 7f791cc00640 1 -- 172.21.15.114:0/3916908069 shutdown_connections 2024-09-13T17:52:47.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.455+0000 7f791cc00640 1 --2- 172.21.15.114:0/3916908069 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f78f4066690 0x7f78f4068b50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.455+0000 7f791cc00640 1 --2- 172.21.15.114:0/3916908069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f791815a1e0 0x7f791815bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.455+0000 7f791cc00640 1 --2- 172.21.15.114:0/3916908069 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f79181538d0 0x7f791815b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.455+0000 7f791cc00640 1 --2- 172.21.15.114:0/3916908069 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f791806dd70 0x7f7918097a20 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.455+0000 7f791cc00640 1 -- 172.21.15.114:0/3916908069 >> 172.21.15.114:0/3916908069 conn(0x7f79180ce0d0 msgr2=0x7f79180ae7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:47.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.455+0000 7f791cc00640 1 -- 172.21.15.114:0/3916908069 shutdown_connections 2024-09-13T17:52:47.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.455+0000 7f791cc00640 1 -- 172.21.15.114:0/3916908069 wait complete. 2024-09-13T17:52:47.477 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:52:47.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.611+0000 7f4eb0e00640 1 Processor -- start 2024-09-13T17:52:47.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.611+0000 7f4eb0e00640 1 -- start start 2024-09-13T17:52:47.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.611+0000 7f4eb0e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4eac070420 0x7f4eac070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:47.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.611+0000 7f4eb0e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4eac06c540 0x7f4eac06c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:47.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.611+0000 7f4eb0e00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eac151800 con 0x7f4eac151420 2024-09-13T17:52:47.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.611+0000 7f4eb0e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eac0cbc30 con 0x7f4eac06c540 2024-09-13T17:52:47.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.611+0000 7f4eb0e00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eac070dd0 con 0x7f4eac070420 2024-09-13T17:52:47.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.611+0000 7f4eaa800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4eac06c540 0x7f4eac06c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:47.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.611+0000 7f4eaa800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4eac06c540 0x7f4eac06c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50424/0 (socket says 172.21.15.114:50424) 2024-09-13T17:52:47.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.611+0000 7f4eaa800640 1 -- 172.21.15.114:0/2057710687 learned_addr learned my addr 172.21.15.114:0/2057710687 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:47.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.611+0000 7f4ea9400640 1 --2- 172.21.15.114:0/2057710687 >> v2:172.21.15.134:3300/0 conn(0x7f4eac070420 0x7f4eac070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:47.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.611+0000 7f4eaa800640 1 -- 172.21.15.114:0/2057710687 >> v2:172.21.15.134:3300/0 conn(0x7f4eac070420 msgr2=0x7f4eac070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:47.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.611+0000 7f4eaa800640 1 --2- 172.21.15.114:0/2057710687 >> v2:172.21.15.134:3300/0 conn(0x7f4eac070420 0x7f4eac070890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.611+0000 7f4eaa800640 1 -- 172.21.15.114:0/2057710687 >> v1:172.21.15.134:6789/0 conn(0x7f4eac151420 legacy=0x7f4eac0cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:47.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.611+0000 7f4eaa800640 1 -- 172.21.15.114:0/2057710687 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eac0cafb0 con 0x7f4eac06c540 2024-09-13T17:52:47.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.615+0000 7f4eaa800640 1 --2- 172.21.15.114:0/2057710687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4eac06c540 0x7f4eac06c970 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4eac06e510 tx=0x7f4ea401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5077e7d41e4bd86b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:47.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.615+0000 7f4ea8a00640 1 -- 172.21.15.114:0/2057710687 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea40ac630 con 0x7f4eac06c540 2024-09-13T17:52:47.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.615+0000 7f4ea8a00640 1 -- 172.21.15.114:0/2057710687 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea40ac790 con 0x7f4eac06c540 2024-09-13T17:52:47.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.615+0000 7f4ea8a00640 1 -- 172.21.15.114:0/2057710687 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea40acb20 con 0x7f4eac06c540 2024-09-13T17:52:47.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.615+0000 7f4eb0e00640 1 -- 172.21.15.114:0/2057710687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4eac06c540 msgr2=0x7f4eac06c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:47.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.615+0000 7f4eb0e00640 1 --2- 172.21.15.114:0/2057710687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4eac06c540 0x7f4eac06c970 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4eac06e510 tx=0x7f4ea401c3d0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.615+0000 7f4eb0e00640 1 -- 172.21.15.114:0/2057710687 shutdown_connections 2024-09-13T17:52:47.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.615+0000 7f4eb0e00640 1 --2- 172.21.15.114:0/2057710687 >> v2:172.21.15.134:3300/0 conn(0x7f4eac070420 0x7f4eac070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.615+0000 7f4eb0e00640 1 --2- 172.21.15.114:0/2057710687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4eac06c540 0x7f4eac06c970 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.615+0000 7f4eb0e00640 1 -- 172.21.15.114:0/2057710687 >> 172.21.15.114:0/2057710687 conn(0x7f4eac0660b0 msgr2=0x7f4eac069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:47.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.615+0000 7f4eb0e00640 1 -- 172.21.15.114:0/2057710687 shutdown_connections 2024-09-13T17:52:47.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.615+0000 7f4eb0e00640 1 -- 172.21.15.114:0/2057710687 wait complete. 2024-09-13T17:52:47.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.619+0000 7f4eb0e00640 1 Processor -- start 2024-09-13T17:52:47.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.619+0000 7f4eb0e00640 1 -- start start 2024-09-13T17:52:47.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.619+0000 7f4eb0e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eac06c540 0x7f4eac14e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:47.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.619+0000 7f4eb0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4eac070420 0x7f4eac14fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:47.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.619+0000 7f4eb0e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4eac151420 0x7f4eac1502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:47.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.619+0000 7f4eb0e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac133650 con 0x7f4eac070420 2024-09-13T17:52:47.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.619+0000 7f4eb0e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac133ef0 con 0x7f4eac151420 2024-09-13T17:52:47.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.619+0000 7f4eb0e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac150af0 con 0x7f4eac06c540 2024-09-13T17:52:47.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.619+0000 7f4ea9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4eac070420 0x7f4eac14fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:47.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.619+0000 7f4ea9400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4eac070420 0x7f4eac14fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50430/0 (socket says 172.21.15.114:50430) 2024-09-13T17:52:47.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.619+0000 7f4ea9400640 1 -- 172.21.15.114:0/2412885844 learned_addr learned my addr 172.21.15.114:0/2412885844 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:47.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.619+0000 7f4ea9e00640 1 --2- 172.21.15.114:0/2412885844 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eac06c540 0x7f4eac14e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:47.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.619+0000 7f4eaa800640 1 --2- 172.21.15.114:0/2412885844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4eac151420 0x7f4eac1502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:47.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.619+0000 7f4ea9400640 1 -- 172.21.15.114:0/2412885844 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eac06c540 msgr2=0x7f4eac14e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:47.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.619+0000 7f4ea9400640 1 --2- 172.21.15.114:0/2412885844 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eac06c540 0x7f4eac14e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.619+0000 7f4ea9400640 1 -- 172.21.15.114:0/2412885844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4eac151420 msgr2=0x7f4eac1502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:47.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.619+0000 7f4ea9400640 1 --2- 172.21.15.114:0/2412885844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4eac151420 0x7f4eac1502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.619+0000 7f4ea9400640 1 -- 172.21.15.114:0/2412885844 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea40094d0 con 0x7f4eac070420 2024-09-13T17:52:47.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.619+0000 7f4ea9400640 1 --2- 172.21.15.114:0/2412885844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4eac070420 0x7f4eac14fd80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800d830 tx=0x7f4e9800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:47.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.619+0000 7f4ea2000640 1 -- 172.21.15.114:0/2412885844 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9800b6c0 con 0x7f4eac070420 2024-09-13T17:52:47.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.619+0000 7f4ea2000640 1 -- 172.21.15.114:0/2412885844 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9800b820 con 0x7f4eac070420 2024-09-13T17:52:47.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.619+0000 7f4eb0e00640 1 -- 172.21.15.114:0/2412885844 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eac1338a0 con 0x7f4eac070420 2024-09-13T17:52:47.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.619+0000 7f4ea2000640 1 -- 172.21.15.114:0/2412885844 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9800bb90 con 0x7f4eac070420 2024-09-13T17:52:47.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.619+0000 7f4eb0e00640 1 -- 172.21.15.114:0/2412885844 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eac150800 con 0x7f4eac070420 2024-09-13T17:52:47.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.619+0000 7f4eb0e00640 1 -- 172.21.15.114:0/2412885844 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eac06c970 con 0x7f4eac070420 2024-09-13T17:52:47.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.623+0000 7f4ea2000640 1 -- 172.21.15.114:0/2412885844 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4e9801e460 con 0x7f4eac070420 2024-09-13T17:52:47.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.623+0000 7f4ea2000640 1 --2- 172.21.15.114:0/2412885844 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4e8c066690 0x7f4e8c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:47.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.623+0000 7f4ea2000640 1 -- 172.21.15.114:0/2412885844 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4e98084ca0 con 0x7f4eac070420 2024-09-13T17:52:47.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.623+0000 7f4ea9e00640 1 --2- 172.21.15.114:0/2412885844 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4e8c066690 0x7f4e8c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:47.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.623+0000 7f4ea9e00640 1 --2- 172.21.15.114:0/2412885844 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4e8c066690 0x7f4e8c068b50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c0012f0 tx=0x7f4e9c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:47.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.627+0000 7f4ea2000640 1 -- 172.21.15.114:0/2412885844 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4e98051bd0 con 0x7f4eac070420 2024-09-13T17:52:47.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.779+0000 7f4eb0e00640 1 -- 172.21.15.114:0/2412885844 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4eac134030 con 0x7f4eac070420 2024-09-13T17:52:47.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.779+0000 7f4ea2000640 1 -- 172.21.15.114:0/2412885844 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4e980551f0 con 0x7f4eac070420 2024-09-13T17:52:47.784 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:52:47.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.779+0000 7f4eb0e00640 1 -- 172.21.15.114:0/2412885844 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4e8c066690 msgr2=0x7f4e8c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:47.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.779+0000 7f4eb0e00640 1 --2- 172.21.15.114:0/2412885844 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4e8c066690 0x7f4e8c068b50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c0012f0 tx=0x7f4e9c009040 comp rx=0 tx=0).stop 2024-09-13T17:52:47.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.779+0000 7f4eb0e00640 1 -- 172.21.15.114:0/2412885844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4eac070420 msgr2=0x7f4eac14fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:47.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.779+0000 7f4eb0e00640 1 --2- 172.21.15.114:0/2412885844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4eac070420 0x7f4eac14fd80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800d830 tx=0x7f4e9800dcf0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.779+0000 7f4eb0e00640 1 -- 172.21.15.114:0/2412885844 shutdown_connections 2024-09-13T17:52:47.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.779+0000 7f4eb0e00640 1 --2- 172.21.15.114:0/2412885844 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4e8c066690 0x7f4e8c068b50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.779+0000 7f4eb0e00640 1 --2- 172.21.15.114:0/2412885844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4eac151420 0x7f4eac1502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.779+0000 7f4eb0e00640 1 --2- 172.21.15.114:0/2412885844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4eac070420 0x7f4eac14fd80 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.779+0000 7f4eb0e00640 1 --2- 172.21.15.114:0/2412885844 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4eac06c540 0x7f4eac14e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.779+0000 7f4eb0e00640 1 -- 172.21.15.114:0/2412885844 >> 172.21.15.114:0/2412885844 conn(0x7f4eac0660b0 msgr2=0x7f4eac0cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:47.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.779+0000 7f4eb0e00640 1 -- 172.21.15.114:0/2412885844 shutdown_connections 2024-09-13T17:52:47.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.779+0000 7f4eb0e00640 1 -- 172.21.15.114:0/2412885844 wait complete. 2024-09-13T17:52:47.805 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:52:47.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.935+0000 7f059aa00640 1 Processor -- start 2024-09-13T17:52:47.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.935+0000 7f059aa00640 1 -- start start 2024-09-13T17:52:47.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.939+0000 7f059aa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f059415d950 0x7f05940ad950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:47.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.939+0000 7f059aa00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0594098a70 0x7f0594098f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:47.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.939+0000 7f059aa00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f059415dd30 con 0x7f05940b3f50 2024-09-13T17:52:47.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.939+0000 7f059aa00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0594099440 con 0x7f059415d950 2024-09-13T17:52:47.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.939+0000 7f059aa00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f059406e7b0 con 0x7f0594098a70 2024-09-13T17:52:47.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.939+0000 7f0593e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f059415d950 0x7f05940ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:47.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.939+0000 7f0593e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f059415d950 0x7f05940ad950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50440/0 (socket says 172.21.15.114:50440) 2024-09-13T17:52:47.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.939+0000 7f0593e00640 1 -- 172.21.15.114:0/1188824843 learned_addr learned my addr 172.21.15.114:0/1188824843 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:47.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.939+0000 7f0593400640 1 --2- 172.21.15.114:0/1188824843 >> v2:172.21.15.134:3300/0 conn(0x7f0594098a70 0x7f0594098f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:47.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.939+0000 7f0593e00640 1 -- 172.21.15.114:0/1188824843 >> v2:172.21.15.134:3300/0 conn(0x7f0594098a70 msgr2=0x7f0594098f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:47.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.939+0000 7f0593e00640 1 --2- 172.21.15.114:0/1188824843 >> v2:172.21.15.134:3300/0 conn(0x7f0594098a70 0x7f0594098f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.939+0000 7f0593e00640 1 -- 172.21.15.114:0/1188824843 >> v1:172.21.15.114:6789/0 conn(0x7f05940b3f50 legacy=0x7f05940b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:47.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.939+0000 7f0593e00640 1 -- 172.21.15.114:0/1188824843 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059406ea50 con 0x7f059415d950 2024-09-13T17:52:47.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.943+0000 7f0593e00640 1 --2- 172.21.15.114:0/1188824843 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f059415d950 0x7f05940ad950 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f05940ad6d0 tx=0x7f058401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a308d412a5157945 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:47.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.943+0000 7f0592a00640 1 -- 172.21.15.114:0/1188824843 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05840ab610 con 0x7f059415d950 2024-09-13T17:52:47.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.943+0000 7f0592a00640 1 -- 172.21.15.114:0/1188824843 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05840ab770 con 0x7f059415d950 2024-09-13T17:52:47.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.943+0000 7f0592a00640 1 -- 172.21.15.114:0/1188824843 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05840abb00 con 0x7f059415d950 2024-09-13T17:52:47.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.943+0000 7f059aa00640 1 -- 172.21.15.114:0/1188824843 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f059415d950 msgr2=0x7f05940ad950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:47.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.943+0000 7f059aa00640 1 --2- 172.21.15.114:0/1188824843 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f059415d950 0x7f05940ad950 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f05940ad6d0 tx=0x7f058401c520 comp rx=0 tx=0).stop 2024-09-13T17:52:47.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.943+0000 7f059aa00640 1 -- 172.21.15.114:0/1188824843 shutdown_connections 2024-09-13T17:52:47.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.943+0000 7f059aa00640 1 --2- 172.21.15.114:0/1188824843 >> v2:172.21.15.134:3300/0 conn(0x7f0594098a70 0x7f0594098f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.943+0000 7f059aa00640 1 --2- 172.21.15.114:0/1188824843 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f059415d950 0x7f05940ad950 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.943+0000 7f059aa00640 1 -- 172.21.15.114:0/1188824843 >> 172.21.15.114:0/1188824843 conn(0x7f05940b2080 msgr2=0x7f05940b2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:47.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.943+0000 7f059aa00640 1 -- 172.21.15.114:0/1188824843 shutdown_connections 2024-09-13T17:52:47.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.943+0000 7f059aa00640 1 -- 172.21.15.114:0/1188824843 wait complete. 2024-09-13T17:52:47.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.943+0000 7f059aa00640 1 Processor -- start 2024-09-13T17:52:47.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.943+0000 7f059aa00640 1 -- start start 2024-09-13T17:52:47.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.947+0000 7f059aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0594098a70 0x7f0594149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:47.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.947+0000 7f059aa00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05940b3f50 0x7f059415c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:47.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.947+0000 7f059aa00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f059415d950 0x7f059415cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:47.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.947+0000 7f059aa00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059406ca00 con 0x7f0594098a70 2024-09-13T17:52:47.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.947+0000 7f059aa00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059406ce90 con 0x7f05940b3f50 2024-09-13T17:52:47.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.947+0000 7f059aa00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059406bdf0 con 0x7f059415d950 2024-09-13T17:52:47.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.947+0000 7f0593e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0594098a70 0x7f0594149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:47.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.947+0000 7f0593e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0594098a70 0x7f0594149b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50444/0 (socket says 172.21.15.114:50444) 2024-09-13T17:52:47.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.947+0000 7f0593e00640 1 -- 172.21.15.114:0/3527660958 learned_addr learned my addr 172.21.15.114:0/3527660958 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:47.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.947+0000 7f0598a00640 1 --2- 172.21.15.114:0/3527660958 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f059415d950 0x7f059415cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:47.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.947+0000 7f0593400640 1 --2- 172.21.15.114:0/3527660958 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05940b3f50 0x7f059415c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:47.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.947+0000 7f0593e00640 1 -- 172.21.15.114:0/3527660958 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f059415d950 msgr2=0x7f059415cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:47.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.947+0000 7f0593e00640 1 --2- 172.21.15.114:0/3527660958 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f059415d950 0x7f059415cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.947+0000 7f0593e00640 1 -- 172.21.15.114:0/3527660958 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05940b3f50 msgr2=0x7f059415c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:47.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.947+0000 7f0593e00640 1 --2- 172.21.15.114:0/3527660958 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05940b3f50 0x7f059415c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:47.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.947+0000 7f0593e00640 1 -- 172.21.15.114:0/3527660958 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05840094d0 con 0x7f0594098a70 2024-09-13T17:52:47.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.947+0000 7f0593e00640 1 --2- 172.21.15.114:0/3527660958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0594098a70 0x7f0594149b60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0584019130 tx=0x7f058401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:47.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.947+0000 7f058be00640 1 -- 172.21.15.114:0/3527660958 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05840b4800 con 0x7f0594098a70 2024-09-13T17:52:47.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.947+0000 7f058be00640 1 -- 172.21.15.114:0/3527660958 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05840b4980 con 0x7f0594098a70 2024-09-13T17:52:47.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.947+0000 7f058be00640 1 -- 172.21.15.114:0/3527660958 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05840b4d30 con 0x7f0594098a70 2024-09-13T17:52:47.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.947+0000 7f059aa00640 1 -- 172.21.15.114:0/3527660958 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059406c0d0 con 0x7f0594098a70 2024-09-13T17:52:47.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.947+0000 7f059aa00640 1 -- 172.21.15.114:0/3527660958 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059406c690 con 0x7f0594098a70 2024-09-13T17:52:47.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.947+0000 7f059aa00640 1 -- 172.21.15.114:0/3527660958 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059406c820 con 0x7f0594098a70 2024-09-13T17:52:47.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.947+0000 7f058be00640 1 -- 172.21.15.114:0/3527660958 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f05840b3380 con 0x7f0594098a70 2024-09-13T17:52:47.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.951+0000 7f058be00640 1 --2- 172.21.15.114:0/3527660958 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0574066690 0x7f0574068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:47.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.951+0000 7f058be00640 1 -- 172.21.15.114:0/3527660958 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f058411eb10 con 0x7f0594098a70 2024-09-13T17:52:47.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.951+0000 7f0593400640 1 --2- 172.21.15.114:0/3527660958 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0574066690 0x7f0574068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:47.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.951+0000 7f0593400640 1 --2- 172.21.15.114:0/3527660958 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0574066690 0x7f0574068b50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f05941f8770 tx=0x7f0580008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:47.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:47.955+0000 7f058be00640 1 -- 172.21.15.114:0/3527660958 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f05840ebad0 con 0x7f0594098a70 2024-09-13T17:52:48.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.119+0000 7f059aa00640 1 -- 172.21.15.114:0/3527660958 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f05940ade60 con 0x7f0594098a70 2024-09-13T17:52:48.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.119+0000 7f058be00640 1 -- 172.21.15.114:0/3527660958 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f05840ef0f0 con 0x7f0594098a70 2024-09-13T17:52:48.125 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-13T17:52:48.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.123+0000 7f059aa00640 1 -- 172.21.15.114:0/3527660958 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0574066690 msgr2=0x7f0574068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:48.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.123+0000 7f059aa00640 1 --2- 172.21.15.114:0/3527660958 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0574066690 0x7f0574068b50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f05941f8770 tx=0x7f0580008040 comp rx=0 tx=0).stop 2024-09-13T17:52:48.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.123+0000 7f059aa00640 1 -- 172.21.15.114:0/3527660958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0594098a70 msgr2=0x7f0594149b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:48.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.123+0000 7f059aa00640 1 --2- 172.21.15.114:0/3527660958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0594098a70 0x7f0594149b60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0584019130 tx=0x7f058401ad60 comp rx=0 tx=0).stop 2024-09-13T17:52:48.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.123+0000 7f059aa00640 1 -- 172.21.15.114:0/3527660958 shutdown_connections 2024-09-13T17:52:48.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.123+0000 7f059aa00640 1 --2- 172.21.15.114:0/3527660958 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0574066690 0x7f0574068b50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:48.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.123+0000 7f059aa00640 1 --2- 172.21.15.114:0/3527660958 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f059415d950 0x7f059415cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:48.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.123+0000 7f059aa00640 1 --2- 172.21.15.114:0/3527660958 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05940b3f50 0x7f059415c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:48.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.123+0000 7f059aa00640 1 --2- 172.21.15.114:0/3527660958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0594098a70 0x7f0594149b60 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:48.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.123+0000 7f059aa00640 1 -- 172.21.15.114:0/3527660958 >> 172.21.15.114:0/3527660958 conn(0x7f05940b2080 msgr2=0x7f05940d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:48.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.123+0000 7f059aa00640 1 -- 172.21.15.114:0/3527660958 shutdown_connections 2024-09-13T17:52:48.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.123+0000 7f059aa00640 1 -- 172.21.15.114:0/3527660958 wait complete. 2024-09-13T17:52:48.146 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T17:52:48.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:48.147 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-13T17:52:48.183 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2024-09-13T17:52:48.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:48.184 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T17:52:48.245 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:52:48.245 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:52:48.254 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:52:48.254 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:52:48.305 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:52:48.305 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:52:48.353 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:52:48.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.527+0000 7fe2d8000640 1 Processor -- start 2024-09-13T17:52:48.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.527+0000 7fe2d8000640 1 -- start start 2024-09-13T17:52:48.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.527+0000 7fe2d8000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe2d013c240 0x7fe2d013f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:48.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.527+0000 7fe2d8000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe2d013c980 0x7fe2d006d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:48.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.527+0000 7fe2d8000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d00cd220 con 0x7fe2d006da90 2024-09-13T17:52:48.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.527+0000 7fe2d8000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d006df40 con 0x7fe2d013c240 2024-09-13T17:52:48.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.527+0000 7fe2d8000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d013f960 con 0x7fe2d013c980 2024-09-13T17:52:48.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.527+0000 7fe2d5600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe2d013c240 0x7fe2d013f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:48.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.527+0000 7fe2d5600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe2d013c240 0x7fe2d013f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50458/0 (socket says 172.21.15.114:50458) 2024-09-13T17:52:48.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.527+0000 7fe2d5600640 1 -- 172.21.15.114:0/2601435337 learned_addr learned my addr 172.21.15.114:0/2601435337 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:48.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.527+0000 7fe2d4c00640 1 --2- 172.21.15.114:0/2601435337 >> v2:172.21.15.134:3300/0 conn(0x7fe2d013c980 0x7fe2d006d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:48.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.531+0000 7fe2d5600640 1 -- 172.21.15.114:0/2601435337 >> v2:172.21.15.134:3300/0 conn(0x7fe2d013c980 msgr2=0x7fe2d006d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:48.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.531+0000 7fe2d5600640 1 --2- 172.21.15.114:0/2601435337 >> v2:172.21.15.134:3300/0 conn(0x7fe2d013c980 0x7fe2d006d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:48.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.531+0000 7fe2d5600640 1 -- 172.21.15.114:0/2601435337 >> v1:172.21.15.114:6789/0 conn(0x7fe2d006da90 legacy=0x7fe2d00cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:48.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.531+0000 7fe2d5600640 1 -- 172.21.15.114:0/2601435337 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d015a740 con 0x7fe2d013c240 2024-09-13T17:52:48.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.531+0000 7fe2d5600640 1 --2- 172.21.15.114:0/2601435337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2d013c240 0x7fe2d013f420 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe2d00ae130 tx=0x7fe2c401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c27d659c63418b14 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:48.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.531+0000 7fe2cfe00640 1 -- 172.21.15.114:0/2601435337 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c40aa650 con 0x7fe2d013c240 2024-09-13T17:52:48.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.531+0000 7fe2cfe00640 1 -- 172.21.15.114:0/2601435337 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c40aa7b0 con 0x7fe2d013c240 2024-09-13T17:52:48.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.531+0000 7fe2cfe00640 1 -- 172.21.15.114:0/2601435337 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c40aab40 con 0x7fe2d013c240 2024-09-13T17:52:48.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.531+0000 7fe2d8000640 1 -- 172.21.15.114:0/2601435337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2d013c240 msgr2=0x7fe2d013f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:48.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.531+0000 7fe2d8000640 1 --2- 172.21.15.114:0/2601435337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2d013c240 0x7fe2d013f420 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe2d00ae130 tx=0x7fe2c401c4f0 comp rx=0 tx=0).stop 2024-09-13T17:52:48.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.531+0000 7fe2d8000640 1 -- 172.21.15.114:0/2601435337 shutdown_connections 2024-09-13T17:52:48.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.531+0000 7fe2d8000640 1 --2- 172.21.15.114:0/2601435337 >> v2:172.21.15.134:3300/0 conn(0x7fe2d013c980 0x7fe2d006d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:48.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.531+0000 7fe2d8000640 1 --2- 172.21.15.114:0/2601435337 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2d013c240 0x7fe2d013f420 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:48.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.531+0000 7fe2d8000640 1 -- 172.21.15.114:0/2601435337 >> 172.21.15.114:0/2601435337 conn(0x7fe2d00660b0 msgr2=0x7fe2d0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:48.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.535+0000 7fe2d8000640 1 -- 172.21.15.114:0/2601435337 shutdown_connections 2024-09-13T17:52:48.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.535+0000 7fe2d8000640 1 -- 172.21.15.114:0/2601435337 wait complete. 2024-09-13T17:52:48.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.535+0000 7fe2d8000640 1 Processor -- start 2024-09-13T17:52:48.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.535+0000 7fe2d8000640 1 -- start start 2024-09-13T17:52:48.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.535+0000 7fe2d8000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2d006da90 0x7fe2d01f4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:48.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.535+0000 7fe2d8000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe2d013c240 0x7fe2d013de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:48.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.535+0000 7fe2d8000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2d013c980 0x7fe2d013acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:48.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.535+0000 7fe2d8000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d00ac2f0 con 0x7fe2d013c980 2024-09-13T17:52:48.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.535+0000 7fe2d8000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d00ac5d0 con 0x7fe2d006da90 2024-09-13T17:52:48.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.535+0000 7fe2d8000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d00ac8b0 con 0x7fe2d013c240 2024-09-13T17:52:48.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.535+0000 7fe2d6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2d013c980 0x7fe2d013acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:48.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.535+0000 7fe2d6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2d013c980 0x7fe2d013acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50462/0 (socket says 172.21.15.114:50462) 2024-09-13T17:52:48.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.535+0000 7fe2d6000640 1 -- 172.21.15.114:0/2022667933 learned_addr learned my addr 172.21.15.114:0/2022667933 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:48.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.535+0000 7fe2d5600640 1 --2- 172.21.15.114:0/2022667933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2d006da90 0x7fe2d01f4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:48.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.535+0000 7fe2d4c00640 1 --2- 172.21.15.114:0/2022667933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe2d013c240 0x7fe2d013de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:48.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.535+0000 7fe2d6000640 1 -- 172.21.15.114:0/2022667933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe2d013c240 msgr2=0x7fe2d013de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:48.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.535+0000 7fe2d6000640 1 --2- 172.21.15.114:0/2022667933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe2d013c240 0x7fe2d013de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:48.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.535+0000 7fe2d6000640 1 -- 172.21.15.114:0/2022667933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2d006da90 msgr2=0x7fe2d01f4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:48.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.535+0000 7fe2d6000640 1 --2- 172.21.15.114:0/2022667933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2d006da90 0x7fe2d01f4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:48.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.535+0000 7fe2d6000640 1 -- 172.21.15.114:0/2022667933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c40094d0 con 0x7fe2d013c980 2024-09-13T17:52:48.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.535+0000 7fe2d6000640 1 --2- 172.21.15.114:0/2022667933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2d013c980 0x7fe2d013acb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe2c800c770 tx=0x7fe2c800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:48.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.535+0000 7fe2cd600640 1 -- 172.21.15.114:0/2022667933 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8003b80 con 0x7fe2d013c980 2024-09-13T17:52:48.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.535+0000 7fe2cd600640 1 -- 172.21.15.114:0/2022667933 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c8003ce0 con 0x7fe2d013c980 2024-09-13T17:52:48.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.535+0000 7fe2d8000640 1 -- 172.21.15.114:0/2022667933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d00acb90 con 0x7fe2d013c980 2024-09-13T17:52:48.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.535+0000 7fe2cd600640 1 -- 172.21.15.114:0/2022667933 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c800aa90 con 0x7fe2d013c980 2024-09-13T17:52:48.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.539+0000 7fe2d8000640 1 -- 172.21.15.114:0/2022667933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d00ad150 con 0x7fe2d013c980 2024-09-13T17:52:48.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.539+0000 7fe2d8000640 1 -- 172.21.15.114:0/2022667933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d0070620 con 0x7fe2d013c980 2024-09-13T17:52:48.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.539+0000 7fe2cd600640 1 -- 172.21.15.114:0/2022667933 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe2c800abf0 con 0x7fe2d013c980 2024-09-13T17:52:48.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.539+0000 7fe2cd600640 1 --2- 172.21.15.114:0/2022667933 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe2b0066690 0x7fe2b0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:48.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.539+0000 7fe2cd600640 1 -- 172.21.15.114:0/2022667933 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe2c8084250 con 0x7fe2d013c980 2024-09-13T17:52:48.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.539+0000 7fe2d5600640 1 --2- 172.21.15.114:0/2022667933 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe2b0066690 0x7fe2b0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:48.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.539+0000 7fe2d5600640 1 --2- 172.21.15.114:0/2022667933 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe2b0066690 0x7fe2b0068b50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe2c40ae000 tx=0x7fe2c40b5040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:48.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.543+0000 7fe2cd600640 1 -- 172.21.15.114:0/2022667933 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe2c80512b0 con 0x7fe2d013c980 2024-09-13T17:52:48.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.699+0000 7fe2d8000640 1 -- 172.21.15.114:0/2022667933 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2d015a1b0 con 0x7fe2d013c980 2024-09-13T17:52:48.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.699+0000 7fe2cd600640 1 -- 172.21.15.114:0/2022667933 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18784 (secure 0 0 0) 0x7fe2c80548d0 con 0x7fe2d013c980 2024-09-13T17:52:48.704 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:48.704 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:52:31.139000+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:51:48.278220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:51:48.773888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:51:51.856300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:52:48.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.703+0000 7fe2d8000640 1 -- 172.21.15.114:0/2022667933 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe2b0066690 msgr2=0x7fe2b0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:48.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.703+0000 7fe2d8000640 1 --2- 172.21.15.114:0/2022667933 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe2b0066690 0x7fe2b0068b50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe2c40ae000 tx=0x7fe2c40b5040 comp rx=0 tx=0).stop 2024-09-13T17:52:48.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.703+0000 7fe2d8000640 1 -- 172.21.15.114:0/2022667933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2d013c980 msgr2=0x7fe2d013acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:48.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.703+0000 7fe2d8000640 1 --2- 172.21.15.114:0/2022667933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2d013c980 0x7fe2d013acb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe2c800c770 tx=0x7fe2c800cc30 comp rx=0 tx=0).stop 2024-09-13T17:52:48.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.703+0000 7fe2d8000640 1 -- 172.21.15.114:0/2022667933 shutdown_connections 2024-09-13T17:52:48.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.703+0000 7fe2d8000640 1 --2- 172.21.15.114:0/2022667933 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe2b0066690 0x7fe2b0068b50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:48.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.703+0000 7fe2d8000640 1 --2- 172.21.15.114:0/2022667933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe2d013c980 0x7fe2d013acb0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:48.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.703+0000 7fe2d8000640 1 --2- 172.21.15.114:0/2022667933 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe2d013c240 0x7fe2d013de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:48.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.703+0000 7fe2d8000640 1 --2- 172.21.15.114:0/2022667933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe2d006da90 0x7fe2d01f4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:48.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.703+0000 7fe2d8000640 1 -- 172.21.15.114:0/2022667933 >> 172.21.15.114:0/2022667933 conn(0x7fe2d00660b0 msgr2=0x7fe2d006c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:48.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.703+0000 7fe2d8000640 1 -- 172.21.15.114:0/2022667933 shutdown_connections 2024-09-13T17:52:48.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.703+0000 7fe2d8000640 1 -- 172.21.15.114:0/2022667933 wait complete. 2024-09-13T17:52:48.726 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:51:37.996254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:51:48.278220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:51:48.773888+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:51:51.856300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:52:48.727 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:52:48.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.863+0000 7f0cd9600640 1 Processor -- start 2024-09-13T17:52:48.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.863+0000 7f0cd9600640 1 -- start start 2024-09-13T17:52:48.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.863+0000 7f0cd9600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0cd413f420 0x7f0cd406d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:48.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.863+0000 7f0cd9600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0cd406da90 0x7f0cd40cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:48.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.863+0000 7f0cd9600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd40cd220 con 0x7f0cd413c240 2024-09-13T17:52:48.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.863+0000 7f0cd9600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cd406df40 con 0x7f0cd406da90 2024-09-13T17:52:48.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.863+0000 7f0cd9600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cd415a740 con 0x7f0cd413f420 2024-09-13T17:52:48.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.863+0000 7f0cd2a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0cd413c240 0x7f0cd413c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46634/0 (socket says 172.21.15.114:46634) 2024-09-13T17:52:48.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.863+0000 7f0cd2a00640 1 -- 172.21.15.114:0/3759373839 learned_addr learned my addr 172.21.15.114:0/3759373839 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:48.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.863+0000 7f0cd3400640 1 --2- 172.21.15.114:0/3759373839 >> v2:172.21.15.114:3300/0 conn(0x7f0cd406da90 0x7f0cd40cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:48.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.863+0000 7f0cd2000640 1 --2- 172.21.15.114:0/3759373839 >> v2:172.21.15.134:3300/0 conn(0x7f0cd413f420 0x7f0cd406d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:48.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.863+0000 7f0cd3400640 1 -- 172.21.15.114:0/3759373839 >> v2:172.21.15.134:3300/0 conn(0x7f0cd413f420 msgr2=0x7f0cd406d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:48.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.863+0000 7f0cd3400640 1 --2- 172.21.15.114:0/3759373839 >> v2:172.21.15.134:3300/0 conn(0x7f0cd413f420 0x7f0cd406d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:48.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.863+0000 7f0cd3400640 1 -- 172.21.15.114:0/3759373839 >> v1:172.21.15.114:6789/0 conn(0x7f0cd413c240 legacy=0x7f0cd413c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:48.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.863+0000 7f0cd3400640 1 -- 172.21.15.114:0/3759373839 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd4159bc0 con 0x7f0cd406da90 2024-09-13T17:52:48.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.867+0000 7f0cd3400640 1 --2- 172.21.15.114:0/3759373839 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cd406da90 0x7f0cd40cd650 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0cd40ae130 tx=0x7f0ccc01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f5083c3a0ed66f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:48.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.867+0000 7f0cd1600640 1 -- 172.21.15.114:0/3759373839 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc0a59c0 con 0x7f0cd406da90 2024-09-13T17:52:48.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.867+0000 7f0cd1600640 1 -- 172.21.15.114:0/3759373839 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ccc0a5b20 con 0x7f0cd406da90 2024-09-13T17:52:48.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.867+0000 7f0cd1600640 1 -- 172.21.15.114:0/3759373839 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc0ad440 con 0x7f0cd406da90 2024-09-13T17:52:48.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.867+0000 7f0cd9600640 1 -- 172.21.15.114:0/3759373839 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cd406da90 msgr2=0x7f0cd40cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:48.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.867+0000 7f0cd9600640 1 --2- 172.21.15.114:0/3759373839 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cd406da90 0x7f0cd40cd650 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0cd40ae130 tx=0x7f0ccc01c900 comp rx=0 tx=0).stop 2024-09-13T17:52:48.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.867+0000 7f0cd9600640 1 -- 172.21.15.114:0/3759373839 shutdown_connections 2024-09-13T17:52:48.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.867+0000 7f0cd9600640 1 --2- 172.21.15.114:0/3759373839 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cd406da90 0x7f0cd40cd650 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:48.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.867+0000 7f0cd9600640 1 --2- 172.21.15.114:0/3759373839 >> v2:172.21.15.134:3300/0 conn(0x7f0cd413f420 0x7f0cd406d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:48.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.867+0000 7f0cd9600640 1 -- 172.21.15.114:0/3759373839 >> 172.21.15.114:0/3759373839 conn(0x7f0cd40660b0 msgr2=0x7f0cd4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:48.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.867+0000 7f0cd9600640 1 -- 172.21.15.114:0/3759373839 shutdown_connections 2024-09-13T17:52:48.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.867+0000 7f0cd9600640 1 -- 172.21.15.114:0/3759373839 wait complete. 2024-09-13T17:52:48.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.871+0000 7f0cd9600640 1 Processor -- start 2024-09-13T17:52:48.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.871+0000 7f0cd9600640 1 -- start start 2024-09-13T17:52:48.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.871+0000 7f0cd9600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0cd406da90 0x7f0cd4154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:48.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.871+0000 7f0cd9600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cd413c240 0x7f0cd415d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:48.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.871+0000 7f0cd9600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cd413f420 0x7f0cd406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:48.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.871+0000 7f0cd9600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd4155f40 con 0x7f0cd413f420 2024-09-13T17:52:48.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.871+0000 7f0cd9600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd4155330 con 0x7f0cd413c240 2024-09-13T17:52:48.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.871+0000 7f0cd9600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd4155610 con 0x7f0cd406da90 2024-09-13T17:52:48.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.871+0000 7f0cd3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cd413f420 0x7f0cd406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:48.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.871+0000 7f0cd3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cd413f420 0x7f0cd406c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50482/0 (socket says 172.21.15.114:50482) 2024-09-13T17:52:48.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.871+0000 7f0cd3400640 1 -- 172.21.15.114:0/1149105912 learned_addr learned my addr 172.21.15.114:0/1149105912 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:48.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.871+0000 7f0cd2000640 1 --2- 172.21.15.114:0/1149105912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cd413c240 0x7f0cd415d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:48.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.871+0000 7f0cd2a00640 1 --2- 172.21.15.114:0/1149105912 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0cd406da90 0x7f0cd4154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:48.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.871+0000 7f0cd3400640 1 -- 172.21.15.114:0/1149105912 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0cd406da90 msgr2=0x7f0cd4154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:48.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.871+0000 7f0cd3400640 1 --2- 172.21.15.114:0/1149105912 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0cd406da90 0x7f0cd4154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:48.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.871+0000 7f0cd3400640 1 -- 172.21.15.114:0/1149105912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cd413c240 msgr2=0x7f0cd415d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:48.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.871+0000 7f0cd3400640 1 --2- 172.21.15.114:0/1149105912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cd413c240 0x7f0cd415d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:48.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.871+0000 7f0cd3400640 1 -- 172.21.15.114:0/1149105912 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ccc009a70 con 0x7f0cd413f420 2024-09-13T17:52:48.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.871+0000 7f0cd3400640 1 --2- 172.21.15.114:0/1149105912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cd413f420 0x7f0cd406c6a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc0b0040 tx=0x7f0cd40ce3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:48.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.871+0000 7f0ccaa00640 1 -- 172.21.15.114:0/1149105912 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc0ade40 con 0x7f0cd413f420 2024-09-13T17:52:48.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.871+0000 7f0ccaa00640 1 -- 172.21.15.114:0/1149105912 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ccc009450 con 0x7f0cd413f420 2024-09-13T17:52:48.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.871+0000 7f0ccaa00640 1 -- 172.21.15.114:0/1149105912 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc0b8660 con 0x7f0cd413f420 2024-09-13T17:52:48.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.871+0000 7f0cd9600640 1 -- 172.21.15.114:0/1149105912 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd41558f0 con 0x7f0cd413f420 2024-09-13T17:52:48.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.871+0000 7f0cd9600640 1 -- 172.21.15.114:0/1149105912 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd415def0 con 0x7f0cd413f420 2024-09-13T17:52:48.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.871+0000 7f0cd9600640 1 -- 172.21.15.114:0/1149105912 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd4159820 con 0x7f0cd413f420 2024-09-13T17:52:48.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.875+0000 7f0ccaa00640 1 -- 172.21.15.114:0/1149105912 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0ccc0b4040 con 0x7f0cd413f420 2024-09-13T17:52:48.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.875+0000 7f0ccaa00640 1 --2- 172.21.15.114:0/1149105912 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0cb4066690 0x7f0cb4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:48.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.875+0000 7f0ccaa00640 1 -- 172.21.15.114:0/1149105912 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0ccc11f2e0 con 0x7f0cd413f420 2024-09-13T17:52:48.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.875+0000 7f0cd2a00640 1 --2- 172.21.15.114:0/1149105912 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0cb4066690 0x7f0cb4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:48.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.875+0000 7f0cd2a00640 1 --2- 172.21.15.114:0/1149105912 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0cb4066690 0x7f0cb4068b50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4005890 tx=0x7f0cc4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:48.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:48.879+0000 7f0ccaa00640 1 -- 172.21.15.114:0/1149105912 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0ccc0ec340 con 0x7f0cd413f420 2024-09-13T17:52:49.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.035+0000 7f0cd9600640 1 -- 172.21.15.114:0/1149105912 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0cd415a4c0 con 0x7f0cd413f420 2024-09-13T17:52:49.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.035+0000 7f0ccaa00640 1 -- 172.21.15.114:0/1149105912 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0ccc0ef960 con 0x7f0cd413f420 2024-09-13T17:52:49.040 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-13T17:52:49.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.035+0000 7f0cd9600640 1 -- 172.21.15.114:0/1149105912 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0cb4066690 msgr2=0x7f0cb4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:49.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.035+0000 7f0cd9600640 1 --2- 172.21.15.114:0/1149105912 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0cb4066690 0x7f0cb4068b50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4005890 tx=0x7f0cc4009040 comp rx=0 tx=0).stop 2024-09-13T17:52:49.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.035+0000 7f0cd9600640 1 -- 172.21.15.114:0/1149105912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cd413f420 msgr2=0x7f0cd406c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:49.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.035+0000 7f0cd9600640 1 --2- 172.21.15.114:0/1149105912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cd413f420 0x7f0cd406c6a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc0b0040 tx=0x7f0cd40ce3a0 comp rx=0 tx=0).stop 2024-09-13T17:52:49.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.035+0000 7f0cd9600640 1 -- 172.21.15.114:0/1149105912 shutdown_connections 2024-09-13T17:52:49.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.035+0000 7f0cd9600640 1 --2- 172.21.15.114:0/1149105912 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0cb4066690 0x7f0cb4068b50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:49.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.035+0000 7f0cd9600640 1 --2- 172.21.15.114:0/1149105912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0cd413f420 0x7f0cd406c6a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:49.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.035+0000 7f0cd9600640 1 --2- 172.21.15.114:0/1149105912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cd413c240 0x7f0cd415d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:49.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.035+0000 7f0cd9600640 1 --2- 172.21.15.114:0/1149105912 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0cd406da90 0x7f0cd4154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:49.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.035+0000 7f0cd9600640 1 -- 172.21.15.114:0/1149105912 >> 172.21.15.114:0/1149105912 conn(0x7f0cd40660b0 msgr2=0x7f0cd4158220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:49.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.039+0000 7f0cd9600640 1 -- 172.21.15.114:0/1149105912 shutdown_connections 2024-09-13T17:52:49.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.039+0000 7f0cd9600640 1 -- 172.21.15.114:0/1149105912 wait complete. 2024-09-13T17:52:49.060 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:52:49.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.195+0000 7fa662a00640 1 Processor -- start 2024-09-13T17:52:49.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.195+0000 7fa662a00640 1 -- start start 2024-09-13T17:52:49.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.195+0000 7fa662a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa65c0ce750 0x7fa65c15d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:49.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.195+0000 7fa662a00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa65c0b1c60 0x7fa65c0b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:49.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.195+0000 7fa662a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa65c15dbb0 con 0x7fa65c06cd60 2024-09-13T17:52:49.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.195+0000 7fa662a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa65c0b2610 con 0x7fa65c0ce750 2024-09-13T17:52:49.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.195+0000 7fa662a00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa65c160630 con 0x7fa65c0b1c60 2024-09-13T17:52:49.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.195+0000 7fa65be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa65c0ce750 0x7fa65c15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:49.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.195+0000 7fa65be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa65c0ce750 0x7fa65c15d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50496/0 (socket says 172.21.15.114:50496) 2024-09-13T17:52:49.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.195+0000 7fa65be00640 1 -- 172.21.15.114:0/2080510325 learned_addr learned my addr 172.21.15.114:0/2080510325 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:49.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.195+0000 7fa65b400640 1 --2- 172.21.15.114:0/2080510325 >> v2:172.21.15.134:3300/0 conn(0x7fa65c0b1c60 0x7fa65c0b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:49.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.195+0000 7fa65be00640 1 -- 172.21.15.114:0/2080510325 >> v2:172.21.15.134:3300/0 conn(0x7fa65c0b1c60 msgr2=0x7fa65c0b20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:49.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.195+0000 7fa65be00640 1 --2- 172.21.15.114:0/2080510325 >> v2:172.21.15.134:3300/0 conn(0x7fa65c0b1c60 0x7fa65c0b20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:49.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.195+0000 7fa65be00640 1 -- 172.21.15.114:0/2080510325 >> v1:172.21.15.114:6789/0 conn(0x7fa65c06cd60 legacy=0x7fa65c06d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:49.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.195+0000 7fa65be00640 1 -- 172.21.15.114:0/2080510325 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c160910 con 0x7fa65c0ce750 2024-09-13T17:52:49.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.199+0000 7fa65be00640 1 --2- 172.21.15.114:0/2080510325 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa65c0ce750 0x7fa65c15d670 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0b3120 tx=0x7fa64c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49bfd1d87a11012 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:49.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.199+0000 7fa65aa00640 1 -- 172.21.15.114:0/2080510325 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64c0aa650 con 0x7fa65c0ce750 2024-09-13T17:52:49.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.199+0000 7fa65aa00640 1 -- 172.21.15.114:0/2080510325 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64c0aa7b0 con 0x7fa65c0ce750 2024-09-13T17:52:49.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.199+0000 7fa65aa00640 1 -- 172.21.15.114:0/2080510325 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64c0aab40 con 0x7fa65c0ce750 2024-09-13T17:52:49.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.199+0000 7fa662a00640 1 -- 172.21.15.114:0/2080510325 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa65c0ce750 msgr2=0x7fa65c15d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:49.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.199+0000 7fa662a00640 1 --2- 172.21.15.114:0/2080510325 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa65c0ce750 0x7fa65c15d670 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0b3120 tx=0x7fa64c01c4f0 comp rx=0 tx=0).stop 2024-09-13T17:52:49.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.199+0000 7fa662a00640 1 -- 172.21.15.114:0/2080510325 shutdown_connections 2024-09-13T17:52:49.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.199+0000 7fa662a00640 1 --2- 172.21.15.114:0/2080510325 >> v2:172.21.15.134:3300/0 conn(0x7fa65c0b1c60 0x7fa65c0b20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:49.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.199+0000 7fa662a00640 1 --2- 172.21.15.114:0/2080510325 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa65c0ce750 0x7fa65c15d670 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:49.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.199+0000 7fa662a00640 1 -- 172.21.15.114:0/2080510325 >> 172.21.15.114:0/2080510325 conn(0x7fa65c0b0f60 msgr2=0x7fa65c0cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:49.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.199+0000 7fa662a00640 1 -- 172.21.15.114:0/2080510325 shutdown_connections 2024-09-13T17:52:49.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.199+0000 7fa662a00640 1 -- 172.21.15.114:0/2080510325 wait complete. 2024-09-13T17:52:49.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.199+0000 7fa662a00640 1 Processor -- start 2024-09-13T17:52:49.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.203+0000 7fa662a00640 1 -- start start 2024-09-13T17:52:49.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.203+0000 7fa662a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa65c06cd60 0x7fa65c154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:49.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.203+0000 7fa662a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa65c0b1c60 0x7fa65c14def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:49.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.203+0000 7fa662a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa65c0ce750 0x7fa65c14f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:49.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.203+0000 7fa662a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c153f60 con 0x7fa65c0ce750 2024-09-13T17:52:49.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.203+0000 7fa662a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c1616e0 con 0x7fa65c0b1c60 2024-09-13T17:52:49.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.203+0000 7fa662a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c1532e0 con 0x7fa65c06cd60 2024-09-13T17:52:49.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.203+0000 7fa660a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa65c0ce750 0x7fa65c14f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:49.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.203+0000 7fa660a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa65c0ce750 0x7fa65c14f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50504/0 (socket says 172.21.15.114:50504) 2024-09-13T17:52:49.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.203+0000 7fa660a00640 1 -- 172.21.15.114:0/3497750408 learned_addr learned my addr 172.21.15.114:0/3497750408 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:49.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.203+0000 7fa65be00640 1 --2- 172.21.15.114:0/3497750408 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa65c06cd60 0x7fa65c154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:49.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.203+0000 7fa65b400640 1 --2- 172.21.15.114:0/3497750408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa65c0b1c60 0x7fa65c14def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:49.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.203+0000 7fa660a00640 1 -- 172.21.15.114:0/3497750408 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa65c06cd60 msgr2=0x7fa65c154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:49.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.203+0000 7fa660a00640 1 --2- 172.21.15.114:0/3497750408 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa65c06cd60 0x7fa65c154380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:49.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.203+0000 7fa660a00640 1 -- 172.21.15.114:0/3497750408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa65c0b1c60 msgr2=0x7fa65c14def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:49.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.203+0000 7fa660a00640 1 --2- 172.21.15.114:0/3497750408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa65c0b1c60 0x7fa65c14def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:49.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.203+0000 7fa660a00640 1 -- 172.21.15.114:0/3497750408 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64c0094d0 con 0x7fa65c0ce750 2024-09-13T17:52:49.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.203+0000 7fa660a00640 1 --2- 172.21.15.114:0/3497750408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa65c0ce750 0x7fa65c14f640 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa65400c730 tx=0x7fa65400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:49.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.203+0000 7fa653e00640 1 -- 172.21.15.114:0/3497750408 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa654003b80 con 0x7fa65c0ce750 2024-09-13T17:52:49.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.203+0000 7fa653e00640 1 -- 172.21.15.114:0/3497750408 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa654003ce0 con 0x7fa65c0ce750 2024-09-13T17:52:49.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.203+0000 7fa653e00640 1 -- 172.21.15.114:0/3497750408 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65400aa30 con 0x7fa65c0ce750 2024-09-13T17:52:49.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.203+0000 7fa662a00640 1 -- 172.21.15.114:0/3497750408 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa65c1535c0 con 0x7fa65c0ce750 2024-09-13T17:52:49.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.203+0000 7fa662a00640 1 -- 172.21.15.114:0/3497750408 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa65c153b80 con 0x7fa65c0ce750 2024-09-13T17:52:49.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.203+0000 7fa662a00640 1 -- 172.21.15.114:0/3497750408 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa65c1540a0 con 0x7fa65c0ce750 2024-09-13T17:52:49.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.207+0000 7fa653e00640 1 -- 172.21.15.114:0/3497750408 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa65400ab90 con 0x7fa65c0ce750 2024-09-13T17:52:49.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.207+0000 7fa653e00640 1 --2- 172.21.15.114:0/3497750408 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa63c066690 0x7fa63c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:49.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.207+0000 7fa653e00640 1 -- 172.21.15.114:0/3497750408 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa654084200 con 0x7fa65c0ce750 2024-09-13T17:52:49.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.207+0000 7fa65be00640 1 --2- 172.21.15.114:0/3497750408 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa63c066690 0x7fa63c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:49.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.207+0000 7fa65be00640 1 --2- 172.21.15.114:0/3497750408 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa63c066690 0x7fa63c068b50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa64c0ae000 tx=0x7fa64c0b5040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:49.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.211+0000 7fa653e00640 1 -- 172.21.15.114:0/3497750408 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa65c1540a0 con 0x7fa65c0ce750 2024-09-13T17:52:49.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.363+0000 7fa662a00640 1 -- 172.21.15.114:0/3497750408 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa65c1540a0 con 0x7fa65c0ce750 2024-09-13T17:52:49.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.363+0000 7fa653e00640 1 -- 172.21.15.114:0/3497750408 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa65c1540a0 con 0x7fa65c0ce750 2024-09-13T17:52:49.369 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:52:49.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.367+0000 7fa662a00640 1 -- 172.21.15.114:0/3497750408 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa63c066690 msgr2=0x7fa63c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:49.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.367+0000 7fa662a00640 1 --2- 172.21.15.114:0/3497750408 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa63c066690 0x7fa63c068b50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa64c0ae000 tx=0x7fa64c0b5040 comp rx=0 tx=0).stop 2024-09-13T17:52:49.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.367+0000 7fa662a00640 1 -- 172.21.15.114:0/3497750408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa65c0ce750 msgr2=0x7fa65c14f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:49.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.367+0000 7fa662a00640 1 --2- 172.21.15.114:0/3497750408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa65c0ce750 0x7fa65c14f640 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa65400c730 tx=0x7fa65400cbf0 comp rx=0 tx=0).stop 2024-09-13T17:52:49.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.367+0000 7fa662a00640 1 -- 172.21.15.114:0/3497750408 shutdown_connections 2024-09-13T17:52:49.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.367+0000 7fa662a00640 1 --2- 172.21.15.114:0/3497750408 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa63c066690 0x7fa63c068b50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:49.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.367+0000 7fa662a00640 1 --2- 172.21.15.114:0/3497750408 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa65c0ce750 0x7fa65c14f640 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:49.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.367+0000 7fa662a00640 1 --2- 172.21.15.114:0/3497750408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa65c0b1c60 0x7fa65c14def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:49.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.367+0000 7fa662a00640 1 --2- 172.21.15.114:0/3497750408 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa65c06cd60 0x7fa65c154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:49.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.367+0000 7fa662a00640 1 -- 172.21.15.114:0/3497750408 >> 172.21.15.114:0/3497750408 conn(0x7fa65c0b0f60 msgr2=0x7fa65c15dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:49.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.367+0000 7fa662a00640 1 -- 172.21.15.114:0/3497750408 shutdown_connections 2024-09-13T17:52:49.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.367+0000 7fa662a00640 1 -- 172.21.15.114:0/3497750408 wait complete. 2024-09-13T17:52:49.391 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:52:49.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.523+0000 7fb1c3400640 1 Processor -- start 2024-09-13T17:52:49.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.523+0000 7fb1c3400640 1 -- start start 2024-09-13T17:52:49.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.523+0000 7fb1c3400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb1bc070890 0x7fb1bc06cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:49.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.523+0000 7fb1c3400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1bc151800 con 0x7fb1bc151420 2024-09-13T17:52:49.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.523+0000 7fb1c3400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1bc0cafb0 con 0x7fb1bc070420 2024-09-13T17:52:49.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.523+0000 7fb1c3400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1bc0cbc30 con 0x7fb1bc070890 2024-09-13T17:52:49.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.527+0000 7fb1c0a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb1bc151420 0x7fb1bc0cc660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46656/0 (socket says 172.21.15.114:46656) 2024-09-13T17:52:49.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.527+0000 7fb1c0a00640 1 -- 172.21.15.114:0/841178951 learned_addr learned my addr 172.21.15.114:0/841178951 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:49.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.527+0000 7fb1c1400640 1 --2- 172.21.15.114:0/841178951 >> v2:172.21.15.134:3300/0 conn(0x7fb1bc070890 0x7fb1bc06cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:49.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.527+0000 7fb1bbe00640 1 -- 172.21.15.114:0/841178951 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109960717 0 0) 0x7fb1bc151800 con 0x7fb1bc151420 2024-09-13T17:52:49.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.527+0000 7fb1bbe00640 1 -- 172.21.15.114:0/841178951 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1a0003530 con 0x7fb1bc151420 2024-09-13T17:52:49.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.527+0000 7fb1bbe00640 1 -- 172.21.15.114:0/841178951 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1544078184 0 0) 0x7fb1a0003530 con 0x7fb1bc151420 2024-09-13T17:52:49.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.527+0000 7fb1c1400640 1 -- 172.21.15.114:0/841178951 >> v1:172.21.15.134:6789/0 conn(0x7fb1bc070420 legacy=0x7fb1bc06c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:49.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.527+0000 7fb1c1400640 1 -- 172.21.15.114:0/841178951 >> v1:172.21.15.114:6789/0 conn(0x7fb1bc151420 legacy=0x7fb1bc0cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:49.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.527+0000 7fb1c1400640 1 -- 172.21.15.114:0/841178951 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1bc0cb290 con 0x7fb1bc070890 2024-09-13T17:52:49.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.527+0000 7fb1c1400640 1 --2- 172.21.15.114:0/841178951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1bc070890 0x7fb1bc06cc50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009d90 tx=0x7fb1b401c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=843afb14e78a649a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:49.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.531+0000 7fb1bbe00640 1 -- 172.21.15.114:0/841178951 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac0016a0 con 0x7fb1bc070890 2024-09-13T17:52:49.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.531+0000 7fb1bbe00640 1 -- 172.21.15.114:0/841178951 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b40a5580 con 0x7fb1bc070890 2024-09-13T17:52:49.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.531+0000 7fb1bbe00640 1 -- 172.21.15.114:0/841178951 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b40a5910 con 0x7fb1bc070890 2024-09-13T17:52:49.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.531+0000 7fb1c3400640 1 -- 172.21.15.114:0/841178951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1bc070890 msgr2=0x7fb1bc06cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:49.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.531+0000 7fb1c3400640 1 --2- 172.21.15.114:0/841178951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1bc070890 0x7fb1bc06cc50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009d90 tx=0x7fb1b401c740 comp rx=0 tx=0).stop 2024-09-13T17:52:49.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.531+0000 7fb1c3400640 1 -- 172.21.15.114:0/841178951 shutdown_connections 2024-09-13T17:52:49.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.531+0000 7fb1c3400640 1 --2- 172.21.15.114:0/841178951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1bc070890 0x7fb1bc06cc50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:49.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.531+0000 7fb1c3400640 1 -- 172.21.15.114:0/841178951 >> 172.21.15.114:0/841178951 conn(0x7fb1bc0660b0 msgr2=0x7fb1bc069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:49.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.531+0000 7fb1c3400640 1 -- 172.21.15.114:0/841178951 shutdown_connections 2024-09-13T17:52:49.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.531+0000 7fb1c3400640 1 -- 172.21.15.114:0/841178951 wait complete. 2024-09-13T17:52:49.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.531+0000 7fb1c3400640 1 Processor -- start 2024-09-13T17:52:49.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.531+0000 7fb1c3400640 1 -- start start 2024-09-13T17:52:49.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.531+0000 7fb1c3400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb1bc070420 0x7fb1bc14d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:49.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.531+0000 7fb1c3400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1bc070890 0x7fb1bc14d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:49.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.531+0000 7fb1c3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1bc151420 0x7fb1bc153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:49.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.531+0000 7fb1c3400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc14db70 con 0x7fb1bc151420 2024-09-13T17:52:49.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.531+0000 7fb1c3400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc0b0bf0 con 0x7fb1bc070890 2024-09-13T17:52:49.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.531+0000 7fb1c3400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc0b0ed0 con 0x7fb1bc070420 2024-09-13T17:52:49.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.531+0000 7fb1c1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1bc151420 0x7fb1bc153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:49.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.535+0000 7fb1c1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1bc151420 0x7fb1bc153970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50506/0 (socket says 172.21.15.114:50506) 2024-09-13T17:52:49.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.535+0000 7fb1c1400640 1 -- 172.21.15.114:0/1108119728 learned_addr learned my addr 172.21.15.114:0/1108119728 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:49.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.535+0000 7fb1c0a00640 1 --2- 172.21.15.114:0/1108119728 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb1bc070420 0x7fb1bc14d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:49.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.535+0000 7fb1b3e00640 1 --2- 172.21.15.114:0/1108119728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1bc070890 0x7fb1bc14d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:49.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.535+0000 7fb1c1400640 1 -- 172.21.15.114:0/1108119728 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb1bc070420 msgr2=0x7fb1bc14d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:49.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.535+0000 7fb1c1400640 1 --2- 172.21.15.114:0/1108119728 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb1bc070420 0x7fb1bc14d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:49.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.535+0000 7fb1c1400640 1 -- 172.21.15.114:0/1108119728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1bc070890 msgr2=0x7fb1bc14d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:49.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.535+0000 7fb1c1400640 1 --2- 172.21.15.114:0/1108119728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1bc070890 0x7fb1bc14d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:49.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.535+0000 7fb1c1400640 1 -- 172.21.15.114:0/1108119728 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b4009a70 con 0x7fb1bc151420 2024-09-13T17:52:49.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.535+0000 7fb1c1400640 1 --2- 172.21.15.114:0/1108119728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1bc151420 0x7fb1bc153970 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb1b401a370 tx=0x7fb1bc06d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:49.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.535+0000 7fb1b9600640 1 -- 172.21.15.114:0/1108119728 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4009450 con 0x7fb1bc151420 2024-09-13T17:52:49.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.535+0000 7fb1b9600640 1 -- 172.21.15.114:0/1108119728 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b40039a0 con 0x7fb1bc151420 2024-09-13T17:52:49.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.535+0000 7fb1c3400640 1 -- 172.21.15.114:0/1108119728 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1bc14de30 con 0x7fb1bc151420 2024-09-13T17:52:49.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.535+0000 7fb1b9600640 1 -- 172.21.15.114:0/1108119728 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4003d50 con 0x7fb1bc151420 2024-09-13T17:52:49.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.535+0000 7fb1c3400640 1 -- 172.21.15.114:0/1108119728 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1bc151bf0 con 0x7fb1bc151420 2024-09-13T17:52:49.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.535+0000 7fb1c3400640 1 -- 172.21.15.114:0/1108119728 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1bc0b1090 con 0x7fb1bc151420 2024-09-13T17:52:49.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.535+0000 7fb1b9600640 1 -- 172.21.15.114:0/1108119728 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb1b40b4040 con 0x7fb1bc151420 2024-09-13T17:52:49.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.539+0000 7fb1b9600640 1 --2- 172.21.15.114:0/1108119728 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb198066690 0x7fb198068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:49.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.539+0000 7fb1b9600640 1 -- 172.21.15.114:0/1108119728 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb1b411e830 con 0x7fb1bc151420 2024-09-13T17:52:49.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.539+0000 7fb1c0a00640 1 --2- 172.21.15.114:0/1108119728 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb198066690 0x7fb198068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:49.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.539+0000 7fb1c0a00640 1 --2- 172.21.15.114:0/1108119728 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb198066690 0x7fb198068b50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac0017d0 tx=0x7fb1ac001260 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:49.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.543+0000 7fb1b9600640 1 -- 172.21.15.114:0/1108119728 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb1b40ef320 con 0x7fb1bc151420 2024-09-13T17:52:49.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.695+0000 7fb1c3400640 1 -- 172.21.15.114:0/1108119728 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb1bc0cc660 con 0x7fb1bc151420 2024-09-13T17:52:49.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.695+0000 7fb1b9600640 1 -- 172.21.15.114:0/1108119728 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb1b40eeeb0 con 0x7fb1bc151420 2024-09-13T17:52:49.700 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-09-13T17:52:49.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.699+0000 7fb1c3400640 1 -- 172.21.15.114:0/1108119728 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb198066690 msgr2=0x7fb198068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:49.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.699+0000 7fb1c3400640 1 --2- 172.21.15.114:0/1108119728 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb198066690 0x7fb198068b50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac0017d0 tx=0x7fb1ac001260 comp rx=0 tx=0).stop 2024-09-13T17:52:49.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.699+0000 7fb1c3400640 1 -- 172.21.15.114:0/1108119728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1bc151420 msgr2=0x7fb1bc153970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:49.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.699+0000 7fb1c3400640 1 --2- 172.21.15.114:0/1108119728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1bc151420 0x7fb1bc153970 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb1b401a370 tx=0x7fb1bc06d9a0 comp rx=0 tx=0).stop 2024-09-13T17:52:49.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.699+0000 7fb1c3400640 1 -- 172.21.15.114:0/1108119728 shutdown_connections 2024-09-13T17:52:49.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.699+0000 7fb1c3400640 1 --2- 172.21.15.114:0/1108119728 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb198066690 0x7fb198068b50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:49.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.699+0000 7fb1c3400640 1 --2- 172.21.15.114:0/1108119728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1bc151420 0x7fb1bc153970 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:49.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.699+0000 7fb1c3400640 1 --2- 172.21.15.114:0/1108119728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1bc070890 0x7fb1bc14d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:49.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.699+0000 7fb1c3400640 1 --2- 172.21.15.114:0/1108119728 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb1bc070420 0x7fb1bc14d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:49.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.699+0000 7fb1c3400640 1 -- 172.21.15.114:0/1108119728 >> 172.21.15.114:0/1108119728 conn(0x7fb1bc0660b0 msgr2=0x7fb1bc14ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:49.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.699+0000 7fb1c3400640 1 -- 172.21.15.114:0/1108119728 shutdown_connections 2024-09-13T17:52:49.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.699+0000 7fb1c3400640 1 -- 172.21.15.114:0/1108119728 wait complete. 2024-09-13T17:52:49.721 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:52:49.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.855+0000 7f06b9000640 1 Processor -- start 2024-09-13T17:52:49.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.855+0000 7f06b9000640 1 -- start start 2024-09-13T17:52:49.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.859+0000 7f06b9000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f06b406bfc0 0x7f06b40d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:49.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.859+0000 7f06b9000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06b40ca980 con 0x7f06b4099180 2024-09-13T17:52:49.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.859+0000 7f06b9000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06b406c450 con 0x7f06b415c880 2024-09-13T17:52:49.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.859+0000 7f06b9000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06b415cc60 con 0x7f06b406bfc0 2024-09-13T17:52:49.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.859+0000 7f06b3e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f06b4099180 0x7f06b40cb3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46664/0 (socket says 172.21.15.114:46664) 2024-09-13T17:52:49.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.859+0000 7f06b3e00640 1 -- 172.21.15.114:0/1402571491 learned_addr learned my addr 172.21.15.114:0/1402571491 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:49.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.859+0000 7f06b2a00640 1 --2- 172.21.15.114:0/1402571491 >> v2:172.21.15.134:3300/0 conn(0x7f06b406bfc0 0x7f06b40d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:49.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.859+0000 7f06b2000640 1 -- 172.21.15.114:0/1402571491 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3368221447 0 0) 0x7f06b40ca980 con 0x7f06b4099180 2024-09-13T17:52:49.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.859+0000 7f06b2000640 1 -- 172.21.15.114:0/1402571491 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0698003530 con 0x7f06b4099180 2024-09-13T17:52:49.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.859+0000 7f06b2a00640 1 -- 172.21.15.114:0/1402571491 >> v1:172.21.15.134:6789/0 conn(0x7f06b415c880 legacy=0x7f06b4098a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:49.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.859+0000 7f06b2000640 1 -- 172.21.15.114:0/1402571491 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 419918793 0 0) 0x7f0698003530 con 0x7f06b4099180 2024-09-13T17:52:49.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.859+0000 7f06b2a00640 1 -- 172.21.15.114:0/1402571491 >> v1:172.21.15.114:6789/0 conn(0x7f06b4099180 legacy=0x7f06b40cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:49.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.859+0000 7f06b2a00640 1 -- 172.21.15.114:0/1402571491 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b406c730 con 0x7f06b406bfc0 2024-09-13T17:52:49.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.863+0000 7f06b2a00640 1 --2- 172.21.15.114:0/1402571491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b406bfc0 0x7f06b40d0e50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f06a00097c0 tx=0x7f06a001c1b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70999de8a8375a73 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:49.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.863+0000 7f06b2000640 1 -- 172.21.15.114:0/1402571491 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac001a00 con 0x7f06b406bfc0 2024-09-13T17:52:49.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.863+0000 7f06b2000640 1 -- 172.21.15.114:0/1402571491 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a00a7050 con 0x7f06b406bfc0 2024-09-13T17:52:49.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.863+0000 7f06b2000640 1 -- 172.21.15.114:0/1402571491 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a00ab400 con 0x7f06b406bfc0 2024-09-13T17:52:49.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.863+0000 7f06b9000640 1 -- 172.21.15.114:0/1402571491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b406bfc0 msgr2=0x7f06b40d0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:49.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.863+0000 7f06b9000640 1 --2- 172.21.15.114:0/1402571491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b406bfc0 0x7f06b40d0e50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f06a00097c0 tx=0x7f06a001c1b0 comp rx=0 tx=0).stop 2024-09-13T17:52:49.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.863+0000 7f06b9000640 1 -- 172.21.15.114:0/1402571491 shutdown_connections 2024-09-13T17:52:49.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.863+0000 7f06b9000640 1 --2- 172.21.15.114:0/1402571491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b406bfc0 0x7f06b40d0e50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:49.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.863+0000 7f06b9000640 1 -- 172.21.15.114:0/1402571491 >> 172.21.15.114:0/1402571491 conn(0x7f06b40d0330 msgr2=0x7f06b40d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:49.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.863+0000 7f06b9000640 1 -- 172.21.15.114:0/1402571491 shutdown_connections 2024-09-13T17:52:49.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.863+0000 7f06b9000640 1 -- 172.21.15.114:0/1402571491 wait complete. 2024-09-13T17:52:49.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.863+0000 7f06b9000640 1 Processor -- start 2024-09-13T17:52:49.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.863+0000 7f06b9000640 1 -- start start 2024-09-13T17:52:49.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.867+0000 7f06b9000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b4099180 0x7f06b41553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:49.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.867+0000 7f06b9000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06b415c880 0x7f06b414c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:49.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.867+0000 7f06b9000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06b4154af0 0x7f06b41571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:49.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.867+0000 7f06b9000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b4156a70 con 0x7f06b415c880 2024-09-13T17:52:49.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.867+0000 7f06b9000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b4156d50 con 0x7f06b4099180 2024-09-13T17:52:49.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.867+0000 7f06b9000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b40c75c0 con 0x7f06b4154af0 2024-09-13T17:52:49.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.867+0000 7f06b2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06b415c880 0x7f06b414c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:49.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.867+0000 7f06b2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06b415c880 0x7f06b414c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50514/0 (socket says 172.21.15.114:50514) 2024-09-13T17:52:49.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.867+0000 7f06b2a00640 1 -- 172.21.15.114:0/52706374 learned_addr learned my addr 172.21.15.114:0/52706374 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:49.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.867+0000 7f06b3400640 1 --2- 172.21.15.114:0/52706374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b4099180 0x7f06b41553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:49.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.867+0000 7f06b3e00640 1 --2- 172.21.15.114:0/52706374 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06b4154af0 0x7f06b41571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:49.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.867+0000 7f06b2a00640 1 -- 172.21.15.114:0/52706374 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06b4154af0 msgr2=0x7f06b41571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:49.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.867+0000 7f06b2a00640 1 --2- 172.21.15.114:0/52706374 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06b4154af0 0x7f06b41571e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:49.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.867+0000 7f06b2a00640 1 -- 172.21.15.114:0/52706374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b4099180 msgr2=0x7f06b41553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:49.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.867+0000 7f06b2a00640 1 --2- 172.21.15.114:0/52706374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b4099180 0x7f06b41553f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:49.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.867+0000 7f06b2a00640 1 -- 172.21.15.114:0/52706374 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a0009420 con 0x7f06b415c880 2024-09-13T17:52:49.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.867+0000 7f06b3e00640 1 --2- 172.21.15.114:0/52706374 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06b4154af0 0x7f06b41571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:49.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.867+0000 7f06b2a00640 1 --2- 172.21.15.114:0/52706374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06b415c880 0x7f06b414c3c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f06a0019de0 tx=0x7f06a001a9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:49.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.867+0000 7f06ab400640 1 -- 172.21.15.114:0/52706374 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a00abdd0 con 0x7f06b415c880 2024-09-13T17:52:49.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.867+0000 7f06ab400640 1 -- 172.21.15.114:0/52706374 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a00b7450 con 0x7f06b415c880 2024-09-13T17:52:49.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.867+0000 7f06b9000640 1 -- 172.21.15.114:0/52706374 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b40c78a0 con 0x7f06b415c880 2024-09-13T17:52:49.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.867+0000 7f06ab400640 1 -- 172.21.15.114:0/52706374 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a00b7800 con 0x7f06b415c880 2024-09-13T17:52:49.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.867+0000 7f06b9000640 1 -- 172.21.15.114:0/52706374 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b414c900 con 0x7f06b415c880 2024-09-13T17:52:49.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.867+0000 7f06b9000640 1 -- 172.21.15.114:0/52706374 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06b4156ee0 con 0x7f06b415c880 2024-09-13T17:52:49.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.867+0000 7f06ab400640 1 -- 172.21.15.114:0/52706374 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f06a00b7960 con 0x7f06b415c880 2024-09-13T17:52:49.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.871+0000 7f06ab400640 1 --2- 172.21.15.114:0/52706374 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f06940666c0 0x7f0694068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:49.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.871+0000 7f06ab400640 1 -- 172.21.15.114:0/52706374 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f06a011ea80 con 0x7f06b415c880 2024-09-13T17:52:49.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.871+0000 7f06b3400640 1 --2- 172.21.15.114:0/52706374 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f06940666c0 0x7f0694068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:49.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.871+0000 7f06b3400640 1 --2- 172.21.15.114:0/52706374 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f06940666c0 0x7f0694068b80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f06a4000c10 tx=0x7f06a4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:49.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:49.875+0000 7f06ab400640 1 -- 172.21.15.114:0/52706374 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f06a00ebb40 con 0x7f06b415c880 2024-09-13T17:52:50.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.071+0000 7f06b9000640 1 -- 172.21.15.114:0/52706374 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f06b40d0e50 con 0x7f06b415c880 2024-09-13T17:52:50.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.071+0000 7f06ab400640 1 -- 172.21.15.114:0/52706374 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f06a00bb0a0 con 0x7f06b415c880 2024-09-13T17:52:50.075 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:52:50.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.071+0000 7f06b9000640 1 -- 172.21.15.114:0/52706374 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f06940666c0 msgr2=0x7f0694068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:50.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.071+0000 7f06b9000640 1 --2- 172.21.15.114:0/52706374 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f06940666c0 0x7f0694068b80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f06a4000c10 tx=0x7f06a4009040 comp rx=0 tx=0).stop 2024-09-13T17:52:50.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.071+0000 7f06b9000640 1 -- 172.21.15.114:0/52706374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06b415c880 msgr2=0x7f06b414c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:50.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.071+0000 7f06b9000640 1 --2- 172.21.15.114:0/52706374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06b415c880 0x7f06b414c3c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f06a0019de0 tx=0x7f06a001a9f0 comp rx=0 tx=0).stop 2024-09-13T17:52:50.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.071+0000 7f06b9000640 1 -- 172.21.15.114:0/52706374 shutdown_connections 2024-09-13T17:52:50.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.071+0000 7f06b9000640 1 --2- 172.21.15.114:0/52706374 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f06940666c0 0x7f0694068b80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:50.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.071+0000 7f06b9000640 1 --2- 172.21.15.114:0/52706374 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06b4154af0 0x7f06b41571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:50.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.071+0000 7f06b9000640 1 --2- 172.21.15.114:0/52706374 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06b415c880 0x7f06b414c3c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:50.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.071+0000 7f06b9000640 1 --2- 172.21.15.114:0/52706374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b4099180 0x7f06b41553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:50.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.071+0000 7f06b9000640 1 -- 172.21.15.114:0/52706374 >> 172.21.15.114:0/52706374 conn(0x7f06b40d0330 msgr2=0x7f06b4098a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:50.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.071+0000 7f06b9000640 1 -- 172.21.15.114:0/52706374 shutdown_connections 2024-09-13T17:52:50.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.071+0000 7f06b9000640 1 -- 172.21.15.114:0/52706374 wait complete. 2024-09-13T17:52:50.105 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:52:50.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.239+0000 7fbe0dc00640 1 Processor -- start 2024-09-13T17:52:50.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.239+0000 7fbe0dc00640 1 -- start start 2024-09-13T17:52:50.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.239+0000 7fbe0dc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe0813f420 0x7fbe0806d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:50.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.239+0000 7fbe0dc00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbe0806da90 0x7fbe080cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:50.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.239+0000 7fbe0dc00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe080cd220 con 0x7fbe0813c240 2024-09-13T17:52:50.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.239+0000 7fbe0dc00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0806ded0 con 0x7fbe0806da90 2024-09-13T17:52:50.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.239+0000 7fbe0dc00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0815a740 con 0x7fbe0813f420 2024-09-13T17:52:50.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.239+0000 7fbe06a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbe0813c240 0x7fbe0813c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46678/0 (socket says 172.21.15.114:46678) 2024-09-13T17:52:50.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.239+0000 7fbe06a00640 1 -- 172.21.15.114:0/2209518420 learned_addr learned my addr 172.21.15.114:0/2209518420 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:50.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.239+0000 7fbdffe00640 1 --2- 172.21.15.114:0/2209518420 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe0813f420 0x7fbe0806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:50.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.239+0000 7fbe07400640 1 --2- 172.21.15.114:0/2209518420 >> v2:172.21.15.134:3300/0 conn(0x7fbe0806da90 0x7fbe080cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:50.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.239+0000 7fbe06000640 1 -- 172.21.15.114:0/2209518420 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 662329902 0 0) 0x7fbe080cd220 con 0x7fbe0813c240 2024-09-13T17:52:50.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.239+0000 7fbe06000640 1 -- 172.21.15.114:0/2209518420 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdec003530 con 0x7fbe0813c240 2024-09-13T17:52:50.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.239+0000 7fbe07400640 1 -- 172.21.15.114:0/2209518420 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe0813f420 msgr2=0x7fbe0806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:50.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.239+0000 7fbe07400640 1 --2- 172.21.15.114:0/2209518420 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe0813f420 0x7fbe0806d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:50.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.239+0000 7fbe07400640 1 -- 172.21.15.114:0/2209518420 >> v1:172.21.15.114:6789/0 conn(0x7fbe0813c240 legacy=0x7fbe0813c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:50.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.239+0000 7fbe07400640 1 -- 172.21.15.114:0/2209518420 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe08159bc0 con 0x7fbe0806da90 2024-09-13T17:52:50.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.243+0000 7fbe07400640 1 --2- 172.21.15.114:0/2209518420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe0806da90 0x7fbe080cd650 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbe00009d90 tx=0x7fbe0001c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe2354bc8a970c74 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:50.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.243+0000 7fbe06000640 1 -- 172.21.15.114:0/2209518420 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe000a5a00 con 0x7fbe0806da90 2024-09-13T17:52:50.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.243+0000 7fbe06000640 1 -- 172.21.15.114:0/2209518420 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe000a5b60 con 0x7fbe0806da90 2024-09-13T17:52:50.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.243+0000 7fbe06000640 1 -- 172.21.15.114:0/2209518420 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe000ad440 con 0x7fbe0806da90 2024-09-13T17:52:50.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.243+0000 7fbe0dc00640 1 -- 172.21.15.114:0/2209518420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe0806da90 msgr2=0x7fbe080cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:50.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.243+0000 7fbe0dc00640 1 --2- 172.21.15.114:0/2209518420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe0806da90 0x7fbe080cd650 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbe00009d90 tx=0x7fbe0001c940 comp rx=0 tx=0).stop 2024-09-13T17:52:50.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.243+0000 7fbe0dc00640 1 -- 172.21.15.114:0/2209518420 shutdown_connections 2024-09-13T17:52:50.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.243+0000 7fbe0dc00640 1 --2- 172.21.15.114:0/2209518420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe0806da90 0x7fbe080cd650 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:50.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.243+0000 7fbe0dc00640 1 --2- 172.21.15.114:0/2209518420 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe0813f420 0x7fbe0806d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:50.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.243+0000 7fbe0dc00640 1 -- 172.21.15.114:0/2209518420 >> 172.21.15.114:0/2209518420 conn(0x7fbe080660b0 msgr2=0x7fbe08069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:50.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.243+0000 7fbe0dc00640 1 -- 172.21.15.114:0/2209518420 shutdown_connections 2024-09-13T17:52:50.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.243+0000 7fbe0dc00640 1 -- 172.21.15.114:0/2209518420 wait complete. 2024-09-13T17:52:50.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.247+0000 7fbe0dc00640 1 Processor -- start 2024-09-13T17:52:50.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.247+0000 7fbe0dc00640 1 -- start start 2024-09-13T17:52:50.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.247+0000 7fbe0dc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe0806da90 0x7fbe0813ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:50.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.247+0000 7fbe0dc00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe0813c240 0x7fbe08154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:50.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.247+0000 7fbe0dc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe0813f420 0x7fbe080b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:50.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.247+0000 7fbe0dc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe08153a60 con 0x7fbe0806da90 2024-09-13T17:52:50.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.247+0000 7fbe0dc00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe08153cb0 con 0x7fbe0813c240 2024-09-13T17:52:50.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.247+0000 7fbe0dc00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe08153f90 con 0x7fbe0813f420 2024-09-13T17:52:50.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.247+0000 7fbe06a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe0806da90 0x7fbe0813ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:50.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.247+0000 7fbe06a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe0806da90 0x7fbe0813ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50520/0 (socket says 172.21.15.114:50520) 2024-09-13T17:52:50.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.247+0000 7fbe06a00640 1 -- 172.21.15.114:0/132040699 learned_addr learned my addr 172.21.15.114:0/132040699 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:50.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.247+0000 7fbdffe00640 1 --2- 172.21.15.114:0/132040699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe0813c240 0x7fbe08154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:50.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.247+0000 7fbe07400640 1 --2- 172.21.15.114:0/132040699 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe0813f420 0x7fbe080b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:50.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.247+0000 7fbe06a00640 1 -- 172.21.15.114:0/132040699 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe0813f420 msgr2=0x7fbe080b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:50.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.247+0000 7fbe06a00640 1 --2- 172.21.15.114:0/132040699 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe0813f420 0x7fbe080b09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:50.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.247+0000 7fbe06a00640 1 -- 172.21.15.114:0/132040699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe0813c240 msgr2=0x7fbe08154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:50.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.247+0000 7fbe06a00640 1 --2- 172.21.15.114:0/132040699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe0813c240 0x7fbe08154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:50.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.247+0000 7fbe06a00640 1 -- 172.21.15.114:0/132040699 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe00009a70 con 0x7fbe0806da90 2024-09-13T17:52:50.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.247+0000 7fbe06a00640 1 --2- 172.21.15.114:0/132040699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe0806da90 0x7fbe0813ee10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800c4d0 tx=0x7fbdf800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:50.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.247+0000 7fbdfea00640 1 -- 172.21.15.114:0/132040699 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8005cf0 con 0x7fbe0806da90 2024-09-13T17:52:50.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.247+0000 7fbdfea00640 1 -- 172.21.15.114:0/132040699 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf8005e50 con 0x7fbe0806da90 2024-09-13T17:52:50.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.247+0000 7fbdfea00640 1 -- 172.21.15.114:0/132040699 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8007270 con 0x7fbe0806da90 2024-09-13T17:52:50.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.247+0000 7fbe0dc00640 1 -- 172.21.15.114:0/132040699 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe08154270 con 0x7fbe0806da90 2024-09-13T17:52:50.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.247+0000 7fbe0dc00640 1 -- 172.21.15.114:0/132040699 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe08154830 con 0x7fbe0806da90 2024-09-13T17:52:50.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.251+0000 7fbe0dc00640 1 -- 172.21.15.114:0/132040699 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe08154a20 con 0x7fbe0806da90 2024-09-13T17:52:50.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.251+0000 7fbdfea00640 1 -- 172.21.15.114:0/132040699 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbdf80073d0 con 0x7fbe0806da90 2024-09-13T17:52:50.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.251+0000 7fbdfea00640 1 --2- 172.21.15.114:0/132040699 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbde4066690 0x7fbde4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:50.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.251+0000 7fbdfea00640 1 -- 172.21.15.114:0/132040699 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbdf8083b80 con 0x7fbe0806da90 2024-09-13T17:52:50.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.251+0000 7fbdffe00640 1 --2- 172.21.15.114:0/132040699 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbde4066690 0x7fbde4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:50.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.251+0000 7fbdffe00640 1 --2- 172.21.15.114:0/132040699 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbde4066690 0x7fbde4068b50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbdf000b240 tx=0x7fbdf000b3a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:50.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.255+0000 7fbdfea00640 1 -- 172.21.15.114:0/132040699 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbdf8050ab0 con 0x7fbe0806da90 2024-09-13T17:52:50.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.423+0000 7fbe0dc00640 1 -- 172.21.15.114:0/132040699 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbe08159790 con 0x7fbe0806da90 2024-09-13T17:52:50.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.423+0000 7fbdfea00640 1 -- 172.21.15.114:0/132040699 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbdf8083e60 con 0x7fbe0806da90 2024-09-13T17:52:50.429 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-13T17:52:50.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.427+0000 7fbe0dc00640 1 -- 172.21.15.114:0/132040699 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbde4066690 msgr2=0x7fbde4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:50.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.427+0000 7fbe0dc00640 1 --2- 172.21.15.114:0/132040699 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbde4066690 0x7fbde4068b50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbdf000b240 tx=0x7fbdf000b3a0 comp rx=0 tx=0).stop 2024-09-13T17:52:50.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.427+0000 7fbe0dc00640 1 -- 172.21.15.114:0/132040699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe0806da90 msgr2=0x7fbe0813ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:50.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.427+0000 7fbe0dc00640 1 --2- 172.21.15.114:0/132040699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe0806da90 0x7fbe0813ee10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800c4d0 tx=0x7fbdf800c990 comp rx=0 tx=0).stop 2024-09-13T17:52:50.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.427+0000 7fbe0dc00640 1 -- 172.21.15.114:0/132040699 shutdown_connections 2024-09-13T17:52:50.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.427+0000 7fbe0dc00640 1 --2- 172.21.15.114:0/132040699 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbde4066690 0x7fbde4068b50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:50.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.427+0000 7fbe0dc00640 1 --2- 172.21.15.114:0/132040699 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbe0813f420 0x7fbe080b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:50.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.427+0000 7fbe0dc00640 1 --2- 172.21.15.114:0/132040699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe0813c240 0x7fbe08154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:50.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.427+0000 7fbe0dc00640 1 --2- 172.21.15.114:0/132040699 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbe0806da90 0x7fbe0813ee10 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:50.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.427+0000 7fbe0dc00640 1 -- 172.21.15.114:0/132040699 >> 172.21.15.114:0/132040699 conn(0x7fbe080660b0 msgr2=0x7fbe08155eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:50.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.427+0000 7fbe0dc00640 1 -- 172.21.15.114:0/132040699 shutdown_connections 2024-09-13T17:52:50.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.427+0000 7fbe0dc00640 1 -- 172.21.15.114:0/132040699 wait complete. 2024-09-13T17:52:50.450 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-13T17:52:50.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:50.450 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-13T17:52:50.474 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-09-13T17:52:50.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:50.474 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T17:52:50.526 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:52:50.526 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:52:50.535 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:52:50.535 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:52:50.586 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:52:50.586 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:52:50.637 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:52:50.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.767+0000 7f59c0e00640 1 Processor -- start 2024-09-13T17:52:50.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.767+0000 7f59c0e00640 1 -- start start 2024-09-13T17:52:50.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.767+0000 7f59c0e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f59bc13f420 0x7f59bc06d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:50.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.767+0000 7f59c0e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59bc06da90 0x7f59bc0cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:50.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.767+0000 7f59c0e00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59bc0cd220 con 0x7f59bc13c240 2024-09-13T17:52:50.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.767+0000 7f59c0e00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59bc06df40 con 0x7f59bc13f420 2024-09-13T17:52:50.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.767+0000 7f59c0e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc15a740 con 0x7f59bc06da90 2024-09-13T17:52:50.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.767+0000 7f59b1400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f59bc13f420 0x7f59bc06d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:50.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.767+0000 7f59ba800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59bc06da90 0x7f59bc0cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:50.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.767+0000 7f59ba800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59bc06da90 0x7f59bc0cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:41938/0 (socket says 172.21.15.114:41938) 2024-09-13T17:52:50.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.767+0000 7f59b9e00640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f59bc13c240 0x7f59bc13c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:34766/0 (socket says 172.21.15.114:34766) 2024-09-13T17:52:50.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.767+0000 7f59b1400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f59bc13f420 0x7f59bc06d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:51290/0 (socket says 172.21.15.114:51290) 2024-09-13T17:52:50.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.767+0000 7f59ba800640 1 -- 172.21.15.114:0/1871111231 learned_addr learned my addr 172.21.15.114:0/1871111231 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:50.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.771+0000 7f59ba800640 1 -- 172.21.15.114:0/1871111231 >> v2:172.21.15.134:3300/0 conn(0x7f59bc13f420 msgr2=0x7f59bc06d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:50.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.771+0000 7f59ba800640 1 --2- 172.21.15.114:0/1871111231 >> v2:172.21.15.134:3300/0 conn(0x7f59bc13f420 0x7f59bc06d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:50.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.771+0000 7f59ba800640 1 -- 172.21.15.114:0/1871111231 >> v1:172.21.15.134:6789/0 conn(0x7f59bc13c240 legacy=0x7f59bc13c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:50.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.771+0000 7f59ba800640 1 -- 172.21.15.114:0/1871111231 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59bc159bc0 con 0x7f59bc06da90 2024-09-13T17:52:50.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.771+0000 7f59b9400640 1 -- 172.21.15.114:0/1871111231 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287279858 0 0) 0x7f59bc0cd220 con 0x7f59bc13c240 2024-09-13T17:52:50.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.771+0000 7f59ba800640 1 --2- 172.21.15.114:0/1871111231 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59bc06da90 0x7f59bc0cd650 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f59b4009e50 tx=0x7f59b401ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cde11fe1b66debe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:50.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.771+0000 7f59b9400640 1 -- 172.21.15.114:0/1871111231 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b40a58d0 con 0x7f59bc06da90 2024-09-13T17:52:50.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.771+0000 7f59b9400640 1 -- 172.21.15.114:0/1871111231 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b40a5a30 con 0x7f59bc06da90 2024-09-13T17:52:50.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.771+0000 7f59b9400640 1 -- 172.21.15.114:0/1871111231 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b40a5dc0 con 0x7f59bc06da90 2024-09-13T17:52:50.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.771+0000 7f59c0e00640 1 -- 172.21.15.114:0/1871111231 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59bc06da90 msgr2=0x7f59bc0cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:50.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59c0e00640 1 --2- 172.21.15.114:0/1871111231 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59bc06da90 0x7f59bc0cd650 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f59b4009e50 tx=0x7f59b401ca00 comp rx=0 tx=0).stop 2024-09-13T17:52:50.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59c0e00640 1 -- 172.21.15.114:0/1871111231 shutdown_connections 2024-09-13T17:52:50.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59c0e00640 1 --2- 172.21.15.114:0/1871111231 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59bc06da90 0x7f59bc0cd650 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:50.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59c0e00640 1 --2- 172.21.15.114:0/1871111231 >> v2:172.21.15.134:3300/0 conn(0x7f59bc13f420 0x7f59bc06d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:50.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59c0e00640 1 -- 172.21.15.114:0/1871111231 >> 172.21.15.114:0/1871111231 conn(0x7f59bc0660b0 msgr2=0x7f59bc069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:50.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59c0e00640 1 -- 172.21.15.114:0/1871111231 shutdown_connections 2024-09-13T17:52:50.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59c0e00640 1 -- 172.21.15.114:0/1871111231 wait complete. 2024-09-13T17:52:50.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59c0e00640 1 Processor -- start 2024-09-13T17:52:50.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59c0e00640 1 -- start start 2024-09-13T17:52:50.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59c0e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59bc06da90 0x7f59bc14de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:50.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59c0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59bc13c240 0x7f59bc139030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:50.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59c0e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59bc13f420 0x7f59bc138890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:50.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59c0e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc13a3b0 con 0x7f59bc13c240 2024-09-13T17:52:50.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59c0e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc139570 con 0x7f59bc13f420 2024-09-13T17:52:50.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59c0e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc1397a0 con 0x7f59bc06da90 2024-09-13T17:52:50.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59b9e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59bc06da90 0x7f59bc14de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:50.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59ba800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59bc13f420 0x7f59bc138890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:50.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59b9e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59bc06da90 0x7f59bc14de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:41946/0 (socket says 172.21.15.114:41946) 2024-09-13T17:52:50.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59b9e00640 1 -- 172.21.15.114:0/2638012755 learned_addr learned my addr 172.21.15.114:0/2638012755 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:50.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59b1400640 1 --2- 172.21.15.114:0/2638012755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59bc13c240 0x7f59bc139030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:50.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59b9e00640 1 -- 172.21.15.114:0/2638012755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59bc13f420 msgr2=0x7f59bc138890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:50.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59b9e00640 1 --2- 172.21.15.114:0/2638012755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59bc13f420 0x7f59bc138890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:50.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59b9e00640 1 -- 172.21.15.114:0/2638012755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59bc13c240 msgr2=0x7f59bc139030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:50.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59b9e00640 1 --2- 172.21.15.114:0/2638012755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59bc13c240 0x7f59bc139030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:50.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59b9e00640 1 -- 172.21.15.114:0/2638012755 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b4009b30 con 0x7f59bc06da90 2024-09-13T17:52:50.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59b9e00640 1 --2- 172.21.15.114:0/2638012755 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59bc06da90 0x7f59bc14de90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00c520 tx=0x7f59ac00c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:50.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59b2a00640 1 -- 172.21.15.114:0/2638012755 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac0074e0 con 0x7f59bc06da90 2024-09-13T17:52:50.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59b2a00640 1 -- 172.21.15.114:0/2638012755 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ac007640 con 0x7f59bc06da90 2024-09-13T17:52:50.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.775+0000 7f59b2a00640 1 -- 172.21.15.114:0/2638012755 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac0049f0 con 0x7f59bc06da90 2024-09-13T17:52:50.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.779+0000 7f59c0e00640 1 -- 172.21.15.114:0/2638012755 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59bc139a80 con 0x7f59bc06da90 2024-09-13T17:52:50.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.779+0000 7f59c0e00640 1 -- 172.21.15.114:0/2638012755 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59bc13a040 con 0x7f59bc06da90 2024-09-13T17:52:50.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.779+0000 7f59c0e00640 1 -- 172.21.15.114:0/2638012755 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59bc159790 con 0x7f59bc06da90 2024-09-13T17:52:50.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.779+0000 7f59b2a00640 1 -- 172.21.15.114:0/2638012755 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f59ac004b50 con 0x7f59bc06da90 2024-09-13T17:52:50.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.779+0000 7f59b2a00640 1 --2- 172.21.15.114:0/2638012755 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5998066690 0x7f5998068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:50.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.779+0000 7f59b2a00640 1 -- 172.21.15.114:0/2638012755 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f59ac083740 con 0x7f59bc06da90 2024-09-13T17:52:50.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.779+0000 7f59b1400640 1 --2- 172.21.15.114:0/2638012755 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5998066690 0x7f5998068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:50.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.779+0000 7f59b1400640 1 --2- 172.21.15.114:0/2638012755 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5998066690 0x7f5998068b50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f59bc157100 tx=0x7f59a4009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:50.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.783+0000 7f59b2a00640 1 -- 172.21.15.114:0/2638012755 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f59ac050790 con 0x7f59bc06da90 2024-09-13T17:52:50.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.939+0000 7f59c0e00640 1 -- 172.21.15.114:0/2638012755 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59bc13a1d0 con 0x7f59bc06da90 2024-09-13T17:52:50.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.939+0000 7f59b2a00640 1 -- 172.21.15.114:0/2638012755 <== mon.2 v2:172.21.15.134:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18784 (secure 0 0 0) 0x7f59ac053db0 con 0x7f59bc06da90 2024-09-13T17:52:50.944 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:50.944 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:52:31.139000+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:51:48.278220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:51:48.773888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:51:51.856300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:52:50.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.943+0000 7f59c0e00640 1 -- 172.21.15.114:0/2638012755 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5998066690 msgr2=0x7f5998068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:50.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.943+0000 7f59c0e00640 1 --2- 172.21.15.114:0/2638012755 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5998066690 0x7f5998068b50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f59bc157100 tx=0x7f59a4009190 comp rx=0 tx=0).stop 2024-09-13T17:52:50.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.943+0000 7f59c0e00640 1 -- 172.21.15.114:0/2638012755 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59bc06da90 msgr2=0x7f59bc14de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:50.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.943+0000 7f59c0e00640 1 --2- 172.21.15.114:0/2638012755 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59bc06da90 0x7f59bc14de90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00c520 tx=0x7f59ac00c9e0 comp rx=0 tx=0).stop 2024-09-13T17:52:50.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.943+0000 7f59c0e00640 1 -- 172.21.15.114:0/2638012755 shutdown_connections 2024-09-13T17:52:50.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.943+0000 7f59c0e00640 1 --2- 172.21.15.114:0/2638012755 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5998066690 0x7f5998068b50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:50.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.943+0000 7f59c0e00640 1 --2- 172.21.15.114:0/2638012755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59bc13f420 0x7f59bc138890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:50.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.943+0000 7f59c0e00640 1 --2- 172.21.15.114:0/2638012755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59bc13c240 0x7f59bc139030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:50.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.943+0000 7f59c0e00640 1 --2- 172.21.15.114:0/2638012755 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f59bc06da90 0x7f59bc14de90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:50.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.943+0000 7f59c0e00640 1 -- 172.21.15.114:0/2638012755 >> 172.21.15.114:0/2638012755 conn(0x7f59bc0660b0 msgr2=0x7f59bc14e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:50.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.943+0000 7f59c0e00640 1 -- 172.21.15.114:0/2638012755 shutdown_connections 2024-09-13T17:52:50.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:50.943+0000 7f59c0e00640 1 -- 172.21.15.114:0/2638012755 wait complete. 2024-09-13T17:52:50.965 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:51:37.996254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:51:48.278220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:51:48.773888+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:51:51.856300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:52:50.966 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:52:51.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.107+0000 7fc85dc00640 1 Processor -- start 2024-09-13T17:52:51.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.107+0000 7fc85dc00640 1 -- start start 2024-09-13T17:52:51.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.107+0000 7fc85dc00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc858158a70 0x7fc858070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:51.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.107+0000 7fc85dc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc858159be0 0x7fc8580711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:51.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.107+0000 7fc85dc00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8580b2490 con 0x7fc8580b1510 2024-09-13T17:52:51.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.107+0000 7fc85dc00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc858158e50 con 0x7fc858158a70 2024-09-13T17:52:51.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.107+0000 7fc85dc00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8580b21b0 con 0x7fc858159be0 2024-09-13T17:52:51.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.107+0000 7fc84fe00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc858159be0 0x7fc8580711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:51.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.107+0000 7fc84fe00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc858159be0 0x7fc8580711f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:49488/0 (socket says 172.21.15.114:49488) 2024-09-13T17:52:51.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.107+0000 7fc84fe00640 1 -- 172.21.15.114:0/3571174135 learned_addr learned my addr 172.21.15.114:0/3571174135 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:51.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.107+0000 7fc856a00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc858158a70 0x7fc858070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:51.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.107+0000 7fc84fe00640 1 -- 172.21.15.114:0/3571174135 >> v2:172.21.15.134:3300/0 conn(0x7fc858158a70 msgr2=0x7fc858070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:51.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.107+0000 7fc84fe00640 1 --2- 172.21.15.114:0/3571174135 >> v2:172.21.15.134:3300/0 conn(0x7fc858158a70 0x7fc858070cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:51.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.107+0000 7fc84fe00640 1 -- 172.21.15.114:0/3571174135 >> v1:172.21.15.134:6789/0 conn(0x7fc8580b1510 legacy=0x7fc8580b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:51.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.107+0000 7fc84fe00640 1 -- 172.21.15.114:0/3571174135 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc858159100 con 0x7fc858159be0 2024-09-13T17:52:51.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.111+0000 7fc84fe00640 1 --2- 172.21.15.114:0/3571174135 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc858159be0 0x7fc8580711f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc84000aa10 tx=0x7fc84001d900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e491904b8eee14ea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:51.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.111+0000 7fc856000640 1 -- 172.21.15.114:0/3571174135 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8400a6930 con 0x7fc858159be0 2024-09-13T17:52:51.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.111+0000 7fc856000640 1 -- 172.21.15.114:0/3571174135 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8400a6a90 con 0x7fc858159be0 2024-09-13T17:52:51.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.111+0000 7fc856000640 1 -- 172.21.15.114:0/3571174135 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8400a6e20 con 0x7fc858159be0 2024-09-13T17:52:51.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.111+0000 7fc85dc00640 1 -- 172.21.15.114:0/3571174135 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc858159be0 msgr2=0x7fc8580711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:51.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.111+0000 7fc85dc00640 1 --2- 172.21.15.114:0/3571174135 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc858159be0 0x7fc8580711f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc84000aa10 tx=0x7fc84001d900 comp rx=0 tx=0).stop 2024-09-13T17:52:51.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.111+0000 7fc85dc00640 1 -- 172.21.15.114:0/3571174135 shutdown_connections 2024-09-13T17:52:51.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.111+0000 7fc85dc00640 1 --2- 172.21.15.114:0/3571174135 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc858159be0 0x7fc8580711f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:51.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.111+0000 7fc85dc00640 1 --2- 172.21.15.114:0/3571174135 >> v2:172.21.15.134:3300/0 conn(0x7fc858158a70 0x7fc858070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:51.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.111+0000 7fc85dc00640 1 -- 172.21.15.114:0/3571174135 >> 172.21.15.114:0/3571174135 conn(0x7fc8580660b0 msgr2=0x7fc858069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:51.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.111+0000 7fc85dc00640 1 -- 172.21.15.114:0/3571174135 shutdown_connections 2024-09-13T17:52:51.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.111+0000 7fc85dc00640 1 -- 172.21.15.114:0/3571174135 wait complete. 2024-09-13T17:52:51.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.111+0000 7fc85dc00640 1 Processor -- start 2024-09-13T17:52:51.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.111+0000 7fc85dc00640 1 -- start start 2024-09-13T17:52:51.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.115+0000 7fc85dc00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8580b1510 0x7fc858148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:51.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.115+0000 7fc85dc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc858158a70 0x7fc8580af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:51.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.115+0000 7fc85dc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc858159be0 0x7fc85814dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:51.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.115+0000 7fc85dc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8580aff70 con 0x7fc858159be0 2024-09-13T17:52:51.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.115+0000 7fc85dc00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc858155b70 con 0x7fc8580b1510 2024-09-13T17:52:51.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.115+0000 7fc85dc00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc858155350 con 0x7fc858158a70 2024-09-13T17:52:51.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.115+0000 7fc857400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc858159be0 0x7fc85814dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:51.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.115+0000 7fc857400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc858159be0 0x7fc85814dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42454/0 (socket says 172.21.15.114:42454) 2024-09-13T17:52:51.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.115+0000 7fc857400640 1 -- 172.21.15.114:0/2963599252 learned_addr learned my addr 172.21.15.114:0/2963599252 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:51.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.115+0000 7fc84fe00640 1 --2- 172.21.15.114:0/2963599252 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc858158a70 0x7fc8580af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:51.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.115+0000 7fc856a00640 1 --2- 172.21.15.114:0/2963599252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8580b1510 0x7fc858148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:51.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.115+0000 7fc857400640 1 -- 172.21.15.114:0/2963599252 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc858158a70 msgr2=0x7fc8580af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:51.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.115+0000 7fc857400640 1 --2- 172.21.15.114:0/2963599252 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc858158a70 0x7fc8580af860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:51.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.115+0000 7fc857400640 1 -- 172.21.15.114:0/2963599252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8580b1510 msgr2=0x7fc858148920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:51.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.115+0000 7fc857400640 1 --2- 172.21.15.114:0/2963599252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8580b1510 0x7fc858148920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:51.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.115+0000 7fc857400640 1 -- 172.21.15.114:0/2963599252 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84000a670 con 0x7fc858159be0 2024-09-13T17:52:51.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.115+0000 7fc857400640 1 --2- 172.21.15.114:0/2963599252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc858159be0 0x7fc85814dd30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc85000c770 tx=0x7fc85000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:51.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.115+0000 7fc84ea00640 1 -- 172.21.15.114:0/2963599252 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc850003b80 con 0x7fc858159be0 2024-09-13T17:52:51.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.115+0000 7fc84ea00640 1 -- 172.21.15.114:0/2963599252 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc850003ce0 con 0x7fc858159be0 2024-09-13T17:52:51.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.115+0000 7fc84ea00640 1 -- 172.21.15.114:0/2963599252 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85000aa30 con 0x7fc858159be0 2024-09-13T17:52:51.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.115+0000 7fc85dc00640 1 -- 172.21.15.114:0/2963599252 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8581555f0 con 0x7fc858159be0 2024-09-13T17:52:51.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.115+0000 7fc85dc00640 1 -- 172.21.15.114:0/2963599252 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8581f8810 con 0x7fc858159be0 2024-09-13T17:52:51.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.115+0000 7fc85dc00640 1 -- 172.21.15.114:0/2963599252 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8581f8a00 con 0x7fc858159be0 2024-09-13T17:52:51.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.119+0000 7fc84ea00640 1 -- 172.21.15.114:0/2963599252 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc85000ab90 con 0x7fc858159be0 2024-09-13T17:52:51.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.119+0000 7fc84ea00640 1 --2- 172.21.15.114:0/2963599252 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc834066690 0x7fc834068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:51.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.119+0000 7fc84ea00640 1 -- 172.21.15.114:0/2963599252 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc8500841e0 con 0x7fc858159be0 2024-09-13T17:52:51.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.119+0000 7fc856a00640 1 --2- 172.21.15.114:0/2963599252 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc834066690 0x7fc834068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:51.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.119+0000 7fc856a00640 1 --2- 172.21.15.114:0/2963599252 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc834066690 0x7fc834068b50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc848009b60 tx=0x7fc848009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:51.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.123+0000 7fc84ea00640 1 -- 172.21.15.114:0/2963599252 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc850051240 con 0x7fc858159be0 2024-09-13T17:52:51.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.279+0000 7fc85dc00640 1 -- 172.21.15.114:0/2963599252 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc8580b19a0 con 0x7fc858159be0 2024-09-13T17:52:51.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.279+0000 7fc84ea00640 1 -- 172.21.15.114:0/2963599252 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc850054860 con 0x7fc858159be0 2024-09-13T17:52:51.284 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-13T17:52:51.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.283+0000 7fc85dc00640 1 -- 172.21.15.114:0/2963599252 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc834066690 msgr2=0x7fc834068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:51.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.283+0000 7fc85dc00640 1 --2- 172.21.15.114:0/2963599252 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc834066690 0x7fc834068b50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc848009b60 tx=0x7fc848009190 comp rx=0 tx=0).stop 2024-09-13T17:52:51.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.283+0000 7fc85dc00640 1 -- 172.21.15.114:0/2963599252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc858159be0 msgr2=0x7fc85814dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:51.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.283+0000 7fc85dc00640 1 --2- 172.21.15.114:0/2963599252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc858159be0 0x7fc85814dd30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc85000c770 tx=0x7fc85000cc30 comp rx=0 tx=0).stop 2024-09-13T17:52:51.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.283+0000 7fc85dc00640 1 -- 172.21.15.114:0/2963599252 shutdown_connections 2024-09-13T17:52:51.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.283+0000 7fc85dc00640 1 --2- 172.21.15.114:0/2963599252 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc834066690 0x7fc834068b50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:51.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.283+0000 7fc85dc00640 1 --2- 172.21.15.114:0/2963599252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc858159be0 0x7fc85814dd30 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:51.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.283+0000 7fc85dc00640 1 --2- 172.21.15.114:0/2963599252 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc858158a70 0x7fc8580af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:51.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.283+0000 7fc85dc00640 1 --2- 172.21.15.114:0/2963599252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8580b1510 0x7fc858148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:51.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.283+0000 7fc85dc00640 1 -- 172.21.15.114:0/2963599252 >> 172.21.15.114:0/2963599252 conn(0x7fc8580660b0 msgr2=0x7fc8580ad7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:51.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.283+0000 7fc85dc00640 1 -- 172.21.15.114:0/2963599252 shutdown_connections 2024-09-13T17:52:51.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.283+0000 7fc85dc00640 1 -- 172.21.15.114:0/2963599252 wait complete. 2024-09-13T17:52:51.306 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:52:51.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.439+0000 7f3380a00640 1 Processor -- start 2024-09-13T17:52:51.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.439+0000 7f3380a00640 1 -- start start 2024-09-13T17:52:51.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.439+0000 7f3380a00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f337c070420 0x7f337c070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:51.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.439+0000 7f3380a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f337c06c540 0x7f337c06c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:51.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.439+0000 7f3380a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f337c151800 con 0x7f337c151420 2024-09-13T17:52:51.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.439+0000 7f3380a00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f337c0cbc30 con 0x7f337c070420 2024-09-13T17:52:51.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.439+0000 7f3380a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337c070dd0 con 0x7f337c06c540 2024-09-13T17:52:51.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.439+0000 7f3379e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f337c151420 0x7f337c0cc660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50078/0 (socket says 172.21.15.114:50078) 2024-09-13T17:52:51.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.439+0000 7f3379e00640 1 -- 172.21.15.114:0/501680208 learned_addr learned my addr 172.21.15.114:0/501680208 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:51.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.439+0000 7f337a800640 1 --2- 172.21.15.114:0/501680208 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f337c06c540 0x7f337c06c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:51.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.439+0000 7f3379400640 1 --2- 172.21.15.114:0/501680208 >> v2:172.21.15.134:3300/0 conn(0x7f337c070420 0x7f337c070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:51.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.439+0000 7f3378a00640 1 -- 172.21.15.114:0/501680208 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3915198951 0 0) 0x7f337c151800 con 0x7f337c151420 2024-09-13T17:52:51.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.439+0000 7f3378a00640 1 -- 172.21.15.114:0/501680208 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3360003530 con 0x7f337c151420 2024-09-13T17:52:51.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.439+0000 7f337a800640 1 -- 172.21.15.114:0/501680208 >> v2:172.21.15.134:3300/0 conn(0x7f337c070420 msgr2=0x7f337c070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:51.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.439+0000 7f337a800640 1 --2- 172.21.15.114:0/501680208 >> v2:172.21.15.134:3300/0 conn(0x7f337c070420 0x7f337c070890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:51.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.439+0000 7f337a800640 1 -- 172.21.15.114:0/501680208 >> v1:172.21.15.114:6789/0 conn(0x7f337c151420 legacy=0x7f337c0cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:51.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.439+0000 7f337a800640 1 -- 172.21.15.114:0/501680208 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c0cafb0 con 0x7f337c06c540 2024-09-13T17:52:51.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.439+0000 7f3379400640 1 --2- 172.21.15.114:0/501680208 >> v2:172.21.15.134:3300/0 conn(0x7f337c070420 0x7f337c070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:52:51.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.443+0000 7f337a800640 1 --2- 172.21.15.114:0/501680208 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f337c06c540 0x7f337c06c970 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f33740097c0 tx=0x7f337401c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa47a160e04c04e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:51.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.443+0000 7f3378a00640 1 -- 172.21.15.114:0/501680208 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3374004230 con 0x7f337c06c540 2024-09-13T17:52:51.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.443+0000 7f3378a00640 1 -- 172.21.15.114:0/501680208 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33740a7050 con 0x7f337c06c540 2024-09-13T17:52:51.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.443+0000 7f3378a00640 1 -- 172.21.15.114:0/501680208 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3374003620 con 0x7f337c06c540 2024-09-13T17:52:51.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.443+0000 7f3380a00640 1 -- 172.21.15.114:0/501680208 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f337c06c540 msgr2=0x7f337c06c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:51.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.443+0000 7f3380a00640 1 --2- 172.21.15.114:0/501680208 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f337c06c540 0x7f337c06c970 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f33740097c0 tx=0x7f337401c350 comp rx=0 tx=0).stop 2024-09-13T17:52:51.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.443+0000 7f3380a00640 1 -- 172.21.15.114:0/501680208 shutdown_connections 2024-09-13T17:52:51.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.443+0000 7f3380a00640 1 --2- 172.21.15.114:0/501680208 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f337c06c540 0x7f337c06c970 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:51.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.443+0000 7f3380a00640 1 --2- 172.21.15.114:0/501680208 >> v2:172.21.15.134:3300/0 conn(0x7f337c070420 0x7f337c070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:51.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.443+0000 7f3380a00640 1 -- 172.21.15.114:0/501680208 >> 172.21.15.114:0/501680208 conn(0x7f337c0660b0 msgr2=0x7f337c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:51.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.443+0000 7f3380a00640 1 -- 172.21.15.114:0/501680208 shutdown_connections 2024-09-13T17:52:51.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.447+0000 7f3380a00640 1 -- 172.21.15.114:0/501680208 wait complete. 2024-09-13T17:52:51.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.447+0000 7f3380a00640 1 Processor -- start 2024-09-13T17:52:51.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.447+0000 7f3380a00640 1 -- start start 2024-09-13T17:52:51.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.447+0000 7f3380a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f337c06c540 0x7f337c0afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:51.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.447+0000 7f3380a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f337c070420 0x7f337c1488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:51.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.447+0000 7f3380a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c151420 0x7f337c1423c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:51.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.447+0000 7f3380a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c0af840 con 0x7f337c151420 2024-09-13T17:52:51.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.447+0000 7f3380a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c0aef50 con 0x7f337c070420 2024-09-13T17:52:51.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.447+0000 7f3380a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337c143180 con 0x7f337c06c540 2024-09-13T17:52:51.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.447+0000 7f337a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c151420 0x7f337c1423c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:51.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.447+0000 7f337a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c151420 0x7f337c1423c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42456/0 (socket says 172.21.15.114:42456) 2024-09-13T17:52:51.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.447+0000 7f337a800640 1 -- 172.21.15.114:0/3479015291 learned_addr learned my addr 172.21.15.114:0/3479015291 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:51.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.447+0000 7f3379e00640 1 --2- 172.21.15.114:0/3479015291 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f337c06c540 0x7f337c0afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:51.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.447+0000 7f3379400640 1 --2- 172.21.15.114:0/3479015291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f337c070420 0x7f337c1488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:51.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.447+0000 7f337a800640 1 -- 172.21.15.114:0/3479015291 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f337c06c540 msgr2=0x7f337c0afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:51.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.447+0000 7f337a800640 1 --2- 172.21.15.114:0/3479015291 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f337c06c540 0x7f337c0afcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:51.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.447+0000 7f337a800640 1 -- 172.21.15.114:0/3479015291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f337c070420 msgr2=0x7f337c1488a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:51.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.447+0000 7f337a800640 1 --2- 172.21.15.114:0/3479015291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f337c070420 0x7f337c1488a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:51.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.447+0000 7f337a800640 1 -- 172.21.15.114:0/3479015291 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3368009420 con 0x7f337c151420 2024-09-13T17:52:51.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.447+0000 7f337a800640 1 --2- 172.21.15.114:0/3479015291 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c151420 0x7f337c1423c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f337401aa00 tx=0x7f33740190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:51.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.447+0000 7f3372000640 1 -- 172.21.15.114:0/3479015291 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3374003a30 con 0x7f337c151420 2024-09-13T17:52:51.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.447+0000 7f3372000640 1 -- 172.21.15.114:0/3479015291 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3374003b90 con 0x7f337c151420 2024-09-13T17:52:51.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.447+0000 7f3380a00640 1 -- 172.21.15.114:0/3479015291 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3374009420 con 0x7f337c151420 2024-09-13T17:52:51.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.447+0000 7f3372000640 1 -- 172.21.15.114:0/3479015291 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33740ab440 con 0x7f337c151420 2024-09-13T17:52:51.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.447+0000 7f3380a00640 1 -- 172.21.15.114:0/3479015291 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f337c0af4d0 con 0x7f337c151420 2024-09-13T17:52:51.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.451+0000 7f3380a00640 1 -- 172.21.15.114:0/3479015291 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f337c0af9b0 con 0x7f337c151420 2024-09-13T17:52:51.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.451+0000 7f3372000640 1 -- 172.21.15.114:0/3479015291 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f33740b2040 con 0x7f337c151420 2024-09-13T17:52:51.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.451+0000 7f3372000640 1 --2- 172.21.15.114:0/3479015291 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f335c0666c0 0x7f335c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:51.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.451+0000 7f3372000640 1 -- 172.21.15.114:0/3479015291 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f337411e2b0 con 0x7f337c151420 2024-09-13T17:52:51.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.451+0000 7f3379e00640 1 --2- 172.21.15.114:0/3479015291 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f335c0666c0 0x7f335c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:51.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.451+0000 7f3379e00640 1 --2- 172.21.15.114:0/3479015291 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f335c0666c0 0x7f335c068b80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f336c005c10 tx=0x7f336c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:51.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.455+0000 7f3372000640 1 -- 172.21.15.114:0/3479015291 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f33740eb270 con 0x7f337c151420 2024-09-13T17:52:51.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.611+0000 7f3380a00640 1 -- 172.21.15.114:0/3479015291 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f337c06c970 con 0x7f337c151420 2024-09-13T17:52:51.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.611+0000 7f3372000640 1 -- 172.21.15.114:0/3479015291 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f33740ee890 con 0x7f337c151420 2024-09-13T17:52:51.615 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:52:51.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.611+0000 7f3380a00640 1 -- 172.21.15.114:0/3479015291 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f335c0666c0 msgr2=0x7f335c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:51.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.611+0000 7f3380a00640 1 --2- 172.21.15.114:0/3479015291 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f335c0666c0 0x7f335c068b80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f336c005c10 tx=0x7f336c009040 comp rx=0 tx=0).stop 2024-09-13T17:52:51.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.611+0000 7f3380a00640 1 -- 172.21.15.114:0/3479015291 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c151420 msgr2=0x7f337c1423c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:51.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.611+0000 7f3380a00640 1 --2- 172.21.15.114:0/3479015291 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c151420 0x7f337c1423c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f337401aa00 tx=0x7f33740190f0 comp rx=0 tx=0).stop 2024-09-13T17:52:51.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.611+0000 7f3380a00640 1 -- 172.21.15.114:0/3479015291 shutdown_connections 2024-09-13T17:52:51.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.611+0000 7f3380a00640 1 --2- 172.21.15.114:0/3479015291 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f335c0666c0 0x7f335c068b80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:51.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.611+0000 7f3380a00640 1 --2- 172.21.15.114:0/3479015291 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f337c151420 0x7f337c1423c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:51.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.611+0000 7f3380a00640 1 --2- 172.21.15.114:0/3479015291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f337c070420 0x7f337c1488a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:51.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.611+0000 7f3380a00640 1 --2- 172.21.15.114:0/3479015291 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f337c06c540 0x7f337c0afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:51.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.611+0000 7f3380a00640 1 -- 172.21.15.114:0/3479015291 >> 172.21.15.114:0/3479015291 conn(0x7f337c0660b0 msgr2=0x7f337c14f790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:51.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.611+0000 7f3380a00640 1 -- 172.21.15.114:0/3479015291 shutdown_connections 2024-09-13T17:52:51.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.611+0000 7f3380a00640 1 -- 172.21.15.114:0/3479015291 wait complete. 2024-09-13T17:52:51.636 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:52:51.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.767+0000 7fe871800640 1 Processor -- start 2024-09-13T17:52:51.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.771+0000 7fe871800640 1 -- start start 2024-09-13T17:52:51.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.771+0000 7fe871800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe86c13f420 0x7fe86c06d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:51.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.771+0000 7fe871800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe86c06da90 0x7fe86c0cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:51.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.771+0000 7fe871800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe86c0cd220 con 0x7fe86c13c240 2024-09-13T17:52:51.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.771+0000 7fe871800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe86c06df40 con 0x7fe86c06da90 2024-09-13T17:52:51.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.771+0000 7fe871800640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe86c15a740 con 0x7fe86c13f420 2024-09-13T17:52:51.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.771+0000 7fe86aa00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe86c13c240 0x7fe86c13c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50084/0 (socket says 172.21.15.114:50084) 2024-09-13T17:52:51.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.771+0000 7fe86aa00640 1 -- 172.21.15.114:0/1388632631 learned_addr learned my addr 172.21.15.114:0/1388632631 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:51.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.771+0000 7fe86b400640 1 --2- 172.21.15.114:0/1388632631 >> v2:172.21.15.114:3300/0 conn(0x7fe86c06da90 0x7fe86c0cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:51.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.771+0000 7fe862000640 1 --2- 172.21.15.114:0/1388632631 >> v2:172.21.15.134:3300/0 conn(0x7fe86c13f420 0x7fe86c06d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:51.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.771+0000 7fe86b400640 1 -- 172.21.15.114:0/1388632631 >> v2:172.21.15.134:3300/0 conn(0x7fe86c13f420 msgr2=0x7fe86c06d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:51.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.771+0000 7fe86b400640 1 --2- 172.21.15.114:0/1388632631 >> v2:172.21.15.134:3300/0 conn(0x7fe86c13f420 0x7fe86c06d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:51.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.771+0000 7fe86b400640 1 -- 172.21.15.114:0/1388632631 >> v1:172.21.15.114:6789/0 conn(0x7fe86c13c240 legacy=0x7fe86c13c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:51.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.771+0000 7fe86b400640 1 -- 172.21.15.114:0/1388632631 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86c159bc0 con 0x7fe86c06da90 2024-09-13T17:52:51.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.771+0000 7fe86a000640 1 -- 172.21.15.114:0/1388632631 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511312088 0 0) 0x7fe86c0cd220 con 0x7fe86c13c240 2024-09-13T17:52:51.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.775+0000 7fe86b400640 1 --2- 172.21.15.114:0/1388632631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe86c06da90 0x7fe86c0cd650 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe86c0ae130 tx=0x7fe86401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=969aa1762954b5c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:51.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.775+0000 7fe86a000640 1 -- 172.21.15.114:0/1388632631 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8640a59c0 con 0x7fe86c06da90 2024-09-13T17:52:51.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.775+0000 7fe86a000640 1 -- 172.21.15.114:0/1388632631 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8640a5b20 con 0x7fe86c06da90 2024-09-13T17:52:51.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.775+0000 7fe86a000640 1 -- 172.21.15.114:0/1388632631 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8640ad440 con 0x7fe86c06da90 2024-09-13T17:52:51.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.775+0000 7fe871800640 1 -- 172.21.15.114:0/1388632631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe86c06da90 msgr2=0x7fe86c0cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:51.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.775+0000 7fe871800640 1 --2- 172.21.15.114:0/1388632631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe86c06da90 0x7fe86c0cd650 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe86c0ae130 tx=0x7fe86401c900 comp rx=0 tx=0).stop 2024-09-13T17:52:51.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.775+0000 7fe871800640 1 -- 172.21.15.114:0/1388632631 shutdown_connections 2024-09-13T17:52:51.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.775+0000 7fe871800640 1 --2- 172.21.15.114:0/1388632631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe86c06da90 0x7fe86c0cd650 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:51.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.775+0000 7fe871800640 1 --2- 172.21.15.114:0/1388632631 >> v2:172.21.15.134:3300/0 conn(0x7fe86c13f420 0x7fe86c06d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:51.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.775+0000 7fe871800640 1 -- 172.21.15.114:0/1388632631 >> 172.21.15.114:0/1388632631 conn(0x7fe86c0660b0 msgr2=0x7fe86c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:51.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.775+0000 7fe871800640 1 -- 172.21.15.114:0/1388632631 shutdown_connections 2024-09-13T17:52:51.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.775+0000 7fe871800640 1 -- 172.21.15.114:0/1388632631 wait complete. 2024-09-13T17:52:51.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.775+0000 7fe871800640 1 Processor -- start 2024-09-13T17:52:51.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.775+0000 7fe871800640 1 -- start start 2024-09-13T17:52:51.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.779+0000 7fe871800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe86c06da90 0x7fe86c150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:51.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.779+0000 7fe871800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe86c13c240 0x7fe86c1f43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:51.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.779+0000 7fe871800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe86c13f420 0x7fe86c0ac150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:51.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.779+0000 7fe871800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86c13cba0 con 0x7fe86c13c240 2024-09-13T17:52:51.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.779+0000 7fe871800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86c0aba00 con 0x7fe86c13f420 2024-09-13T17:52:51.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.779+0000 7fe871800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe86c1f4900 con 0x7fe86c06da90 2024-09-13T17:52:51.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.779+0000 7fe862000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe86c13c240 0x7fe86c1f43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:51.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.779+0000 7fe862000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe86c13c240 0x7fe86c1f43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42474/0 (socket says 172.21.15.114:42474) 2024-09-13T17:52:51.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.779+0000 7fe862000640 1 -- 172.21.15.114:0/623791871 learned_addr learned my addr 172.21.15.114:0/623791871 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:51.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.779+0000 7fe86b400640 1 --2- 172.21.15.114:0/623791871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe86c13f420 0x7fe86c0ac150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:51.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.779+0000 7fe86aa00640 1 --2- 172.21.15.114:0/623791871 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe86c06da90 0x7fe86c150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:51.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.779+0000 7fe862000640 1 -- 172.21.15.114:0/623791871 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe86c06da90 msgr2=0x7fe86c150550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:51.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.779+0000 7fe862000640 1 --2- 172.21.15.114:0/623791871 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe86c06da90 0x7fe86c150550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:51.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.779+0000 7fe862000640 1 -- 172.21.15.114:0/623791871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe86c13f420 msgr2=0x7fe86c0ac150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:51.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.779+0000 7fe862000640 1 --2- 172.21.15.114:0/623791871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe86c13f420 0x7fe86c0ac150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:51.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.779+0000 7fe862000640 1 -- 172.21.15.114:0/623791871 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe864009a70 con 0x7fe86c13c240 2024-09-13T17:52:51.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.779+0000 7fe86aa00640 1 --2- 172.21.15.114:0/623791871 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe86c06da90 0x7fe86c150550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:51.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.779+0000 7fe862000640 1 --2- 172.21.15.114:0/623791871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe86c13c240 0x7fe86c1f43c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe85400e960 tx=0x7fe85400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:51.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.779+0000 7fe863400640 1 -- 172.21.15.114:0/623791871 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854009690 con 0x7fe86c13c240 2024-09-13T17:52:51.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.779+0000 7fe863400640 1 -- 172.21.15.114:0/623791871 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85400ca00 con 0x7fe86c13c240 2024-09-13T17:52:51.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.779+0000 7fe871800640 1 -- 172.21.15.114:0/623791871 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe86c150c30 con 0x7fe86c13c240 2024-09-13T17:52:51.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.779+0000 7fe863400640 1 -- 172.21.15.114:0/623791871 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85400cd70 con 0x7fe86c13c240 2024-09-13T17:52:51.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.779+0000 7fe871800640 1 -- 172.21.15.114:0/623791871 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe86c1511f0 con 0x7fe86c13c240 2024-09-13T17:52:51.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.779+0000 7fe871800640 1 -- 172.21.15.114:0/623791871 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe86c13cd50 con 0x7fe86c13c240 2024-09-13T17:52:51.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.779+0000 7fe863400640 1 -- 172.21.15.114:0/623791871 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe854013470 con 0x7fe86c13c240 2024-09-13T17:52:51.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.783+0000 7fe863400640 1 --2- 172.21.15.114:0/623791871 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe8480666c0 0x7fe848068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:51.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.783+0000 7fe863400640 1 -- 172.21.15.114:0/623791871 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe854084b20 con 0x7fe86c13c240 2024-09-13T17:52:51.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.783+0000 7fe86aa00640 1 --2- 172.21.15.114:0/623791871 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe8480666c0 0x7fe848068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:51.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.783+0000 7fe86aa00640 1 --2- 172.21.15.114:0/623791871 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe8480666c0 0x7fe848068b80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe85c007fd0 tx=0x7fe85c007c20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:51.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.787+0000 7fe863400640 1 -- 172.21.15.114:0/623791871 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe86c13cd50 con 0x7fe86c13c240 2024-09-13T17:52:51.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.939+0000 7fe871800640 1 -- 172.21.15.114:0/623791871 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe86c13cd50 con 0x7fe86c13c240 2024-09-13T17:52:51.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.939+0000 7fe863400640 1 -- 172.21.15.114:0/623791871 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe86c13cd50 con 0x7fe86c13c240 2024-09-13T17:52:51.943 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-09-13T17:52:51.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.939+0000 7fe871800640 1 -- 172.21.15.114:0/623791871 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe8480666c0 msgr2=0x7fe848068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:51.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.939+0000 7fe871800640 1 --2- 172.21.15.114:0/623791871 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe8480666c0 0x7fe848068b80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe85c007fd0 tx=0x7fe85c007c20 comp rx=0 tx=0).stop 2024-09-13T17:52:51.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.939+0000 7fe871800640 1 -- 172.21.15.114:0/623791871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe86c13c240 msgr2=0x7fe86c1f43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:51.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.939+0000 7fe871800640 1 --2- 172.21.15.114:0/623791871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe86c13c240 0x7fe86c1f43c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe85400e960 tx=0x7fe85400ee20 comp rx=0 tx=0).stop 2024-09-13T17:52:51.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.939+0000 7fe871800640 1 -- 172.21.15.114:0/623791871 shutdown_connections 2024-09-13T17:52:51.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.939+0000 7fe871800640 1 --2- 172.21.15.114:0/623791871 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe8480666c0 0x7fe848068b80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:51.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.939+0000 7fe871800640 1 --2- 172.21.15.114:0/623791871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe86c13f420 0x7fe86c0ac150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:51.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.939+0000 7fe871800640 1 --2- 172.21.15.114:0/623791871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe86c13c240 0x7fe86c1f43c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:51.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.939+0000 7fe871800640 1 --2- 172.21.15.114:0/623791871 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe86c06da90 0x7fe86c150550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:51.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.939+0000 7fe871800640 1 -- 172.21.15.114:0/623791871 >> 172.21.15.114:0/623791871 conn(0x7fe86c0660b0 msgr2=0x7fe86c13b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:51.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.939+0000 7fe871800640 1 -- 172.21.15.114:0/623791871 shutdown_connections 2024-09-13T17:52:51.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:51.939+0000 7fe871800640 1 -- 172.21.15.114:0/623791871 wait complete. 2024-09-13T17:52:51.964 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:52:52.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.099+0000 7f09eb800640 1 Processor -- start 2024-09-13T17:52:52.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.099+0000 7f09eb800640 1 -- start start 2024-09-13T17:52:52.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.099+0000 7f09eb800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09e4158a70 0x7f09e4070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:52.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.099+0000 7f09eb800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f09e4159be0 0x7f09e40711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:52.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.099+0000 7f09eb800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f09e40b1510 0x7f09e40b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:52.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.099+0000 7f09eb800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e40b2490 con 0x7f09e4159be0 2024-09-13T17:52:52.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.099+0000 7f09eb800640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e4158e50 con 0x7f09e40b1510 2024-09-13T17:52:52.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.099+0000 7f09eb800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e40b1ee0 con 0x7f09e4158a70 2024-09-13T17:52:52.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.099+0000 7f09dbe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f09e4159be0 0x7f09e40711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:52.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.099+0000 7f09dbe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f09e4159be0 0x7f09e40711f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42484/0 (socket says 172.21.15.114:42484) 2024-09-13T17:52:52.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.099+0000 7f09dbe00640 1 -- 172.21.15.114:0/4099359782 learned_addr learned my addr 172.21.15.114:0/4099359782 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:52.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.099+0000 7f09e8e00640 1 --2- 172.21.15.114:0/4099359782 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09e4158a70 0x7f09e4070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:52.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.099+0000 7f09e9800640 1 --2- 172.21.15.114:0/4099359782 >> v2:172.21.15.134:3300/0 conn(0x7f09e40b1510 0x7f09e40b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:52.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.099+0000 7f09dbe00640 1 -- 172.21.15.114:0/4099359782 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09e4158a70 msgr2=0x7f09e4070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:52.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.099+0000 7f09dbe00640 1 --2- 172.21.15.114:0/4099359782 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09e4158a70 0x7f09e4070cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:52.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.099+0000 7f09dbe00640 1 -- 172.21.15.114:0/4099359782 >> v2:172.21.15.134:3300/0 conn(0x7f09e40b1510 msgr2=0x7f09e40b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:52.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.099+0000 7f09dbe00640 1 --2- 172.21.15.114:0/4099359782 >> v2:172.21.15.134:3300/0 conn(0x7f09e40b1510 0x7f09e40b19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:52.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.099+0000 7f09dbe00640 1 -- 172.21.15.114:0/4099359782 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e40b21b0 con 0x7f09e4159be0 2024-09-13T17:52:52.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.099+0000 7f09e8e00640 1 --2- 172.21.15.114:0/4099359782 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09e4158a70 0x7f09e4070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:52.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.099+0000 7f09e9800640 1 --2- 172.21.15.114:0/4099359782 >> v2:172.21.15.134:3300/0 conn(0x7f09e40b1510 0x7f09e40b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:52.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.103+0000 7f09dbe00640 1 --2- 172.21.15.114:0/4099359782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09e4159be0 0x7f09e40711f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f09e40cc450 tx=0x7f09cc01e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6f82c5462aa554 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:52.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.103+0000 7f09e3e00640 1 -- 172.21.15.114:0/4099359782 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc004230 con 0x7f09e4159be0 2024-09-13T17:52:52.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.103+0000 7f09e3e00640 1 -- 172.21.15.114:0/4099359782 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09cc0ab070 con 0x7f09e4159be0 2024-09-13T17:52:52.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.103+0000 7f09e3e00640 1 -- 172.21.15.114:0/4099359782 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc0a7720 con 0x7f09e4159be0 2024-09-13T17:52:52.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.103+0000 7f09eb800640 1 -- 172.21.15.114:0/4099359782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09e4159be0 msgr2=0x7f09e40711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:52.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.103+0000 7f09eb800640 1 --2- 172.21.15.114:0/4099359782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09e4159be0 0x7f09e40711f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f09e40cc450 tx=0x7f09cc01e910 comp rx=0 tx=0).stop 2024-09-13T17:52:52.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.103+0000 7f09eb800640 1 -- 172.21.15.114:0/4099359782 shutdown_connections 2024-09-13T17:52:52.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.103+0000 7f09eb800640 1 --2- 172.21.15.114:0/4099359782 >> v2:172.21.15.134:3300/0 conn(0x7f09e40b1510 0x7f09e40b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:52.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.103+0000 7f09eb800640 1 --2- 172.21.15.114:0/4099359782 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09e4159be0 0x7f09e40711f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:52.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.103+0000 7f09eb800640 1 --2- 172.21.15.114:0/4099359782 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09e4158a70 0x7f09e4070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:52.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.103+0000 7f09eb800640 1 -- 172.21.15.114:0/4099359782 >> 172.21.15.114:0/4099359782 conn(0x7f09e40660b0 msgr2=0x7f09e4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:52.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.103+0000 7f09eb800640 1 -- 172.21.15.114:0/4099359782 shutdown_connections 2024-09-13T17:52:52.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.103+0000 7f09eb800640 1 -- 172.21.15.114:0/4099359782 wait complete. 2024-09-13T17:52:52.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.103+0000 7f09eb800640 1 Processor -- start 2024-09-13T17:52:52.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.103+0000 7f09eb800640 1 -- start start 2024-09-13T17:52:52.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.107+0000 7f09eb800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09e40b1510 0x7f09e413ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:52.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.107+0000 7f09eb800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09e4158a70 0x7f09e4156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:52.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.107+0000 7f09eb800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09e4159be0 0x7f09e414c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:52.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.107+0000 7f09eb800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e414e1d0 con 0x7f09e40b1510 2024-09-13T17:52:52.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.107+0000 7f09eb800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e414fa40 con 0x7f09e4159be0 2024-09-13T17:52:52.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.107+0000 7f09eb800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e41404b0 con 0x7f09e4158a70 2024-09-13T17:52:52.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.107+0000 7f09e8e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09e40b1510 0x7f09e413ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:52.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.107+0000 7f09e8e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09e40b1510 0x7f09e413ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42498/0 (socket says 172.21.15.114:42498) 2024-09-13T17:52:52.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.107+0000 7f09e8e00640 1 -- 172.21.15.114:0/1154039125 learned_addr learned my addr 172.21.15.114:0/1154039125 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:52.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.107+0000 7f09e9800640 1 --2- 172.21.15.114:0/1154039125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09e4159be0 0x7f09e414c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:52.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.107+0000 7f09dbe00640 1 --2- 172.21.15.114:0/1154039125 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09e4158a70 0x7f09e4156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:52.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.107+0000 7f09e8e00640 1 -- 172.21.15.114:0/1154039125 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09e4158a70 msgr2=0x7f09e4156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:52.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.107+0000 7f09e8e00640 1 --2- 172.21.15.114:0/1154039125 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09e4158a70 0x7f09e4156800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:52.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.107+0000 7f09e8e00640 1 -- 172.21.15.114:0/1154039125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09e4159be0 msgr2=0x7f09e414c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:52.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.107+0000 7f09e8e00640 1 --2- 172.21.15.114:0/1154039125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09e4159be0 0x7f09e414c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:52.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.107+0000 7f09e8e00640 1 -- 172.21.15.114:0/1154039125 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09cc00b780 con 0x7f09e40b1510 2024-09-13T17:52:52.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.107+0000 7f09e8e00640 1 --2- 172.21.15.114:0/1154039125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09e40b1510 0x7f09e413ff70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f09d400e810 tx=0x7f09d400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:52.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.107+0000 7f09e1600640 1 -- 172.21.15.114:0/1154039125 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d400c8d0 con 0x7f09e40b1510 2024-09-13T17:52:52.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.107+0000 7f09e1600640 1 -- 172.21.15.114:0/1154039125 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d400ca30 con 0x7f09e40b1510 2024-09-13T17:52:52.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.107+0000 7f09eb800640 1 -- 172.21.15.114:0/1154039125 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e4156d40 con 0x7f09e40b1510 2024-09-13T17:52:52.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.107+0000 7f09e1600640 1 -- 172.21.15.114:0/1154039125 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d400cde0 con 0x7f09e40b1510 2024-09-13T17:52:52.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.107+0000 7f09eb800640 1 -- 172.21.15.114:0/1154039125 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e4155a40 con 0x7f09e40b1510 2024-09-13T17:52:52.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.107+0000 7f09eb800640 1 -- 172.21.15.114:0/1154039125 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e40b19a0 con 0x7f09e40b1510 2024-09-13T17:52:52.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.107+0000 7f09e1600640 1 -- 172.21.15.114:0/1154039125 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f09d4013410 con 0x7f09e40b1510 2024-09-13T17:52:52.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.111+0000 7f09e1600640 1 --2- 172.21.15.114:0/1154039125 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f09c0066690 0x7f09c0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:52.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.111+0000 7f09e1600640 1 -- 172.21.15.114:0/1154039125 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f09d40842b0 con 0x7f09e40b1510 2024-09-13T17:52:52.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.111+0000 7f09dbe00640 1 --2- 172.21.15.114:0/1154039125 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f09c0066690 0x7f09c0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:52.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.111+0000 7f09dbe00640 1 --2- 172.21.15.114:0/1154039125 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f09c0066690 0x7f09c0068b50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f09cc0b1000 tx=0x7f09cc0b3040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:52.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.115+0000 7f09e1600640 1 -- 172.21.15.114:0/1154039125 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f09d4051300 con 0x7f09e40b1510 2024-09-13T17:52:52.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.271+0000 7f09eb800640 1 -- 172.21.15.114:0/1154039125 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f09e4157150 con 0x7f09e40b1510 2024-09-13T17:52:52.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.271+0000 7f09e1600640 1 -- 172.21.15.114:0/1154039125 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f09d4054920 con 0x7f09e40b1510 2024-09-13T17:52:52.276 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:52:52.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.275+0000 7f09eb800640 1 -- 172.21.15.114:0/1154039125 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f09c0066690 msgr2=0x7f09c0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:52.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.275+0000 7f09eb800640 1 --2- 172.21.15.114:0/1154039125 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f09c0066690 0x7f09c0068b50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f09cc0b1000 tx=0x7f09cc0b3040 comp rx=0 tx=0).stop 2024-09-13T17:52:52.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.275+0000 7f09eb800640 1 -- 172.21.15.114:0/1154039125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09e40b1510 msgr2=0x7f09e413ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:52.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.275+0000 7f09eb800640 1 --2- 172.21.15.114:0/1154039125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09e40b1510 0x7f09e413ff70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f09d400e810 tx=0x7f09d400ecd0 comp rx=0 tx=0).stop 2024-09-13T17:52:52.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.275+0000 7f09eb800640 1 -- 172.21.15.114:0/1154039125 shutdown_connections 2024-09-13T17:52:52.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.275+0000 7f09eb800640 1 --2- 172.21.15.114:0/1154039125 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f09c0066690 0x7f09c0068b50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:52.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.275+0000 7f09eb800640 1 --2- 172.21.15.114:0/1154039125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09e4159be0 0x7f09e414c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:52.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.275+0000 7f09eb800640 1 --2- 172.21.15.114:0/1154039125 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f09e4158a70 0x7f09e4156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:52.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.275+0000 7f09eb800640 1 --2- 172.21.15.114:0/1154039125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f09e40b1510 0x7f09e413ff70 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:52.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.275+0000 7f09eb800640 1 -- 172.21.15.114:0/1154039125 >> 172.21.15.114:0/1154039125 conn(0x7f09e40660b0 msgr2=0x7f09e40acb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:52.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.275+0000 7f09eb800640 1 -- 172.21.15.114:0/1154039125 shutdown_connections 2024-09-13T17:52:52.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.275+0000 7f09eb800640 1 -- 172.21.15.114:0/1154039125 wait complete. 2024-09-13T17:52:52.298 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:52:52.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.427+0000 7efd0ca00640 1 Processor -- start 2024-09-13T17:52:52.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.427+0000 7efd0ca00640 1 -- start start 2024-09-13T17:52:52.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.431+0000 7efd0ca00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd0813c240 0x7efd0813f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:52.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.431+0000 7efd0ca00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efd0813c980 0x7efd0806d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:52.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.431+0000 7efd0ca00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efd0806da90 0x7efd080cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:52.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.431+0000 7efd0ca00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd0806df00 con 0x7efd0806da90 2024-09-13T17:52:52.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.431+0000 7efd0ca00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd080cd220 con 0x7efd0813c980 2024-09-13T17:52:52.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.431+0000 7efd0ca00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0813f960 con 0x7efd0813c240 2024-09-13T17:52:52.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.431+0000 7efd06800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efd0806da90 0x7efd080cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:52.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.431+0000 7efd06800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efd0806da90 0x7efd080cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42514/0 (socket says 172.21.15.114:42514) 2024-09-13T17:52:52.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.431+0000 7efd06800640 1 -- 172.21.15.114:0/1313944627 learned_addr learned my addr 172.21.15.114:0/1313944627 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:52.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.431+0000 7efd05e00640 1 --2- 172.21.15.114:0/1313944627 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd0813c240 0x7efd0813f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:52.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.431+0000 7efcfd400640 1 --2- 172.21.15.114:0/1313944627 >> v2:172.21.15.134:3300/0 conn(0x7efd0813c980 0x7efd0806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:52.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.431+0000 7efd06800640 1 -- 172.21.15.114:0/1313944627 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd0813c240 msgr2=0x7efd0813f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:52.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.431+0000 7efd06800640 1 --2- 172.21.15.114:0/1313944627 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd0813c240 0x7efd0813f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:52.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.431+0000 7efd06800640 1 -- 172.21.15.114:0/1313944627 >> v2:172.21.15.134:3300/0 conn(0x7efd0813c980 msgr2=0x7efd0806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:52.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.431+0000 7efd06800640 1 --2- 172.21.15.114:0/1313944627 >> v2:172.21.15.134:3300/0 conn(0x7efd0813c980 0x7efd0806d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:52.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.431+0000 7efd06800640 1 -- 172.21.15.114:0/1313944627 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0815a740 con 0x7efd0806da90 2024-09-13T17:52:52.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.431+0000 7efcfd400640 1 --2- 172.21.15.114:0/1313944627 >> v2:172.21.15.134:3300/0 conn(0x7efd0813c980 0x7efd0806d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:52.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.435+0000 7efd06800640 1 --2- 172.21.15.114:0/1313944627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd0806da90 0x7efd080cd650 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7efd0806e930 tx=0x7efd0001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8105b52bb75df0f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:52.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.435+0000 7efd05400640 1 -- 172.21.15.114:0/1313944627 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd000a5840 con 0x7efd0806da90 2024-09-13T17:52:52.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.435+0000 7efd05400640 1 -- 172.21.15.114:0/1313944627 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd000a59a0 con 0x7efd0806da90 2024-09-13T17:52:52.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.435+0000 7efd05400640 1 -- 172.21.15.114:0/1313944627 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd000a5d30 con 0x7efd0806da90 2024-09-13T17:52:52.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.435+0000 7efd0ca00640 1 -- 172.21.15.114:0/1313944627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd0806da90 msgr2=0x7efd080cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:52.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.435+0000 7efd0ca00640 1 --2- 172.21.15.114:0/1313944627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd0806da90 0x7efd080cd650 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7efd0806e930 tx=0x7efd0001c9c0 comp rx=0 tx=0).stop 2024-09-13T17:52:52.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.435+0000 7efd0ca00640 1 -- 172.21.15.114:0/1313944627 shutdown_connections 2024-09-13T17:52:52.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.435+0000 7efd0ca00640 1 --2- 172.21.15.114:0/1313944627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd0806da90 0x7efd080cd650 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:52.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.435+0000 7efd0ca00640 1 --2- 172.21.15.114:0/1313944627 >> v2:172.21.15.134:3300/0 conn(0x7efd0813c980 0x7efd0806d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:52.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.435+0000 7efd0ca00640 1 --2- 172.21.15.114:0/1313944627 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd0813c240 0x7efd0813f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:52.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.435+0000 7efd0ca00640 1 -- 172.21.15.114:0/1313944627 >> 172.21.15.114:0/1313944627 conn(0x7efd080660b0 msgr2=0x7efd08069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:52.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.435+0000 7efd0ca00640 1 -- 172.21.15.114:0/1313944627 shutdown_connections 2024-09-13T17:52:52.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.435+0000 7efd0ca00640 1 -- 172.21.15.114:0/1313944627 wait complete. 2024-09-13T17:52:52.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.435+0000 7efd0ca00640 1 Processor -- start 2024-09-13T17:52:52.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.435+0000 7efd0ca00640 1 -- start start 2024-09-13T17:52:52.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.435+0000 7efd0ca00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd0806da90 0x7efd081f7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:52.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.435+0000 7efd0ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd0813c240 0x7efd081f6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:52.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.435+0000 7efd0ca00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd0813c980 0x7efd0813e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:52.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.435+0000 7efd0ca00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd081f76c0 con 0x7efd0813c240 2024-09-13T17:52:52.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.435+0000 7efd0ca00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd081f8020 con 0x7efd0806da90 2024-09-13T17:52:52.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.435+0000 7efd0ca00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd081f6a40 con 0x7efd0813c980 2024-09-13T17:52:52.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.439+0000 7efcfd400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd0813c240 0x7efd081f6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:52.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.439+0000 7efd06800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd0813c980 0x7efd0813e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:52.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.439+0000 7efcfd400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd0813c240 0x7efd081f6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42524/0 (socket says 172.21.15.114:42524) 2024-09-13T17:52:52.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.439+0000 7efcfd400640 1 -- 172.21.15.114:0/924104853 learned_addr learned my addr 172.21.15.114:0/924104853 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:52.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.439+0000 7efd05e00640 1 --2- 172.21.15.114:0/924104853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd0806da90 0x7efd081f7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:52.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.439+0000 7efd05e00640 1 -- 172.21.15.114:0/924104853 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd0813c980 msgr2=0x7efd0813e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:52.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.439+0000 7efd05e00640 1 --2- 172.21.15.114:0/924104853 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd0813c980 0x7efd0813e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:52.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.439+0000 7efd05e00640 1 -- 172.21.15.114:0/924104853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd0813c240 msgr2=0x7efd081f6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:52.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.439+0000 7efd05e00640 1 --2- 172.21.15.114:0/924104853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd0813c240 0x7efd081f6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:52.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.439+0000 7efd05e00640 1 -- 172.21.15.114:0/924104853 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd00009b30 con 0x7efd0806da90 2024-09-13T17:52:52.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.439+0000 7efd06800640 1 --2- 172.21.15.114:0/924104853 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd0813c980 0x7efd0813e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:52:52.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.439+0000 7efcfd400640 1 --2- 172.21.15.114:0/924104853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd0813c240 0x7efd081f6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:52:52.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.439+0000 7efd05e00640 1 --2- 172.21.15.114:0/924104853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd0806da90 0x7efd081f7ae0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efcf800e820 tx=0x7efcf800ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:52.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.439+0000 7efcfea00640 1 -- 172.21.15.114:0/924104853 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf800c940 con 0x7efd0806da90 2024-09-13T17:52:52.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.439+0000 7efcfea00640 1 -- 172.21.15.114:0/924104853 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf800caa0 con 0x7efd0806da90 2024-09-13T17:52:52.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.439+0000 7efcfea00640 1 -- 172.21.15.114:0/924104853 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf800ce10 con 0x7efd0806da90 2024-09-13T17:52:52.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.439+0000 7efd0ca00640 1 -- 172.21.15.114:0/924104853 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd081f6d20 con 0x7efd0806da90 2024-09-13T17:52:52.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.439+0000 7efd0ca00640 1 -- 172.21.15.114:0/924104853 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd081f72e0 con 0x7efd0806da90 2024-09-13T17:52:52.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.439+0000 7efd0ca00640 1 -- 172.21.15.114:0/924104853 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd0813cdf0 con 0x7efd0806da90 2024-09-13T17:52:52.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.439+0000 7efcfea00640 1 -- 172.21.15.114:0/924104853 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efcf8013470 con 0x7efd0806da90 2024-09-13T17:52:52.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.439+0000 7efcfea00640 1 --2- 172.21.15.114:0/924104853 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7efce4066690 0x7efce4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:52.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.439+0000 7efcfea00640 1 -- 172.21.15.114:0/924104853 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efcf80845c0 con 0x7efd0806da90 2024-09-13T17:52:52.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.443+0000 7efcfd400640 1 --2- 172.21.15.114:0/924104853 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7efce4066690 0x7efce4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:52.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.443+0000 7efcfd400640 1 --2- 172.21.15.114:0/924104853 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7efce4066690 0x7efce4068b50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efd081f6030 tx=0x7efcf0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:52.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.447+0000 7efcfea00640 1 -- 172.21.15.114:0/924104853 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efcf8051610 con 0x7efd0806da90 2024-09-13T17:52:52.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.611+0000 7efd0ca00640 1 -- 172.21.15.114:0/924104853 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7efd0815a210 con 0x7efd0806da90 2024-09-13T17:52:52.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.611+0000 7efcfea00640 1 -- 172.21.15.114:0/924104853 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7efcf8054c30 con 0x7efd0806da90 2024-09-13T17:52:52.616 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-13T17:52:52.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.615+0000 7efd0ca00640 1 -- 172.21.15.114:0/924104853 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7efce4066690 msgr2=0x7efce4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:52.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.615+0000 7efd0ca00640 1 --2- 172.21.15.114:0/924104853 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7efce4066690 0x7efce4068b50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efd081f6030 tx=0x7efcf0008040 comp rx=0 tx=0).stop 2024-09-13T17:52:52.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.615+0000 7efd0ca00640 1 -- 172.21.15.114:0/924104853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd0806da90 msgr2=0x7efd081f7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:52.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.615+0000 7efd0ca00640 1 --2- 172.21.15.114:0/924104853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd0806da90 0x7efd081f7ae0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efcf800e820 tx=0x7efcf800ece0 comp rx=0 tx=0).stop 2024-09-13T17:52:52.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.615+0000 7efd0ca00640 1 -- 172.21.15.114:0/924104853 shutdown_connections 2024-09-13T17:52:52.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.615+0000 7efd0ca00640 1 --2- 172.21.15.114:0/924104853 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7efce4066690 0x7efce4068b50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:52.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.615+0000 7efd0ca00640 1 --2- 172.21.15.114:0/924104853 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7efd0813c980 0x7efd0813e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:52.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.615+0000 7efd0ca00640 1 --2- 172.21.15.114:0/924104853 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd0813c240 0x7efd081f6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:52.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.615+0000 7efd0ca00640 1 --2- 172.21.15.114:0/924104853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd0806da90 0x7efd081f7ae0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:52.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.615+0000 7efd0ca00640 1 -- 172.21.15.114:0/924104853 >> 172.21.15.114:0/924104853 conn(0x7efd080660b0 msgr2=0x7efd080cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:52.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.615+0000 7efd0ca00640 1 -- 172.21.15.114:0/924104853 shutdown_connections 2024-09-13T17:52:52.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.615+0000 7efd0ca00640 1 -- 172.21.15.114:0/924104853 wait complete. 2024-09-13T17:52:52.636 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-13T17:52:52.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:52.636 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-13T17:52:52.660 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2024-09-13T17:52:52.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:52:52.660 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T17:52:52.710 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T17:52:52.711 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:52:52.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.839+0000 7f4927400640 1 Processor -- start 2024-09-13T17:52:52.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.839+0000 7f4927400640 1 -- start start 2024-09-13T17:52:52.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.843+0000 7f4927400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f492013f420 0x7f492006d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:52.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.843+0000 7f4927400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49200cd220 con 0x7f492013c240 2024-09-13T17:52:52.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.843+0000 7f4927400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f492015a740 con 0x7f492006da90 2024-09-13T17:52:52.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.843+0000 7f4927400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f492006df40 con 0x7f492013f420 2024-09-13T17:52:52.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.843+0000 7f4924a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f492013c240 0x7f492013c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50088/0 (socket says 172.21.15.114:50088) 2024-09-13T17:52:52.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.843+0000 7f4924a00640 1 -- 172.21.15.114:0/2849144656 learned_addr learned my addr 172.21.15.114:0/2849144656 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:52.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.843+0000 7f491fe00640 1 --2- 172.21.15.114:0/2849144656 >> v2:172.21.15.134:3300/0 conn(0x7f492013f420 0x7f492006d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:52.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.843+0000 7f491f400640 1 -- 172.21.15.114:0/2849144656 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3434722280 0 0) 0x7f49200cd220 con 0x7f492013c240 2024-09-13T17:52:52.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.843+0000 7f491f400640 1 -- 172.21.15.114:0/2849144656 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4904003530 con 0x7f492013c240 2024-09-13T17:52:52.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.843+0000 7f491f400640 1 -- 172.21.15.114:0/2849144656 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3411188839 0 0) 0x7f492015a740 con 0x7f492006da90 2024-09-13T17:52:52.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.843+0000 7f491f400640 1 -- 172.21.15.114:0/2849144656 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49200cd220 con 0x7f492006da90 2024-09-13T17:52:52.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.843+0000 7f491fe00640 1 -- 172.21.15.114:0/2849144656 >> v1:172.21.15.134:6789/0 conn(0x7f492006da90 legacy=0x7f49200cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:52.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.843+0000 7f491fe00640 1 -- 172.21.15.114:0/2849144656 >> v1:172.21.15.114:6789/0 conn(0x7f492013c240 legacy=0x7f492013c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:52.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.843+0000 7f491fe00640 1 -- 172.21.15.114:0/2849144656 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4920159bc0 con 0x7f492013f420 2024-09-13T17:52:52.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.847+0000 7f491fe00640 1 --2- 172.21.15.114:0/2849144656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f492013f420 0x7f492006d550 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f490c0097c0 tx=0x7f490c01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2ad209dfdbfb043 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:52.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.847+0000 7f491f400640 1 -- 172.21.15.114:0/2849144656 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c0ab600 con 0x7f492013f420 2024-09-13T17:52:52.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.847+0000 7f491f400640 1 -- 172.21.15.114:0/2849144656 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490c0a7050 con 0x7f492013f420 2024-09-13T17:52:52.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.847+0000 7f491f400640 1 -- 172.21.15.114:0/2849144656 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c0ab980 con 0x7f492013f420 2024-09-13T17:52:52.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.847+0000 7f4927400640 1 -- 172.21.15.114:0/2849144656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f492013f420 msgr2=0x7f492006d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:52.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.847+0000 7f4927400640 1 --2- 172.21.15.114:0/2849144656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f492013f420 0x7f492006d550 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f490c0097c0 tx=0x7f490c01c470 comp rx=0 tx=0).stop 2024-09-13T17:52:52.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.847+0000 7f4927400640 1 -- 172.21.15.114:0/2849144656 shutdown_connections 2024-09-13T17:52:52.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.847+0000 7f4927400640 1 --2- 172.21.15.114:0/2849144656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f492013f420 0x7f492006d550 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:52.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.847+0000 7f4927400640 1 -- 172.21.15.114:0/2849144656 >> 172.21.15.114:0/2849144656 conn(0x7f49200660b0 msgr2=0x7f4920069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:52.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.847+0000 7f4927400640 1 -- 172.21.15.114:0/2849144656 shutdown_connections 2024-09-13T17:52:52.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.847+0000 7f4927400640 1 -- 172.21.15.114:0/2849144656 wait complete. 2024-09-13T17:52:52.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.847+0000 7f4927400640 1 Processor -- start 2024-09-13T17:52:52.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.847+0000 7f4927400640 1 -- start start 2024-09-13T17:52:52.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.847+0000 7f4927400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f492006da90 0x7f4920138fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:52.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.847+0000 7f4927400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f492013c240 0x7f492013a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:52.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.847+0000 7f4927400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f492013f420 0x7f492013ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:52.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.847+0000 7f4927400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4920153240 con 0x7f492013f420 2024-09-13T17:52:52.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.847+0000 7f4927400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49200b00b0 con 0x7f492006da90 2024-09-13T17:52:52.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.847+0000 7f4927400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4920152f60 con 0x7f492013c240 2024-09-13T17:52:52.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.851+0000 7f4925400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f492013f420 0x7f492013ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:52.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.851+0000 7f4924a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f492006da90 0x7f4920138fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:52.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.851+0000 7f4925400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f492013f420 0x7f492013ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42530/0 (socket says 172.21.15.114:42530) 2024-09-13T17:52:52.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.851+0000 7f4925400640 1 -- 172.21.15.114:0/3243389959 learned_addr learned my addr 172.21.15.114:0/3243389959 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:52.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.851+0000 7f491fe00640 1 --2- 172.21.15.114:0/3243389959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f492013c240 0x7f492013a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:52.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.851+0000 7f4924a00640 1 -- 172.21.15.114:0/3243389959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f492013c240 msgr2=0x7f492013a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:52.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.851+0000 7f4924a00640 1 --2- 172.21.15.114:0/3243389959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f492013c240 0x7f492013a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:52.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.851+0000 7f4924a00640 1 -- 172.21.15.114:0/3243389959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f492013f420 msgr2=0x7f492013ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:52.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.851+0000 7f4924a00640 1 --2- 172.21.15.114:0/3243389959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f492013f420 0x7f492013ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:52.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.851+0000 7f4924a00640 1 -- 172.21.15.114:0/3243389959 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f490c009420 con 0x7f492006da90 2024-09-13T17:52:52.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.851+0000 7f491fe00640 1 --2- 172.21.15.114:0/3243389959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f492013c240 0x7f492013a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:52.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.851+0000 7f4924a00640 1 --2- 172.21.15.114:0/3243389959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f492006da90 0x7f4920138fc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f491000cbc0 tx=0x7f491000a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:52.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.851+0000 7f491cc00640 1 -- 172.21.15.114:0/3243389959 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491000ad40 con 0x7f492006da90 2024-09-13T17:52:52.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.851+0000 7f491cc00640 1 -- 172.21.15.114:0/3243389959 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4910012400 con 0x7f492006da90 2024-09-13T17:52:52.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.851+0000 7f4927400640 1 -- 172.21.15.114:0/3243389959 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49200b0350 con 0x7f492006da90 2024-09-13T17:52:52.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.851+0000 7f491cc00640 1 -- 172.21.15.114:0/3243389959 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491000aea0 con 0x7f492006da90 2024-09-13T17:52:52.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.851+0000 7f4927400640 1 -- 172.21.15.114:0/3243389959 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49200caa70 con 0x7f492006da90 2024-09-13T17:52:52.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.851+0000 7f4927400640 1 -- 172.21.15.114:0/3243389959 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f492013ebf0 con 0x7f492006da90 2024-09-13T17:52:52.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.851+0000 7f491cc00640 1 -- 172.21.15.114:0/3243389959 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4910007070 con 0x7f492006da90 2024-09-13T17:52:52.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.851+0000 7f491cc00640 1 --2- 172.21.15.114:0/3243389959 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4900066690 0x7f4900068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:52.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.851+0000 7f491cc00640 1 -- 172.21.15.114:0/3243389959 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4910084430 con 0x7f492006da90 2024-09-13T17:52:52.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.855+0000 7f491fe00640 1 --2- 172.21.15.114:0/3243389959 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4900066690 0x7f4900068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:52.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.855+0000 7f491fe00640 1 --2- 172.21.15.114:0/3243389959 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4900066690 0x7f4900068b50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f490c0ad000 tx=0x7f490c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:52.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:52.855+0000 7f491cc00640 1 -- 172.21.15.114:0/3243389959 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f49100513f0 con 0x7f492006da90 2024-09-13T17:52:53.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.043+0000 7f4927400640 1 -- 172.21.15.114:0/3243389959 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49200667b0 con 0x7f492006da90 2024-09-13T17:52:53.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.043+0000 7f491cc00640 1 -- 172.21.15.114:0/3243389959 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4739 (secure 0 0 0) 0x7f4910054a10 con 0x7f492006da90 2024-09-13T17:52:53.050 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:53.050 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/534634081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":534634081},{"type":"v1","addr":"172.21.15.134:6835","nonce":534634081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1773366615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1773366615},{"type":"v1","addr":"172.21.15.114:6836","nonce":1773366615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4122490085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":4122490085},{"type":"v1","addr":"172.21.15.114:6837","nonce":4122490085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:51:49.789079+0000","modified":"2024-09-13T17:52:13.041461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/1863104078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1863104078},{"type":"v1","addr":"172.21.15.134:6834","nonce":1863104078}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:52:53.050 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 9 2024-09-13T17:52:53.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.047+0000 7f4927400640 1 -- 172.21.15.114:0/3243389959 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4900066690 msgr2=0x7f4900068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:53.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.047+0000 7f4927400640 1 --2- 172.21.15.114:0/3243389959 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4900066690 0x7f4900068b50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f490c0ad000 tx=0x7f490c008040 comp rx=0 tx=0).stop 2024-09-13T17:52:53.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.047+0000 7f4927400640 1 -- 172.21.15.114:0/3243389959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f492006da90 msgr2=0x7f4920138fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:53.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.047+0000 7f4927400640 1 --2- 172.21.15.114:0/3243389959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f492006da90 0x7f4920138fc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f491000cbc0 tx=0x7f491000a430 comp rx=0 tx=0).stop 2024-09-13T17:52:53.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.047+0000 7f4927400640 1 -- 172.21.15.114:0/3243389959 shutdown_connections 2024-09-13T17:52:53.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.047+0000 7f4927400640 1 --2- 172.21.15.114:0/3243389959 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4900066690 0x7f4900068b50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.047+0000 7f4927400640 1 --2- 172.21.15.114:0/3243389959 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f492013f420 0x7f492013ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.047+0000 7f4927400640 1 --2- 172.21.15.114:0/3243389959 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f492013c240 0x7f492013a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.047+0000 7f4927400640 1 --2- 172.21.15.114:0/3243389959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f492006da90 0x7f4920138fc0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.047+0000 7f4927400640 1 -- 172.21.15.114:0/3243389959 >> 172.21.15.114:0/3243389959 conn(0x7f49200660b0 msgr2=0x7f49200b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:53.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.047+0000 7f4927400640 1 -- 172.21.15.114:0/3243389959 shutdown_connections 2024-09-13T17:52:53.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.047+0000 7f4927400640 1 -- 172.21.15.114:0/3243389959 wait complete. 2024-09-13T17:52:53.071 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:52:53.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.203+0000 7f12e7200640 1 Processor -- start 2024-09-13T17:52:53.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.203+0000 7f12e7200640 1 -- start start 2024-09-13T17:52:53.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.203+0000 7f12e7200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f12e815a390 0x7f12e8070600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:53.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.203+0000 7f12e7200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12e8070b40 0x7f12e80cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:53.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.203+0000 7f12e7200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e8070f80 con 0x7f12e80cc0c0 2024-09-13T17:52:53.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.203+0000 7f12e7200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e80cd0a0 con 0x7f12e815a390 2024-09-13T17:52:53.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.203+0000 7f12e7200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e80cc550 con 0x7f12e8070b40 2024-09-13T17:52:53.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.203+0000 7f12e5e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f12e815a390 0x7f12e8070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:53.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.203+0000 7f12e5e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f12e815a390 0x7f12e8070600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42540/0 (socket says 172.21.15.114:42540) 2024-09-13T17:52:53.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.203+0000 7f12e5e00640 1 -- 172.21.15.114:0/287957060 learned_addr learned my addr 172.21.15.114:0/287957060 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:53.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.203+0000 7f12dd400640 1 --2- 172.21.15.114:0/287957060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12e8070b40 0x7f12e80cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:53.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.203+0000 7f12e5e00640 1 -- 172.21.15.114:0/287957060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12e8070b40 msgr2=0x7f12e80cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:53.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.203+0000 7f12e5e00640 1 --2- 172.21.15.114:0/287957060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12e8070b40 0x7f12e80cbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.203+0000 7f12e5e00640 1 -- 172.21.15.114:0/287957060 >> v1:172.21.15.134:6789/0 conn(0x7f12e80cc0c0 legacy=0x7f12e806c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:53.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.203+0000 7f12e5e00640 1 -- 172.21.15.114:0/287957060 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e80cc800 con 0x7f12e815a390 2024-09-13T17:52:53.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.207+0000 7f12e5e00640 1 --2- 172.21.15.114:0/287957060 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12e815a390 0x7f12e8070600 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f12d8009870 tx=0x7f12d801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6b0b3e3db50a07 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:53.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.207+0000 7f12e5400640 1 -- 172.21.15.114:0/287957060 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d80a95f0 con 0x7f12e815a390 2024-09-13T17:52:53.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.207+0000 7f12e5400640 1 -- 172.21.15.114:0/287957060 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d80a9750 con 0x7f12e815a390 2024-09-13T17:52:53.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.207+0000 7f12e5400640 1 -- 172.21.15.114:0/287957060 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d80a9ae0 con 0x7f12e815a390 2024-09-13T17:52:53.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.207+0000 7f12e7200640 1 -- 172.21.15.114:0/287957060 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12e815a390 msgr2=0x7f12e8070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:53.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.207+0000 7f12e7200640 1 --2- 172.21.15.114:0/287957060 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12e815a390 0x7f12e8070600 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f12d8009870 tx=0x7f12d801c530 comp rx=0 tx=0).stop 2024-09-13T17:52:53.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.207+0000 7f12e7200640 1 -- 172.21.15.114:0/287957060 shutdown_connections 2024-09-13T17:52:53.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.207+0000 7f12e7200640 1 --2- 172.21.15.114:0/287957060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12e8070b40 0x7f12e80cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.207+0000 7f12e7200640 1 --2- 172.21.15.114:0/287957060 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12e815a390 0x7f12e8070600 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.207+0000 7f12e7200640 1 -- 172.21.15.114:0/287957060 >> 172.21.15.114:0/287957060 conn(0x7f12e8069f80 msgr2=0x7f12e806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:53.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.207+0000 7f12e7200640 1 -- 172.21.15.114:0/287957060 shutdown_connections 2024-09-13T17:52:53.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.207+0000 7f12e7200640 1 -- 172.21.15.114:0/287957060 wait complete. 2024-09-13T17:52:53.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.207+0000 7f12e7200640 1 Processor -- start 2024-09-13T17:52:53.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.211+0000 7f12e7200640 1 -- start start 2024-09-13T17:52:53.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.211+0000 7f12e7200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e8070b40 0x7f12e814b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:53.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.211+0000 7f12e7200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12e80cc0c0 0x7f12e80b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:53.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.211+0000 7f12e7200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12e815a390 0x7f12e815c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:53.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.211+0000 7f12e7200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e81554c0 con 0x7f12e815a390 2024-09-13T17:52:53.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.211+0000 7f12e7200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e8154b90 con 0x7f12e8070b40 2024-09-13T17:52:53.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.211+0000 7f12e7200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e8154e70 con 0x7f12e80cc0c0 2024-09-13T17:52:53.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.211+0000 7f12e6800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12e815a390 0x7f12e815c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:53.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.211+0000 7f12e5e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e8070b40 0x7f12e814b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:53.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.211+0000 7f12dd400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12e80cc0c0 0x7f12e80b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:53.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.211+0000 7f12e5e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e8070b40 0x7f12e814b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:54904/0 (socket says 172.21.15.114:54904) 2024-09-13T17:52:53.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.211+0000 7f12e5e00640 1 -- 172.21.15.114:0/2757359949 learned_addr learned my addr 172.21.15.114:0/2757359949 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:53.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.211+0000 7f12dd400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12e80cc0c0 0x7f12e80b1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:49618/0 (socket says 172.21.15.114:49618) 2024-09-13T17:52:53.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.211+0000 7f12e6800640 1 -- 172.21.15.114:0/2757359949 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12e80cc0c0 msgr2=0x7f12e80b1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:53.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.211+0000 7f12e6800640 1 --2- 172.21.15.114:0/2757359949 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12e80cc0c0 0x7f12e80b1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.211+0000 7f12e6800640 1 -- 172.21.15.114:0/2757359949 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e8070b40 msgr2=0x7f12e814b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:53.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.211+0000 7f12e6800640 1 --2- 172.21.15.114:0/2757359949 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e8070b40 0x7f12e814b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.211+0000 7f12e6800640 1 -- 172.21.15.114:0/2757359949 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d80094d0 con 0x7f12e815a390 2024-09-13T17:52:53.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.211+0000 7f12e6800640 1 --2- 172.21.15.114:0/2757359949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12e815a390 0x7f12e815c420 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f12e000c700 tx=0x7f12e000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:53.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.211+0000 7f12dea00640 1 -- 172.21.15.114:0/2757359949 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e0003b80 con 0x7f12e815a390 2024-09-13T17:52:53.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.211+0000 7f12dea00640 1 -- 172.21.15.114:0/2757359949 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e0003ce0 con 0x7f12e815a390 2024-09-13T17:52:53.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.211+0000 7f12e7200640 1 -- 172.21.15.114:0/2757359949 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e8155150 con 0x7f12e815a390 2024-09-13T17:52:53.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.211+0000 7f12dea00640 1 -- 172.21.15.114:0/2757359949 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e000aa30 con 0x7f12e815a390 2024-09-13T17:52:53.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.211+0000 7f12e7200640 1 -- 172.21.15.114:0/2757359949 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e80b24e0 con 0x7f12e815a390 2024-09-13T17:52:53.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.211+0000 7f12e7200640 1 -- 172.21.15.114:0/2757359949 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e8155670 con 0x7f12e815a390 2024-09-13T17:52:53.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.215+0000 7f12dea00640 1 -- 172.21.15.114:0/2757359949 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f12e000ab90 con 0x7f12e815a390 2024-09-13T17:52:53.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.215+0000 7f12dea00640 1 --2- 172.21.15.114:0/2757359949 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f12c4066690 0x7f12c4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:53.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.215+0000 7f12dea00640 1 -- 172.21.15.114:0/2757359949 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f12e00842b0 con 0x7f12e815a390 2024-09-13T17:52:53.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.215+0000 7f12e5e00640 1 --2- 172.21.15.114:0/2757359949 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f12c4066690 0x7f12c4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:53.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.215+0000 7f12e5e00640 1 --2- 172.21.15.114:0/2757359949 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f12c4066690 0x7f12c4068b50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f12d8009870 tx=0x7f12d80b3040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:53.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.219+0000 7f12dea00640 1 -- 172.21.15.114:0/2757359949 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f12e8155670 con 0x7f12e815a390 2024-09-13T17:52:53.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.375+0000 7f12e7200640 1 -- 172.21.15.114:0/2757359949 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12e806af10 con 0x7f12e815a390 2024-09-13T17:52:53.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.375+0000 7f12dea00640 1 -- 172.21.15.114:0/2757359949 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18784 (secure 0 0 0) 0x7f12e0051270 con 0x7f12e815a390 2024-09-13T17:52:53.381 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:53.381 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:52:31.139000+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:51:48.278220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:51:48.773888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:51:51.856300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:52:53.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.379+0000 7f12e7200640 1 -- 172.21.15.114:0/2757359949 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f12c4066690 msgr2=0x7f12c4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:53.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.379+0000 7f12e7200640 1 --2- 172.21.15.114:0/2757359949 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f12c4066690 0x7f12c4068b50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f12d8009870 tx=0x7f12d80b3040 comp rx=0 tx=0).stop 2024-09-13T17:52:53.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.379+0000 7f12e7200640 1 -- 172.21.15.114:0/2757359949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12e815a390 msgr2=0x7f12e815c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:53.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.379+0000 7f12e7200640 1 --2- 172.21.15.114:0/2757359949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12e815a390 0x7f12e815c420 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f12e000c700 tx=0x7f12e000cbc0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.379+0000 7f12e7200640 1 -- 172.21.15.114:0/2757359949 shutdown_connections 2024-09-13T17:52:53.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.379+0000 7f12e7200640 1 --2- 172.21.15.114:0/2757359949 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f12c4066690 0x7f12c4068b50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.379+0000 7f12e7200640 1 --2- 172.21.15.114:0/2757359949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12e815a390 0x7f12e815c420 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.379+0000 7f12e7200640 1 --2- 172.21.15.114:0/2757359949 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12e80cc0c0 0x7f12e80b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.379+0000 7f12e7200640 1 --2- 172.21.15.114:0/2757359949 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e8070b40 0x7f12e814b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.379+0000 7f12e7200640 1 -- 172.21.15.114:0/2757359949 >> 172.21.15.114:0/2757359949 conn(0x7f12e8069f80 msgr2=0x7f12e80ae390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:53.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.379+0000 7f12e7200640 1 -- 172.21.15.114:0/2757359949 shutdown_connections 2024-09-13T17:52:53.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.379+0000 7f12e7200640 1 -- 172.21.15.114:0/2757359949 wait complete. 2024-09-13T17:52:53.402 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:51:37.996254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:51:48.278220+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:51:48.773888+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T17:51:51.856300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T17:52:53.403 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:52:53.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.535+0000 7f1f63600640 1 Processor -- start 2024-09-13T17:52:53.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.535+0000 7f1f63600640 1 -- start start 2024-09-13T17:52:53.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.539+0000 7f1f63600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1f5c06dc60 0x7f1f5c0cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:53.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.539+0000 7f1f63600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5c0cd220 con 0x7f1f5c13c240 2024-09-13T17:52:53.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.539+0000 7f1f63600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5c15a740 con 0x7f1f5c13f420 2024-09-13T17:52:53.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.539+0000 7f1f63600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f5c159bc0 con 0x7f1f5c06dc60 2024-09-13T17:52:53.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.539+0000 7f1f60c00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1f5c13c240 0x7f1f5c13c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50092/0 (socket says 172.21.15.114:50092) 2024-09-13T17:52:53.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.539+0000 7f1f60c00640 1 -- 172.21.15.114:0/3115324052 learned_addr learned my addr 172.21.15.114:0/3115324052 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:53.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.539+0000 7f1f61600640 1 --2- 172.21.15.114:0/3115324052 >> v2:172.21.15.134:3300/0 conn(0x7f1f5c06dc60 0x7f1f5c0cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:53.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.539+0000 7f1f5be00640 1 -- 172.21.15.114:0/3115324052 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3137465774 0 0) 0x7f1f5c15a740 con 0x7f1f5c13f420 2024-09-13T17:52:53.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.539+0000 7f1f5be00640 1 -- 172.21.15.114:0/3115324052 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f40005740 con 0x7f1f5c13f420 2024-09-13T17:52:53.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.539+0000 7f1f5be00640 1 -- 172.21.15.114:0/3115324052 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2023501321 0 0) 0x7f1f5c0cd220 con 0x7f1f5c13c240 2024-09-13T17:52:53.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.539+0000 7f1f61600640 1 -- 172.21.15.114:0/3115324052 >> v1:172.21.15.134:6789/0 conn(0x7f1f5c13f420 legacy=0x7f1f5c06d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:53.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.539+0000 7f1f61600640 1 -- 172.21.15.114:0/3115324052 >> v1:172.21.15.114:6789/0 conn(0x7f1f5c13c240 legacy=0x7f1f5c13c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:53.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.539+0000 7f1f61600640 1 -- 172.21.15.114:0/3115324052 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5c159ea0 con 0x7f1f5c06dc60 2024-09-13T17:52:53.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.543+0000 7f1f61600640 1 --2- 172.21.15.114:0/3115324052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f5c06dc60 0x7f1f5c0cd650 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009d90 tx=0x7f1f5401c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e00807e05e5d9eaf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:53.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.543+0000 7f1f5be00640 1 -- 172.21.15.114:0/3115324052 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f540a5970 con 0x7f1f5c06dc60 2024-09-13T17:52:53.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.543+0000 7f1f5be00640 1 -- 172.21.15.114:0/3115324052 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f540a5ad0 con 0x7f1f5c06dc60 2024-09-13T17:52:53.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.543+0000 7f1f5be00640 1 -- 172.21.15.114:0/3115324052 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f540a5e60 con 0x7f1f5c06dc60 2024-09-13T17:52:53.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.543+0000 7f1f63600640 1 -- 172.21.15.114:0/3115324052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f5c06dc60 msgr2=0x7f1f5c0cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:53.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.543+0000 7f1f63600640 1 --2- 172.21.15.114:0/3115324052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f5c06dc60 0x7f1f5c0cd650 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009d90 tx=0x7f1f5401c8b0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.543+0000 7f1f63600640 1 -- 172.21.15.114:0/3115324052 shutdown_connections 2024-09-13T17:52:53.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.543+0000 7f1f63600640 1 --2- 172.21.15.114:0/3115324052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f5c06dc60 0x7f1f5c0cd650 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.543+0000 7f1f63600640 1 -- 172.21.15.114:0/3115324052 >> 172.21.15.114:0/3115324052 conn(0x7f1f5c0660b0 msgr2=0x7f1f5c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:53.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.543+0000 7f1f63600640 1 -- 172.21.15.114:0/3115324052 shutdown_connections 2024-09-13T17:52:53.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.543+0000 7f1f63600640 1 -- 172.21.15.114:0/3115324052 wait complete. 2024-09-13T17:52:53.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.543+0000 7f1f63600640 1 Processor -- start 2024-09-13T17:52:53.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.543+0000 7f1f63600640 1 -- start start 2024-09-13T17:52:53.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.547+0000 7f1f63600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f5c06dc60 0x7f1f5c0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:53.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.547+0000 7f1f63600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f5c13c240 0x7f1f5c151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:53.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.547+0000 7f1f63600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f5c13f420 0x7f1f5c0b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:53.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.547+0000 7f1f63600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c0b1e90 con 0x7f1f5c13f420 2024-09-13T17:52:53.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.547+0000 7f1f63600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c14dc90 con 0x7f1f5c13c240 2024-09-13T17:52:53.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.547+0000 7f1f63600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c0adef0 con 0x7f1f5c06dc60 2024-09-13T17:52:53.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.547+0000 7f1f61600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f5c13f420 0x7f1f5c0b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:53.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.547+0000 7f1f61600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f5c13f420 0x7f1f5c0b2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42544/0 (socket says 172.21.15.114:42544) 2024-09-13T17:52:53.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.547+0000 7f1f61600640 1 -- 172.21.15.114:0/3740353669 learned_addr learned my addr 172.21.15.114:0/3740353669 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:53.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.547+0000 7f1f53e00640 1 --2- 172.21.15.114:0/3740353669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f5c13c240 0x7f1f5c151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:53.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.547+0000 7f1f60c00640 1 --2- 172.21.15.114:0/3740353669 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f5c06dc60 0x7f1f5c0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:53.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.547+0000 7f1f61600640 1 -- 172.21.15.114:0/3740353669 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f5c06dc60 msgr2=0x7f1f5c0ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:53.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.547+0000 7f1f61600640 1 --2- 172.21.15.114:0/3740353669 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f5c06dc60 0x7f1f5c0ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.547+0000 7f1f61600640 1 -- 172.21.15.114:0/3740353669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f5c13c240 msgr2=0x7f1f5c151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:53.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.547+0000 7f1f61600640 1 --2- 172.21.15.114:0/3740353669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f5c13c240 0x7f1f5c151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.547+0000 7f1f61600640 1 -- 172.21.15.114:0/3740353669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f54009a70 con 0x7f1f5c13f420 2024-09-13T17:52:53.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.547+0000 7f1f61600640 1 --2- 172.21.15.114:0/3740353669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f5c13f420 0x7f1f5c0b2290 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1f5401cd90 tx=0x7f1f5c0ce3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:53.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.547+0000 7f1f59600640 1 -- 172.21.15.114:0/3740353669 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f540add50 con 0x7f1f5c13f420 2024-09-13T17:52:53.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.547+0000 7f1f59600640 1 -- 172.21.15.114:0/3740353669 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f54009450 con 0x7f1f5c13f420 2024-09-13T17:52:53.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.547+0000 7f1f59600640 1 -- 172.21.15.114:0/3740353669 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f54003be0 con 0x7f1f5c13f420 2024-09-13T17:52:53.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.547+0000 7f1f63600640 1 -- 172.21.15.114:0/3740353669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f5c14dee0 con 0x7f1f5c13f420 2024-09-13T17:52:53.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.547+0000 7f1f63600640 1 -- 172.21.15.114:0/3740353669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f5c0b17d0 con 0x7f1f5c13f420 2024-09-13T17:52:53.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.547+0000 7f1f63600640 1 -- 172.21.15.114:0/3740353669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f5c0b2100 con 0x7f1f5c13f420 2024-09-13T17:52:53.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.547+0000 7f1f59600640 1 -- 172.21.15.114:0/3740353669 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1f540b4040 con 0x7f1f5c13f420 2024-09-13T17:52:53.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.551+0000 7f1f59600640 1 --2- 172.21.15.114:0/3740353669 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1f38066690 0x7f1f38068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:53.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.551+0000 7f1f59600640 1 -- 172.21.15.114:0/3740353669 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1f5411f470 con 0x7f1f5c13f420 2024-09-13T17:52:53.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.551+0000 7f1f60c00640 1 --2- 172.21.15.114:0/3740353669 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1f38066690 0x7f1f38068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:53.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.551+0000 7f1f60c00640 1 --2- 172.21.15.114:0/3740353669 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1f38066690 0x7f1f38068b50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c007a90 tx=0x7f1f4c0079e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:53.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.555+0000 7f1f59600640 1 -- 172.21.15.114:0/3740353669 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1f540ec4c0 con 0x7f1f5c13f420 2024-09-13T17:52:53.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.707+0000 7f1f63600640 1 -- 172.21.15.114:0/3740353669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1f5c0cd650 con 0x7f1f5c13f420 2024-09-13T17:52:53.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.707+0000 7f1f59600640 1 -- 172.21.15.114:0/3740353669 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1f540efae0 con 0x7f1f5c13f420 2024-09-13T17:52:53.713 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-13T17:52:53.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.711+0000 7f1f63600640 1 -- 172.21.15.114:0/3740353669 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1f38066690 msgr2=0x7f1f38068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:53.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.711+0000 7f1f63600640 1 --2- 172.21.15.114:0/3740353669 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1f38066690 0x7f1f38068b50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c007a90 tx=0x7f1f4c0079e0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.711+0000 7f1f63600640 1 -- 172.21.15.114:0/3740353669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f5c13f420 msgr2=0x7f1f5c0b2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:53.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.711+0000 7f1f63600640 1 --2- 172.21.15.114:0/3740353669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f5c13f420 0x7f1f5c0b2290 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1f5401cd90 tx=0x7f1f5c0ce3a0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.711+0000 7f1f63600640 1 -- 172.21.15.114:0/3740353669 shutdown_connections 2024-09-13T17:52:53.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.711+0000 7f1f63600640 1 --2- 172.21.15.114:0/3740353669 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1f38066690 0x7f1f38068b50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.711+0000 7f1f63600640 1 --2- 172.21.15.114:0/3740353669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f5c13f420 0x7f1f5c0b2290 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.711+0000 7f1f63600640 1 --2- 172.21.15.114:0/3740353669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f5c13c240 0x7f1f5c151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.711+0000 7f1f63600640 1 --2- 172.21.15.114:0/3740353669 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1f5c06dc60 0x7f1f5c0ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.711+0000 7f1f63600640 1 -- 172.21.15.114:0/3740353669 >> 172.21.15.114:0/3740353669 conn(0x7f1f5c0660b0 msgr2=0x7f1f5c13a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:53.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.711+0000 7f1f63600640 1 -- 172.21.15.114:0/3740353669 shutdown_connections 2024-09-13T17:52:53.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.711+0000 7f1f63600640 1 -- 172.21.15.114:0/3740353669 wait complete. 2024-09-13T17:52:53.734 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:52:53.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.871+0000 7fc1a2600640 1 Processor -- start 2024-09-13T17:52:53.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.871+0000 7fc1a2600640 1 -- start start 2024-09-13T17:52:53.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.871+0000 7fc1a2600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc19c13c240 0x7fc19c13f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:53.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.871+0000 7fc1a2600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc19c13c980 0x7fc19c06d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:53.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.871+0000 7fc1a2600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc19c0cd220 con 0x7fc19c06da90 2024-09-13T17:52:53.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.871+0000 7fc1a2600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc19c06df00 con 0x7fc19c13c980 2024-09-13T17:52:53.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.871+0000 7fc1a2600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19c13f960 con 0x7fc19c13c240 2024-09-13T17:52:53.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.871+0000 7fc19be00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc19c06da90 0x7fc19c0cd650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50096/0 (socket says 172.21.15.114:50096) 2024-09-13T17:52:53.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.871+0000 7fc19be00640 1 -- 172.21.15.114:0/4223248619 learned_addr learned my addr 172.21.15.114:0/4223248619 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:53.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.871+0000 7fc19b400640 1 --2- 172.21.15.114:0/4223248619 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc19c13c240 0x7fc19c13f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:53.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.871+0000 7fc19aa00640 1 --2- 172.21.15.114:0/4223248619 >> v2:172.21.15.134:3300/0 conn(0x7fc19c13c980 0x7fc19c06d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:53.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.871+0000 7fc19a000640 1 -- 172.21.15.114:0/4223248619 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886972892 0 0) 0x7fc19c0cd220 con 0x7fc19c06da90 2024-09-13T17:52:53.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.871+0000 7fc19a000640 1 -- 172.21.15.114:0/4223248619 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc180003530 con 0x7fc19c06da90 2024-09-13T17:52:53.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.871+0000 7fc19b400640 1 -- 172.21.15.114:0/4223248619 >> v2:172.21.15.134:3300/0 conn(0x7fc19c13c980 msgr2=0x7fc19c06d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:53.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.871+0000 7fc19b400640 1 --2- 172.21.15.114:0/4223248619 >> v2:172.21.15.134:3300/0 conn(0x7fc19c13c980 0x7fc19c06d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.871+0000 7fc19b400640 1 -- 172.21.15.114:0/4223248619 >> v1:172.21.15.114:6789/0 conn(0x7fc19c06da90 legacy=0x7fc19c0cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:53.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.871+0000 7fc19b400640 1 -- 172.21.15.114:0/4223248619 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19c15a740 con 0x7fc19c13c240 2024-09-13T17:52:53.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.871+0000 7fc19aa00640 1 --2- 172.21.15.114:0/4223248619 >> v2:172.21.15.134:3300/0 conn(0x7fc19c13c980 0x7fc19c06d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:52:53.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.875+0000 7fc19b400640 1 --2- 172.21.15.114:0/4223248619 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc19c13c240 0x7fc19c13f420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009d90 tx=0x7fc18c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba1c5bc24f29d9d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:53.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.875+0000 7fc19a000640 1 -- 172.21.15.114:0/4223248619 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c0a5a00 con 0x7fc19c13c240 2024-09-13T17:52:53.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.875+0000 7fc19a000640 1 -- 172.21.15.114:0/4223248619 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18c0a5b60 con 0x7fc19c13c240 2024-09-13T17:52:53.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.875+0000 7fc19a000640 1 -- 172.21.15.114:0/4223248619 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c0ad440 con 0x7fc19c13c240 2024-09-13T17:52:53.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.875+0000 7fc1a2600640 1 -- 172.21.15.114:0/4223248619 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc19c13c240 msgr2=0x7fc19c13f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:53.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.875+0000 7fc1a2600640 1 --2- 172.21.15.114:0/4223248619 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc19c13c240 0x7fc19c13f420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009d90 tx=0x7fc18c01c940 comp rx=0 tx=0).stop 2024-09-13T17:52:53.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.875+0000 7fc1a2600640 1 -- 172.21.15.114:0/4223248619 shutdown_connections 2024-09-13T17:52:53.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.875+0000 7fc1a2600640 1 --2- 172.21.15.114:0/4223248619 >> v2:172.21.15.134:3300/0 conn(0x7fc19c13c980 0x7fc19c06d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.875+0000 7fc1a2600640 1 --2- 172.21.15.114:0/4223248619 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc19c13c240 0x7fc19c13f420 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.875+0000 7fc1a2600640 1 -- 172.21.15.114:0/4223248619 >> 172.21.15.114:0/4223248619 conn(0x7fc19c0660b0 msgr2=0x7fc19c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:53.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.875+0000 7fc1a2600640 1 -- 172.21.15.114:0/4223248619 shutdown_connections 2024-09-13T17:52:53.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.875+0000 7fc1a2600640 1 -- 172.21.15.114:0/4223248619 wait complete. 2024-09-13T17:52:53.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.879+0000 7fc1a2600640 1 Processor -- start 2024-09-13T17:52:53.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.879+0000 7fc1a2600640 1 -- start start 2024-09-13T17:52:53.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.879+0000 7fc1a2600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc19c06da90 0x7fc19c0a74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:53.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.879+0000 7fc1a2600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc19c13c240 0x7fc19c0ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:53.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.879+0000 7fc1a2600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc19c13c980 0x7fc19c13af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:53.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.879+0000 7fc1a2600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19c0ab6d0 con 0x7fc19c13c980 2024-09-13T17:52:53.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.879+0000 7fc1a2600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19c0a7a10 con 0x7fc19c06da90 2024-09-13T17:52:53.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.879+0000 7fc1a2600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19c0b09e0 con 0x7fc19c13c240 2024-09-13T17:52:53.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.879+0000 7fc19be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc19c13c980 0x7fc19c13af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:53.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.879+0000 7fc19be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc19c13c980 0x7fc19c13af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42550/0 (socket says 172.21.15.114:42550) 2024-09-13T17:52:53.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.879+0000 7fc19be00640 1 -- 172.21.15.114:0/338369511 learned_addr learned my addr 172.21.15.114:0/338369511 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:53.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.879+0000 7fc19b400640 1 --2- 172.21.15.114:0/338369511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc19c06da90 0x7fc19c0a74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:53.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.879+0000 7fc19aa00640 1 --2- 172.21.15.114:0/338369511 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc19c13c240 0x7fc19c0ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:53.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.879+0000 7fc19be00640 1 -- 172.21.15.114:0/338369511 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc19c13c240 msgr2=0x7fc19c0ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:53.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.879+0000 7fc19be00640 1 --2- 172.21.15.114:0/338369511 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc19c13c240 0x7fc19c0ace30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.879+0000 7fc19be00640 1 -- 172.21.15.114:0/338369511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc19c06da90 msgr2=0x7fc19c0a74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:53.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.879+0000 7fc19be00640 1 --2- 172.21.15.114:0/338369511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc19c06da90 0x7fc19c0a74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:53.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.879+0000 7fc19be00640 1 -- 172.21.15.114:0/338369511 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc188009420 con 0x7fc19c13c980 2024-09-13T17:52:53.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.879+0000 7fc19be00640 1 --2- 172.21.15.114:0/338369511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc19c13c980 0x7fc19c13af90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc19400c450 tx=0x7fc19400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:53.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.879+0000 7fc193400640 1 -- 172.21.15.114:0/338369511 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc194005cf0 con 0x7fc19c13c980 2024-09-13T17:52:53.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.879+0000 7fc193400640 1 -- 172.21.15.114:0/338369511 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc194005e50 con 0x7fc19c13c980 2024-09-13T17:52:53.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.879+0000 7fc193400640 1 -- 172.21.15.114:0/338369511 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1940072b0 con 0x7fc19c13c980 2024-09-13T17:52:53.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.879+0000 7fc1a2600640 1 -- 172.21.15.114:0/338369511 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc18c009a70 con 0x7fc19c13c980 2024-09-13T17:52:53.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.879+0000 7fc1a2600640 1 -- 172.21.15.114:0/338369511 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc19c0ab970 con 0x7fc19c13c980 2024-09-13T17:52:53.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.883+0000 7fc1a2600640 1 -- 172.21.15.114:0/338369511 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc19c0ab530 con 0x7fc19c13c980 2024-09-13T17:52:53.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.883+0000 7fc193400640 1 -- 172.21.15.114:0/338369511 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc194007410 con 0x7fc19c13c980 2024-09-13T17:52:53.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.883+0000 7fc193400640 1 --2- 172.21.15.114:0/338369511 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc17c066690 0x7fc17c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:53.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.883+0000 7fc193400640 1 -- 172.21.15.114:0/338369511 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc1940836d0 con 0x7fc19c13c980 2024-09-13T17:52:53.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.883+0000 7fc19b400640 1 --2- 172.21.15.114:0/338369511 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc17c066690 0x7fc17c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:53.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.883+0000 7fc19b400640 1 --2- 172.21.15.114:0/338369511 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc17c066690 0x7fc17c068b50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc18c0af000 tx=0x7fc18c0a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:53.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:53.887+0000 7fc193400640 1 -- 172.21.15.114:0/338369511 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc19c0ab530 con 0x7fc19c13c980 2024-09-13T17:52:54.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.043+0000 7fc1a2600640 1 -- 172.21.15.114:0/338369511 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc19c0ab530 con 0x7fc19c13c980 2024-09-13T17:52:54.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.043+0000 7fc193400640 1 -- 172.21.15.114:0/338369511 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc19c0ab530 con 0x7fc19c13c980 2024-09-13T17:52:54.047 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:52:54.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.043+0000 7fc1a2600640 1 -- 172.21.15.114:0/338369511 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc17c066690 msgr2=0x7fc17c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:54.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.043+0000 7fc1a2600640 1 --2- 172.21.15.114:0/338369511 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc17c066690 0x7fc17c068b50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc18c0af000 tx=0x7fc18c0a7070 comp rx=0 tx=0).stop 2024-09-13T17:52:54.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.043+0000 7fc1a2600640 1 -- 172.21.15.114:0/338369511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc19c13c980 msgr2=0x7fc19c13af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:54.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.043+0000 7fc1a2600640 1 --2- 172.21.15.114:0/338369511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc19c13c980 0x7fc19c13af90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc19400c450 tx=0x7fc19400c910 comp rx=0 tx=0).stop 2024-09-13T17:52:54.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.043+0000 7fc1a2600640 1 -- 172.21.15.114:0/338369511 shutdown_connections 2024-09-13T17:52:54.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.043+0000 7fc1a2600640 1 --2- 172.21.15.114:0/338369511 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc17c066690 0x7fc17c068b50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:54.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.043+0000 7fc1a2600640 1 --2- 172.21.15.114:0/338369511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc19c13c980 0x7fc19c13af90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:54.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.043+0000 7fc1a2600640 1 --2- 172.21.15.114:0/338369511 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc19c13c240 0x7fc19c0ace30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:54.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.043+0000 7fc1a2600640 1 --2- 172.21.15.114:0/338369511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc19c06da90 0x7fc19c0a74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:54.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.043+0000 7fc1a2600640 1 -- 172.21.15.114:0/338369511 >> 172.21.15.114:0/338369511 conn(0x7fc19c0660b0 msgr2=0x7fc19c06c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:54.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.043+0000 7fc1a2600640 1 -- 172.21.15.114:0/338369511 shutdown_connections 2024-09-13T17:52:54.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.043+0000 7fc1a2600640 1 -- 172.21.15.114:0/338369511 wait complete. 2024-09-13T17:52:54.068 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:52:54.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.199+0000 7f89ece00640 1 Processor -- start 2024-09-13T17:52:54.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.199+0000 7f89ece00640 1 -- start start 2024-09-13T17:52:54.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.203+0000 7f89ece00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f89e8151420 0x7f89e80cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:54.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.203+0000 7f89ece00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89e80ccba0 0x7f89e8070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:54.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.203+0000 7f89ece00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e8151800 con 0x7f89e8070960 2024-09-13T17:52:54.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.203+0000 7f89ece00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e80cbc30 con 0x7f89e8151420 2024-09-13T17:52:54.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.203+0000 7f89ece00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e8070d90 con 0x7f89e80ccba0 2024-09-13T17:52:54.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.203+0000 7f89e6800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f89e8070960 0x7f89e815df20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50102/0 (socket says 172.21.15.114:50102) 2024-09-13T17:52:54.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.203+0000 7f89e6800640 1 -- 172.21.15.114:0/999476082 learned_addr learned my addr 172.21.15.114:0/999476082 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:54.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.203+0000 7f89e5e00640 1 --2- 172.21.15.114:0/999476082 >> v2:172.21.15.134:3300/0 conn(0x7f89e8151420 0x7f89e80cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:54.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.203+0000 7f89e5400640 1 --2- 172.21.15.114:0/999476082 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89e80ccba0 0x7f89e8070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:54.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.203+0000 7f89e4a00640 1 -- 172.21.15.114:0/999476082 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2238686365 0 0) 0x7f89e8151800 con 0x7f89e8070960 2024-09-13T17:52:54.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.203+0000 7f89e4a00640 1 -- 172.21.15.114:0/999476082 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89cc003530 con 0x7f89e8070960 2024-09-13T17:52:54.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.203+0000 7f89e5e00640 1 -- 172.21.15.114:0/999476082 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89e80ccba0 msgr2=0x7f89e8070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:54.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.203+0000 7f89e5e00640 1 --2- 172.21.15.114:0/999476082 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89e80ccba0 0x7f89e8070420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:54.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.203+0000 7f89e5e00640 1 -- 172.21.15.114:0/999476082 >> v1:172.21.15.114:6789/0 conn(0x7f89e8070960 legacy=0x7f89e815df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:54.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.203+0000 7f89e5e00640 1 -- 172.21.15.114:0/999476082 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e80cafb0 con 0x7f89e8151420 2024-09-13T17:52:54.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.207+0000 7f89e5e00640 1 --2- 172.21.15.114:0/999476082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e8151420 0x7f89e80cc660 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f89d80097c0 tx=0x7f89d801c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f7bc1f3ee085baa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:54.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.207+0000 7f89e4a00640 1 -- 172.21.15.114:0/999476082 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d8004230 con 0x7f89e8151420 2024-09-13T17:52:54.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.207+0000 7f89e4a00640 1 -- 172.21.15.114:0/999476082 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d80a7050 con 0x7f89e8151420 2024-09-13T17:52:54.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.207+0000 7f89e4a00640 1 -- 172.21.15.114:0/999476082 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d8003620 con 0x7f89e8151420 2024-09-13T17:52:54.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.207+0000 7f89ece00640 1 -- 172.21.15.114:0/999476082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e8151420 msgr2=0x7f89e80cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:54.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.207+0000 7f89ece00640 1 --2- 172.21.15.114:0/999476082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e8151420 0x7f89e80cc660 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f89d80097c0 tx=0x7f89d801c350 comp rx=0 tx=0).stop 2024-09-13T17:52:54.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.207+0000 7f89ece00640 1 -- 172.21.15.114:0/999476082 shutdown_connections 2024-09-13T17:52:54.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.207+0000 7f89ece00640 1 --2- 172.21.15.114:0/999476082 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89e80ccba0 0x7f89e8070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:54.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.207+0000 7f89ece00640 1 --2- 172.21.15.114:0/999476082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e8151420 0x7f89e80cc660 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:54.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.207+0000 7f89ece00640 1 -- 172.21.15.114:0/999476082 >> 172.21.15.114:0/999476082 conn(0x7f89e80660b0 msgr2=0x7f89e8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:54.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.207+0000 7f89ece00640 1 -- 172.21.15.114:0/999476082 shutdown_connections 2024-09-13T17:52:54.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.207+0000 7f89ece00640 1 -- 172.21.15.114:0/999476082 wait complete. 2024-09-13T17:52:54.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.207+0000 7f89ece00640 1 Processor -- start 2024-09-13T17:52:54.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.207+0000 7f89ece00640 1 -- start start 2024-09-13T17:52:54.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.211+0000 7f89ece00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89e8070960 0x7f89e81519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:54.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.211+0000 7f89ece00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89e80ccba0 0x7f89e80ac900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:54.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.211+0000 7f89ece00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e8151420 0x7f89e80aaee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:54.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.211+0000 7f89ece00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e80ac020 con 0x7f89e8070960 2024-09-13T17:52:54.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.211+0000 7f89ece00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e80ace40 con 0x7f89e8151420 2024-09-13T17:52:54.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.211+0000 7f89ece00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e80ab420 con 0x7f89e80ccba0 2024-09-13T17:52:54.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.211+0000 7f89e5e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89e8070960 0x7f89e81519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:54.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.211+0000 7f89e5e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89e8070960 0x7f89e81519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42558/0 (socket says 172.21.15.114:42558) 2024-09-13T17:52:54.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.211+0000 7f89e5e00640 1 -- 172.21.15.114:0/3123791583 learned_addr learned my addr 172.21.15.114:0/3123791583 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:54.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.211+0000 7f89e6800640 1 --2- 172.21.15.114:0/3123791583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e8151420 0x7f89e80aaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:54.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.211+0000 7f89e5400640 1 --2- 172.21.15.114:0/3123791583 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89e80ccba0 0x7f89e80ac900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:54.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.211+0000 7f89e5e00640 1 -- 172.21.15.114:0/3123791583 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89e80ccba0 msgr2=0x7f89e80ac900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:54.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.211+0000 7f89e5e00640 1 --2- 172.21.15.114:0/3123791583 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89e80ccba0 0x7f89e80ac900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:54.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.211+0000 7f89e5e00640 1 -- 172.21.15.114:0/3123791583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e8151420 msgr2=0x7f89e80aaee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:54.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.211+0000 7f89e5e00640 1 --2- 172.21.15.114:0/3123791583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e8151420 0x7f89e80aaee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:54.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.211+0000 7f89e5e00640 1 -- 172.21.15.114:0/3123791583 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d8009420 con 0x7f89e8070960 2024-09-13T17:52:54.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.211+0000 7f89e6800640 1 --2- 172.21.15.114:0/3123791583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e8151420 0x7f89e80aaee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:54.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.211+0000 7f89e5e00640 1 --2- 172.21.15.114:0/3123791583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89e8070960 0x7f89e81519c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f89d8019f80 tx=0x7f89d80190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:54.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.211+0000 7f89de000640 1 -- 172.21.15.114:0/3123791583 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d8003af0 con 0x7f89e8070960 2024-09-13T17:52:54.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.211+0000 7f89de000640 1 -- 172.21.15.114:0/3123791583 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d8003c50 con 0x7f89e8070960 2024-09-13T17:52:54.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.211+0000 7f89de000640 1 -- 172.21.15.114:0/3123791583 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d80ab440 con 0x7f89e8070960 2024-09-13T17:52:54.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.211+0000 7f89ece00640 1 -- 172.21.15.114:0/3123791583 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e80ad050 con 0x7f89e8070960 2024-09-13T17:52:54.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.211+0000 7f89ece00640 1 -- 172.21.15.114:0/3123791583 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e80ad610 con 0x7f89e8070960 2024-09-13T17:52:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.211+0000 7f89ece00640 1 -- 172.21.15.114:0/3123791583 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e815da80 con 0x7f89e8070960 2024-09-13T17:52:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.211+0000 7f89de000640 1 -- 172.21.15.114:0/3123791583 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f89d80b2040 con 0x7f89e8070960 2024-09-13T17:52:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.215+0000 7f89de000640 1 --2- 172.21.15.114:0/3123791583 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f89c8066690 0x7f89c8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.215+0000 7f89de000640 1 -- 172.21.15.114:0/3123791583 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f89d811e330 con 0x7f89e8070960 2024-09-13T17:52:54.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.215+0000 7f89e5400640 1 --2- 172.21.15.114:0/3123791583 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f89c8066690 0x7f89c8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:54.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.215+0000 7f89e5400640 1 --2- 172.21.15.114:0/3123791583 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f89c8066690 0x7f89c8068b50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f89e80cc230 tx=0x7f89d4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:54.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.219+0000 7f89de000640 1 -- 172.21.15.114:0/3123791583 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f89d80eb2d0 con 0x7f89e8070960 2024-09-13T17:52:54.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.371+0000 7f89ece00640 1 -- 172.21.15.114:0/3123791583 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f89e80ad7a0 con 0x7f89e8070960 2024-09-13T17:52:54.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.371+0000 7f89de000640 1 -- 172.21.15.114:0/3123791583 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f89d80ee8f0 con 0x7f89e8070960 2024-09-13T17:52:54.376 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-09-13T17:52:54.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.375+0000 7f89ece00640 1 -- 172.21.15.114:0/3123791583 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f89c8066690 msgr2=0x7f89c8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:54.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.375+0000 7f89ece00640 1 --2- 172.21.15.114:0/3123791583 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f89c8066690 0x7f89c8068b50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f89e80cc230 tx=0x7f89d4008040 comp rx=0 tx=0).stop 2024-09-13T17:52:54.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.375+0000 7f89ece00640 1 -- 172.21.15.114:0/3123791583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89e8070960 msgr2=0x7f89e81519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:54.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.375+0000 7f89ece00640 1 --2- 172.21.15.114:0/3123791583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89e8070960 0x7f89e81519c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f89d8019f80 tx=0x7f89d80190f0 comp rx=0 tx=0).stop 2024-09-13T17:52:54.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.375+0000 7f89ece00640 1 -- 172.21.15.114:0/3123791583 shutdown_connections 2024-09-13T17:52:54.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.375+0000 7f89ece00640 1 --2- 172.21.15.114:0/3123791583 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f89c8066690 0x7f89c8068b50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:54.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.375+0000 7f89ece00640 1 --2- 172.21.15.114:0/3123791583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89e8151420 0x7f89e80aaee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:54.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.375+0000 7f89ece00640 1 --2- 172.21.15.114:0/3123791583 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f89e80ccba0 0x7f89e80ac900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:54.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.375+0000 7f89ece00640 1 --2- 172.21.15.114:0/3123791583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89e8070960 0x7f89e81519c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:54.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.375+0000 7f89ece00640 1 -- 172.21.15.114:0/3123791583 >> 172.21.15.114:0/3123791583 conn(0x7f89e80660b0 msgr2=0x7f89e8150710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:54.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.375+0000 7f89ece00640 1 -- 172.21.15.114:0/3123791583 shutdown_connections 2024-09-13T17:52:54.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.375+0000 7f89ece00640 1 -- 172.21.15.114:0/3123791583 wait complete. 2024-09-13T17:52:54.397 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T17:52:54.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.531+0000 7fdc9fe00640 1 Processor -- start 2024-09-13T17:52:54.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.531+0000 7fdc9fe00640 1 -- start start 2024-09-13T17:52:54.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.531+0000 7fdc9fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdc980cdad0 0x7fdc980ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:54.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.531+0000 7fdc9fe00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc980adfb0 con 0x7fdc9806d740 2024-09-13T17:52:54.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.531+0000 7fdc9fe00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc980adcd0 con 0x7fdc98070420 2024-09-13T17:52:54.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.531+0000 7fdc9fe00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc9806cc10 con 0x7fdc980cdad0 2024-09-13T17:52:54.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.531+0000 7fdc9d400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdc980cdad0 0x7fdc980ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:54.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.531+0000 7fdc9d400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdc980cdad0 0x7fdc980ad4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42566/0 (socket says 172.21.15.114:42566) 2024-09-13T17:52:54.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.531+0000 7fdc9d400640 1 -- 172.21.15.114:0/1904089816 learned_addr learned my addr 172.21.15.114:0/1904089816 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:54.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.531+0000 7fdc9d400640 1 -- 172.21.15.114:0/1904089816 >> v1:172.21.15.134:6789/0 conn(0x7fdc98070420 legacy=0x7fdc9806d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:54.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.531+0000 7fdc9d400640 1 -- 172.21.15.114:0/1904089816 >> v1:172.21.15.114:6789/0 conn(0x7fdc9806d740 legacy=0x7fdc9815d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:54.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.531+0000 7fdc9d400640 1 -- 172.21.15.114:0/1904089816 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9806c550 con 0x7fdc980cdad0 2024-09-13T17:52:54.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.535+0000 7fdc9d400640 1 --2- 172.21.15.114:0/1904089816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc980cdad0 0x7fdc980ad4a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c009870 tx=0x7fdc8c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9712ea25594b45d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:54.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.535+0000 7fdc97e00640 1 -- 172.21.15.114:0/1904089816 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c0ab680 con 0x7fdc980cdad0 2024-09-13T17:52:54.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.535+0000 7fdc97e00640 1 -- 172.21.15.114:0/1904089816 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8c0ab7e0 con 0x7fdc980cdad0 2024-09-13T17:52:54.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.535+0000 7fdc97e00640 1 -- 172.21.15.114:0/1904089816 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c0abb70 con 0x7fdc980cdad0 2024-09-13T17:52:54.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.535+0000 7fdc9fe00640 1 -- 172.21.15.114:0/1904089816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc980cdad0 msgr2=0x7fdc980ad4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:54.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.535+0000 7fdc9fe00640 1 --2- 172.21.15.114:0/1904089816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc980cdad0 0x7fdc980ad4a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c009870 tx=0x7fdc8c01c4a0 comp rx=0 tx=0).stop 2024-09-13T17:52:54.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.535+0000 7fdc9fe00640 1 -- 172.21.15.114:0/1904089816 shutdown_connections 2024-09-13T17:52:54.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.535+0000 7fdc9fe00640 1 --2- 172.21.15.114:0/1904089816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc980cdad0 0x7fdc980ad4a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:54.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.535+0000 7fdc9fe00640 1 -- 172.21.15.114:0/1904089816 >> 172.21.15.114:0/1904089816 conn(0x7fdc980660b0 msgr2=0x7fdc98069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:54.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.535+0000 7fdc9fe00640 1 -- 172.21.15.114:0/1904089816 shutdown_connections 2024-09-13T17:52:54.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.535+0000 7fdc9fe00640 1 -- 172.21.15.114:0/1904089816 wait complete. 2024-09-13T17:52:54.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.539+0000 7fdc9fe00640 1 Processor -- start 2024-09-13T17:52:54.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.539+0000 7fdc9fe00640 1 -- start start 2024-09-13T17:52:54.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.539+0000 7fdc9fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc9806d740 0x7fdc9814c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:54.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.539+0000 7fdc9fe00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc98070420 0x7fdc98154e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:54.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.539+0000 7fdc9fe00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc980cdad0 0x7fdc98156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:54.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.539+0000 7fdc9fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9814bb60 con 0x7fdc9806d740 2024-09-13T17:52:54.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.539+0000 7fdc9fe00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9814be40 con 0x7fdc980cdad0 2024-09-13T17:52:54.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.539+0000 7fdc9fe00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9814c120 con 0x7fdc98070420 2024-09-13T17:52:54.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.539+0000 7fdc9d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc9806d740 0x7fdc9814c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:54.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.539+0000 7fdc9d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc9806d740 0x7fdc9814c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42572/0 (socket says 172.21.15.114:42572) 2024-09-13T17:52:54.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.539+0000 7fdc9d400640 1 -- 172.21.15.114:0/1374702144 learned_addr learned my addr 172.21.15.114:0/1374702144 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:54.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.539+0000 7fdc9de00640 1 --2- 172.21.15.114:0/1374702144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc980cdad0 0x7fdc98156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:54.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.539+0000 7fdc9ca00640 1 --2- 172.21.15.114:0/1374702144 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc98070420 0x7fdc98154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:54.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.539+0000 7fdc9d400640 1 -- 172.21.15.114:0/1374702144 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc98070420 msgr2=0x7fdc98154e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:54.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.539+0000 7fdc9d400640 1 --2- 172.21.15.114:0/1374702144 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc98070420 0x7fdc98154e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:54.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.539+0000 7fdc9d400640 1 -- 172.21.15.114:0/1374702144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc980cdad0 msgr2=0x7fdc98156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:54.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.539+0000 7fdc9d400640 1 --2- 172.21.15.114:0/1374702144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc980cdad0 0x7fdc98156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:54.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.539+0000 7fdc9d400640 1 -- 172.21.15.114:0/1374702144 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8c0094d0 con 0x7fdc9806d740 2024-09-13T17:52:54.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.539+0000 7fdc9de00640 1 --2- 172.21.15.114:0/1374702144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc980cdad0 0x7fdc98156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:54.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.539+0000 7fdc9d400640 1 --2- 172.21.15.114:0/1374702144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc9806d740 0x7fdc9814c920 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c0ad040 tx=0x7fdc8c01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:54.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.539+0000 7fdc95600640 1 -- 172.21.15.114:0/1374702144 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c0b48c0 con 0x7fdc9806d740 2024-09-13T17:52:54.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.539+0000 7fdc95600640 1 -- 172.21.15.114:0/1374702144 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8c0b4a40 con 0x7fdc9806d740 2024-09-13T17:52:54.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.539+0000 7fdc9fe00640 1 -- 172.21.15.114:0/1374702144 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc98070dc0 con 0x7fdc9806d740 2024-09-13T17:52:54.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.539+0000 7fdc95600640 1 -- 172.21.15.114:0/1374702144 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c0b4df0 con 0x7fdc9806d740 2024-09-13T17:52:54.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.539+0000 7fdc9fe00640 1 -- 172.21.15.114:0/1374702144 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc98156bd0 con 0x7fdc9806d740 2024-09-13T17:52:54.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.539+0000 7fdc9fe00640 1 -- 172.21.15.114:0/1374702144 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc9814bca0 con 0x7fdc9806d740 2024-09-13T17:52:54.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.543+0000 7fdc95600640 1 -- 172.21.15.114:0/1374702144 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdc8c0c7390 con 0x7fdc9806d740 2024-09-13T17:52:54.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.543+0000 7fdc95600640 1 --2- 172.21.15.114:0/1374702144 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdc78066690 0x7fdc78068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:54.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.543+0000 7fdc95600640 1 -- 172.21.15.114:0/1374702144 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdc8c11f530 con 0x7fdc9806d740 2024-09-13T17:52:54.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.543+0000 7fdc9ca00640 1 --2- 172.21.15.114:0/1374702144 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdc78066690 0x7fdc78068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:54.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.543+0000 7fdc9ca00640 1 --2- 172.21.15.114:0/1374702144 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdc78066690 0x7fdc78068b50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdc9814d600 tx=0x7fdc84009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:54.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.547+0000 7fdc95600640 1 -- 172.21.15.114:0/1374702144 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdc9814bca0 con 0x7fdc9806d740 2024-09-13T17:52:54.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.703+0000 7fdc9fe00640 1 -- 172.21.15.114:0/1374702144 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdc9814bca0 con 0x7fdc9806d740 2024-09-13T17:52:54.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.703+0000 7fdc95600640 1 -- 172.21.15.114:0/1374702144 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdc9814bca0 con 0x7fdc9806d740 2024-09-13T17:52:54.708 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:52:54.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.703+0000 7fdc9fe00640 1 -- 172.21.15.114:0/1374702144 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdc78066690 msgr2=0x7fdc78068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:54.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.703+0000 7fdc9fe00640 1 --2- 172.21.15.114:0/1374702144 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdc78066690 0x7fdc78068b50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdc9814d600 tx=0x7fdc84009040 comp rx=0 tx=0).stop 2024-09-13T17:52:54.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.703+0000 7fdc9fe00640 1 -- 172.21.15.114:0/1374702144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc9806d740 msgr2=0x7fdc9814c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:54.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.703+0000 7fdc9fe00640 1 --2- 172.21.15.114:0/1374702144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc9806d740 0x7fdc9814c920 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c0ad040 tx=0x7fdc8c01ace0 comp rx=0 tx=0).stop 2024-09-13T17:52:54.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.703+0000 7fdc9fe00640 1 -- 172.21.15.114:0/1374702144 shutdown_connections 2024-09-13T17:52:54.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.703+0000 7fdc9fe00640 1 --2- 172.21.15.114:0/1374702144 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdc78066690 0x7fdc78068b50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:54.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.703+0000 7fdc9fe00640 1 --2- 172.21.15.114:0/1374702144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc980cdad0 0x7fdc98156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:54.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.703+0000 7fdc9fe00640 1 --2- 172.21.15.114:0/1374702144 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdc98070420 0x7fdc98154e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:54.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.703+0000 7fdc9fe00640 1 --2- 172.21.15.114:0/1374702144 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc9806d740 0x7fdc9814c920 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:54.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.703+0000 7fdc9fe00640 1 -- 172.21.15.114:0/1374702144 >> 172.21.15.114:0/1374702144 conn(0x7fdc980660b0 msgr2=0x7fdc9806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:54.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.703+0000 7fdc9fe00640 1 -- 172.21.15.114:0/1374702144 shutdown_connections 2024-09-13T17:52:54.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.707+0000 7fdc9fe00640 1 -- 172.21.15.114:0/1374702144 wait complete. 2024-09-13T17:52:54.729 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:52:54.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.859+0000 7fb67d000640 1 Processor -- start 2024-09-13T17:52:54.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.859+0000 7fb67d000640 1 -- start start 2024-09-13T17:52:54.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.863+0000 7fb67d000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb6780b1380 0x7fb6780afd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:54.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.863+0000 7fb67d000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb678161310 con 0x7fb67815ff80 2024-09-13T17:52:54.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.863+0000 7fb67d000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb67806b780 con 0x7fb6780d00d0 2024-09-13T17:52:54.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.863+0000 7fb67d000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6780ce660 con 0x7fb6780b1380 2024-09-13T17:52:54.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.863+0000 7fb675e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb67815ff80 0x7fb678160400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50118/0 (socket says 172.21.15.114:50118) 2024-09-13T17:52:54.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.863+0000 7fb675e00640 1 -- 172.21.15.114:0/1245924622 learned_addr learned my addr 172.21.15.114:0/1245924622 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:54.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.863+0000 7fb676800640 1 --2- 172.21.15.114:0/1245924622 >> v2:172.21.15.134:3300/0 conn(0x7fb6780b1380 0x7fb6780afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:54.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.863+0000 7fb674a00640 1 -- 172.21.15.114:0/1245924622 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1795702461 0 0) 0x7fb678161310 con 0x7fb67815ff80 2024-09-13T17:52:54.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.863+0000 7fb674a00640 1 -- 172.21.15.114:0/1245924622 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb65c003530 con 0x7fb67815ff80 2024-09-13T17:52:54.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.863+0000 7fb676800640 1 -- 172.21.15.114:0/1245924622 >> v1:172.21.15.134:6789/0 conn(0x7fb6780d00d0 legacy=0x7fb678160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:54.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.863+0000 7fb674a00640 1 -- 172.21.15.114:0/1245924622 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1339643203 0 0) 0x7fb67806b780 con 0x7fb6780d00d0 2024-09-13T17:52:54.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.863+0000 7fb676800640 1 -- 172.21.15.114:0/1245924622 >> v1:172.21.15.114:6789/0 conn(0x7fb67815ff80 legacy=0x7fb678160400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:54.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.863+0000 7fb676800640 1 -- 172.21.15.114:0/1245924622 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67806b1c0 con 0x7fb6780b1380 2024-09-13T17:52:54.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.867+0000 7fb676800640 1 --2- 172.21.15.114:0/1245924622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6780b1380 0x7fb6780afd00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb670009d90 tx=0x7fb67001c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9725393c3d0ee792 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:54.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.867+0000 7fb674a00640 1 -- 172.21.15.114:0/1245924622 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6700a59a0 con 0x7fb6780b1380 2024-09-13T17:52:54.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.867+0000 7fb674a00640 1 -- 172.21.15.114:0/1245924622 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6700a5b00 con 0x7fb6780b1380 2024-09-13T17:52:54.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.867+0000 7fb674a00640 1 -- 172.21.15.114:0/1245924622 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6700a5e90 con 0x7fb6780b1380 2024-09-13T17:52:54.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.867+0000 7fb67d000640 1 -- 172.21.15.114:0/1245924622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6780b1380 msgr2=0x7fb6780afd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:54.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.867+0000 7fb67d000640 1 --2- 172.21.15.114:0/1245924622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6780b1380 0x7fb6780afd00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb670009d90 tx=0x7fb67001c8e0 comp rx=0 tx=0).stop 2024-09-13T17:52:54.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.867+0000 7fb67d000640 1 -- 172.21.15.114:0/1245924622 shutdown_connections 2024-09-13T17:52:54.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.867+0000 7fb67d000640 1 --2- 172.21.15.114:0/1245924622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6780b1380 0x7fb6780afd00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:54.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.867+0000 7fb67d000640 1 -- 172.21.15.114:0/1245924622 >> 172.21.15.114:0/1245924622 conn(0x7fb6780d04d0 msgr2=0x7fb6780d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:54.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.867+0000 7fb67d000640 1 -- 172.21.15.114:0/1245924622 shutdown_connections 2024-09-13T17:52:54.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.867+0000 7fb67d000640 1 -- 172.21.15.114:0/1245924622 wait complete. 2024-09-13T17:52:54.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.867+0000 7fb67d000640 1 Processor -- start 2024-09-13T17:52:54.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.867+0000 7fb67d000640 1 -- start start 2024-09-13T17:52:54.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.871+0000 7fb67d000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6780b1380 0x7fb6780cc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:54.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.871+0000 7fb67d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6780d00d0 0x7fb6780c4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:54.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.871+0000 7fb67d000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb67815ff80 0x7fb6781f8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:54.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.871+0000 7fb67d000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6780cd8c0 con 0x7fb6780d00d0 2024-09-13T17:52:54.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.871+0000 7fb67d000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6780c72e0 con 0x7fb6780b1380 2024-09-13T17:52:54.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.871+0000 7fb67d000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6780ccc40 con 0x7fb67815ff80 2024-09-13T17:52:54.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.871+0000 7fb675400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6780d00d0 0x7fb6780c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:54.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.871+0000 7fb675400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6780d00d0 0x7fb6780c4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42578/0 (socket says 172.21.15.114:42578) 2024-09-13T17:52:54.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.871+0000 7fb675400640 1 -- 172.21.15.114:0/4039377586 learned_addr learned my addr 172.21.15.114:0/4039377586 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:54.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.871+0000 7fb676800640 1 --2- 172.21.15.114:0/4039377586 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb67815ff80 0x7fb6781f8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:54.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.871+0000 7fb675e00640 1 --2- 172.21.15.114:0/4039377586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6780b1380 0x7fb6780cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:54.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.871+0000 7fb675400640 1 -- 172.21.15.114:0/4039377586 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb67815ff80 msgr2=0x7fb6781f8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:54.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.871+0000 7fb675400640 1 --2- 172.21.15.114:0/4039377586 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb67815ff80 0x7fb6781f8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:54.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.871+0000 7fb675400640 1 -- 172.21.15.114:0/4039377586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6780b1380 msgr2=0x7fb6780cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:54.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.871+0000 7fb675400640 1 --2- 172.21.15.114:0/4039377586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6780b1380 0x7fb6780cc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:54.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.871+0000 7fb675400640 1 -- 172.21.15.114:0/4039377586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb670009a70 con 0x7fb6780d00d0 2024-09-13T17:52:54.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.871+0000 7fb675e00640 1 --2- 172.21.15.114:0/4039377586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6780b1380 0x7fb6780cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:54.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.871+0000 7fb675400640 1 --2- 172.21.15.114:0/4039377586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6780d00d0 0x7fb6780c4260 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb664001ec0 tx=0x7fb66400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:54.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.871+0000 7fb66e000640 1 -- 172.21.15.114:0/4039377586 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6640054e0 con 0x7fb6780d00d0 2024-09-13T17:52:54.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.871+0000 7fb66e000640 1 -- 172.21.15.114:0/4039377586 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb664003600 con 0x7fb6780d00d0 2024-09-13T17:52:54.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.871+0000 7fb66e000640 1 -- 172.21.15.114:0/4039377586 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6640039b0 con 0x7fb6780d00d0 2024-09-13T17:52:54.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.871+0000 7fb67d000640 1 -- 172.21.15.114:0/4039377586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6780ccf20 con 0x7fb6780d00d0 2024-09-13T17:52:54.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.871+0000 7fb67d000640 1 -- 172.21.15.114:0/4039377586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6780cd4e0 con 0x7fb6780d00d0 2024-09-13T17:52:54.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.871+0000 7fb67d000640 1 -- 172.21.15.114:0/4039377586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6780d10f0 con 0x7fb6780d00d0 2024-09-13T17:52:54.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.871+0000 7fb66e000640 1 -- 172.21.15.114:0/4039377586 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb664003b10 con 0x7fb6780d00d0 2024-09-13T17:52:54.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.875+0000 7fb66e000640 1 --2- 172.21.15.114:0/4039377586 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb658066690 0x7fb658068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:54.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.875+0000 7fb66e000640 1 -- 172.21.15.114:0/4039377586 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb664083ab0 con 0x7fb6780d00d0 2024-09-13T17:52:54.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.875+0000 7fb675e00640 1 --2- 172.21.15.114:0/4039377586 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb658066690 0x7fb658068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:54.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.875+0000 7fb675e00640 1 --2- 172.21.15.114:0/4039377586 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb658066690 0x7fb658068b50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb668005890 tx=0x7fb668009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:54.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:54.879+0000 7fb66e000640 1 -- 172.21.15.114:0/4039377586 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb664050b00 con 0x7fb6780d00d0 2024-09-13T17:52:55.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.063+0000 7fb67d000640 1 -- 172.21.15.114:0/4039377586 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6780ad680 con 0x7fb6780d00d0 2024-09-13T17:52:55.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.067+0000 7fb66e000640 1 -- 172.21.15.114:0/4039377586 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4739 (secure 0 0 0) 0x7fb664017020 con 0x7fb6780d00d0 2024-09-13T17:52:55.071 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:55.071 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/534634081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":534634081},{"type":"v1","addr":"172.21.15.134:6835","nonce":534634081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1773366615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1773366615},{"type":"v1","addr":"172.21.15.114:6836","nonce":1773366615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4122490085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":4122490085},{"type":"v1","addr":"172.21.15.114:6837","nonce":4122490085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:51:49.789079+0000","modified":"2024-09-13T17:52:13.041461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/1863104078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1863104078},{"type":"v1","addr":"172.21.15.134:6834","nonce":1863104078}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:52:55.071 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 9 2024-09-13T17:52:55.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.067+0000 7fb67d000640 1 -- 172.21.15.114:0/4039377586 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb658066690 msgr2=0x7fb658068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:55.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.067+0000 7fb67d000640 1 --2- 172.21.15.114:0/4039377586 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb658066690 0x7fb658068b50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb668005890 tx=0x7fb668009040 comp rx=0 tx=0).stop 2024-09-13T17:52:55.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.067+0000 7fb67d000640 1 -- 172.21.15.114:0/4039377586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6780d00d0 msgr2=0x7fb6780c4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:55.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.067+0000 7fb67d000640 1 --2- 172.21.15.114:0/4039377586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6780d00d0 0x7fb6780c4260 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb664001ec0 tx=0x7fb66400c8e0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.067+0000 7fb67d000640 1 -- 172.21.15.114:0/4039377586 shutdown_connections 2024-09-13T17:52:55.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.067+0000 7fb67d000640 1 --2- 172.21.15.114:0/4039377586 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb658066690 0x7fb658068b50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.067+0000 7fb67d000640 1 --2- 172.21.15.114:0/4039377586 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb67815ff80 0x7fb6781f8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.067+0000 7fb67d000640 1 --2- 172.21.15.114:0/4039377586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb6780d00d0 0x7fb6780c4260 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.067+0000 7fb67d000640 1 --2- 172.21.15.114:0/4039377586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6780b1380 0x7fb6780cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.067+0000 7fb67d000640 1 -- 172.21.15.114:0/4039377586 >> 172.21.15.114:0/4039377586 conn(0x7fb6780d04d0 msgr2=0x7fb6780b18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:55.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.067+0000 7fb67d000640 1 -- 172.21.15.114:0/4039377586 shutdown_connections 2024-09-13T17:52:55.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.067+0000 7fb67d000640 1 -- 172.21.15.114:0/4039377586 wait complete. 2024-09-13T17:52:55.092 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:52:55.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.223+0000 7fe566400640 1 Processor -- start 2024-09-13T17:52:55.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.223+0000 7fe566400640 1 -- start start 2024-09-13T17:52:55.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.223+0000 7fe566400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe56015d280 0x7fe56015d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:55.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.223+0000 7fe566400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe5600b2300 0x7fe560069f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:55.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.223+0000 7fe566400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe56006d200 con 0x7fe560065c80 2024-09-13T17:52:55.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.223+0000 7fe566400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5600b3680 con 0x7fe56015d280 2024-09-13T17:52:55.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.223+0000 7fe566400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe560157000 con 0x7fe5600b2300 2024-09-13T17:52:55.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.223+0000 7fe55f400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe56015d280 0x7fe56015d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:55.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.223+0000 7fe55f400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe56015d280 0x7fe56015d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42584/0 (socket says 172.21.15.114:42584) 2024-09-13T17:52:55.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.223+0000 7fe55f400640 1 -- 172.21.15.114:0/340842180 learned_addr learned my addr 172.21.15.114:0/340842180 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:55.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.223+0000 7fe55fe00640 1 --2- 172.21.15.114:0/340842180 >> v2:172.21.15.134:3300/0 conn(0x7fe5600b2300 0x7fe560069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:55.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.223+0000 7fe55f400640 1 -- 172.21.15.114:0/340842180 >> v2:172.21.15.134:3300/0 conn(0x7fe5600b2300 msgr2=0x7fe560069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:55.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.223+0000 7fe55f400640 1 --2- 172.21.15.114:0/340842180 >> v2:172.21.15.134:3300/0 conn(0x7fe5600b2300 0x7fe560069f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.223+0000 7fe55f400640 1 -- 172.21.15.114:0/340842180 >> v1:172.21.15.134:6789/0 conn(0x7fe560065c80 legacy=0x7fe5600b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:55.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.223+0000 7fe55f400640 1 -- 172.21.15.114:0/340842180 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56006e1f0 con 0x7fe56015d280 2024-09-13T17:52:55.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.227+0000 7fe55f400640 1 --2- 172.21.15.114:0/340842180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe56015d280 0x7fe56015d660 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe560160070 tx=0x7fe55001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47e592a9429f03d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:55.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.227+0000 7fe55e000640 1 -- 172.21.15.114:0/340842180 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5500a5880 con 0x7fe56015d280 2024-09-13T17:52:55.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.227+0000 7fe55e000640 1 -- 172.21.15.114:0/340842180 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5500a59e0 con 0x7fe56015d280 2024-09-13T17:52:55.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.227+0000 7fe55e000640 1 -- 172.21.15.114:0/340842180 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5500a5d70 con 0x7fe56015d280 2024-09-13T17:52:55.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.227+0000 7fe566400640 1 -- 172.21.15.114:0/340842180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe56015d280 msgr2=0x7fe56015d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:55.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.227+0000 7fe566400640 1 --2- 172.21.15.114:0/340842180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe56015d280 0x7fe56015d660 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe560160070 tx=0x7fe55001c9c0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.227+0000 7fe566400640 1 -- 172.21.15.114:0/340842180 shutdown_connections 2024-09-13T17:52:55.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.227+0000 7fe566400640 1 --2- 172.21.15.114:0/340842180 >> v2:172.21.15.134:3300/0 conn(0x7fe5600b2300 0x7fe560069f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.227+0000 7fe566400640 1 --2- 172.21.15.114:0/340842180 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe56015d280 0x7fe56015d660 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.227+0000 7fe566400640 1 -- 172.21.15.114:0/340842180 >> 172.21.15.114:0/340842180 conn(0x7fe5600cebc0 msgr2=0x7fe5600cefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:55.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.227+0000 7fe566400640 1 -- 172.21.15.114:0/340842180 shutdown_connections 2024-09-13T17:52:55.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.227+0000 7fe566400640 1 -- 172.21.15.114:0/340842180 wait complete. 2024-09-13T17:52:55.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.231+0000 7fe566400640 1 Processor -- start 2024-09-13T17:52:55.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.231+0000 7fe566400640 1 -- start start 2024-09-13T17:52:55.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.231+0000 7fe566400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe560065c80 0x7fe5601563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:55.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.231+0000 7fe566400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5600b2300 0x7fe5600cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:55.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.231+0000 7fe566400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe56015d280 0x7fe560164600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:55.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.231+0000 7fe566400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe560161980 con 0x7fe5600b2300 2024-09-13T17:52:55.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.231+0000 7fe566400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5601571b0 con 0x7fe560065c80 2024-09-13T17:52:55.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.231+0000 7fe566400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5600cdf30 con 0x7fe56015d280 2024-09-13T17:52:55.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.231+0000 7fe55ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5600b2300 0x7fe5600cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:55.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.231+0000 7fe55ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5600b2300 0x7fe5600cd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42598/0 (socket says 172.21.15.114:42598) 2024-09-13T17:52:55.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.231+0000 7fe55ea00640 1 -- 172.21.15.114:0/3608855488 learned_addr learned my addr 172.21.15.114:0/3608855488 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:55.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.231+0000 7fe55f400640 1 --2- 172.21.15.114:0/3608855488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe560065c80 0x7fe5601563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:55.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.231+0000 7fe55fe00640 1 --2- 172.21.15.114:0/3608855488 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe56015d280 0x7fe560164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:55.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.231+0000 7fe55ea00640 1 -- 172.21.15.114:0/3608855488 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe56015d280 msgr2=0x7fe560164600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:55.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.231+0000 7fe55ea00640 1 --2- 172.21.15.114:0/3608855488 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe56015d280 0x7fe560164600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.231+0000 7fe55ea00640 1 -- 172.21.15.114:0/3608855488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe560065c80 msgr2=0x7fe5601563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:55.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.231+0000 7fe55ea00640 1 --2- 172.21.15.114:0/3608855488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe560065c80 0x7fe5601563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.231+0000 7fe55ea00640 1 -- 172.21.15.114:0/3608855488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe550009b30 con 0x7fe5600b2300 2024-09-13T17:52:55.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.231+0000 7fe55ea00640 1 --2- 172.21.15.114:0/3608855488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5600b2300 0x7fe5600cd9f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe54c00c500 tx=0x7fe54c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:55.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.231+0000 7fe557400640 1 -- 172.21.15.114:0/3608855488 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c005220 con 0x7fe5600b2300 2024-09-13T17:52:55.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.231+0000 7fe557400640 1 -- 172.21.15.114:0/3608855488 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54c005380 con 0x7fe5600b2300 2024-09-13T17:52:55.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.231+0000 7fe566400640 1 -- 172.21.15.114:0/3608855488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5600ce1b0 con 0x7fe5600b2300 2024-09-13T17:52:55.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.231+0000 7fe557400640 1 -- 172.21.15.114:0/3608855488 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c007270 con 0x7fe5600b2300 2024-09-13T17:52:55.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.231+0000 7fe566400640 1 -- 172.21.15.114:0/3608855488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5600ce770 con 0x7fe5600b2300 2024-09-13T17:52:55.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.231+0000 7fe566400640 1 -- 172.21.15.114:0/3608855488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5600673b0 con 0x7fe5600b2300 2024-09-13T17:52:55.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.235+0000 7fe557400640 1 -- 172.21.15.114:0/3608855488 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe54c0073d0 con 0x7fe5600b2300 2024-09-13T17:52:55.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.235+0000 7fe557400640 1 --2- 172.21.15.114:0/3608855488 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe540066690 0x7fe540068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:55.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.235+0000 7fe557400640 1 -- 172.21.15.114:0/3608855488 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe54c083de0 con 0x7fe5600b2300 2024-09-13T17:52:55.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.235+0000 7fe55f400640 1 --2- 172.21.15.114:0/3608855488 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe540066690 0x7fe540068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:55.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.235+0000 7fe55f400640 1 --2- 172.21.15.114:0/3608855488 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe540066690 0x7fe540068b50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe5500ae000 tx=0x7fe5500a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:55.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.239+0000 7fe557400640 1 -- 172.21.15.114:0/3608855488 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe54c050db0 con 0x7fe5600b2300 2024-09-13T17:52:55.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.395+0000 7fe566400640 1 -- 172.21.15.114:0/3608855488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe56006dc90 con 0x7fe5600b2300 2024-09-13T17:52:55.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.395+0000 7fe557400640 1 -- 172.21.15.114:0/3608855488 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18784 (secure 0 0 0) 0x7fe54c0543d0 con 0x7fe5600b2300 2024-09-13T17:52:55.447 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:55.447 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:52:31.139000+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:51:48.278220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:51:48.773888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:51:51.856300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:52:55.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.395+0000 7fe566400640 1 -- 172.21.15.114:0/3608855488 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe540066690 msgr2=0x7fe540068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:55.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.395+0000 7fe566400640 1 --2- 172.21.15.114:0/3608855488 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe540066690 0x7fe540068b50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe5500ae000 tx=0x7fe5500a7070 comp rx=0 tx=0).stop 2024-09-13T17:52:55.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.395+0000 7fe566400640 1 -- 172.21.15.114:0/3608855488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5600b2300 msgr2=0x7fe5600cd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:55.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.395+0000 7fe566400640 1 --2- 172.21.15.114:0/3608855488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5600b2300 0x7fe5600cd9f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe54c00c500 tx=0x7fe54c00c9c0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.399+0000 7fe566400640 1 -- 172.21.15.114:0/3608855488 shutdown_connections 2024-09-13T17:52:55.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.399+0000 7fe566400640 1 --2- 172.21.15.114:0/3608855488 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe540066690 0x7fe540068b50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.399+0000 7fe566400640 1 --2- 172.21.15.114:0/3608855488 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe56015d280 0x7fe560164600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.399+0000 7fe566400640 1 --2- 172.21.15.114:0/3608855488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe5600b2300 0x7fe5600cd9f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.399+0000 7fe566400640 1 --2- 172.21.15.114:0/3608855488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe560065c80 0x7fe5601563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.399+0000 7fe566400640 1 -- 172.21.15.114:0/3608855488 >> 172.21.15.114:0/3608855488 conn(0x7fe5600cebc0 msgr2=0x7fe56015eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:55.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.399+0000 7fe566400640 1 -- 172.21.15.114:0/3608855488 shutdown_connections 2024-09-13T17:52:55.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.399+0000 7fe566400640 1 -- 172.21.15.114:0/3608855488 wait complete. 2024-09-13T17:52:55.451 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T17:52:55.451 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:52:55.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.579+0000 7fa940200640 1 Processor -- start 2024-09-13T17:52:55.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.579+0000 7fa940200640 1 -- start start 2024-09-13T17:52:55.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.583+0000 7fa940200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa93813f420 0x7fa93806d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:55.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.583+0000 7fa940200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa93806da90 0x7fa9380cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:55.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.583+0000 7fa940200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9380cd220 con 0x7fa93813c240 2024-09-13T17:52:55.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.583+0000 7fa940200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa93806df40 con 0x7fa93806da90 2024-09-13T17:52:55.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.583+0000 7fa940200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa93815a740 con 0x7fa93813f420 2024-09-13T17:52:55.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.583+0000 7fa93e200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa93806da90 0x7fa9380cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:55.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.583+0000 7fa93d800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa93813c240 0x7fa93813c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50128/0 (socket says 172.21.15.114:50128) 2024-09-13T17:52:55.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.583+0000 7fa93d800640 1 -- 172.21.15.114:0/3035027394 learned_addr learned my addr 172.21.15.114:0/3035027394 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:55.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.583+0000 7fa93ce00640 1 --2- 172.21.15.114:0/3035027394 >> v2:172.21.15.134:3300/0 conn(0x7fa93813f420 0x7fa93806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:55.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.583+0000 7fa93e200640 1 -- 172.21.15.114:0/3035027394 >> v2:172.21.15.134:3300/0 conn(0x7fa93813f420 msgr2=0x7fa93806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:55.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.583+0000 7fa93e200640 1 --2- 172.21.15.114:0/3035027394 >> v2:172.21.15.134:3300/0 conn(0x7fa93813f420 0x7fa93806d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.583+0000 7fa93e200640 1 -- 172.21.15.114:0/3035027394 >> v1:172.21.15.114:6789/0 conn(0x7fa93813c240 legacy=0x7fa93813c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:55.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.583+0000 7fa93e200640 1 -- 172.21.15.114:0/3035027394 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa938159bc0 con 0x7fa93806da90 2024-09-13T17:52:55.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.583+0000 7fa93ce00640 1 --2- 172.21.15.114:0/3035027394 >> v2:172.21.15.134:3300/0 conn(0x7fa93813f420 0x7fa93806d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:55.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.587+0000 7fa93e200640 1 --2- 172.21.15.114:0/3035027394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa93806da90 0x7fa9380cd650 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa9380ae130 tx=0x7fa93001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ae80f5e472f94e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:55.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.587+0000 7fa937e00640 1 -- 172.21.15.114:0/3035027394 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9300ab650 con 0x7fa93806da90 2024-09-13T17:52:55.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.587+0000 7fa937e00640 1 -- 172.21.15.114:0/3035027394 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9300ab7b0 con 0x7fa93806da90 2024-09-13T17:52:55.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.587+0000 7fa937e00640 1 -- 172.21.15.114:0/3035027394 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9300abb40 con 0x7fa93806da90 2024-09-13T17:52:55.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.587+0000 7fa940200640 1 -- 172.21.15.114:0/3035027394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa93806da90 msgr2=0x7fa9380cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:55.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.587+0000 7fa940200640 1 --2- 172.21.15.114:0/3035027394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa93806da90 0x7fa9380cd650 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa9380ae130 tx=0x7fa93001c450 comp rx=0 tx=0).stop 2024-09-13T17:52:55.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.587+0000 7fa940200640 1 -- 172.21.15.114:0/3035027394 shutdown_connections 2024-09-13T17:52:55.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.587+0000 7fa940200640 1 --2- 172.21.15.114:0/3035027394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa93806da90 0x7fa9380cd650 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.587+0000 7fa940200640 1 --2- 172.21.15.114:0/3035027394 >> v2:172.21.15.134:3300/0 conn(0x7fa93813f420 0x7fa93806d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.587+0000 7fa940200640 1 -- 172.21.15.114:0/3035027394 >> 172.21.15.114:0/3035027394 conn(0x7fa9380660b0 msgr2=0x7fa938069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:55.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.587+0000 7fa940200640 1 -- 172.21.15.114:0/3035027394 shutdown_connections 2024-09-13T17:52:55.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.587+0000 7fa940200640 1 -- 172.21.15.114:0/3035027394 wait complete. 2024-09-13T17:52:55.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.587+0000 7fa940200640 1 Processor -- start 2024-09-13T17:52:55.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.587+0000 7fa940200640 1 -- start start 2024-09-13T17:52:55.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.587+0000 7fa940200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa93806da90 0x7fa9380c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:55.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.587+0000 7fa940200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa93813c240 0x7fa938156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:55.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.587+0000 7fa940200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa93813f420 0x7fa938161120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:55.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.587+0000 7fa940200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9381f4e90 con 0x7fa93813f420 2024-09-13T17:52:55.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.587+0000 7fa940200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa938156bb0 con 0x7fa93813c240 2024-09-13T17:52:55.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.587+0000 7fa940200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa938161660 con 0x7fa93806da90 2024-09-13T17:52:55.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.591+0000 7fa93e200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa93813f420 0x7fa938161120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:55.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.591+0000 7fa93e200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa93813f420 0x7fa938161120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42614/0 (socket says 172.21.15.114:42614) 2024-09-13T17:52:55.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.591+0000 7fa93e200640 1 -- 172.21.15.114:0/1390079241 learned_addr learned my addr 172.21.15.114:0/1390079241 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:55.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.591+0000 7fa93ce00640 1 --2- 172.21.15.114:0/1390079241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa93813c240 0x7fa938156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:55.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.591+0000 7fa93d800640 1 --2- 172.21.15.114:0/1390079241 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa93806da90 0x7fa9380c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:55.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.591+0000 7fa93e200640 1 -- 172.21.15.114:0/1390079241 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa93806da90 msgr2=0x7fa9380c3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:55.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.591+0000 7fa93e200640 1 --2- 172.21.15.114:0/1390079241 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa93806da90 0x7fa9380c3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.591+0000 7fa93e200640 1 -- 172.21.15.114:0/1390079241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa93813c240 msgr2=0x7fa938156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:55.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.591+0000 7fa93e200640 1 --2- 172.21.15.114:0/1390079241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa93813c240 0x7fa938156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.591+0000 7fa93e200640 1 -- 172.21.15.114:0/1390079241 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa930009420 con 0x7fa93813f420 2024-09-13T17:52:55.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.591+0000 7fa93e200640 1 --2- 172.21.15.114:0/1390079241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa93813f420 0x7fa938161120 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa9300ad040 tx=0x7fa9300191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:55.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.591+0000 7fa935600640 1 -- 172.21.15.114:0/1390079241 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9300bf610 con 0x7fa93813f420 2024-09-13T17:52:55.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.591+0000 7fa935600640 1 -- 172.21.15.114:0/1390079241 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9300bf790 con 0x7fa93813f420 2024-09-13T17:52:55.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.591+0000 7fa940200640 1 -- 172.21.15.114:0/1390079241 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa938162130 con 0x7fa93813f420 2024-09-13T17:52:55.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.591+0000 7fa935600640 1 -- 172.21.15.114:0/1390079241 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9300bfb40 con 0x7fa93813f420 2024-09-13T17:52:55.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.591+0000 7fa940200640 1 -- 172.21.15.114:0/1390079241 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa938161b70 con 0x7fa93813f420 2024-09-13T17:52:55.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.591+0000 7fa940200640 1 -- 172.21.15.114:0/1390079241 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa938159820 con 0x7fa93813f420 2024-09-13T17:52:55.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.591+0000 7fa935600640 1 -- 172.21.15.114:0/1390079241 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa9300bfca0 con 0x7fa93813f420 2024-09-13T17:52:55.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.595+0000 7fa935600640 1 --2- 172.21.15.114:0/1390079241 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa918066690 0x7fa918068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:55.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.595+0000 7fa935600640 1 -- 172.21.15.114:0/1390079241 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa93011f150 con 0x7fa93813f420 2024-09-13T17:52:55.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.595+0000 7fa93d800640 1 --2- 172.21.15.114:0/1390079241 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa918066690 0x7fa918068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:55.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.595+0000 7fa93d800640 1 --2- 172.21.15.114:0/1390079241 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa918066690 0x7fa918068b50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa92c005c10 tx=0x7fa92c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:55.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.599+0000 7fa935600640 1 -- 172.21.15.114:0/1390079241 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa9300ec210 con 0x7fa93813f420 2024-09-13T17:52:55.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.783+0000 7fa940200640 1 -- 172.21.15.114:0/1390079241 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa93815a4c0 con 0x7fa93813f420 2024-09-13T17:52:55.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.783+0000 7fa935600640 1 -- 172.21.15.114:0/1390079241 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4739 (secure 0 0 0) 0x7fa9300ef830 con 0x7fa93813f420 2024-09-13T17:52:55.789 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:55.789 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/534634081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":534634081},{"type":"v1","addr":"172.21.15.134:6835","nonce":534634081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1773366615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1773366615},{"type":"v1","addr":"172.21.15.114:6836","nonce":1773366615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4122490085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":4122490085},{"type":"v1","addr":"172.21.15.114:6837","nonce":4122490085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:51:49.789079+0000","modified":"2024-09-13T17:52:13.041461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/1863104078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1863104078},{"type":"v1","addr":"172.21.15.134:6834","nonce":1863104078}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:52:55.789 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 9 2024-09-13T17:52:55.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.787+0000 7fa940200640 1 -- 172.21.15.114:0/1390079241 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa918066690 msgr2=0x7fa918068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:55.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.787+0000 7fa940200640 1 --2- 172.21.15.114:0/1390079241 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa918066690 0x7fa918068b50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa92c005c10 tx=0x7fa92c009040 comp rx=0 tx=0).stop 2024-09-13T17:52:55.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.787+0000 7fa940200640 1 -- 172.21.15.114:0/1390079241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa93813f420 msgr2=0x7fa938161120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:55.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.787+0000 7fa940200640 1 --2- 172.21.15.114:0/1390079241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa93813f420 0x7fa938161120 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa9300ad040 tx=0x7fa9300191f0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.787+0000 7fa940200640 1 -- 172.21.15.114:0/1390079241 shutdown_connections 2024-09-13T17:52:55.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.787+0000 7fa940200640 1 --2- 172.21.15.114:0/1390079241 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa918066690 0x7fa918068b50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.787+0000 7fa940200640 1 --2- 172.21.15.114:0/1390079241 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa93813f420 0x7fa938161120 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.787+0000 7fa940200640 1 --2- 172.21.15.114:0/1390079241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa93813c240 0x7fa938156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.787+0000 7fa940200640 1 --2- 172.21.15.114:0/1390079241 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa93806da90 0x7fa9380c3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.787+0000 7fa940200640 1 -- 172.21.15.114:0/1390079241 >> 172.21.15.114:0/1390079241 conn(0x7fa9380660b0 msgr2=0x7fa9380b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:55.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.787+0000 7fa940200640 1 -- 172.21.15.114:0/1390079241 shutdown_connections 2024-09-13T17:52:55.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.787+0000 7fa940200640 1 -- 172.21.15.114:0/1390079241 wait complete. 2024-09-13T17:52:55.810 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:52:55.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.939+0000 7f8eb1e00640 1 Processor -- start 2024-09-13T17:52:55.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.939+0000 7f8eb1e00640 1 -- start start 2024-09-13T17:52:55.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.939+0000 7f8eb1e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8eac15ff80 0x7f8eac0afd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:55.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.939+0000 7f8eb1e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8eac0b1380 0x7f8eac160b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:55.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.939+0000 7f8eb1e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eac161310 con 0x7f8eac0d00d0 2024-09-13T17:52:55.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.939+0000 7f8eb1e00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eac0ce660 con 0x7f8eac0b1380 2024-09-13T17:52:55.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.939+0000 7f8eb1e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac06b780 con 0x7f8eac15ff80 2024-09-13T17:52:55.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.939+0000 7f8eaa000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8eac0d00d0 0x7f8eac160400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50134/0 (socket says 172.21.15.114:50134) 2024-09-13T17:52:55.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.939+0000 7f8eaa000640 1 -- 172.21.15.114:0/918167859 learned_addr learned my addr 172.21.15.114:0/918167859 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:55.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.943+0000 7f8eab400640 1 --2- 172.21.15.114:0/918167859 >> v2:172.21.15.134:3300/0 conn(0x7f8eac0b1380 0x7f8eac160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:55.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.943+0000 7f8eaaa00640 1 --2- 172.21.15.114:0/918167859 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8eac15ff80 0x7f8eac0afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:55.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.943+0000 7f8ea9600640 1 -- 172.21.15.114:0/918167859 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815776481 0 0) 0x7f8eac161310 con 0x7f8eac0d00d0 2024-09-13T17:52:55.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.943+0000 7f8ea9600640 1 -- 172.21.15.114:0/918167859 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e90003530 con 0x7f8eac0d00d0 2024-09-13T17:52:55.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.943+0000 7f8eab400640 1 -- 172.21.15.114:0/918167859 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8eac15ff80 msgr2=0x7f8eac0afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:55.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.943+0000 7f8eab400640 1 --2- 172.21.15.114:0/918167859 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8eac15ff80 0x7f8eac0afd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.943+0000 7f8eab400640 1 -- 172.21.15.114:0/918167859 >> v1:172.21.15.114:6789/0 conn(0x7f8eac0d00d0 legacy=0x7f8eac160400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:55.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.943+0000 7f8eab400640 1 -- 172.21.15.114:0/918167859 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eac161050 con 0x7f8eac0b1380 2024-09-13T17:52:55.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.943+0000 7f8eaaa00640 1 --2- 172.21.15.114:0/918167859 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8eac15ff80 0x7f8eac0afd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:52:55.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.943+0000 7f8eab400640 1 --2- 172.21.15.114:0/918167859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8eac0b1380 0x7f8eac160b10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009d90 tx=0x7f8ea401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f030beee5fd1123 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:55.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.943+0000 7f8ea9600640 1 -- 172.21.15.114:0/918167859 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40a59a0 con 0x7f8eac0b1380 2024-09-13T17:52:55.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.943+0000 7f8ea9600640 1 -- 172.21.15.114:0/918167859 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea40a5b00 con 0x7f8eac0b1380 2024-09-13T17:52:55.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.943+0000 7f8ea9600640 1 -- 172.21.15.114:0/918167859 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40a5e90 con 0x7f8eac0b1380 2024-09-13T17:52:55.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.947+0000 7f8eb1e00640 1 -- 172.21.15.114:0/918167859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8eac0b1380 msgr2=0x7f8eac160b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:55.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.947+0000 7f8eb1e00640 1 --2- 172.21.15.114:0/918167859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8eac0b1380 0x7f8eac160b10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009d90 tx=0x7f8ea401c8e0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.947+0000 7f8eb1e00640 1 -- 172.21.15.114:0/918167859 shutdown_connections 2024-09-13T17:52:55.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.947+0000 7f8eb1e00640 1 --2- 172.21.15.114:0/918167859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8eac0b1380 0x7f8eac160b10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.947+0000 7f8eb1e00640 1 --2- 172.21.15.114:0/918167859 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8eac15ff80 0x7f8eac0afd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.947+0000 7f8eb1e00640 1 -- 172.21.15.114:0/918167859 >> 172.21.15.114:0/918167859 conn(0x7f8eac0d04d0 msgr2=0x7f8eac0d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:55.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.947+0000 7f8eb1e00640 1 -- 172.21.15.114:0/918167859 shutdown_connections 2024-09-13T17:52:55.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.947+0000 7f8eb1e00640 1 -- 172.21.15.114:0/918167859 wait complete. 2024-09-13T17:52:55.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.947+0000 7f8eb1e00640 1 Processor -- start 2024-09-13T17:52:55.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.947+0000 7f8eb1e00640 1 -- start start 2024-09-13T17:52:55.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.947+0000 7f8eb1e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8eac0b1380 0x7f8eac0c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:55.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.947+0000 7f8eb1e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8eac0d00d0 0x7f8eac0cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:55.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.947+0000 7f8eb1e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8eac15ff80 0x7f8eac0aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:55.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.947+0000 7f8eb1e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac0cb040 con 0x7f8eac15ff80 2024-09-13T17:52:55.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.947+0000 7f8eb1e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac151ca0 con 0x7f8eac0b1380 2024-09-13T17:52:55.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.947+0000 7f8eb1e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac151f80 con 0x7f8eac0d00d0 2024-09-13T17:52:55.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.947+0000 7f8eab400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8eac15ff80 0x7f8eac0aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:55.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.947+0000 7f8eab400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8eac15ff80 0x7f8eac0aeff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42626/0 (socket says 172.21.15.114:42626) 2024-09-13T17:52:55.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.947+0000 7f8eab400640 1 -- 172.21.15.114:0/2519456851 learned_addr learned my addr 172.21.15.114:0/2519456851 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:55.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.947+0000 7f8eaaa00640 1 --2- 172.21.15.114:0/2519456851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8eac0b1380 0x7f8eac0c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:55.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.947+0000 7f8eaa000640 1 --2- 172.21.15.114:0/2519456851 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8eac0d00d0 0x7f8eac0cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:55.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.951+0000 7f8eab400640 1 -- 172.21.15.114:0/2519456851 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8eac0d00d0 msgr2=0x7f8eac0cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:55.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.951+0000 7f8eab400640 1 --2- 172.21.15.114:0/2519456851 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8eac0d00d0 0x7f8eac0cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.951+0000 7f8eab400640 1 -- 172.21.15.114:0/2519456851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8eac0b1380 msgr2=0x7f8eac0c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:55.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.951+0000 7f8eab400640 1 --2- 172.21.15.114:0/2519456851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8eac0b1380 0x7f8eac0c6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:55.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.951+0000 7f8eab400640 1 -- 172.21.15.114:0/2519456851 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c009420 con 0x7f8eac15ff80 2024-09-13T17:52:55.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.951+0000 7f8eab400640 1 --2- 172.21.15.114:0/2519456851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8eac15ff80 0x7f8eac0aeff0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8ea401af90 tx=0x7f8ea4019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:55.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.951+0000 7f8ea3400640 1 -- 172.21.15.114:0/2519456851 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40adce0 con 0x7f8eac15ff80 2024-09-13T17:52:55.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.951+0000 7f8ea3400640 1 -- 172.21.15.114:0/2519456851 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea40ade40 con 0x7f8eac15ff80 2024-09-13T17:52:55.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.951+0000 7f8ea3400640 1 -- 172.21.15.114:0/2519456851 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40b9670 con 0x7f8eac15ff80 2024-09-13T17:52:55.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.951+0000 7f8eb1e00640 1 -- 172.21.15.114:0/2519456851 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea4009a70 con 0x7f8eac15ff80 2024-09-13T17:52:55.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.951+0000 7f8eb1e00640 1 -- 172.21.15.114:0/2519456851 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eac0cc820 con 0x7f8eac15ff80 2024-09-13T17:52:55.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.951+0000 7f8eb1e00640 1 -- 172.21.15.114:0/2519456851 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eac099c90 con 0x7f8eac15ff80 2024-09-13T17:52:55.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.951+0000 7f8ea3400640 1 -- 172.21.15.114:0/2519456851 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8ea40b97d0 con 0x7f8eac15ff80 2024-09-13T17:52:55.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.951+0000 7f8ea3400640 1 --2- 172.21.15.114:0/2519456851 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8e8c0666c0 0x7f8e8c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:55.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.951+0000 7f8ea3400640 1 -- 172.21.15.114:0/2519456851 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8ea411fa00 con 0x7f8eac15ff80 2024-09-13T17:52:55.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.951+0000 7f8eaaa00640 1 --2- 172.21.15.114:0/2519456851 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8e8c0666c0 0x7f8e8c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:55.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.955+0000 7f8eaaa00640 1 --2- 172.21.15.114:0/2519456851 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8e8c0666c0 0x7f8e8c068b80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c009c50 tx=0x7f8e9c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:55.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:55.955+0000 7f8ea3400640 1 -- 172.21.15.114:0/2519456851 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8ea40eca60 con 0x7f8eac15ff80 2024-09-13T17:52:56.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.147+0000 7f8eb1e00640 1 -- 172.21.15.114:0/2519456851 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8eac0cca10 con 0x7f8eac15ff80 2024-09-13T17:52:56.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.147+0000 7f8ea3400640 1 -- 172.21.15.114:0/2519456851 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4739 (secure 0 0 0) 0x7f8ea4009450 con 0x7f8eac15ff80 2024-09-13T17:52:56.153 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:56.154 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/534634081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":534634081},{"type":"v1","addr":"172.21.15.134:6835","nonce":534634081}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/1773366615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1773366615},{"type":"v1","addr":"172.21.15.114:6836","nonce":1773366615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/4122490085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":4122490085},{"type":"v1","addr":"172.21.15.114:6837","nonce":4122490085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:51:49.789079+0000","modified":"2024-09-13T17:52:13.041461+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6834/1863104078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1863104078},{"type":"v1","addr":"172.21.15.134:6834","nonce":1863104078}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T17:52:56.154 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 9 2024-09-13T17:52:56.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.151+0000 7f8eb1e00640 1 -- 172.21.15.114:0/2519456851 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8e8c0666c0 msgr2=0x7f8e8c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:56.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.151+0000 7f8eb1e00640 1 --2- 172.21.15.114:0/2519456851 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8e8c0666c0 0x7f8e8c068b80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c009c50 tx=0x7f8e9c009190 comp rx=0 tx=0).stop 2024-09-13T17:52:56.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.151+0000 7f8eb1e00640 1 -- 172.21.15.114:0/2519456851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8eac15ff80 msgr2=0x7f8eac0aeff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:56.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.151+0000 7f8eb1e00640 1 --2- 172.21.15.114:0/2519456851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8eac15ff80 0x7f8eac0aeff0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8ea401af90 tx=0x7f8ea4019680 comp rx=0 tx=0).stop 2024-09-13T17:52:56.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.151+0000 7f8eb1e00640 1 -- 172.21.15.114:0/2519456851 shutdown_connections 2024-09-13T17:52:56.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.151+0000 7f8eb1e00640 1 --2- 172.21.15.114:0/2519456851 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8e8c0666c0 0x7f8e8c068b80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:56.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.151+0000 7f8eb1e00640 1 --2- 172.21.15.114:0/2519456851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8eac15ff80 0x7f8eac0aeff0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:56.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.151+0000 7f8eb1e00640 1 --2- 172.21.15.114:0/2519456851 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8eac0d00d0 0x7f8eac0cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:56.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.151+0000 7f8eb1e00640 1 --2- 172.21.15.114:0/2519456851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8eac0b1380 0x7f8eac0c6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:56.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.151+0000 7f8eb1e00640 1 -- 172.21.15.114:0/2519456851 >> 172.21.15.114:0/2519456851 conn(0x7f8eac0d04d0 msgr2=0x7f8eac0ad5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:56.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.151+0000 7f8eb1e00640 1 -- 172.21.15.114:0/2519456851 shutdown_connections 2024-09-13T17:52:56.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.151+0000 7f8eb1e00640 1 -- 172.21.15.114:0/2519456851 wait complete. 2024-09-13T17:52:56.176 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:52:56.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.307+0000 7fa3adc00640 1 Processor -- start 2024-09-13T17:52:56.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.307+0000 7fa3adc00640 1 -- start start 2024-09-13T17:52:56.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.307+0000 7fa3adc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa3a813f420 0x7fa3a806d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:56.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.307+0000 7fa3adc00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa3a806da90 0x7fa3a80cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:56.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.307+0000 7fa3adc00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a80cd220 con 0x7fa3a813c240 2024-09-13T17:52:56.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.307+0000 7fa3adc00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a806df40 con 0x7fa3a813f420 2024-09-13T17:52:56.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.307+0000 7fa3adc00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a815a740 con 0x7fa3a806da90 2024-09-13T17:52:56.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.307+0000 7fa3a6000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa3a813f420 0x7fa3a806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:56.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.311+0000 7fa3a6000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa3a813f420 0x7fa3a806d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42630/0 (socket says 172.21.15.114:42630) 2024-09-13T17:52:56.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.311+0000 7fa3a6000640 1 -- 172.21.15.114:0/1194770996 learned_addr learned my addr 172.21.15.114:0/1194770996 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:56.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.311+0000 7fa3a7400640 1 --2- 172.21.15.114:0/1194770996 >> v2:172.21.15.134:3300/0 conn(0x7fa3a806da90 0x7fa3a80cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:56.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.311+0000 7fa3a6000640 1 -- 172.21.15.114:0/1194770996 >> v2:172.21.15.134:3300/0 conn(0x7fa3a806da90 msgr2=0x7fa3a80cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:56.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.311+0000 7fa3a6000640 1 --2- 172.21.15.114:0/1194770996 >> v2:172.21.15.134:3300/0 conn(0x7fa3a806da90 0x7fa3a80cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:56.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.311+0000 7fa3a6000640 1 -- 172.21.15.114:0/1194770996 >> v1:172.21.15.134:6789/0 conn(0x7fa3a813c240 legacy=0x7fa3a813c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:56.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.311+0000 7fa3a6000640 1 -- 172.21.15.114:0/1194770996 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a8159bc0 con 0x7fa3a813f420 2024-09-13T17:52:56.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.311+0000 7fa3a6000640 1 --2- 172.21.15.114:0/1194770996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3a813f420 0x7fa3a806d550 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa3a80cc4f0 tx=0x7fa39401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197ed7efc72a972e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:56.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.311+0000 7fa3a5600640 1 -- 172.21.15.114:0/1194770996 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3940aa610 con 0x7fa3a813f420 2024-09-13T17:52:56.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.311+0000 7fa3a5600640 1 -- 172.21.15.114:0/1194770996 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3940a6040 con 0x7fa3a813f420 2024-09-13T17:52:56.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.311+0000 7fa3a5600640 1 -- 172.21.15.114:0/1194770996 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3940aa990 con 0x7fa3a813f420 2024-09-13T17:52:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa3adc00640 1 -- 172.21.15.114:0/1194770996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3a813f420 msgr2=0x7fa3a806d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa3adc00640 1 --2- 172.21.15.114:0/1194770996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3a813f420 0x7fa3a806d550 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa3a80cc4f0 tx=0x7fa39401c4b0 comp rx=0 tx=0).stop 2024-09-13T17:52:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa3adc00640 1 -- 172.21.15.114:0/1194770996 shutdown_connections 2024-09-13T17:52:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa3adc00640 1 --2- 172.21.15.114:0/1194770996 >> v2:172.21.15.134:3300/0 conn(0x7fa3a806da90 0x7fa3a80cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa3adc00640 1 --2- 172.21.15.114:0/1194770996 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3a813f420 0x7fa3a806d550 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa3adc00640 1 -- 172.21.15.114:0/1194770996 >> 172.21.15.114:0/1194770996 conn(0x7fa3a80660b0 msgr2=0x7fa3a8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa3adc00640 1 -- 172.21.15.114:0/1194770996 shutdown_connections 2024-09-13T17:52:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa3adc00640 1 -- 172.21.15.114:0/1194770996 wait complete. 2024-09-13T17:52:56.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa3adc00640 1 Processor -- start 2024-09-13T17:52:56.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa3adc00640 1 -- start start 2024-09-13T17:52:56.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa3adc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3a806da90 0x7fa3a8152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:56.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa3adc00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3a813c240 0x7fa3a813d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:56.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa3adc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3a813f420 0x7fa3a813ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:56.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa3adc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a80ae180 con 0x7fa3a806da90 2024-09-13T17:52:56.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa3adc00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a80ac5a0 con 0x7fa3a813c240 2024-09-13T17:52:56.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa3adc00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a80ae3d0 con 0x7fa3a813f420 2024-09-13T17:52:56.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa3a6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3a806da90 0x7fa3a8152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:56.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa3a6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3a806da90 0x7fa3a8152560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42632/0 (socket says 172.21.15.114:42632) 2024-09-13T17:52:56.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa3a6a00640 1 -- 172.21.15.114:0/743756581 learned_addr learned my addr 172.21.15.114:0/743756581 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:56.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa3a7400640 1 --2- 172.21.15.114:0/743756581 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3a813f420 0x7fa3a813ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:56.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa3a6000640 1 --2- 172.21.15.114:0/743756581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3a813c240 0x7fa3a813d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:56.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa3a6a00640 1 -- 172.21.15.114:0/743756581 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3a813f420 msgr2=0x7fa3a813ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:56.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa3a6a00640 1 --2- 172.21.15.114:0/743756581 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3a813f420 0x7fa3a813ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:56.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa3a6a00640 1 -- 172.21.15.114:0/743756581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3a813c240 msgr2=0x7fa3a813d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:56.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa3a6a00640 1 --2- 172.21.15.114:0/743756581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3a813c240 0x7fa3a813d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:56.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa3a6a00640 1 -- 172.21.15.114:0/743756581 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3940094d0 con 0x7fa3a806da90 2024-09-13T17:52:56.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa3a6a00640 1 --2- 172.21.15.114:0/743756581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3a806da90 0x7fa3a8152560 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa39800c450 tx=0x7fa39800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:56.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa39ea00640 1 -- 172.21.15.114:0/743756581 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa398012830 con 0x7fa3a806da90 2024-09-13T17:52:56.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa39ea00640 1 -- 172.21.15.114:0/743756581 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3980129b0 con 0x7fa3a806da90 2024-09-13T17:52:56.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.315+0000 7fa3adc00640 1 -- 172.21.15.114:0/743756581 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a80ae6b0 con 0x7fa3a806da90 2024-09-13T17:52:56.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.319+0000 7fa39ea00640 1 -- 172.21.15.114:0/743756581 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa398012d60 con 0x7fa3a806da90 2024-09-13T17:52:56.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.319+0000 7fa3adc00640 1 -- 172.21.15.114:0/743756581 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a8152aa0 con 0x7fa3a806da90 2024-09-13T17:52:56.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.319+0000 7fa3adc00640 1 -- 172.21.15.114:0/743756581 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a8159790 con 0x7fa3a806da90 2024-09-13T17:52:56.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.319+0000 7fa39ea00640 1 -- 172.21.15.114:0/743756581 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa39801c460 con 0x7fa3a806da90 2024-09-13T17:52:56.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.319+0000 7fa39ea00640 1 --2- 172.21.15.114:0/743756581 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa388066690 0x7fa388068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:56.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.319+0000 7fa39ea00640 1 -- 172.21.15.114:0/743756581 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa3980842b0 con 0x7fa3a806da90 2024-09-13T17:52:56.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.319+0000 7fa3a6000640 1 --2- 172.21.15.114:0/743756581 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa388066690 0x7fa388068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:56.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.319+0000 7fa3a6000640 1 --2- 172.21.15.114:0/743756581 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa388066690 0x7fa388068b50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa3940ae000 tx=0x7fa3940b5040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:56.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.323+0000 7fa39ea00640 1 -- 172.21.15.114:0/743756581 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa398051300 con 0x7fa3a806da90 2024-09-13T17:52:56.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.479+0000 7fa3adc00640 1 -- 172.21.15.114:0/743756581 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3a813b670 con 0x7fa3a806da90 2024-09-13T17:52:56.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.479+0000 7fa39ea00640 1 -- 172.21.15.114:0/743756581 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18784 (secure 0 0 0) 0x7fa398054920 con 0x7fa3a806da90 2024-09-13T17:52:56.485 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:52:56.485 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":26,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:52:31.139000+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:51:48.278220+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T17:51:48.773888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T17:51:51.856300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:52:56.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.483+0000 7fa3adc00640 1 -- 172.21.15.114:0/743756581 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa388066690 msgr2=0x7fa388068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:56.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.483+0000 7fa3adc00640 1 --2- 172.21.15.114:0/743756581 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa388066690 0x7fa388068b50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa3940ae000 tx=0x7fa3940b5040 comp rx=0 tx=0).stop 2024-09-13T17:52:56.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.483+0000 7fa3adc00640 1 -- 172.21.15.114:0/743756581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3a806da90 msgr2=0x7fa3a8152560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:56.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.483+0000 7fa3adc00640 1 --2- 172.21.15.114:0/743756581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3a806da90 0x7fa3a8152560 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa39800c450 tx=0x7fa39800c910 comp rx=0 tx=0).stop 2024-09-13T17:52:56.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.483+0000 7fa3adc00640 1 -- 172.21.15.114:0/743756581 shutdown_connections 2024-09-13T17:52:56.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.483+0000 7fa3adc00640 1 --2- 172.21.15.114:0/743756581 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa388066690 0x7fa388068b50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:56.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.483+0000 7fa3adc00640 1 --2- 172.21.15.114:0/743756581 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa3a813f420 0x7fa3a813ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:56.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.483+0000 7fa3adc00640 1 --2- 172.21.15.114:0/743756581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3a813c240 0x7fa3a813d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:56.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.483+0000 7fa3adc00640 1 --2- 172.21.15.114:0/743756581 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa3a806da90 0x7fa3a8152560 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:56.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.483+0000 7fa3adc00640 1 -- 172.21.15.114:0/743756581 >> 172.21.15.114:0/743756581 conn(0x7fa3a80660b0 msgr2=0x7fa3a8157f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:56.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.483+0000 7fa3adc00640 1 -- 172.21.15.114:0/743756581 shutdown_connections 2024-09-13T17:52:56.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.483+0000 7fa3adc00640 1 -- 172.21.15.114:0/743756581 wait complete. 2024-09-13T17:52:56.507 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T17:52:56.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.639+0000 7f88e4200640 1 Processor -- start 2024-09-13T17:52:56.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.639+0000 7f88e4200640 1 -- start start 2024-09-13T17:52:56.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.639+0000 7f88e4200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88dc13c240 0x7f88dc13f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:56.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.639+0000 7f88e4200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f88dc06dc60 0x7f88dc0cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:56.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.643+0000 7f88e4200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88dc0cd220 con 0x7f88dc13c980 2024-09-13T17:52:56.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.643+0000 7f88e4200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88dc13f960 con 0x7f88dc06dc60 2024-09-13T17:52:56.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.643+0000 7f88e4200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc15a740 con 0x7f88dc13c240 2024-09-13T17:52:56.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.643+0000 7f88e2200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f88dc06dc60 0x7f88dc0cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:56.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.643+0000 7f88e2200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f88dc06dc60 0x7f88dc0cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42646/0 (socket says 172.21.15.114:42646) 2024-09-13T17:52:56.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.643+0000 7f88e2200640 1 -- 172.21.15.114:0/397312235 learned_addr learned my addr 172.21.15.114:0/397312235 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:56.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.643+0000 7f88e1800640 1 --2- 172.21.15.114:0/397312235 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88dc13c240 0x7f88dc13f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:56.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.643+0000 7f88e2200640 1 -- 172.21.15.114:0/397312235 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88dc13c240 msgr2=0x7f88dc13f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:56.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.643+0000 7f88e2200640 1 --2- 172.21.15.114:0/397312235 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88dc13c240 0x7f88dc13f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:56.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.643+0000 7f88e2200640 1 -- 172.21.15.114:0/397312235 >> v1:172.21.15.114:6789/0 conn(0x7f88dc13c980 legacy=0x7f88dc06d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:56.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.643+0000 7f88e2200640 1 -- 172.21.15.114:0/397312235 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc159bc0 con 0x7f88dc06dc60 2024-09-13T17:52:56.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.643+0000 7f88e2200640 1 --2- 172.21.15.114:0/397312235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88dc06dc60 0x7f88dc0cd650 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f88d4009e50 tx=0x7f88d401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a286f6750b23d0b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:56.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.647+0000 7f88dbe00640 1 -- 172.21.15.114:0/397312235 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d40a58d0 con 0x7f88dc06dc60 2024-09-13T17:52:56.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.647+0000 7f88dbe00640 1 -- 172.21.15.114:0/397312235 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d40a5a30 con 0x7f88dc06dc60 2024-09-13T17:52:56.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.647+0000 7f88dbe00640 1 -- 172.21.15.114:0/397312235 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d40a5dc0 con 0x7f88dc06dc60 2024-09-13T17:52:56.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.647+0000 7f88e4200640 1 -- 172.21.15.114:0/397312235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88dc06dc60 msgr2=0x7f88dc0cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:56.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.647+0000 7f88e4200640 1 --2- 172.21.15.114:0/397312235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88dc06dc60 0x7f88dc0cd650 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f88d4009e50 tx=0x7f88d401ca00 comp rx=0 tx=0).stop 2024-09-13T17:52:56.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.647+0000 7f88e4200640 1 -- 172.21.15.114:0/397312235 shutdown_connections 2024-09-13T17:52:56.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.647+0000 7f88e4200640 1 --2- 172.21.15.114:0/397312235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88dc06dc60 0x7f88dc0cd650 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:56.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.647+0000 7f88e4200640 1 --2- 172.21.15.114:0/397312235 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88dc13c240 0x7f88dc13f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:56.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.647+0000 7f88e4200640 1 -- 172.21.15.114:0/397312235 >> 172.21.15.114:0/397312235 conn(0x7f88dc0660b0 msgr2=0x7f88dc069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:56.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.647+0000 7f88e4200640 1 -- 172.21.15.114:0/397312235 shutdown_connections 2024-09-13T17:52:56.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.647+0000 7f88e4200640 1 -- 172.21.15.114:0/397312235 wait complete. 2024-09-13T17:52:56.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.647+0000 7f88e4200640 1 Processor -- start 2024-09-13T17:52:56.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.647+0000 7f88e4200640 1 -- start start 2024-09-13T17:52:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.647+0000 7f88e4200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88dc06dc60 0x7f88dc153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.647+0000 7f88e4200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88dc13c240 0x7f88dc1f7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.647+0000 7f88e4200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88dc13c980 0x7f88dc1f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.647+0000 7f88e4200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc1537b0 con 0x7f88dc13c240 2024-09-13T17:52:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.647+0000 7f88e4200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc1f8590 con 0x7f88dc13c980 2024-09-13T17:52:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.647+0000 7f88e4200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc1f8870 con 0x7f88dc06dc60 2024-09-13T17:52:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.647+0000 7f88e0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88dc13c240 0x7f88dc1f7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.647+0000 7f88e0e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88dc13c240 0x7f88dc1f7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42650/0 (socket says 172.21.15.114:42650) 2024-09-13T17:52:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.647+0000 7f88e0e00640 1 -- 172.21.15.114:0/1205118747 learned_addr learned my addr 172.21.15.114:0/1205118747 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.647+0000 7f88e2200640 1 --2- 172.21.15.114:0/1205118747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88dc13c980 0x7f88dc1f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.647+0000 7f88e1800640 1 --2- 172.21.15.114:0/1205118747 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88dc06dc60 0x7f88dc153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.651+0000 7f88e0e00640 1 -- 172.21.15.114:0/1205118747 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88dc06dc60 msgr2=0x7f88dc153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:56.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.651+0000 7f88e0e00640 1 --2- 172.21.15.114:0/1205118747 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88dc06dc60 0x7f88dc153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:56.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.651+0000 7f88e0e00640 1 -- 172.21.15.114:0/1205118747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88dc13c980 msgr2=0x7f88dc1f4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:56.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.651+0000 7f88e0e00640 1 --2- 172.21.15.114:0/1205118747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88dc13c980 0x7f88dc1f4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:56.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.651+0000 7f88e0e00640 1 -- 172.21.15.114:0/1205118747 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d4009b30 con 0x7f88dc13c240 2024-09-13T17:52:56.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.651+0000 7f88e0e00640 1 --2- 172.21.15.114:0/1205118747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88dc13c240 0x7f88dc1f7c90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f88c800c3c0 tx=0x7f88c800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:56.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.651+0000 7f88d9600640 1 -- 172.21.15.114:0/1205118747 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c80052d0 con 0x7f88dc13c240 2024-09-13T17:52:56.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.651+0000 7f88d9600640 1 -- 172.21.15.114:0/1205118747 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c8005430 con 0x7f88dc13c240 2024-09-13T17:52:56.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.651+0000 7f88e4200640 1 -- 172.21.15.114:0/1205118747 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88dc1f8b50 con 0x7f88dc13c240 2024-09-13T17:52:56.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.651+0000 7f88d9600640 1 -- 172.21.15.114:0/1205118747 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c8003840 con 0x7f88dc13c240 2024-09-13T17:52:56.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.651+0000 7f88e4200640 1 -- 172.21.15.114:0/1205118747 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88dc1f4a90 con 0x7f88dc13c240 2024-09-13T17:52:56.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.651+0000 7f88e4200640 1 -- 172.21.15.114:0/1205118747 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88dc1f4cb0 con 0x7f88dc13c240 2024-09-13T17:52:56.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.651+0000 7f88d9600640 1 -- 172.21.15.114:0/1205118747 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f88c80039a0 con 0x7f88dc13c240 2024-09-13T17:52:56.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.651+0000 7f88d9600640 1 --2- 172.21.15.114:0/1205118747 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f88bc066690 0x7f88bc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:56.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.651+0000 7f88d9600640 1 -- 172.21.15.114:0/1205118747 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f88c8083a90 con 0x7f88dc13c240 2024-09-13T17:52:56.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.651+0000 7f88e1800640 1 --2- 172.21.15.114:0/1205118747 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f88bc066690 0x7f88bc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:56.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.655+0000 7f88e1800640 1 --2- 172.21.15.114:0/1205118747 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f88bc066690 0x7f88bc068b50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f88d0009b60 tx=0x7f88d0009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:56.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.655+0000 7f88d9600640 1 -- 172.21.15.114:0/1205118747 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f88c8050a60 con 0x7f88dc13c240 2024-09-13T17:52:56.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.843+0000 7f88e4200640 1 -- 172.21.15.114:0/1205118747 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f88dc159790 con 0x7f88dc13c240 2024-09-13T17:52:56.848 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-09-13T17:52:56.843+0000 7f67ad800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:52:56.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.855+0000 7f88d9600640 1 -- 172.21.15.114:0/1205118747 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f88c8054080 con 0x7f88dc13c240 2024-09-13T17:52:56.858 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T17:52:56.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.855+0000 7f88e4200640 1 -- 172.21.15.114:0/1205118747 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f88bc066690 msgr2=0x7f88bc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:56.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.855+0000 7f88e4200640 1 --2- 172.21.15.114:0/1205118747 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f88bc066690 0x7f88bc068b50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f88d0009b60 tx=0x7f88d0009190 comp rx=0 tx=0).stop 2024-09-13T17:52:56.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.855+0000 7f88e4200640 1 -- 172.21.15.114:0/1205118747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88dc13c240 msgr2=0x7f88dc1f7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:56.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.855+0000 7f88e4200640 1 --2- 172.21.15.114:0/1205118747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88dc13c240 0x7f88dc1f7c90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f88c800c3c0 tx=0x7f88c800c880 comp rx=0 tx=0).stop 2024-09-13T17:52:56.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.855+0000 7f88e4200640 1 -- 172.21.15.114:0/1205118747 shutdown_connections 2024-09-13T17:52:56.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.855+0000 7f88e4200640 1 --2- 172.21.15.114:0/1205118747 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f88bc066690 0x7f88bc068b50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:56.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.855+0000 7f88e4200640 1 --2- 172.21.15.114:0/1205118747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f88dc13c980 0x7f88dc1f4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:56.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.855+0000 7f88e4200640 1 --2- 172.21.15.114:0/1205118747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f88dc13c240 0x7f88dc1f7c90 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:56.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.855+0000 7f88e4200640 1 --2- 172.21.15.114:0/1205118747 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f88dc06dc60 0x7f88dc153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:56.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.855+0000 7f88e4200640 1 -- 172.21.15.114:0/1205118747 >> 172.21.15.114:0/1205118747 conn(0x7f88dc0660b0 msgr2=0x7f88dc154550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:56.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.855+0000 7f88e4200640 1 -- 172.21.15.114:0/1205118747 shutdown_connections 2024-09-13T17:52:56.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:56.855+0000 7f88e4200640 1 -- 172.21.15.114:0/1205118747 wait complete. 2024-09-13T17:52:56.868 INFO:tasks.ceph.mds.d.smithi134.stderr: -4994> 2024-09-13T17:51:54.593+0000 7f00c4800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:52:56.879 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T17:52:56.919 INFO:tasks.ceph.mds.d.smithi134.stdout:starting mds.d at 2024-09-13T17:52:57.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.011+0000 7fe23d800640 1 Processor -- start 2024-09-13T17:52:57.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.011+0000 7fe23d800640 1 -- start start 2024-09-13T17:52:57.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.015+0000 7fe23d800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe23813f420 0x7fe23806d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:57.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.015+0000 7fe23d800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2380cd220 con 0x7fe23806da90 2024-09-13T17:52:57.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.015+0000 7fe23d800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe23815a740 con 0x7fe23813c240 2024-09-13T17:52:57.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.015+0000 7fe23d800640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe23806df40 con 0x7fe23813f420 2024-09-13T17:52:57.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.015+0000 7fe237400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe23806da90 0x7fe2380cd650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50150/0 (socket says 172.21.15.114:50150) 2024-09-13T17:52:57.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.015+0000 7fe237400640 1 -- 172.21.15.114:0/819057634 learned_addr learned my addr 172.21.15.114:0/819057634 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:52:57.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.015+0000 7fe22e000640 1 --2- 172.21.15.114:0/819057634 >> v2:172.21.15.134:3300/0 conn(0x7fe23813f420 0x7fe23806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:57.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.015+0000 7fe236000640 1 -- 172.21.15.114:0/819057634 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4164371586 0 0) 0x7fe2380cd220 con 0x7fe23806da90 2024-09-13T17:52:57.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.015+0000 7fe236000640 1 -- 172.21.15.114:0/819057634 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe21c003530 con 0x7fe23806da90 2024-09-13T17:52:57.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.015+0000 7fe236000640 1 -- 172.21.15.114:0/819057634 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1714897565 0 0) 0x7fe23815a740 con 0x7fe23813c240 2024-09-13T17:52:57.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.015+0000 7fe236000640 1 -- 172.21.15.114:0/819057634 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2380cd220 con 0x7fe23813c240 2024-09-13T17:52:57.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.015+0000 7fe22e000640 1 -- 172.21.15.114:0/819057634 >> v1:172.21.15.134:6789/0 conn(0x7fe23813c240 legacy=0x7fe23813c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:57.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.015+0000 7fe22e000640 1 -- 172.21.15.114:0/819057634 >> v1:172.21.15.114:6789/0 conn(0x7fe23806da90 legacy=0x7fe2380cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:57.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.015+0000 7fe22e000640 1 -- 172.21.15.114:0/819057634 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe238159bc0 con 0x7fe23813f420 2024-09-13T17:52:57.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.015+0000 7fe22e000640 1 --2- 172.21.15.114:0/819057634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe23813f420 0x7fe23806d550 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe2200097c0 tx=0x7fe22001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12e497db6fc98cfb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:57.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.019+0000 7fe236000640 1 -- 172.21.15.114:0/819057634 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2200ab670 con 0x7fe23813f420 2024-09-13T17:52:57.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.019+0000 7fe236000640 1 -- 172.21.15.114:0/819057634 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2200ab7d0 con 0x7fe23813f420 2024-09-13T17:52:57.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.019+0000 7fe236000640 1 -- 172.21.15.114:0/819057634 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2200abb60 con 0x7fe23813f420 2024-09-13T17:52:57.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.019+0000 7fe23d800640 1 -- 172.21.15.114:0/819057634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe23813f420 msgr2=0x7fe23806d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:57.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.019+0000 7fe23d800640 1 --2- 172.21.15.114:0/819057634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe23813f420 0x7fe23806d550 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe2200097c0 tx=0x7fe22001c470 comp rx=0 tx=0).stop 2024-09-13T17:52:57.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.019+0000 7fe23d800640 1 -- 172.21.15.114:0/819057634 shutdown_connections 2024-09-13T17:52:57.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.019+0000 7fe23d800640 1 --2- 172.21.15.114:0/819057634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe23813f420 0x7fe23806d550 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:57.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.019+0000 7fe23d800640 1 -- 172.21.15.114:0/819057634 >> 172.21.15.114:0/819057634 conn(0x7fe2380660b0 msgr2=0x7fe238069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:57.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.019+0000 7fe23d800640 1 -- 172.21.15.114:0/819057634 shutdown_connections 2024-09-13T17:52:57.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.019+0000 7fe23d800640 1 -- 172.21.15.114:0/819057634 wait complete. 2024-09-13T17:52:57.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.019+0000 7fe23d800640 1 Processor -- start 2024-09-13T17:52:57.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.019+0000 7fe23d800640 1 -- start start 2024-09-13T17:52:57.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.019+0000 7fe23d800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe23806da90 0x7fe238155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:57.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.019+0000 7fe23d800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe23813c240 0x7fe238156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:57.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.019+0000 7fe23d800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe23813f420 0x7fe23814e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:57.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.019+0000 7fe23d800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe238156ad0 con 0x7fe23813f420 2024-09-13T17:52:57.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.019+0000 7fe23d800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2380ae320 con 0x7fe23813c240 2024-09-13T17:52:57.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.019+0000 7fe23d800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2380ae600 con 0x7fe23806da90 2024-09-13T17:52:57.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.019+0000 7fe237400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe23813f420 0x7fe23814e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:57.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.019+0000 7fe237400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe23813f420 0x7fe23814e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42666/0 (socket says 172.21.15.114:42666) 2024-09-13T17:52:57.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.019+0000 7fe237400640 1 -- 172.21.15.114:0/4131030451 learned_addr learned my addr 172.21.15.114:0/4131030451 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:57.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.019+0000 7fe22e000640 1 --2- 172.21.15.114:0/4131030451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe23813c240 0x7fe238156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:57.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.019+0000 7fe236a00640 1 --2- 172.21.15.114:0/4131030451 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe23806da90 0x7fe238155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:57.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.023+0000 7fe237400640 1 -- 172.21.15.114:0/4131030451 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe23806da90 msgr2=0x7fe238155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:57.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.023+0000 7fe237400640 1 --2- 172.21.15.114:0/4131030451 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe23806da90 0x7fe238155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:57.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.023+0000 7fe237400640 1 -- 172.21.15.114:0/4131030451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe23813c240 msgr2=0x7fe238156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:57.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.023+0000 7fe237400640 1 --2- 172.21.15.114:0/4131030451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe23813c240 0x7fe238156460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:57.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.023+0000 7fe237400640 1 -- 172.21.15.114:0/4131030451 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe220009420 con 0x7fe23813f420 2024-09-13T17:52:57.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.023+0000 7fe236a00640 1 --2- 172.21.15.114:0/4131030451 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe23806da90 0x7fe238155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:57.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.023+0000 7fe237400640 1 --2- 172.21.15.114:0/4131030451 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe23813f420 0x7fe23814e630 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe23000caf0 tx=0x7fe23000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:57.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.023+0000 7fe22f400640 1 -- 172.21.15.114:0/4131030451 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23000aca0 con 0x7fe23813f420 2024-09-13T17:52:57.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.023+0000 7fe22f400640 1 -- 172.21.15.114:0/4131030451 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23000ae00 con 0x7fe23813f420 2024-09-13T17:52:57.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.023+0000 7fe23d800640 1 -- 172.21.15.114:0/4131030451 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe238139a80 con 0x7fe23813f420 2024-09-13T17:52:57.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.023+0000 7fe22f400640 1 -- 172.21.15.114:0/4131030451 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe230012620 con 0x7fe23813f420 2024-09-13T17:52:57.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.023+0000 7fe23d800640 1 -- 172.21.15.114:0/4131030451 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2381570d0 con 0x7fe23813f420 2024-09-13T17:52:57.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.023+0000 7fe23d800640 1 -- 172.21.15.114:0/4131030451 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2380ae160 con 0x7fe23813f420 2024-09-13T17:52:57.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.023+0000 7fe22f400640 1 -- 172.21.15.114:0/4131030451 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe230007070 con 0x7fe23813f420 2024-09-13T17:52:57.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.023+0000 7fe22f400640 1 --2- 172.21.15.114:0/4131030451 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe214066690 0x7fe214068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:57.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.023+0000 7fe22f400640 1 -- 172.21.15.114:0/4131030451 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fe2300843e0 con 0x7fe23813f420 2024-09-13T17:52:57.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.023+0000 7fe236a00640 1 --2- 172.21.15.114:0/4131030451 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe214066690 0x7fe214068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:57.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.027+0000 7fe236a00640 1 --2- 172.21.15.114:0/4131030451 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe214066690 0x7fe214068b50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe2280011f0 tx=0x7fe228009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:57.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.027+0000 7fe22f400640 1 -- 172.21.15.114:0/4131030451 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe230051480 con 0x7fe23813f420 2024-09-13T17:52:57.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.219+0000 7fe23d800640 1 -- 172.21.15.114:0/4131030451 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe2380667b0 con 0x7fe23813f420 2024-09-13T17:52:57.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.855+0000 7fe22f400640 1 -- 172.21.15.114:0/4131030451 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe230054aa0 con 0x7fe23813f420 2024-09-13T17:52:57.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.859+0000 7fe23d800640 1 -- 172.21.15.114:0/4131030451 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe214066690 msgr2=0x7fe214068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:57.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.859+0000 7fe23d800640 1 --2- 172.21.15.114:0/4131030451 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe214066690 0x7fe214068b50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe2280011f0 tx=0x7fe228009040 comp rx=0 tx=0).stop 2024-09-13T17:52:57.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.859+0000 7fe23d800640 1 -- 172.21.15.114:0/4131030451 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe23813f420 msgr2=0x7fe23814e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:57.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.859+0000 7fe23d800640 1 --2- 172.21.15.114:0/4131030451 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe23813f420 0x7fe23814e630 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe23000caf0 tx=0x7fe23000a060 comp rx=0 tx=0).stop 2024-09-13T17:52:57.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.859+0000 7fe23d800640 1 -- 172.21.15.114:0/4131030451 shutdown_connections 2024-09-13T17:52:57.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.859+0000 7fe23d800640 1 --2- 172.21.15.114:0/4131030451 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe214066690 0x7fe214068b50 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:57.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.859+0000 7fe23d800640 1 --2- 172.21.15.114:0/4131030451 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe23813f420 0x7fe23814e630 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:57.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.859+0000 7fe23d800640 1 --2- 172.21.15.114:0/4131030451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe23813c240 0x7fe238156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:57.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.859+0000 7fe23d800640 1 --2- 172.21.15.114:0/4131030451 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe23806da90 0x7fe238155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:57.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.859+0000 7fe23d800640 1 -- 172.21.15.114:0/4131030451 >> 172.21.15.114:0/4131030451 conn(0x7fe2380660b0 msgr2=0x7fe238150b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:57.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.859+0000 7fe23d800640 1 -- 172.21.15.114:0/4131030451 shutdown_connections 2024-09-13T17:52:57.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:57.859+0000 7fe23d800640 1 -- 172.21.15.114:0/4131030451 wait complete. 2024-09-13T17:52:57.883 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T17:52:58.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.019+0000 7f7b6ac00640 1 Processor -- start 2024-09-13T17:52:58.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.019+0000 7f7b6ac00640 1 -- start start 2024-09-13T17:52:58.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.019+0000 7f7b6ac00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7b6415a5c0 0x7f7b6406a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:58.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.019+0000 7f7b6ac00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7b640b50a0 0x7f7b640b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:58.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.019+0000 7f7b6ac00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7b640b0b10 0x7f7b6415dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:58.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.019+0000 7f7b6ac00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b64099140 con 0x7f7b640b50a0 2024-09-13T17:52:58.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.019+0000 7f7b6ac00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b640cff90 con 0x7f7b6415a5c0 2024-09-13T17:52:58.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.019+0000 7f7b6ac00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b640b0fa0 con 0x7f7b640b0b10 2024-09-13T17:52:58.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.019+0000 7f7b63400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7b640b50a0 0x7f7b640b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:58.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.019+0000 7f7b63400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7b640b50a0 0x7f7b640b05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42678/0 (socket says 172.21.15.114:42678) 2024-09-13T17:52:58.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.019+0000 7f7b63400640 1 -- 172.21.15.114:0/2485751968 learned_addr learned my addr 172.21.15.114:0/2485751968 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:58.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.019+0000 7f7b63e00640 1 --2- 172.21.15.114:0/2485751968 >> v2:172.21.15.134:3300/0 conn(0x7f7b6415a5c0 0x7f7b6406a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:58.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.019+0000 7f7b68c00640 1 --2- 172.21.15.114:0/2485751968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7b640b0b10 0x7f7b6415dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:58.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.019+0000 7f7b63400640 1 -- 172.21.15.114:0/2485751968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7b640b0b10 msgr2=0x7f7b6415dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:58.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.019+0000 7f7b63400640 1 --2- 172.21.15.114:0/2485751968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7b640b0b10 0x7f7b6415dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:58.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.019+0000 7f7b63400640 1 -- 172.21.15.114:0/2485751968 >> v2:172.21.15.134:3300/0 conn(0x7f7b6415a5c0 msgr2=0x7f7b6406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:58.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.019+0000 7f7b63400640 1 --2- 172.21.15.114:0/2485751968 >> v2:172.21.15.134:3300/0 conn(0x7f7b6415a5c0 0x7f7b6406a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:58.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.019+0000 7f7b63400640 1 -- 172.21.15.114:0/2485751968 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b640cf380 con 0x7f7b640b50a0 2024-09-13T17:52:58.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.019+0000 7f7b63e00640 1 --2- 172.21.15.114:0/2485751968 >> v2:172.21.15.134:3300/0 conn(0x7f7b6415a5c0 0x7f7b6406a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:58.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.023+0000 7f7b63400640 1 --2- 172.21.15.114:0/2485751968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b640b50a0 0x7f7b640b05d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7b640b4910 tx=0x7f7b5001c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf05e7d89d855b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:58.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.023+0000 7f7b62a00640 1 -- 172.21.15.114:0/2485751968 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b500ab600 con 0x7f7b640b50a0 2024-09-13T17:52:58.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.023+0000 7f7b62a00640 1 -- 172.21.15.114:0/2485751968 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b500a7050 con 0x7f7b640b50a0 2024-09-13T17:52:58.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.023+0000 7f7b62a00640 1 -- 172.21.15.114:0/2485751968 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b500ab980 con 0x7f7b640b50a0 2024-09-13T17:52:58.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.023+0000 7f7b6ac00640 1 -- 172.21.15.114:0/2485751968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b640b50a0 msgr2=0x7f7b640b05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:58.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.023+0000 7f7b6ac00640 1 --2- 172.21.15.114:0/2485751968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b640b50a0 0x7f7b640b05d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7b640b4910 tx=0x7f7b5001c260 comp rx=0 tx=0).stop 2024-09-13T17:52:58.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.023+0000 7f7b6ac00640 1 -- 172.21.15.114:0/2485751968 shutdown_connections 2024-09-13T17:52:58.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.023+0000 7f7b6ac00640 1 --2- 172.21.15.114:0/2485751968 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7b640b0b10 0x7f7b6415dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:58.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.023+0000 7f7b6ac00640 1 --2- 172.21.15.114:0/2485751968 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b640b50a0 0x7f7b640b05d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:58.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.023+0000 7f7b6ac00640 1 --2- 172.21.15.114:0/2485751968 >> v2:172.21.15.134:3300/0 conn(0x7f7b6415a5c0 0x7f7b6406a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:58.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.023+0000 7f7b6ac00640 1 -- 172.21.15.114:0/2485751968 >> 172.21.15.114:0/2485751968 conn(0x7f7b64098a70 msgr2=0x7f7b640b4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:58.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.023+0000 7f7b6ac00640 1 -- 172.21.15.114:0/2485751968 shutdown_connections 2024-09-13T17:52:58.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.023+0000 7f7b6ac00640 1 -- 172.21.15.114:0/2485751968 wait complete. 2024-09-13T17:52:58.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.027+0000 7f7b6ac00640 1 Processor -- start 2024-09-13T17:52:58.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.027+0000 7f7b6ac00640 1 -- start start 2024-09-13T17:52:58.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.027+0000 7f7b6ac00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7b640b0b10 0x7f7b6413f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:58.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.027+0000 7f7b6ac00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b640b50a0 0x7f7b641f9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:58.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.027+0000 7f7b6ac00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b6415a5c0 0x7f7b641518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:58.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.027+0000 7f7b6ac00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b641f9ff0 con 0x7f7b6415a5c0 2024-09-13T17:52:58.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.027+0000 7f7b6ac00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6414ec60 con 0x7f7b640b50a0 2024-09-13T17:52:58.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.027+0000 7f7b6ac00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6415bf80 con 0x7f7b640b0b10 2024-09-13T17:52:58.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.027+0000 7f7b68c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b6415a5c0 0x7f7b641518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:58.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.027+0000 7f7b68c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b6415a5c0 0x7f7b641518d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42680/0 (socket says 172.21.15.114:42680) 2024-09-13T17:52:58.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.027+0000 7f7b68c00640 1 -- 172.21.15.114:0/737656535 learned_addr learned my addr 172.21.15.114:0/737656535 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:58.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.027+0000 7f7b63e00640 1 --2- 172.21.15.114:0/737656535 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7b640b0b10 0x7f7b6413f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:58.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.027+0000 7f7b63400640 1 --2- 172.21.15.114:0/737656535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b640b50a0 0x7f7b641f9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:58.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.027+0000 7f7b68c00640 1 -- 172.21.15.114:0/737656535 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7b640b0b10 msgr2=0x7f7b6413f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:58.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.027+0000 7f7b68c00640 1 --2- 172.21.15.114:0/737656535 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7b640b0b10 0x7f7b6413f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:58.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.027+0000 7f7b68c00640 1 -- 172.21.15.114:0/737656535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b640b50a0 msgr2=0x7f7b641f9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:58.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.027+0000 7f7b68c00640 1 --2- 172.21.15.114:0/737656535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b640b50a0 0x7f7b641f9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:58.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.027+0000 7f7b68c00640 1 -- 172.21.15.114:0/737656535 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b500094d0 con 0x7f7b6415a5c0 2024-09-13T17:52:58.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.027+0000 7f7b63e00640 1 --2- 172.21.15.114:0/737656535 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7b640b0b10 0x7f7b6413f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:58.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.027+0000 7f7b63400640 1 --2- 172.21.15.114:0/737656535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b640b50a0 0x7f7b641f9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:52:58.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.027+0000 7f7b68c00640 1 --2- 172.21.15.114:0/737656535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b6415a5c0 0x7f7b641518d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c007e60 tx=0x7f7b5c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:58.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.027+0000 7f7b5be00640 1 -- 172.21.15.114:0/737656535 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c014620 con 0x7f7b6415a5c0 2024-09-13T17:52:58.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.027+0000 7f7b5be00640 1 -- 172.21.15.114:0/737656535 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5c00ee90 con 0x7f7b6415a5c0 2024-09-13T17:52:58.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.027+0000 7f7b5be00640 1 -- 172.21.15.114:0/737656535 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c0149e0 con 0x7f7b6415a5c0 2024-09-13T17:52:58.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.027+0000 7f7b6ac00640 1 -- 172.21.15.114:0/737656535 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b641f9750 con 0x7f7b6415a5c0 2024-09-13T17:52:58.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.027+0000 7f7b6ac00640 1 -- 172.21.15.114:0/737656535 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b641f9d10 con 0x7f7b6415a5c0 2024-09-13T17:52:58.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.031+0000 7f7b6ac00640 1 -- 172.21.15.114:0/737656535 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b640ad1e0 con 0x7f7b6415a5c0 2024-09-13T17:52:58.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.031+0000 7f7b5be00640 1 -- 172.21.15.114:0/737656535 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7b5c014b40 con 0x7f7b6415a5c0 2024-09-13T17:52:58.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.031+0000 7f7b5be00640 1 --2- 172.21.15.114:0/737656535 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7b44066690 0x7f7b44068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:58.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.031+0000 7f7b5be00640 1 -- 172.21.15.114:0/737656535 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f7b5c084f50 con 0x7f7b6415a5c0 2024-09-13T17:52:58.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.031+0000 7f7b63e00640 1 --2- 172.21.15.114:0/737656535 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7b44066690 0x7f7b44068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:58.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.031+0000 7f7b63e00640 1 --2- 172.21.15.114:0/737656535 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7b44066690 0x7f7b44068b50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400b990 tx=0x7f7b54008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:58.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.035+0000 7f7b5be00640 1 -- 172.21.15.114:0/737656535 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7b5c051e10 con 0x7f7b6415a5c0 2024-09-13T17:52:58.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.191+0000 7f7b6ac00640 1 -- 172.21.15.114:0/737656535 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7b6406ac80 con 0x7f7b6415a5c0 2024-09-13T17:52:58.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.859+0000 7f7b5be00640 1 -- 172.21.15.114:0/737656535 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7b5c055430 con 0x7f7b6415a5c0 2024-09-13T17:52:58.865 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2024-09-13T17:52:58.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.863+0000 7f7b6ac00640 1 -- 172.21.15.114:0/737656535 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7b44066690 msgr2=0x7f7b44068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:58.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.863+0000 7f7b6ac00640 1 --2- 172.21.15.114:0/737656535 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7b44066690 0x7f7b44068b50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400b990 tx=0x7f7b54008040 comp rx=0 tx=0).stop 2024-09-13T17:52:58.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.863+0000 7f7b6ac00640 1 -- 172.21.15.114:0/737656535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b6415a5c0 msgr2=0x7f7b641518d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:58.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.863+0000 7f7b6ac00640 1 --2- 172.21.15.114:0/737656535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b6415a5c0 0x7f7b641518d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c007e60 tx=0x7f7b5c00e4b0 comp rx=0 tx=0).stop 2024-09-13T17:52:58.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.863+0000 7f7b6ac00640 1 -- 172.21.15.114:0/737656535 shutdown_connections 2024-09-13T17:52:58.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.863+0000 7f7b6ac00640 1 --2- 172.21.15.114:0/737656535 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7b44066690 0x7f7b44068b50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:58.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.863+0000 7f7b6ac00640 1 --2- 172.21.15.114:0/737656535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b6415a5c0 0x7f7b641518d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:58.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.863+0000 7f7b6ac00640 1 --2- 172.21.15.114:0/737656535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b640b50a0 0x7f7b641f9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:58.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.863+0000 7f7b6ac00640 1 --2- 172.21.15.114:0/737656535 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7b640b0b10 0x7f7b6413f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:58.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.863+0000 7f7b6ac00640 1 -- 172.21.15.114:0/737656535 >> 172.21.15.114:0/737656535 conn(0x7f7b64098a70 msgr2=0x7f7b6406ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:58.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.863+0000 7f7b6ac00640 1 -- 172.21.15.114:0/737656535 shutdown_connections 2024-09-13T17:52:58.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:58.863+0000 7f7b6ac00640 1 -- 172.21.15.114:0/737656535 wait complete. 2024-09-13T17:52:58.890 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T17:52:59.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.031+0000 7fe0bec00640 1 Processor -- start 2024-09-13T17:52:59.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.031+0000 7fe0bec00640 1 -- start start 2024-09-13T17:52:59.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.031+0000 7fe0bec00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0b8158a70 0x7fe0b8070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:59.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.031+0000 7fe0bec00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe0b8159be0 0x7fe0b80711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:59.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.031+0000 7fe0bec00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b80b2490 con 0x7fe0b80b1510 2024-09-13T17:52:59.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.031+0000 7fe0bec00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b8158e50 con 0x7fe0b8159be0 2024-09-13T17:52:59.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.031+0000 7fe0bec00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b80b21b0 con 0x7fe0b8158a70 2024-09-13T17:52:59.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.031+0000 7fe0b7400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe0b8159be0 0x7fe0b80711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:59.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.031+0000 7fe0b7400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe0b8159be0 0x7fe0b80711f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42686/0 (socket says 172.21.15.114:42686) 2024-09-13T17:52:59.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.031+0000 7fe0b7400640 1 -- 172.21.15.114:0/163192583 learned_addr learned my addr 172.21.15.114:0/163192583 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:59.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.031+0000 7fe0b7e00640 1 --2- 172.21.15.114:0/163192583 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0b8158a70 0x7fe0b8070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:59.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.031+0000 7fe0b7400640 1 -- 172.21.15.114:0/163192583 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0b8158a70 msgr2=0x7fe0b8070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:52:59.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.031+0000 7fe0b7400640 1 --2- 172.21.15.114:0/163192583 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0b8158a70 0x7fe0b8070cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:59.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.031+0000 7fe0b7400640 1 -- 172.21.15.114:0/163192583 >> v1:172.21.15.114:6789/0 conn(0x7fe0b80b1510 legacy=0x7fe0b80b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:59.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.031+0000 7fe0b7400640 1 -- 172.21.15.114:0/163192583 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b8159100 con 0x7fe0b8159be0 2024-09-13T17:52:59.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.035+0000 7fe0b7400640 1 --2- 172.21.15.114:0/163192583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0b8159be0 0x7fe0b80711f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4009870 tx=0x7fe0a401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20f62b9b7fa298b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:59.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.035+0000 7fe0b6a00640 1 -- 172.21.15.114:0/163192583 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a40ab620 con 0x7fe0b8159be0 2024-09-13T17:52:59.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.035+0000 7fe0b6a00640 1 -- 172.21.15.114:0/163192583 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a40ab780 con 0x7fe0b8159be0 2024-09-13T17:52:59.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.035+0000 7fe0b6a00640 1 -- 172.21.15.114:0/163192583 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a40abb10 con 0x7fe0b8159be0 2024-09-13T17:52:59.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.035+0000 7fe0bec00640 1 -- 172.21.15.114:0/163192583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0b8159be0 msgr2=0x7fe0b80711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:59.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.035+0000 7fe0bec00640 1 --2- 172.21.15.114:0/163192583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0b8159be0 0x7fe0b80711f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4009870 tx=0x7fe0a401c4a0 comp rx=0 tx=0).stop 2024-09-13T17:52:59.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.035+0000 7fe0bec00640 1 -- 172.21.15.114:0/163192583 shutdown_connections 2024-09-13T17:52:59.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.035+0000 7fe0bec00640 1 --2- 172.21.15.114:0/163192583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0b8159be0 0x7fe0b80711f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:59.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.035+0000 7fe0bec00640 1 --2- 172.21.15.114:0/163192583 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0b8158a70 0x7fe0b8070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:59.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.035+0000 7fe0bec00640 1 -- 172.21.15.114:0/163192583 >> 172.21.15.114:0/163192583 conn(0x7fe0b80660b0 msgr2=0x7fe0b8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:59.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.035+0000 7fe0bec00640 1 -- 172.21.15.114:0/163192583 shutdown_connections 2024-09-13T17:52:59.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.035+0000 7fe0bec00640 1 -- 172.21.15.114:0/163192583 wait complete. 2024-09-13T17:52:59.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.039+0000 7fe0bec00640 1 Processor -- start 2024-09-13T17:52:59.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.039+0000 7fe0bec00640 1 -- start start 2024-09-13T17:52:59.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.039+0000 7fe0bec00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0b80b1510 0x7fe0b814ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:59.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.039+0000 7fe0bec00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0b8158a70 0x7fe0b8154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:59.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.039+0000 7fe0bec00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0b8159be0 0x7fe0b8141990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:59.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.039+0000 7fe0bec00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b8150c30 con 0x7fe0b8159be0 2024-09-13T17:52:59.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.039+0000 7fe0bec00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b80ae880 con 0x7fe0b8158a70 2024-09-13T17:52:59.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.039+0000 7fe0bec00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b8155280 con 0x7fe0b80b1510 2024-09-13T17:52:59.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.039+0000 7fe0bcc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0b8159be0 0x7fe0b8141990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:59.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.039+0000 7fe0bcc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0b8159be0 0x7fe0b8141990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42692/0 (socket says 172.21.15.114:42692) 2024-09-13T17:52:59.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.039+0000 7fe0bcc00640 1 -- 172.21.15.114:0/2034160824 learned_addr learned my addr 172.21.15.114:0/2034160824 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:52:59.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.039+0000 7fe0b7e00640 1 --2- 172.21.15.114:0/2034160824 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0b80b1510 0x7fe0b814ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:59.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.039+0000 7fe0b7400640 1 --2- 172.21.15.114:0/2034160824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0b8158a70 0x7fe0b8154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:59.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.039+0000 7fe0bcc00640 1 -- 172.21.15.114:0/2034160824 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0b80b1510 msgr2=0x7fe0b814ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:59.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.039+0000 7fe0bcc00640 1 --2- 172.21.15.114:0/2034160824 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0b80b1510 0x7fe0b814ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:59.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.039+0000 7fe0bcc00640 1 -- 172.21.15.114:0/2034160824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0b8158a70 msgr2=0x7fe0b8154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:59.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.039+0000 7fe0bcc00640 1 --2- 172.21.15.114:0/2034160824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0b8158a70 0x7fe0b8154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:59.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.039+0000 7fe0bcc00640 1 -- 172.21.15.114:0/2034160824 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a40094d0 con 0x7fe0b8159be0 2024-09-13T17:52:59.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.039+0000 7fe0bcc00640 1 --2- 172.21.15.114:0/2034160824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0b8159be0 0x7fe0b8141990 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000c7a0 tx=0x7fe0b000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:59.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.039+0000 7fe0afe00640 1 -- 172.21.15.114:0/2034160824 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0003b80 con 0x7fe0b8159be0 2024-09-13T17:52:59.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.039+0000 7fe0afe00640 1 -- 172.21.15.114:0/2034160824 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b0003ce0 con 0x7fe0b8159be0 2024-09-13T17:52:59.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.039+0000 7fe0afe00640 1 -- 172.21.15.114:0/2034160824 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b000aa90 con 0x7fe0b8159be0 2024-09-13T17:52:59.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.039+0000 7fe0bec00640 1 -- 172.21.15.114:0/2034160824 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b8150670 con 0x7fe0b8159be0 2024-09-13T17:52:59.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.039+0000 7fe0bec00640 1 -- 172.21.15.114:0/2034160824 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b80ae510 con 0x7fe0b8159be0 2024-09-13T17:52:59.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.043+0000 7fe0bec00640 1 -- 172.21.15.114:0/2034160824 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b80b19a0 con 0x7fe0b8159be0 2024-09-13T17:52:59.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.043+0000 7fe0afe00640 1 -- 172.21.15.114:0/2034160824 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe0b000abf0 con 0x7fe0b8159be0 2024-09-13T17:52:59.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.043+0000 7fe0afe00640 1 --2- 172.21.15.114:0/2034160824 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe098066690 0x7fe098068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:52:59.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.043+0000 7fe0afe00640 1 -- 172.21.15.114:0/2034160824 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6311+0+0 (secure 0 0 0) 0x7fe0b0084130 con 0x7fe0b8159be0 2024-09-13T17:52:59.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.043+0000 7fe0b7e00640 1 --2- 172.21.15.114:0/2034160824 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe098066690 0x7fe098068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:52:59.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.043+0000 7fe0b7e00640 1 --2- 172.21.15.114:0/2034160824 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe098066690 0x7fe098068b50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009b60 tx=0x7fe0a8009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:52:59.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.047+0000 7fe0afe00640 1 -- 172.21.15.114:0/2034160824 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe0b00512e0 con 0x7fe0b8159be0 2024-09-13T17:52:59.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.199+0000 7fe0bec00640 1 -- 172.21.15.114:0/2034160824 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe0b80ae9c0 con 0x7fe0b8159be0 2024-09-13T17:52:59.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.867+0000 7fe0afe00640 1 -- 172.21.15.114:0/2034160824 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe0b0054900 con 0x7fe0b8159be0 2024-09-13T17:52:59.873 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2024-09-13T17:52:59.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.871+0000 7fe0bec00640 1 -- 172.21.15.114:0/2034160824 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe098066690 msgr2=0x7fe098068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:59.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.871+0000 7fe0bec00640 1 --2- 172.21.15.114:0/2034160824 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe098066690 0x7fe098068b50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009b60 tx=0x7fe0a8009190 comp rx=0 tx=0).stop 2024-09-13T17:52:59.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.871+0000 7fe0bec00640 1 -- 172.21.15.114:0/2034160824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0b8159be0 msgr2=0x7fe0b8141990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:52:59.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.871+0000 7fe0bec00640 1 --2- 172.21.15.114:0/2034160824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0b8159be0 0x7fe0b8141990 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000c7a0 tx=0x7fe0b000cc60 comp rx=0 tx=0).stop 2024-09-13T17:52:59.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.875+0000 7fe0bec00640 1 -- 172.21.15.114:0/2034160824 shutdown_connections 2024-09-13T17:52:59.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.875+0000 7fe0bec00640 1 --2- 172.21.15.114:0/2034160824 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe098066690 0x7fe098068b50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:59.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.875+0000 7fe0bec00640 1 --2- 172.21.15.114:0/2034160824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0b8159be0 0x7fe0b8141990 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:59.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.875+0000 7fe0bec00640 1 --2- 172.21.15.114:0/2034160824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0b8158a70 0x7fe0b8154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:59.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.875+0000 7fe0bec00640 1 --2- 172.21.15.114:0/2034160824 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe0b80b1510 0x7fe0b814ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:52:59.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.875+0000 7fe0bec00640 1 -- 172.21.15.114:0/2034160824 >> 172.21.15.114:0/2034160824 conn(0x7fe0b80660b0 msgr2=0x7fe0b8157120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:52:59.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.875+0000 7fe0bec00640 1 -- 172.21.15.114:0/2034160824 shutdown_connections 2024-09-13T17:52:59.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:52:59.875+0000 7fe0bec00640 1 -- 172.21.15.114:0/2034160824 wait complete. 2024-09-13T17:52:59.904 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-13T17:53:00.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.043+0000 7f6513a00640 1 Processor -- start 2024-09-13T17:53:00.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.043+0000 7f6513a00640 1 -- start start 2024-09-13T17:53:00.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.043+0000 7f6513a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f650c13c240 0x7f650c13f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:00.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.043+0000 7f6513a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f650c06dc60 0x7f650c0cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:00.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.043+0000 7f6513a00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f650c0cd220 con 0x7f650c13c980 2024-09-13T17:53:00.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.043+0000 7f6513a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f650c13f960 con 0x7f650c13c240 2024-09-13T17:53:00.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.043+0000 7f6513a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650c15a740 con 0x7f650c06dc60 2024-09-13T17:53:00.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.043+0000 7f6511000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f650c13c240 0x7f650c13f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:00.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.043+0000 7f6511000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f650c13c240 0x7f650c13f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42706/0 (socket says 172.21.15.114:42706) 2024-09-13T17:53:00.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.043+0000 7f6511000640 1 -- 172.21.15.114:0/1356348867 learned_addr learned my addr 172.21.15.114:0/1356348867 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:00.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.043+0000 7f6511a00640 1 --2- 172.21.15.114:0/1356348867 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f650c06dc60 0x7f650c0cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:00.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.043+0000 7f6511000640 1 -- 172.21.15.114:0/1356348867 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f650c06dc60 msgr2=0x7f650c0cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:00.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.043+0000 7f6511000640 1 --2- 172.21.15.114:0/1356348867 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f650c06dc60 0x7f650c0cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:00.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.043+0000 7f6511000640 1 -- 172.21.15.114:0/1356348867 >> v1:172.21.15.134:6789/0 conn(0x7f650c13c980 legacy=0x7f650c06d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:00.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.043+0000 7f6511000640 1 -- 172.21.15.114:0/1356348867 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f650c159bc0 con 0x7f650c13c240 2024-09-13T17:53:00.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.047+0000 7f6511000640 1 --2- 172.21.15.114:0/1356348867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f650c13c240 0x7f650c13f420 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009870 tx=0x7f64fc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec382b4f068d5b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:00.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.047+0000 7f650be00640 1 -- 172.21.15.114:0/1356348867 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc0aa610 con 0x7f650c13c240 2024-09-13T17:53:00.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.047+0000 7f650be00640 1 -- 172.21.15.114:0/1356348867 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64fc0a6040 con 0x7f650c13c240 2024-09-13T17:53:00.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.047+0000 7f650be00640 1 -- 172.21.15.114:0/1356348867 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc0aa990 con 0x7f650c13c240 2024-09-13T17:53:00.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.047+0000 7f6513a00640 1 -- 172.21.15.114:0/1356348867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f650c13c240 msgr2=0x7f650c13f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:00.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.047+0000 7f6513a00640 1 --2- 172.21.15.114:0/1356348867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f650c13c240 0x7f650c13f420 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009870 tx=0x7f64fc01c4f0 comp rx=0 tx=0).stop 2024-09-13T17:53:00.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.047+0000 7f6513a00640 1 -- 172.21.15.114:0/1356348867 shutdown_connections 2024-09-13T17:53:00.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.047+0000 7f6513a00640 1 --2- 172.21.15.114:0/1356348867 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f650c06dc60 0x7f650c0cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:00.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.047+0000 7f6513a00640 1 --2- 172.21.15.114:0/1356348867 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f650c13c240 0x7f650c13f420 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:00.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.047+0000 7f6513a00640 1 -- 172.21.15.114:0/1356348867 >> 172.21.15.114:0/1356348867 conn(0x7f650c0660b0 msgr2=0x7f650c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:00.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.047+0000 7f6513a00640 1 -- 172.21.15.114:0/1356348867 shutdown_connections 2024-09-13T17:53:00.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.047+0000 7f6513a00640 1 -- 172.21.15.114:0/1356348867 wait complete. 2024-09-13T17:53:00.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.051+0000 7f6513a00640 1 Processor -- start 2024-09-13T17:53:00.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.051+0000 7f6513a00640 1 -- start start 2024-09-13T17:53:00.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.051+0000 7f6513a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f650c06dc60 0x7f650c153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:00.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.051+0000 7f6513a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f650c13c240 0x7f650c154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:00.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.051+0000 7f6513a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f650c13c980 0x7f650c15bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:00.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.051+0000 7f6513a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650c155f40 con 0x7f650c13c980 2024-09-13T17:53:00.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.051+0000 7f6513a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650c153670 con 0x7f650c13c240 2024-09-13T17:53:00.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.051+0000 7f6513a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650c1552c0 con 0x7f650c06dc60 2024-09-13T17:53:00.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.051+0000 7f6511a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f650c13c980 0x7f650c15bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:00.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.051+0000 7f6511a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f650c13c980 0x7f650c15bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42708/0 (socket says 172.21.15.114:42708) 2024-09-13T17:53:00.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.051+0000 7f6511a00640 1 -- 172.21.15.114:0/2843962941 learned_addr learned my addr 172.21.15.114:0/2843962941 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:00.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.051+0000 7f6511000640 1 --2- 172.21.15.114:0/2843962941 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f650c06dc60 0x7f650c153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:00.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.051+0000 7f6503e00640 1 --2- 172.21.15.114:0/2843962941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f650c13c240 0x7f650c154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:00.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.051+0000 7f6511a00640 1 -- 172.21.15.114:0/2843962941 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f650c06dc60 msgr2=0x7f650c153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:00.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.051+0000 7f6511a00640 1 --2- 172.21.15.114:0/2843962941 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f650c06dc60 0x7f650c153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:00.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.051+0000 7f6511a00640 1 -- 172.21.15.114:0/2843962941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f650c13c240 msgr2=0x7f650c154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:00.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.051+0000 7f6511a00640 1 --2- 172.21.15.114:0/2843962941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f650c13c240 0x7f650c154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:00.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.051+0000 7f6511a00640 1 -- 172.21.15.114:0/2843962941 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc0094d0 con 0x7f650c13c980 2024-09-13T17:53:00.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.051+0000 7f6503e00640 1 --2- 172.21.15.114:0/2843962941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f650c13c240 0x7f650c154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:00.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.051+0000 7f6511a00640 1 --2- 172.21.15.114:0/2843962941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f650c13c980 0x7f650c15bab0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6504009fd0 tx=0x7f650400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:00.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.051+0000 7f6509600640 1 -- 172.21.15.114:0/2843962941 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6504014420 con 0x7f650c13c980 2024-09-13T17:53:00.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.051+0000 7f6509600640 1 -- 172.21.15.114:0/2843962941 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6504014580 con 0x7f650c13c980 2024-09-13T17:53:00.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.051+0000 7f6509600640 1 -- 172.21.15.114:0/2843962941 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6504014930 con 0x7f650c13c980 2024-09-13T17:53:00.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.051+0000 7f6513a00640 1 -- 172.21.15.114:0/2843962941 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f650c1555a0 con 0x7f650c13c980 2024-09-13T17:53:00.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.051+0000 7f6513a00640 1 -- 172.21.15.114:0/2843962941 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f650c155b60 con 0x7f650c13c980 2024-09-13T17:53:00.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.051+0000 7f6513a00640 1 -- 172.21.15.114:0/2843962941 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f650c13cdb0 con 0x7f650c13c980 2024-09-13T17:53:00.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.055+0000 7f6509600640 1 -- 172.21.15.114:0/2843962941 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6504014a90 con 0x7f650c13c980 2024-09-13T17:53:00.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.055+0000 7f6509600640 1 --2- 172.21.15.114:0/2843962941 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f64e80666c0 0x7f64e8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:00.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.055+0000 7f6509600640 1 -- 172.21.15.114:0/2843962941 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f6504084a50 con 0x7f650c13c980 2024-09-13T17:53:00.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.055+0000 7f6511000640 1 --2- 172.21.15.114:0/2843962941 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f64e80666c0 0x7f64e8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:00.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.055+0000 7f6511000640 1 --2- 172.21.15.114:0/2843962941 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f64e80666c0 0x7f64e8068b80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f64fc0ae000 tx=0x7f64fc0b5040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:00.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.059+0000 7f6509600640 1 -- 172.21.15.114:0/2843962941 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f650c13cdb0 con 0x7f650c13c980 2024-09-13T17:53:00.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.215+0000 7f6513a00640 1 -- 172.21.15.114:0/2843962941 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f650c156080 con 0x7f650c13c980 2024-09-13T17:53:00.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.879+0000 7f6509600640 1 -- 172.21.15.114:0/2843962941 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7f650c156080 con 0x7f650c13c980 2024-09-13T17:53:00.883 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data_ec' removed 2024-09-13T17:53:00.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.879+0000 7f6513a00640 1 -- 172.21.15.114:0/2843962941 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f64e80666c0 msgr2=0x7f64e8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:00.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.879+0000 7f6513a00640 1 --2- 172.21.15.114:0/2843962941 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f64e80666c0 0x7f64e8068b80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f64fc0ae000 tx=0x7f64fc0b5040 comp rx=0 tx=0).stop 2024-09-13T17:53:00.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.879+0000 7f6513a00640 1 -- 172.21.15.114:0/2843962941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f650c13c980 msgr2=0x7f650c15bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:00.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.879+0000 7f6513a00640 1 --2- 172.21.15.114:0/2843962941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f650c13c980 0x7f650c15bab0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6504009fd0 tx=0x7f650400e4b0 comp rx=0 tx=0).stop 2024-09-13T17:53:00.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.883+0000 7f6513a00640 1 -- 172.21.15.114:0/2843962941 shutdown_connections 2024-09-13T17:53:00.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.883+0000 7f6513a00640 1 --2- 172.21.15.114:0/2843962941 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f64e80666c0 0x7f64e8068b80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:00.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.883+0000 7f6513a00640 1 --2- 172.21.15.114:0/2843962941 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f650c13c980 0x7f650c15bab0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:00.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.883+0000 7f6513a00640 1 --2- 172.21.15.114:0/2843962941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f650c13c240 0x7f650c154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:00.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.883+0000 7f6513a00640 1 --2- 172.21.15.114:0/2843962941 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f650c06dc60 0x7f650c153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:00.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.883+0000 7f6513a00640 1 -- 172.21.15.114:0/2843962941 >> 172.21.15.114:0/2843962941 conn(0x7f650c0660b0 msgr2=0x7f650c0b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:00.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.883+0000 7f6513a00640 1 -- 172.21.15.114:0/2843962941 shutdown_connections 2024-09-13T17:53:00.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:00.883+0000 7f6513a00640 1 -- 172.21.15.114:0/2843962941 wait complete. 2024-09-13T17:53:00.907 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T17:53:00.907 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T17:53:00.908 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T17:53:00.908 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:53:00.908 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T17:53:00.908 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T17:53:00.908 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T17:53:00.908 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:53:00.909 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T17:53:00.909 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T17:53:00.909 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T17:53:00.909 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:53:00.909 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T17:53:00.909 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T17:53:00.910 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T17:53:00.910 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:53:00.920 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T17:53:00.920 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T17:53:00.921 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T17:53:00.921 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T17:53:00.923 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T17:53:00.923 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T17:53:00.924 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T17:53:00.924 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T17:53:00.968 INFO:tasks.ceph.mds.a:Started 2024-09-13T17:53:00.968 DEBUG:teuthology.parallel:result is None 2024-09-13T17:53:00.969 INFO:tasks.ceph.mds.b:Started 2024-09-13T17:53:00.969 DEBUG:teuthology.parallel:result is None 2024-09-13T17:53:00.969 INFO:tasks.ceph.mds.c:Started 2024-09-13T17:53:00.970 DEBUG:teuthology.parallel:result is None 2024-09-13T17:53:00.970 INFO:tasks.ceph.mds.d:Started 2024-09-13T17:53:00.970 DEBUG:teuthology.parallel:result is None 2024-09-13T17:53:00.970 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T17:53:01.066 INFO:tasks.ceph.mds.d.smithi134.stdout:starting mds.d at 2024-09-13T17:53:01.066 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2024-09-13T17:53:01.066 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-09-13T17:53:01.085 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-09-13T17:53:01.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.135+0000 7fb44c400640 1 Processor -- start 2024-09-13T17:53:01.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.139+0000 7fb44c400640 1 -- start start 2024-09-13T17:53:01.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.139+0000 7fb44c400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb444070420 0x7fb444070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:01.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.139+0000 7fb44c400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb444151800 con 0x7fb44406c540 2024-09-13T17:53:01.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.139+0000 7fb44c400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4440cafb0 con 0x7fb444151420 2024-09-13T17:53:01.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.139+0000 7fb44c400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4440cbc30 con 0x7fb444070420 2024-09-13T17:53:01.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.139+0000 7fb44a400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb44406c540 0x7fb44406c970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41004/0 (socket says 172.21.15.114:41004) 2024-09-13T17:53:01.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.139+0000 7fb44a400640 1 -- 172.21.15.114:0/3168805491 learned_addr learned my addr 172.21.15.114:0/3168805491 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:01.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.139+0000 7fb449000640 1 --2- 172.21.15.114:0/3168805491 >> v2:172.21.15.134:3300/0 conn(0x7fb444070420 0x7fb444070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:01.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.139+0000 7fb443e00640 1 -- 172.21.15.114:0/3168805491 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2938007926 0 0) 0x7fb444151800 con 0x7fb44406c540 2024-09-13T17:53:01.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.139+0000 7fb443e00640 1 -- 172.21.15.114:0/3168805491 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb42c003530 con 0x7fb44406c540 2024-09-13T17:53:01.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.139+0000 7fb449000640 1 -- 172.21.15.114:0/3168805491 >> v1:172.21.15.134:6789/0 conn(0x7fb444151420 legacy=0x7fb4440cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:01.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.139+0000 7fb449000640 1 -- 172.21.15.114:0/3168805491 >> v1:172.21.15.114:6789/0 conn(0x7fb44406c540 legacy=0x7fb44406c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:01.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.139+0000 7fb449000640 1 -- 172.21.15.114:0/3168805491 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4440cb290 con 0x7fb444070420 2024-09-13T17:53:01.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.143+0000 7fb449000640 1 --2- 172.21.15.114:0/3168805491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb444070420 0x7fb444070890 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb4300097c0 tx=0x7fb43001c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a2f4328a1097c7e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:01.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.143+0000 7fb443e00640 1 -- 172.21.15.114:0/3168805491 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4300ab600 con 0x7fb444070420 2024-09-13T17:53:01.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.143+0000 7fb443e00640 1 -- 172.21.15.114:0/3168805491 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4300a7050 con 0x7fb444070420 2024-09-13T17:53:01.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.143+0000 7fb443e00640 1 -- 172.21.15.114:0/3168805491 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4300ab980 con 0x7fb444070420 2024-09-13T17:53:01.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.143+0000 7fb44c400640 1 -- 172.21.15.114:0/3168805491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb444070420 msgr2=0x7fb444070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:01.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.143+0000 7fb44c400640 1 --2- 172.21.15.114:0/3168805491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb444070420 0x7fb444070890 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb4300097c0 tx=0x7fb43001c380 comp rx=0 tx=0).stop 2024-09-13T17:53:01.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.143+0000 7fb44c400640 1 -- 172.21.15.114:0/3168805491 shutdown_connections 2024-09-13T17:53:01.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.143+0000 7fb44c400640 1 --2- 172.21.15.114:0/3168805491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb444070420 0x7fb444070890 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:01.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.143+0000 7fb44c400640 1 -- 172.21.15.114:0/3168805491 >> 172.21.15.114:0/3168805491 conn(0x7fb4440660b0 msgr2=0x7fb444069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:01.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.143+0000 7fb44c400640 1 -- 172.21.15.114:0/3168805491 shutdown_connections 2024-09-13T17:53:01.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.143+0000 7fb44c400640 1 -- 172.21.15.114:0/3168805491 wait complete. 2024-09-13T17:53:01.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.143+0000 7fb44c400640 1 Processor -- start 2024-09-13T17:53:01.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.147+0000 7fb44c400640 1 -- start start 2024-09-13T17:53:01.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.147+0000 7fb44c400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb44406c540 0x7fb44414d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:01.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.147+0000 7fb44c400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb444070420 0x7fb4440b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:01.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.147+0000 7fb44c400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb444151420 0x7fb44414c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.147+0000 7fb44c400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4440afc40 con 0x7fb444151420 2024-09-13T17:53:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.147+0000 7fb44c400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4440b0610 con 0x7fb444070420 2024-09-13T17:53:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.147+0000 7fb44c400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4440af030 con 0x7fb44406c540 2024-09-13T17:53:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.147+0000 7fb44a400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb444151420 0x7fb44414c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.147+0000 7fb44a400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb444151420 0x7fb44414c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45858/0 (socket says 172.21.15.114:45858) 2024-09-13T17:53:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.147+0000 7fb44a400640 1 -- 172.21.15.114:0/3674791651 learned_addr learned my addr 172.21.15.114:0/3674791651 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.147+0000 7fb449000640 1 --2- 172.21.15.114:0/3674791651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb444070420 0x7fb4440b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.147+0000 7fb449a00640 1 --2- 172.21.15.114:0/3674791651 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb44406c540 0x7fb44414d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.147+0000 7fb44a400640 1 -- 172.21.15.114:0/3674791651 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb44406c540 msgr2=0x7fb44414d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.147+0000 7fb44a400640 1 --2- 172.21.15.114:0/3674791651 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb44406c540 0x7fb44414d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.147+0000 7fb44a400640 1 -- 172.21.15.114:0/3674791651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb444070420 msgr2=0x7fb4440b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.147+0000 7fb44a400640 1 --2- 172.21.15.114:0/3674791651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb444070420 0x7fb4440b00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.147+0000 7fb44a400640 1 -- 172.21.15.114:0/3674791651 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb430009420 con 0x7fb444151420 2024-09-13T17:53:01.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.147+0000 7fb44a400640 1 --2- 172.21.15.114:0/3674791651 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb444151420 0x7fb44414c900 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00cae0 tx=0x7fb43c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:01.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.147+0000 7fb441600640 1 -- 172.21.15.114:0/3674791651 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c00ac40 con 0x7fb444151420 2024-09-13T17:53:01.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.147+0000 7fb441600640 1 -- 172.21.15.114:0/3674791651 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43c00ada0 con 0x7fb444151420 2024-09-13T17:53:01.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.147+0000 7fb44c400640 1 -- 172.21.15.114:0/3674791651 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4440af310 con 0x7fb444151420 2024-09-13T17:53:01.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.147+0000 7fb441600640 1 -- 172.21.15.114:0/3674791651 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c012600 con 0x7fb444151420 2024-09-13T17:53:01.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.147+0000 7fb44c400640 1 -- 172.21.15.114:0/3674791651 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4440af8d0 con 0x7fb444151420 2024-09-13T17:53:01.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.147+0000 7fb44c400640 1 -- 172.21.15.114:0/3674791651 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4440afdb0 con 0x7fb444151420 2024-09-13T17:53:01.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.151+0000 7fb441600640 1 -- 172.21.15.114:0/3674791651 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb43c007070 con 0x7fb444151420 2024-09-13T17:53:01.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.151+0000 7fb441600640 1 --2- 172.21.15.114:0/3674791651 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb424066690 0x7fb424068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:01.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.151+0000 7fb441600640 1 -- 172.21.15.114:0/3674791651 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fb43c083e20 con 0x7fb444151420 2024-09-13T17:53:01.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.151+0000 7fb449a00640 1 --2- 172.21.15.114:0/3674791651 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb424066690 0x7fb424068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:01.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.151+0000 7fb449a00640 1 --2- 172.21.15.114:0/3674791651 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb424066690 0x7fb424068b50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb444165270 tx=0x7fb438009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:01.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.155+0000 7fb441600640 1 -- 172.21.15.114:0/3674791651 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb43c051400 con 0x7fb444151420 2024-09-13T17:53:01.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:01.319+0000 7fb44c400640 1 -- 172.21.15.114:0/3674791651 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb444070890 con 0x7fb444151420 2024-09-13T17:53:02.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.107+0000 7fb441600640 1 -- 172.21.15.114:0/3674791651 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb43c017080 con 0x7fb444151420 2024-09-13T17:53:02.112 INFO:teuthology.orchestra.run.smithi114.stderr: removed all blocklist entries 2024-09-13T17:53:02.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.111+0000 7fb44c400640 1 -- 172.21.15.114:0/3674791651 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb424066690 msgr2=0x7fb424068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:02.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.111+0000 7fb44c400640 1 --2- 172.21.15.114:0/3674791651 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb424066690 0x7fb424068b50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb444165270 tx=0x7fb438009040 comp rx=0 tx=0).stop 2024-09-13T17:53:02.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.111+0000 7fb44c400640 1 -- 172.21.15.114:0/3674791651 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb444151420 msgr2=0x7fb44414c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:02.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.111+0000 7fb44c400640 1 --2- 172.21.15.114:0/3674791651 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb444151420 0x7fb44414c900 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00cae0 tx=0x7fb43c00a060 comp rx=0 tx=0).stop 2024-09-13T17:53:02.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.111+0000 7fb44c400640 1 -- 172.21.15.114:0/3674791651 shutdown_connections 2024-09-13T17:53:02.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.111+0000 7fb44c400640 1 --2- 172.21.15.114:0/3674791651 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb424066690 0x7fb424068b50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:02.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.111+0000 7fb44c400640 1 --2- 172.21.15.114:0/3674791651 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb444151420 0x7fb44414c900 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:02.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.111+0000 7fb44c400640 1 --2- 172.21.15.114:0/3674791651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb444070420 0x7fb4440b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:02.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.111+0000 7fb44c400640 1 --2- 172.21.15.114:0/3674791651 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb44406c540 0x7fb44414d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:02.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.111+0000 7fb44c400640 1 -- 172.21.15.114:0/3674791651 >> 172.21.15.114:0/3674791651 conn(0x7fb4440660b0 msgr2=0x7fb44415d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:02.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.111+0000 7fb44c400640 1 -- 172.21.15.114:0/3674791651 shutdown_connections 2024-09-13T17:53:02.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.111+0000 7fb44c400640 1 -- 172.21.15.114:0/3674791651 wait complete. 2024-09-13T17:53:02.135 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T17:53:02.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.267+0000 7fe9c6600640 1 Processor -- start 2024-09-13T17:53:02.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.267+0000 7fe9c6600640 1 -- start start 2024-09-13T17:53:02.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.267+0000 7fe9c6600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe9c015c880 0x7fe9c00d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:02.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.267+0000 7fe9c6600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe9c006bfc0 0x7fe9c0098a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:02.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.267+0000 7fe9c6600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9c0099400 con 0x7fe9c0098fb0 2024-09-13T17:53:02.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.267+0000 7fe9c6600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c015cc60 con 0x7fe9c015c880 2024-09-13T17:53:02.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.267+0000 7fe9c6600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c00ca980 con 0x7fe9c006bfc0 2024-09-13T17:53:02.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.267+0000 7fe9c5200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe9c015c880 0x7fe9c00d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:02.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.267+0000 7fe9c5c00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe9c0098fb0 0x7fe9c00ce230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41016/0 (socket says 172.21.15.114:41016) 2024-09-13T17:53:02.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.267+0000 7fe9c5200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe9c015c880 0x7fe9c00d0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45872/0 (socket says 172.21.15.114:45872) 2024-09-13T17:53:02.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.267+0000 7fe9c5c00640 1 -- 172.21.15.114:0/2929332871 learned_addr learned my addr 172.21.15.114:0/2929332871 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:02.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.267+0000 7fe9b7e00640 1 --2- 172.21.15.114:0/2929332871 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe9c006bfc0 0x7fe9c0098a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:02.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.267+0000 7fe9c5200640 1 -- 172.21.15.114:0/2929332871 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe9c006bfc0 msgr2=0x7fe9c0098a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:02.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.267+0000 7fe9c5200640 1 --2- 172.21.15.114:0/2929332871 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe9c006bfc0 0x7fe9c0098a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:02.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.267+0000 7fe9c5200640 1 -- 172.21.15.114:0/2929332871 >> v1:172.21.15.114:6789/0 conn(0x7fe9c0098fb0 legacy=0x7fe9c00ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:02.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.267+0000 7fe9c5200640 1 -- 172.21.15.114:0/2929332871 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c006c450 con 0x7fe9c015c880 2024-09-13T17:53:02.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.267+0000 7fe9bfe00640 1 -- 172.21.15.114:0/2929332871 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2557958630 0 0) 0x7fe9b80014a0 con 0x7fe9c0098fb0 2024-09-13T17:53:02.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.271+0000 7fe9c5200640 1 --2- 172.21.15.114:0/2929332871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9c015c880 0x7fe9c00d0e50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe9b00097c0 tx=0x7fe9b001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8d4fcfc4b0f387 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:02.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.271+0000 7fe9bfe00640 1 -- 172.21.15.114:0/2929332871 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b00ac640 con 0x7fe9c015c880 2024-09-13T17:53:02.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.271+0000 7fe9bfe00640 1 -- 172.21.15.114:0/2929332871 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b00ac7a0 con 0x7fe9c015c880 2024-09-13T17:53:02.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.271+0000 7fe9bfe00640 1 -- 172.21.15.114:0/2929332871 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b00acb30 con 0x7fe9c015c880 2024-09-13T17:53:02.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.271+0000 7fe9c6600640 1 -- 172.21.15.114:0/2929332871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9c015c880 msgr2=0x7fe9c00d0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:02.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.271+0000 7fe9c6600640 1 --2- 172.21.15.114:0/2929332871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9c015c880 0x7fe9c00d0e50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe9b00097c0 tx=0x7fe9b001c3e0 comp rx=0 tx=0).stop 2024-09-13T17:53:02.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.271+0000 7fe9c6600640 1 -- 172.21.15.114:0/2929332871 shutdown_connections 2024-09-13T17:53:02.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.271+0000 7fe9c6600640 1 --2- 172.21.15.114:0/2929332871 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe9c006bfc0 0x7fe9c0098a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:02.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.271+0000 7fe9c6600640 1 --2- 172.21.15.114:0/2929332871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9c015c880 0x7fe9c00d0e50 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:02.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.271+0000 7fe9c6600640 1 -- 172.21.15.114:0/2929332871 >> 172.21.15.114:0/2929332871 conn(0x7fe9c00d0330 msgr2=0x7fe9c00d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:02.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.271+0000 7fe9c6600640 1 -- 172.21.15.114:0/2929332871 shutdown_connections 2024-09-13T17:53:02.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.271+0000 7fe9c6600640 1 -- 172.21.15.114:0/2929332871 wait complete. 2024-09-13T17:53:02.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.271+0000 7fe9c6600640 1 Processor -- start 2024-09-13T17:53:02.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.271+0000 7fe9c6600640 1 -- start start 2024-09-13T17:53:02.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.275+0000 7fe9c6600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe9c0098fb0 0x7fe9c014f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:02.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.275+0000 7fe9c6600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9c015c880 0x7fe9c015d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:02.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.275+0000 7fe9c6600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9c00b1510 0x7fe9c0156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:02.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.275+0000 7fe9c6600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c00c7400 con 0x7fe9c00b1510 2024-09-13T17:53:02.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.275+0000 7fe9c6600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c014fd80 con 0x7fe9c015c880 2024-09-13T17:53:02.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.275+0000 7fe9c6600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c015e120 con 0x7fe9c0098fb0 2024-09-13T17:53:02.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.275+0000 7fe9c5c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9c00b1510 0x7fe9c0156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:02.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.275+0000 7fe9c5c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9c00b1510 0x7fe9c0156c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45882/0 (socket says 172.21.15.114:45882) 2024-09-13T17:53:02.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.275+0000 7fe9c5c00640 1 -- 172.21.15.114:0/1687998214 learned_addr learned my addr 172.21.15.114:0/1687998214 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:02.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.275+0000 7fe9c5200640 1 --2- 172.21.15.114:0/1687998214 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe9c0098fb0 0x7fe9c014f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:02.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.275+0000 7fe9b7e00640 1 --2- 172.21.15.114:0/1687998214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9c015c880 0x7fe9c015d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:02.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.275+0000 7fe9c5c00640 1 -- 172.21.15.114:0/1687998214 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe9c0098fb0 msgr2=0x7fe9c014f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:02.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.275+0000 7fe9c5c00640 1 --2- 172.21.15.114:0/1687998214 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe9c0098fb0 0x7fe9c014f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:02.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.275+0000 7fe9c5c00640 1 -- 172.21.15.114:0/1687998214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9c015c880 msgr2=0x7fe9c015d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:02.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.275+0000 7fe9c5c00640 1 --2- 172.21.15.114:0/1687998214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9c015c880 0x7fe9c015d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:02.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.275+0000 7fe9c5c00640 1 -- 172.21.15.114:0/1687998214 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b0009420 con 0x7fe9c00b1510 2024-09-13T17:53:02.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.275+0000 7fe9c5c00640 1 --2- 172.21.15.114:0/1687998214 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9c00b1510 0x7fe9c0156c00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800c7b0 tx=0x7fe9b800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:02.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.275+0000 7fe9bd600640 1 -- 172.21.15.114:0/1687998214 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b800a640 con 0x7fe9c00b1510 2024-09-13T17:53:02.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.275+0000 7fe9bd600640 1 -- 172.21.15.114:0/1687998214 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b800a7c0 con 0x7fe9c00b1510 2024-09-13T17:53:02.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.275+0000 7fe9c6600640 1 -- 172.21.15.114:0/1687998214 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9c00c7650 con 0x7fe9c00b1510 2024-09-13T17:53:02.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.275+0000 7fe9bd600640 1 -- 172.21.15.114:0/1687998214 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b800ab70 con 0x7fe9c00b1510 2024-09-13T17:53:02.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.275+0000 7fe9c6600640 1 -- 172.21.15.114:0/1687998214 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c00c7c10 con 0x7fe9c00b1510 2024-09-13T17:53:02.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.275+0000 7fe9c6600640 1 -- 172.21.15.114:0/1687998214 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c00c7e30 con 0x7fe9c00b1510 2024-09-13T17:53:02.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.279+0000 7fe9bd600640 1 -- 172.21.15.114:0/1687998214 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe9b800acd0 con 0x7fe9c00b1510 2024-09-13T17:53:02.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.279+0000 7fe9bd600640 1 --2- 172.21.15.114:0/1687998214 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe99c066690 0x7fe99c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:02.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.279+0000 7fe9bd600640 1 -- 172.21.15.114:0/1687998214 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fe9b80831d0 con 0x7fe9c00b1510 2024-09-13T17:53:02.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.279+0000 7fe9c5200640 1 --2- 172.21.15.114:0/1687998214 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe99c066690 0x7fe99c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:02.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.279+0000 7fe9c5200640 1 --2- 172.21.15.114:0/1687998214 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe99c066690 0x7fe99c068b50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe9b00ae000 tx=0x7fe9b00a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:02.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.283+0000 7fe9bd600640 1 -- 172.21.15.114:0/1687998214 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe9b8050760 con 0x7fe9c00b1510 2024-09-13T17:53:02.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.487+0000 7fe9c6600640 1 -- 172.21.15.114:0/1687998214 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe9c0099400 con 0x7fe9c00b1510 2024-09-13T17:53:02.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.491+0000 7fe9bd600640 1 -- 172.21.15.114:0/1687998214 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fe9c0099400 con 0x7fe9c00b1510 2024-09-13T17:53:02.494 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:02.495 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-13T17:53:02.495 INFO:teuthology.orchestra.run.smithi114.stdout: "auth_dump": [ 2024-09-13T17:53:02.495 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-13T17:53:02.495 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.a", 2024-09-13T17:53:02.495 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQB1e+RmncdJKBAAysIDwMafxT5K6gz/kxoQdg==", 2024-09-13T17:53:02.495 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-13T17:53:02.495 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-13T17:53:02.495 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-13T17:53:02.495 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-13T17:53:02.495 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-13T17:53:02.495 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:02.495 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-13T17:53:02.496 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-13T17:53:02.496 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.b", 2024-09-13T17:53:02.496 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQB1e+Rm8wQ7NBAA5l/7OWAIaHNNP1Ht0VwbNw==", 2024-09-13T17:53:02.496 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-13T17:53:02.496 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-13T17:53:02.496 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-13T17:53:02.496 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-13T17:53:02.496 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-13T17:53:02.496 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:02.496 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-13T17:53:02.496 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-13T17:53:02.496 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.c", 2024-09-13T17:53:02.496 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQB1e+RmGFldLxAAZsrNqxkMzrDXtsH73AXikQ==", 2024-09-13T17:53:02.497 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-13T17:53:02.497 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-13T17:53:02.497 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-13T17:53:02.497 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-13T17:53:02.497 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-13T17:53:02.497 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:02.497 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-13T17:53:02.497 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-13T17:53:02.497 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.d", 2024-09-13T17:53:02.497 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQB1e+RmaJOOOxAAikhRbRTATgtGIl9Xe0XG1w==", 2024-09-13T17:53:02.497 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-13T17:53:02.498 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-13T17:53:02.498 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-13T17:53:02.498 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-13T17:53:02.498 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-13T17:53:02.498 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:02.498 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-13T17:53:02.498 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-13T17:53:02.498 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.0", 2024-09-13T17:53:02.498 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQB5e+Rmu+NxAxAAPYsqcyZoGuDNhPdJ9uzj1Q==", 2024-09-13T17:53:02.498 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-13T17:53:02.498 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-13T17:53:02.498 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-13T17:53:02.498 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-13T17:53:02.498 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:02.499 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-13T17:53:02.499 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-13T17:53:02.499 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.1", 2024-09-13T17:53:02.499 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQB8e+RmRe6QDhAAODh2OqKFo4wPbpJIHR7iWQ==", 2024-09-13T17:53:02.499 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-13T17:53:02.499 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-13T17:53:02.499 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-13T17:53:02.499 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-13T17:53:02.499 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:02.500 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-13T17:53:02.500 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-13T17:53:02.500 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.2", 2024-09-13T17:53:02.500 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQB/e+RmBjIGGRAAijx9//aNbfFpnBAjid5W5Q==", 2024-09-13T17:53:02.500 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-13T17:53:02.500 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-13T17:53:02.500 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-13T17:53:02.500 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-13T17:53:02.500 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:02.500 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-13T17:53:02.500 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-13T17:53:02.500 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.3", 2024-09-13T17:53:02.501 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQCCe+Rm5nW9IhAAPJkQnS0rRmxyys3HHNOcDg==", 2024-09-13T17:53:02.501 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-13T17:53:02.501 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-13T17:53:02.501 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-13T17:53:02.501 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-13T17:53:02.501 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:02.501 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-13T17:53:02.501 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-13T17:53:02.502 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.4", 2024-09-13T17:53:02.502 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQCIe+RmGRx7GhAALoXgz2B5bs08BoLt0MWR/g==", 2024-09-13T17:53:02.502 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-13T17:53:02.502 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-13T17:53:02.502 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-13T17:53:02.502 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-13T17:53:02.502 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:02.502 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-13T17:53:02.502 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-13T17:53:02.502 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.5", 2024-09-13T17:53:02.503 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQCLe+RmvWucIxAAC/sqikj+O41H0FBFVBxQvg==", 2024-09-13T17:53:02.503 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-13T17:53:02.503 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-13T17:53:02.503 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-13T17:53:02.503 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-13T17:53:02.503 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:02.503 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-13T17:53:02.503 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-13T17:53:02.503 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.6", 2024-09-13T17:53:02.503 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQCOe+RmCchjLhAAJ6WL+TvYqahpsEWVDPbR8g==", 2024-09-13T17:53:02.503 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-13T17:53:02.504 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-13T17:53:02.504 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-13T17:53:02.504 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-13T17:53:02.504 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:02.504 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-13T17:53:02.504 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-13T17:53:02.504 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.7", 2024-09-13T17:53:02.504 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQCRe+RmZXSmOBAAorSzbtW3hRIcoGipUhf0Fg==", 2024-09-13T17:53:02.504 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-13T17:53:02.504 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2024-09-13T17:53:02.504 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2024-09-13T17:53:02.505 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-13T17:53:02.505 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:02.505 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-13T17:53:02.505 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-13T17:53:02.505 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.0", 2024-09-13T17:53:02.505 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQB2e+Rmlv/dAxAA02imgVgOpA5coMMyhIxX0A==", 2024-09-13T17:53:02.505 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-13T17:53:02.505 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-13T17:53:02.505 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-13T17:53:02.505 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-13T17:53:02.505 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-13T17:53:02.505 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:02.506 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-13T17:53:02.506 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-13T17:53:02.506 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.1", 2024-09-13T17:53:02.506 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQB2e+RmYBlVDRAAfJTruk3uULAudbWy40lusg==", 2024-09-13T17:53:02.506 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-13T17:53:02.506 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-13T17:53:02.506 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-13T17:53:02.506 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-13T17:53:02.506 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-13T17:53:02.506 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:02.506 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-13T17:53:02.506 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-13T17:53:02.506 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.2", 2024-09-13T17:53:02.507 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQB2e+RmdZjmCRAA2rB0NwPaLvTjntGn1pBIrg==", 2024-09-13T17:53:02.507 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-13T17:53:02.507 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-13T17:53:02.507 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-13T17:53:02.507 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-13T17:53:02.507 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-13T17:53:02.507 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:02.507 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-13T17:53:02.507 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-13T17:53:02.507 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.3", 2024-09-13T17:53:02.507 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQB2e+Rm8h0tExAAdz5gW3cy/T7xsC2rvvxuWg==", 2024-09-13T17:53:02.507 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-13T17:53:02.507 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2024-09-13T17:53:02.508 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2024-09-13T17:53:02.508 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2024-09-13T17:53:02.508 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2024-09-13T17:53:02.508 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:02.508 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-13T17:53:02.508 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-13T17:53:02.508 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.admin", 2024-09-13T17:53:02.508 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQB1e+RmLqxSDRAAT1bBAfXDpTC+YIGLUfJH6w==", 2024-09-13T17:53:02.508 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-13T17:53:02.508 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-13T17:53:02.508 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2024-09-13T17:53:02.508 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2024-09-13T17:53:02.508 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-13T17:53:02.509 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:02.509 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-13T17:53:02.509 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-13T17:53:02.509 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-mds", 2024-09-13T17:53:02.509 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQCce+RmInAqOBAALdaNPnRI8+pRLwvUFr2B2A==", 2024-09-13T17:53:02.509 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-13T17:53:02.509 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-mds" 2024-09-13T17:53:02.509 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:02.509 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-13T17:53:02.509 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-13T17:53:02.509 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-mgr", 2024-09-13T17:53:02.510 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQCce+RmRIUqOBAA8nsMfZxaDcsiaaYv3+jB+g==", 2024-09-13T17:53:02.510 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-13T17:53:02.510 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-13T17:53:02.510 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:02.510 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-13T17:53:02.510 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-13T17:53:02.510 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-osd", 2024-09-13T17:53:02.510 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQCce+RmLJUqOBAA7YLVVBtpqQC4Eiu/3xqJ9Q==", 2024-09-13T17:53:02.510 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-13T17:53:02.510 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-osd" 2024-09-13T17:53:02.510 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:02.510 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-13T17:53:02.510 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-13T17:53:02.511 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-rbd", 2024-09-13T17:53:02.511 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQCce+RmC6YqOBAAKVuZVKW1XLuayzyVdj7zkg==", 2024-09-13T17:53:02.511 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-13T17:53:02.511 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-13T17:53:02.511 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:02.511 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-13T17:53:02.511 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-13T17:53:02.512 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-13T17:53:02.512 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQCce+RmQrUqOBAAVfIcFt0zBdqXRRhj2sTz9A==", 2024-09-13T17:53:02.512 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-13T17:53:02.512 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-13T17:53:02.512 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:02.512 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-13T17:53:02.512 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-13T17:53:02.512 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-rgw", 2024-09-13T17:53:02.512 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQCce+RmWsQqOBAAUjFDU0w/EBD0dO92qDJkZA==", 2024-09-13T17:53:02.512 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-13T17:53:02.512 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-13T17:53:02.512 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:02.513 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-13T17:53:02.513 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-13T17:53:02.513 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.x", 2024-09-13T17:53:02.513 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQB1e+RmGl8bJBAAhiq/mLUuZha/RGjFM+b0IA==", 2024-09-13T17:53:02.513 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-13T17:53:02.513 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-13T17:53:02.513 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-09-13T17:53:02.513 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-13T17:53:02.513 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:02.513 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-09-13T17:53:02.514 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-13T17:53:02.514 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.y", 2024-09-13T17:53:02.514 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQB1e+RmdnRgIBAAyfLnbvtc4IqebPiB4b+HJg==", 2024-09-13T17:53:02.514 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2024-09-13T17:53:02.514 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2024-09-13T17:53:02.514 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2024-09-13T17:53:02.514 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2024-09-13T17:53:02.514 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:02.514 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:02.514 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-13T17:53:02.514 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-13T17:53:02.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.491+0000 7fe9c6600640 1 -- 172.21.15.114:0/1687998214 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe99c066690 msgr2=0x7fe99c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:02.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.491+0000 7fe9c6600640 1 --2- 172.21.15.114:0/1687998214 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe99c066690 0x7fe99c068b50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe9b00ae000 tx=0x7fe9b00a7000 comp rx=0 tx=0).stop 2024-09-13T17:53:02.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.491+0000 7fe9c6600640 1 -- 172.21.15.114:0/1687998214 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9c00b1510 msgr2=0x7fe9c0156c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:02.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.491+0000 7fe9c6600640 1 --2- 172.21.15.114:0/1687998214 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9c00b1510 0x7fe9c0156c00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800c7b0 tx=0x7fe9b800cc70 comp rx=0 tx=0).stop 2024-09-13T17:53:02.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.491+0000 7fe9c6600640 1 -- 172.21.15.114:0/1687998214 shutdown_connections 2024-09-13T17:53:02.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.491+0000 7fe9c6600640 1 --2- 172.21.15.114:0/1687998214 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe99c066690 0x7fe99c068b50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:02.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.491+0000 7fe9c6600640 1 --2- 172.21.15.114:0/1687998214 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9c00b1510 0x7fe9c0156c00 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:02.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.491+0000 7fe9c6600640 1 --2- 172.21.15.114:0/1687998214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9c015c880 0x7fe9c015d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:02.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.491+0000 7fe9c6600640 1 --2- 172.21.15.114:0/1687998214 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe9c0098fb0 0x7fe9c014f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:02.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.491+0000 7fe9c6600640 1 -- 172.21.15.114:0/1687998214 >> 172.21.15.114:0/1687998214 conn(0x7fe9c00d0330 msgr2=0x7fe9c00b3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:02.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.491+0000 7fe9c6600640 1 -- 172.21.15.114:0/1687998214 shutdown_connections 2024-09-13T17:53:02.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.491+0000 7fe9c6600640 1 -- 172.21.15.114:0/1687998214 wait complete. 2024-09-13T17:53:02.517 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-13T17:53:02.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.647+0000 7f95d3a00640 1 Processor -- start 2024-09-13T17:53:02.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.647+0000 7f95d3a00640 1 -- start start 2024-09-13T17:53:02.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.647+0000 7f95d3a00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f95cc13c240 0x7f95cc13f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:02.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.651+0000 7f95d3a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95cc0cd220 con 0x7f95cc06dc60 2024-09-13T17:53:02.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.651+0000 7f95d3a00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95cc13f960 con 0x7f95cc13c980 2024-09-13T17:53:02.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.651+0000 7f95d3a00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95cc15a740 con 0x7f95cc13c240 2024-09-13T17:53:02.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.651+0000 7f95d1a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f95cc06dc60 0x7f95cc0cd650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41018/0 (socket says 172.21.15.114:41018) 2024-09-13T17:53:02.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.651+0000 7f95d1a00640 1 -- 172.21.15.114:0/3146997556 learned_addr learned my addr 172.21.15.114:0/3146997556 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:02.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.651+0000 7f95d1000640 1 --2- 172.21.15.114:0/3146997556 >> v2:172.21.15.134:3300/0 conn(0x7f95cc13c240 0x7f95cc13f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:02.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.651+0000 7f95cbe00640 1 -- 172.21.15.114:0/3146997556 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183375596 0 0) 0x7f95cc0cd220 con 0x7f95cc06dc60 2024-09-13T17:53:02.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.651+0000 7f95cbe00640 1 -- 172.21.15.114:0/3146997556 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95b0005740 con 0x7f95cc06dc60 2024-09-13T17:53:02.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.651+0000 7f95d1000640 1 -- 172.21.15.114:0/3146997556 >> v1:172.21.15.134:6789/0 conn(0x7f95cc13c980 legacy=0x7f95cc06d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:02.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.651+0000 7f95d1000640 1 -- 172.21.15.114:0/3146997556 >> v1:172.21.15.114:6789/0 conn(0x7f95cc06dc60 legacy=0x7f95cc0cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:02.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.651+0000 7f95d1000640 1 -- 172.21.15.114:0/3146997556 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95cc159bc0 con 0x7f95cc13c240 2024-09-13T17:53:02.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.651+0000 7f95d1000640 1 --2- 172.21.15.114:0/3146997556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95cc13c240 0x7f95cc13f420 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0097c0 tx=0x7f95bc01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4617582eb4e0976f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:02.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.655+0000 7f95cbe00640 1 -- 172.21.15.114:0/3146997556 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc0ab600 con 0x7f95cc13c240 2024-09-13T17:53:02.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.655+0000 7f95cbe00640 1 -- 172.21.15.114:0/3146997556 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95bc0a7050 con 0x7f95cc13c240 2024-09-13T17:53:02.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.655+0000 7f95cbe00640 1 -- 172.21.15.114:0/3146997556 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc0ab980 con 0x7f95cc13c240 2024-09-13T17:53:02.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.655+0000 7f95d3a00640 1 -- 172.21.15.114:0/3146997556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95cc13c240 msgr2=0x7f95cc13f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:02.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.655+0000 7f95d3a00640 1 --2- 172.21.15.114:0/3146997556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95cc13c240 0x7f95cc13f420 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0097c0 tx=0x7f95bc01c3e0 comp rx=0 tx=0).stop 2024-09-13T17:53:02.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.655+0000 7f95d3a00640 1 -- 172.21.15.114:0/3146997556 shutdown_connections 2024-09-13T17:53:02.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.655+0000 7f95d3a00640 1 --2- 172.21.15.114:0/3146997556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95cc13c240 0x7f95cc13f420 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:02.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.655+0000 7f95d3a00640 1 -- 172.21.15.114:0/3146997556 >> 172.21.15.114:0/3146997556 conn(0x7f95cc0660b0 msgr2=0x7f95cc069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:02.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.655+0000 7f95d3a00640 1 -- 172.21.15.114:0/3146997556 shutdown_connections 2024-09-13T17:53:02.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.655+0000 7f95d3a00640 1 -- 172.21.15.114:0/3146997556 wait complete. 2024-09-13T17:53:02.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.655+0000 7f95d3a00640 1 Processor -- start 2024-09-13T17:53:02.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.655+0000 7f95d3a00640 1 -- start start 2024-09-13T17:53:02.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.655+0000 7f95d3a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95cc06dc60 0x7f95cc156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:02.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.655+0000 7f95d3a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95cc13c240 0x7f95cc13b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:02.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.655+0000 7f95d3a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95cc13c980 0x7f95cc1542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:02.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.655+0000 7f95d3a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc13a480 con 0x7f95cc13c980 2024-09-13T17:53:02.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.655+0000 7f95d3a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc13a760 con 0x7f95cc13c240 2024-09-13T17:53:02.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.655+0000 7f95d3a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc13aa40 con 0x7f95cc06dc60 2024-09-13T17:53:02.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.655+0000 7f95d1a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95cc13c980 0x7f95cc1542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:02.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.655+0000 7f95d1a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95cc13c980 0x7f95cc1542d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45890/0 (socket says 172.21.15.114:45890) 2024-09-13T17:53:02.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.655+0000 7f95d1a00640 1 -- 172.21.15.114:0/694920641 learned_addr learned my addr 172.21.15.114:0/694920641 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:02.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.655+0000 7f95c3e00640 1 --2- 172.21.15.114:0/694920641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95cc13c240 0x7f95cc13b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:02.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.655+0000 7f95d1000640 1 --2- 172.21.15.114:0/694920641 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95cc06dc60 0x7f95cc156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:02.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.659+0000 7f95d1a00640 1 -- 172.21.15.114:0/694920641 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95cc06dc60 msgr2=0x7f95cc156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:02.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.659+0000 7f95d1a00640 1 --2- 172.21.15.114:0/694920641 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95cc06dc60 0x7f95cc156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:02.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.659+0000 7f95d1a00640 1 -- 172.21.15.114:0/694920641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95cc13c240 msgr2=0x7f95cc13b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:02.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.659+0000 7f95d1a00640 1 --2- 172.21.15.114:0/694920641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95cc13c240 0x7f95cc13b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:02.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.659+0000 7f95d1a00640 1 -- 172.21.15.114:0/694920641 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc009420 con 0x7f95cc13c980 2024-09-13T17:53:02.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.659+0000 7f95c3e00640 1 --2- 172.21.15.114:0/694920641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95cc13c240 0x7f95cc13b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:02.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.659+0000 7f95d1000640 1 --2- 172.21.15.114:0/694920641 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95cc06dc60 0x7f95cc156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:02.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.659+0000 7f95d1a00640 1 --2- 172.21.15.114:0/694920641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95cc13c980 0x7f95cc1542d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f95c400caa0 tx=0x7f95c400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:02.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.659+0000 7f95c9600640 1 -- 172.21.15.114:0/694920641 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c400ac00 con 0x7f95cc13c980 2024-09-13T17:53:02.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.659+0000 7f95c9600640 1 -- 172.21.15.114:0/694920641 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c400ad60 con 0x7f95cc13c980 2024-09-13T17:53:02.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.659+0000 7f95d3a00640 1 -- 172.21.15.114:0/694920641 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95cc13ad20 con 0x7f95cc13c980 2024-09-13T17:53:02.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.659+0000 7f95c9600640 1 -- 172.21.15.114:0/694920641 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c4012620 con 0x7f95cc13c980 2024-09-13T17:53:02.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.659+0000 7f95d3a00640 1 -- 172.21.15.114:0/694920641 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95cc154810 con 0x7f95cc13c980 2024-09-13T17:53:02.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.659+0000 7f95d3a00640 1 -- 172.21.15.114:0/694920641 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95cc13b240 con 0x7f95cc13c980 2024-09-13T17:53:02.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.659+0000 7f95c9600640 1 -- 172.21.15.114:0/694920641 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f95c4007070 con 0x7f95cc13c980 2024-09-13T17:53:02.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.659+0000 7f95c9600640 1 --2- 172.21.15.114:0/694920641 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f95a8066690 0x7f95a8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:02.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.659+0000 7f95c9600640 1 -- 172.21.15.114:0/694920641 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f95c4083f70 con 0x7f95cc13c980 2024-09-13T17:53:02.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.659+0000 7f95d1000640 1 --2- 172.21.15.114:0/694920641 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f95a8066690 0x7f95a8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:02.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.663+0000 7f95d1000640 1 --2- 172.21.15.114:0/694920641 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f95a8066690 0x7f95a8068b50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0ad000 tx=0x7f95bc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:02.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.663+0000 7f95c9600640 1 -- 172.21.15.114:0/694920641 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f95cc13b240 con 0x7f95cc13c980 2024-09-13T17:53:02.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.871+0000 7f95d3a00640 1 -- 172.21.15.114:0/694920641 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f95cc13b240 con 0x7f95cc13c980 2024-09-13T17:53:02.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.875+0000 7f95c9600640 1 -- 172.21.15.114:0/694920641 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f95cc13b240 con 0x7f95cc13c980 2024-09-13T17:53:02.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.879+0000 7f95d3a00640 1 -- 172.21.15.114:0/694920641 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f95a8066690 msgr2=0x7f95a8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:02.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.879+0000 7f95d3a00640 1 --2- 172.21.15.114:0/694920641 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f95a8066690 0x7f95a8068b50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0ad000 tx=0x7f95bc008040 comp rx=0 tx=0).stop 2024-09-13T17:53:02.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.879+0000 7f95d3a00640 1 -- 172.21.15.114:0/694920641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95cc13c980 msgr2=0x7f95cc1542d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:02.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.879+0000 7f95d3a00640 1 --2- 172.21.15.114:0/694920641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95cc13c980 0x7f95cc1542d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f95c400caa0 tx=0x7f95c400cf60 comp rx=0 tx=0).stop 2024-09-13T17:53:02.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.879+0000 7f95d3a00640 1 -- 172.21.15.114:0/694920641 shutdown_connections 2024-09-13T17:53:02.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.879+0000 7f95d3a00640 1 --2- 172.21.15.114:0/694920641 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f95a8066690 0x7f95a8068b50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:02.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.879+0000 7f95d3a00640 1 --2- 172.21.15.114:0/694920641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95cc13c980 0x7f95cc1542d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:02.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.879+0000 7f95d3a00640 1 --2- 172.21.15.114:0/694920641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95cc13c240 0x7f95cc13b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:02.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.879+0000 7f95d3a00640 1 --2- 172.21.15.114:0/694920641 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f95cc06dc60 0x7f95cc156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:02.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.879+0000 7f95d3a00640 1 -- 172.21.15.114:0/694920641 >> 172.21.15.114:0/694920641 conn(0x7f95cc0660b0 msgr2=0x7f95cc067cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:02.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.879+0000 7f95d3a00640 1 -- 172.21.15.114:0/694920641 shutdown_connections 2024-09-13T17:53:02.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:02.879+0000 7f95d3a00640 1 -- 172.21.15.114:0/694920641 wait complete. 2024-09-13T17:53:02.903 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-13T17:53:03.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.035+0000 7f5e01000640 1 Processor -- start 2024-09-13T17:53:03.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.035+0000 7f5e01000640 1 -- start start 2024-09-13T17:53:03.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.035+0000 7f5e01000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5dfc0b1c20 0x7f5dfc158a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:03.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.035+0000 7f5e01000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dfc0b2490 con 0x7f5dfc159be0 2024-09-13T17:53:03.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.035+0000 7f5e01000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dfc0b21b0 con 0x7f5dfc070420 2024-09-13T17:53:03.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.035+0000 7f5e01000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc159100 con 0x7f5dfc0b1c20 2024-09-13T17:53:03.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.035+0000 7f5df9e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5dfc159be0 0x7f5dfc0b1510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41020/0 (socket says 172.21.15.114:41020) 2024-09-13T17:53:03.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.035+0000 7f5df9e00640 1 -- 172.21.15.114:0/2439589508 learned_addr learned my addr 172.21.15.114:0/2439589508 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:03.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.035+0000 7f5df9400640 1 --2- 172.21.15.114:0/2439589508 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5dfc0b1c20 0x7f5dfc158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:03.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.035+0000 7f5df8a00640 1 -- 172.21.15.114:0/2439589508 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4026290871 0 0) 0x7f5dfc0b2490 con 0x7f5dfc159be0 2024-09-13T17:53:03.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.035+0000 7f5df8a00640 1 -- 172.21.15.114:0/2439589508 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5de0003530 con 0x7f5dfc159be0 2024-09-13T17:53:03.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.035+0000 7f5df8a00640 1 -- 172.21.15.114:0/2439589508 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2200958062 0 0) 0x7f5dfc0b21b0 con 0x7f5dfc070420 2024-09-13T17:53:03.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.035+0000 7f5df8a00640 1 -- 172.21.15.114:0/2439589508 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dfc0b2490 con 0x7f5dfc070420 2024-09-13T17:53:03.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.035+0000 7f5df9400640 1 -- 172.21.15.114:0/2439589508 >> v1:172.21.15.134:6789/0 conn(0x7f5dfc070420 legacy=0x7f5dfc0708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:03.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.035+0000 7f5df9400640 1 -- 172.21.15.114:0/2439589508 >> v1:172.21.15.114:6789/0 conn(0x7f5dfc159be0 legacy=0x7f5dfc0b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:03.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.035+0000 7f5df9400640 1 -- 172.21.15.114:0/2439589508 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dfc1593e0 con 0x7f5dfc0b1c20 2024-09-13T17:53:03.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.039+0000 7f5df9400640 1 --2- 172.21.15.114:0/2439589508 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5dfc0b1c20 0x7f5dfc158a70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5de80097f0 tx=0x7f5de801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2aae71399a90df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:03.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.039+0000 7f5df8a00640 1 -- 172.21.15.114:0/2439589508 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de80aa430 con 0x7f5dfc0b1c20 2024-09-13T17:53:03.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.039+0000 7f5df8a00640 1 -- 172.21.15.114:0/2439589508 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de80aa590 con 0x7f5dfc0b1c20 2024-09-13T17:53:03.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.039+0000 7f5df8a00640 1 -- 172.21.15.114:0/2439589508 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de80aa920 con 0x7f5dfc0b1c20 2024-09-13T17:53:03.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.039+0000 7f5e01000640 1 -- 172.21.15.114:0/2439589508 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5dfc0b1c20 msgr2=0x7f5dfc158a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:03.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.039+0000 7f5e01000640 1 --2- 172.21.15.114:0/2439589508 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5dfc0b1c20 0x7f5dfc158a70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5de80097f0 tx=0x7f5de801c4b0 comp rx=0 tx=0).stop 2024-09-13T17:53:03.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.043+0000 7f5e01000640 1 -- 172.21.15.114:0/2439589508 shutdown_connections 2024-09-13T17:53:03.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.043+0000 7f5e01000640 1 --2- 172.21.15.114:0/2439589508 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5dfc0b1c20 0x7f5dfc158a70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:03.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.043+0000 7f5e01000640 1 -- 172.21.15.114:0/2439589508 >> 172.21.15.114:0/2439589508 conn(0x7f5dfc0660b0 msgr2=0x7f5dfc069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:03.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.043+0000 7f5e01000640 1 -- 172.21.15.114:0/2439589508 shutdown_connections 2024-09-13T17:53:03.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.043+0000 7f5e01000640 1 -- 172.21.15.114:0/2439589508 wait complete. 2024-09-13T17:53:03.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.043+0000 7f5e01000640 1 Processor -- start 2024-09-13T17:53:03.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.043+0000 7f5e01000640 1 -- start start 2024-09-13T17:53:03.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.043+0000 7f5e01000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dfc070420 0x7f5dfc1549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:03.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.043+0000 7f5e01000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5dfc0b1c20 0x7f5dfc1436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:03.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.043+0000 7f5e01000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5dfc159be0 0x7f5dfc0af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:03.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.043+0000 7f5e01000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc153f90 con 0x7f5dfc070420 2024-09-13T17:53:03.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.043+0000 7f5e01000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc154550 con 0x7f5dfc159be0 2024-09-13T17:53:03.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.043+0000 7f5e01000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc0acf60 con 0x7f5dfc0b1c20 2024-09-13T17:53:03.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.043+0000 7f5df9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dfc070420 0x7f5dfc1549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:03.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.043+0000 7f5df9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dfc070420 0x7f5dfc1549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45904/0 (socket says 172.21.15.114:45904) 2024-09-13T17:53:03.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.043+0000 7f5df9e00640 1 -- 172.21.15.114:0/1941978155 learned_addr learned my addr 172.21.15.114:0/1941978155 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:03.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.043+0000 7f5df9400640 1 --2- 172.21.15.114:0/1941978155 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5dfc0b1c20 0x7f5dfc1436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:03.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.043+0000 7f5dfa800640 1 --2- 172.21.15.114:0/1941978155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5dfc159be0 0x7f5dfc0af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:03.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.043+0000 7f5df9e00640 1 -- 172.21.15.114:0/1941978155 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5dfc0b1c20 msgr2=0x7f5dfc1436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:03.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.043+0000 7f5df9e00640 1 --2- 172.21.15.114:0/1941978155 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5dfc0b1c20 0x7f5dfc1436f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:03.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.043+0000 7f5df9e00640 1 -- 172.21.15.114:0/1941978155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5dfc159be0 msgr2=0x7f5dfc0af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:03.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.043+0000 7f5df9e00640 1 --2- 172.21.15.114:0/1941978155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5dfc159be0 0x7f5dfc0af2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:03.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.043+0000 7f5df9e00640 1 -- 172.21.15.114:0/1941978155 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de8009420 con 0x7f5dfc070420 2024-09-13T17:53:03.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.043+0000 7f5df9e00640 1 --2- 172.21.15.114:0/1941978155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dfc070420 0x7f5dfc1549e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00cb20 tx=0x7f5dec00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:03.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.043+0000 7f5df2000640 1 -- 172.21.15.114:0/1941978155 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec00aca0 con 0x7f5dfc070420 2024-09-13T17:53:03.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.047+0000 7f5df2000640 1 -- 172.21.15.114:0/1941978155 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dec00ae00 con 0x7f5dfc070420 2024-09-13T17:53:03.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.047+0000 7f5e01000640 1 -- 172.21.15.114:0/1941978155 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dfc0ad200 con 0x7f5dfc070420 2024-09-13T17:53:03.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.047+0000 7f5df2000640 1 -- 172.21.15.114:0/1941978155 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec012600 con 0x7f5dfc070420 2024-09-13T17:53:03.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.047+0000 7f5e01000640 1 -- 172.21.15.114:0/1941978155 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dfc153c50 con 0x7f5dfc070420 2024-09-13T17:53:03.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.047+0000 7f5e01000640 1 -- 172.21.15.114:0/1941978155 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dfc154f20 con 0x7f5dfc070420 2024-09-13T17:53:03.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.047+0000 7f5df2000640 1 -- 172.21.15.114:0/1941978155 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5dec007070 con 0x7f5dfc070420 2024-09-13T17:53:03.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.047+0000 7f5df2000640 1 --2- 172.21.15.114:0/1941978155 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5ddc0666c0 0x7f5ddc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:03.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.047+0000 7f5df2000640 1 -- 172.21.15.114:0/1941978155 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f5dec083ef0 con 0x7f5dfc070420 2024-09-13T17:53:03.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.047+0000 7f5df9400640 1 --2- 172.21.15.114:0/1941978155 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5ddc0666c0 0x7f5ddc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:03.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.047+0000 7f5df9400640 1 --2- 172.21.15.114:0/1941978155 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5ddc0666c0 0x7f5ddc068b80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5de80ae000 tx=0x7f5de80a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:03.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.051+0000 7f5df2000640 1 -- 172.21.15.114:0/1941978155 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5dec051400 con 0x7f5dfc070420 2024-09-13T17:53:03.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.259+0000 7f5e01000640 1 -- 172.21.15.114:0/1941978155 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f5dfc0ad3f0 con 0x7f5dfc070420 2024-09-13T17:53:03.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.263+0000 7f5df2000640 1 -- 172.21.15.114:0/1941978155 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5dec054a20 con 0x7f5dfc070420 2024-09-13T17:53:03.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.263+0000 7f5e01000640 1 -- 172.21.15.114:0/1941978155 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5ddc0666c0 msgr2=0x7f5ddc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:03.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.263+0000 7f5e01000640 1 --2- 172.21.15.114:0/1941978155 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5ddc0666c0 0x7f5ddc068b80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5de80ae000 tx=0x7f5de80a7000 comp rx=0 tx=0).stop 2024-09-13T17:53:03.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.263+0000 7f5e01000640 1 -- 172.21.15.114:0/1941978155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dfc070420 msgr2=0x7f5dfc1549e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:03.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.263+0000 7f5e01000640 1 --2- 172.21.15.114:0/1941978155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dfc070420 0x7f5dfc1549e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00cb20 tx=0x7f5dec00a060 comp rx=0 tx=0).stop 2024-09-13T17:53:03.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.263+0000 7f5e01000640 1 -- 172.21.15.114:0/1941978155 shutdown_connections 2024-09-13T17:53:03.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.263+0000 7f5e01000640 1 --2- 172.21.15.114:0/1941978155 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5ddc0666c0 0x7f5ddc068b80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:03.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.263+0000 7f5e01000640 1 --2- 172.21.15.114:0/1941978155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5dfc159be0 0x7f5dfc0af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:03.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.263+0000 7f5e01000640 1 --2- 172.21.15.114:0/1941978155 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5dfc0b1c20 0x7f5dfc1436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:03.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.263+0000 7f5e01000640 1 --2- 172.21.15.114:0/1941978155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5dfc070420 0x7f5dfc1549e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:03.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.263+0000 7f5e01000640 1 -- 172.21.15.114:0/1941978155 >> 172.21.15.114:0/1941978155 conn(0x7f5dfc0660b0 msgr2=0x7f5dfc0ad9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:03.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.263+0000 7f5e01000640 1 -- 172.21.15.114:0/1941978155 shutdown_connections 2024-09-13T17:53:03.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.263+0000 7f5e01000640 1 -- 172.21.15.114:0/1941978155 wait complete. 2024-09-13T17:53:03.288 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-13T17:53:03.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.419+0000 7f06eae00640 1 Processor -- start 2024-09-13T17:53:03.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.419+0000 7f06eae00640 1 -- start start 2024-09-13T17:53:03.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.419+0000 7f06eae00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06e413f420 0x7f06e406d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:03.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.419+0000 7f06eae00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f06e406da90 0x7f06e40cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:03.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.419+0000 7f06eae00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e40cd220 con 0x7f06e413c240 2024-09-13T17:53:03.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.419+0000 7f06eae00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e406ded0 con 0x7f06e406da90 2024-09-13T17:53:03.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.419+0000 7f06eae00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e415a740 con 0x7f06e413f420 2024-09-13T17:53:03.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.423+0000 7f06db400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06e413f420 0x7f06e406d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:03.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.423+0000 7f06db400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06e413f420 0x7f06e406d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:54532/0 (socket says 172.21.15.114:54532) 2024-09-13T17:53:03.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.423+0000 7f06db400640 1 -- 172.21.15.114:0/3124013569 learned_addr learned my addr 172.21.15.114:0/3124013569 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:03.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.423+0000 7f06e8e00640 1 --2- 172.21.15.114:0/3124013569 >> v2:172.21.15.134:3300/0 conn(0x7f06e406da90 0x7f06e40cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:03.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.423+0000 7f06db400640 1 -- 172.21.15.114:0/3124013569 >> v2:172.21.15.134:3300/0 conn(0x7f06e406da90 msgr2=0x7f06e40cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:03.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.423+0000 7f06db400640 1 --2- 172.21.15.114:0/3124013569 >> v2:172.21.15.134:3300/0 conn(0x7f06e406da90 0x7f06e40cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:03.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.423+0000 7f06db400640 1 -- 172.21.15.114:0/3124013569 >> v1:172.21.15.134:6789/0 conn(0x7f06e413c240 legacy=0x7f06e413c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:03.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.423+0000 7f06db400640 1 -- 172.21.15.114:0/3124013569 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e4159bc0 con 0x7f06e413f420 2024-09-13T17:53:03.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.423+0000 7f06e8e00640 1 --2- 172.21.15.114:0/3124013569 >> v2:172.21.15.134:3300/0 conn(0x7f06e406da90 0x7f06e40cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:53:03.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.423+0000 7f06db400640 1 --2- 172.21.15.114:0/3124013569 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06e413f420 0x7f06e406d550 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009870 tx=0x7f06cc01e740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f032a42f58d205 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:03.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.427+0000 7f06e3400640 1 -- 172.21.15.114:0/3124013569 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc0a8710 con 0x7f06e413f420 2024-09-13T17:53:03.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.427+0000 7f06e3400640 1 -- 172.21.15.114:0/3124013569 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06cc0a8870 con 0x7f06e413f420 2024-09-13T17:53:03.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.427+0000 7f06e3400640 1 -- 172.21.15.114:0/3124013569 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc0a8c00 con 0x7f06e413f420 2024-09-13T17:53:03.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.427+0000 7f06eae00640 1 -- 172.21.15.114:0/3124013569 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06e413f420 msgr2=0x7f06e406d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:03.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.427+0000 7f06eae00640 1 --2- 172.21.15.114:0/3124013569 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06e413f420 0x7f06e406d550 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009870 tx=0x7f06cc01e740 comp rx=0 tx=0).stop 2024-09-13T17:53:03.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.427+0000 7f06eae00640 1 -- 172.21.15.114:0/3124013569 shutdown_connections 2024-09-13T17:53:03.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.427+0000 7f06eae00640 1 --2- 172.21.15.114:0/3124013569 >> v2:172.21.15.134:3300/0 conn(0x7f06e406da90 0x7f06e40cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:03.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.427+0000 7f06eae00640 1 --2- 172.21.15.114:0/3124013569 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06e413f420 0x7f06e406d550 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:03.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.427+0000 7f06eae00640 1 -- 172.21.15.114:0/3124013569 >> 172.21.15.114:0/3124013569 conn(0x7f06e40660b0 msgr2=0x7f06e4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:03.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.427+0000 7f06eae00640 1 -- 172.21.15.114:0/3124013569 shutdown_connections 2024-09-13T17:53:03.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.427+0000 7f06eae00640 1 -- 172.21.15.114:0/3124013569 wait complete. 2024-09-13T17:53:03.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.427+0000 7f06eae00640 1 Processor -- start 2024-09-13T17:53:03.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.427+0000 7f06eae00640 1 -- start start 2024-09-13T17:53:03.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.427+0000 7f06eae00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06e406da90 0x7f06e413d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:03.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.427+0000 7f06eae00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06e413c240 0x7f06e4138660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:03.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.427+0000 7f06eae00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06e413f420 0x7f06e413de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:03.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.427+0000 7f06eae00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e40ab8e0 con 0x7f06e406da90 2024-09-13T17:53:03.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.427+0000 7f06eae00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e4158080 con 0x7f06e413c240 2024-09-13T17:53:03.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.427+0000 7f06eae00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e4158360 con 0x7f06e413f420 2024-09-13T17:53:03.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.427+0000 7f06e3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06e406da90 0x7f06e413d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:03.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.427+0000 7f06e3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06e406da90 0x7f06e413d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45920/0 (socket says 172.21.15.114:45920) 2024-09-13T17:53:03.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.427+0000 7f06e3e00640 1 -- 172.21.15.114:0/3643813389 learned_addr learned my addr 172.21.15.114:0/3643813389 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:03.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.427+0000 7f06db400640 1 --2- 172.21.15.114:0/3643813389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06e413c240 0x7f06e4138660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:03.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.427+0000 7f06e8e00640 1 --2- 172.21.15.114:0/3643813389 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06e413f420 0x7f06e413de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:03.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.431+0000 7f06e3e00640 1 -- 172.21.15.114:0/3643813389 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06e413f420 msgr2=0x7f06e413de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:03.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.431+0000 7f06e3e00640 1 --2- 172.21.15.114:0/3643813389 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06e413f420 0x7f06e413de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:03.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.431+0000 7f06e3e00640 1 -- 172.21.15.114:0/3643813389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06e413c240 msgr2=0x7f06e4138660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:03.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.431+0000 7f06e3e00640 1 --2- 172.21.15.114:0/3643813389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06e413c240 0x7f06e4138660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:03.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.431+0000 7f06e3e00640 1 -- 172.21.15.114:0/3643813389 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc009a70 con 0x7f06e406da90 2024-09-13T17:53:03.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.431+0000 7f06e3e00640 1 --2- 172.21.15.114:0/3643813389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06e406da90 0x7f06e413d510 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f06d400c500 tx=0x7f06d400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:03.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.431+0000 7f06e0c00640 1 -- 172.21.15.114:0/3643813389 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d40052d0 con 0x7f06e406da90 2024-09-13T17:53:03.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.431+0000 7f06e0c00640 1 -- 172.21.15.114:0/3643813389 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d4005430 con 0x7f06e406da90 2024-09-13T17:53:03.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.431+0000 7f06eae00640 1 -- 172.21.15.114:0/3643813389 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06cc0094d0 con 0x7f06e406da90 2024-09-13T17:53:03.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.431+0000 7f06e0c00640 1 -- 172.21.15.114:0/3643813389 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d4003840 con 0x7f06e406da90 2024-09-13T17:53:03.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.431+0000 7f06eae00640 1 -- 172.21.15.114:0/3643813389 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e40abe10 con 0x7f06e406da90 2024-09-13T17:53:03.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.431+0000 7f06eae00640 1 -- 172.21.15.114:0/3643813389 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e40ac000 con 0x7f06e406da90 2024-09-13T17:53:03.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.431+0000 7f06e0c00640 1 -- 172.21.15.114:0/3643813389 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f06d40039a0 con 0x7f06e406da90 2024-09-13T17:53:03.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.435+0000 7f06e0c00640 1 --2- 172.21.15.114:0/3643813389 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f06c0066690 0x7f06c0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:03.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.435+0000 7f06e0c00640 1 -- 172.21.15.114:0/3643813389 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f06d40834c0 con 0x7f06e406da90 2024-09-13T17:53:03.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.435+0000 7f06db400640 1 --2- 172.21.15.114:0/3643813389 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f06c0066690 0x7f06c0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:03.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.435+0000 7f06db400640 1 --2- 172.21.15.114:0/3643813389 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f06c0066690 0x7f06c0068b50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0b1000 tx=0x7f06cc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:03.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.439+0000 7f06e0c00640 1 -- 172.21.15.114:0/3643813389 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f06d4050a50 con 0x7f06e406da90 2024-09-13T17:53:03.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.647+0000 7f06eae00640 1 -- 172.21.15.114:0/3643813389 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f06e4159790 con 0x7f06e406da90 2024-09-13T17:53:03.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.651+0000 7f06e0c00640 1 -- 172.21.15.114:0/3643813389 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f06d4054070 con 0x7f06e406da90 2024-09-13T17:53:03.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.651+0000 7f06eae00640 1 -- 172.21.15.114:0/3643813389 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f06c0066690 msgr2=0x7f06c0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:03.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.651+0000 7f06eae00640 1 --2- 172.21.15.114:0/3643813389 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f06c0066690 0x7f06c0068b50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0b1000 tx=0x7f06cc008040 comp rx=0 tx=0).stop 2024-09-13T17:53:03.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.651+0000 7f06eae00640 1 -- 172.21.15.114:0/3643813389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06e406da90 msgr2=0x7f06e413d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:03.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.651+0000 7f06eae00640 1 --2- 172.21.15.114:0/3643813389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06e406da90 0x7f06e413d510 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f06d400c500 tx=0x7f06d400c900 comp rx=0 tx=0).stop 2024-09-13T17:53:03.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.651+0000 7f06eae00640 1 -- 172.21.15.114:0/3643813389 shutdown_connections 2024-09-13T17:53:03.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.651+0000 7f06eae00640 1 --2- 172.21.15.114:0/3643813389 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f06c0066690 0x7f06c0068b50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:03.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.651+0000 7f06eae00640 1 --2- 172.21.15.114:0/3643813389 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f06e413f420 0x7f06e413de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:03.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.651+0000 7f06eae00640 1 --2- 172.21.15.114:0/3643813389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06e413c240 0x7f06e4138660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:03.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.651+0000 7f06eae00640 1 --2- 172.21.15.114:0/3643813389 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06e406da90 0x7f06e413d510 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:03.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.651+0000 7f06eae00640 1 -- 172.21.15.114:0/3643813389 >> 172.21.15.114:0/3643813389 conn(0x7f06e40660b0 msgr2=0x7f06e40ad910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:03.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.651+0000 7f06eae00640 1 -- 172.21.15.114:0/3643813389 shutdown_connections 2024-09-13T17:53:03.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.651+0000 7f06eae00640 1 -- 172.21.15.114:0/3643813389 wait complete. 2024-09-13T17:53:03.675 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-13T17:53:03.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.807+0000 7f1c4ec00640 1 Processor -- start 2024-09-13T17:53:03.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.807+0000 7f1c4ec00640 1 -- start start 2024-09-13T17:53:03.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.807+0000 7f1c4ec00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c480713c0 0x7f1c480b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:03.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.807+0000 7f1c4ec00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1c48159be0 0x7f1c480b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:03.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.807+0000 7f1c4ec00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c480b2490 con 0x7f1c48158a70 2024-09-13T17:53:03.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.807+0000 7f1c4ec00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c480b1f90 con 0x7f1c48159be0 2024-09-13T17:53:03.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.807+0000 7f1c4ec00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c48158e50 con 0x7f1c480713c0 2024-09-13T17:53:03.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.807+0000 7f1c4cc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1c48159be0 0x7f1c480b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:03.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.807+0000 7f1c4cc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1c48159be0 0x7f1c480b1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45934/0 (socket says 172.21.15.114:45934) 2024-09-13T17:53:03.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.807+0000 7f1c4cc00640 1 -- 172.21.15.114:0/3676737730 learned_addr learned my addr 172.21.15.114:0/3676737730 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:03.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.807+0000 7f1c3f400640 1 --2- 172.21.15.114:0/3676737730 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c480713c0 0x7f1c480b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:03.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.807+0000 7f1c4cc00640 1 -- 172.21.15.114:0/3676737730 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c480713c0 msgr2=0x7f1c480b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:03.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.807+0000 7f1c4cc00640 1 --2- 172.21.15.114:0/3676737730 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c480713c0 0x7f1c480b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:03.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.807+0000 7f1c4cc00640 1 -- 172.21.15.114:0/3676737730 >> v1:172.21.15.134:6789/0 conn(0x7f1c48158a70 legacy=0x7f1c48070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:03.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.807+0000 7f1c4cc00640 1 -- 172.21.15.114:0/3676737730 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c480b21b0 con 0x7f1c48159be0 2024-09-13T17:53:03.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.811+0000 7f1c4cc00640 1 --2- 172.21.15.114:0/3676737730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c48159be0 0x7f1c480b1a50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1c40009e50 tx=0x7f1c4001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc11fa9f908dbea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:03.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.811+0000 7f1c47400640 1 -- 172.21.15.114:0/3676737730 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c400a57b0 con 0x7f1c48159be0 2024-09-13T17:53:03.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.811+0000 7f1c47400640 1 -- 172.21.15.114:0/3676737730 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c400a5910 con 0x7f1c48159be0 2024-09-13T17:53:03.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.811+0000 7f1c47400640 1 -- 172.21.15.114:0/3676737730 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c400a5ca0 con 0x7f1c48159be0 2024-09-13T17:53:03.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.811+0000 7f1c4ec00640 1 -- 172.21.15.114:0/3676737730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c48159be0 msgr2=0x7f1c480b1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:03.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.811+0000 7f1c4ec00640 1 --2- 172.21.15.114:0/3676737730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c48159be0 0x7f1c480b1a50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1c40009e50 tx=0x7f1c4001c970 comp rx=0 tx=0).stop 2024-09-13T17:53:03.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.811+0000 7f1c4ec00640 1 -- 172.21.15.114:0/3676737730 shutdown_connections 2024-09-13T17:53:03.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.811+0000 7f1c4ec00640 1 --2- 172.21.15.114:0/3676737730 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c480713c0 0x7f1c480b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:03.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.811+0000 7f1c4ec00640 1 --2- 172.21.15.114:0/3676737730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c48159be0 0x7f1c480b1a50 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:03.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.811+0000 7f1c4ec00640 1 -- 172.21.15.114:0/3676737730 >> 172.21.15.114:0/3676737730 conn(0x7f1c480660b0 msgr2=0x7f1c48069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:03.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.811+0000 7f1c4ec00640 1 -- 172.21.15.114:0/3676737730 shutdown_connections 2024-09-13T17:53:03.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.811+0000 7f1c4ec00640 1 -- 172.21.15.114:0/3676737730 wait complete. 2024-09-13T17:53:03.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.815+0000 7f1c4ec00640 1 Processor -- start 2024-09-13T17:53:03.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.815+0000 7f1c4ec00640 1 -- start start 2024-09-13T17:53:03.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.815+0000 7f1c4ec00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c480713c0 0x7f1c48146e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:03.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.815+0000 7f1c4ec00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c48158a70 0x7f1c480b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:03.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.815+0000 7f1c4ec00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c48159be0 0x7f1c480b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:03.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.815+0000 7f1c4ec00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4814e9b0 con 0x7f1c48159be0 2024-09-13T17:53:03.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.815+0000 7f1c4ec00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4814ec90 con 0x7f1c480713c0 2024-09-13T17:53:03.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.815+0000 7f1c4ec00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4814ef70 con 0x7f1c48158a70 2024-09-13T17:53:03.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.815+0000 7f1c4cc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c48159be0 0x7f1c480b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:03.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.815+0000 7f1c4cc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c48159be0 0x7f1c480b2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45938/0 (socket says 172.21.15.114:45938) 2024-09-13T17:53:03.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.815+0000 7f1c4cc00640 1 -- 172.21.15.114:0/3847488713 learned_addr learned my addr 172.21.15.114:0/3847488713 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:03.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.815+0000 7f1c47e00640 1 --2- 172.21.15.114:0/3847488713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c480713c0 0x7f1c48146e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:03.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.815+0000 7f1c3f400640 1 --2- 172.21.15.114:0/3847488713 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c48158a70 0x7f1c480b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:03.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.815+0000 7f1c4cc00640 1 -- 172.21.15.114:0/3847488713 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c48158a70 msgr2=0x7f1c480b28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:03.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.815+0000 7f1c4cc00640 1 --2- 172.21.15.114:0/3847488713 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c48158a70 0x7f1c480b28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:03.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.815+0000 7f1c4cc00640 1 -- 172.21.15.114:0/3847488713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c480713c0 msgr2=0x7f1c48146e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:03.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.815+0000 7f1c4cc00640 1 --2- 172.21.15.114:0/3847488713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c480713c0 0x7f1c48146e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:03.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.815+0000 7f1c4cc00640 1 -- 172.21.15.114:0/3847488713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c40009b30 con 0x7f1c48159be0 2024-09-13T17:53:03.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.815+0000 7f1c4cc00640 1 --2- 172.21.15.114:0/3847488713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c48159be0 0x7f1c480b2e10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1c4001a5a0 tx=0x7f1c40019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:03.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.815+0000 7f1c44c00640 1 -- 172.21.15.114:0/3847488713 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c400b8670 con 0x7f1c48159be0 2024-09-13T17:53:03.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.815+0000 7f1c44c00640 1 -- 172.21.15.114:0/3847488713 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c400b87d0 con 0x7f1c48159be0 2024-09-13T17:53:03.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.815+0000 7f1c4ec00640 1 -- 172.21.15.114:0/3847488713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c4814f250 con 0x7f1c48159be0 2024-09-13T17:53:03.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.815+0000 7f1c44c00640 1 -- 172.21.15.114:0/3847488713 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c400b8b60 con 0x7f1c48159be0 2024-09-13T17:53:03.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.815+0000 7f1c4ec00640 1 -- 172.21.15.114:0/3847488713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c481474f0 con 0x7f1c48159be0 2024-09-13T17:53:03.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.819+0000 7f1c4ec00640 1 -- 172.21.15.114:0/3847488713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c481476e0 con 0x7f1c48159be0 2024-09-13T17:53:03.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.819+0000 7f1c44c00640 1 -- 172.21.15.114:0/3847488713 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1c400b8cc0 con 0x7f1c48159be0 2024-09-13T17:53:03.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.819+0000 7f1c44c00640 1 --2- 172.21.15.114:0/3847488713 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1c24066690 0x7f1c24068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:03.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.819+0000 7f1c44c00640 1 -- 172.21.15.114:0/3847488713 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f1c4011f5d0 con 0x7f1c48159be0 2024-09-13T17:53:03.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.819+0000 7f1c47e00640 1 --2- 172.21.15.114:0/3847488713 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1c24066690 0x7f1c24068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:03.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.819+0000 7f1c47e00640 1 --2- 172.21.15.114:0/3847488713 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1c24066690 0x7f1c24068b50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1c38000f70 tx=0x7f1c38009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:03.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:03.823+0000 7f1c44c00640 1 -- 172.21.15.114:0/3847488713 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1c400ecb70 con 0x7f1c48159be0 2024-09-13T17:53:04.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.035+0000 7f1c4ec00640 1 -- 172.21.15.114:0/3847488713 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f1c48070cb0 con 0x7f1c48159be0 2024-09-13T17:53:04.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.039+0000 7f1c44c00640 1 -- 172.21.15.114:0/3847488713 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1c400ace80 con 0x7f1c48159be0 2024-09-13T17:53:04.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.043+0000 7f1c4ec00640 1 -- 172.21.15.114:0/3847488713 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1c24066690 msgr2=0x7f1c24068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:04.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.043+0000 7f1c4ec00640 1 --2- 172.21.15.114:0/3847488713 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1c24066690 0x7f1c24068b50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1c38000f70 tx=0x7f1c38009040 comp rx=0 tx=0).stop 2024-09-13T17:53:04.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.043+0000 7f1c4ec00640 1 -- 172.21.15.114:0/3847488713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c48159be0 msgr2=0x7f1c480b2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:04.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.043+0000 7f1c4ec00640 1 --2- 172.21.15.114:0/3847488713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c48159be0 0x7f1c480b2e10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1c4001a5a0 tx=0x7f1c40019710 comp rx=0 tx=0).stop 2024-09-13T17:53:04.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.043+0000 7f1c4ec00640 1 -- 172.21.15.114:0/3847488713 shutdown_connections 2024-09-13T17:53:04.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.043+0000 7f1c4ec00640 1 --2- 172.21.15.114:0/3847488713 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1c24066690 0x7f1c24068b50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.043+0000 7f1c4ec00640 1 --2- 172.21.15.114:0/3847488713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c48159be0 0x7f1c480b2e10 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.043+0000 7f1c4ec00640 1 --2- 172.21.15.114:0/3847488713 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1c48158a70 0x7f1c480b28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.043+0000 7f1c4ec00640 1 --2- 172.21.15.114:0/3847488713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c480713c0 0x7f1c48146e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.043+0000 7f1c4ec00640 1 -- 172.21.15.114:0/3847488713 >> 172.21.15.114:0/3847488713 conn(0x7f1c480660b0 msgr2=0x7f1c480cce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:04.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.043+0000 7f1c4ec00640 1 -- 172.21.15.114:0/3847488713 shutdown_connections 2024-09-13T17:53:04.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.043+0000 7f1c4ec00640 1 -- 172.21.15.114:0/3847488713 wait complete. 2024-09-13T17:53:04.065 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-13T17:53:04.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.195+0000 7f65cf000640 1 Processor -- start 2024-09-13T17:53:04.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.195+0000 7f65cf000640 1 -- start start 2024-09-13T17:53:04.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.199+0000 7f65cf000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f65c813c240 0x7f65c813f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:04.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.199+0000 7f65cf000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f65c813c980 0x7f65c806d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:04.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.199+0000 7f65cf000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65c80cd220 con 0x7f65c806da90 2024-09-13T17:53:04.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.199+0000 7f65cf000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c806df40 con 0x7f65c813c980 2024-09-13T17:53:04.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.199+0000 7f65cf000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c813f960 con 0x7f65c813c240 2024-09-13T17:53:04.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.199+0000 7f65bf400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f65c813c980 0x7f65c806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:04.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.199+0000 7f65bf400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f65c813c980 0x7f65c806d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45952/0 (socket says 172.21.15.114:45952) 2024-09-13T17:53:04.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.199+0000 7f65bf400640 1 -- 172.21.15.114:0/3395865834 learned_addr learned my addr 172.21.15.114:0/3395865834 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:04.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.199+0000 7f65c7e00640 1 --2- 172.21.15.114:0/3395865834 >> v2:172.21.15.134:3300/0 conn(0x7f65c813c240 0x7f65c813f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:04.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.199+0000 7f65bf400640 1 -- 172.21.15.114:0/3395865834 >> v2:172.21.15.134:3300/0 conn(0x7f65c813c240 msgr2=0x7f65c813f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:04.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.199+0000 7f65bf400640 1 --2- 172.21.15.114:0/3395865834 >> v2:172.21.15.134:3300/0 conn(0x7f65c813c240 0x7f65c813f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.199+0000 7f65bf400640 1 -- 172.21.15.114:0/3395865834 >> v1:172.21.15.134:6789/0 conn(0x7f65c806da90 legacy=0x7f65c80cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:04.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.199+0000 7f65bf400640 1 -- 172.21.15.114:0/3395865834 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c815a740 con 0x7f65c813c980 2024-09-13T17:53:04.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.199+0000 7f65bf400640 1 --2- 172.21.15.114:0/3395865834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65c813c980 0x7f65c806d550 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f65c806e720 tx=0x7f65b001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65839cb9b13fea7e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:04.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.203+0000 7f65c7400640 1 -- 172.21.15.114:0/3395865834 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b00aa650 con 0x7f65c813c980 2024-09-13T17:53:04.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.203+0000 7f65c7400640 1 -- 172.21.15.114:0/3395865834 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b00aa7b0 con 0x7f65c813c980 2024-09-13T17:53:04.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.203+0000 7f65c7400640 1 -- 172.21.15.114:0/3395865834 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b00aab40 con 0x7f65c813c980 2024-09-13T17:53:04.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.203+0000 7f65cf000640 1 -- 172.21.15.114:0/3395865834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65c813c980 msgr2=0x7f65c806d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:04.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.203+0000 7f65cf000640 1 --2- 172.21.15.114:0/3395865834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65c813c980 0x7f65c806d550 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f65c806e720 tx=0x7f65b001c4f0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.203+0000 7f65cf000640 1 -- 172.21.15.114:0/3395865834 shutdown_connections 2024-09-13T17:53:04.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.203+0000 7f65cf000640 1 --2- 172.21.15.114:0/3395865834 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65c813c980 0x7f65c806d550 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.203+0000 7f65cf000640 1 --2- 172.21.15.114:0/3395865834 >> v2:172.21.15.134:3300/0 conn(0x7f65c813c240 0x7f65c813f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.203+0000 7f65cf000640 1 -- 172.21.15.114:0/3395865834 >> 172.21.15.114:0/3395865834 conn(0x7f65c80660b0 msgr2=0x7f65c8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:04.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.203+0000 7f65cf000640 1 -- 172.21.15.114:0/3395865834 shutdown_connections 2024-09-13T17:53:04.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.203+0000 7f65cf000640 1 -- 172.21.15.114:0/3395865834 wait complete. 2024-09-13T17:53:04.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.203+0000 7f65cf000640 1 Processor -- start 2024-09-13T17:53:04.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.203+0000 7f65cf000640 1 -- start start 2024-09-13T17:53:04.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.203+0000 7f65cf000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65c806da90 0x7f65c80c4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:04.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.203+0000 7f65cf000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65c813c240 0x7f65c81566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:04.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.203+0000 7f65cf000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65c813c980 0x7f65c80ca190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:04.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.203+0000 7f65cf000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c8156c10 con 0x7f65c806da90 2024-09-13T17:53:04.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.203+0000 7f65cf000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c80ca9a0 con 0x7f65c813c980 2024-09-13T17:53:04.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.203+0000 7f65cf000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c80af5f0 con 0x7f65c813c240 2024-09-13T17:53:04.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.203+0000 7f65c7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65c806da90 0x7f65c80c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:04.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.203+0000 7f65c7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65c806da90 0x7f65c80c4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45962/0 (socket says 172.21.15.114:45962) 2024-09-13T17:53:04.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.203+0000 7f65c7e00640 1 -- 172.21.15.114:0/160249536 learned_addr learned my addr 172.21.15.114:0/160249536 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:04.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.203+0000 7f65bf400640 1 --2- 172.21.15.114:0/160249536 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65c813c240 0x7f65c81566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:04.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.203+0000 7f65cd000640 1 --2- 172.21.15.114:0/160249536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65c813c980 0x7f65c80ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:04.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.207+0000 7f65c7e00640 1 -- 172.21.15.114:0/160249536 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65c813c240 msgr2=0x7f65c81566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:04.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.207+0000 7f65c7e00640 1 --2- 172.21.15.114:0/160249536 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65c813c240 0x7f65c81566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.207+0000 7f65c7e00640 1 -- 172.21.15.114:0/160249536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65c813c980 msgr2=0x7f65c80ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:04.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.207+0000 7f65c7e00640 1 --2- 172.21.15.114:0/160249536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65c813c980 0x7f65c80ca190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.207+0000 7f65c7e00640 1 -- 172.21.15.114:0/160249536 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b00094d0 con 0x7f65c806da90 2024-09-13T17:53:04.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.207+0000 7f65c7e00640 1 --2- 172.21.15.114:0/160249536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65c806da90 0x7f65c80c4090 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f65b800e930 tx=0x7f65b800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:04.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.207+0000 7f65c4c00640 1 -- 172.21.15.114:0/160249536 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b8009690 con 0x7f65c806da90 2024-09-13T17:53:04.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.207+0000 7f65c4c00640 1 -- 172.21.15.114:0/160249536 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b800ca00 con 0x7f65c806da90 2024-09-13T17:53:04.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.207+0000 7f65cf000640 1 -- 172.21.15.114:0/160249536 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c80ca6d0 con 0x7f65c806da90 2024-09-13T17:53:04.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.207+0000 7f65c4c00640 1 -- 172.21.15.114:0/160249536 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b800cd70 con 0x7f65c806da90 2024-09-13T17:53:04.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.207+0000 7f65cf000640 1 -- 172.21.15.114:0/160249536 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c80aefa0 con 0x7f65c806da90 2024-09-13T17:53:04.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.207+0000 7f65cf000640 1 -- 172.21.15.114:0/160249536 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c8070620 con 0x7f65c806da90 2024-09-13T17:53:04.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.207+0000 7f65c4c00640 1 -- 172.21.15.114:0/160249536 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f65b8013470 con 0x7f65c806da90 2024-09-13T17:53:04.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.207+0000 7f65c4c00640 1 --2- 172.21.15.114:0/160249536 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f65a4066690 0x7f65a4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:04.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.207+0000 7f65c4c00640 1 -- 172.21.15.114:0/160249536 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f65b8084510 con 0x7f65c806da90 2024-09-13T17:53:04.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.207+0000 7f65bf400640 1 --2- 172.21.15.114:0/160249536 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f65a4066690 0x7f65a4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:04.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.211+0000 7f65bf400640 1 --2- 172.21.15.114:0/160249536 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f65a4066690 0x7f65a4068b50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f65b00ae000 tx=0x7f65b00b5040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:04.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.211+0000 7f65c4c00640 1 -- 172.21.15.114:0/160249536 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f65b8051bf0 con 0x7f65c806da90 2024-09-13T17:53:04.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.419+0000 7f65cf000640 1 -- 172.21.15.114:0/160249536 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f65c815a1b0 con 0x7f65c806da90 2024-09-13T17:53:04.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.423+0000 7f65c4c00640 1 -- 172.21.15.114:0/160249536 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f65b8055210 con 0x7f65c806da90 2024-09-13T17:53:04.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.427+0000 7f65cf000640 1 -- 172.21.15.114:0/160249536 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f65a4066690 msgr2=0x7f65a4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:04.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.427+0000 7f65cf000640 1 --2- 172.21.15.114:0/160249536 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f65a4066690 0x7f65a4068b50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f65b00ae000 tx=0x7f65b00b5040 comp rx=0 tx=0).stop 2024-09-13T17:53:04.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.427+0000 7f65cf000640 1 -- 172.21.15.114:0/160249536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65c806da90 msgr2=0x7f65c80c4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:04.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.427+0000 7f65cf000640 1 --2- 172.21.15.114:0/160249536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65c806da90 0x7f65c80c4090 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f65b800e930 tx=0x7f65b800edf0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.427+0000 7f65cf000640 1 -- 172.21.15.114:0/160249536 shutdown_connections 2024-09-13T17:53:04.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.427+0000 7f65cf000640 1 --2- 172.21.15.114:0/160249536 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f65a4066690 0x7f65a4068b50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.427+0000 7f65cf000640 1 --2- 172.21.15.114:0/160249536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65c813c980 0x7f65c80ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.427+0000 7f65cf000640 1 --2- 172.21.15.114:0/160249536 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f65c813c240 0x7f65c81566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.427+0000 7f65cf000640 1 --2- 172.21.15.114:0/160249536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f65c806da90 0x7f65c80c4090 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.427+0000 7f65cf000640 1 -- 172.21.15.114:0/160249536 >> 172.21.15.114:0/160249536 conn(0x7f65c80660b0 msgr2=0x7f65c8139fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:04.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.427+0000 7f65cf000640 1 -- 172.21.15.114:0/160249536 shutdown_connections 2024-09-13T17:53:04.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.427+0000 7f65cf000640 1 -- 172.21.15.114:0/160249536 wait complete. 2024-09-13T17:53:04.450 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-13T17:53:04.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.583+0000 7f71b5600640 1 Processor -- start 2024-09-13T17:53:04.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.583+0000 7f71b5600640 1 -- start start 2024-09-13T17:53:04.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.583+0000 7f71b5600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b013c240 0x7f71b013f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:04.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.583+0000 7f71b5600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f71b013c980 0x7f71b006d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:04.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.583+0000 7f71b5600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b00cd220 con 0x7f71b006da90 2024-09-13T17:53:04.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.583+0000 7f71b5600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b006df00 con 0x7f71b013c980 2024-09-13T17:53:04.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.583+0000 7f71b5600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b013f960 con 0x7f71b013c240 2024-09-13T17:53:04.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.583+0000 7f71ae000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f71b013c980 0x7f71b006d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:04.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.583+0000 7f71aea00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b013c240 0x7f71b013f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:04.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.583+0000 7f71ae000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f71b013c980 0x7f71b006d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:33476/0 (socket says 172.21.15.114:33476) 2024-09-13T17:53:04.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.583+0000 7f71ae000640 1 -- 172.21.15.114:0/1414438993 learned_addr learned my addr 172.21.15.114:0/1414438993 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:04.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.583+0000 7f71af400640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f71b006da90 0x7f71b00cd650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:43820/0 (socket says 172.21.15.114:43820) 2024-09-13T17:53:04.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.583+0000 7f71ae000640 1 -- 172.21.15.114:0/1414438993 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b013c240 msgr2=0x7f71b013f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:04.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.583+0000 7f71ae000640 1 --2- 172.21.15.114:0/1414438993 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b013c240 0x7f71b013f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.583+0000 7f71ae000640 1 -- 172.21.15.114:0/1414438993 >> v1:172.21.15.134:6789/0 conn(0x7f71b006da90 legacy=0x7f71b00cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:04.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.583+0000 7f71ae000640 1 -- 172.21.15.114:0/1414438993 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b015a740 con 0x7f71b013c980 2024-09-13T17:53:04.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.583+0000 7f71ad600640 1 -- 172.21.15.114:0/1414438993 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517006144 0 0) 0x7f71b00cd220 con 0x7f71b006da90 2024-09-13T17:53:04.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.583+0000 7f71aea00640 1 --2- 172.21.15.114:0/1414438993 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b013c240 0x7f71b013f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:53:04.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.587+0000 7f71ae000640 1 --2- 172.21.15.114:0/1414438993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b013c980 0x7f71b006d550 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f719c009870 tx=0x7f719c01c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9948957cf37c95e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:04.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.587+0000 7f71ad600640 1 -- 172.21.15.114:0/1414438993 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c0a95f0 con 0x7f71b013c980 2024-09-13T17:53:04.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.587+0000 7f71ad600640 1 -- 172.21.15.114:0/1414438993 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719c0a9750 con 0x7f71b013c980 2024-09-13T17:53:04.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.587+0000 7f71ad600640 1 -- 172.21.15.114:0/1414438993 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c0a9ae0 con 0x7f71b013c980 2024-09-13T17:53:04.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.587+0000 7f71b5600640 1 -- 172.21.15.114:0/1414438993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b013c980 msgr2=0x7f71b006d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:04.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.587+0000 7f71b5600640 1 --2- 172.21.15.114:0/1414438993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b013c980 0x7f71b006d550 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f719c009870 tx=0x7f719c01c530 comp rx=0 tx=0).stop 2024-09-13T17:53:04.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.587+0000 7f71b5600640 1 -- 172.21.15.114:0/1414438993 shutdown_connections 2024-09-13T17:53:04.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.587+0000 7f71b5600640 1 --2- 172.21.15.114:0/1414438993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b013c980 0x7f71b006d550 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.587+0000 7f71b5600640 1 --2- 172.21.15.114:0/1414438993 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b013c240 0x7f71b013f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.587+0000 7f71b5600640 1 -- 172.21.15.114:0/1414438993 >> 172.21.15.114:0/1414438993 conn(0x7f71b00660b0 msgr2=0x7f71b0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:04.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.587+0000 7f71b5600640 1 -- 172.21.15.114:0/1414438993 shutdown_connections 2024-09-13T17:53:04.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.587+0000 7f71b5600640 1 -- 172.21.15.114:0/1414438993 wait complete. 2024-09-13T17:53:04.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.591+0000 7f71b5600640 1 Processor -- start 2024-09-13T17:53:04.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.591+0000 7f71b5600640 1 -- start start 2024-09-13T17:53:04.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.591+0000 7f71b5600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b006da90 0x7f71b01f8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:04.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.591+0000 7f71b5600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b013c240 0x7f71b0133cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:04.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.591+0000 7f71b5600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71b013c980 0x7f71b0134230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:04.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.591+0000 7f71b5600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b01f90e0 con 0x7f71b013c980 2024-09-13T17:53:04.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.591+0000 7f71b5600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b01f4ba0 con 0x7f71b013c240 2024-09-13T17:53:04.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.591+0000 7f71b5600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b01f4db0 con 0x7f71b006da90 2024-09-13T17:53:04.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.591+0000 7f71af400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71b013c980 0x7f71b0134230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:04.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.591+0000 7f71af400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71b013c980 0x7f71b0134230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45964/0 (socket says 172.21.15.114:45964) 2024-09-13T17:53:04.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.591+0000 7f71af400640 1 -- 172.21.15.114:0/408792519 learned_addr learned my addr 172.21.15.114:0/408792519 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:04.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.591+0000 7f71aea00640 1 --2- 172.21.15.114:0/408792519 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b006da90 0x7f71b01f8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:04.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.591+0000 7f71ae000640 1 --2- 172.21.15.114:0/408792519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b013c240 0x7f71b0133cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:04.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.591+0000 7f71af400640 1 -- 172.21.15.114:0/408792519 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b006da90 msgr2=0x7f71b01f8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:04.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.591+0000 7f71af400640 1 --2- 172.21.15.114:0/408792519 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b006da90 0x7f71b01f8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.591+0000 7f71af400640 1 -- 172.21.15.114:0/408792519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b013c240 msgr2=0x7f71b0133cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:04.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.591+0000 7f71af400640 1 --2- 172.21.15.114:0/408792519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b013c240 0x7f71b0133cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.591+0000 7f71af400640 1 -- 172.21.15.114:0/408792519 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a0009a70 con 0x7f71b013c980 2024-09-13T17:53:04.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.591+0000 7f71af400640 1 --2- 172.21.15.114:0/408792519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71b013c980 0x7f71b0134230 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f71a800c470 tx=0x7f71a800c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:04.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.591+0000 7f71a6a00640 1 -- 172.21.15.114:0/408792519 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a80074e0 con 0x7f71b013c980 2024-09-13T17:53:04.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.591+0000 7f71a6a00640 1 -- 172.21.15.114:0/408792519 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a8007640 con 0x7f71b013c980 2024-09-13T17:53:04.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.591+0000 7f71a6a00640 1 -- 172.21.15.114:0/408792519 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8004a30 con 0x7f71b013c980 2024-09-13T17:53:04.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.591+0000 7f71b5600640 1 -- 172.21.15.114:0/408792519 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719c0094d0 con 0x7f71b013c980 2024-09-13T17:53:04.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.591+0000 7f71b5600640 1 -- 172.21.15.114:0/408792519 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b01f5370 con 0x7f71b013c980 2024-09-13T17:53:04.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.591+0000 7f71b5600640 1 -- 172.21.15.114:0/408792519 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b00667b0 con 0x7f71b013c980 2024-09-13T17:53:04.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.595+0000 7f71a6a00640 1 -- 172.21.15.114:0/408792519 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f71a8004b90 con 0x7f71b013c980 2024-09-13T17:53:04.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.595+0000 7f71a6a00640 1 --2- 172.21.15.114:0/408792519 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7190066690 0x7f7190068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:04.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.595+0000 7f71a6a00640 1 -- 172.21.15.114:0/408792519 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f71a8083200 con 0x7f71b013c980 2024-09-13T17:53:04.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.595+0000 7f71aea00640 1 --2- 172.21.15.114:0/408792519 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7190066690 0x7f7190068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:04.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.595+0000 7f71aea00640 1 --2- 172.21.15.114:0/408792519 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7190066690 0x7f7190068b50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f71a0009fd0 tx=0x7f71a000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:04.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.599+0000 7f71a6a00640 1 -- 172.21.15.114:0/408792519 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f71a8050790 con 0x7f71b013c980 2024-09-13T17:53:04.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.803+0000 7f71b5600640 1 -- 172.21.15.114:0/408792519 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f71b00706b0 con 0x7f71b013c980 2024-09-13T17:53:04.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.807+0000 7f71a6a00640 1 -- 172.21.15.114:0/408792519 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f71a80180a0 con 0x7f71b013c980 2024-09-13T17:53:04.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.811+0000 7f71b5600640 1 -- 172.21.15.114:0/408792519 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7190066690 msgr2=0x7f7190068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:04.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.811+0000 7f71b5600640 1 --2- 172.21.15.114:0/408792519 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7190066690 0x7f7190068b50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f71a0009fd0 tx=0x7f71a000b040 comp rx=0 tx=0).stop 2024-09-13T17:53:04.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.811+0000 7f71b5600640 1 -- 172.21.15.114:0/408792519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71b013c980 msgr2=0x7f71b0134230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:04.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.811+0000 7f71b5600640 1 --2- 172.21.15.114:0/408792519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71b013c980 0x7f71b0134230 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f71a800c470 tx=0x7f71a800c930 comp rx=0 tx=0).stop 2024-09-13T17:53:04.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.811+0000 7f71b5600640 1 -- 172.21.15.114:0/408792519 shutdown_connections 2024-09-13T17:53:04.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.811+0000 7f71b5600640 1 --2- 172.21.15.114:0/408792519 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7190066690 0x7f7190068b50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.811+0000 7f71b5600640 1 --2- 172.21.15.114:0/408792519 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f71b013c980 0x7f71b0134230 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.811+0000 7f71b5600640 1 --2- 172.21.15.114:0/408792519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f71b013c240 0x7f71b0133cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.811+0000 7f71b5600640 1 --2- 172.21.15.114:0/408792519 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f71b006da90 0x7f71b01f8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.811+0000 7f71b5600640 1 -- 172.21.15.114:0/408792519 >> 172.21.15.114:0/408792519 conn(0x7f71b00660b0 msgr2=0x7f71b0157440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:04.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.811+0000 7f71b5600640 1 -- 172.21.15.114:0/408792519 shutdown_connections 2024-09-13T17:53:04.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.811+0000 7f71b5600640 1 -- 172.21.15.114:0/408792519 wait complete. 2024-09-13T17:53:04.833 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:53:04.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.967+0000 7f8092a00640 1 Processor -- start 2024-09-13T17:53:04.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.967+0000 7f8092a00640 1 -- start start 2024-09-13T17:53:04.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.967+0000 7f8092a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f808c15dd60 0x7f808c06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:04.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.967+0000 7f8092a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f808c070380 0x7f808c0caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:04.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.967+0000 7f8092a00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f808c099160 con 0x7f808c0cb490 2024-09-13T17:53:04.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.967+0000 7f8092a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f808c15ef90 con 0x7f808c15dd60 2024-09-13T17:53:04.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.967+0000 7f8092a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808c15e140 con 0x7f808c070380 2024-09-13T17:53:04.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.967+0000 7f808be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f808c15dd60 0x7f808c06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:04.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.967+0000 7f808be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f808c15dd60 0x7f808c06f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45970/0 (socket says 172.21.15.114:45970) 2024-09-13T17:53:04.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.967+0000 7f808be00640 1 -- 172.21.15.114:0/2522188281 learned_addr learned my addr 172.21.15.114:0/2522188281 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:04.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.967+0000 7f8083400640 1 --2- 172.21.15.114:0/2522188281 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f808c070380 0x7f808c0caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:04.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.967+0000 7f808be00640 1 -- 172.21.15.114:0/2522188281 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f808c070380 msgr2=0x7f808c0caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:04.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.967+0000 7f808be00640 1 --2- 172.21.15.114:0/2522188281 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f808c070380 0x7f808c0caf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.967+0000 7f808be00640 1 -- 172.21.15.114:0/2522188281 >> v1:172.21.15.134:6789/0 conn(0x7f808c0cb490 legacy=0x7f808c0ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:04.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.967+0000 7f808be00640 1 -- 172.21.15.114:0/2522188281 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808c098b10 con 0x7f808c15dd60 2024-09-13T17:53:04.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.967+0000 7f8083400640 1 --2- 172.21.15.114:0/2522188281 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f808c070380 0x7f808c0caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:04.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.971+0000 7f808be00640 1 --2- 172.21.15.114:0/2522188281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f808c15dd60 0x7f808c06f6b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f807c009870 tx=0x7f807c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd8d8c9179f2d9c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:04.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.971+0000 7f808b400640 1 -- 172.21.15.114:0/2522188281 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c0ac620 con 0x7f808c15dd60 2024-09-13T17:53:04.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.971+0000 7f808b400640 1 -- 172.21.15.114:0/2522188281 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807c0ac780 con 0x7f808c15dd60 2024-09-13T17:53:04.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.971+0000 7f808b400640 1 -- 172.21.15.114:0/2522188281 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c0acb10 con 0x7f808c15dd60 2024-09-13T17:53:04.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.971+0000 7f8092a00640 1 -- 172.21.15.114:0/2522188281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f808c15dd60 msgr2=0x7f808c06f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:04.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.971+0000 7f8092a00640 1 --2- 172.21.15.114:0/2522188281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f808c15dd60 0x7f808c06f6b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f807c009870 tx=0x7f807c01c4f0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.971+0000 7f8092a00640 1 -- 172.21.15.114:0/2522188281 shutdown_connections 2024-09-13T17:53:04.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.971+0000 7f8092a00640 1 --2- 172.21.15.114:0/2522188281 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f808c070380 0x7f808c0caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.971+0000 7f8092a00640 1 --2- 172.21.15.114:0/2522188281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f808c15dd60 0x7f808c06f6b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.971+0000 7f8092a00640 1 -- 172.21.15.114:0/2522188281 >> 172.21.15.114:0/2522188281 conn(0x7f808c0d0570 msgr2=0x7f808c0d0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:04.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.971+0000 7f8092a00640 1 -- 172.21.15.114:0/2522188281 shutdown_connections 2024-09-13T17:53:04.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.971+0000 7f8092a00640 1 -- 172.21.15.114:0/2522188281 wait complete. 2024-09-13T17:53:04.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.975+0000 7f8092a00640 1 Processor -- start 2024-09-13T17:53:04.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.975+0000 7f8092a00640 1 -- start start 2024-09-13T17:53:04.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.975+0000 7f8092a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f808c070380 0x7f808c0ad360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:04.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.975+0000 7f8092a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f808c0cb490 0x7f808c0ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:04.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.975+0000 7f8092a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f808c15dd60 0x7f808c1f2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:04.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.975+0000 7f8092a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c0adde0 con 0x7f808c15dd60 2024-09-13T17:53:04.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.975+0000 7f8092a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c0ae650 con 0x7f808c070380 2024-09-13T17:53:04.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.975+0000 7f8092a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808c0ae090 con 0x7f808c0cb490 2024-09-13T17:53:04.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.975+0000 7f8090a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f808c15dd60 0x7f808c1f2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:04.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.975+0000 7f8090a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f808c15dd60 0x7f808c1f2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45986/0 (socket says 172.21.15.114:45986) 2024-09-13T17:53:04.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.975+0000 7f8090a00640 1 -- 172.21.15.114:0/2984752012 learned_addr learned my addr 172.21.15.114:0/2984752012 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:04.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.975+0000 7f808be00640 1 --2- 172.21.15.114:0/2984752012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f808c070380 0x7f808c0ad360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:04.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.975+0000 7f8083400640 1 --2- 172.21.15.114:0/2984752012 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f808c0cb490 0x7f808c0ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:04.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.975+0000 7f8090a00640 1 -- 172.21.15.114:0/2984752012 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f808c0cb490 msgr2=0x7f808c0ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:04.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.975+0000 7f8090a00640 1 --2- 172.21.15.114:0/2984752012 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f808c0cb490 0x7f808c0ad8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.975+0000 7f8090a00640 1 -- 172.21.15.114:0/2984752012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f808c070380 msgr2=0x7f808c0ad360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:04.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.975+0000 7f8090a00640 1 --2- 172.21.15.114:0/2984752012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f808c070380 0x7f808c0ad360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:04.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.975+0000 7f8090a00640 1 -- 172.21.15.114:0/2984752012 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f807c0094d0 con 0x7f808c15dd60 2024-09-13T17:53:04.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.975+0000 7f808be00640 1 --2- 172.21.15.114:0/2984752012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f808c070380 0x7f808c0ad360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:04.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.975+0000 7f8083400640 1 --2- 172.21.15.114:0/2984752012 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f808c0cb490 0x7f808c0ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:04.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.975+0000 7f8090a00640 1 --2- 172.21.15.114:0/2984752012 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f808c15dd60 0x7f808c1f2e40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f808400c780 tx=0x7f808400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:04.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.975+0000 7f8088c00640 1 -- 172.21.15.114:0/2984752012 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8084004b70 con 0x7f808c15dd60 2024-09-13T17:53:04.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.975+0000 7f8088c00640 1 -- 172.21.15.114:0/2984752012 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808400ce90 con 0x7f808c15dd60 2024-09-13T17:53:04.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.975+0000 7f8088c00640 1 -- 172.21.15.114:0/2984752012 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808400a850 con 0x7f808c15dd60 2024-09-13T17:53:04.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.975+0000 7f8092a00640 1 -- 172.21.15.114:0/2984752012 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f808c0ae370 con 0x7f808c15dd60 2024-09-13T17:53:04.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.975+0000 7f8092a00640 1 -- 172.21.15.114:0/2984752012 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f808c0c5470 con 0x7f808c15dd60 2024-09-13T17:53:04.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.979+0000 7f8092a00640 1 -- 172.21.15.114:0/2984752012 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f808c0673b0 con 0x7f808c15dd60 2024-09-13T17:53:04.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.979+0000 7f8088c00640 1 -- 172.21.15.114:0/2984752012 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f808400a9b0 con 0x7f808c15dd60 2024-09-13T17:53:04.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.979+0000 7f8088c00640 1 --2- 172.21.15.114:0/2984752012 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8068066690 0x7f8068068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:04.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.979+0000 7f8088c00640 1 -- 172.21.15.114:0/2984752012 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f8084084260 con 0x7f808c15dd60 2024-09-13T17:53:04.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.979+0000 7f808be00640 1 --2- 172.21.15.114:0/2984752012 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8068066690 0x7f8068068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:04.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.979+0000 7f808be00640 1 --2- 172.21.15.114:0/2984752012 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8068066690 0x7f8068068b50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f807c0ae000 tx=0x7f807c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:04.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:04.983+0000 7f8088c00640 1 -- 172.21.15.114:0/2984752012 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8084051740 con 0x7f808c15dd60 2024-09-13T17:53:05.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.139+0000 7f8092a00640 1 -- 172.21.15.114:0/2984752012 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f808c0c5690 con 0x7f808c15dd60 2024-09-13T17:53:05.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.139+0000 7f8088c00640 1 -- 172.21.15.114:0/2984752012 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+13110 (secure 0 0 0) 0x7f8084054d60 con 0x7f808c15dd60 2024-09-13T17:53:05.145 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:05.146 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":35,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:53:02.107531+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:53:05.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.143+0000 7f8092a00640 1 -- 172.21.15.114:0/2984752012 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8068066690 msgr2=0x7f8068068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:05.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.143+0000 7f8092a00640 1 --2- 172.21.15.114:0/2984752012 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8068066690 0x7f8068068b50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f807c0ae000 tx=0x7f807c008040 comp rx=0 tx=0).stop 2024-09-13T17:53:05.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.143+0000 7f8092a00640 1 -- 172.21.15.114:0/2984752012 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f808c15dd60 msgr2=0x7f808c1f2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:05.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.143+0000 7f8092a00640 1 --2- 172.21.15.114:0/2984752012 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f808c15dd60 0x7f808c1f2e40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f808400c780 tx=0x7f808400cc40 comp rx=0 tx=0).stop 2024-09-13T17:53:05.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.143+0000 7f8092a00640 1 -- 172.21.15.114:0/2984752012 shutdown_connections 2024-09-13T17:53:05.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.143+0000 7f8092a00640 1 --2- 172.21.15.114:0/2984752012 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8068066690 0x7f8068068b50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.143+0000 7f8092a00640 1 --2- 172.21.15.114:0/2984752012 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f808c15dd60 0x7f808c1f2e40 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.143+0000 7f8092a00640 1 --2- 172.21.15.114:0/2984752012 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f808c0cb490 0x7f808c0ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.143+0000 7f8092a00640 1 --2- 172.21.15.114:0/2984752012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f808c070380 0x7f808c0ad360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.143+0000 7f8092a00640 1 -- 172.21.15.114:0/2984752012 >> 172.21.15.114:0/2984752012 conn(0x7f808c0d0570 msgr2=0x7f808c0cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:05.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.143+0000 7f8092a00640 1 -- 172.21.15.114:0/2984752012 shutdown_connections 2024-09-13T17:53:05.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.143+0000 7f8092a00640 1 -- 172.21.15.114:0/2984752012 wait complete. 2024-09-13T17:53:05.166 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:51:37.996254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:53:05.167 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:53:05.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.299+0000 7f6552e00640 1 Processor -- start 2024-09-13T17:53:05.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.299+0000 7f6552e00640 1 -- start start 2024-09-13T17:53:05.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.299+0000 7f6552e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f654c13c240 0x7f654c13f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:05.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.299+0000 7f6552e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f654c13c980 0x7f654c06d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:05.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.299+0000 7f6552e00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f654c0cd220 con 0x7f654c06da90 2024-09-13T17:53:05.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.299+0000 7f6552e00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f654c13f960 con 0x7f654c13c240 2024-09-13T17:53:05.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.299+0000 7f6552e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f654c06ded0 con 0x7f654c13c980 2024-09-13T17:53:05.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.299+0000 7f654be00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f654c13c240 0x7f654c13f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:05.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.299+0000 7f6543400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f654c13c980 0x7f654c06d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:05.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.299+0000 7f654be00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f654c13c240 0x7f654c13f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:33504/0 (socket says 172.21.15.114:33504) 2024-09-13T17:53:05.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.299+0000 7f6543400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f654c13c980 0x7f654c06d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:54620/0 (socket says 172.21.15.114:54620) 2024-09-13T17:53:05.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.299+0000 7f654be00640 1 -- 172.21.15.114:0/117875361 learned_addr learned my addr 172.21.15.114:0/117875361 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:05.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.303+0000 7f654be00640 1 -- 172.21.15.114:0/117875361 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f654c13c980 msgr2=0x7f654c06d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:05.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.303+0000 7f654be00640 1 --2- 172.21.15.114:0/117875361 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f654c13c980 0x7f654c06d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.303+0000 7f654be00640 1 -- 172.21.15.114:0/117875361 >> v1:172.21.15.134:6789/0 conn(0x7f654c06da90 legacy=0x7f654c0cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:05.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.303+0000 7f654be00640 1 -- 172.21.15.114:0/117875361 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654c15a740 con 0x7f654c13c240 2024-09-13T17:53:05.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.303+0000 7f654be00640 1 --2- 172.21.15.114:0/117875361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f654c13c240 0x7f654c13f420 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f653c009870 tx=0x7f653c01c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdd82d4e9fafa7d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:05.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.303+0000 7f654b400640 1 -- 172.21.15.114:0/117875361 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653c0a95f0 con 0x7f654c13c240 2024-09-13T17:53:05.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.303+0000 7f654b400640 1 -- 172.21.15.114:0/117875361 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653c0a9750 con 0x7f654c13c240 2024-09-13T17:53:05.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.303+0000 7f654b400640 1 -- 172.21.15.114:0/117875361 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653c0a9ae0 con 0x7f654c13c240 2024-09-13T17:53:05.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.303+0000 7f6552e00640 1 -- 172.21.15.114:0/117875361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f654c13c240 msgr2=0x7f654c13f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:05.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.303+0000 7f6552e00640 1 --2- 172.21.15.114:0/117875361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f654c13c240 0x7f654c13f420 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f653c009870 tx=0x7f653c01c530 comp rx=0 tx=0).stop 2024-09-13T17:53:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.303+0000 7f6552e00640 1 -- 172.21.15.114:0/117875361 shutdown_connections 2024-09-13T17:53:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.307+0000 7f6552e00640 1 --2- 172.21.15.114:0/117875361 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f654c13c980 0x7f654c06d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.307+0000 7f6552e00640 1 --2- 172.21.15.114:0/117875361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f654c13c240 0x7f654c13f420 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.307+0000 7f6552e00640 1 -- 172.21.15.114:0/117875361 >> 172.21.15.114:0/117875361 conn(0x7f654c0660b0 msgr2=0x7f654c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.307+0000 7f6552e00640 1 -- 172.21.15.114:0/117875361 shutdown_connections 2024-09-13T17:53:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.307+0000 7f6552e00640 1 -- 172.21.15.114:0/117875361 wait complete. 2024-09-13T17:53:05.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.307+0000 7f6552e00640 1 Processor -- start 2024-09-13T17:53:05.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.307+0000 7f6552e00640 1 -- start start 2024-09-13T17:53:05.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.307+0000 7f6552e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f654c06da90 0x7f654c0b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:05.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.307+0000 7f6552e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f654c13c240 0x7f654c0b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:05.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.307+0000 7f6552e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f654c13c980 0x7f654c1394e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:05.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.307+0000 7f6552e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c0affd0 con 0x7f654c13c240 2024-09-13T17:53:05.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.307+0000 7f6552e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c0a7780 con 0x7f654c13c980 2024-09-13T17:53:05.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.307+0000 7f6552e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f654c0af350 con 0x7f654c06da90 2024-09-13T17:53:05.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.307+0000 7f6543400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f654c13c240 0x7f654c0b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:05.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.307+0000 7f6543400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f654c13c240 0x7f654c0b0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45988/0 (socket says 172.21.15.114:45988) 2024-09-13T17:53:05.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.307+0000 7f6543400640 1 -- 172.21.15.114:0/1274808415 learned_addr learned my addr 172.21.15.114:0/1274808415 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:05.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.307+0000 7f6550e00640 1 --2- 172.21.15.114:0/1274808415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f654c13c980 0x7f654c1394e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:05.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.307+0000 7f654be00640 1 --2- 172.21.15.114:0/1274808415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f654c06da90 0x7f654c0b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:05.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.307+0000 7f6543400640 1 -- 172.21.15.114:0/1274808415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f654c06da90 msgr2=0x7f654c0b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:05.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.307+0000 7f6543400640 1 --2- 172.21.15.114:0/1274808415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f654c06da90 0x7f654c0b03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.307+0000 7f6543400640 1 -- 172.21.15.114:0/1274808415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f654c13c980 msgr2=0x7f654c1394e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:05.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.307+0000 7f6543400640 1 --2- 172.21.15.114:0/1274808415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f654c13c980 0x7f654c1394e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.307+0000 7f6543400640 1 -- 172.21.15.114:0/1274808415 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653c0094d0 con 0x7f654c13c240 2024-09-13T17:53:05.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.307+0000 7f6543400640 1 --2- 172.21.15.114:0/1274808415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f654c13c240 0x7f654c0b0b90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f653400e8a0 tx=0x7f653400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:05.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.307+0000 7f6548c00640 1 -- 172.21.15.114:0/1274808415 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6534009510 con 0x7f654c13c240 2024-09-13T17:53:05.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.307+0000 7f6548c00640 1 -- 172.21.15.114:0/1274808415 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653400c940 con 0x7f654c13c240 2024-09-13T17:53:05.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.307+0000 7f6552e00640 1 -- 172.21.15.114:0/1274808415 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f654c0af630 con 0x7f654c13c240 2024-09-13T17:53:05.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.307+0000 7f6548c00640 1 -- 172.21.15.114:0/1274808415 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653400ccb0 con 0x7f654c13c240 2024-09-13T17:53:05.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.311+0000 7f6552e00640 1 -- 172.21.15.114:0/1274808415 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f654c0afbf0 con 0x7f654c13c240 2024-09-13T17:53:05.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.311+0000 7f6552e00640 1 -- 172.21.15.114:0/1274808415 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f654c0b0110 con 0x7f654c13c240 2024-09-13T17:53:05.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.311+0000 7f6548c00640 1 -- 172.21.15.114:0/1274808415 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6534013470 con 0x7f654c13c240 2024-09-13T17:53:05.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.311+0000 7f6548c00640 1 --2- 172.21.15.114:0/1274808415 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6528066690 0x7f6528068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:05.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.311+0000 7f6548c00640 1 -- 172.21.15.114:0/1274808415 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f6534084060 con 0x7f654c13c240 2024-09-13T17:53:05.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.311+0000 7f654be00640 1 --2- 172.21.15.114:0/1274808415 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6528066690 0x7f6528068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:05.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.311+0000 7f654be00640 1 --2- 172.21.15.114:0/1274808415 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6528066690 0x7f6528068b50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f653c0ae000 tx=0x7f653c0b3040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:05.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.315+0000 7f6548c00640 1 -- 172.21.15.114:0/1274808415 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f65340b5db0 con 0x7f654c13c240 2024-09-13T17:53:05.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.475+0000 7f6552e00640 1 -- 172.21.15.114:0/1274808415 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f654c0667b0 con 0x7f654c13c240 2024-09-13T17:53:05.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.475+0000 7f6548c00640 1 -- 172.21.15.114:0/1274808415 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f654c0b0110 con 0x7f654c13c240 2024-09-13T17:53:05.479 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-13T17:53:05.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.475+0000 7f6552e00640 1 -- 172.21.15.114:0/1274808415 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6528066690 msgr2=0x7f6528068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:05.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.475+0000 7f6552e00640 1 --2- 172.21.15.114:0/1274808415 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6528066690 0x7f6528068b50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f653c0ae000 tx=0x7f653c0b3040 comp rx=0 tx=0).stop 2024-09-13T17:53:05.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.475+0000 7f6552e00640 1 -- 172.21.15.114:0/1274808415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f654c13c240 msgr2=0x7f654c0b0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:05.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.475+0000 7f6552e00640 1 --2- 172.21.15.114:0/1274808415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f654c13c240 0x7f654c0b0b90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f653400e8a0 tx=0x7f653400eca0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.475+0000 7f6552e00640 1 -- 172.21.15.114:0/1274808415 shutdown_connections 2024-09-13T17:53:05.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.475+0000 7f6552e00640 1 --2- 172.21.15.114:0/1274808415 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6528066690 0x7f6528068b50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.475+0000 7f6552e00640 1 --2- 172.21.15.114:0/1274808415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f654c13c980 0x7f654c1394e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.475+0000 7f6552e00640 1 --2- 172.21.15.114:0/1274808415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f654c13c240 0x7f654c0b0b90 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.475+0000 7f6552e00640 1 --2- 172.21.15.114:0/1274808415 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f654c06da90 0x7f654c0b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.475+0000 7f6552e00640 1 -- 172.21.15.114:0/1274808415 >> 172.21.15.114:0/1274808415 conn(0x7f654c0660b0 msgr2=0x7f654c0b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:05.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.475+0000 7f6552e00640 1 -- 172.21.15.114:0/1274808415 shutdown_connections 2024-09-13T17:53:05.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.475+0000 7f6552e00640 1 -- 172.21.15.114:0/1274808415 wait complete. 2024-09-13T17:53:05.500 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T17:53:05.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.631+0000 7f98a2600640 1 Processor -- start 2024-09-13T17:53:05.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.631+0000 7f98a2600640 1 -- start start 2024-09-13T17:53:05.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.631+0000 7f98a2600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f989c13f420 0x7f989c06d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:05.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.631+0000 7f98a2600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f989c06da90 0x7f989c0cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:05.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.631+0000 7f98a2600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f989c0cd220 con 0x7f989c13c240 2024-09-13T17:53:05.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.631+0000 7f98a2600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f989c06df40 con 0x7f989c13f420 2024-09-13T17:53:05.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.631+0000 7f98a2600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989c15a740 con 0x7f989c06da90 2024-09-13T17:53:05.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.631+0000 7f9892a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f989c13f420 0x7f989c06d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:05.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.631+0000 7f989b400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f989c13c240 0x7f989c13c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41022/0 (socket says 172.21.15.114:41022) 2024-09-13T17:53:05.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.631+0000 7f9892a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f989c13f420 0x7f989c06d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45996/0 (socket says 172.21.15.114:45996) 2024-09-13T17:53:05.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.631+0000 7f989b400640 1 -- 172.21.15.114:0/545536218 learned_addr learned my addr 172.21.15.114:0/545536218 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:05.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.631+0000 7f989be00640 1 --2- 172.21.15.114:0/545536218 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f989c06da90 0x7f989c0cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:05.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.631+0000 7f9892a00640 1 -- 172.21.15.114:0/545536218 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f989c06da90 msgr2=0x7f989c0cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:05.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.631+0000 7f9892a00640 1 --2- 172.21.15.114:0/545536218 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f989c06da90 0x7f989c0cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.631+0000 7f9892a00640 1 -- 172.21.15.114:0/545536218 >> v1:172.21.15.114:6789/0 conn(0x7f989c13c240 legacy=0x7f989c13c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:05.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.635+0000 7f9892a00640 1 -- 172.21.15.114:0/545536218 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c159bc0 con 0x7f989c13f420 2024-09-13T17:53:05.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.631+0000 7f989aa00640 1 -- 172.21.15.114:0/545536218 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1653652387 0 0) 0x7f989c0cd220 con 0x7f989c13c240 2024-09-13T17:53:05.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.635+0000 7f9892a00640 1 --2- 172.21.15.114:0/545536218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f989c13f420 0x7f989c06d550 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9884009d90 tx=0x7f988401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=592f125bde01c4ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:05.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.635+0000 7f989aa00640 1 -- 172.21.15.114:0/545536218 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98840a5a00 con 0x7f989c13f420 2024-09-13T17:53:05.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.635+0000 7f989aa00640 1 -- 172.21.15.114:0/545536218 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98840a5b60 con 0x7f989c13f420 2024-09-13T17:53:05.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.635+0000 7f989aa00640 1 -- 172.21.15.114:0/545536218 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98840ad440 con 0x7f989c13f420 2024-09-13T17:53:05.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.635+0000 7f98a2600640 1 -- 172.21.15.114:0/545536218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f989c13f420 msgr2=0x7f989c06d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:05.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.635+0000 7f98a2600640 1 --2- 172.21.15.114:0/545536218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f989c13f420 0x7f989c06d550 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9884009d90 tx=0x7f988401c940 comp rx=0 tx=0).stop 2024-09-13T17:53:05.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.635+0000 7f98a2600640 1 -- 172.21.15.114:0/545536218 shutdown_connections 2024-09-13T17:53:05.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.635+0000 7f98a2600640 1 --2- 172.21.15.114:0/545536218 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f989c06da90 0x7f989c0cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.635+0000 7f98a2600640 1 --2- 172.21.15.114:0/545536218 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f989c13f420 0x7f989c06d550 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.635+0000 7f98a2600640 1 -- 172.21.15.114:0/545536218 >> 172.21.15.114:0/545536218 conn(0x7f989c0660b0 msgr2=0x7f989c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:05.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.635+0000 7f98a2600640 1 -- 172.21.15.114:0/545536218 shutdown_connections 2024-09-13T17:53:05.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.635+0000 7f98a2600640 1 -- 172.21.15.114:0/545536218 wait complete. 2024-09-13T17:53:05.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.639+0000 7f98a2600640 1 Processor -- start 2024-09-13T17:53:05.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.639+0000 7f98a2600640 1 -- start start 2024-09-13T17:53:05.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.639+0000 7f98a2600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f989c06da90 0x7f989c14f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:05.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.639+0000 7f98a2600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f989c13c240 0x7f989c1526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:05.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.639+0000 7f98a2600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f989c13f420 0x7f989c150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:05.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.639+0000 7f98a2600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989c1379b0 con 0x7f989c06da90 2024-09-13T17:53:05.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.639+0000 7f98a2600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989c152c00 con 0x7f989c13c240 2024-09-13T17:53:05.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.639+0000 7f98a2600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989c0b0c40 con 0x7f989c13f420 2024-09-13T17:53:05.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.639+0000 7f989b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f989c06da90 0x7f989c14f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:05.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.639+0000 7f989b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f989c06da90 0x7f989c14f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46008/0 (socket says 172.21.15.114:46008) 2024-09-13T17:53:05.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.639+0000 7f989b400640 1 -- 172.21.15.114:0/2560821369 learned_addr learned my addr 172.21.15.114:0/2560821369 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:05.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.639+0000 7f989be00640 1 --2- 172.21.15.114:0/2560821369 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f989c13f420 0x7f989c150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:05.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.639+0000 7f9892a00640 1 --2- 172.21.15.114:0/2560821369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f989c13c240 0x7f989c1526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:05.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.639+0000 7f989b400640 1 -- 172.21.15.114:0/2560821369 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f989c13f420 msgr2=0x7f989c150650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:05.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.639+0000 7f989b400640 1 --2- 172.21.15.114:0/2560821369 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f989c13f420 0x7f989c150650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.639+0000 7f989b400640 1 -- 172.21.15.114:0/2560821369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f989c13c240 msgr2=0x7f989c1526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:05.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.639+0000 7f989b400640 1 --2- 172.21.15.114:0/2560821369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f989c13c240 0x7f989c1526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.639+0000 7f989b400640 1 -- 172.21.15.114:0/2560821369 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9884009a70 con 0x7f989c06da90 2024-09-13T17:53:05.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.639+0000 7f989b400640 1 --2- 172.21.15.114:0/2560821369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f989c06da90 0x7f989c14f3f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f988c0011f0 tx=0x7f988c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:05.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.639+0000 7f9893e00640 1 -- 172.21.15.114:0/2560821369 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c0074e0 con 0x7f989c06da90 2024-09-13T17:53:05.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.639+0000 7f9893e00640 1 -- 172.21.15.114:0/2560821369 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988c007640 con 0x7f989c06da90 2024-09-13T17:53:05.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.639+0000 7f98a2600640 1 -- 172.21.15.114:0/2560821369 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f989c137080 con 0x7f989c06da90 2024-09-13T17:53:05.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.639+0000 7f9893e00640 1 -- 172.21.15.114:0/2560821369 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c004a10 con 0x7f989c06da90 2024-09-13T17:53:05.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.639+0000 7f98a2600640 1 -- 172.21.15.114:0/2560821369 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f989c137640 con 0x7f989c06da90 2024-09-13T17:53:05.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.643+0000 7f98a2600640 1 -- 172.21.15.114:0/2560821369 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f989c159790 con 0x7f989c06da90 2024-09-13T17:53:05.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.643+0000 7f9893e00640 1 -- 172.21.15.114:0/2560821369 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f988c004b70 con 0x7f989c06da90 2024-09-13T17:53:05.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.643+0000 7f9893e00640 1 --2- 172.21.15.114:0/2560821369 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f98780666c0 0x7f9878068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:05.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.643+0000 7f9893e00640 1 -- 172.21.15.114:0/2560821369 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f988c083530 con 0x7f989c06da90 2024-09-13T17:53:05.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.643+0000 7f9892a00640 1 --2- 172.21.15.114:0/2560821369 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f98780666c0 0x7f9878068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:05.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.643+0000 7f9892a00640 1 --2- 172.21.15.114:0/2560821369 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f98780666c0 0x7f9878068b80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f98840af000 tx=0x7f9884004ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:05.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.647+0000 7f9893e00640 1 -- 172.21.15.114:0/2560821369 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f988c050a10 con 0x7f989c06da90 2024-09-13T17:53:05.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.803+0000 7f98a2600640 1 -- 172.21.15.114:0/2560821369 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f989c13b8c0 con 0x7f989c06da90 2024-09-13T17:53:05.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.803+0000 7f9893e00640 1 -- 172.21.15.114:0/2560821369 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+65 (secure 0 0 0) 0x7f988c018090 con 0x7f989c06da90 2024-09-13T17:53:05.809 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:05.809 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2024-09-13T17:53:05.809 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-09-13T17:53:05.810 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2024-09-13T17:53:05.810 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2024-09-13T17:53:05.810 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:05.810 INFO:teuthology.orchestra.run.smithi114.stdout:] 2024-09-13T17:53:05.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.803+0000 7f98a2600640 1 -- 172.21.15.114:0/2560821369 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f98780666c0 msgr2=0x7f9878068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:05.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.803+0000 7f98a2600640 1 --2- 172.21.15.114:0/2560821369 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f98780666c0 0x7f9878068b80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f98840af000 tx=0x7f9884004ac0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.803+0000 7f98a2600640 1 -- 172.21.15.114:0/2560821369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f989c06da90 msgr2=0x7f989c14f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:05.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.803+0000 7f98a2600640 1 --2- 172.21.15.114:0/2560821369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f989c06da90 0x7f989c14f3f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f988c0011f0 tx=0x7f988c00c9b0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.803+0000 7f98a2600640 1 -- 172.21.15.114:0/2560821369 shutdown_connections 2024-09-13T17:53:05.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.803+0000 7f98a2600640 1 --2- 172.21.15.114:0/2560821369 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f98780666c0 0x7f9878068b80 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.803+0000 7f98a2600640 1 --2- 172.21.15.114:0/2560821369 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f989c13f420 0x7f989c150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.803+0000 7f98a2600640 1 --2- 172.21.15.114:0/2560821369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f989c13c240 0x7f989c1526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.803+0000 7f98a2600640 1 --2- 172.21.15.114:0/2560821369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f989c06da90 0x7f989c14f3f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.803+0000 7f98a2600640 1 -- 172.21.15.114:0/2560821369 >> 172.21.15.114:0/2560821369 conn(0x7f989c0660b0 msgr2=0x7f989c13e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:05.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.803+0000 7f98a2600640 1 -- 172.21.15.114:0/2560821369 shutdown_connections 2024-09-13T17:53:05.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.803+0000 7f98a2600640 1 -- 172.21.15.114:0/2560821369 wait complete. 2024-09-13T17:53:05.828 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T17:53:05.829 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T17:53:05.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.967+0000 7f586a200640 1 Processor -- start 2024-09-13T17:53:05.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.967+0000 7f586a200640 1 -- start start 2024-09-13T17:53:05.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.967+0000 7f586a200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f586413c240 0x7f586413f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:05.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.967+0000 7f586a200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f586406dc60 0x7f58640cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:05.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.967+0000 7f586a200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58640cd220 con 0x7f586413c980 2024-09-13T17:53:05.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.967+0000 7f586a200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f586413f960 con 0x7f586406dc60 2024-09-13T17:53:05.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.967+0000 7f586a200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586415a740 con 0x7f586413c240 2024-09-13T17:53:05.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.967+0000 7f5863400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f586413c240 0x7f586413f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:05.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.967+0000 7f5863e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f586406dc60 0x7f58640cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:05.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.967+0000 7f5863400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f586413c240 0x7f586413f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:54648/0 (socket says 172.21.15.114:54648) 2024-09-13T17:53:05.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.967+0000 7f5863400640 1 -- 172.21.15.114:0/2163904872 learned_addr learned my addr 172.21.15.114:0/2163904872 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:05.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.967+0000 7f5863e00640 1 -- 172.21.15.114:0/2163904872 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f586413c240 msgr2=0x7f586413f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:05.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.967+0000 7f5863e00640 1 --2- 172.21.15.114:0/2163904872 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f586413c240 0x7f586413f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.967+0000 7f5863e00640 1 -- 172.21.15.114:0/2163904872 >> v1:172.21.15.134:6789/0 conn(0x7f586413c980 legacy=0x7f586406d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:05.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.967+0000 7f5863e00640 1 -- 172.21.15.114:0/2163904872 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5864159bc0 con 0x7f586406dc60 2024-09-13T17:53:05.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.967+0000 7f5863400640 1 --2- 172.21.15.114:0/2163904872 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f586413c240 0x7f586413f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:53:05.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.971+0000 7f5863e00640 1 --2- 172.21.15.114:0/2163904872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f586406dc60 0x7f58640cd650 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f585c009d90 tx=0x7f585c01c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cf82b51dde9e842 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:05.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.971+0000 7f5862a00640 1 -- 172.21.15.114:0/2163904872 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c0a5a00 con 0x7f586406dc60 2024-09-13T17:53:05.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.971+0000 7f5862a00640 1 -- 172.21.15.114:0/2163904872 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585c0a5b60 con 0x7f586406dc60 2024-09-13T17:53:05.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.971+0000 7f5862a00640 1 -- 172.21.15.114:0/2163904872 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c0ad440 con 0x7f586406dc60 2024-09-13T17:53:05.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.971+0000 7f586a200640 1 -- 172.21.15.114:0/2163904872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f586406dc60 msgr2=0x7f58640cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:05.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.971+0000 7f586a200640 1 --2- 172.21.15.114:0/2163904872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f586406dc60 0x7f58640cd650 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f585c009d90 tx=0x7f585c01c940 comp rx=0 tx=0).stop 2024-09-13T17:53:05.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.971+0000 7f586a200640 1 -- 172.21.15.114:0/2163904872 shutdown_connections 2024-09-13T17:53:05.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.971+0000 7f586a200640 1 --2- 172.21.15.114:0/2163904872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f586406dc60 0x7f58640cd650 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.971+0000 7f586a200640 1 --2- 172.21.15.114:0/2163904872 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f586413c240 0x7f586413f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.971+0000 7f586a200640 1 -- 172.21.15.114:0/2163904872 >> 172.21.15.114:0/2163904872 conn(0x7f58640660b0 msgr2=0x7f5864069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:05.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.971+0000 7f586a200640 1 -- 172.21.15.114:0/2163904872 shutdown_connections 2024-09-13T17:53:05.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.971+0000 7f586a200640 1 -- 172.21.15.114:0/2163904872 wait complete. 2024-09-13T17:53:05.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.975+0000 7f586a200640 1 Processor -- start 2024-09-13T17:53:05.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.975+0000 7f586a200640 1 -- start start 2024-09-13T17:53:05.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.975+0000 7f586a200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f586406dc60 0x7f58640ae160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:05.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.975+0000 7f586a200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f586413c240 0x7f5864139550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:05.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.975+0000 7f586a200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f586413c980 0x7f58640ac980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:05.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.975+0000 7f586a200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5864154eb0 con 0x7f586413c980 2024-09-13T17:53:05.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.975+0000 7f586a200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5864155ec0 con 0x7f586413c240 2024-09-13T17:53:05.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.975+0000 7f586a200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5864155100 con 0x7f586406dc60 2024-09-13T17:53:05.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.975+0000 7f5863e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f586413c980 0x7f58640ac980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:05.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.975+0000 7f5863e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f586413c980 0x7f58640ac980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46010/0 (socket says 172.21.15.114:46010) 2024-09-13T17:53:05.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.975+0000 7f5863e00640 1 -- 172.21.15.114:0/1445003742 learned_addr learned my addr 172.21.15.114:0/1445003742 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:05.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.975+0000 7f5863400640 1 --2- 172.21.15.114:0/1445003742 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f586406dc60 0x7f58640ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:05.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.975+0000 7f585aa00640 1 --2- 172.21.15.114:0/1445003742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f586413c240 0x7f5864139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:05.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.975+0000 7f5863e00640 1 -- 172.21.15.114:0/1445003742 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f586406dc60 msgr2=0x7f58640ae160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:05.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.975+0000 7f5863e00640 1 --2- 172.21.15.114:0/1445003742 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f586406dc60 0x7f58640ae160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.975+0000 7f5863e00640 1 -- 172.21.15.114:0/1445003742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f586413c240 msgr2=0x7f5864139550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:05.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.975+0000 7f5863e00640 1 --2- 172.21.15.114:0/1445003742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f586413c240 0x7f5864139550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:05.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.975+0000 7f5863e00640 1 -- 172.21.15.114:0/1445003742 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58540094d0 con 0x7f586413c980 2024-09-13T17:53:05.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.975+0000 7f5863e00640 1 --2- 172.21.15.114:0/1445003742 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f586413c980 0x7f58640ac980 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f585c01a570 tx=0x7f58640ce3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:05.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.975+0000 7f585be00640 1 -- 172.21.15.114:0/1445003742 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c0add90 con 0x7f586413c980 2024-09-13T17:53:05.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.975+0000 7f585be00640 1 -- 172.21.15.114:0/1445003742 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585c009450 con 0x7f586413c980 2024-09-13T17:53:05.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.975+0000 7f585be00640 1 -- 172.21.15.114:0/1445003742 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c0b8660 con 0x7f586413c980 2024-09-13T17:53:05.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.975+0000 7f586a200640 1 -- 172.21.15.114:0/1445003742 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585c009a70 con 0x7f586413c980 2024-09-13T17:53:05.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.975+0000 7f586a200640 1 -- 172.21.15.114:0/1445003742 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58641556c0 con 0x7f586413c980 2024-09-13T17:53:05.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.979+0000 7f586a200640 1 -- 172.21.15.114:0/1445003742 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5864159820 con 0x7f586413c980 2024-09-13T17:53:05.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.979+0000 7f585be00640 1 -- 172.21.15.114:0/1445003742 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f585c0b4040 con 0x7f586413c980 2024-09-13T17:53:05.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.979+0000 7f585be00640 1 --2- 172.21.15.114:0/1445003742 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5840066690 0x7f5840068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:05.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.979+0000 7f585be00640 1 -- 172.21.15.114:0/1445003742 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f585c11eec0 con 0x7f586413c980 2024-09-13T17:53:05.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.979+0000 7f5863400640 1 --2- 172.21.15.114:0/1445003742 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5840066690 0x7f5840068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:05.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.979+0000 7f5863400640 1 --2- 172.21.15.114:0/1445003742 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5840066690 0x7f5840068b50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f586413f1f0 tx=0x7f5854009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:05.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:05.983+0000 7f585be00640 1 -- 172.21.15.114:0/1445003742 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f585c0ec5a0 con 0x7f586413c980 2024-09-13T17:53:06.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:06.139+0000 7f586a200640 1 -- 172.21.15.114:0/1445003742 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f58641538e0 con 0x7f586413c980 2024-09-13T17:53:06.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:06.907+0000 7f585be00640 1 -- 172.21.15.114:0/1445003742 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) v1 ==== 138+0+0 (secure 0 0 0) 0x7f585c0efbc0 con 0x7f586413c980 2024-09-13T17:53:06.912 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2024-09-13T17:53:06.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:06.911+0000 7f586a200640 1 -- 172.21.15.114:0/1445003742 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5840066690 msgr2=0x7f5840068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:06.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:06.911+0000 7f586a200640 1 --2- 172.21.15.114:0/1445003742 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5840066690 0x7f5840068b50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f586413f1f0 tx=0x7f5854009240 comp rx=0 tx=0).stop 2024-09-13T17:53:06.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:06.911+0000 7f586a200640 1 -- 172.21.15.114:0/1445003742 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f586413c980 msgr2=0x7f58640ac980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:06.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:06.911+0000 7f586a200640 1 --2- 172.21.15.114:0/1445003742 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f586413c980 0x7f58640ac980 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f585c01a570 tx=0x7f58640ce3a0 comp rx=0 tx=0).stop 2024-09-13T17:53:06.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:06.911+0000 7f586a200640 1 -- 172.21.15.114:0/1445003742 shutdown_connections 2024-09-13T17:53:06.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:06.911+0000 7f586a200640 1 --2- 172.21.15.114:0/1445003742 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5840066690 0x7f5840068b50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:06.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:06.911+0000 7f586a200640 1 --2- 172.21.15.114:0/1445003742 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f586413c980 0x7f58640ac980 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:06.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:06.911+0000 7f586a200640 1 --2- 172.21.15.114:0/1445003742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f586413c240 0x7f5864139550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:06.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:06.911+0000 7f586a200640 1 --2- 172.21.15.114:0/1445003742 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f586406dc60 0x7f58640ae160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:06.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:06.911+0000 7f586a200640 1 -- 172.21.15.114:0/1445003742 >> 172.21.15.114:0/1445003742 conn(0x7f58640660b0 msgr2=0x7f5864152d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:06.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:06.911+0000 7f586a200640 1 -- 172.21.15.114:0/1445003742 shutdown_connections 2024-09-13T17:53:06.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:06.911+0000 7f586a200640 1 -- 172.21.15.114:0/1445003742 wait complete. 2024-09-13T17:53:06.941 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T17:53:07.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.079+0000 7fdffa400640 1 Processor -- start 2024-09-13T17:53:07.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.079+0000 7fdffa400640 1 -- start start 2024-09-13T17:53:07.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.079+0000 7fdffa400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdff406dc60 0x7fdff40cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:07.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.079+0000 7fdffa400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff40cd220 con 0x7fdff413f420 2024-09-13T17:53:07.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.079+0000 7fdffa400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff415a740 con 0x7fdff413c240 2024-09-13T17:53:07.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.079+0000 7fdffa400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff4159bc0 con 0x7fdff406dc60 2024-09-13T17:53:07.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.079+0000 7fdff2a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fdff413f420 0x7fdff406d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41028/0 (socket says 172.21.15.114:41028) 2024-09-13T17:53:07.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.079+0000 7fdff2a00640 1 -- 172.21.15.114:0/883266379 learned_addr learned my addr 172.21.15.114:0/883266379 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:07.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.079+0000 7fdff3e00640 1 --2- 172.21.15.114:0/883266379 >> v2:172.21.15.134:3300/0 conn(0x7fdff406dc60 0x7fdff40cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:07.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.083+0000 7fdff2000640 1 -- 172.21.15.114:0/883266379 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815472119 0 0) 0x7fdff40cd220 con 0x7fdff413f420 2024-09-13T17:53:07.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.083+0000 7fdff2000640 1 -- 172.21.15.114:0/883266379 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfd8003530 con 0x7fdff413f420 2024-09-13T17:53:07.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.083+0000 7fdff2000640 1 -- 172.21.15.114:0/883266379 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 101522106 0 0) 0x7fdff415a740 con 0x7fdff413c240 2024-09-13T17:53:07.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.083+0000 7fdff2000640 1 -- 172.21.15.114:0/883266379 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdff40cd220 con 0x7fdff413c240 2024-09-13T17:53:07.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.083+0000 7fdff3e00640 1 -- 172.21.15.114:0/883266379 >> v1:172.21.15.134:6789/0 conn(0x7fdff413c240 legacy=0x7fdff413c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:07.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.083+0000 7fdff3e00640 1 -- 172.21.15.114:0/883266379 >> v1:172.21.15.114:6789/0 conn(0x7fdff413f420 legacy=0x7fdff406d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:07.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.083+0000 7fdff3e00640 1 -- 172.21.15.114:0/883266379 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff4159ea0 con 0x7fdff406dc60 2024-09-13T17:53:07.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.083+0000 7fdff3e00640 1 --2- 172.21.15.114:0/883266379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdff406dc60 0x7fdff40cd650 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009d90 tx=0x7fdfec01c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f5302e4287a35bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:07.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.083+0000 7fdff2000640 1 -- 172.21.15.114:0/883266379 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec0a5970 con 0x7fdff406dc60 2024-09-13T17:53:07.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.083+0000 7fdff2000640 1 -- 172.21.15.114:0/883266379 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfec0a5ad0 con 0x7fdff406dc60 2024-09-13T17:53:07.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.083+0000 7fdff2000640 1 -- 172.21.15.114:0/883266379 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec0a5e60 con 0x7fdff406dc60 2024-09-13T17:53:07.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.087+0000 7fdffa400640 1 -- 172.21.15.114:0/883266379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdff406dc60 msgr2=0x7fdff40cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:07.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.087+0000 7fdffa400640 1 --2- 172.21.15.114:0/883266379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdff406dc60 0x7fdff40cd650 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009d90 tx=0x7fdfec01c8b0 comp rx=0 tx=0).stop 2024-09-13T17:53:07.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.087+0000 7fdffa400640 1 -- 172.21.15.114:0/883266379 shutdown_connections 2024-09-13T17:53:07.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.087+0000 7fdffa400640 1 --2- 172.21.15.114:0/883266379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdff406dc60 0x7fdff40cd650 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:07.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.087+0000 7fdffa400640 1 -- 172.21.15.114:0/883266379 >> 172.21.15.114:0/883266379 conn(0x7fdff40660b0 msgr2=0x7fdff4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:07.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.087+0000 7fdffa400640 1 -- 172.21.15.114:0/883266379 shutdown_connections 2024-09-13T17:53:07.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.087+0000 7fdffa400640 1 -- 172.21.15.114:0/883266379 wait complete. 2024-09-13T17:53:07.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.087+0000 7fdffa400640 1 Processor -- start 2024-09-13T17:53:07.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.087+0000 7fdffa400640 1 -- start start 2024-09-13T17:53:07.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.087+0000 7fdffa400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdff406dc60 0x7fdff40b2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:07.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.087+0000 7fdffa400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdff413c240 0x7fdff40b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:07.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.087+0000 7fdffa400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdff413f420 0x7fdff41391a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:07.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.087+0000 7fdffa400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff40adfe0 con 0x7fdff406dc60 2024-09-13T17:53:07.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.087+0000 7fdffa400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff414ff50 con 0x7fdff413f420 2024-09-13T17:53:07.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.087+0000 7fdffa400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff40cac10 con 0x7fdff413c240 2024-09-13T17:53:07.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.087+0000 7fdff3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdff406dc60 0x7fdff40b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:07.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.087+0000 7fdff3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdff406dc60 0x7fdff40b2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46020/0 (socket says 172.21.15.114:46020) 2024-09-13T17:53:07.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.087+0000 7fdff3400640 1 -- 172.21.15.114:0/2909203394 learned_addr learned my addr 172.21.15.114:0/2909203394 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:07.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.087+0000 7fdff2a00640 1 --2- 172.21.15.114:0/2909203394 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdff413c240 0x7fdff40b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:07.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.087+0000 7fdff3e00640 1 --2- 172.21.15.114:0/2909203394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdff413f420 0x7fdff41391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:07.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.087+0000 7fdff3400640 1 -- 172.21.15.114:0/2909203394 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdff413c240 msgr2=0x7fdff40b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:07.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.087+0000 7fdff3400640 1 --2- 172.21.15.114:0/2909203394 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdff413c240 0x7fdff40b2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:07.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.087+0000 7fdff3400640 1 -- 172.21.15.114:0/2909203394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdff413f420 msgr2=0x7fdff41391a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:07.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.087+0000 7fdff3400640 1 --2- 172.21.15.114:0/2909203394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdff413f420 0x7fdff41391a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:07.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.087+0000 7fdff3400640 1 -- 172.21.15.114:0/2909203394 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfec009a70 con 0x7fdff406dc60 2024-09-13T17:53:07.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.087+0000 7fdff3400640 1 --2- 172.21.15.114:0/2909203394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdff406dc60 0x7fdff40b2410 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdfe400c490 tx=0x7fdfe400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:07.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.091+0000 7fdfeb400640 1 -- 172.21.15.114:0/2909203394 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe40052d0 con 0x7fdff406dc60 2024-09-13T17:53:07.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.091+0000 7fdfeb400640 1 -- 172.21.15.114:0/2909203394 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe4005430 con 0x7fdff406dc60 2024-09-13T17:53:07.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.091+0000 7fdffa400640 1 -- 172.21.15.114:0/2909203394 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff40add00 con 0x7fdff406dc60 2024-09-13T17:53:07.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.091+0000 7fdfeb400640 1 -- 172.21.15.114:0/2909203394 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4003840 con 0x7fdff406dc60 2024-09-13T17:53:07.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.091+0000 7fdffa400640 1 -- 172.21.15.114:0/2909203394 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff414fbe0 con 0x7fdff406dc60 2024-09-13T17:53:07.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.091+0000 7fdffa400640 1 -- 172.21.15.114:0/2909203394 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff414fd70 con 0x7fdff406dc60 2024-09-13T17:53:07.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.091+0000 7fdfeb400640 1 -- 172.21.15.114:0/2909203394 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdfe40039a0 con 0x7fdff406dc60 2024-09-13T17:53:07.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.091+0000 7fdfeb400640 1 --2- 172.21.15.114:0/2909203394 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdfd4066690 0x7fdfd4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:07.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.091+0000 7fdfeb400640 1 -- 172.21.15.114:0/2909203394 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5547+0+0 (secure 0 0 0) 0x7fdfe4083bc0 con 0x7fdff406dc60 2024-09-13T17:53:07.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.091+0000 7fdff2a00640 1 --2- 172.21.15.114:0/2909203394 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdfd4066690 0x7fdfd4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:07.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.091+0000 7fdff2a00640 1 --2- 172.21.15.114:0/2909203394 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdfd4066690 0x7fdfd4068b50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdff41f5f50 tx=0x7fdfe0007d40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:07.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.095+0000 7fdfeb400640 1 -- 172.21.15.114:0/2909203394 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdfe4051060 con 0x7fdff406dc60 2024-09-13T17:53:07.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.251+0000 7fdffa400640 1 -- 172.21.15.114:0/2909203394 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdff40cd650 con 0x7fdff406dc60 2024-09-13T17:53:07.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.911+0000 7fdfeb400640 1 -- 172.21.15.114:0/2909203394 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) v1 ==== 170+0+0 (secure 0 0 0) 0x7fdfe40170d0 con 0x7fdff406dc60 2024-09-13T17:53:07.917 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2024-09-13T17:53:07.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.915+0000 7fdffa400640 1 -- 172.21.15.114:0/2909203394 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdfd4066690 msgr2=0x7fdfd4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:07.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.915+0000 7fdffa400640 1 --2- 172.21.15.114:0/2909203394 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdfd4066690 0x7fdfd4068b50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdff41f5f50 tx=0x7fdfe0007d40 comp rx=0 tx=0).stop 2024-09-13T17:53:07.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.915+0000 7fdffa400640 1 -- 172.21.15.114:0/2909203394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdff406dc60 msgr2=0x7fdff40b2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:07.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.915+0000 7fdffa400640 1 --2- 172.21.15.114:0/2909203394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdff406dc60 0x7fdff40b2410 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdfe400c490 tx=0x7fdfe400c950 comp rx=0 tx=0).stop 2024-09-13T17:53:07.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.919+0000 7fdffa400640 1 -- 172.21.15.114:0/2909203394 shutdown_connections 2024-09-13T17:53:07.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.919+0000 7fdffa400640 1 --2- 172.21.15.114:0/2909203394 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdfd4066690 0x7fdfd4068b50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:07.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.919+0000 7fdffa400640 1 --2- 172.21.15.114:0/2909203394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdff413f420 0x7fdff41391a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:07.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.919+0000 7fdffa400640 1 --2- 172.21.15.114:0/2909203394 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdff413c240 0x7fdff40b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:07.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.919+0000 7fdffa400640 1 --2- 172.21.15.114:0/2909203394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdff406dc60 0x7fdff40b2410 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:07.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.919+0000 7fdffa400640 1 -- 172.21.15.114:0/2909203394 >> 172.21.15.114:0/2909203394 conn(0x7fdff40660b0 msgr2=0x7fdff413e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:07.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.923+0000 7fdffa400640 1 -- 172.21.15.114:0/2909203394 shutdown_connections 2024-09-13T17:53:07.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:07.923+0000 7fdffa400640 1 -- 172.21.15.114:0/2909203394 wait complete. 2024-09-13T17:53:07.956 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T17:53:08.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.091+0000 7faea4800640 1 Processor -- start 2024-09-13T17:53:08.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.091+0000 7faea4800640 1 -- start start 2024-09-13T17:53:08.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.091+0000 7faea4800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae9c13c240 0x7fae9c13f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:08.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.091+0000 7faea4800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fae9c13c980 0x7fae9c06d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:08.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.091+0000 7faea4800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae9c0cd220 con 0x7fae9c06da90 2024-09-13T17:53:08.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.091+0000 7faea4800640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae9c06df00 con 0x7fae9c13c980 2024-09-13T17:53:08.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.091+0000 7faea4800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c13f960 con 0x7fae9c13c240 2024-09-13T17:53:08.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.091+0000 7faea2800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fae9c06da90 0x7fae9c0cd650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41034/0 (socket says 172.21.15.114:41034) 2024-09-13T17:53:08.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.091+0000 7faea2800640 1 -- 172.21.15.114:0/2410586799 learned_addr learned my addr 172.21.15.114:0/2410586799 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:08.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.091+0000 7faea1e00640 1 --2- 172.21.15.114:0/2410586799 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae9c13c240 0x7fae9c13f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:08.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.091+0000 7faea1400640 1 --2- 172.21.15.114:0/2410586799 >> v2:172.21.15.134:3300/0 conn(0x7fae9c13c980 0x7fae9c06d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:08.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.091+0000 7faea0a00640 1 -- 172.21.15.114:0/2410586799 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2065086328 0 0) 0x7fae9c0cd220 con 0x7fae9c06da90 2024-09-13T17:53:08.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.091+0000 7faea0a00640 1 -- 172.21.15.114:0/2410586799 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae84003530 con 0x7fae9c06da90 2024-09-13T17:53:08.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.091+0000 7faea1400640 1 -- 172.21.15.114:0/2410586799 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae9c13c240 msgr2=0x7fae9c13f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:08.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.091+0000 7faea1400640 1 --2- 172.21.15.114:0/2410586799 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae9c13c240 0x7fae9c13f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.091+0000 7faea1400640 1 -- 172.21.15.114:0/2410586799 >> v1:172.21.15.114:6789/0 conn(0x7fae9c06da90 legacy=0x7fae9c0cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:08.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.091+0000 7faea1400640 1 -- 172.21.15.114:0/2410586799 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae9c15a740 con 0x7fae9c13c980 2024-09-13T17:53:08.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.095+0000 7faea1400640 1 --2- 172.21.15.114:0/2410586799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae9c13c980 0x7fae9c06d550 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fae8c0097c0 tx=0x7fae8c01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c3289a8c30f0d7e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:08.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.095+0000 7faea0a00640 1 -- 172.21.15.114:0/2410586799 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c0ab670 con 0x7fae9c13c980 2024-09-13T17:53:08.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.095+0000 7faea0a00640 1 -- 172.21.15.114:0/2410586799 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8c0ab7d0 con 0x7fae9c13c980 2024-09-13T17:53:08.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.095+0000 7faea0a00640 1 -- 172.21.15.114:0/2410586799 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c0abb60 con 0x7fae9c13c980 2024-09-13T17:53:08.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.095+0000 7faea4800640 1 -- 172.21.15.114:0/2410586799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae9c13c980 msgr2=0x7fae9c06d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:08.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.095+0000 7faea4800640 1 --2- 172.21.15.114:0/2410586799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae9c13c980 0x7fae9c06d550 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fae8c0097c0 tx=0x7fae8c01c470 comp rx=0 tx=0).stop 2024-09-13T17:53:08.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.095+0000 7faea4800640 1 -- 172.21.15.114:0/2410586799 shutdown_connections 2024-09-13T17:53:08.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.095+0000 7faea4800640 1 --2- 172.21.15.114:0/2410586799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae9c13c980 0x7fae9c06d550 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.095+0000 7faea4800640 1 --2- 172.21.15.114:0/2410586799 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae9c13c240 0x7fae9c13f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.095+0000 7faea4800640 1 -- 172.21.15.114:0/2410586799 >> 172.21.15.114:0/2410586799 conn(0x7fae9c0660b0 msgr2=0x7fae9c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:08.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.095+0000 7faea4800640 1 -- 172.21.15.114:0/2410586799 shutdown_connections 2024-09-13T17:53:08.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.095+0000 7faea4800640 1 -- 172.21.15.114:0/2410586799 wait complete. 2024-09-13T17:53:08.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.099+0000 7faea4800640 1 Processor -- start 2024-09-13T17:53:08.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.099+0000 7faea4800640 1 -- start start 2024-09-13T17:53:08.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.099+0000 7faea4800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae9c06da90 0x7fae9c158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:08.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.099+0000 7faea4800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae9c13c240 0x7fae9c15fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:08.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.099+0000 7faea4800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae9c13c980 0x7fae9c160190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:08.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.099+0000 7faea4800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c145770 con 0x7fae9c13c240 2024-09-13T17:53:08.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.099+0000 7faea4800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c154740 con 0x7fae9c06da90 2024-09-13T17:53:08.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.099+0000 7faea4800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c154a20 con 0x7fae9c13c980 2024-09-13T17:53:08.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.099+0000 7faea1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae9c13c240 0x7fae9c15fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:08.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.099+0000 7faea1400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae9c13c240 0x7fae9c15fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46026/0 (socket says 172.21.15.114:46026) 2024-09-13T17:53:08.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.099+0000 7faea1400640 1 -- 172.21.15.114:0/2473980584 learned_addr learned my addr 172.21.15.114:0/2473980584 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:08.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.099+0000 7faea1e00640 1 --2- 172.21.15.114:0/2473980584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae9c06da90 0x7fae9c158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:08.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.099+0000 7faea2800640 1 --2- 172.21.15.114:0/2473980584 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae9c13c980 0x7fae9c160190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:08.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.099+0000 7faea1400640 1 -- 172.21.15.114:0/2473980584 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae9c13c980 msgr2=0x7fae9c160190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:08.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.099+0000 7faea1400640 1 --2- 172.21.15.114:0/2473980584 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae9c13c980 0x7fae9c160190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.099+0000 7faea1400640 1 -- 172.21.15.114:0/2473980584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae9c06da90 msgr2=0x7fae9c158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:08.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.099+0000 7faea1400640 1 --2- 172.21.15.114:0/2473980584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae9c06da90 0x7fae9c158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.099+0000 7faea1400640 1 -- 172.21.15.114:0/2473980584 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8c009420 con 0x7fae9c13c240 2024-09-13T17:53:08.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.099+0000 7faea1400640 1 --2- 172.21.15.114:0/2473980584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae9c13c240 0x7fae9c15fc50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fae8c0ad040 tx=0x7fae8c01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:08.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.099+0000 7fae96000640 1 -- 172.21.15.114:0/2473980584 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c0bf610 con 0x7fae9c13c240 2024-09-13T17:53:08.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.099+0000 7fae96000640 1 -- 172.21.15.114:0/2473980584 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8c0bf770 con 0x7fae9c13c240 2024-09-13T17:53:08.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.099+0000 7faea4800640 1 -- 172.21.15.114:0/2473980584 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae9c161bb0 con 0x7fae9c13c240 2024-09-13T17:53:08.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.099+0000 7fae96000640 1 -- 172.21.15.114:0/2473980584 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c0bfb20 con 0x7fae9c13c240 2024-09-13T17:53:08.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.099+0000 7faea4800640 1 -- 172.21.15.114:0/2473980584 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae9c162170 con 0x7fae9c13c240 2024-09-13T17:53:08.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.103+0000 7faea4800640 1 -- 172.21.15.114:0/2473980584 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae9c161a10 con 0x7fae9c13c240 2024-09-13T17:53:08.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.103+0000 7fae96000640 1 -- 172.21.15.114:0/2473980584 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fae8c0bfc80 con 0x7fae9c13c240 2024-09-13T17:53:08.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.103+0000 7fae96000640 1 --2- 172.21.15.114:0/2473980584 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fae80066690 0x7fae80068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:08.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.103+0000 7fae96000640 1 -- 172.21.15.114:0/2473980584 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5929+0+0 (secure 0 0 0) 0x7fae8c11ee60 con 0x7fae9c13c240 2024-09-13T17:53:08.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.103+0000 7faea1e00640 1 --2- 172.21.15.114:0/2473980584 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fae80066690 0x7fae80068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:08.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.103+0000 7faea1e00640 1 --2- 172.21.15.114:0/2473980584 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fae80066690 0x7fae80068b50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fae90009af0 tx=0x7fae90008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:08.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.107+0000 7fae96000640 1 -- 172.21.15.114:0/2473980584 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fae8c0ec050 con 0x7fae9c13c240 2024-09-13T17:53:08.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.291+0000 7faea4800640 1 -- 172.21.15.114:0/2473980584 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fae9c161a10 con 0x7fae9c13c240 2024-09-13T17:53:08.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.299+0000 7fae96000640 1 -- 172.21.15.114:0/2473980584 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fae9c161a10 con 0x7fae9c13c240 2024-09-13T17:53:08.305 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 5 and data pool 6 2024-09-13T17:53:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.303+0000 7faea4800640 1 -- 172.21.15.114:0/2473980584 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fae80066690 msgr2=0x7fae80068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.303+0000 7faea4800640 1 --2- 172.21.15.114:0/2473980584 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fae80066690 0x7fae80068b50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fae90009af0 tx=0x7fae90008040 comp rx=0 tx=0).stop 2024-09-13T17:53:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.303+0000 7faea4800640 1 -- 172.21.15.114:0/2473980584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae9c13c240 msgr2=0x7fae9c15fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.303+0000 7faea4800640 1 --2- 172.21.15.114:0/2473980584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae9c13c240 0x7fae9c15fc50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fae8c0ad040 tx=0x7fae8c01acb0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.303+0000 7faea4800640 1 -- 172.21.15.114:0/2473980584 shutdown_connections 2024-09-13T17:53:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.303+0000 7faea4800640 1 --2- 172.21.15.114:0/2473980584 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fae80066690 0x7fae80068b50 secure :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fae90009af0 tx=0x7fae90008040 comp rx=0 tx=0).stop 2024-09-13T17:53:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.303+0000 7faea4800640 1 --2- 172.21.15.114:0/2473980584 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fae9c13c980 0x7fae9c160190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.303+0000 7faea4800640 1 --2- 172.21.15.114:0/2473980584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae9c13c240 0x7fae9c15fc50 secure :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fae8c0ad040 tx=0x7fae8c01acb0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.303+0000 7faea4800640 1 --2- 172.21.15.114:0/2473980584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae9c06da90 0x7fae9c158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.303+0000 7faea4800640 1 -- 172.21.15.114:0/2473980584 >> 172.21.15.114:0/2473980584 conn(0x7fae9c0660b0 msgr2=0x7fae9c06d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:08.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.303+0000 7faea4800640 1 -- 172.21.15.114:0/2473980584 shutdown_connections 2024-09-13T17:53:08.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.307+0000 7faea4800640 1 -- 172.21.15.114:0/2473980584 wait complete. 2024-09-13T17:53:08.345 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:53:08.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.475+0000 7fe195e00640 1 Processor -- start 2024-09-13T17:53:08.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.475+0000 7fe195e00640 1 -- start start 2024-09-13T17:53:08.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.475+0000 7fe195e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe1900713c0 0x7fe1900b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:08.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.475+0000 7fe195e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe190159be0 0x7fe1900b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:08.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.475+0000 7fe195e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1900b2490 con 0x7fe190158a70 2024-09-13T17:53:08.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.475+0000 7fe195e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1900b1f90 con 0x7fe1900713c0 2024-09-13T17:53:08.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.475+0000 7fe195e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe190158e50 con 0x7fe190159be0 2024-09-13T17:53:08.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.475+0000 7fe186000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe1900713c0 0x7fe1900b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:08.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.475+0000 7fe186000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe1900713c0 0x7fe1900b1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46032/0 (socket says 172.21.15.114:46032) 2024-09-13T17:53:08.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.475+0000 7fe186000640 1 -- 172.21.15.114:0/37261258 learned_addr learned my addr 172.21.15.114:0/37261258 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:08.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.479+0000 7fe18f400640 1 --2- 172.21.15.114:0/37261258 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe190159be0 0x7fe1900b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:08.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.479+0000 7fe186000640 1 -- 172.21.15.114:0/37261258 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe190159be0 msgr2=0x7fe1900b1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:08.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.479+0000 7fe186000640 1 --2- 172.21.15.114:0/37261258 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe190159be0 0x7fe1900b1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.479+0000 7fe186000640 1 -- 172.21.15.114:0/37261258 >> v1:172.21.15.114:6789/0 conn(0x7fe190158a70 legacy=0x7fe190070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:08.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.479+0000 7fe186000640 1 -- 172.21.15.114:0/37261258 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1900b21b0 con 0x7fe1900713c0 2024-09-13T17:53:08.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.479+0000 7fe18e000640 1 -- 172.21.15.114:0/37261258 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1687963770 0 0) 0x7fe1900b2490 con 0x7fe190158a70 2024-09-13T17:53:08.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.479+0000 7fe186000640 1 --2- 172.21.15.114:0/37261258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1900713c0 0x7fe1900b1510 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe178009870 tx=0x7fe17801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12485b294f90eae7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:08.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.479+0000 7fe18e000640 1 -- 172.21.15.114:0/37261258 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1780ab620 con 0x7fe1900713c0 2024-09-13T17:53:08.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.479+0000 7fe18e000640 1 -- 172.21.15.114:0/37261258 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1780ab780 con 0x7fe1900713c0 2024-09-13T17:53:08.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.479+0000 7fe18e000640 1 -- 172.21.15.114:0/37261258 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1780abb10 con 0x7fe1900713c0 2024-09-13T17:53:08.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.479+0000 7fe195e00640 1 -- 172.21.15.114:0/37261258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1900713c0 msgr2=0x7fe1900b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:08.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.479+0000 7fe195e00640 1 --2- 172.21.15.114:0/37261258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1900713c0 0x7fe1900b1510 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe178009870 tx=0x7fe17801c4a0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe195e00640 1 -- 172.21.15.114:0/37261258 shutdown_connections 2024-09-13T17:53:08.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe195e00640 1 --2- 172.21.15.114:0/37261258 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe190159be0 0x7fe1900b1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe195e00640 1 --2- 172.21.15.114:0/37261258 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1900713c0 0x7fe1900b1510 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe195e00640 1 -- 172.21.15.114:0/37261258 >> 172.21.15.114:0/37261258 conn(0x7fe1900660b0 msgr2=0x7fe190069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:08.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe195e00640 1 -- 172.21.15.114:0/37261258 shutdown_connections 2024-09-13T17:53:08.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe195e00640 1 -- 172.21.15.114:0/37261258 wait complete. 2024-09-13T17:53:08.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe195e00640 1 Processor -- start 2024-09-13T17:53:08.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe195e00640 1 -- start start 2024-09-13T17:53:08.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe195e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1900713c0 0x7fe1900aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe195e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe190158a70 0x7fe1901546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe195e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe190159be0 0x7fe190143d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe195e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe190154be0 con 0x7fe190158a70 2024-09-13T17:53:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe195e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe190150170 con 0x7fe190159be0 2024-09-13T17:53:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe195e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900af1a0 con 0x7fe1900713c0 2024-09-13T17:53:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe186000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe190158a70 0x7fe1901546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe186000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe190158a70 0x7fe1901546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46038/0 (socket says 172.21.15.114:46038) 2024-09-13T17:53:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe186000640 1 -- 172.21.15.114:0/2840799450 learned_addr learned my addr 172.21.15.114:0/2840799450 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe18ea00640 1 --2- 172.21.15.114:0/2840799450 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1900713c0 0x7fe1900aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe18f400640 1 --2- 172.21.15.114:0/2840799450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe190159be0 0x7fe190143d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe186000640 1 -- 172.21.15.114:0/2840799450 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1900713c0 msgr2=0x7fe1900aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe186000640 1 --2- 172.21.15.114:0/2840799450 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1900713c0 0x7fe1900aeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe186000640 1 -- 172.21.15.114:0/2840799450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe190159be0 msgr2=0x7fe190143d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:08.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe186000640 1 --2- 172.21.15.114:0/2840799450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe190159be0 0x7fe190143d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe186000640 1 -- 172.21.15.114:0/2840799450 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1780094d0 con 0x7fe190158a70 2024-09-13T17:53:08.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe18ea00640 1 --2- 172.21.15.114:0/2840799450 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1900713c0 0x7fe1900aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:08.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe18f400640 1 --2- 172.21.15.114:0/2840799450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe190159be0 0x7fe190143d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:08.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe186000640 1 --2- 172.21.15.114:0/2840799450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe190158a70 0x7fe1901546a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe1780ad040 tx=0x7fe17801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:08.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe187e00640 1 -- 172.21.15.114:0/2840799450 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1780be3f0 con 0x7fe190158a70 2024-09-13T17:53:08.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe187e00640 1 -- 172.21.15.114:0/2840799450 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1780be570 con 0x7fe190158a70 2024-09-13T17:53:08.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe195e00640 1 -- 172.21.15.114:0/2840799450 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe19014fb20 con 0x7fe190158a70 2024-09-13T17:53:08.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe187e00640 1 -- 172.21.15.114:0/2840799450 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1780be920 con 0x7fe190158a70 2024-09-13T17:53:08.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.483+0000 7fe195e00640 1 -- 172.21.15.114:0/2840799450 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1901442d0 con 0x7fe190158a70 2024-09-13T17:53:08.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.487+0000 7fe195e00640 1 -- 172.21.15.114:0/2840799450 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe19014f960 con 0x7fe190158a70 2024-09-13T17:53:08.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.487+0000 7fe187e00640 1 -- 172.21.15.114:0/2840799450 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe1780b43f0 con 0x7fe190158a70 2024-09-13T17:53:08.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.487+0000 7fe187e00640 1 --2- 172.21.15.114:0/2840799450 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe16c066690 0x7fe16c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:08.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.487+0000 7fe187e00640 1 -- 172.21.15.114:0/2840799450 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe17811eb90 con 0x7fe190158a70 2024-09-13T17:53:08.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.487+0000 7fe18ea00640 1 --2- 172.21.15.114:0/2840799450 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe16c066690 0x7fe16c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:08.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.487+0000 7fe18ea00640 1 --2- 172.21.15.114:0/2840799450 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe16c066690 0x7fe16c068b50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe180000f70 tx=0x7fe180009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:08.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.491+0000 7fe187e00640 1 -- 172.21.15.114:0/2840799450 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe1780ebd20 con 0x7fe190158a70 2024-09-13T17:53:08.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.647+0000 7fe195e00640 1 -- 172.21.15.114:0/2840799450 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe190070cb0 con 0x7fe190158a70 2024-09-13T17:53:08.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.647+0000 7fe187e00640 1 -- 172.21.15.114:0/2840799450 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16835 (secure 0 0 0) 0x7fe1780ef340 con 0x7fe190158a70 2024-09-13T17:53:08.653 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:08.653 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":38,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:53:08.298139+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:53:06.185439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:53:07.297633+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:53:08.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.651+0000 7fe195e00640 1 -- 172.21.15.114:0/2840799450 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe16c066690 msgr2=0x7fe16c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:08.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.651+0000 7fe195e00640 1 --2- 172.21.15.114:0/2840799450 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe16c066690 0x7fe16c068b50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe180000f70 tx=0x7fe180009040 comp rx=0 tx=0).stop 2024-09-13T17:53:08.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.651+0000 7fe195e00640 1 -- 172.21.15.114:0/2840799450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe190158a70 msgr2=0x7fe1901546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:08.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.651+0000 7fe195e00640 1 --2- 172.21.15.114:0/2840799450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe190158a70 0x7fe1901546a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe1780ad040 tx=0x7fe17801ace0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.651+0000 7fe195e00640 1 -- 172.21.15.114:0/2840799450 shutdown_connections 2024-09-13T17:53:08.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.651+0000 7fe195e00640 1 --2- 172.21.15.114:0/2840799450 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe16c066690 0x7fe16c068b50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.651+0000 7fe195e00640 1 --2- 172.21.15.114:0/2840799450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe190159be0 0x7fe190143d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.651+0000 7fe195e00640 1 --2- 172.21.15.114:0/2840799450 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe190158a70 0x7fe1901546a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.651+0000 7fe195e00640 1 --2- 172.21.15.114:0/2840799450 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe1900713c0 0x7fe1900aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.651+0000 7fe195e00640 1 -- 172.21.15.114:0/2840799450 >> 172.21.15.114:0/2840799450 conn(0x7fe1900660b0 msgr2=0x7fe1901515e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:08.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.651+0000 7fe195e00640 1 -- 172.21.15.114:0/2840799450 shutdown_connections 2024-09-13T17:53:08.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.651+0000 7fe195e00640 1 -- 172.21.15.114:0/2840799450 wait complete. 2024-09-13T17:53:08.674 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:53:08.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.803+0000 7faff1600640 1 Processor -- start 2024-09-13T17:53:08.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.803+0000 7faff1600640 1 -- start start 2024-09-13T17:53:08.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7faff1600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fafec070890 0x7fafec06cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:08.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7faff1600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafec151800 con 0x7fafec070420 2024-09-13T17:53:08.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7faff1600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafec0cafb0 con 0x7fafec151420 2024-09-13T17:53:08.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7faff1600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafec0cbc30 con 0x7fafec070890 2024-09-13T17:53:08.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafea000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fafec070420 0x7fafec06c540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41040/0 (socket says 172.21.15.114:41040) 2024-09-13T17:53:08.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafea000640 1 -- 172.21.15.114:0/493027483 learned_addr learned my addr 172.21.15.114:0/493027483 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:08.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafeb400640 1 --2- 172.21.15.114:0/493027483 >> v2:172.21.15.134:3300/0 conn(0x7fafec070890 0x7fafec06cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:08.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafe9600640 1 -- 172.21.15.114:0/493027483 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020755406 0 0) 0x7fafec151800 con 0x7fafec070420 2024-09-13T17:53:08.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafe9600640 1 -- 172.21.15.114:0/493027483 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafd0003530 con 0x7fafec070420 2024-09-13T17:53:08.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafe9600640 1 -- 172.21.15.114:0/493027483 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1066753964 0 0) 0x7fafec0cafb0 con 0x7fafec151420 2024-09-13T17:53:08.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafe9600640 1 -- 172.21.15.114:0/493027483 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafec151800 con 0x7fafec151420 2024-09-13T17:53:08.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafe9600640 1 -- 172.21.15.114:0/493027483 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2088031588 0 0) 0x7fafd0003530 con 0x7fafec070420 2024-09-13T17:53:08.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafe9600640 1 -- 172.21.15.114:0/493027483 >> v2:172.21.15.134:3300/0 conn(0x7fafec070890 msgr2=0x7fafec06cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:08.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafe9600640 1 --2- 172.21.15.114:0/493027483 >> v2:172.21.15.134:3300/0 conn(0x7fafec070890 0x7fafec06cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafe9600640 1 -- 172.21.15.114:0/493027483 >> v1:172.21.15.134:6789/0 conn(0x7fafec151420 legacy=0x7fafec0cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:08.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafe9600640 1 -- 172.21.15.114:0/493027483 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafec0cb290 con 0x7fafec070420 2024-09-13T17:53:08.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafe9600640 1 -- 172.21.15.114:0/493027483 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7fafd80016a0 con 0x7fafec070420 2024-09-13T17:53:08.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafeb400640 1 --2- 172.21.15.114:0/493027483 >> v2:172.21.15.134:3300/0 conn(0x7fafec070890 0x7fafec06cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:53:08.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafe9600640 1 -- 172.21.15.114:0/493027483 >> v1:172.21.15.114:6789/0 conn(0x7fafec070420 legacy=0x7fafec06c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:08.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafe9600640 1 --2- 172.21.15.114:0/493027483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd0003b10 0x7fafd0003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:08.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafe9600640 1 --2- 172.21.15.114:0/493027483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafd00047d0 0x7fafd0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:08.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafe9600640 1 --2- 172.21.15.114:0/493027483 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafd0005190 0x7fafd000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:08.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafe9600640 1 -- 172.21.15.114:0/493027483 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafec0cbc30 con 0x7fafd00047d0 2024-09-13T17:53:08.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafe9600640 1 -- 172.21.15.114:0/493027483 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd000c090 con 0x7fafd0003b10 2024-09-13T17:53:08.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafe9600640 1 -- 172.21.15.114:0/493027483 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd000c250 con 0x7fafd0005190 2024-09-13T17:53:08.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafea000640 1 --2- 172.21.15.114:0/493027483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafd00047d0 0x7fafd0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:08.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafeaa00640 1 --2- 172.21.15.114:0/493027483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd0003b10 0x7fafd0003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:08.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafeb400640 1 --2- 172.21.15.114:0/493027483 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafd0005190 0x7fafd000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:08.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafea000640 1 -- 172.21.15.114:0/493027483 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafd0005190 msgr2=0x7fafd000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:08.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafea000640 1 --2- 172.21.15.114:0/493027483 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafd0005190 0x7fafd000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafea000640 1 -- 172.21.15.114:0/493027483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd0003b10 msgr2=0x7fafd0003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:08.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafea000640 1 --2- 172.21.15.114:0/493027483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd0003b10 0x7fafd0003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafea000640 1 -- 172.21.15.114:0/493027483 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd0003530 con 0x7fafd00047d0 2024-09-13T17:53:08.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.807+0000 7fafeb400640 1 -- 172.21.15.114:0/493027483 reap_dead start 2024-09-13T17:53:08.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.811+0000 7fafea000640 1 --2- 172.21.15.114:0/493027483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafd00047d0 0x7fafd0004c50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fafd80050b0 tx=0x7fafd801d150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147daa173a5d87f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:08.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.811+0000 7fafe9600640 1 -- 172.21.15.114:0/493027483 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd8005ae0 con 0x7fafd00047d0 2024-09-13T17:53:08.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.811+0000 7fafe9600640 1 -- 172.21.15.114:0/493027483 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd80a8070 con 0x7fafd00047d0 2024-09-13T17:53:08.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.811+0000 7fafe9600640 1 -- 172.21.15.114:0/493027483 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd8005ea0 con 0x7fafd00047d0 2024-09-13T17:53:08.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.811+0000 7faff1600640 1 -- 172.21.15.114:0/493027483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafd00047d0 msgr2=0x7fafd0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:08.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.811+0000 7faff1600640 1 --2- 172.21.15.114:0/493027483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafd00047d0 0x7fafd0004c50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fafd80050b0 tx=0x7fafd801d150 comp rx=0 tx=0).stop 2024-09-13T17:53:08.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.811+0000 7faff1600640 1 -- 172.21.15.114:0/493027483 shutdown_connections 2024-09-13T17:53:08.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.811+0000 7faff1600640 1 --2- 172.21.15.114:0/493027483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafd00047d0 0x7fafd0004c50 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.811+0000 7faff1600640 1 -- 172.21.15.114:0/493027483 >> 172.21.15.114:0/493027483 conn(0x7fafec0660b0 msgr2=0x7fafec069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:08.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.811+0000 7faff1600640 1 -- 172.21.15.114:0/493027483 shutdown_connections 2024-09-13T17:53:08.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.811+0000 7faff1600640 1 -- 172.21.15.114:0/493027483 wait complete. 2024-09-13T17:53:08.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.811+0000 7faff1600640 1 Processor -- start 2024-09-13T17:53:08.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.815+0000 7faff1600640 1 -- start start 2024-09-13T17:53:08.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.815+0000 7faff1600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafd00047d0 0x7fafec14a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:08.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.815+0000 7faff1600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafec0b2020 0x7fafec15ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:08.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.815+0000 7faff1600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafec15d350 0x7fafec0c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:08.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.815+0000 7faff1600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafec15d7d0 con 0x7fafec0b2020 2024-09-13T17:53:08.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.815+0000 7faff1600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafec155860 con 0x7fafec15d350 2024-09-13T17:53:08.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.815+0000 7faff1600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafec0b24a0 con 0x7fafd00047d0 2024-09-13T17:53:08.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.815+0000 7fafea000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafec0b2020 0x7fafec15ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:08.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.815+0000 7fafea000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafec0b2020 0x7fafec15ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46066/0 (socket says 172.21.15.114:46066) 2024-09-13T17:53:08.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.815+0000 7fafea000640 1 -- 172.21.15.114:0/2180253910 learned_addr learned my addr 172.21.15.114:0/2180253910 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:08.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.815+0000 7fafeaa00640 1 --2- 172.21.15.114:0/2180253910 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafd00047d0 0x7fafec14a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:08.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.815+0000 7fafeb400640 1 --2- 172.21.15.114:0/2180253910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafec15d350 0x7fafec0c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:08.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.815+0000 7fafea000640 1 -- 172.21.15.114:0/2180253910 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafd00047d0 msgr2=0x7fafec14a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:08.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.815+0000 7fafea000640 1 --2- 172.21.15.114:0/2180253910 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafd00047d0 0x7fafec14a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.815+0000 7fafea000640 1 -- 172.21.15.114:0/2180253910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafec15d350 msgr2=0x7fafec0c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:08.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.815+0000 7fafea000640 1 --2- 172.21.15.114:0/2180253910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafec15d350 0x7fafec0c7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.815+0000 7fafea000640 1 -- 172.21.15.114:0/2180253910 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafec0c95e0 con 0x7fafec0b2020 2024-09-13T17:53:08.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.815+0000 7fafea000640 1 --2- 172.21.15.114:0/2180253910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafec0b2020 0x7fafec15ce10 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fafd80050b0 tx=0x7fafd0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:08.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.815+0000 7fafe2a00640 1 -- 172.21.15.114:0/2180253910 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd80b3070 con 0x7fafec0b2020 2024-09-13T17:53:08.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.815+0000 7fafe2a00640 1 -- 172.21.15.114:0/2180253910 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd8001520 con 0x7fafec0b2020 2024-09-13T17:53:08.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.815+0000 7faff1600640 1 -- 172.21.15.114:0/2180253910 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafec0c98c0 con 0x7fafec0b2020 2024-09-13T17:53:08.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.815+0000 7fafe2a00640 1 -- 172.21.15.114:0/2180253910 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd8001ae0 con 0x7fafec0b2020 2024-09-13T17:53:08.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.815+0000 7faff1600640 1 -- 172.21.15.114:0/2180253910 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafec0c9e80 con 0x7fafec0b2020 2024-09-13T17:53:08.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.815+0000 7faff1600640 1 -- 172.21.15.114:0/2180253910 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafec155b70 con 0x7fafec0b2020 2024-09-13T17:53:08.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.819+0000 7fafe2a00640 1 -- 172.21.15.114:0/2180253910 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fafd80058c0 con 0x7fafec0b2020 2024-09-13T17:53:08.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.819+0000 7fafe2a00640 1 --2- 172.21.15.114:0/2180253910 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fafcc066690 0x7fafcc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:08.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.819+0000 7fafe2a00640 1 -- 172.21.15.114:0/2180253910 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fafd811d500 con 0x7fafec0b2020 2024-09-13T17:53:08.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.819+0000 7fafeaa00640 1 --2- 172.21.15.114:0/2180253910 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fafcc066690 0x7fafcc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:08.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.819+0000 7fafeaa00640 1 --2- 172.21.15.114:0/2180253910 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fafcc066690 0x7fafcc068b50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fafec067c10 tx=0x7fafdc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:08.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.823+0000 7fafe2a00640 1 -- 172.21.15.114:0/2180253910 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fafd80ea7d0 con 0x7fafec0b2020 2024-09-13T17:53:08.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.979+0000 7faff1600640 1 -- 172.21.15.114:0/2180253910 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafec15d730 con 0x7fafec0b2020 2024-09-13T17:53:08.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.979+0000 7fafe2a00640 1 -- 172.21.15.114:0/2180253910 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16835 (secure 0 0 0) 0x7fafd80eddf0 con 0x7fafec0b2020 2024-09-13T17:53:08.984 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:08.984 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":38,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:53:08.298139+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:53:06.185439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:53:07.297633+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:53:08.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.983+0000 7faff1600640 1 -- 172.21.15.114:0/2180253910 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fafcc066690 msgr2=0x7fafcc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:08.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.983+0000 7faff1600640 1 --2- 172.21.15.114:0/2180253910 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fafcc066690 0x7fafcc068b50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fafec067c10 tx=0x7fafdc009040 comp rx=0 tx=0).stop 2024-09-13T17:53:08.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.983+0000 7faff1600640 1 -- 172.21.15.114:0/2180253910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafec0b2020 msgr2=0x7fafec15ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:08.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.983+0000 7faff1600640 1 --2- 172.21.15.114:0/2180253910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafec0b2020 0x7fafec15ce10 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fafd80050b0 tx=0x7fafd0005800 comp rx=0 tx=0).stop 2024-09-13T17:53:08.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.983+0000 7faff1600640 1 -- 172.21.15.114:0/2180253910 shutdown_connections 2024-09-13T17:53:08.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.983+0000 7faff1600640 1 --2- 172.21.15.114:0/2180253910 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fafcc066690 0x7fafcc068b50 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.983+0000 7faff1600640 1 --2- 172.21.15.114:0/2180253910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafec15d350 0x7fafec0c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.983+0000 7faff1600640 1 --2- 172.21.15.114:0/2180253910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafec0b2020 0x7fafec15ce10 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.983+0000 7faff1600640 1 --2- 172.21.15.114:0/2180253910 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafd00047d0 0x7fafec14a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:08.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.983+0000 7faff1600640 1 -- 172.21.15.114:0/2180253910 >> 172.21.15.114:0/2180253910 conn(0x7fafec0660b0 msgr2=0x7fafec158950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:08.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.983+0000 7faff1600640 1 -- 172.21.15.114:0/2180253910 shutdown_connections 2024-09-13T17:53:08.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:08.983+0000 7faff1600640 1 -- 172.21.15.114:0/2180253910 wait complete. 2024-09-13T17:53:09.006 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T17:53:09.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.139+0000 7f99eea00640 1 Processor -- start 2024-09-13T17:53:09.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.139+0000 7f99eea00640 1 -- start start 2024-09-13T17:53:09.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.139+0000 7f99eea00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f99e813f420 0x7f99e806d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:09.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.139+0000 7f99eea00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f99e806da90 0x7f99e80cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:09.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.139+0000 7f99eea00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e80cd220 con 0x7f99e813c240 2024-09-13T17:53:09.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.139+0000 7f99eea00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e806df40 con 0x7f99e806da90 2024-09-13T17:53:09.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.139+0000 7f99eea00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e815a740 con 0x7f99e813f420 2024-09-13T17:53:09.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.139+0000 7f99eca00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f99e806da90 0x7f99e80cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:09.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.139+0000 7f99eca00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f99e806da90 0x7f99e80cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46068/0 (socket says 172.21.15.114:46068) 2024-09-13T17:53:09.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.139+0000 7f99eca00640 1 -- 172.21.15.114:0/728545299 learned_addr learned my addr 172.21.15.114:0/728545299 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:09.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.139+0000 7f99df400640 1 --2- 172.21.15.114:0/728545299 >> v2:172.21.15.134:3300/0 conn(0x7f99e813f420 0x7f99e806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:09.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.143+0000 7f99eca00640 1 -- 172.21.15.114:0/728545299 >> v2:172.21.15.134:3300/0 conn(0x7f99e813f420 msgr2=0x7f99e806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:09.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.143+0000 7f99eca00640 1 --2- 172.21.15.114:0/728545299 >> v2:172.21.15.134:3300/0 conn(0x7f99e813f420 0x7f99e806d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:09.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.143+0000 7f99eca00640 1 -- 172.21.15.114:0/728545299 >> v1:172.21.15.134:6789/0 conn(0x7f99e813c240 legacy=0x7f99e813c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:09.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.143+0000 7f99eca00640 1 -- 172.21.15.114:0/728545299 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e8159bc0 con 0x7f99e806da90 2024-09-13T17:53:09.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.143+0000 7f99eca00640 1 --2- 172.21.15.114:0/728545299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99e806da90 0x7f99e80cd650 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f99e80ae130 tx=0x7f99e001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=825063d7ce567401 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:09.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.143+0000 7f99e7400640 1 -- 172.21.15.114:0/728545299 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e00a5880 con 0x7f99e806da90 2024-09-13T17:53:09.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.143+0000 7f99e7400640 1 -- 172.21.15.114:0/728545299 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e00a59e0 con 0x7f99e806da90 2024-09-13T17:53:09.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.143+0000 7f99e7400640 1 -- 172.21.15.114:0/728545299 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e00a5d70 con 0x7f99e806da90 2024-09-13T17:53:09.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.143+0000 7f99eea00640 1 -- 172.21.15.114:0/728545299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99e806da90 msgr2=0x7f99e80cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:09.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.143+0000 7f99eea00640 1 --2- 172.21.15.114:0/728545299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99e806da90 0x7f99e80cd650 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f99e80ae130 tx=0x7f99e001c9c0 comp rx=0 tx=0).stop 2024-09-13T17:53:09.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.143+0000 7f99eea00640 1 -- 172.21.15.114:0/728545299 shutdown_connections 2024-09-13T17:53:09.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.143+0000 7f99eea00640 1 --2- 172.21.15.114:0/728545299 >> v2:172.21.15.134:3300/0 conn(0x7f99e813f420 0x7f99e806d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:09.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.143+0000 7f99eea00640 1 --2- 172.21.15.114:0/728545299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99e806da90 0x7f99e80cd650 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:09.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.143+0000 7f99eea00640 1 -- 172.21.15.114:0/728545299 >> 172.21.15.114:0/728545299 conn(0x7f99e80660b0 msgr2=0x7f99e8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:09.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.147+0000 7f99eea00640 1 -- 172.21.15.114:0/728545299 shutdown_connections 2024-09-13T17:53:09.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.147+0000 7f99eea00640 1 -- 172.21.15.114:0/728545299 wait complete. 2024-09-13T17:53:09.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.147+0000 7f99eea00640 1 Processor -- start 2024-09-13T17:53:09.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.147+0000 7f99eea00640 1 -- start start 2024-09-13T17:53:09.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.147+0000 7f99eea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99e806da90 0x7f99e81557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:09.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.147+0000 7f99eea00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99e813c240 0x7f99e8153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:09.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.147+0000 7f99eea00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f99e813f420 0x7f99e813e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:09.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.147+0000 7f99eea00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e8156010 con 0x7f99e806da90 2024-09-13T17:53:09.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.147+0000 7f99eea00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e813d3e0 con 0x7f99e813c240 2024-09-13T17:53:09.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.147+0000 7f99eea00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e813d6c0 con 0x7f99e813f420 2024-09-13T17:53:09.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.147+0000 7f99e7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99e806da90 0x7f99e81557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:09.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.147+0000 7f99e7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99e806da90 0x7f99e81557e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46078/0 (socket says 172.21.15.114:46078) 2024-09-13T17:53:09.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.147+0000 7f99e7e00640 1 -- 172.21.15.114:0/1254396570 learned_addr learned my addr 172.21.15.114:0/1254396570 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:09.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.147+0000 7f99df400640 1 --2- 172.21.15.114:0/1254396570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99e813c240 0x7f99e8153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:09.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.147+0000 7f99eca00640 1 --2- 172.21.15.114:0/1254396570 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f99e813f420 0x7f99e813e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:09.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.147+0000 7f99e7e00640 1 -- 172.21.15.114:0/1254396570 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f99e813f420 msgr2=0x7f99e813e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:09.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.147+0000 7f99e7e00640 1 --2- 172.21.15.114:0/1254396570 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f99e813f420 0x7f99e813e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:09.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.147+0000 7f99e7e00640 1 -- 172.21.15.114:0/1254396570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99e813c240 msgr2=0x7f99e8153440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:09.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.147+0000 7f99e7e00640 1 --2- 172.21.15.114:0/1254396570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99e813c240 0x7f99e8153440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:09.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.147+0000 7f99e7e00640 1 -- 172.21.15.114:0/1254396570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e0009b30 con 0x7f99e806da90 2024-09-13T17:53:09.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.147+0000 7f99df400640 1 --2- 172.21.15.114:0/1254396570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99e813c240 0x7f99e8153440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:09.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.147+0000 7f99e7e00640 1 --2- 172.21.15.114:0/1254396570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99e806da90 0x7f99e81557e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f99d800c500 tx=0x7f99d800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:09.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.147+0000 7f99e4c00640 1 -- 172.21.15.114:0/1254396570 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d8005220 con 0x7f99e806da90 2024-09-13T17:53:09.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.147+0000 7f99e4c00640 1 -- 172.21.15.114:0/1254396570 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d8005380 con 0x7f99e806da90 2024-09-13T17:53:09.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.147+0000 7f99e4c00640 1 -- 172.21.15.114:0/1254396570 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d8007270 con 0x7f99e806da90 2024-09-13T17:53:09.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.147+0000 7f99eea00640 1 -- 172.21.15.114:0/1254396570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e813d9a0 con 0x7f99e806da90 2024-09-13T17:53:09.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.147+0000 7f99eea00640 1 -- 172.21.15.114:0/1254396570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e8155d20 con 0x7f99e806da90 2024-09-13T17:53:09.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.151+0000 7f99eea00640 1 -- 172.21.15.114:0/1254396570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e8159790 con 0x7f99e806da90 2024-09-13T17:53:09.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.151+0000 7f99e4c00640 1 -- 172.21.15.114:0/1254396570 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f99d80073d0 con 0x7f99e806da90 2024-09-13T17:53:09.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.151+0000 7f99e4c00640 1 --2- 172.21.15.114:0/1254396570 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f99c40666c0 0x7f99c4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:09.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.151+0000 7f99e4c00640 1 -- 172.21.15.114:0/1254396570 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f99d8083c20 con 0x7f99e806da90 2024-09-13T17:53:09.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.151+0000 7f99df400640 1 --2- 172.21.15.114:0/1254396570 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f99c40666c0 0x7f99c4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:09.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.151+0000 7f99df400640 1 --2- 172.21.15.114:0/1254396570 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f99c40666c0 0x7f99c4068b80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f99e815c4f0 tx=0x7f99d0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:09.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.155+0000 7f99e4c00640 1 -- 172.21.15.114:0/1254396570 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f99d8050dc0 con 0x7f99e806da90 2024-09-13T17:53:09.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:09.343+0000 7f99eea00640 1 -- 172.21.15.114:0/1254396570 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f99e813f180 con 0x7f99e806da90 2024-09-13T17:53:10.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.307+0000 7f99e4c00640 1 -- 172.21.15.114:0/1254396570 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f99d80543e0 con 0x7f99e806da90 2024-09-13T17:53:10.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.311+0000 7f99eea00640 1 -- 172.21.15.114:0/1254396570 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f99c40666c0 msgr2=0x7f99c4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:10.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.311+0000 7f99eea00640 1 --2- 172.21.15.114:0/1254396570 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f99c40666c0 0x7f99c4068b80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f99e815c4f0 tx=0x7f99d0008040 comp rx=0 tx=0).stop 2024-09-13T17:53:10.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.311+0000 7f99eea00640 1 -- 172.21.15.114:0/1254396570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99e806da90 msgr2=0x7f99e81557e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:10.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.311+0000 7f99eea00640 1 --2- 172.21.15.114:0/1254396570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99e806da90 0x7f99e81557e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f99d800c500 tx=0x7f99d800c9c0 comp rx=0 tx=0).stop 2024-09-13T17:53:10.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.311+0000 7f99eea00640 1 -- 172.21.15.114:0/1254396570 shutdown_connections 2024-09-13T17:53:10.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.311+0000 7f99eea00640 1 --2- 172.21.15.114:0/1254396570 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f99c40666c0 0x7f99c4068b80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:10.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.311+0000 7f99eea00640 1 --2- 172.21.15.114:0/1254396570 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f99e813f420 0x7f99e813e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:10.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.311+0000 7f99eea00640 1 --2- 172.21.15.114:0/1254396570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99e813c240 0x7f99e8153440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:10.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.311+0000 7f99eea00640 1 --2- 172.21.15.114:0/1254396570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99e806da90 0x7f99e81557e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:10.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.311+0000 7f99eea00640 1 -- 172.21.15.114:0/1254396570 >> 172.21.15.114:0/1254396570 conn(0x7f99e80660b0 msgr2=0x7f99e813a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:10.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.311+0000 7f99eea00640 1 -- 172.21.15.114:0/1254396570 shutdown_connections 2024-09-13T17:53:10.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.311+0000 7f99eea00640 1 -- 172.21.15.114:0/1254396570 wait complete. 2024-09-13T17:53:10.337 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T17:53:10.337 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T17:53:10.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.475+0000 7f7b05000640 1 Processor -- start 2024-09-13T17:53:10.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.475+0000 7f7b05000640 1 -- start start 2024-09-13T17:53:10.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.475+0000 7f7b05000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7b00151420 0x7f7b000cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:10.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.475+0000 7f7b05000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7b000ccba0 0x7f7b00070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:10.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.475+0000 7f7b05000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b00151800 con 0x7f7b00070960 2024-09-13T17:53:10.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.475+0000 7f7b05000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b000cbc30 con 0x7f7b00151420 2024-09-13T17:53:10.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.475+0000 7f7b05000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b00070d90 con 0x7f7b000ccba0 2024-09-13T17:53:10.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.475+0000 7f7afde00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7b00151420 0x7f7b000cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:10.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.475+0000 7f7afde00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7b00151420 0x7f7b000cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46088/0 (socket says 172.21.15.114:46088) 2024-09-13T17:53:10.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.475+0000 7f7afde00640 1 -- 172.21.15.114:0/2620411653 learned_addr learned my addr 172.21.15.114:0/2620411653 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:10.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.475+0000 7f7af5400640 1 --2- 172.21.15.114:0/2620411653 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7b000ccba0 0x7f7b00070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:10.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.475+0000 7f7afde00640 1 -- 172.21.15.114:0/2620411653 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7b000ccba0 msgr2=0x7f7b00070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:10.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.475+0000 7f7afde00640 1 --2- 172.21.15.114:0/2620411653 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7b000ccba0 0x7f7b00070420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:10.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.475+0000 7f7afde00640 1 -- 172.21.15.114:0/2620411653 >> v1:172.21.15.134:6789/0 conn(0x7f7b00070960 legacy=0x7f7b0015df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:10.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.475+0000 7f7afde00640 1 -- 172.21.15.114:0/2620411653 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b000cafb0 con 0x7f7b00151420 2024-09-13T17:53:10.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.475+0000 7f7af5400640 1 --2- 172.21.15.114:0/2620411653 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7b000ccba0 0x7f7b00070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:10.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.479+0000 7f7afde00640 1 --2- 172.21.15.114:0/2620411653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b00151420 0x7f7b000cc660 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7b000b3980 tx=0x7f7af001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=567e8f8cc40c0514 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:10.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.479+0000 7f7afd400640 1 -- 172.21.15.114:0/2620411653 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af0004230 con 0x7f7b00151420 2024-09-13T17:53:10.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.479+0000 7f7afd400640 1 -- 172.21.15.114:0/2620411653 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af00a7050 con 0x7f7b00151420 2024-09-13T17:53:10.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.479+0000 7f7afd400640 1 -- 172.21.15.114:0/2620411653 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af0003620 con 0x7f7b00151420 2024-09-13T17:53:10.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.479+0000 7f7b05000640 1 -- 172.21.15.114:0/2620411653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b00151420 msgr2=0x7f7b000cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:10.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.479+0000 7f7b05000640 1 --2- 172.21.15.114:0/2620411653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b00151420 0x7f7b000cc660 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7b000b3980 tx=0x7f7af001c390 comp rx=0 tx=0).stop 2024-09-13T17:53:10.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.479+0000 7f7b05000640 1 -- 172.21.15.114:0/2620411653 shutdown_connections 2024-09-13T17:53:10.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.479+0000 7f7b05000640 1 --2- 172.21.15.114:0/2620411653 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7b000ccba0 0x7f7b00070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:10.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.479+0000 7f7b05000640 1 --2- 172.21.15.114:0/2620411653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b00151420 0x7f7b000cc660 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:10.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.479+0000 7f7b05000640 1 -- 172.21.15.114:0/2620411653 >> 172.21.15.114:0/2620411653 conn(0x7f7b000660b0 msgr2=0x7f7b00069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:10.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.479+0000 7f7b05000640 1 -- 172.21.15.114:0/2620411653 shutdown_connections 2024-09-13T17:53:10.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.479+0000 7f7b05000640 1 -- 172.21.15.114:0/2620411653 wait complete. 2024-09-13T17:53:10.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.483+0000 7f7b05000640 1 Processor -- start 2024-09-13T17:53:10.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.483+0000 7f7b05000640 1 -- start start 2024-09-13T17:53:10.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.483+0000 7f7b05000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b00070960 0x7f7b000b3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:10.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.483+0000 7f7b05000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7b000ccba0 0x7f7b0014a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:10.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.483+0000 7f7b05000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b00151420 0x7f7b001f5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:10.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.483+0000 7f7b05000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b000b0730 con 0x7f7b00070960 2024-09-13T17:53:10.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.483+0000 7f7b05000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0014b170 con 0x7f7b00151420 2024-09-13T17:53:10.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.483+0000 7f7b05000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b000b0cb0 con 0x7f7b000ccba0 2024-09-13T17:53:10.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.483+0000 7f7afde00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b00070960 0x7f7b000b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:10.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.483+0000 7f7afde00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b00070960 0x7f7b000b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46104/0 (socket says 172.21.15.114:46104) 2024-09-13T17:53:10.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.483+0000 7f7afde00640 1 -- 172.21.15.114:0/2799979444 learned_addr learned my addr 172.21.15.114:0/2799979444 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:10.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.483+0000 7f7afe800640 1 --2- 172.21.15.114:0/2799979444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b00151420 0x7f7b001f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:10.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.483+0000 7f7af5400640 1 --2- 172.21.15.114:0/2799979444 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7b000ccba0 0x7f7b0014a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:10.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.483+0000 7f7afde00640 1 -- 172.21.15.114:0/2799979444 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7b000ccba0 msgr2=0x7f7b0014a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:10.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.483+0000 7f7afde00640 1 --2- 172.21.15.114:0/2799979444 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7b000ccba0 0x7f7b0014a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:10.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.483+0000 7f7afde00640 1 -- 172.21.15.114:0/2799979444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b00151420 msgr2=0x7f7b001f5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:10.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.483+0000 7f7afde00640 1 --2- 172.21.15.114:0/2799979444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b00151420 0x7f7b001f5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:10.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.483+0000 7f7afde00640 1 -- 172.21.15.114:0/2799979444 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af00094d0 con 0x7f7b00070960 2024-09-13T17:53:10.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.483+0000 7f7afde00640 1 --2- 172.21.15.114:0/2799979444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b00070960 0x7f7b000b3090 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7af001aa40 tx=0x7f7af0019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:10.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.483+0000 7f7af6a00640 1 -- 172.21.15.114:0/2799979444 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af0003cb0 con 0x7f7b00070960 2024-09-13T17:53:10.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.483+0000 7f7af6a00640 1 -- 172.21.15.114:0/2799979444 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af0003e10 con 0x7f7b00070960 2024-09-13T17:53:10.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.483+0000 7f7af6a00640 1 -- 172.21.15.114:0/2799979444 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af00ab660 con 0x7f7b00070960 2024-09-13T17:53:10.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.483+0000 7f7b05000640 1 -- 172.21.15.114:0/2799979444 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b000b09d0 con 0x7f7b00070960 2024-09-13T17:53:10.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.483+0000 7f7b05000640 1 -- 172.21.15.114:0/2799979444 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b000b35d0 con 0x7f7b00070960 2024-09-13T17:53:10.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.483+0000 7f7b05000640 1 -- 172.21.15.114:0/2799979444 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b00070400 con 0x7f7b00070960 2024-09-13T17:53:10.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.487+0000 7f7af6a00640 1 -- 172.21.15.114:0/2799979444 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7af00ab7c0 con 0x7f7b00070960 2024-09-13T17:53:10.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.487+0000 7f7af6a00640 1 --2- 172.21.15.114:0/2799979444 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7adc0666c0 0x7f7adc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:10.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.487+0000 7f7af6a00640 1 -- 172.21.15.114:0/2799979444 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7af011e900 con 0x7f7b00070960 2024-09-13T17:53:10.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.487+0000 7f7af5400640 1 --2- 172.21.15.114:0/2799979444 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7adc0666c0 0x7f7adc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:10.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.487+0000 7f7af5400640 1 --2- 172.21.15.114:0/2799979444 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7adc0666c0 0x7f7adc068b80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7b0014fd90 tx=0x7f7ae8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:10.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.491+0000 7f7af6a00640 1 -- 172.21.15.114:0/2799979444 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7af00ebaa0 con 0x7f7b00070960 2024-09-13T17:53:10.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:10.679+0000 7f7b05000640 1 -- 172.21.15.114:0/2799979444 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7b000713e0 con 0x7f7b00070960 2024-09-13T17:53:11.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.311+0000 7f7af6a00640 1 -- 172.21.15.114:0/2799979444 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7af00ef0c0 con 0x7f7b00070960 2024-09-13T17:53:11.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.311+0000 7f7b05000640 1 -- 172.21.15.114:0/2799979444 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7adc0666c0 msgr2=0x7f7adc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:11.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.311+0000 7f7b05000640 1 --2- 172.21.15.114:0/2799979444 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7adc0666c0 0x7f7adc068b80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7b0014fd90 tx=0x7f7ae8008040 comp rx=0 tx=0).stop 2024-09-13T17:53:11.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.311+0000 7f7b05000640 1 -- 172.21.15.114:0/2799979444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b00070960 msgr2=0x7f7b000b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:11.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.311+0000 7f7b05000640 1 --2- 172.21.15.114:0/2799979444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b00070960 0x7f7b000b3090 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7af001aa40 tx=0x7f7af0019130 comp rx=0 tx=0).stop 2024-09-13T17:53:11.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.311+0000 7f7b05000640 1 -- 172.21.15.114:0/2799979444 shutdown_connections 2024-09-13T17:53:11.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.311+0000 7f7b05000640 1 --2- 172.21.15.114:0/2799979444 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7adc0666c0 0x7f7adc068b80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:11.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.311+0000 7f7b05000640 1 --2- 172.21.15.114:0/2799979444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b00151420 0x7f7b001f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:11.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.311+0000 7f7b05000640 1 --2- 172.21.15.114:0/2799979444 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7b000ccba0 0x7f7b0014a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:11.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.311+0000 7f7b05000640 1 --2- 172.21.15.114:0/2799979444 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b00070960 0x7f7b000b3090 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:11.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.311+0000 7f7b05000640 1 -- 172.21.15.114:0/2799979444 >> 172.21.15.114:0/2799979444 conn(0x7f7b000660b0 msgr2=0x7f7b00159840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:11.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.311+0000 7f7b05000640 1 -- 172.21.15.114:0/2799979444 shutdown_connections 2024-09-13T17:53:11.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.311+0000 7f7b05000640 1 -- 172.21.15.114:0/2799979444 wait complete. 2024-09-13T17:53:11.339 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T17:53:11.339 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:53:11.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.471+0000 7fec25000640 1 Processor -- start 2024-09-13T17:53:11.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.471+0000 7fec25000640 1 -- start start 2024-09-13T17:53:11.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.471+0000 7fec25000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fec20158a70 0x7fec20070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:11.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.471+0000 7fec25000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fec200b1c20 0x7fec200711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:11.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.471+0000 7fec25000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec200b2490 con 0x7fec20159be0 2024-09-13T17:53:11.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.471+0000 7fec25000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec20158e50 con 0x7fec200b1c20 2024-09-13T17:53:11.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.471+0000 7fec25000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec200b21b0 con 0x7fec20158a70 2024-09-13T17:53:11.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.471+0000 7fec1e800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fec200b1c20 0x7fec200711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:11.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.471+0000 7fec1d400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fec20159be0 0x7fec200b1510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52600/0 (socket says 172.21.15.114:52600) 2024-09-13T17:53:11.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.471+0000 7fec1d400640 1 -- 172.21.15.114:0/1274665018 learned_addr learned my addr 172.21.15.114:0/1274665018 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:11.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.475+0000 7fec1de00640 1 --2- 172.21.15.114:0/1274665018 >> v2:172.21.15.134:3300/0 conn(0x7fec20158a70 0x7fec20070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:11.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.475+0000 7fec1e800640 1 -- 172.21.15.114:0/1274665018 >> v2:172.21.15.134:3300/0 conn(0x7fec20158a70 msgr2=0x7fec20070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:11.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.475+0000 7fec1e800640 1 --2- 172.21.15.114:0/1274665018 >> v2:172.21.15.134:3300/0 conn(0x7fec20158a70 0x7fec20070cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:11.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.475+0000 7fec1e800640 1 -- 172.21.15.114:0/1274665018 >> v1:172.21.15.114:6789/0 conn(0x7fec20159be0 legacy=0x7fec200b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:11.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.475+0000 7fec1e800640 1 -- 172.21.15.114:0/1274665018 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec20159100 con 0x7fec200b1c20 2024-09-13T17:53:11.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.475+0000 7fec1ca00640 1 -- 172.21.15.114:0/1274665018 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3939132183 0 0) 0x7fec200b2490 con 0x7fec20159be0 2024-09-13T17:53:11.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.475+0000 7fec1e800640 1 --2- 172.21.15.114:0/1274665018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec200b1c20 0x7fec200711f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fec2006e7f0 tx=0x7fec1801d790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e565927fc95754cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:11.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.475+0000 7fec1ca00640 1 -- 172.21.15.114:0/1274665018 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec180a67c0 con 0x7fec200b1c20 2024-09-13T17:53:11.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.475+0000 7fec1ca00640 1 -- 172.21.15.114:0/1274665018 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec180a6920 con 0x7fec200b1c20 2024-09-13T17:53:11.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.475+0000 7fec1ca00640 1 -- 172.21.15.114:0/1274665018 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec180a6cb0 con 0x7fec200b1c20 2024-09-13T17:53:11.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.475+0000 7fec25000640 1 -- 172.21.15.114:0/1274665018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec200b1c20 msgr2=0x7fec200711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:11.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.475+0000 7fec25000640 1 --2- 172.21.15.114:0/1274665018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec200b1c20 0x7fec200711f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fec2006e7f0 tx=0x7fec1801d790 comp rx=0 tx=0).stop 2024-09-13T17:53:11.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec25000640 1 -- 172.21.15.114:0/1274665018 shutdown_connections 2024-09-13T17:53:11.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec25000640 1 --2- 172.21.15.114:0/1274665018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec200b1c20 0x7fec200711f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:11.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec25000640 1 --2- 172.21.15.114:0/1274665018 >> v2:172.21.15.134:3300/0 conn(0x7fec20158a70 0x7fec20070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:11.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec25000640 1 -- 172.21.15.114:0/1274665018 >> 172.21.15.114:0/1274665018 conn(0x7fec200660b0 msgr2=0x7fec20069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:11.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec25000640 1 -- 172.21.15.114:0/1274665018 shutdown_connections 2024-09-13T17:53:11.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec25000640 1 -- 172.21.15.114:0/1274665018 wait complete. 2024-09-13T17:53:11.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec25000640 1 Processor -- start 2024-09-13T17:53:11.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec25000640 1 -- start start 2024-09-13T17:53:11.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec25000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec200b1c20 0x7fec201f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:11.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec25000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec20158a70 0x7fec200c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:11.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec25000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec20159be0 0x7fec2014ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:11.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec25000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2014efc0 con 0x7fec200b1c20 2024-09-13T17:53:11.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec25000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec200c53b0 con 0x7fec20159be0 2024-09-13T17:53:11.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec25000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec200c5690 con 0x7fec20158a70 2024-09-13T17:53:11.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec1de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec200b1c20 0x7fec201f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:11.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec1de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec200b1c20 0x7fec201f5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53904/0 (socket says 172.21.15.114:53904) 2024-09-13T17:53:11.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec1de00640 1 -- 172.21.15.114:0/3996515410 learned_addr learned my addr 172.21.15.114:0/3996515410 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:11.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec1e800640 1 --2- 172.21.15.114:0/3996515410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec20159be0 0x7fec2014ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:11.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec1d400640 1 --2- 172.21.15.114:0/3996515410 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec20158a70 0x7fec200c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:11.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec1de00640 1 -- 172.21.15.114:0/3996515410 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec20158a70 msgr2=0x7fec200c3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:11.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec1de00640 1 --2- 172.21.15.114:0/3996515410 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec20158a70 0x7fec200c3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:11.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec1de00640 1 -- 172.21.15.114:0/3996515410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec20159be0 msgr2=0x7fec2014ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:11.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec1de00640 1 --2- 172.21.15.114:0/3996515410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec20159be0 0x7fec2014ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:11.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec1de00640 1 -- 172.21.15.114:0/3996515410 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1800a5c0 con 0x7fec200b1c20 2024-09-13T17:53:11.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec1e800640 1 --2- 172.21.15.114:0/3996515410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec20159be0 0x7fec2014ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:11.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec1d400640 1 --2- 172.21.15.114:0/3996515410 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec20158a70 0x7fec200c3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:11.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec1de00640 1 --2- 172.21.15.114:0/3996515410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec200b1c20 0x7fec201f5010 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fec10007ef0 tx=0x7fec1000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:11.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec16000640 1 -- 172.21.15.114:0/3996515410 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec10014620 con 0x7fec200b1c20 2024-09-13T17:53:11.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec16000640 1 -- 172.21.15.114:0/3996515410 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec10014780 con 0x7fec200b1c20 2024-09-13T17:53:11.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec25000640 1 -- 172.21.15.114:0/3996515410 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec200c5970 con 0x7fec200b1c20 2024-09-13T17:53:11.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.479+0000 7fec16000640 1 -- 172.21.15.114:0/3996515410 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec10014b30 con 0x7fec200b1c20 2024-09-13T17:53:11.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.483+0000 7fec25000640 1 -- 172.21.15.114:0/3996515410 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2014f120 con 0x7fec200b1c20 2024-09-13T17:53:11.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.483+0000 7fec25000640 1 -- 172.21.15.114:0/3996515410 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec200b1510 con 0x7fec200b1c20 2024-09-13T17:53:11.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.483+0000 7fec16000640 1 -- 172.21.15.114:0/3996515410 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fec10014c90 con 0x7fec200b1c20 2024-09-13T17:53:11.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.483+0000 7fec16000640 1 --2- 172.21.15.114:0/3996515410 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fec00066690 0x7fec00068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:11.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.483+0000 7fec16000640 1 -- 172.21.15.114:0/3996515410 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fec10084d60 con 0x7fec200b1c20 2024-09-13T17:53:11.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.483+0000 7fec1d400640 1 --2- 172.21.15.114:0/3996515410 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fec00066690 0x7fec00068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:11.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.483+0000 7fec1d400640 1 --2- 172.21.15.114:0/3996515410 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fec00066690 0x7fec00068b50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fec0c007fd0 tx=0x7fec0c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:11.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.487+0000 7fec16000640 1 -- 172.21.15.114:0/3996515410 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fec10051ef0 con 0x7fec200b1c20 2024-09-13T17:53:11.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.671+0000 7fec25000640 1 -- 172.21.15.114:0/3996515410 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec20071510 con 0x7fec200b1c20 2024-09-13T17:53:11.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.675+0000 7fec16000640 1 -- 172.21.15.114:0/3996515410 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4743 (secure 0 0 0) 0x7fec10055510 con 0x7fec200b1c20 2024-09-13T17:53:11.679 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:11.679 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4940,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/895508060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":895508060},{"type":"v1","addr":"172.21.15.134:6834","nonce":895508060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5230,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1163188146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":1163188146},{"type":"v1","addr":"172.21.15.114:6837","nonce":1163188146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5313,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1106595705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1106595705},{"type":"v1","addr":"172.21.15.114:6835","nonce":1106595705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:53:08.298484+0000","modified":"2024-09-13T17:53:11.309977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5316},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5316":{"gid":5316,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/1239035445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":1239035445},{"type":"v1","addr":"172.21.15.134:6835","nonce":1239035445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T17:53:11.679 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 17 2024-09-13T17:53:11.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.675+0000 7fec25000640 1 -- 172.21.15.114:0/3996515410 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fec00066690 msgr2=0x7fec00068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:11.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.675+0000 7fec25000640 1 --2- 172.21.15.114:0/3996515410 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fec00066690 0x7fec00068b50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fec0c007fd0 tx=0x7fec0c009040 comp rx=0 tx=0).stop 2024-09-13T17:53:11.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.675+0000 7fec25000640 1 -- 172.21.15.114:0/3996515410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec200b1c20 msgr2=0x7fec201f5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:11.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.675+0000 7fec25000640 1 --2- 172.21.15.114:0/3996515410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec200b1c20 0x7fec201f5010 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fec10007ef0 tx=0x7fec1000e4b0 comp rx=0 tx=0).stop 2024-09-13T17:53:11.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.675+0000 7fec25000640 1 -- 172.21.15.114:0/3996515410 shutdown_connections 2024-09-13T17:53:11.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.675+0000 7fec25000640 1 --2- 172.21.15.114:0/3996515410 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fec00066690 0x7fec00068b50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:11.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.675+0000 7fec25000640 1 --2- 172.21.15.114:0/3996515410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec20159be0 0x7fec2014ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:11.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.675+0000 7fec25000640 1 --2- 172.21.15.114:0/3996515410 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fec20158a70 0x7fec200c3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:11.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.675+0000 7fec25000640 1 --2- 172.21.15.114:0/3996515410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec200b1c20 0x7fec201f5010 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:11.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.675+0000 7fec25000640 1 -- 172.21.15.114:0/3996515410 >> 172.21.15.114:0/3996515410 conn(0x7fec200660b0 msgr2=0x7fec201576f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:11.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.675+0000 7fec25000640 1 -- 172.21.15.114:0/3996515410 shutdown_connections 2024-09-13T17:53:11.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.675+0000 7fec25000640 1 -- 172.21.15.114:0/3996515410 wait complete. 2024-09-13T17:53:11.700 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:53:11.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.831+0000 7fa2dd400640 1 Processor -- start 2024-09-13T17:53:11.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.831+0000 7fa2dd400640 1 -- start start 2024-09-13T17:53:11.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.831+0000 7fa2dd400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa2d813f420 0x7fa2d806d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:11.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.831+0000 7fa2dd400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa2d806da90 0x7fa2d80cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:11.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.831+0000 7fa2dd400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d80cd220 con 0x7fa2d813c240 2024-09-13T17:53:11.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.831+0000 7fa2dd400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d806df40 con 0x7fa2d806da90 2024-09-13T17:53:11.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.831+0000 7fa2dd400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d815a740 con 0x7fa2d813f420 2024-09-13T17:53:11.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.831+0000 7fa2d6800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa2d813c240 0x7fa2d813c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52612/0 (socket says 172.21.15.114:52612) 2024-09-13T17:53:11.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.831+0000 7fa2d6800640 1 -- 172.21.15.114:0/3084483962 learned_addr learned my addr 172.21.15.114:0/3084483962 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:11.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.831+0000 7fa2d7200640 1 --2- 172.21.15.114:0/3084483962 >> v2:172.21.15.114:3300/0 conn(0x7fa2d806da90 0x7fa2d80cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:11.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.831+0000 7fa2cde00640 1 --2- 172.21.15.114:0/3084483962 >> v2:172.21.15.134:3300/0 conn(0x7fa2d813f420 0x7fa2d806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:11.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.831+0000 7fa2d5e00640 1 -- 172.21.15.114:0/3084483962 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859469815 0 0) 0x7fa2d80cd220 con 0x7fa2d813c240 2024-09-13T17:53:11.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.831+0000 7fa2d5e00640 1 -- 172.21.15.114:0/3084483962 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2bc005740 con 0x7fa2d813c240 2024-09-13T17:53:11.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.831+0000 7fa2d7200640 1 -- 172.21.15.114:0/3084483962 >> v2:172.21.15.134:3300/0 conn(0x7fa2d813f420 msgr2=0x7fa2d806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:11.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.831+0000 7fa2d7200640 1 --2- 172.21.15.114:0/3084483962 >> v2:172.21.15.134:3300/0 conn(0x7fa2d813f420 0x7fa2d806d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:11.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.831+0000 7fa2d7200640 1 -- 172.21.15.114:0/3084483962 >> v1:172.21.15.114:6789/0 conn(0x7fa2d813c240 legacy=0x7fa2d813c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:11.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.831+0000 7fa2d7200640 1 -- 172.21.15.114:0/3084483962 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d8159bc0 con 0x7fa2d806da90 2024-09-13T17:53:11.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.831+0000 7fa2cde00640 1 --2- 172.21.15.114:0/3084483962 >> v2:172.21.15.134:3300/0 conn(0x7fa2d813f420 0x7fa2d806d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:11.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.835+0000 7fa2d7200640 1 --2- 172.21.15.114:0/3084483962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2d806da90 0x7fa2d80cd650 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa2d80ae130 tx=0x7fa2d001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd21e123022a4a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:11.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.835+0000 7fa2d5e00640 1 -- 172.21.15.114:0/3084483962 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d00a59c0 con 0x7fa2d806da90 2024-09-13T17:53:11.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.835+0000 7fa2d5e00640 1 -- 172.21.15.114:0/3084483962 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d00a5b20 con 0x7fa2d806da90 2024-09-13T17:53:11.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.835+0000 7fa2d5e00640 1 -- 172.21.15.114:0/3084483962 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d00ad440 con 0x7fa2d806da90 2024-09-13T17:53:11.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.835+0000 7fa2dd400640 1 -- 172.21.15.114:0/3084483962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2d806da90 msgr2=0x7fa2d80cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:11.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.835+0000 7fa2dd400640 1 --2- 172.21.15.114:0/3084483962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2d806da90 0x7fa2d80cd650 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa2d80ae130 tx=0x7fa2d001c900 comp rx=0 tx=0).stop 2024-09-13T17:53:11.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.835+0000 7fa2dd400640 1 -- 172.21.15.114:0/3084483962 shutdown_connections 2024-09-13T17:53:11.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.835+0000 7fa2dd400640 1 --2- 172.21.15.114:0/3084483962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2d806da90 0x7fa2d80cd650 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:11.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.835+0000 7fa2dd400640 1 --2- 172.21.15.114:0/3084483962 >> v2:172.21.15.134:3300/0 conn(0x7fa2d813f420 0x7fa2d806d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:11.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.835+0000 7fa2dd400640 1 -- 172.21.15.114:0/3084483962 >> 172.21.15.114:0/3084483962 conn(0x7fa2d80660b0 msgr2=0x7fa2d8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:11.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.835+0000 7fa2dd400640 1 -- 172.21.15.114:0/3084483962 shutdown_connections 2024-09-13T17:53:11.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.835+0000 7fa2dd400640 1 -- 172.21.15.114:0/3084483962 wait complete. 2024-09-13T17:53:11.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.839+0000 7fa2dd400640 1 Processor -- start 2024-09-13T17:53:11.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.839+0000 7fa2dd400640 1 -- start start 2024-09-13T17:53:11.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.839+0000 7fa2dd400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2d806da90 0x7fa2d813a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:11.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.839+0000 7fa2dd400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2d813c240 0x7fa2d80ad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:11.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.839+0000 7fa2dd400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2d813f420 0x7fa2d80af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:11.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.839+0000 7fa2dd400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d80aeb90 con 0x7fa2d813f420 2024-09-13T17:53:11.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.839+0000 7fa2dd400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d813aef0 con 0x7fa2d813c240 2024-09-13T17:53:11.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.839+0000 7fa2dd400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d80aca80 con 0x7fa2d806da90 2024-09-13T17:53:11.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.839+0000 7fa2d7200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2d813f420 0x7fa2d80af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:11.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.839+0000 7fa2d7200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2d813f420 0x7fa2d80af2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53920/0 (socket says 172.21.15.114:53920) 2024-09-13T17:53:11.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.839+0000 7fa2d7200640 1 -- 172.21.15.114:0/3962448276 learned_addr learned my addr 172.21.15.114:0/3962448276 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:11.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.839+0000 7fa2d7200640 1 -- 172.21.15.114:0/3962448276 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2d806da90 msgr2=0x7fa2d813a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:11.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.839+0000 7fa2d7200640 1 --2- 172.21.15.114:0/3962448276 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2d806da90 0x7fa2d813a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:11.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.839+0000 7fa2d7200640 1 -- 172.21.15.114:0/3962448276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2d813c240 msgr2=0x7fa2d80ad5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:11.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.839+0000 7fa2d7200640 1 --2- 172.21.15.114:0/3962448276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2d813c240 0x7fa2d80ad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:11.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.839+0000 7fa2d7200640 1 -- 172.21.15.114:0/3962448276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d0009a70 con 0x7fa2d813f420 2024-09-13T17:53:11.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.839+0000 7fa2d7200640 1 --2- 172.21.15.114:0/3962448276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2d813f420 0x7fa2d80af2c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0019510 tx=0x7fa2d80ce3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:11.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.839+0000 7fa2cf400640 1 -- 172.21.15.114:0/3962448276 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d00be070 con 0x7fa2d813f420 2024-09-13T17:53:11.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.839+0000 7fa2cf400640 1 -- 172.21.15.114:0/3962448276 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d0009450 con 0x7fa2d813f420 2024-09-13T17:53:11.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.839+0000 7fa2cf400640 1 -- 172.21.15.114:0/3962448276 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d00addd0 con 0x7fa2d813f420 2024-09-13T17:53:11.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.839+0000 7fa2dd400640 1 -- 172.21.15.114:0/3962448276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d80acd20 con 0x7fa2d813f420 2024-09-13T17:53:11.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.839+0000 7fa2dd400640 1 -- 172.21.15.114:0/3962448276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d80aeda0 con 0x7fa2d813f420 2024-09-13T17:53:11.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.839+0000 7fa2dd400640 1 -- 172.21.15.114:0/3962448276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d80aef90 con 0x7fa2d813f420 2024-09-13T17:53:11.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.843+0000 7fa2cf400640 1 -- 172.21.15.114:0/3962448276 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa2d00b4040 con 0x7fa2d813f420 2024-09-13T17:53:11.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.843+0000 7fa2cf400640 1 --2- 172.21.15.114:0/3962448276 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa2b4066690 0x7fa2b4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:11.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.843+0000 7fa2cf400640 1 -- 172.21.15.114:0/3962448276 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa2d011ed10 con 0x7fa2d813f420 2024-09-13T17:53:11.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.843+0000 7fa2d6800640 1 --2- 172.21.15.114:0/3962448276 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa2b4066690 0x7fa2b4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:11.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.843+0000 7fa2d6800640 1 --2- 172.21.15.114:0/3962448276 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa2b4066690 0x7fa2b4068b50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8007fd0 tx=0x7fa2c8007940 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:11.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:11.847+0000 7fa2cf400640 1 -- 172.21.15.114:0/3962448276 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa2d00ec080 con 0x7fa2d813f420 2024-09-13T17:53:11.890 INFO:tasks.ceph.mds.d.smithi134.stderr:2024-09-13T17:53:11.887+0000 7fe311000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:53:12.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.003+0000 7fa2dd400640 1 -- 172.21.15.114:0/3962448276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2d815a4c0 con 0x7fa2d813f420 2024-09-13T17:53:12.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.003+0000 7fa2cf400640 1 -- 172.21.15.114:0/3962448276 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16822 (secure 0 0 0) 0x7fa2d00ef6a0 con 0x7fa2d813f420 2024-09-13T17:53:12.009 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:12.009 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":39,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:53:09.301327+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:53:06.185439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:53:07.297633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:53:12.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.007+0000 7fa2dd400640 1 -- 172.21.15.114:0/3962448276 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa2b4066690 msgr2=0x7fa2b4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:12.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.007+0000 7fa2dd400640 1 --2- 172.21.15.114:0/3962448276 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa2b4066690 0x7fa2b4068b50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8007fd0 tx=0x7fa2c8007940 comp rx=0 tx=0).stop 2024-09-13T17:53:12.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.007+0000 7fa2dd400640 1 -- 172.21.15.114:0/3962448276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2d813f420 msgr2=0x7fa2d80af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:12.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.007+0000 7fa2dd400640 1 --2- 172.21.15.114:0/3962448276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2d813f420 0x7fa2d80af2c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0019510 tx=0x7fa2d80ce3a0 comp rx=0 tx=0).stop 2024-09-13T17:53:12.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.007+0000 7fa2dd400640 1 -- 172.21.15.114:0/3962448276 shutdown_connections 2024-09-13T17:53:12.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.007+0000 7fa2dd400640 1 --2- 172.21.15.114:0/3962448276 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa2b4066690 0x7fa2b4068b50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:12.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.007+0000 7fa2dd400640 1 --2- 172.21.15.114:0/3962448276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa2d813f420 0x7fa2d80af2c0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:12.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.007+0000 7fa2dd400640 1 --2- 172.21.15.114:0/3962448276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2d813c240 0x7fa2d80ad5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:12.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.007+0000 7fa2dd400640 1 --2- 172.21.15.114:0/3962448276 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa2d806da90 0x7fa2d813a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:12.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.007+0000 7fa2dd400640 1 -- 172.21.15.114:0/3962448276 >> 172.21.15.114:0/3962448276 conn(0x7fa2d80660b0 msgr2=0x7fa2d813e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:12.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.007+0000 7fa2dd400640 1 -- 172.21.15.114:0/3962448276 shutdown_connections 2024-09-13T17:53:12.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.007+0000 7fa2dd400640 1 -- 172.21.15.114:0/3962448276 wait complete. 2024-09-13T17:53:12.031 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T17:53:12.031 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:53:12.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.163+0000 7f0fda000640 1 Processor -- start 2024-09-13T17:53:12.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.163+0000 7f0fda000640 1 -- start start 2024-09-13T17:53:12.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.163+0000 7f0fda000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fd4070420 0x7f0fd4070860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:12.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.163+0000 7f0fda000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0fd406c540 0x7f0fd406c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:12.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.163+0000 7f0fda000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd4070da0 con 0x7f0fd4151420 2024-09-13T17:53:12.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.163+0000 7f0fda000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd40cbc30 con 0x7f0fd406c540 2024-09-13T17:53:12.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.163+0000 7f0fda000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd4151800 con 0x7f0fd4070420 2024-09-13T17:53:12.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.163+0000 7f0fd3e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0fd406c540 0x7f0fd406c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:12.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.163+0000 7f0fd3400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0fd4151420 0x7f0fd40cc660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52618/0 (socket says 172.21.15.114:52618) 2024-09-13T17:53:12.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.163+0000 7f0fd3400640 1 -- 172.21.15.114:0/607191119 learned_addr learned my addr 172.21.15.114:0/607191119 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:12.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.163+0000 7f0fd2a00640 1 --2- 172.21.15.114:0/607191119 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fd4070420 0x7f0fd4070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:12.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.163+0000 7f0fd3e00640 1 -- 172.21.15.114:0/607191119 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fd4070420 msgr2=0x7f0fd4070860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:12.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.163+0000 7f0fd3e00640 1 --2- 172.21.15.114:0/607191119 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fd4070420 0x7f0fd4070860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:12.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.163+0000 7f0fd3e00640 1 -- 172.21.15.114:0/607191119 >> v1:172.21.15.114:6789/0 conn(0x7f0fd4151420 legacy=0x7f0fd40cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:12.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.163+0000 7f0fd3e00640 1 -- 172.21.15.114:0/607191119 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd40cafb0 con 0x7f0fd406c540 2024-09-13T17:53:12.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.167+0000 7f0fd3e00640 1 --2- 172.21.15.114:0/607191119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fd406c540 0x7f0fd406c990 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc009d90 tx=0x7f0fcc01c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d3721344826d4b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:12.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.167+0000 7f0fd2000640 1 -- 172.21.15.114:0/607191119 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc0a58e0 con 0x7f0fd406c540 2024-09-13T17:53:12.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.167+0000 7f0fd2000640 1 -- 172.21.15.114:0/607191119 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fcc0a5a40 con 0x7f0fd406c540 2024-09-13T17:53:12.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.167+0000 7f0fd2000640 1 -- 172.21.15.114:0/607191119 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc0a5dd0 con 0x7f0fd406c540 2024-09-13T17:53:12.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.167+0000 7f0fda000640 1 -- 172.21.15.114:0/607191119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fd406c540 msgr2=0x7f0fd406c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:12.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.167+0000 7f0fda000640 1 --2- 172.21.15.114:0/607191119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fd406c540 0x7f0fd406c990 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc009d90 tx=0x7f0fcc01c820 comp rx=0 tx=0).stop 2024-09-13T17:53:12.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.167+0000 7f0fda000640 1 -- 172.21.15.114:0/607191119 shutdown_connections 2024-09-13T17:53:12.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.167+0000 7f0fda000640 1 --2- 172.21.15.114:0/607191119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fd406c540 0x7f0fd406c990 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:12.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.167+0000 7f0fda000640 1 --2- 172.21.15.114:0/607191119 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fd4070420 0x7f0fd4070860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:12.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.167+0000 7f0fda000640 1 -- 172.21.15.114:0/607191119 >> 172.21.15.114:0/607191119 conn(0x7f0fd40660b0 msgr2=0x7f0fd4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:12.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.167+0000 7f0fda000640 1 -- 172.21.15.114:0/607191119 shutdown_connections 2024-09-13T17:53:12.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.167+0000 7f0fda000640 1 -- 172.21.15.114:0/607191119 wait complete. 2024-09-13T17:53:12.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.167+0000 7f0fda000640 1 Processor -- start 2024-09-13T17:53:12.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.167+0000 7f0fda000640 1 -- start start 2024-09-13T17:53:12.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.171+0000 7f0fda000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fd406c540 0x7f0fd414ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:12.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.171+0000 7f0fda000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fd4070420 0x7f0fd40ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:12.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.171+0000 7f0fda000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fd4151420 0x7f0fd414c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:12.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.171+0000 7f0fda000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd414f140 con 0x7f0fd4151420 2024-09-13T17:53:12.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.171+0000 7f0fda000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd414eac0 con 0x7f0fd406c540 2024-09-13T17:53:12.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.171+0000 7f0fda000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd40af1c0 con 0x7f0fd4070420 2024-09-13T17:53:12.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.171+0000 7f0fd3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fd4151420 0x7f0fd414c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:12.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.171+0000 7f0fd3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fd4151420 0x7f0fd414c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53944/0 (socket says 172.21.15.114:53944) 2024-09-13T17:53:12.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.171+0000 7f0fd3e00640 1 -- 172.21.15.114:0/2803561082 learned_addr learned my addr 172.21.15.114:0/2803561082 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:12.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.171+0000 7f0fd2a00640 1 --2- 172.21.15.114:0/2803561082 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fd4070420 0x7f0fd40ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:12.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.171+0000 7f0fd3400640 1 --2- 172.21.15.114:0/2803561082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fd406c540 0x7f0fd414ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:12.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.171+0000 7f0fd3e00640 1 -- 172.21.15.114:0/2803561082 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fd4070420 msgr2=0x7f0fd40ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:12.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.171+0000 7f0fd3e00640 1 --2- 172.21.15.114:0/2803561082 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fd4070420 0x7f0fd40ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:12.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.171+0000 7f0fd3e00640 1 -- 172.21.15.114:0/2803561082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fd406c540 msgr2=0x7f0fd414ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:12.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.171+0000 7f0fd3e00640 1 --2- 172.21.15.114:0/2803561082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fd406c540 0x7f0fd414ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:12.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.171+0000 7f0fd3e00640 1 -- 172.21.15.114:0/2803561082 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fcc009a70 con 0x7f0fd4151420 2024-09-13T17:53:12.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.171+0000 7f0fd3e00640 1 --2- 172.21.15.114:0/2803561082 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fd4151420 0x7f0fd414c6a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc0b0040 tx=0x7f0fcc0195c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:12.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.171+0000 7f0fcb400640 1 -- 172.21.15.114:0/2803561082 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc0ad850 con 0x7f0fd4151420 2024-09-13T17:53:12.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.171+0000 7f0fcb400640 1 -- 172.21.15.114:0/2803561082 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fcc0ad9b0 con 0x7f0fd4151420 2024-09-13T17:53:12.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.171+0000 7f0fcb400640 1 -- 172.21.15.114:0/2803561082 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc0add40 con 0x7f0fd4151420 2024-09-13T17:53:12.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.171+0000 7f0fda000640 1 -- 172.21.15.114:0/2803561082 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd414ed60 con 0x7f0fd4151420 2024-09-13T17:53:12.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.171+0000 7f0fda000640 1 -- 172.21.15.114:0/2803561082 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd40af4a0 con 0x7f0fd4151420 2024-09-13T17:53:12.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.171+0000 7f0fda000640 1 -- 172.21.15.114:0/2803561082 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd406c990 con 0x7f0fd4151420 2024-09-13T17:53:12.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.171+0000 7f0fcb400640 1 -- 172.21.15.114:0/2803561082 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0fcc0b4050 con 0x7f0fd4151420 2024-09-13T17:53:12.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.175+0000 7f0fcb400640 1 --2- 172.21.15.114:0/2803561082 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0fb4066690 0x7f0fb4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:12.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.175+0000 7f0fcb400640 1 -- 172.21.15.114:0/2803561082 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0fcc11f5f0 con 0x7f0fd4151420 2024-09-13T17:53:12.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.175+0000 7f0fd3400640 1 --2- 172.21.15.114:0/2803561082 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0fb4066690 0x7f0fb4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:12.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.175+0000 7f0fd3400640 1 --2- 172.21.15.114:0/2803561082 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0fb4066690 0x7f0fb4068b50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4000f70 tx=0x7f0fc4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:12.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.179+0000 7f0fcb400640 1 -- 172.21.15.114:0/2803561082 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0fcc0ec9e0 con 0x7f0fd4151420 2024-09-13T17:53:12.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.327+0000 7f0fda000640 1 -- 172.21.15.114:0/2803561082 --> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0fd40ccd70 con 0x7f0fb4066690 2024-09-13T17:53:12.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.335+0000 7f0fcb400640 1 -- 172.21.15.114:0/2803561082 <== mgr.4102 v2:172.21.15.114:6832/137691478 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285650 (secure 0 0 0) 0x7f0fc4001350 con 0x7f0fb4066690 2024-09-13T17:53:12.343 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:12.346 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-13T17:53:12.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.339+0000 7f0fda000640 1 -- 172.21.15.114:0/2803561082 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0fb4066690 msgr2=0x7f0fb4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:12.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.339+0000 7f0fda000640 1 --2- 172.21.15.114:0/2803561082 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0fb4066690 0x7f0fb4068b50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4000f70 tx=0x7f0fc4009040 comp rx=0 tx=0).stop 2024-09-13T17:53:12.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.339+0000 7f0fda000640 1 -- 172.21.15.114:0/2803561082 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fd4151420 msgr2=0x7f0fd414c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:12.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.339+0000 7f0fda000640 1 --2- 172.21.15.114:0/2803561082 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fd4151420 0x7f0fd414c6a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc0b0040 tx=0x7f0fcc0195c0 comp rx=0 tx=0).stop 2024-09-13T17:53:12.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.339+0000 7f0fda000640 1 -- 172.21.15.114:0/2803561082 shutdown_connections 2024-09-13T17:53:12.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.339+0000 7f0fda000640 1 --2- 172.21.15.114:0/2803561082 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0fb4066690 0x7f0fb4068b50 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:12.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.339+0000 7f0fda000640 1 --2- 172.21.15.114:0/2803561082 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fd4151420 0x7f0fd414c6a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:12.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.339+0000 7f0fda000640 1 --2- 172.21.15.114:0/2803561082 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0fd4070420 0x7f0fd40ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:12.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.339+0000 7f0fda000640 1 --2- 172.21.15.114:0/2803561082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0fd406c540 0x7f0fd414ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:12.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.339+0000 7f0fda000640 1 -- 172.21.15.114:0/2803561082 >> 172.21.15.114:0/2803561082 conn(0x7f0fd40660b0 msgr2=0x7f0fd40cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:12.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.339+0000 7f0fda000640 1 -- 172.21.15.114:0/2803561082 shutdown_connections 2024-09-13T17:53:12.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.339+0000 7f0fda000640 1 -- 172.21.15.114:0/2803561082 wait complete. 2024-09-13T17:53:12.365 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-09-13T17:53:11.952036+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220552,"kb_used_data":4392,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754168,"statfs":{"total":773094113280,"available":772868268032,"internally_reserved":0,"allocated":4497408,"data_stored":2571176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.044607"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.913592+0000","last_change":"2024-09-13T17:53:07.913592+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.913592+0000","last_undegraded":"2024-09-13T17:53:07.913592+0000","last_fullsized":"2024-09-13T17:53:07.913592+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:02.633358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.914181+0000","last_change":"2024-09-13T17:53:07.914181+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.914181+0000","last_undegraded":"2024-09-13T17:53:07.914181+0000","last_fullsized":"2024-09-13T17:53:07.914181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:11.750011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.922409+0000","last_change":"2024-09-13T17:53:07.922409+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.922409+0000","last_undegraded":"2024-09-13T17:53:07.922409+0000","last_fullsized":"2024-09-13T17:53:07.922409+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:29.844579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.918289+0000","last_change":"2024-09-13T17:53:07.918289+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.918289+0000","last_undegraded":"2024-09-13T17:53:07.918289+0000","last_fullsized":"2024-09-13T17:53:07.918289+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:04:50.600660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.917372+0000","last_change":"2024-09-13T17:53:07.917372+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.917372+0000","last_undegraded":"2024-09-13T17:53:07.917372+0000","last_fullsized":"2024-09-13T17:53:07.917372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:15.795161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.920013+0000","last_change":"2024-09-13T17:53:07.920013+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.920013+0000","last_undegraded":"2024-09-13T17:53:07.920013+0000","last_fullsized":"2024-09-13T17:53:07.920013+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:15.154333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.922040+0000","last_change":"2024-09-13T17:53:07.922040+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.922040+0000","last_undegraded":"2024-09-13T17:53:07.922040+0000","last_fullsized":"2024-09-13T17:53:07.922040+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:00.206010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.913515+0000","last_change":"2024-09-13T17:53:07.913515+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.913515+0000","last_undegraded":"2024-09-13T17:53:07.913515+0000","last_fullsized":"2024-09-13T17:53:07.913515+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:39.920002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.921842+0000","last_change":"2024-09-13T17:53:07.921842+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.921842+0000","last_undegraded":"2024-09-13T17:53:07.921842+0000","last_fullsized":"2024-09-13T17:53:07.921842+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:58.339595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.921409+0000","last_change":"2024-09-13T17:53:07.921409+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.921409+0000","last_undegraded":"2024-09-13T17:53:07.921409+0000","last_fullsized":"2024-09-13T17:53:07.921409+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:08.746286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.920282+0000","last_change":"2024-09-13T17:53:07.920282+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.920282+0000","last_undegraded":"2024-09-13T17:53:07.920282+0000","last_fullsized":"2024-09-13T17:53:07.920282+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:02.660007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.922001+0000","last_change":"2024-09-13T17:53:07.922001+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.922001+0000","last_undegraded":"2024-09-13T17:53:07.922001+0000","last_fullsized":"2024-09-13T17:53:07.922001+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:24.523487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.919785+0000","last_change":"2024-09-13T17:53:07.919785+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.919785+0000","last_undegraded":"2024-09-13T17:53:07.919785+0000","last_fullsized":"2024-09-13T17:53:07.919785+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:24.523487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.923536+0000","last_change":"2024-09-13T17:53:07.923536+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.923536+0000","last_undegraded":"2024-09-13T17:53:07.923536+0000","last_fullsized":"2024-09-13T17:53:07.923536+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:51.440182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.919382+0000","last_change":"2024-09-13T17:53:07.919382+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.919382+0000","last_undegraded":"2024-09-13T17:53:07.919382+0000","last_fullsized":"2024-09-13T17:53:07.919382+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:16.635091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.934811+0000","last_change":"2024-09-13T17:53:07.934811+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.934811+0000","last_undegraded":"2024-09-13T17:53:07.934811+0000","last_fullsized":"2024-09-13T17:53:07.934811+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:42.945540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.932902+0000","last_change":"2024-09-13T17:53:07.932902+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.932902+0000","last_undegraded":"2024-09-13T17:53:07.932902+0000","last_fullsized":"2024-09-13T17:53:07.932902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:43.484986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.914267+0000","last_change":"2024-09-13T17:53:07.914267+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.914267+0000","last_undegraded":"2024-09-13T17:53:07.914267+0000","last_fullsized":"2024-09-13T17:53:07.914267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:09.561563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.916812+0000","last_change":"2024-09-13T17:53:07.916812+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.916812+0000","last_undegraded":"2024-09-13T17:53:07.916812+0000","last_fullsized":"2024-09-13T17:53:07.916812+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:46.004449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.915214+0000","last_change":"2024-09-13T17:53:07.915214+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.915214+0000","last_undegraded":"2024-09-13T17:53:07.915214+0000","last_fullsized":"2024-09-13T17:53:07.915214+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:30.620140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.919237+0000","last_change":"2024-09-13T17:53:07.919237+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.919237+0000","last_undegraded":"2024-09-13T17:53:07.919237+0000","last_fullsized":"2024-09-13T17:53:07.919237+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:51.440182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.918246+0000","last_change":"2024-09-13T17:53:07.918246+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.918246+0000","last_undegraded":"2024-09-13T17:53:07.918246+0000","last_fullsized":"2024-09-13T17:53:07.918246+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:02.621171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.932894+0000","last_change":"2024-09-13T17:53:07.932894+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.932894+0000","last_undegraded":"2024-09-13T17:53:07.932894+0000","last_fullsized":"2024-09-13T17:53:07.932894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:02.660007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.917294+0000","last_change":"2024-09-13T17:53:07.917294+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.917294+0000","last_undegraded":"2024-09-13T17:53:07.917294+0000","last_fullsized":"2024-09-13T17:53:07.917294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:39.411729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.915293+0000","last_change":"2024-09-13T17:53:07.915293+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.915293+0000","last_undegraded":"2024-09-13T17:53:07.915293+0000","last_fullsized":"2024-09-13T17:53:07.915293+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:19.636768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.924894+0000","last_change":"2024-09-13T17:53:07.924894+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.924894+0000","last_undegraded":"2024-09-13T17:53:07.924894+0000","last_fullsized":"2024-09-13T17:53:07.924894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:05.172827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.914373+0000","last_change":"2024-09-13T17:53:07.914373+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.914373+0000","last_undegraded":"2024-09-13T17:53:07.914373+0000","last_fullsized":"2024-09-13T17:53:07.914373+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:05.594213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.918522+0000","last_change":"2024-09-13T17:53:07.918522+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.918522+0000","last_undegraded":"2024-09-13T17:53:07.918522+0000","last_fullsized":"2024-09-13T17:53:07.918522+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:55.588582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.914463+0000","last_change":"2024-09-13T17:53:07.914463+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.914463+0000","last_undegraded":"2024-09-13T17:53:07.914463+0000","last_fullsized":"2024-09-13T17:53:07.914463+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:07.544794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.915528+0000","last_change":"2024-09-13T17:53:07.915528+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.915528+0000","last_undegraded":"2024-09-13T17:53:07.915528+0000","last_fullsized":"2024-09-13T17:53:07.915528+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:06.338741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.925481+0000","last_change":"2024-09-13T17:53:07.925481+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.925481+0000","last_undegraded":"2024-09-13T17:53:07.925481+0000","last_fullsized":"2024-09-13T17:53:07.925481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:15.154333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.924668+0000","last_change":"2024-09-13T17:53:07.924668+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.924668+0000","last_undegraded":"2024-09-13T17:53:07.924668+0000","last_fullsized":"2024-09-13T17:53:07.924668+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:42.945540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.924863+0000","last_change":"2024-09-13T17:53:07.924863+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.924863+0000","last_undegraded":"2024-09-13T17:53:07.924863+0000","last_fullsized":"2024-09-13T17:53:07.924863+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:05.297506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.931791+0000","last_change":"2024-09-13T17:53:07.927772+0000","last_active":"2024-09-13T17:53:07.931791+0000","last_peered":"2024-09-13T17:53:07.931791+0000","last_clean":"2024-09-13T17:53:07.931791+0000","last_became_active":"2024-09-13T17:53:07.926833+0000","last_became_peered":"2024-09-13T17:53:07.926833+0000","last_unstale":"2024-09-13T17:53:07.931791+0000","last_undegraded":"2024-09-13T17:53:07.931791+0000","last_fullsized":"2024-09-13T17:53:07.931791+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:26.713460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.925979+0000","last_change":"2024-09-13T17:53:07.925979+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.925979+0000","last_undegraded":"2024-09-13T17:53:07.925979+0000","last_fullsized":"2024-09-13T17:53:07.925979+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:00.206010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.943737+0000","last_change":"2024-09-13T17:53:07.942858+0000","last_active":"2024-09-13T17:53:07.943737+0000","last_peered":"2024-09-13T17:53:07.943737+0000","last_clean":"2024-09-13T17:53:07.943737+0000","last_became_active":"2024-09-13T17:53:07.942331+0000","last_became_peered":"2024-09-13T17:53:07.942331+0000","last_unstale":"2024-09-13T17:53:07.943737+0000","last_undegraded":"2024-09-13T17:53:07.943737+0000","last_fullsized":"2024-09-13T17:53:07.943737+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:52.434464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.919076+0000","last_change":"2024-09-13T17:53:07.919076+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.919076+0000","last_undegraded":"2024-09-13T17:53:07.919076+0000","last_fullsized":"2024-09-13T17:53:07.919076+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:58.339595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.945322+0000","last_change":"2024-09-13T17:53:07.942677+0000","last_active":"2024-09-13T17:53:07.945322+0000","last_peered":"2024-09-13T17:53:07.945322+0000","last_clean":"2024-09-13T17:53:07.945322+0000","last_became_active":"2024-09-13T17:53:07.942426+0000","last_became_peered":"2024-09-13T17:53:07.942426+0000","last_unstale":"2024-09-13T17:53:07.945322+0000","last_undegraded":"2024-09-13T17:53:07.945322+0000","last_fullsized":"2024-09-13T17:53:07.945322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:08.554504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.914136+0000","last_change":"2024-09-13T17:53:07.914136+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.914136+0000","last_undegraded":"2024-09-13T17:53:07.914136+0000","last_fullsized":"2024-09-13T17:53:07.914136+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:13.404809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.932523+0000","last_change":"2024-09-13T17:53:07.931288+0000","last_active":"2024-09-13T17:53:07.932523+0000","last_peered":"2024-09-13T17:53:07.932523+0000","last_clean":"2024-09-13T17:53:07.932523+0000","last_became_active":"2024-09-13T17:53:07.929489+0000","last_became_peered":"2024-09-13T17:53:07.929489+0000","last_unstale":"2024-09-13T17:53:07.932523+0000","last_undegraded":"2024-09-13T17:53:07.932523+0000","last_fullsized":"2024-09-13T17:53:07.932523+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:42.477927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.921904+0000","last_change":"2024-09-13T17:53:07.921904+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.921904+0000","last_undegraded":"2024-09-13T17:53:07.921904+0000","last_fullsized":"2024-09-13T17:53:07.921904+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:51.440182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.934706+0000","last_change":"2024-09-13T17:53:07.930059+0000","last_active":"2024-09-13T17:53:07.934706+0000","last_peered":"2024-09-13T17:53:07.934706+0000","last_clean":"2024-09-13T17:53:07.934706+0000","last_became_active":"2024-09-13T17:53:07.929603+0000","last_became_peered":"2024-09-13T17:53:07.929603+0000","last_unstale":"2024-09-13T17:53:07.934706+0000","last_undegraded":"2024-09-13T17:53:07.934706+0000","last_fullsized":"2024-09-13T17:53:07.934706+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:18.629709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.917742+0000","last_change":"2024-09-13T17:53:07.917742+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.917742+0000","last_undegraded":"2024-09-13T17:53:07.917742+0000","last_fullsized":"2024-09-13T17:53:07.917742+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:58.339595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.945225+0000","last_change":"2024-09-13T17:53:07.943158+0000","last_active":"2024-09-13T17:53:07.945225+0000","last_peered":"2024-09-13T17:53:07.945225+0000","last_clean":"2024-09-13T17:53:07.945225+0000","last_became_active":"2024-09-13T17:53:07.942861+0000","last_became_peered":"2024-09-13T17:53:07.942861+0000","last_unstale":"2024-09-13T17:53:07.945225+0000","last_undegraded":"2024-09-13T17:53:07.945225+0000","last_fullsized":"2024-09-13T17:53:07.945225+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:38.404670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.922633+0000","last_change":"2024-09-13T17:53:07.922633+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.922633+0000","last_undegraded":"2024-09-13T17:53:07.922633+0000","last_fullsized":"2024-09-13T17:53:07.922633+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:42.232554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.941716+0000","last_change":"2024-09-13T17:53:07.940289+0000","last_active":"2024-09-13T17:53:07.941716+0000","last_peered":"2024-09-13T17:53:07.941716+0000","last_clean":"2024-09-13T17:53:07.941716+0000","last_became_active":"2024-09-13T17:53:07.940047+0000","last_became_peered":"2024-09-13T17:53:07.940047+0000","last_unstale":"2024-09-13T17:53:07.941716+0000","last_undegraded":"2024-09-13T17:53:07.941716+0000","last_fullsized":"2024-09-13T17:53:07.941716+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:29.613081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.914998+0000","last_change":"2024-09-13T17:53:07.914998+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.914998+0000","last_undegraded":"2024-09-13T17:53:07.914998+0000","last_fullsized":"2024-09-13T17:53:07.914998+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:26.764647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.931749+0000","last_change":"2024-09-13T17:53:07.930024+0000","last_active":"2024-09-13T17:53:07.931749+0000","last_peered":"2024-09-13T17:53:07.931749+0000","last_clean":"2024-09-13T17:53:07.931749+0000","last_became_active":"2024-09-13T17:53:07.927170+0000","last_became_peered":"2024-09-13T17:53:07.927170+0000","last_unstale":"2024-09-13T17:53:07.931749+0000","last_undegraded":"2024-09-13T17:53:07.931749+0000","last_fullsized":"2024-09-13T17:53:07.931749+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:15.690853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.916643+0000","last_change":"2024-09-13T17:53:07.916643+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.916643+0000","last_undegraded":"2024-09-13T17:53:07.916643+0000","last_fullsized":"2024-09-13T17:53:07.916643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:24.556344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.935831+0000","last_change":"2024-09-13T17:53:07.933052+0000","last_active":"2024-09-13T17:53:07.935831+0000","last_peered":"2024-09-13T17:53:07.935831+0000","last_clean":"2024-09-13T17:53:07.935831+0000","last_became_active":"2024-09-13T17:53:07.932754+0000","last_became_peered":"2024-09-13T17:53:07.932754+0000","last_unstale":"2024-09-13T17:53:07.935831+0000","last_undegraded":"2024-09-13T17:53:07.935831+0000","last_fullsized":"2024-09-13T17:53:07.935831+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:01.652948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.924440+0000","last_change":"2024-09-13T17:53:07.924440+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.924440+0000","last_undegraded":"2024-09-13T17:53:07.924440+0000","last_fullsized":"2024-09-13T17:53:07.924440+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:00.206010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.935213+0000","last_change":"2024-09-13T17:53:07.933774+0000","last_active":"2024-09-13T17:53:07.935213+0000","last_peered":"2024-09-13T17:53:07.935213+0000","last_clean":"2024-09-13T17:53:07.935213+0000","last_became_active":"2024-09-13T17:53:07.933487+0000","last_became_peered":"2024-09-13T17:53:07.933487+0000","last_unstale":"2024-09-13T17:53:07.935213+0000","last_undegraded":"2024-09-13T17:53:07.935213+0000","last_fullsized":"2024-09-13T17:53:07.935213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:48.805157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.923052+0000","last_change":"2024-09-13T17:53:07.923052+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.923052+0000","last_undegraded":"2024-09-13T17:53:07.923052+0000","last_fullsized":"2024-09-13T17:53:07.923052+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:42.232554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.943462+0000","last_change":"2024-09-13T17:53:07.939168+0000","last_active":"2024-09-13T17:53:07.943462+0000","last_peered":"2024-09-13T17:53:07.943462+0000","last_clean":"2024-09-13T17:53:07.943462+0000","last_became_active":"2024-09-13T17:53:07.938879+0000","last_became_peered":"2024-09-13T17:53:07.938879+0000","last_unstale":"2024-09-13T17:53:07.943462+0000","last_undegraded":"2024-09-13T17:53:07.943462+0000","last_fullsized":"2024-09-13T17:53:07.943462+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:04.587154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.922383+0000","last_change":"2024-09-13T17:53:07.922383+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.922383+0000","last_undegraded":"2024-09-13T17:53:07.922383+0000","last_fullsized":"2024-09-13T17:53:07.922383+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:13.895602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.943376+0000","last_change":"2024-09-13T17:53:07.940964+0000","last_active":"2024-09-13T17:53:07.943376+0000","last_peered":"2024-09-13T17:53:07.943376+0000","last_clean":"2024-09-13T17:53:07.943376+0000","last_became_active":"2024-09-13T17:53:07.940717+0000","last_became_peered":"2024-09-13T17:53:07.940717+0000","last_unstale":"2024-09-13T17:53:07.943376+0000","last_undegraded":"2024-09-13T17:53:07.943376+0000","last_fullsized":"2024-09-13T17:53:07.943376+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:50.212192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.921446+0000","last_change":"2024-09-13T17:53:07.921446+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.921446+0000","last_undegraded":"2024-09-13T17:53:07.921446+0000","last_fullsized":"2024-09-13T17:53:07.921446+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:02.621171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.933384+0000","last_change":"2024-09-13T17:53:07.929999+0000","last_active":"2024-09-13T17:53:07.933384+0000","last_peered":"2024-09-13T17:53:07.933384+0000","last_clean":"2024-09-13T17:53:07.933384+0000","last_became_active":"2024-09-13T17:53:07.929747+0000","last_became_peered":"2024-09-13T17:53:07.929747+0000","last_unstale":"2024-09-13T17:53:07.933384+0000","last_undegraded":"2024-09-13T17:53:07.933384+0000","last_fullsized":"2024-09-13T17:53:07.933384+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:04.165768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.913474+0000","last_change":"2024-09-13T17:53:07.913474+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.913474+0000","last_undegraded":"2024-09-13T17:53:07.913474+0000","last_fullsized":"2024-09-13T17:53:07.913474+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:13.042839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.943645+0000","last_change":"2024-09-13T17:53:07.941959+0000","last_active":"2024-09-13T17:53:07.943645+0000","last_peered":"2024-09-13T17:53:07.943645+0000","last_clean":"2024-09-13T17:53:07.943645+0000","last_became_active":"2024-09-13T17:53:07.941576+0000","last_became_peered":"2024-09-13T17:53:07.941576+0000","last_unstale":"2024-09-13T17:53:07.943645+0000","last_undegraded":"2024-09-13T17:53:07.943645+0000","last_fullsized":"2024-09-13T17:53:07.943645+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:04.911527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.923630+0000","last_change":"2024-09-13T17:53:07.923630+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.923630+0000","last_undegraded":"2024-09-13T17:53:07.923630+0000","last_fullsized":"2024-09-13T17:53:07.923630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:51.219251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.931545+0000","last_change":"2024-09-13T17:53:07.927302+0000","last_active":"2024-09-13T17:53:07.931545+0000","last_peered":"2024-09-13T17:53:07.931545+0000","last_clean":"2024-09-13T17:53:07.931545+0000","last_became_active":"2024-09-13T17:53:07.927010+0000","last_became_peered":"2024-09-13T17:53:07.927010+0000","last_unstale":"2024-09-13T17:53:07.931545+0000","last_undegraded":"2024-09-13T17:53:07.931545+0000","last_fullsized":"2024-09-13T17:53:07.931545+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:58:48.383731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.914556+0000","last_change":"2024-09-13T17:53:07.914556+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.914556+0000","last_undegraded":"2024-09-13T17:53:07.914556+0000","last_fullsized":"2024-09-13T17:53:07.914556+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:22.069383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.944634+0000","last_change":"2024-09-13T17:53:07.941904+0000","last_active":"2024-09-13T17:53:07.944634+0000","last_peered":"2024-09-13T17:53:07.944634+0000","last_clean":"2024-09-13T17:53:07.944634+0000","last_became_active":"2024-09-13T17:53:07.940899+0000","last_became_peered":"2024-09-13T17:53:07.940899+0000","last_unstale":"2024-09-13T17:53:07.944634+0000","last_undegraded":"2024-09-13T17:53:07.944634+0000","last_fullsized":"2024-09-13T17:53:07.944634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:29.355126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.913545+0000","last_change":"2024-09-13T17:53:07.913545+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.913545+0000","last_undegraded":"2024-09-13T17:53:07.913545+0000","last_fullsized":"2024-09-13T17:53:07.913545+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:12.327579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.938893+0000","last_change":"2024-09-13T17:53:07.935326+0000","last_active":"2024-09-13T17:53:07.938893+0000","last_peered":"2024-09-13T17:53:07.938893+0000","last_clean":"2024-09-13T17:53:07.938893+0000","last_became_active":"2024-09-13T17:53:07.934994+0000","last_became_peered":"2024-09-13T17:53:07.934994+0000","last_unstale":"2024-09-13T17:53:07.938893+0000","last_undegraded":"2024-09-13T17:53:07.938893+0000","last_fullsized":"2024-09-13T17:53:07.938893+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:05.331682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.919760+0000","last_change":"2024-09-13T17:53:07.919760+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.919760+0000","last_undegraded":"2024-09-13T17:53:07.919760+0000","last_fullsized":"2024-09-13T17:53:07.919760+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:02.621171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.939039+0000","last_change":"2024-09-13T17:53:07.937200+0000","last_active":"2024-09-13T17:53:07.939039+0000","last_peered":"2024-09-13T17:53:07.939039+0000","last_clean":"2024-09-13T17:53:07.939039+0000","last_became_active":"2024-09-13T17:53:07.936933+0000","last_became_peered":"2024-09-13T17:53:07.936933+0000","last_unstale":"2024-09-13T17:53:07.939039+0000","last_undegraded":"2024-09-13T17:53:07.939039+0000","last_fullsized":"2024-09-13T17:53:07.939039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:41.938481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.919610+0000","last_change":"2024-09-13T17:53:07.919610+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.919610+0000","last_undegraded":"2024-09-13T17:53:07.919610+0000","last_fullsized":"2024-09-13T17:53:07.919610+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:29.844579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.941365+0000","last_change":"2024-09-13T17:53:07.940232+0000","last_active":"2024-09-13T17:53:07.941365+0000","last_peered":"2024-09-13T17:53:07.941365+0000","last_clean":"2024-09-13T17:53:07.941365+0000","last_became_active":"2024-09-13T17:53:07.939995+0000","last_became_peered":"2024-09-13T17:53:07.939995+0000","last_unstale":"2024-09-13T17:53:07.941365+0000","last_undegraded":"2024-09-13T17:53:07.941365+0000","last_fullsized":"2024-09-13T17:53:07.941365+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:30:28.756119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.916956+0000","last_change":"2024-09-13T17:53:07.916956+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.916956+0000","last_undegraded":"2024-09-13T17:53:07.916956+0000","last_fullsized":"2024-09-13T17:53:07.916956+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:27.720519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.938354+0000","last_change":"2024-09-13T17:53:07.935565+0000","last_active":"2024-09-13T17:53:07.938354+0000","last_peered":"2024-09-13T17:53:07.938354+0000","last_clean":"2024-09-13T17:53:07.938354+0000","last_became_active":"2024-09-13T17:53:07.935314+0000","last_became_peered":"2024-09-13T17:53:07.935314+0000","last_unstale":"2024-09-13T17:53:07.938354+0000","last_undegraded":"2024-09-13T17:53:07.938354+0000","last_fullsized":"2024-09-13T17:53:07.938354+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:18.629709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.934206+0000","last_change":"2024-09-13T17:53:07.934206+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.934206+0000","last_undegraded":"2024-09-13T17:53:07.934206+0000","last_fullsized":"2024-09-13T17:53:07.934206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:16.635091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.931778+0000","last_change":"2024-09-13T17:53:07.930426+0000","last_active":"2024-09-13T17:53:07.931778+0000","last_peered":"2024-09-13T17:53:07.931778+0000","last_clean":"2024-09-13T17:53:07.931778+0000","last_became_active":"2024-09-13T17:53:07.929700+0000","last_became_peered":"2024-09-13T17:53:07.929700+0000","last_unstale":"2024-09-13T17:53:07.931778+0000","last_undegraded":"2024-09-13T17:53:07.931778+0000","last_fullsized":"2024-09-13T17:53:07.931778+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:14.633970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.921349+0000","last_change":"2024-09-13T17:53:07.921349+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.921349+0000","last_undegraded":"2024-09-13T17:53:07.921349+0000","last_fullsized":"2024-09-13T17:53:07.921349+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:13.895602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.931395+0000","last_change":"2024-09-13T17:53:07.928071+0000","last_active":"2024-09-13T17:53:07.931395+0000","last_peered":"2024-09-13T17:53:07.931395+0000","last_clean":"2024-09-13T17:53:07.931395+0000","last_became_active":"2024-09-13T17:53:07.927826+0000","last_became_peered":"2024-09-13T17:53:07.927826+0000","last_unstale":"2024-09-13T17:53:07.931395+0000","last_undegraded":"2024-09-13T17:53:07.931395+0000","last_fullsized":"2024-09-13T17:53:07.931395+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:57.190801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.919083+0000","last_change":"2024-09-13T17:53:07.919083+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.919083+0000","last_undegraded":"2024-09-13T17:53:07.919083+0000","last_fullsized":"2024-09-13T17:53:07.919083+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:41.690036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.945642+0000","last_change":"2024-09-13T17:53:07.944383+0000","last_active":"2024-09-13T17:53:07.945642+0000","last_peered":"2024-09-13T17:53:07.945642+0000","last_clean":"2024-09-13T17:53:07.945642+0000","last_became_active":"2024-09-13T17:53:07.944063+0000","last_became_peered":"2024-09-13T17:53:07.944063+0000","last_unstale":"2024-09-13T17:53:07.945642+0000","last_undegraded":"2024-09-13T17:53:07.945642+0000","last_fullsized":"2024-09-13T17:53:07.945642+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:46.511108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.913575+0000","last_change":"2024-09-13T17:53:07.913575+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.913575+0000","last_undegraded":"2024-09-13T17:53:07.913575+0000","last_fullsized":"2024-09-13T17:53:07.913575+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:00.024100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.927652+0000","last_change":"2024-09-13T17:53:07.924570+0000","last_active":"2024-09-13T17:53:07.927652+0000","last_peered":"2024-09-13T17:53:07.927652+0000","last_clean":"2024-09-13T17:53:07.927652+0000","last_became_active":"2024-09-13T17:53:07.924332+0000","last_became_peered":"2024-09-13T17:53:07.924332+0000","last_unstale":"2024-09-13T17:53:07.927652+0000","last_undegraded":"2024-09-13T17:53:07.927652+0000","last_fullsized":"2024-09-13T17:53:07.927652+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:54.256684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.926469+0000","last_change":"2024-09-13T17:53:07.926469+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.926469+0000","last_undegraded":"2024-09-13T17:53:07.926469+0000","last_fullsized":"2024-09-13T17:53:07.926469+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:48.932531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.943010+0000","last_change":"2024-09-13T17:53:07.939026+0000","last_active":"2024-09-13T17:53:07.943010+0000","last_peered":"2024-09-13T17:53:07.943010+0000","last_clean":"2024-09-13T17:53:07.943010+0000","last_became_active":"2024-09-13T17:53:07.938709+0000","last_became_peered":"2024-09-13T17:53:07.938709+0000","last_unstale":"2024-09-13T17:53:07.943010+0000","last_undegraded":"2024-09-13T17:53:07.943010+0000","last_fullsized":"2024-09-13T17:53:07.943010+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:08.554504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.924008+0000","last_change":"2024-09-13T17:53:07.924008+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.924008+0000","last_undegraded":"2024-09-13T17:53:07.924008+0000","last_fullsized":"2024-09-13T17:53:07.924008+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:05.172827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.940487+0000","last_change":"2024-09-13T17:53:07.939210+0000","last_active":"2024-09-13T17:53:07.940487+0000","last_peered":"2024-09-13T17:53:07.940487+0000","last_clean":"2024-09-13T17:53:07.940487+0000","last_became_active":"2024-09-13T17:53:07.938689+0000","last_became_peered":"2024-09-13T17:53:07.938689+0000","last_unstale":"2024-09-13T17:53:07.940487+0000","last_undegraded":"2024-09-13T17:53:07.940487+0000","last_fullsized":"2024-09-13T17:53:07.940487+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:30.156095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.913549+0000","last_change":"2024-09-13T17:53:07.913549+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.913549+0000","last_undegraded":"2024-09-13T17:53:07.913549+0000","last_fullsized":"2024-09-13T17:53:07.913549+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:24.057582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.936014+0000","last_change":"2024-09-13T17:53:07.933119+0000","last_active":"2024-09-13T17:53:07.936014+0000","last_peered":"2024-09-13T17:53:07.936014+0000","last_clean":"2024-09-13T17:53:07.936014+0000","last_became_active":"2024-09-13T17:53:07.932786+0000","last_became_peered":"2024-09-13T17:53:07.932786+0000","last_unstale":"2024-09-13T17:53:07.936014+0000","last_undegraded":"2024-09-13T17:53:07.936014+0000","last_fullsized":"2024-09-13T17:53:07.936014+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:54.581523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.920940+0000","last_change":"2024-09-13T17:53:07.920940+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.920940+0000","last_undegraded":"2024-09-13T17:53:07.920940+0000","last_fullsized":"2024-09-13T17:53:07.920940+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:08.746286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.932047+0000","last_change":"2024-09-13T17:53:07.929110+0000","last_active":"2024-09-13T17:53:07.932047+0000","last_peered":"2024-09-13T17:53:07.932047+0000","last_clean":"2024-09-13T17:53:07.932047+0000","last_became_active":"2024-09-13T17:53:07.928830+0000","last_became_peered":"2024-09-13T17:53:07.928830+0000","last_unstale":"2024-09-13T17:53:07.932047+0000","last_undegraded":"2024-09-13T17:53:07.932047+0000","last_fullsized":"2024-09-13T17:53:07.932047+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:42.477927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.920803+0000","last_change":"2024-09-13T17:53:07.920803+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.920803+0000","last_undegraded":"2024-09-13T17:53:07.920803+0000","last_fullsized":"2024-09-13T17:53:07.920803+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:02.660007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.933680+0000","last_change":"2024-09-13T17:53:07.928968+0000","last_active":"2024-09-13T17:53:07.933680+0000","last_peered":"2024-09-13T17:53:07.933680+0000","last_clean":"2024-09-13T17:53:07.933680+0000","last_became_active":"2024-09-13T17:53:07.928753+0000","last_became_peered":"2024-09-13T17:53:07.928753+0000","last_unstale":"2024-09-13T17:53:07.933680+0000","last_undegraded":"2024-09-13T17:53:07.933680+0000","last_fullsized":"2024-09-13T17:53:07.933680+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:14.788101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.923036+0000","last_change":"2024-09-13T17:53:07.923036+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.923036+0000","last_undegraded":"2024-09-13T17:53:07.923036+0000","last_fullsized":"2024-09-13T17:53:07.923036+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:24.523487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.927850+0000","last_change":"2024-09-13T17:53:07.923741+0000","last_active":"2024-09-13T17:53:07.927850+0000","last_peered":"2024-09-13T17:53:07.927850+0000","last_clean":"2024-09-13T17:53:07.927850+0000","last_became_active":"2024-09-13T17:53:07.922391+0000","last_became_peered":"2024-09-13T17:53:07.922391+0000","last_unstale":"2024-09-13T17:53:07.927850+0000","last_undegraded":"2024-09-13T17:53:07.927850+0000","last_fullsized":"2024-09-13T17:53:07.927850+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:54.581523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.933495+0000","last_change":"2024-09-13T17:53:07.933495+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.933495+0000","last_undegraded":"2024-09-13T17:53:07.933495+0000","last_fullsized":"2024-09-13T17:53:07.933495+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:48.932531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.932247+0000","last_change":"2024-09-13T17:53:07.928173+0000","last_active":"2024-09-13T17:53:07.932247+0000","last_peered":"2024-09-13T17:53:07.932247+0000","last_clean":"2024-09-13T17:53:07.932247+0000","last_became_active":"2024-09-13T17:53:07.927902+0000","last_became_peered":"2024-09-13T17:53:07.927902+0000","last_unstale":"2024-09-13T17:53:07.932247+0000","last_undegraded":"2024-09-13T17:53:07.932247+0000","last_fullsized":"2024-09-13T17:53:07.932247+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:14.147274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.921929+0000","last_change":"2024-09-13T17:53:07.921929+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.921929+0000","last_undegraded":"2024-09-13T17:53:07.921929+0000","last_fullsized":"2024-09-13T17:53:07.921929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:48.932531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.945260+0000","last_change":"2024-09-13T17:53:07.943953+0000","last_active":"2024-09-13T17:53:07.945260+0000","last_peered":"2024-09-13T17:53:07.945260+0000","last_clean":"2024-09-13T17:53:07.945260+0000","last_became_active":"2024-09-13T17:53:07.943699+0000","last_became_peered":"2024-09-13T17:53:07.943699+0000","last_unstale":"2024-09-13T17:53:07.945260+0000","last_undegraded":"2024-09-13T17:53:07.945260+0000","last_fullsized":"2024-09-13T17:53:07.945260+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:44.997390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T17:53:06.912481+0000","last_change":"2024-09-13T17:51:40.205691+0000","last_active":"2024-09-13T17:53:06.912481+0000","last_peered":"2024-09-13T17:53:06.912481+0000","last_clean":"2024-09-13T17:53:06.912481+0000","last_became_active":"2024-09-13T17:51:40.204577+0000","last_became_peered":"2024-09-13T17:51:40.204577+0000","last_unstale":"2024-09-13T17:53:06.912481+0000","last_undegraded":"2024-09-13T17:53:06.912481+0000","last_fullsized":"2024-09-13T17:53:06.912481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_clean_scrub_stamp":"2024-09-13T17:51:38.340495+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:37.899275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":764173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.68400000000000005}]},{"osd":1,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.73999999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.75600000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.81299999999999994}]},{"osd":4,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.52200000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.63500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.63500000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.66500000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.82699999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.76000000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.90300000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.94899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.65700000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.62},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.53900000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.0910000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.63600000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.55500000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.71499999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.74299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.59099999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.624},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.78000000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.72699999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.61699999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.85299999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.65300000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.745},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.91200000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":4.2460000000000004,"5min":4.2460000000000004,"15min":4.2460000000000004},"last":0.434}]},{"osd":1,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.008,"5min":5.008,"15min":5.008},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.38100000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":4.8570000000000002,"5min":4.8570000000000002,"15min":4.8570000000000002},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":4.8399999999999999,"5min":4.8399999999999999,"15min":4.8399999999999999},"last":0.41599999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":4.4450000000000003,"5min":4.4450000000000003,"15min":4.4450000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":4.9000000000000004,"5min":4.9000000000000004,"15min":4.9000000000000004},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.624},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":0.59099999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":4.9710000000000001,"5min":4.9710000000000001,"15min":4.9710000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.755}]},{"osd":7,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":4.4029999999999996,"5min":4.4029999999999996,"15min":4.4029999999999996},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":4.9349999999999996,"5min":4.9349999999999996,"15min":4.9349999999999996},"last":0.69599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":5.5010000000000003,"5min":5.5010000000000003,"15min":5.5010000000000003},"last":0.311},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":4.3689999999999998,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.54500000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":5.3799999999999999,"5min":5.3799999999999999,"15min":5.3799999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":4.2329999999999997,"5min":4.2329999999999997,"15min":4.2329999999999997},"last":0.442}]},{"osd":3,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":5.032,"5min":5.032,"15min":5.032},"last":0.33100000000000002},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":5.4189999999999996,"5min":5.4189999999999996,"15min":5.4189999999999996},"last":0.47699999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":5.4480000000000004,"5min":5.4480000000000004,"15min":5.4480000000000004},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":4.7460000000000004,"5min":4.7460000000000004,"15min":4.7460000000000004},"last":0.84299999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":4.4710000000000001,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":5.4749999999999996,"5min":5.4749999999999996,"15min":5.4749999999999996},"last":0.76200000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":4.7789999999999999,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":4.9859999999999998,"5min":4.9859999999999998,"15min":4.9859999999999998},"last":0.85599999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":4.8200000000000003,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":4.8879999999999999,"5min":4.8879999999999999,"15min":4.8879999999999999},"last":0.89700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.35599999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.40999999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.373}]},{"osd":4,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.73599999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.77200000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.746}]},{"osd":7,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.75700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":764173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.41599999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.44},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.502},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.51700000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.0350000000000001,"5min":3.0350000000000001,"15min":3.0350000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":0.68300000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.9119999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.754},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.75,"5min":2.75,"15min":2.75},"last":0.76700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:53:12.370 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:53:12.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.535+0000 7f27f5000640 1 Processor -- start 2024-09-13T17:53:12.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.535+0000 7f27f5000640 1 -- start start 2024-09-13T17:53:12.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.535+0000 7f27f5000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27f0098a70 0x7f27f00ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:12.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.535+0000 7f27f5000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f00cf870 con 0x7f27f00af4a0 2024-09-13T17:53:12.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.535+0000 7f27f5000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f015d100 con 0x7f27f006bac0 2024-09-13T17:53:12.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.535+0000 7f27f5000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f015cf10 con 0x7f27f0098a70 2024-09-13T17:53:12.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.535+0000 7f27ed400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f27f00af4a0 0x7f27f0098e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52626/0 (socket says 172.21.15.114:52626) 2024-09-13T17:53:12.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.535+0000 7f27ed400640 1 -- 172.21.15.114:0/2017907260 learned_addr learned my addr 172.21.15.114:0/2017907260 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:12.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.535+0000 7f27ede00640 1 --2- 172.21.15.114:0/2017907260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27f0098a70 0x7f27f00ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:12.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.535+0000 7f27eca00640 1 -- 172.21.15.114:0/2017907260 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3886095077 0 0) 0x7f27f00cf870 con 0x7f27f00af4a0 2024-09-13T17:53:12.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.535+0000 7f27eca00640 1 -- 172.21.15.114:0/2017907260 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27d4003530 con 0x7f27f00af4a0 2024-09-13T17:53:12.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.535+0000 7f27eca00640 1 -- 172.21.15.114:0/2017907260 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032844794 0 0) 0x7f27f015d100 con 0x7f27f006bac0 2024-09-13T17:53:12.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.535+0000 7f27eca00640 1 -- 172.21.15.114:0/2017907260 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27f00cf870 con 0x7f27f006bac0 2024-09-13T17:53:12.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.535+0000 7f27ede00640 1 -- 172.21.15.114:0/2017907260 >> v1:172.21.15.134:6789/0 conn(0x7f27f006bac0 legacy=0x7f27f006bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:12.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.535+0000 7f27ede00640 1 -- 172.21.15.114:0/2017907260 >> v1:172.21.15.114:6789/0 conn(0x7f27f00af4a0 legacy=0x7f27f0098e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:12.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.535+0000 7f27eca00640 1 -- 172.21.15.114:0/2017907260 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 504389110 0 0) 0x7f27d4003530 con 0x7f27f00af4a0 2024-09-13T17:53:12.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.535+0000 7f27ede00640 1 -- 172.21.15.114:0/2017907260 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f015d3e0 con 0x7f27f0098a70 2024-09-13T17:53:12.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.539+0000 7f27ede00640 1 --2- 172.21.15.114:0/2017907260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27f0098a70 0x7f27f00ce460 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f27e0009dc0 tx=0x7f27e001c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6e1cf18ca43258b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:12.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.539+0000 7f27eca00640 1 -- 172.21.15.114:0/2017907260 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc001680 con 0x7f27f0098a70 2024-09-13T17:53:12.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.539+0000 7f27eca00640 1 -- 172.21.15.114:0/2017907260 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e00a8460 con 0x7f27f0098a70 2024-09-13T17:53:12.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.539+0000 7f27eca00640 1 -- 172.21.15.114:0/2017907260 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e00a87f0 con 0x7f27f0098a70 2024-09-13T17:53:12.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.539+0000 7f27f5000640 1 -- 172.21.15.114:0/2017907260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27f0098a70 msgr2=0x7f27f00ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:12.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.539+0000 7f27f5000640 1 --2- 172.21.15.114:0/2017907260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27f0098a70 0x7f27f00ce460 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f27e0009dc0 tx=0x7f27e001c8b0 comp rx=0 tx=0).stop 2024-09-13T17:53:12.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.539+0000 7f27f5000640 1 -- 172.21.15.114:0/2017907260 shutdown_connections 2024-09-13T17:53:12.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.539+0000 7f27f5000640 1 --2- 172.21.15.114:0/2017907260 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27f0098a70 0x7f27f00ce460 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:12.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.539+0000 7f27f5000640 1 -- 172.21.15.114:0/2017907260 >> 172.21.15.114:0/2017907260 conn(0x7f27f00b2050 msgr2=0x7f27f00b2430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:12.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.539+0000 7f27f5000640 1 -- 172.21.15.114:0/2017907260 shutdown_connections 2024-09-13T17:53:12.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.539+0000 7f27f5000640 1 -- 172.21.15.114:0/2017907260 wait complete. 2024-09-13T17:53:12.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.543+0000 7f27f5000640 1 Processor -- start 2024-09-13T17:53:12.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.543+0000 7f27f5000640 1 -- start start 2024-09-13T17:53:12.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.543+0000 7f27f5000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27f006bac0 0x7f27f0152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:12.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.543+0000 7f27f5000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27f0098a70 0x7f27f00b5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:12.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.543+0000 7f27f5000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27f00af4a0 0x7f27f01598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:12.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.543+0000 7f27f5000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f015eac0 con 0x7f27f006bac0 2024-09-13T17:53:12.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.543+0000 7f27f5000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f0153260 con 0x7f27f00af4a0 2024-09-13T17:53:12.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.543+0000 7f27f5000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00b5cc0 con 0x7f27f0098a70 2024-09-13T17:53:12.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.543+0000 7f27ede00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27f006bac0 0x7f27f0152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:12.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.543+0000 7f27ede00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27f006bac0 0x7f27f0152d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53960/0 (socket says 172.21.15.114:53960) 2024-09-13T17:53:12.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.543+0000 7f27ede00640 1 -- 172.21.15.114:0/2282258502 learned_addr learned my addr 172.21.15.114:0/2282258502 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:12.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.543+0000 7f27ed400640 1 --2- 172.21.15.114:0/2282258502 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27f0098a70 0x7f27f00b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:12.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.543+0000 7f27ede00640 1 -- 172.21.15.114:0/2282258502 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27f0098a70 msgr2=0x7f27f00b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:12.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.543+0000 7f27ede00640 1 --2- 172.21.15.114:0/2282258502 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27f0098a70 0x7f27f00b5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:12.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.543+0000 7f27ede00640 1 -- 172.21.15.114:0/2282258502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27f00af4a0 msgr2=0x7f27f01598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:12.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.543+0000 7f27ee800640 1 --2- 172.21.15.114:0/2282258502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27f00af4a0 0x7f27f01598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:12.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.543+0000 7f27ede00640 1 --2- 172.21.15.114:0/2282258502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27f00af4a0 0x7f27f01598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:12.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.543+0000 7f27ede00640 1 -- 172.21.15.114:0/2282258502 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e0009a70 con 0x7f27f006bac0 2024-09-13T17:53:12.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.543+0000 7f27ed400640 1 --2- 172.21.15.114:0/2282258502 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27f0098a70 0x7f27f00b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:12.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.543+0000 7f27ee800640 1 --2- 172.21.15.114:0/2282258502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27f00af4a0 0x7f27f01598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:12.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.543+0000 7f27ede00640 1 --2- 172.21.15.114:0/2282258502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27f006bac0 0x7f27f0152d20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f27e001af60 tx=0x7f27e0019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:12.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.543+0000 7f27e6000640 1 -- 172.21.15.114:0/2282258502 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e00b0600 con 0x7f27f006bac0 2024-09-13T17:53:12.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.543+0000 7f27e6000640 1 -- 172.21.15.114:0/2282258502 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e00b6040 con 0x7f27f006bac0 2024-09-13T17:53:12.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.543+0000 7f27e6000640 1 -- 172.21.15.114:0/2282258502 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e00b09a0 con 0x7f27f006bac0 2024-09-13T17:53:12.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.543+0000 7f27f5000640 1 -- 172.21.15.114:0/2282258502 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f015e470 con 0x7f27f006bac0 2024-09-13T17:53:12.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.543+0000 7f27f5000640 1 -- 172.21.15.114:0/2282258502 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f00b5890 con 0x7f27f006bac0 2024-09-13T17:53:12.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.547+0000 7f27f5000640 1 -- 172.21.15.114:0/2282258502 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f015e2d0 con 0x7f27f006bac0 2024-09-13T17:53:12.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.547+0000 7f27e6000640 1 -- 172.21.15.114:0/2282258502 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f27e00b0b00 con 0x7f27f006bac0 2024-09-13T17:53:12.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.547+0000 7f27e6000640 1 --2- 172.21.15.114:0/2282258502 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f27d00666c0 0x7f27d0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:12.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.547+0000 7f27e6000640 1 -- 172.21.15.114:0/2282258502 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f27e011f700 con 0x7f27f006bac0 2024-09-13T17:53:12.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.547+0000 7f27ed400640 1 --2- 172.21.15.114:0/2282258502 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f27d00666c0 0x7f27d0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:12.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.547+0000 7f27ed400640 1 --2- 172.21.15.114:0/2282258502 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f27d00666c0 0x7f27d0068b80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f27dc001350 tx=0x7f27dc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:12.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.551+0000 7f27e6000640 1 -- 172.21.15.114:0/2282258502 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f27f015e2d0 con 0x7f27f006bac0 2024-09-13T17:53:12.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.703+0000 7f27f5000640 1 -- 172.21.15.114:0/2282258502 --> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f27f00ceb20 con 0x7f27d00666c0 2024-09-13T17:53:12.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.707+0000 7f27e6000640 1 -- 172.21.15.114:0/2282258502 <== mgr.4102 v2:172.21.15.114:6832/137691478 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285650 (secure 0 0 0) 0x7f27f00ceb20 con 0x7f27d00666c0 2024-09-13T17:53:12.717 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:12.719 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-13T17:53:12.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.711+0000 7f27f5000640 1 -- 172.21.15.114:0/2282258502 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f27d00666c0 msgr2=0x7f27d0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:12.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.711+0000 7f27f5000640 1 --2- 172.21.15.114:0/2282258502 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f27d00666c0 0x7f27d0068b80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f27dc001350 tx=0x7f27dc009040 comp rx=0 tx=0).stop 2024-09-13T17:53:12.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.711+0000 7f27f5000640 1 -- 172.21.15.114:0/2282258502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27f006bac0 msgr2=0x7f27f0152d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:12.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.711+0000 7f27f5000640 1 --2- 172.21.15.114:0/2282258502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27f006bac0 0x7f27f0152d20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f27e001af60 tx=0x7f27e0019650 comp rx=0 tx=0).stop 2024-09-13T17:53:12.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.711+0000 7f27f5000640 1 -- 172.21.15.114:0/2282258502 shutdown_connections 2024-09-13T17:53:12.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.711+0000 7f27f5000640 1 --2- 172.21.15.114:0/2282258502 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f27d00666c0 0x7f27d0068b80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:12.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.711+0000 7f27f5000640 1 --2- 172.21.15.114:0/2282258502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27f00af4a0 0x7f27f01598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:12.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.711+0000 7f27f5000640 1 --2- 172.21.15.114:0/2282258502 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f27f0098a70 0x7f27f00b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:12.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.711+0000 7f27f5000640 1 --2- 172.21.15.114:0/2282258502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27f006bac0 0x7f27f0152d20 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:12.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.711+0000 7f27f5000640 1 -- 172.21.15.114:0/2282258502 >> 172.21.15.114:0/2282258502 conn(0x7f27f00b2050 msgr2=0x7f27f00cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:12.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.711+0000 7f27f5000640 1 -- 172.21.15.114:0/2282258502 shutdown_connections 2024-09-13T17:53:12.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.711+0000 7f27f5000640 1 -- 172.21.15.114:0/2282258502 wait complete. 2024-09-13T17:53:12.736 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-09-13T17:53:11.952036+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220552,"kb_used_data":4392,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754168,"statfs":{"total":773094113280,"available":772868268032,"internally_reserved":0,"allocated":4497408,"data_stored":2571176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.044607"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.913592+0000","last_change":"2024-09-13T17:53:07.913592+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.913592+0000","last_undegraded":"2024-09-13T17:53:07.913592+0000","last_fullsized":"2024-09-13T17:53:07.913592+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:02.633358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.914181+0000","last_change":"2024-09-13T17:53:07.914181+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.914181+0000","last_undegraded":"2024-09-13T17:53:07.914181+0000","last_fullsized":"2024-09-13T17:53:07.914181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:11.750011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.922409+0000","last_change":"2024-09-13T17:53:07.922409+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.922409+0000","last_undegraded":"2024-09-13T17:53:07.922409+0000","last_fullsized":"2024-09-13T17:53:07.922409+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:29.844579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.918289+0000","last_change":"2024-09-13T17:53:07.918289+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.918289+0000","last_undegraded":"2024-09-13T17:53:07.918289+0000","last_fullsized":"2024-09-13T17:53:07.918289+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:04:50.600660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.917372+0000","last_change":"2024-09-13T17:53:07.917372+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.917372+0000","last_undegraded":"2024-09-13T17:53:07.917372+0000","last_fullsized":"2024-09-13T17:53:07.917372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:15.795161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.920013+0000","last_change":"2024-09-13T17:53:07.920013+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.920013+0000","last_undegraded":"2024-09-13T17:53:07.920013+0000","last_fullsized":"2024-09-13T17:53:07.920013+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:15.154333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.922040+0000","last_change":"2024-09-13T17:53:07.922040+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.922040+0000","last_undegraded":"2024-09-13T17:53:07.922040+0000","last_fullsized":"2024-09-13T17:53:07.922040+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:00.206010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.913515+0000","last_change":"2024-09-13T17:53:07.913515+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.913515+0000","last_undegraded":"2024-09-13T17:53:07.913515+0000","last_fullsized":"2024-09-13T17:53:07.913515+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:39.920002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.921842+0000","last_change":"2024-09-13T17:53:07.921842+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.921842+0000","last_undegraded":"2024-09-13T17:53:07.921842+0000","last_fullsized":"2024-09-13T17:53:07.921842+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:58.339595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.921409+0000","last_change":"2024-09-13T17:53:07.921409+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.921409+0000","last_undegraded":"2024-09-13T17:53:07.921409+0000","last_fullsized":"2024-09-13T17:53:07.921409+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:08.746286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.920282+0000","last_change":"2024-09-13T17:53:07.920282+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.920282+0000","last_undegraded":"2024-09-13T17:53:07.920282+0000","last_fullsized":"2024-09-13T17:53:07.920282+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:02.660007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.922001+0000","last_change":"2024-09-13T17:53:07.922001+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.922001+0000","last_undegraded":"2024-09-13T17:53:07.922001+0000","last_fullsized":"2024-09-13T17:53:07.922001+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:24.523487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.919785+0000","last_change":"2024-09-13T17:53:07.919785+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.919785+0000","last_undegraded":"2024-09-13T17:53:07.919785+0000","last_fullsized":"2024-09-13T17:53:07.919785+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:24.523487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.923536+0000","last_change":"2024-09-13T17:53:07.923536+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.923536+0000","last_undegraded":"2024-09-13T17:53:07.923536+0000","last_fullsized":"2024-09-13T17:53:07.923536+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:51.440182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.919382+0000","last_change":"2024-09-13T17:53:07.919382+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.919382+0000","last_undegraded":"2024-09-13T17:53:07.919382+0000","last_fullsized":"2024-09-13T17:53:07.919382+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:16.635091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.934811+0000","last_change":"2024-09-13T17:53:07.934811+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.934811+0000","last_undegraded":"2024-09-13T17:53:07.934811+0000","last_fullsized":"2024-09-13T17:53:07.934811+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:42.945540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.932902+0000","last_change":"2024-09-13T17:53:07.932902+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.932902+0000","last_undegraded":"2024-09-13T17:53:07.932902+0000","last_fullsized":"2024-09-13T17:53:07.932902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:43.484986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.914267+0000","last_change":"2024-09-13T17:53:07.914267+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.914267+0000","last_undegraded":"2024-09-13T17:53:07.914267+0000","last_fullsized":"2024-09-13T17:53:07.914267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:09.561563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.916812+0000","last_change":"2024-09-13T17:53:07.916812+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.916812+0000","last_undegraded":"2024-09-13T17:53:07.916812+0000","last_fullsized":"2024-09-13T17:53:07.916812+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:46.004449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.915214+0000","last_change":"2024-09-13T17:53:07.915214+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.915214+0000","last_undegraded":"2024-09-13T17:53:07.915214+0000","last_fullsized":"2024-09-13T17:53:07.915214+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:30.620140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.919237+0000","last_change":"2024-09-13T17:53:07.919237+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.919237+0000","last_undegraded":"2024-09-13T17:53:07.919237+0000","last_fullsized":"2024-09-13T17:53:07.919237+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:51.440182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.918246+0000","last_change":"2024-09-13T17:53:07.918246+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.918246+0000","last_undegraded":"2024-09-13T17:53:07.918246+0000","last_fullsized":"2024-09-13T17:53:07.918246+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:02.621171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.932894+0000","last_change":"2024-09-13T17:53:07.932894+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.932894+0000","last_undegraded":"2024-09-13T17:53:07.932894+0000","last_fullsized":"2024-09-13T17:53:07.932894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:02.660007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.917294+0000","last_change":"2024-09-13T17:53:07.917294+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.917294+0000","last_undegraded":"2024-09-13T17:53:07.917294+0000","last_fullsized":"2024-09-13T17:53:07.917294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:39.411729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.915293+0000","last_change":"2024-09-13T17:53:07.915293+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.915293+0000","last_undegraded":"2024-09-13T17:53:07.915293+0000","last_fullsized":"2024-09-13T17:53:07.915293+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:19.636768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.924894+0000","last_change":"2024-09-13T17:53:07.924894+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.924894+0000","last_undegraded":"2024-09-13T17:53:07.924894+0000","last_fullsized":"2024-09-13T17:53:07.924894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:05.172827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.914373+0000","last_change":"2024-09-13T17:53:07.914373+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.914373+0000","last_undegraded":"2024-09-13T17:53:07.914373+0000","last_fullsized":"2024-09-13T17:53:07.914373+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:05.594213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.918522+0000","last_change":"2024-09-13T17:53:07.918522+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.918522+0000","last_undegraded":"2024-09-13T17:53:07.918522+0000","last_fullsized":"2024-09-13T17:53:07.918522+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:55.588582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.914463+0000","last_change":"2024-09-13T17:53:07.914463+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.914463+0000","last_undegraded":"2024-09-13T17:53:07.914463+0000","last_fullsized":"2024-09-13T17:53:07.914463+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:07.544794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.915528+0000","last_change":"2024-09-13T17:53:07.915528+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.915528+0000","last_undegraded":"2024-09-13T17:53:07.915528+0000","last_fullsized":"2024-09-13T17:53:07.915528+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:06.338741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.925481+0000","last_change":"2024-09-13T17:53:07.925481+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.925481+0000","last_undegraded":"2024-09-13T17:53:07.925481+0000","last_fullsized":"2024-09-13T17:53:07.925481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:15.154333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.924668+0000","last_change":"2024-09-13T17:53:07.924668+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.924668+0000","last_undegraded":"2024-09-13T17:53:07.924668+0000","last_fullsized":"2024-09-13T17:53:07.924668+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:42.945540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.924863+0000","last_change":"2024-09-13T17:53:07.924863+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.924863+0000","last_undegraded":"2024-09-13T17:53:07.924863+0000","last_fullsized":"2024-09-13T17:53:07.924863+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:05.297506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.931791+0000","last_change":"2024-09-13T17:53:07.927772+0000","last_active":"2024-09-13T17:53:07.931791+0000","last_peered":"2024-09-13T17:53:07.931791+0000","last_clean":"2024-09-13T17:53:07.931791+0000","last_became_active":"2024-09-13T17:53:07.926833+0000","last_became_peered":"2024-09-13T17:53:07.926833+0000","last_unstale":"2024-09-13T17:53:07.931791+0000","last_undegraded":"2024-09-13T17:53:07.931791+0000","last_fullsized":"2024-09-13T17:53:07.931791+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:26.713460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.925979+0000","last_change":"2024-09-13T17:53:07.925979+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.925979+0000","last_undegraded":"2024-09-13T17:53:07.925979+0000","last_fullsized":"2024-09-13T17:53:07.925979+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:00.206010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.943737+0000","last_change":"2024-09-13T17:53:07.942858+0000","last_active":"2024-09-13T17:53:07.943737+0000","last_peered":"2024-09-13T17:53:07.943737+0000","last_clean":"2024-09-13T17:53:07.943737+0000","last_became_active":"2024-09-13T17:53:07.942331+0000","last_became_peered":"2024-09-13T17:53:07.942331+0000","last_unstale":"2024-09-13T17:53:07.943737+0000","last_undegraded":"2024-09-13T17:53:07.943737+0000","last_fullsized":"2024-09-13T17:53:07.943737+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:52.434464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.919076+0000","last_change":"2024-09-13T17:53:07.919076+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.919076+0000","last_undegraded":"2024-09-13T17:53:07.919076+0000","last_fullsized":"2024-09-13T17:53:07.919076+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:58.339595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.945322+0000","last_change":"2024-09-13T17:53:07.942677+0000","last_active":"2024-09-13T17:53:07.945322+0000","last_peered":"2024-09-13T17:53:07.945322+0000","last_clean":"2024-09-13T17:53:07.945322+0000","last_became_active":"2024-09-13T17:53:07.942426+0000","last_became_peered":"2024-09-13T17:53:07.942426+0000","last_unstale":"2024-09-13T17:53:07.945322+0000","last_undegraded":"2024-09-13T17:53:07.945322+0000","last_fullsized":"2024-09-13T17:53:07.945322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:08.554504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.914136+0000","last_change":"2024-09-13T17:53:07.914136+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.914136+0000","last_undegraded":"2024-09-13T17:53:07.914136+0000","last_fullsized":"2024-09-13T17:53:07.914136+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:13.404809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.932523+0000","last_change":"2024-09-13T17:53:07.931288+0000","last_active":"2024-09-13T17:53:07.932523+0000","last_peered":"2024-09-13T17:53:07.932523+0000","last_clean":"2024-09-13T17:53:07.932523+0000","last_became_active":"2024-09-13T17:53:07.929489+0000","last_became_peered":"2024-09-13T17:53:07.929489+0000","last_unstale":"2024-09-13T17:53:07.932523+0000","last_undegraded":"2024-09-13T17:53:07.932523+0000","last_fullsized":"2024-09-13T17:53:07.932523+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:42.477927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.921904+0000","last_change":"2024-09-13T17:53:07.921904+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.921904+0000","last_undegraded":"2024-09-13T17:53:07.921904+0000","last_fullsized":"2024-09-13T17:53:07.921904+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:51.440182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.934706+0000","last_change":"2024-09-13T17:53:07.930059+0000","last_active":"2024-09-13T17:53:07.934706+0000","last_peered":"2024-09-13T17:53:07.934706+0000","last_clean":"2024-09-13T17:53:07.934706+0000","last_became_active":"2024-09-13T17:53:07.929603+0000","last_became_peered":"2024-09-13T17:53:07.929603+0000","last_unstale":"2024-09-13T17:53:07.934706+0000","last_undegraded":"2024-09-13T17:53:07.934706+0000","last_fullsized":"2024-09-13T17:53:07.934706+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:18.629709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.917742+0000","last_change":"2024-09-13T17:53:07.917742+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.917742+0000","last_undegraded":"2024-09-13T17:53:07.917742+0000","last_fullsized":"2024-09-13T17:53:07.917742+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:58.339595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.945225+0000","last_change":"2024-09-13T17:53:07.943158+0000","last_active":"2024-09-13T17:53:07.945225+0000","last_peered":"2024-09-13T17:53:07.945225+0000","last_clean":"2024-09-13T17:53:07.945225+0000","last_became_active":"2024-09-13T17:53:07.942861+0000","last_became_peered":"2024-09-13T17:53:07.942861+0000","last_unstale":"2024-09-13T17:53:07.945225+0000","last_undegraded":"2024-09-13T17:53:07.945225+0000","last_fullsized":"2024-09-13T17:53:07.945225+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:38.404670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.922633+0000","last_change":"2024-09-13T17:53:07.922633+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.922633+0000","last_undegraded":"2024-09-13T17:53:07.922633+0000","last_fullsized":"2024-09-13T17:53:07.922633+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:42.232554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.941716+0000","last_change":"2024-09-13T17:53:07.940289+0000","last_active":"2024-09-13T17:53:07.941716+0000","last_peered":"2024-09-13T17:53:07.941716+0000","last_clean":"2024-09-13T17:53:07.941716+0000","last_became_active":"2024-09-13T17:53:07.940047+0000","last_became_peered":"2024-09-13T17:53:07.940047+0000","last_unstale":"2024-09-13T17:53:07.941716+0000","last_undegraded":"2024-09-13T17:53:07.941716+0000","last_fullsized":"2024-09-13T17:53:07.941716+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:29.613081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.914998+0000","last_change":"2024-09-13T17:53:07.914998+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.914998+0000","last_undegraded":"2024-09-13T17:53:07.914998+0000","last_fullsized":"2024-09-13T17:53:07.914998+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:26.764647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.931749+0000","last_change":"2024-09-13T17:53:07.930024+0000","last_active":"2024-09-13T17:53:07.931749+0000","last_peered":"2024-09-13T17:53:07.931749+0000","last_clean":"2024-09-13T17:53:07.931749+0000","last_became_active":"2024-09-13T17:53:07.927170+0000","last_became_peered":"2024-09-13T17:53:07.927170+0000","last_unstale":"2024-09-13T17:53:07.931749+0000","last_undegraded":"2024-09-13T17:53:07.931749+0000","last_fullsized":"2024-09-13T17:53:07.931749+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:15.690853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.916643+0000","last_change":"2024-09-13T17:53:07.916643+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.916643+0000","last_undegraded":"2024-09-13T17:53:07.916643+0000","last_fullsized":"2024-09-13T17:53:07.916643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:24.556344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.935831+0000","last_change":"2024-09-13T17:53:07.933052+0000","last_active":"2024-09-13T17:53:07.935831+0000","last_peered":"2024-09-13T17:53:07.935831+0000","last_clean":"2024-09-13T17:53:07.935831+0000","last_became_active":"2024-09-13T17:53:07.932754+0000","last_became_peered":"2024-09-13T17:53:07.932754+0000","last_unstale":"2024-09-13T17:53:07.935831+0000","last_undegraded":"2024-09-13T17:53:07.935831+0000","last_fullsized":"2024-09-13T17:53:07.935831+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:01.652948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.924440+0000","last_change":"2024-09-13T17:53:07.924440+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.924440+0000","last_undegraded":"2024-09-13T17:53:07.924440+0000","last_fullsized":"2024-09-13T17:53:07.924440+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:00.206010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.935213+0000","last_change":"2024-09-13T17:53:07.933774+0000","last_active":"2024-09-13T17:53:07.935213+0000","last_peered":"2024-09-13T17:53:07.935213+0000","last_clean":"2024-09-13T17:53:07.935213+0000","last_became_active":"2024-09-13T17:53:07.933487+0000","last_became_peered":"2024-09-13T17:53:07.933487+0000","last_unstale":"2024-09-13T17:53:07.935213+0000","last_undegraded":"2024-09-13T17:53:07.935213+0000","last_fullsized":"2024-09-13T17:53:07.935213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:48.805157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.923052+0000","last_change":"2024-09-13T17:53:07.923052+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.923052+0000","last_undegraded":"2024-09-13T17:53:07.923052+0000","last_fullsized":"2024-09-13T17:53:07.923052+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:42.232554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.943462+0000","last_change":"2024-09-13T17:53:07.939168+0000","last_active":"2024-09-13T17:53:07.943462+0000","last_peered":"2024-09-13T17:53:07.943462+0000","last_clean":"2024-09-13T17:53:07.943462+0000","last_became_active":"2024-09-13T17:53:07.938879+0000","last_became_peered":"2024-09-13T17:53:07.938879+0000","last_unstale":"2024-09-13T17:53:07.943462+0000","last_undegraded":"2024-09-13T17:53:07.943462+0000","last_fullsized":"2024-09-13T17:53:07.943462+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:04.587154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.922383+0000","last_change":"2024-09-13T17:53:07.922383+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.922383+0000","last_undegraded":"2024-09-13T17:53:07.922383+0000","last_fullsized":"2024-09-13T17:53:07.922383+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:13.895602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.943376+0000","last_change":"2024-09-13T17:53:07.940964+0000","last_active":"2024-09-13T17:53:07.943376+0000","last_peered":"2024-09-13T17:53:07.943376+0000","last_clean":"2024-09-13T17:53:07.943376+0000","last_became_active":"2024-09-13T17:53:07.940717+0000","last_became_peered":"2024-09-13T17:53:07.940717+0000","last_unstale":"2024-09-13T17:53:07.943376+0000","last_undegraded":"2024-09-13T17:53:07.943376+0000","last_fullsized":"2024-09-13T17:53:07.943376+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:50.212192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.921446+0000","last_change":"2024-09-13T17:53:07.921446+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.921446+0000","last_undegraded":"2024-09-13T17:53:07.921446+0000","last_fullsized":"2024-09-13T17:53:07.921446+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:02.621171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.933384+0000","last_change":"2024-09-13T17:53:07.929999+0000","last_active":"2024-09-13T17:53:07.933384+0000","last_peered":"2024-09-13T17:53:07.933384+0000","last_clean":"2024-09-13T17:53:07.933384+0000","last_became_active":"2024-09-13T17:53:07.929747+0000","last_became_peered":"2024-09-13T17:53:07.929747+0000","last_unstale":"2024-09-13T17:53:07.933384+0000","last_undegraded":"2024-09-13T17:53:07.933384+0000","last_fullsized":"2024-09-13T17:53:07.933384+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:04.165768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.913474+0000","last_change":"2024-09-13T17:53:07.913474+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.913474+0000","last_undegraded":"2024-09-13T17:53:07.913474+0000","last_fullsized":"2024-09-13T17:53:07.913474+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:13.042839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.943645+0000","last_change":"2024-09-13T17:53:07.941959+0000","last_active":"2024-09-13T17:53:07.943645+0000","last_peered":"2024-09-13T17:53:07.943645+0000","last_clean":"2024-09-13T17:53:07.943645+0000","last_became_active":"2024-09-13T17:53:07.941576+0000","last_became_peered":"2024-09-13T17:53:07.941576+0000","last_unstale":"2024-09-13T17:53:07.943645+0000","last_undegraded":"2024-09-13T17:53:07.943645+0000","last_fullsized":"2024-09-13T17:53:07.943645+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:04.911527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.923630+0000","last_change":"2024-09-13T17:53:07.923630+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.923630+0000","last_undegraded":"2024-09-13T17:53:07.923630+0000","last_fullsized":"2024-09-13T17:53:07.923630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:51.219251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.931545+0000","last_change":"2024-09-13T17:53:07.927302+0000","last_active":"2024-09-13T17:53:07.931545+0000","last_peered":"2024-09-13T17:53:07.931545+0000","last_clean":"2024-09-13T17:53:07.931545+0000","last_became_active":"2024-09-13T17:53:07.927010+0000","last_became_peered":"2024-09-13T17:53:07.927010+0000","last_unstale":"2024-09-13T17:53:07.931545+0000","last_undegraded":"2024-09-13T17:53:07.931545+0000","last_fullsized":"2024-09-13T17:53:07.931545+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:58:48.383731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.914556+0000","last_change":"2024-09-13T17:53:07.914556+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.914556+0000","last_undegraded":"2024-09-13T17:53:07.914556+0000","last_fullsized":"2024-09-13T17:53:07.914556+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:22.069383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.944634+0000","last_change":"2024-09-13T17:53:07.941904+0000","last_active":"2024-09-13T17:53:07.944634+0000","last_peered":"2024-09-13T17:53:07.944634+0000","last_clean":"2024-09-13T17:53:07.944634+0000","last_became_active":"2024-09-13T17:53:07.940899+0000","last_became_peered":"2024-09-13T17:53:07.940899+0000","last_unstale":"2024-09-13T17:53:07.944634+0000","last_undegraded":"2024-09-13T17:53:07.944634+0000","last_fullsized":"2024-09-13T17:53:07.944634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:29.355126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.913545+0000","last_change":"2024-09-13T17:53:07.913545+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.913545+0000","last_undegraded":"2024-09-13T17:53:07.913545+0000","last_fullsized":"2024-09-13T17:53:07.913545+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:12.327579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.938893+0000","last_change":"2024-09-13T17:53:07.935326+0000","last_active":"2024-09-13T17:53:07.938893+0000","last_peered":"2024-09-13T17:53:07.938893+0000","last_clean":"2024-09-13T17:53:07.938893+0000","last_became_active":"2024-09-13T17:53:07.934994+0000","last_became_peered":"2024-09-13T17:53:07.934994+0000","last_unstale":"2024-09-13T17:53:07.938893+0000","last_undegraded":"2024-09-13T17:53:07.938893+0000","last_fullsized":"2024-09-13T17:53:07.938893+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:05.331682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.919760+0000","last_change":"2024-09-13T17:53:07.919760+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.919760+0000","last_undegraded":"2024-09-13T17:53:07.919760+0000","last_fullsized":"2024-09-13T17:53:07.919760+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:02.621171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.939039+0000","last_change":"2024-09-13T17:53:07.937200+0000","last_active":"2024-09-13T17:53:07.939039+0000","last_peered":"2024-09-13T17:53:07.939039+0000","last_clean":"2024-09-13T17:53:07.939039+0000","last_became_active":"2024-09-13T17:53:07.936933+0000","last_became_peered":"2024-09-13T17:53:07.936933+0000","last_unstale":"2024-09-13T17:53:07.939039+0000","last_undegraded":"2024-09-13T17:53:07.939039+0000","last_fullsized":"2024-09-13T17:53:07.939039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:41.938481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.919610+0000","last_change":"2024-09-13T17:53:07.919610+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.919610+0000","last_undegraded":"2024-09-13T17:53:07.919610+0000","last_fullsized":"2024-09-13T17:53:07.919610+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:29.844579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.941365+0000","last_change":"2024-09-13T17:53:07.940232+0000","last_active":"2024-09-13T17:53:07.941365+0000","last_peered":"2024-09-13T17:53:07.941365+0000","last_clean":"2024-09-13T17:53:07.941365+0000","last_became_active":"2024-09-13T17:53:07.939995+0000","last_became_peered":"2024-09-13T17:53:07.939995+0000","last_unstale":"2024-09-13T17:53:07.941365+0000","last_undegraded":"2024-09-13T17:53:07.941365+0000","last_fullsized":"2024-09-13T17:53:07.941365+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:30:28.756119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.916956+0000","last_change":"2024-09-13T17:53:07.916956+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.916956+0000","last_undegraded":"2024-09-13T17:53:07.916956+0000","last_fullsized":"2024-09-13T17:53:07.916956+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:27.720519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.938354+0000","last_change":"2024-09-13T17:53:07.935565+0000","last_active":"2024-09-13T17:53:07.938354+0000","last_peered":"2024-09-13T17:53:07.938354+0000","last_clean":"2024-09-13T17:53:07.938354+0000","last_became_active":"2024-09-13T17:53:07.935314+0000","last_became_peered":"2024-09-13T17:53:07.935314+0000","last_unstale":"2024-09-13T17:53:07.938354+0000","last_undegraded":"2024-09-13T17:53:07.938354+0000","last_fullsized":"2024-09-13T17:53:07.938354+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:18.629709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.934206+0000","last_change":"2024-09-13T17:53:07.934206+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.934206+0000","last_undegraded":"2024-09-13T17:53:07.934206+0000","last_fullsized":"2024-09-13T17:53:07.934206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:16.635091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.931778+0000","last_change":"2024-09-13T17:53:07.930426+0000","last_active":"2024-09-13T17:53:07.931778+0000","last_peered":"2024-09-13T17:53:07.931778+0000","last_clean":"2024-09-13T17:53:07.931778+0000","last_became_active":"2024-09-13T17:53:07.929700+0000","last_became_peered":"2024-09-13T17:53:07.929700+0000","last_unstale":"2024-09-13T17:53:07.931778+0000","last_undegraded":"2024-09-13T17:53:07.931778+0000","last_fullsized":"2024-09-13T17:53:07.931778+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:14.633970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.921349+0000","last_change":"2024-09-13T17:53:07.921349+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.921349+0000","last_undegraded":"2024-09-13T17:53:07.921349+0000","last_fullsized":"2024-09-13T17:53:07.921349+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:13.895602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.931395+0000","last_change":"2024-09-13T17:53:07.928071+0000","last_active":"2024-09-13T17:53:07.931395+0000","last_peered":"2024-09-13T17:53:07.931395+0000","last_clean":"2024-09-13T17:53:07.931395+0000","last_became_active":"2024-09-13T17:53:07.927826+0000","last_became_peered":"2024-09-13T17:53:07.927826+0000","last_unstale":"2024-09-13T17:53:07.931395+0000","last_undegraded":"2024-09-13T17:53:07.931395+0000","last_fullsized":"2024-09-13T17:53:07.931395+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:57.190801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.919083+0000","last_change":"2024-09-13T17:53:07.919083+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.919083+0000","last_undegraded":"2024-09-13T17:53:07.919083+0000","last_fullsized":"2024-09-13T17:53:07.919083+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:41.690036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.945642+0000","last_change":"2024-09-13T17:53:07.944383+0000","last_active":"2024-09-13T17:53:07.945642+0000","last_peered":"2024-09-13T17:53:07.945642+0000","last_clean":"2024-09-13T17:53:07.945642+0000","last_became_active":"2024-09-13T17:53:07.944063+0000","last_became_peered":"2024-09-13T17:53:07.944063+0000","last_unstale":"2024-09-13T17:53:07.945642+0000","last_undegraded":"2024-09-13T17:53:07.945642+0000","last_fullsized":"2024-09-13T17:53:07.945642+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:46.511108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.913575+0000","last_change":"2024-09-13T17:53:07.913575+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.913575+0000","last_undegraded":"2024-09-13T17:53:07.913575+0000","last_fullsized":"2024-09-13T17:53:07.913575+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:00.024100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.927652+0000","last_change":"2024-09-13T17:53:07.924570+0000","last_active":"2024-09-13T17:53:07.927652+0000","last_peered":"2024-09-13T17:53:07.927652+0000","last_clean":"2024-09-13T17:53:07.927652+0000","last_became_active":"2024-09-13T17:53:07.924332+0000","last_became_peered":"2024-09-13T17:53:07.924332+0000","last_unstale":"2024-09-13T17:53:07.927652+0000","last_undegraded":"2024-09-13T17:53:07.927652+0000","last_fullsized":"2024-09-13T17:53:07.927652+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:54.256684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.926469+0000","last_change":"2024-09-13T17:53:07.926469+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.926469+0000","last_undegraded":"2024-09-13T17:53:07.926469+0000","last_fullsized":"2024-09-13T17:53:07.926469+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:48.932531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.943010+0000","last_change":"2024-09-13T17:53:07.939026+0000","last_active":"2024-09-13T17:53:07.943010+0000","last_peered":"2024-09-13T17:53:07.943010+0000","last_clean":"2024-09-13T17:53:07.943010+0000","last_became_active":"2024-09-13T17:53:07.938709+0000","last_became_peered":"2024-09-13T17:53:07.938709+0000","last_unstale":"2024-09-13T17:53:07.943010+0000","last_undegraded":"2024-09-13T17:53:07.943010+0000","last_fullsized":"2024-09-13T17:53:07.943010+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:08.554504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.924008+0000","last_change":"2024-09-13T17:53:07.924008+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.924008+0000","last_undegraded":"2024-09-13T17:53:07.924008+0000","last_fullsized":"2024-09-13T17:53:07.924008+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:05.172827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.940487+0000","last_change":"2024-09-13T17:53:07.939210+0000","last_active":"2024-09-13T17:53:07.940487+0000","last_peered":"2024-09-13T17:53:07.940487+0000","last_clean":"2024-09-13T17:53:07.940487+0000","last_became_active":"2024-09-13T17:53:07.938689+0000","last_became_peered":"2024-09-13T17:53:07.938689+0000","last_unstale":"2024-09-13T17:53:07.940487+0000","last_undegraded":"2024-09-13T17:53:07.940487+0000","last_fullsized":"2024-09-13T17:53:07.940487+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:30.156095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.913549+0000","last_change":"2024-09-13T17:53:07.913549+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.913549+0000","last_undegraded":"2024-09-13T17:53:07.913549+0000","last_fullsized":"2024-09-13T17:53:07.913549+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:24.057582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.936014+0000","last_change":"2024-09-13T17:53:07.933119+0000","last_active":"2024-09-13T17:53:07.936014+0000","last_peered":"2024-09-13T17:53:07.936014+0000","last_clean":"2024-09-13T17:53:07.936014+0000","last_became_active":"2024-09-13T17:53:07.932786+0000","last_became_peered":"2024-09-13T17:53:07.932786+0000","last_unstale":"2024-09-13T17:53:07.936014+0000","last_undegraded":"2024-09-13T17:53:07.936014+0000","last_fullsized":"2024-09-13T17:53:07.936014+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:54.581523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.920940+0000","last_change":"2024-09-13T17:53:07.920940+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.920940+0000","last_undegraded":"2024-09-13T17:53:07.920940+0000","last_fullsized":"2024-09-13T17:53:07.920940+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:08.746286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.932047+0000","last_change":"2024-09-13T17:53:07.929110+0000","last_active":"2024-09-13T17:53:07.932047+0000","last_peered":"2024-09-13T17:53:07.932047+0000","last_clean":"2024-09-13T17:53:07.932047+0000","last_became_active":"2024-09-13T17:53:07.928830+0000","last_became_peered":"2024-09-13T17:53:07.928830+0000","last_unstale":"2024-09-13T17:53:07.932047+0000","last_undegraded":"2024-09-13T17:53:07.932047+0000","last_fullsized":"2024-09-13T17:53:07.932047+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:42.477927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.920803+0000","last_change":"2024-09-13T17:53:07.920803+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.920803+0000","last_undegraded":"2024-09-13T17:53:07.920803+0000","last_fullsized":"2024-09-13T17:53:07.920803+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:02.660007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.933680+0000","last_change":"2024-09-13T17:53:07.928968+0000","last_active":"2024-09-13T17:53:07.933680+0000","last_peered":"2024-09-13T17:53:07.933680+0000","last_clean":"2024-09-13T17:53:07.933680+0000","last_became_active":"2024-09-13T17:53:07.928753+0000","last_became_peered":"2024-09-13T17:53:07.928753+0000","last_unstale":"2024-09-13T17:53:07.933680+0000","last_undegraded":"2024-09-13T17:53:07.933680+0000","last_fullsized":"2024-09-13T17:53:07.933680+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:14.788101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.923036+0000","last_change":"2024-09-13T17:53:07.923036+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.923036+0000","last_undegraded":"2024-09-13T17:53:07.923036+0000","last_fullsized":"2024-09-13T17:53:07.923036+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:24.523487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.927850+0000","last_change":"2024-09-13T17:53:07.923741+0000","last_active":"2024-09-13T17:53:07.927850+0000","last_peered":"2024-09-13T17:53:07.927850+0000","last_clean":"2024-09-13T17:53:07.927850+0000","last_became_active":"2024-09-13T17:53:07.922391+0000","last_became_peered":"2024-09-13T17:53:07.922391+0000","last_unstale":"2024-09-13T17:53:07.927850+0000","last_undegraded":"2024-09-13T17:53:07.927850+0000","last_fullsized":"2024-09-13T17:53:07.927850+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:54.581523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.933495+0000","last_change":"2024-09-13T17:53:07.933495+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.933495+0000","last_undegraded":"2024-09-13T17:53:07.933495+0000","last_fullsized":"2024-09-13T17:53:07.933495+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:48.932531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.932247+0000","last_change":"2024-09-13T17:53:07.928173+0000","last_active":"2024-09-13T17:53:07.932247+0000","last_peered":"2024-09-13T17:53:07.932247+0000","last_clean":"2024-09-13T17:53:07.932247+0000","last_became_active":"2024-09-13T17:53:07.927902+0000","last_became_peered":"2024-09-13T17:53:07.927902+0000","last_unstale":"2024-09-13T17:53:07.932247+0000","last_undegraded":"2024-09-13T17:53:07.932247+0000","last_fullsized":"2024-09-13T17:53:07.932247+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:14.147274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.921929+0000","last_change":"2024-09-13T17:53:07.921929+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.921929+0000","last_undegraded":"2024-09-13T17:53:07.921929+0000","last_fullsized":"2024-09-13T17:53:07.921929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:48.932531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.945260+0000","last_change":"2024-09-13T17:53:07.943953+0000","last_active":"2024-09-13T17:53:07.945260+0000","last_peered":"2024-09-13T17:53:07.945260+0000","last_clean":"2024-09-13T17:53:07.945260+0000","last_became_active":"2024-09-13T17:53:07.943699+0000","last_became_peered":"2024-09-13T17:53:07.943699+0000","last_unstale":"2024-09-13T17:53:07.945260+0000","last_undegraded":"2024-09-13T17:53:07.945260+0000","last_fullsized":"2024-09-13T17:53:07.945260+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:44.997390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T17:53:06.912481+0000","last_change":"2024-09-13T17:51:40.205691+0000","last_active":"2024-09-13T17:53:06.912481+0000","last_peered":"2024-09-13T17:53:06.912481+0000","last_clean":"2024-09-13T17:53:06.912481+0000","last_became_active":"2024-09-13T17:51:40.204577+0000","last_became_peered":"2024-09-13T17:51:40.204577+0000","last_unstale":"2024-09-13T17:53:06.912481+0000","last_undegraded":"2024-09-13T17:53:06.912481+0000","last_fullsized":"2024-09-13T17:53:06.912481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_clean_scrub_stamp":"2024-09-13T17:51:38.340495+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:37.899275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":764173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.68400000000000005}]},{"osd":1,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.73999999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.75600000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.81299999999999994}]},{"osd":4,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.52200000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.63500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.63500000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.66500000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.82699999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.76000000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.90300000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.94899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.65700000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.62},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.53900000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.0910000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.63600000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.55500000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.71499999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.74299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.59099999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.624},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.78000000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.72699999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.61699999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.85299999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.65300000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.745},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.91200000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":4.2460000000000004,"5min":4.2460000000000004,"15min":4.2460000000000004},"last":0.434}]},{"osd":1,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.008,"5min":5.008,"15min":5.008},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.38100000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":4.8570000000000002,"5min":4.8570000000000002,"15min":4.8570000000000002},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":4.8399999999999999,"5min":4.8399999999999999,"15min":4.8399999999999999},"last":0.41599999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":4.4450000000000003,"5min":4.4450000000000003,"15min":4.4450000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":4.9000000000000004,"5min":4.9000000000000004,"15min":4.9000000000000004},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.624},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":0.59099999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":4.9710000000000001,"5min":4.9710000000000001,"15min":4.9710000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.755}]},{"osd":7,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":4.4029999999999996,"5min":4.4029999999999996,"15min":4.4029999999999996},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":4.9349999999999996,"5min":4.9349999999999996,"15min":4.9349999999999996},"last":0.69599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":5.5010000000000003,"5min":5.5010000000000003,"15min":5.5010000000000003},"last":0.311},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":4.3689999999999998,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.54500000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":5.3799999999999999,"5min":5.3799999999999999,"15min":5.3799999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":4.2329999999999997,"5min":4.2329999999999997,"15min":4.2329999999999997},"last":0.442}]},{"osd":3,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":5.032,"5min":5.032,"15min":5.032},"last":0.33100000000000002},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":5.4189999999999996,"5min":5.4189999999999996,"15min":5.4189999999999996},"last":0.47699999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":5.4480000000000004,"5min":5.4480000000000004,"15min":5.4480000000000004},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":4.7460000000000004,"5min":4.7460000000000004,"15min":4.7460000000000004},"last":0.84299999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":4.4710000000000001,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":5.4749999999999996,"5min":5.4749999999999996,"15min":5.4749999999999996},"last":0.76200000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":4.7789999999999999,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":4.9859999999999998,"5min":4.9859999999999998,"15min":4.9859999999999998},"last":0.85599999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":4.8200000000000003,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":4.8879999999999999,"5min":4.8879999999999999,"15min":4.8879999999999999},"last":0.89700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.35599999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.40999999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.373}]},{"osd":4,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.73599999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.77200000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.746}]},{"osd":7,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.75700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":764173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.41599999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.44},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.502},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.51700000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.0350000000000001,"5min":3.0350000000000001,"15min":3.0350000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":0.68300000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.9119999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.754},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.75,"5min":2.75,"15min":2.75},"last":0.76700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:53:12.741 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:53:12.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.911+0000 7f131b000640 1 Processor -- start 2024-09-13T17:53:12.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.911+0000 7f131b000640 1 -- start start 2024-09-13T17:53:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.911+0000 7f131b000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f131413c240 0x7f131413f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.911+0000 7f131b000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f131406dc60 0x7f13140cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.911+0000 7f131b000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13140cd220 con 0x7f131413c980 2024-09-13T17:53:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.911+0000 7f131b000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f131413f960 con 0x7f131406dc60 2024-09-13T17:53:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.911+0000 7f131b000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131415a740 con 0x7f131413c240 2024-09-13T17:53:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.911+0000 7f1319000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f131406dc60 0x7f13140cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.911+0000 7f1313400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f131413c980 0x7f131406d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52634/0 (socket says 172.21.15.114:52634) 2024-09-13T17:53:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.911+0000 7f1313400640 1 -- 172.21.15.114:0/4139255446 learned_addr learned my addr 172.21.15.114:0/4139255446 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:12.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.911+0000 7f1313e00640 1 --2- 172.21.15.114:0/4139255446 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f131413c240 0x7f131413f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:12.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.911+0000 7f1319000640 1 -- 172.21.15.114:0/4139255446 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f131413c240 msgr2=0x7f131413f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:12.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.911+0000 7f1319000640 1 --2- 172.21.15.114:0/4139255446 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f131413c240 0x7f131413f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:12.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.911+0000 7f1319000640 1 -- 172.21.15.114:0/4139255446 >> v1:172.21.15.114:6789/0 conn(0x7f131413c980 legacy=0x7f131406d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:12.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.911+0000 7f1319000640 1 -- 172.21.15.114:0/4139255446 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1314159bc0 con 0x7f131406dc60 2024-09-13T17:53:12.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.911+0000 7f1312a00640 1 -- 172.21.15.114:0/4139255446 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403443966 0 0) 0x7f13140cd220 con 0x7f131413c980 2024-09-13T17:53:12.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.911+0000 7f1313e00640 1 --2- 172.21.15.114:0/4139255446 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f131413c240 0x7f131413f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:12.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.915+0000 7f1319000640 1 --2- 172.21.15.114:0/4139255446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f131406dc60 0x7f13140cd650 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f130c0097c0 tx=0x7f130c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892b0de4ae9049cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:12.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.915+0000 7f1312a00640 1 -- 172.21.15.114:0/4139255446 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c0ab670 con 0x7f131406dc60 2024-09-13T17:53:12.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.915+0000 7f1312a00640 1 -- 172.21.15.114:0/4139255446 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c0ab7d0 con 0x7f131406dc60 2024-09-13T17:53:12.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.915+0000 7f1312a00640 1 -- 172.21.15.114:0/4139255446 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c0abb60 con 0x7f131406dc60 2024-09-13T17:53:12.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.915+0000 7f131b000640 1 -- 172.21.15.114:0/4139255446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f131406dc60 msgr2=0x7f13140cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:12.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.915+0000 7f131b000640 1 --2- 172.21.15.114:0/4139255446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f131406dc60 0x7f13140cd650 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f130c0097c0 tx=0x7f130c01c470 comp rx=0 tx=0).stop 2024-09-13T17:53:12.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.915+0000 7f131b000640 1 -- 172.21.15.114:0/4139255446 shutdown_connections 2024-09-13T17:53:12.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.915+0000 7f131b000640 1 --2- 172.21.15.114:0/4139255446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f131406dc60 0x7f13140cd650 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:12.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.915+0000 7f131b000640 1 --2- 172.21.15.114:0/4139255446 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f131413c240 0x7f131413f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:12.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.915+0000 7f131b000640 1 -- 172.21.15.114:0/4139255446 >> 172.21.15.114:0/4139255446 conn(0x7f13140660b0 msgr2=0x7f1314069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:12.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.915+0000 7f131b000640 1 -- 172.21.15.114:0/4139255446 shutdown_connections 2024-09-13T17:53:12.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.915+0000 7f131b000640 1 -- 172.21.15.114:0/4139255446 wait complete. 2024-09-13T17:53:12.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.919+0000 7f131b000640 1 Processor -- start 2024-09-13T17:53:12.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.919+0000 7f131b000640 1 -- start start 2024-09-13T17:53:12.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.919+0000 7f131b000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f131406dc60 0x7f13141589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:12.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.919+0000 7f131b000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f131413c240 0x7f1314156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:12.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.919+0000 7f131b000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f131413c980 0x7f1314154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:12.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.919+0000 7f131b000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1314157b80 con 0x7f131413c980 2024-09-13T17:53:12.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.919+0000 7f131b000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1314156ae0 con 0x7f131406dc60 2024-09-13T17:53:12.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.919+0000 7f131b000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1314156dc0 con 0x7f131413c240 2024-09-13T17:53:12.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.919+0000 7f1319000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f131413c980 0x7f1314154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:12.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.919+0000 7f1319000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f131413c980 0x7f1314154a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53972/0 (socket says 172.21.15.114:53972) 2024-09-13T17:53:12.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.919+0000 7f1319000640 1 -- 172.21.15.114:0/1932637949 learned_addr learned my addr 172.21.15.114:0/1932637949 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:12.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.919+0000 7f1313400640 1 --2- 172.21.15.114:0/1932637949 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f131413c240 0x7f1314156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:12.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.919+0000 7f1313e00640 1 --2- 172.21.15.114:0/1932637949 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f131406dc60 0x7f13141589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:12.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.919+0000 7f1319000640 1 -- 172.21.15.114:0/1932637949 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f131413c240 msgr2=0x7f1314156100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:12.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.919+0000 7f1319000640 1 --2- 172.21.15.114:0/1932637949 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f131413c240 0x7f1314156100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:12.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.919+0000 7f1319000640 1 -- 172.21.15.114:0/1932637949 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f131406dc60 msgr2=0x7f13141589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:12.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.919+0000 7f1319000640 1 --2- 172.21.15.114:0/1932637949 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f131406dc60 0x7f13141589f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:12.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.919+0000 7f1319000640 1 -- 172.21.15.114:0/1932637949 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130c009420 con 0x7f131413c980 2024-09-13T17:53:12.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.919+0000 7f1313e00640 1 --2- 172.21.15.114:0/1932637949 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f131406dc60 0x7f13141589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:12.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.919+0000 7f1313400640 1 --2- 172.21.15.114:0/1932637949 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f131413c240 0x7f1314156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:12.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.919+0000 7f1319000640 1 --2- 172.21.15.114:0/1932637949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f131413c980 0x7f1314154a30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f130c0ad040 tx=0x7f130c019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:12.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.919+0000 7f130be00640 1 -- 172.21.15.114:0/1932637949 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c0bf610 con 0x7f131413c980 2024-09-13T17:53:12.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.919+0000 7f130be00640 1 -- 172.21.15.114:0/1932637949 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c0bf770 con 0x7f131413c980 2024-09-13T17:53:12.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.919+0000 7f130be00640 1 -- 172.21.15.114:0/1932637949 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c0bfae0 con 0x7f131413c980 2024-09-13T17:53:12.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.919+0000 7f131b000640 1 -- 172.21.15.114:0/1932637949 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13141570a0 con 0x7f131413c980 2024-09-13T17:53:12.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.919+0000 7f131b000640 1 -- 172.21.15.114:0/1932637949 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1314157660 con 0x7f131413c980 2024-09-13T17:53:12.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.923+0000 7f131b000640 1 -- 172.21.15.114:0/1932637949 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f131413cd60 con 0x7f131413c980 2024-09-13T17:53:12.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.923+0000 7f130be00640 1 -- 172.21.15.114:0/1932637949 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f130c0b5400 con 0x7f131413c980 2024-09-13T17:53:12.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.923+0000 7f130be00640 1 --2- 172.21.15.114:0/1932637949 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f12f4066690 0x7f12f4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:12.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.923+0000 7f130be00640 1 -- 172.21.15.114:0/1932637949 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f130c11ef40 con 0x7f131413c980 2024-09-13T17:53:12.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.923+0000 7f1313e00640 1 --2- 172.21.15.114:0/1932637949 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f12f4066690 0x7f12f4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:12.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.923+0000 7f1313e00640 1 --2- 172.21.15.114:0/1932637949 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f12f4066690 0x7f12f4068b50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1304009540 tx=0x7f130400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:12.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:12.927+0000 7f130be00640 1 -- 172.21.15.114:0/1932637949 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f131413cd60 con 0x7f131413c980 2024-09-13T17:53:13.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.079+0000 7f131b000640 1 -- 172.21.15.114:0/1932637949 --> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1314070620 con 0x7f12f4066690 2024-09-13T17:53:13.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.087+0000 7f130be00640 1 -- 172.21.15.114:0/1932637949 <== mgr.4102 v2:172.21.15.114:6832/137691478 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285650 (secure 0 0 0) 0x7f130400f040 con 0x7f12f4066690 2024-09-13T17:53:13.095 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:13.097 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-13T17:53:13.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.091+0000 7f131b000640 1 -- 172.21.15.114:0/1932637949 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f12f4066690 msgr2=0x7f12f4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:13.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.091+0000 7f131b000640 1 --2- 172.21.15.114:0/1932637949 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f12f4066690 0x7f12f4068b50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1304009540 tx=0x7f130400b040 comp rx=0 tx=0).stop 2024-09-13T17:53:13.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.091+0000 7f131b000640 1 -- 172.21.15.114:0/1932637949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f131413c980 msgr2=0x7f1314154a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:13.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.091+0000 7f131b000640 1 --2- 172.21.15.114:0/1932637949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f131413c980 0x7f1314154a30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f130c0ad040 tx=0x7f130c019210 comp rx=0 tx=0).stop 2024-09-13T17:53:13.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.091+0000 7f131b000640 1 -- 172.21.15.114:0/1932637949 shutdown_connections 2024-09-13T17:53:13.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.091+0000 7f131b000640 1 --2- 172.21.15.114:0/1932637949 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f12f4066690 0x7f12f4068b50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:13.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.091+0000 7f131b000640 1 --2- 172.21.15.114:0/1932637949 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f131413c980 0x7f1314154a30 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:13.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.091+0000 7f131b000640 1 --2- 172.21.15.114:0/1932637949 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f131413c240 0x7f1314156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:13.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.091+0000 7f131b000640 1 --2- 172.21.15.114:0/1932637949 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f131406dc60 0x7f13141589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:13.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.091+0000 7f131b000640 1 -- 172.21.15.114:0/1932637949 >> 172.21.15.114:0/1932637949 conn(0x7f13140660b0 msgr2=0x7f13140b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:13.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.091+0000 7f131b000640 1 -- 172.21.15.114:0/1932637949 shutdown_connections 2024-09-13T17:53:13.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.091+0000 7f131b000640 1 -- 172.21.15.114:0/1932637949 wait complete. 2024-09-13T17:53:13.116 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-09-13T17:53:11.952036+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220552,"kb_used_data":4392,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754168,"statfs":{"total":773094113280,"available":772868268032,"internally_reserved":0,"allocated":4497408,"data_stored":2571176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.044607"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.913592+0000","last_change":"2024-09-13T17:53:07.913592+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.913592+0000","last_undegraded":"2024-09-13T17:53:07.913592+0000","last_fullsized":"2024-09-13T17:53:07.913592+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:02.633358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.914181+0000","last_change":"2024-09-13T17:53:07.914181+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.914181+0000","last_undegraded":"2024-09-13T17:53:07.914181+0000","last_fullsized":"2024-09-13T17:53:07.914181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:11.750011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.922409+0000","last_change":"2024-09-13T17:53:07.922409+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.922409+0000","last_undegraded":"2024-09-13T17:53:07.922409+0000","last_fullsized":"2024-09-13T17:53:07.922409+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:29.844579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.918289+0000","last_change":"2024-09-13T17:53:07.918289+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.918289+0000","last_undegraded":"2024-09-13T17:53:07.918289+0000","last_fullsized":"2024-09-13T17:53:07.918289+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:04:50.600660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.917372+0000","last_change":"2024-09-13T17:53:07.917372+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.917372+0000","last_undegraded":"2024-09-13T17:53:07.917372+0000","last_fullsized":"2024-09-13T17:53:07.917372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:15.795161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.920013+0000","last_change":"2024-09-13T17:53:07.920013+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.920013+0000","last_undegraded":"2024-09-13T17:53:07.920013+0000","last_fullsized":"2024-09-13T17:53:07.920013+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:15.154333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.922040+0000","last_change":"2024-09-13T17:53:07.922040+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.922040+0000","last_undegraded":"2024-09-13T17:53:07.922040+0000","last_fullsized":"2024-09-13T17:53:07.922040+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:00.206010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.913515+0000","last_change":"2024-09-13T17:53:07.913515+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.913515+0000","last_undegraded":"2024-09-13T17:53:07.913515+0000","last_fullsized":"2024-09-13T17:53:07.913515+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:39.920002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.921842+0000","last_change":"2024-09-13T17:53:07.921842+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.921842+0000","last_undegraded":"2024-09-13T17:53:07.921842+0000","last_fullsized":"2024-09-13T17:53:07.921842+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:58.339595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.921409+0000","last_change":"2024-09-13T17:53:07.921409+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.921409+0000","last_undegraded":"2024-09-13T17:53:07.921409+0000","last_fullsized":"2024-09-13T17:53:07.921409+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:08.746286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.920282+0000","last_change":"2024-09-13T17:53:07.920282+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.920282+0000","last_undegraded":"2024-09-13T17:53:07.920282+0000","last_fullsized":"2024-09-13T17:53:07.920282+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:02.660007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.922001+0000","last_change":"2024-09-13T17:53:07.922001+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.922001+0000","last_undegraded":"2024-09-13T17:53:07.922001+0000","last_fullsized":"2024-09-13T17:53:07.922001+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:24.523487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.919785+0000","last_change":"2024-09-13T17:53:07.919785+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.919785+0000","last_undegraded":"2024-09-13T17:53:07.919785+0000","last_fullsized":"2024-09-13T17:53:07.919785+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:24.523487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.923536+0000","last_change":"2024-09-13T17:53:07.923536+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.923536+0000","last_undegraded":"2024-09-13T17:53:07.923536+0000","last_fullsized":"2024-09-13T17:53:07.923536+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:51.440182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.919382+0000","last_change":"2024-09-13T17:53:07.919382+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.919382+0000","last_undegraded":"2024-09-13T17:53:07.919382+0000","last_fullsized":"2024-09-13T17:53:07.919382+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:16.635091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.934811+0000","last_change":"2024-09-13T17:53:07.934811+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.934811+0000","last_undegraded":"2024-09-13T17:53:07.934811+0000","last_fullsized":"2024-09-13T17:53:07.934811+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:42.945540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.932902+0000","last_change":"2024-09-13T17:53:07.932902+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.932902+0000","last_undegraded":"2024-09-13T17:53:07.932902+0000","last_fullsized":"2024-09-13T17:53:07.932902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:43.484986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.914267+0000","last_change":"2024-09-13T17:53:07.914267+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.914267+0000","last_undegraded":"2024-09-13T17:53:07.914267+0000","last_fullsized":"2024-09-13T17:53:07.914267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:09.561563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.916812+0000","last_change":"2024-09-13T17:53:07.916812+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.916812+0000","last_undegraded":"2024-09-13T17:53:07.916812+0000","last_fullsized":"2024-09-13T17:53:07.916812+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:46.004449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.915214+0000","last_change":"2024-09-13T17:53:07.915214+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.915214+0000","last_undegraded":"2024-09-13T17:53:07.915214+0000","last_fullsized":"2024-09-13T17:53:07.915214+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:30.620140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.919237+0000","last_change":"2024-09-13T17:53:07.919237+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.919237+0000","last_undegraded":"2024-09-13T17:53:07.919237+0000","last_fullsized":"2024-09-13T17:53:07.919237+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:51.440182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.918246+0000","last_change":"2024-09-13T17:53:07.918246+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.918246+0000","last_undegraded":"2024-09-13T17:53:07.918246+0000","last_fullsized":"2024-09-13T17:53:07.918246+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:02.621171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.932894+0000","last_change":"2024-09-13T17:53:07.932894+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.932894+0000","last_undegraded":"2024-09-13T17:53:07.932894+0000","last_fullsized":"2024-09-13T17:53:07.932894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:02.660007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.917294+0000","last_change":"2024-09-13T17:53:07.917294+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.917294+0000","last_undegraded":"2024-09-13T17:53:07.917294+0000","last_fullsized":"2024-09-13T17:53:07.917294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:39.411729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.915293+0000","last_change":"2024-09-13T17:53:07.915293+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.915293+0000","last_undegraded":"2024-09-13T17:53:07.915293+0000","last_fullsized":"2024-09-13T17:53:07.915293+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:19.636768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.924894+0000","last_change":"2024-09-13T17:53:07.924894+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.924894+0000","last_undegraded":"2024-09-13T17:53:07.924894+0000","last_fullsized":"2024-09-13T17:53:07.924894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:05.172827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.914373+0000","last_change":"2024-09-13T17:53:07.914373+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.914373+0000","last_undegraded":"2024-09-13T17:53:07.914373+0000","last_fullsized":"2024-09-13T17:53:07.914373+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:05.594213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.918522+0000","last_change":"2024-09-13T17:53:07.918522+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.918522+0000","last_undegraded":"2024-09-13T17:53:07.918522+0000","last_fullsized":"2024-09-13T17:53:07.918522+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:55.588582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.914463+0000","last_change":"2024-09-13T17:53:07.914463+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.914463+0000","last_undegraded":"2024-09-13T17:53:07.914463+0000","last_fullsized":"2024-09-13T17:53:07.914463+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:07.544794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.915528+0000","last_change":"2024-09-13T17:53:07.915528+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.915528+0000","last_undegraded":"2024-09-13T17:53:07.915528+0000","last_fullsized":"2024-09-13T17:53:07.915528+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:06.338741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.925481+0000","last_change":"2024-09-13T17:53:07.925481+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.925481+0000","last_undegraded":"2024-09-13T17:53:07.925481+0000","last_fullsized":"2024-09-13T17:53:07.925481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:15.154333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.924668+0000","last_change":"2024-09-13T17:53:07.924668+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.924668+0000","last_undegraded":"2024-09-13T17:53:07.924668+0000","last_fullsized":"2024-09-13T17:53:07.924668+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:42.945540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.924863+0000","last_change":"2024-09-13T17:53:07.924863+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.924863+0000","last_undegraded":"2024-09-13T17:53:07.924863+0000","last_fullsized":"2024-09-13T17:53:07.924863+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:05.297506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.931791+0000","last_change":"2024-09-13T17:53:07.927772+0000","last_active":"2024-09-13T17:53:07.931791+0000","last_peered":"2024-09-13T17:53:07.931791+0000","last_clean":"2024-09-13T17:53:07.931791+0000","last_became_active":"2024-09-13T17:53:07.926833+0000","last_became_peered":"2024-09-13T17:53:07.926833+0000","last_unstale":"2024-09-13T17:53:07.931791+0000","last_undegraded":"2024-09-13T17:53:07.931791+0000","last_fullsized":"2024-09-13T17:53:07.931791+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:26.713460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.925979+0000","last_change":"2024-09-13T17:53:07.925979+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.925979+0000","last_undegraded":"2024-09-13T17:53:07.925979+0000","last_fullsized":"2024-09-13T17:53:07.925979+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:00.206010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.943737+0000","last_change":"2024-09-13T17:53:07.942858+0000","last_active":"2024-09-13T17:53:07.943737+0000","last_peered":"2024-09-13T17:53:07.943737+0000","last_clean":"2024-09-13T17:53:07.943737+0000","last_became_active":"2024-09-13T17:53:07.942331+0000","last_became_peered":"2024-09-13T17:53:07.942331+0000","last_unstale":"2024-09-13T17:53:07.943737+0000","last_undegraded":"2024-09-13T17:53:07.943737+0000","last_fullsized":"2024-09-13T17:53:07.943737+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:52.434464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.919076+0000","last_change":"2024-09-13T17:53:07.919076+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.919076+0000","last_undegraded":"2024-09-13T17:53:07.919076+0000","last_fullsized":"2024-09-13T17:53:07.919076+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:58.339595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.945322+0000","last_change":"2024-09-13T17:53:07.942677+0000","last_active":"2024-09-13T17:53:07.945322+0000","last_peered":"2024-09-13T17:53:07.945322+0000","last_clean":"2024-09-13T17:53:07.945322+0000","last_became_active":"2024-09-13T17:53:07.942426+0000","last_became_peered":"2024-09-13T17:53:07.942426+0000","last_unstale":"2024-09-13T17:53:07.945322+0000","last_undegraded":"2024-09-13T17:53:07.945322+0000","last_fullsized":"2024-09-13T17:53:07.945322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:08.554504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.914136+0000","last_change":"2024-09-13T17:53:07.914136+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.914136+0000","last_undegraded":"2024-09-13T17:53:07.914136+0000","last_fullsized":"2024-09-13T17:53:07.914136+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:13.404809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.932523+0000","last_change":"2024-09-13T17:53:07.931288+0000","last_active":"2024-09-13T17:53:07.932523+0000","last_peered":"2024-09-13T17:53:07.932523+0000","last_clean":"2024-09-13T17:53:07.932523+0000","last_became_active":"2024-09-13T17:53:07.929489+0000","last_became_peered":"2024-09-13T17:53:07.929489+0000","last_unstale":"2024-09-13T17:53:07.932523+0000","last_undegraded":"2024-09-13T17:53:07.932523+0000","last_fullsized":"2024-09-13T17:53:07.932523+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:42.477927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.921904+0000","last_change":"2024-09-13T17:53:07.921904+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.921904+0000","last_undegraded":"2024-09-13T17:53:07.921904+0000","last_fullsized":"2024-09-13T17:53:07.921904+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:51.440182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.934706+0000","last_change":"2024-09-13T17:53:07.930059+0000","last_active":"2024-09-13T17:53:07.934706+0000","last_peered":"2024-09-13T17:53:07.934706+0000","last_clean":"2024-09-13T17:53:07.934706+0000","last_became_active":"2024-09-13T17:53:07.929603+0000","last_became_peered":"2024-09-13T17:53:07.929603+0000","last_unstale":"2024-09-13T17:53:07.934706+0000","last_undegraded":"2024-09-13T17:53:07.934706+0000","last_fullsized":"2024-09-13T17:53:07.934706+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:18.629709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.917742+0000","last_change":"2024-09-13T17:53:07.917742+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.917742+0000","last_undegraded":"2024-09-13T17:53:07.917742+0000","last_fullsized":"2024-09-13T17:53:07.917742+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:58.339595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.945225+0000","last_change":"2024-09-13T17:53:07.943158+0000","last_active":"2024-09-13T17:53:07.945225+0000","last_peered":"2024-09-13T17:53:07.945225+0000","last_clean":"2024-09-13T17:53:07.945225+0000","last_became_active":"2024-09-13T17:53:07.942861+0000","last_became_peered":"2024-09-13T17:53:07.942861+0000","last_unstale":"2024-09-13T17:53:07.945225+0000","last_undegraded":"2024-09-13T17:53:07.945225+0000","last_fullsized":"2024-09-13T17:53:07.945225+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:38.404670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.922633+0000","last_change":"2024-09-13T17:53:07.922633+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.922633+0000","last_undegraded":"2024-09-13T17:53:07.922633+0000","last_fullsized":"2024-09-13T17:53:07.922633+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:42.232554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.941716+0000","last_change":"2024-09-13T17:53:07.940289+0000","last_active":"2024-09-13T17:53:07.941716+0000","last_peered":"2024-09-13T17:53:07.941716+0000","last_clean":"2024-09-13T17:53:07.941716+0000","last_became_active":"2024-09-13T17:53:07.940047+0000","last_became_peered":"2024-09-13T17:53:07.940047+0000","last_unstale":"2024-09-13T17:53:07.941716+0000","last_undegraded":"2024-09-13T17:53:07.941716+0000","last_fullsized":"2024-09-13T17:53:07.941716+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:29.613081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.914998+0000","last_change":"2024-09-13T17:53:07.914998+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.914998+0000","last_undegraded":"2024-09-13T17:53:07.914998+0000","last_fullsized":"2024-09-13T17:53:07.914998+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:26.764647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.931749+0000","last_change":"2024-09-13T17:53:07.930024+0000","last_active":"2024-09-13T17:53:07.931749+0000","last_peered":"2024-09-13T17:53:07.931749+0000","last_clean":"2024-09-13T17:53:07.931749+0000","last_became_active":"2024-09-13T17:53:07.927170+0000","last_became_peered":"2024-09-13T17:53:07.927170+0000","last_unstale":"2024-09-13T17:53:07.931749+0000","last_undegraded":"2024-09-13T17:53:07.931749+0000","last_fullsized":"2024-09-13T17:53:07.931749+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:15.690853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.916643+0000","last_change":"2024-09-13T17:53:07.916643+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.916643+0000","last_undegraded":"2024-09-13T17:53:07.916643+0000","last_fullsized":"2024-09-13T17:53:07.916643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:24.556344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.935831+0000","last_change":"2024-09-13T17:53:07.933052+0000","last_active":"2024-09-13T17:53:07.935831+0000","last_peered":"2024-09-13T17:53:07.935831+0000","last_clean":"2024-09-13T17:53:07.935831+0000","last_became_active":"2024-09-13T17:53:07.932754+0000","last_became_peered":"2024-09-13T17:53:07.932754+0000","last_unstale":"2024-09-13T17:53:07.935831+0000","last_undegraded":"2024-09-13T17:53:07.935831+0000","last_fullsized":"2024-09-13T17:53:07.935831+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:01.652948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.924440+0000","last_change":"2024-09-13T17:53:07.924440+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.924440+0000","last_undegraded":"2024-09-13T17:53:07.924440+0000","last_fullsized":"2024-09-13T17:53:07.924440+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:00.206010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.935213+0000","last_change":"2024-09-13T17:53:07.933774+0000","last_active":"2024-09-13T17:53:07.935213+0000","last_peered":"2024-09-13T17:53:07.935213+0000","last_clean":"2024-09-13T17:53:07.935213+0000","last_became_active":"2024-09-13T17:53:07.933487+0000","last_became_peered":"2024-09-13T17:53:07.933487+0000","last_unstale":"2024-09-13T17:53:07.935213+0000","last_undegraded":"2024-09-13T17:53:07.935213+0000","last_fullsized":"2024-09-13T17:53:07.935213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:48.805157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.923052+0000","last_change":"2024-09-13T17:53:07.923052+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.923052+0000","last_undegraded":"2024-09-13T17:53:07.923052+0000","last_fullsized":"2024-09-13T17:53:07.923052+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:42.232554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.943462+0000","last_change":"2024-09-13T17:53:07.939168+0000","last_active":"2024-09-13T17:53:07.943462+0000","last_peered":"2024-09-13T17:53:07.943462+0000","last_clean":"2024-09-13T17:53:07.943462+0000","last_became_active":"2024-09-13T17:53:07.938879+0000","last_became_peered":"2024-09-13T17:53:07.938879+0000","last_unstale":"2024-09-13T17:53:07.943462+0000","last_undegraded":"2024-09-13T17:53:07.943462+0000","last_fullsized":"2024-09-13T17:53:07.943462+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:04.587154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.922383+0000","last_change":"2024-09-13T17:53:07.922383+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.922383+0000","last_undegraded":"2024-09-13T17:53:07.922383+0000","last_fullsized":"2024-09-13T17:53:07.922383+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:13.895602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.943376+0000","last_change":"2024-09-13T17:53:07.940964+0000","last_active":"2024-09-13T17:53:07.943376+0000","last_peered":"2024-09-13T17:53:07.943376+0000","last_clean":"2024-09-13T17:53:07.943376+0000","last_became_active":"2024-09-13T17:53:07.940717+0000","last_became_peered":"2024-09-13T17:53:07.940717+0000","last_unstale":"2024-09-13T17:53:07.943376+0000","last_undegraded":"2024-09-13T17:53:07.943376+0000","last_fullsized":"2024-09-13T17:53:07.943376+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:50.212192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.921446+0000","last_change":"2024-09-13T17:53:07.921446+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.921446+0000","last_undegraded":"2024-09-13T17:53:07.921446+0000","last_fullsized":"2024-09-13T17:53:07.921446+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:02.621171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.933384+0000","last_change":"2024-09-13T17:53:07.929999+0000","last_active":"2024-09-13T17:53:07.933384+0000","last_peered":"2024-09-13T17:53:07.933384+0000","last_clean":"2024-09-13T17:53:07.933384+0000","last_became_active":"2024-09-13T17:53:07.929747+0000","last_became_peered":"2024-09-13T17:53:07.929747+0000","last_unstale":"2024-09-13T17:53:07.933384+0000","last_undegraded":"2024-09-13T17:53:07.933384+0000","last_fullsized":"2024-09-13T17:53:07.933384+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:04.165768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.913474+0000","last_change":"2024-09-13T17:53:07.913474+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.913474+0000","last_undegraded":"2024-09-13T17:53:07.913474+0000","last_fullsized":"2024-09-13T17:53:07.913474+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:13.042839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.943645+0000","last_change":"2024-09-13T17:53:07.941959+0000","last_active":"2024-09-13T17:53:07.943645+0000","last_peered":"2024-09-13T17:53:07.943645+0000","last_clean":"2024-09-13T17:53:07.943645+0000","last_became_active":"2024-09-13T17:53:07.941576+0000","last_became_peered":"2024-09-13T17:53:07.941576+0000","last_unstale":"2024-09-13T17:53:07.943645+0000","last_undegraded":"2024-09-13T17:53:07.943645+0000","last_fullsized":"2024-09-13T17:53:07.943645+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:04.911527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.923630+0000","last_change":"2024-09-13T17:53:07.923630+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.923630+0000","last_undegraded":"2024-09-13T17:53:07.923630+0000","last_fullsized":"2024-09-13T17:53:07.923630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:51.219251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.931545+0000","last_change":"2024-09-13T17:53:07.927302+0000","last_active":"2024-09-13T17:53:07.931545+0000","last_peered":"2024-09-13T17:53:07.931545+0000","last_clean":"2024-09-13T17:53:07.931545+0000","last_became_active":"2024-09-13T17:53:07.927010+0000","last_became_peered":"2024-09-13T17:53:07.927010+0000","last_unstale":"2024-09-13T17:53:07.931545+0000","last_undegraded":"2024-09-13T17:53:07.931545+0000","last_fullsized":"2024-09-13T17:53:07.931545+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:58:48.383731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.914556+0000","last_change":"2024-09-13T17:53:07.914556+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.914556+0000","last_undegraded":"2024-09-13T17:53:07.914556+0000","last_fullsized":"2024-09-13T17:53:07.914556+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:22.069383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.944634+0000","last_change":"2024-09-13T17:53:07.941904+0000","last_active":"2024-09-13T17:53:07.944634+0000","last_peered":"2024-09-13T17:53:07.944634+0000","last_clean":"2024-09-13T17:53:07.944634+0000","last_became_active":"2024-09-13T17:53:07.940899+0000","last_became_peered":"2024-09-13T17:53:07.940899+0000","last_unstale":"2024-09-13T17:53:07.944634+0000","last_undegraded":"2024-09-13T17:53:07.944634+0000","last_fullsized":"2024-09-13T17:53:07.944634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:29.355126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.913545+0000","last_change":"2024-09-13T17:53:07.913545+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.913545+0000","last_undegraded":"2024-09-13T17:53:07.913545+0000","last_fullsized":"2024-09-13T17:53:07.913545+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:12.327579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.938893+0000","last_change":"2024-09-13T17:53:07.935326+0000","last_active":"2024-09-13T17:53:07.938893+0000","last_peered":"2024-09-13T17:53:07.938893+0000","last_clean":"2024-09-13T17:53:07.938893+0000","last_became_active":"2024-09-13T17:53:07.934994+0000","last_became_peered":"2024-09-13T17:53:07.934994+0000","last_unstale":"2024-09-13T17:53:07.938893+0000","last_undegraded":"2024-09-13T17:53:07.938893+0000","last_fullsized":"2024-09-13T17:53:07.938893+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:05.331682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.919760+0000","last_change":"2024-09-13T17:53:07.919760+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.919760+0000","last_undegraded":"2024-09-13T17:53:07.919760+0000","last_fullsized":"2024-09-13T17:53:07.919760+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:02.621171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.939039+0000","last_change":"2024-09-13T17:53:07.937200+0000","last_active":"2024-09-13T17:53:07.939039+0000","last_peered":"2024-09-13T17:53:07.939039+0000","last_clean":"2024-09-13T17:53:07.939039+0000","last_became_active":"2024-09-13T17:53:07.936933+0000","last_became_peered":"2024-09-13T17:53:07.936933+0000","last_unstale":"2024-09-13T17:53:07.939039+0000","last_undegraded":"2024-09-13T17:53:07.939039+0000","last_fullsized":"2024-09-13T17:53:07.939039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:41.938481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.919610+0000","last_change":"2024-09-13T17:53:07.919610+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.919610+0000","last_undegraded":"2024-09-13T17:53:07.919610+0000","last_fullsized":"2024-09-13T17:53:07.919610+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:29.844579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.941365+0000","last_change":"2024-09-13T17:53:07.940232+0000","last_active":"2024-09-13T17:53:07.941365+0000","last_peered":"2024-09-13T17:53:07.941365+0000","last_clean":"2024-09-13T17:53:07.941365+0000","last_became_active":"2024-09-13T17:53:07.939995+0000","last_became_peered":"2024-09-13T17:53:07.939995+0000","last_unstale":"2024-09-13T17:53:07.941365+0000","last_undegraded":"2024-09-13T17:53:07.941365+0000","last_fullsized":"2024-09-13T17:53:07.941365+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:30:28.756119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.916956+0000","last_change":"2024-09-13T17:53:07.916956+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.916956+0000","last_undegraded":"2024-09-13T17:53:07.916956+0000","last_fullsized":"2024-09-13T17:53:07.916956+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:27.720519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.938354+0000","last_change":"2024-09-13T17:53:07.935565+0000","last_active":"2024-09-13T17:53:07.938354+0000","last_peered":"2024-09-13T17:53:07.938354+0000","last_clean":"2024-09-13T17:53:07.938354+0000","last_became_active":"2024-09-13T17:53:07.935314+0000","last_became_peered":"2024-09-13T17:53:07.935314+0000","last_unstale":"2024-09-13T17:53:07.938354+0000","last_undegraded":"2024-09-13T17:53:07.938354+0000","last_fullsized":"2024-09-13T17:53:07.938354+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:18.629709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.934206+0000","last_change":"2024-09-13T17:53:07.934206+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.934206+0000","last_undegraded":"2024-09-13T17:53:07.934206+0000","last_fullsized":"2024-09-13T17:53:07.934206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:16.635091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.931778+0000","last_change":"2024-09-13T17:53:07.930426+0000","last_active":"2024-09-13T17:53:07.931778+0000","last_peered":"2024-09-13T17:53:07.931778+0000","last_clean":"2024-09-13T17:53:07.931778+0000","last_became_active":"2024-09-13T17:53:07.929700+0000","last_became_peered":"2024-09-13T17:53:07.929700+0000","last_unstale":"2024-09-13T17:53:07.931778+0000","last_undegraded":"2024-09-13T17:53:07.931778+0000","last_fullsized":"2024-09-13T17:53:07.931778+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:14.633970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.921349+0000","last_change":"2024-09-13T17:53:07.921349+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.921349+0000","last_undegraded":"2024-09-13T17:53:07.921349+0000","last_fullsized":"2024-09-13T17:53:07.921349+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:13.895602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.931395+0000","last_change":"2024-09-13T17:53:07.928071+0000","last_active":"2024-09-13T17:53:07.931395+0000","last_peered":"2024-09-13T17:53:07.931395+0000","last_clean":"2024-09-13T17:53:07.931395+0000","last_became_active":"2024-09-13T17:53:07.927826+0000","last_became_peered":"2024-09-13T17:53:07.927826+0000","last_unstale":"2024-09-13T17:53:07.931395+0000","last_undegraded":"2024-09-13T17:53:07.931395+0000","last_fullsized":"2024-09-13T17:53:07.931395+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:57.190801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.919083+0000","last_change":"2024-09-13T17:53:07.919083+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.919083+0000","last_undegraded":"2024-09-13T17:53:07.919083+0000","last_fullsized":"2024-09-13T17:53:07.919083+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:41.690036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.945642+0000","last_change":"2024-09-13T17:53:07.944383+0000","last_active":"2024-09-13T17:53:07.945642+0000","last_peered":"2024-09-13T17:53:07.945642+0000","last_clean":"2024-09-13T17:53:07.945642+0000","last_became_active":"2024-09-13T17:53:07.944063+0000","last_became_peered":"2024-09-13T17:53:07.944063+0000","last_unstale":"2024-09-13T17:53:07.945642+0000","last_undegraded":"2024-09-13T17:53:07.945642+0000","last_fullsized":"2024-09-13T17:53:07.945642+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:46.511108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.913575+0000","last_change":"2024-09-13T17:53:07.913575+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.913575+0000","last_undegraded":"2024-09-13T17:53:07.913575+0000","last_fullsized":"2024-09-13T17:53:07.913575+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:00.024100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.927652+0000","last_change":"2024-09-13T17:53:07.924570+0000","last_active":"2024-09-13T17:53:07.927652+0000","last_peered":"2024-09-13T17:53:07.927652+0000","last_clean":"2024-09-13T17:53:07.927652+0000","last_became_active":"2024-09-13T17:53:07.924332+0000","last_became_peered":"2024-09-13T17:53:07.924332+0000","last_unstale":"2024-09-13T17:53:07.927652+0000","last_undegraded":"2024-09-13T17:53:07.927652+0000","last_fullsized":"2024-09-13T17:53:07.927652+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:54.256684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.926469+0000","last_change":"2024-09-13T17:53:07.926469+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.926469+0000","last_undegraded":"2024-09-13T17:53:07.926469+0000","last_fullsized":"2024-09-13T17:53:07.926469+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:48.932531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.943010+0000","last_change":"2024-09-13T17:53:07.939026+0000","last_active":"2024-09-13T17:53:07.943010+0000","last_peered":"2024-09-13T17:53:07.943010+0000","last_clean":"2024-09-13T17:53:07.943010+0000","last_became_active":"2024-09-13T17:53:07.938709+0000","last_became_peered":"2024-09-13T17:53:07.938709+0000","last_unstale":"2024-09-13T17:53:07.943010+0000","last_undegraded":"2024-09-13T17:53:07.943010+0000","last_fullsized":"2024-09-13T17:53:07.943010+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:08.554504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.924008+0000","last_change":"2024-09-13T17:53:07.924008+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.924008+0000","last_undegraded":"2024-09-13T17:53:07.924008+0000","last_fullsized":"2024-09-13T17:53:07.924008+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:05.172827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.940487+0000","last_change":"2024-09-13T17:53:07.939210+0000","last_active":"2024-09-13T17:53:07.940487+0000","last_peered":"2024-09-13T17:53:07.940487+0000","last_clean":"2024-09-13T17:53:07.940487+0000","last_became_active":"2024-09-13T17:53:07.938689+0000","last_became_peered":"2024-09-13T17:53:07.938689+0000","last_unstale":"2024-09-13T17:53:07.940487+0000","last_undegraded":"2024-09-13T17:53:07.940487+0000","last_fullsized":"2024-09-13T17:53:07.940487+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:30.156095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.913549+0000","last_change":"2024-09-13T17:53:07.913549+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.913549+0000","last_undegraded":"2024-09-13T17:53:07.913549+0000","last_fullsized":"2024-09-13T17:53:07.913549+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:24.057582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.936014+0000","last_change":"2024-09-13T17:53:07.933119+0000","last_active":"2024-09-13T17:53:07.936014+0000","last_peered":"2024-09-13T17:53:07.936014+0000","last_clean":"2024-09-13T17:53:07.936014+0000","last_became_active":"2024-09-13T17:53:07.932786+0000","last_became_peered":"2024-09-13T17:53:07.932786+0000","last_unstale":"2024-09-13T17:53:07.936014+0000","last_undegraded":"2024-09-13T17:53:07.936014+0000","last_fullsized":"2024-09-13T17:53:07.936014+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:54.581523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.920940+0000","last_change":"2024-09-13T17:53:07.920940+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.920940+0000","last_undegraded":"2024-09-13T17:53:07.920940+0000","last_fullsized":"2024-09-13T17:53:07.920940+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:08.746286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.932047+0000","last_change":"2024-09-13T17:53:07.929110+0000","last_active":"2024-09-13T17:53:07.932047+0000","last_peered":"2024-09-13T17:53:07.932047+0000","last_clean":"2024-09-13T17:53:07.932047+0000","last_became_active":"2024-09-13T17:53:07.928830+0000","last_became_peered":"2024-09-13T17:53:07.928830+0000","last_unstale":"2024-09-13T17:53:07.932047+0000","last_undegraded":"2024-09-13T17:53:07.932047+0000","last_fullsized":"2024-09-13T17:53:07.932047+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:42.477927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.920803+0000","last_change":"2024-09-13T17:53:07.920803+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.920803+0000","last_undegraded":"2024-09-13T17:53:07.920803+0000","last_fullsized":"2024-09-13T17:53:07.920803+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:02.660007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.933680+0000","last_change":"2024-09-13T17:53:07.928968+0000","last_active":"2024-09-13T17:53:07.933680+0000","last_peered":"2024-09-13T17:53:07.933680+0000","last_clean":"2024-09-13T17:53:07.933680+0000","last_became_active":"2024-09-13T17:53:07.928753+0000","last_became_peered":"2024-09-13T17:53:07.928753+0000","last_unstale":"2024-09-13T17:53:07.933680+0000","last_undegraded":"2024-09-13T17:53:07.933680+0000","last_fullsized":"2024-09-13T17:53:07.933680+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:14.788101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.923036+0000","last_change":"2024-09-13T17:53:07.923036+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.923036+0000","last_undegraded":"2024-09-13T17:53:07.923036+0000","last_fullsized":"2024-09-13T17:53:07.923036+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:24.523487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.927850+0000","last_change":"2024-09-13T17:53:07.923741+0000","last_active":"2024-09-13T17:53:07.927850+0000","last_peered":"2024-09-13T17:53:07.927850+0000","last_clean":"2024-09-13T17:53:07.927850+0000","last_became_active":"2024-09-13T17:53:07.922391+0000","last_became_peered":"2024-09-13T17:53:07.922391+0000","last_unstale":"2024-09-13T17:53:07.927850+0000","last_undegraded":"2024-09-13T17:53:07.927850+0000","last_fullsized":"2024-09-13T17:53:07.927850+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:54.581523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.933495+0000","last_change":"2024-09-13T17:53:07.933495+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.933495+0000","last_undegraded":"2024-09-13T17:53:07.933495+0000","last_fullsized":"2024-09-13T17:53:07.933495+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:48.932531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.932247+0000","last_change":"2024-09-13T17:53:07.928173+0000","last_active":"2024-09-13T17:53:07.932247+0000","last_peered":"2024-09-13T17:53:07.932247+0000","last_clean":"2024-09-13T17:53:07.932247+0000","last_became_active":"2024-09-13T17:53:07.927902+0000","last_became_peered":"2024-09-13T17:53:07.927902+0000","last_unstale":"2024-09-13T17:53:07.932247+0000","last_undegraded":"2024-09-13T17:53:07.932247+0000","last_fullsized":"2024-09-13T17:53:07.932247+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:14.147274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.921929+0000","last_change":"2024-09-13T17:53:07.921929+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.921929+0000","last_undegraded":"2024-09-13T17:53:07.921929+0000","last_fullsized":"2024-09-13T17:53:07.921929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:48.932531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.945260+0000","last_change":"2024-09-13T17:53:07.943953+0000","last_active":"2024-09-13T17:53:07.945260+0000","last_peered":"2024-09-13T17:53:07.945260+0000","last_clean":"2024-09-13T17:53:07.945260+0000","last_became_active":"2024-09-13T17:53:07.943699+0000","last_became_peered":"2024-09-13T17:53:07.943699+0000","last_unstale":"2024-09-13T17:53:07.945260+0000","last_undegraded":"2024-09-13T17:53:07.945260+0000","last_fullsized":"2024-09-13T17:53:07.945260+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:44.997390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T17:53:06.912481+0000","last_change":"2024-09-13T17:51:40.205691+0000","last_active":"2024-09-13T17:53:06.912481+0000","last_peered":"2024-09-13T17:53:06.912481+0000","last_clean":"2024-09-13T17:53:06.912481+0000","last_became_active":"2024-09-13T17:51:40.204577+0000","last_became_peered":"2024-09-13T17:51:40.204577+0000","last_unstale":"2024-09-13T17:53:06.912481+0000","last_undegraded":"2024-09-13T17:53:06.912481+0000","last_fullsized":"2024-09-13T17:53:06.912481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_clean_scrub_stamp":"2024-09-13T17:51:38.340495+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:37.899275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":764173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.68400000000000005}]},{"osd":1,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.73999999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.75600000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.81299999999999994}]},{"osd":4,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.52200000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.63500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.63500000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.66500000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.82699999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.76000000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.90300000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.94899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.65700000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.62},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.53900000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.0910000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.63600000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.55500000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.71499999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.74299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.59099999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.624},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.78000000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.72699999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.61699999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.85299999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.65300000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.745},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.91200000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":4.2460000000000004,"5min":4.2460000000000004,"15min":4.2460000000000004},"last":0.434}]},{"osd":1,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.008,"5min":5.008,"15min":5.008},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.38100000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":4.8570000000000002,"5min":4.8570000000000002,"15min":4.8570000000000002},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":4.8399999999999999,"5min":4.8399999999999999,"15min":4.8399999999999999},"last":0.41599999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":4.4450000000000003,"5min":4.4450000000000003,"15min":4.4450000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":4.9000000000000004,"5min":4.9000000000000004,"15min":4.9000000000000004},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.624},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":0.59099999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":4.9710000000000001,"5min":4.9710000000000001,"15min":4.9710000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.755}]},{"osd":7,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":4.4029999999999996,"5min":4.4029999999999996,"15min":4.4029999999999996},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":4.9349999999999996,"5min":4.9349999999999996,"15min":4.9349999999999996},"last":0.69599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":5.5010000000000003,"5min":5.5010000000000003,"15min":5.5010000000000003},"last":0.311},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":4.3689999999999998,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.54500000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":5.3799999999999999,"5min":5.3799999999999999,"15min":5.3799999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":4.2329999999999997,"5min":4.2329999999999997,"15min":4.2329999999999997},"last":0.442}]},{"osd":3,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":5.032,"5min":5.032,"15min":5.032},"last":0.33100000000000002},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":5.4189999999999996,"5min":5.4189999999999996,"15min":5.4189999999999996},"last":0.47699999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":5.4480000000000004,"5min":5.4480000000000004,"15min":5.4480000000000004},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":4.7460000000000004,"5min":4.7460000000000004,"15min":4.7460000000000004},"last":0.84299999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":4.4710000000000001,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":5.4749999999999996,"5min":5.4749999999999996,"15min":5.4749999999999996},"last":0.76200000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":4.7789999999999999,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":4.9859999999999998,"5min":4.9859999999999998,"15min":4.9859999999999998},"last":0.85599999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":4.8200000000000003,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":4.8879999999999999,"5min":4.8879999999999999,"15min":4.8879999999999999},"last":0.89700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.35599999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.40999999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.373}]},{"osd":4,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.73599999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.77200000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.746}]},{"osd":7,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.75700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":764173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.41599999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.44},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.502},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.51700000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.0350000000000001,"5min":3.0350000000000001,"15min":3.0350000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":0.68300000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.9119999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.754},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.75,"5min":2.75,"15min":2.75},"last":0.76700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:53:13.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2024-09-13T17:53:13.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.913592+0000', 'last_change': '2024-09-13T17:53:07.913592+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.913592+0000', 'last_undegraded': '2024-09-13T17:53:07.913592+0000', 'last_fullsized': '2024-09-13T17:53:07.913592+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:12:02.633358+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:53:13.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2024-09-13T17:53:13.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.914181+0000', 'last_change': '2024-09-13T17:53:07.914181+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.914181+0000', 'last_undegraded': '2024-09-13T17:53:07.914181+0000', 'last_fullsized': '2024-09-13T17:53:07.914181+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:45:11.750011+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:53:13.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2024-09-13T17:53:13.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.922409+0000', 'last_change': '2024-09-13T17:53:07.922409+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.922409+0000', 'last_undegraded': '2024-09-13T17:53:07.922409+0000', 'last_fullsized': '2024-09-13T17:53:07.922409+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:58:29.844579+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:53:13.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2024-09-13T17:53:13.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.918289+0000', 'last_change': '2024-09-13T17:53:07.918289+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.918289+0000', 'last_undegraded': '2024-09-13T17:53:07.918289+0000', 'last_fullsized': '2024-09-13T17:53:07.918289+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:04:50.600660+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:53:13.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2024-09-13T17:53:13.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.917372+0000', 'last_change': '2024-09-13T17:53:07.917372+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.917372+0000', 'last_undegraded': '2024-09-13T17:53:07.917372+0000', 'last_fullsized': '2024-09-13T17:53:07.917372+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:22:15.795161+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:53:13.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2024-09-13T17:53:13.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.920013+0000', 'last_change': '2024-09-13T17:53:07.920013+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.920013+0000', 'last_undegraded': '2024-09-13T17:53:07.920013+0000', 'last_fullsized': '2024-09-13T17:53:07.920013+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:45:15.154333+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:53:13.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2024-09-13T17:53:13.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.922040+0000', 'last_change': '2024-09-13T17:53:07.922040+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.922040+0000', 'last_undegraded': '2024-09-13T17:53:07.922040+0000', 'last_fullsized': '2024-09-13T17:53:07.922040+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:20:00.206010+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:53:13.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2024-09-13T17:53:13.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.913515+0000', 'last_change': '2024-09-13T17:53:07.913515+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.913515+0000', 'last_undegraded': '2024-09-13T17:53:07.913515+0000', 'last_fullsized': '2024-09-13T17:53:07.913515+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:16:39.920002+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:53:13.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2024-09-13T17:53:13.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.921842+0000', 'last_change': '2024-09-13T17:53:07.921842+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.921842+0000', 'last_undegraded': '2024-09-13T17:53:07.921842+0000', 'last_fullsized': '2024-09-13T17:53:07.921842+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:34:58.339595+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:53:13.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2024-09-13T17:53:13.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.921409+0000', 'last_change': '2024-09-13T17:53:07.921409+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.921409+0000', 'last_undegraded': '2024-09-13T17:53:07.921409+0000', 'last_fullsized': '2024-09-13T17:53:07.921409+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:08:08.746286+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:53:13.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2024-09-13T17:53:13.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.920282+0000', 'last_change': '2024-09-13T17:53:07.920282+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.920282+0000', 'last_undegraded': '2024-09-13T17:53:07.920282+0000', 'last_fullsized': '2024-09-13T17:53:07.920282+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:31:02.660007+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:53:13.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2024-09-13T17:53:13.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.922001+0000', 'last_change': '2024-09-13T17:53:07.922001+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.922001+0000', 'last_undegraded': '2024-09-13T17:53:07.922001+0000', 'last_fullsized': '2024-09-13T17:53:07.922001+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:01:24.523487+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:53:13.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2024-09-13T17:53:13.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.919785+0000', 'last_change': '2024-09-13T17:53:07.919785+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.919785+0000', 'last_undegraded': '2024-09-13T17:53:07.919785+0000', 'last_fullsized': '2024-09-13T17:53:07.919785+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:01:24.523487+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:53:13.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2024-09-13T17:53:13.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.923536+0000', 'last_change': '2024-09-13T17:53:07.923536+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.923536+0000', 'last_undegraded': '2024-09-13T17:53:07.923536+0000', 'last_fullsized': '2024-09-13T17:53:07.923536+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:19:51.440182+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:53:13.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2024-09-13T17:53:13.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.919382+0000', 'last_change': '2024-09-13T17:53:07.919382+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.919382+0000', 'last_undegraded': '2024-09-13T17:53:07.919382+0000', 'last_fullsized': '2024-09-13T17:53:07.919382+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:32:16.635091+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:53:13.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2024-09-13T17:53:13.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.934811+0000', 'last_change': '2024-09-13T17:53:07.934811+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.934811+0000', 'last_undegraded': '2024-09-13T17:53:07.934811+0000', 'last_fullsized': '2024-09-13T17:53:07.934811+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:13:42.945540+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:53:13.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2024-09-13T17:53:13.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.932902+0000', 'last_change': '2024-09-13T17:53:07.932902+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.932902+0000', 'last_undegraded': '2024-09-13T17:53:07.932902+0000', 'last_fullsized': '2024-09-13T17:53:07.932902+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:36:43.484986+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:53:13.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2024-09-13T17:53:13.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.914267+0000', 'last_change': '2024-09-13T17:53:07.914267+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.914267+0000', 'last_undegraded': '2024-09-13T17:53:07.914267+0000', 'last_fullsized': '2024-09-13T17:53:07.914267+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:47:09.561563+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:53:13.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2024-09-13T17:53:13.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.916812+0000', 'last_change': '2024-09-13T17:53:07.916812+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.916812+0000', 'last_undegraded': '2024-09-13T17:53:07.916812+0000', 'last_fullsized': '2024-09-13T17:53:07.916812+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:37:46.004449+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:53:13.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2024-09-13T17:53:13.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.915214+0000', 'last_change': '2024-09-13T17:53:07.915214+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.915214+0000', 'last_undegraded': '2024-09-13T17:53:07.915214+0000', 'last_fullsized': '2024-09-13T17:53:07.915214+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:48:30.620140+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:53:13.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2024-09-13T17:53:13.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.919237+0000', 'last_change': '2024-09-13T17:53:07.919237+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.919237+0000', 'last_undegraded': '2024-09-13T17:53:07.919237+0000', 'last_fullsized': '2024-09-13T17:53:07.919237+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:19:51.440182+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:53:13.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2024-09-13T17:53:13.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.918246+0000', 'last_change': '2024-09-13T17:53:07.918246+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.918246+0000', 'last_undegraded': '2024-09-13T17:53:07.918246+0000', 'last_fullsized': '2024-09-13T17:53:07.918246+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:46:02.621171+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:53:13.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2024-09-13T17:53:13.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.932894+0000', 'last_change': '2024-09-13T17:53:07.932894+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.932894+0000', 'last_undegraded': '2024-09-13T17:53:07.932894+0000', 'last_fullsized': '2024-09-13T17:53:07.932894+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:31:02.660007+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:53:13.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2024-09-13T17:53:13.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.917294+0000', 'last_change': '2024-09-13T17:53:07.917294+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.917294+0000', 'last_undegraded': '2024-09-13T17:53:07.917294+0000', 'last_fullsized': '2024-09-13T17:53:07.917294+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:16:39.411729+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:53:13.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2024-09-13T17:53:13.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.915293+0000', 'last_change': '2024-09-13T17:53:07.915293+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.915293+0000', 'last_undegraded': '2024-09-13T17:53:07.915293+0000', 'last_fullsized': '2024-09-13T17:53:07.915293+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:47:19.636768+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:53:13.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2024-09-13T17:53:13.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.924894+0000', 'last_change': '2024-09-13T17:53:07.924894+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.924894+0000', 'last_undegraded': '2024-09-13T17:53:07.924894+0000', 'last_fullsized': '2024-09-13T17:53:07.924894+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:54:05.172827+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:53:13.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2024-09-13T17:53:13.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.914373+0000', 'last_change': '2024-09-13T17:53:07.914373+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.914373+0000', 'last_undegraded': '2024-09-13T17:53:07.914373+0000', 'last_fullsized': '2024-09-13T17:53:07.914373+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:33:05.594213+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:53:13.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2024-09-13T17:53:13.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.918522+0000', 'last_change': '2024-09-13T17:53:07.918522+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.918522+0000', 'last_undegraded': '2024-09-13T17:53:07.918522+0000', 'last_fullsized': '2024-09-13T17:53:07.918522+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:11:55.588582+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:53:13.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2024-09-13T17:53:13.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.914463+0000', 'last_change': '2024-09-13T17:53:07.914463+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.914463+0000', 'last_undegraded': '2024-09-13T17:53:07.914463+0000', 'last_fullsized': '2024-09-13T17:53:07.914463+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:43:07.544794+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:53:13.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2024-09-13T17:53:13.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.915528+0000', 'last_change': '2024-09-13T17:53:07.915528+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.915528+0000', 'last_undegraded': '2024-09-13T17:53:07.915528+0000', 'last_fullsized': '2024-09-13T17:53:07.915528+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:31:06.338741+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T17:53:13.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2024-09-13T17:53:13.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.925481+0000', 'last_change': '2024-09-13T17:53:07.925481+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.925481+0000', 'last_undegraded': '2024-09-13T17:53:07.925481+0000', 'last_fullsized': '2024-09-13T17:53:07.925481+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:45:15.154333+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:53:13.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2024-09-13T17:53:13.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.924668+0000', 'last_change': '2024-09-13T17:53:07.924668+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.924668+0000', 'last_undegraded': '2024-09-13T17:53:07.924668+0000', 'last_fullsized': '2024-09-13T17:53:07.924668+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:13:42.945540+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:53:13.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2024-09-13T17:53:13.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.924863+0000', 'last_change': '2024-09-13T17:53:07.924863+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.924863+0000', 'last_undegraded': '2024-09-13T17:53:07.924863+0000', 'last_fullsized': '2024-09-13T17:53:07.924863+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:47:05.297506+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:53:13.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2024-09-13T17:53:13.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.925979+0000', 'last_change': '2024-09-13T17:53:07.925979+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.925979+0000', 'last_undegraded': '2024-09-13T17:53:07.925979+0000', 'last_fullsized': '2024-09-13T17:53:07.925979+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:20:00.206010+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:53:13.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2024-09-13T17:53:13.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.919076+0000', 'last_change': '2024-09-13T17:53:07.919076+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.919076+0000', 'last_undegraded': '2024-09-13T17:53:07.919076+0000', 'last_fullsized': '2024-09-13T17:53:07.919076+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:34:58.339595+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:53:13.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2024-09-13T17:53:13.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.914136+0000', 'last_change': '2024-09-13T17:53:07.914136+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.914136+0000', 'last_undegraded': '2024-09-13T17:53:07.914136+0000', 'last_fullsized': '2024-09-13T17:53:07.914136+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:39:13.404809+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:53:13.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2024-09-13T17:53:13.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.921904+0000', 'last_change': '2024-09-13T17:53:07.921904+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.921904+0000', 'last_undegraded': '2024-09-13T17:53:07.921904+0000', 'last_fullsized': '2024-09-13T17:53:07.921904+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:19:51.440182+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:53:13.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2024-09-13T17:53:13.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.917742+0000', 'last_change': '2024-09-13T17:53:07.917742+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.917742+0000', 'last_undegraded': '2024-09-13T17:53:07.917742+0000', 'last_fullsized': '2024-09-13T17:53:07.917742+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:34:58.339595+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:53:13.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2024-09-13T17:53:13.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.922633+0000', 'last_change': '2024-09-13T17:53:07.922633+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.922633+0000', 'last_undegraded': '2024-09-13T17:53:07.922633+0000', 'last_fullsized': '2024-09-13T17:53:07.922633+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:36:42.232554+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:53:13.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2024-09-13T17:53:13.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.914998+0000', 'last_change': '2024-09-13T17:53:07.914998+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.914998+0000', 'last_undegraded': '2024-09-13T17:53:07.914998+0000', 'last_fullsized': '2024-09-13T17:53:07.914998+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:35:26.764647+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:53:13.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2024-09-13T17:53:13.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.916643+0000', 'last_change': '2024-09-13T17:53:07.916643+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.916643+0000', 'last_undegraded': '2024-09-13T17:53:07.916643+0000', 'last_fullsized': '2024-09-13T17:53:07.916643+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:02:24.556344+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:53:13.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2024-09-13T17:53:13.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.924440+0000', 'last_change': '2024-09-13T17:53:07.924440+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.924440+0000', 'last_undegraded': '2024-09-13T17:53:07.924440+0000', 'last_fullsized': '2024-09-13T17:53:07.924440+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:20:00.206010+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:53:13.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2024-09-13T17:53:13.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.923052+0000', 'last_change': '2024-09-13T17:53:07.923052+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.923052+0000', 'last_undegraded': '2024-09-13T17:53:07.923052+0000', 'last_fullsized': '2024-09-13T17:53:07.923052+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:36:42.232554+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:53:13.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2024-09-13T17:53:13.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.922383+0000', 'last_change': '2024-09-13T17:53:07.922383+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.922383+0000', 'last_undegraded': '2024-09-13T17:53:07.922383+0000', 'last_fullsized': '2024-09-13T17:53:07.922383+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:46:13.895602+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:53:13.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2024-09-13T17:53:13.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.921446+0000', 'last_change': '2024-09-13T17:53:07.921446+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.921446+0000', 'last_undegraded': '2024-09-13T17:53:07.921446+0000', 'last_fullsized': '2024-09-13T17:53:07.921446+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:46:02.621171+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:53:13.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2024-09-13T17:53:13.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.913474+0000', 'last_change': '2024-09-13T17:53:07.913474+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.913474+0000', 'last_undegraded': '2024-09-13T17:53:07.913474+0000', 'last_fullsized': '2024-09-13T17:53:07.913474+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:29:13.042839+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:53:13.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2024-09-13T17:53:13.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.923630+0000', 'last_change': '2024-09-13T17:53:07.923630+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.923630+0000', 'last_undegraded': '2024-09-13T17:53:07.923630+0000', 'last_fullsized': '2024-09-13T17:53:07.923630+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:05:51.219251+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:53:13.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2024-09-13T17:53:13.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.914556+0000', 'last_change': '2024-09-13T17:53:07.914556+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.914556+0000', 'last_undegraded': '2024-09-13T17:53:07.914556+0000', 'last_fullsized': '2024-09-13T17:53:07.914556+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:33:22.069383+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:53:13.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2024-09-13T17:53:13.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.913545+0000', 'last_change': '2024-09-13T17:53:07.913545+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.913545+0000', 'last_undegraded': '2024-09-13T17:53:07.913545+0000', 'last_fullsized': '2024-09-13T17:53:07.913545+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:24:12.327579+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:53:13.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2024-09-13T17:53:13.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.919760+0000', 'last_change': '2024-09-13T17:53:07.919760+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.919760+0000', 'last_undegraded': '2024-09-13T17:53:07.919760+0000', 'last_fullsized': '2024-09-13T17:53:07.919760+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:46:02.621171+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:53:13.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2024-09-13T17:53:13.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.919610+0000', 'last_change': '2024-09-13T17:53:07.919610+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.919610+0000', 'last_undegraded': '2024-09-13T17:53:07.919610+0000', 'last_fullsized': '2024-09-13T17:53:07.919610+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:58:29.844579+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:53:13.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2024-09-13T17:53:13.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.916956+0000', 'last_change': '2024-09-13T17:53:07.916956+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.916956+0000', 'last_undegraded': '2024-09-13T17:53:07.916956+0000', 'last_fullsized': '2024-09-13T17:53:07.916956+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:01:27.720519+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T17:53:13.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2024-09-13T17:53:13.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.934206+0000', 'last_change': '2024-09-13T17:53:07.934206+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.934206+0000', 'last_undegraded': '2024-09-13T17:53:07.934206+0000', 'last_fullsized': '2024-09-13T17:53:07.934206+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:32:16.635091+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:53:13.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2024-09-13T17:53:13.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.921349+0000', 'last_change': '2024-09-13T17:53:07.921349+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.921349+0000', 'last_undegraded': '2024-09-13T17:53:07.921349+0000', 'last_fullsized': '2024-09-13T17:53:07.921349+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:46:13.895602+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:53:13.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2024-09-13T17:53:13.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.919083+0000', 'last_change': '2024-09-13T17:53:07.919083+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.919083+0000', 'last_undegraded': '2024-09-13T17:53:07.919083+0000', 'last_fullsized': '2024-09-13T17:53:07.919083+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:25:41.690036+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:53:13.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2024-09-13T17:53:13.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.913575+0000', 'last_change': '2024-09-13T17:53:07.913575+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.913575+0000', 'last_undegraded': '2024-09-13T17:53:07.913575+0000', 'last_fullsized': '2024-09-13T17:53:07.913575+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:06:00.024100+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:53:13.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2024-09-13T17:53:13.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.926469+0000', 'last_change': '2024-09-13T17:53:07.926469+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.926469+0000', 'last_undegraded': '2024-09-13T17:53:07.926469+0000', 'last_fullsized': '2024-09-13T17:53:07.926469+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T17:59:48.932531+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:53:13.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2024-09-13T17:53:13.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.924008+0000', 'last_change': '2024-09-13T17:53:07.924008+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.924008+0000', 'last_undegraded': '2024-09-13T17:53:07.924008+0000', 'last_fullsized': '2024-09-13T17:53:07.924008+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:54:05.172827+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:53:13.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2024-09-13T17:53:13.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.913549+0000', 'last_change': '2024-09-13T17:53:07.913549+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.913549+0000', 'last_undegraded': '2024-09-13T17:53:07.913549+0000', 'last_fullsized': '2024-09-13T17:53:07.913549+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:18:24.057582+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T17:53:13.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2024-09-13T17:53:13.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.920940+0000', 'last_change': '2024-09-13T17:53:07.920940+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.920940+0000', 'last_undegraded': '2024-09-13T17:53:07.920940+0000', 'last_fullsized': '2024-09-13T17:53:07.920940+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:08:08.746286+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T17:53:13.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2024-09-13T17:53:13.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.920803+0000', 'last_change': '2024-09-13T17:53:07.920803+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.920803+0000', 'last_undegraded': '2024-09-13T17:53:07.920803+0000', 'last_fullsized': '2024-09-13T17:53:07.920803+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:31:02.660007+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T17:53:13.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2024-09-13T17:53:13.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.923036+0000', 'last_change': '2024-09-13T17:53:07.923036+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.923036+0000', 'last_undegraded': '2024-09-13T17:53:07.923036+0000', 'last_fullsized': '2024-09-13T17:53:07.923036+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:01:24.523487+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T17:53:13.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2024-09-13T17:53:13.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.933495+0000', 'last_change': '2024-09-13T17:53:07.933495+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.933495+0000', 'last_undegraded': '2024-09-13T17:53:07.933495+0000', 'last_fullsized': '2024-09-13T17:53:07.933495+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T17:59:48.932531+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T17:53:13.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2024-09-13T17:53:13.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-13T17:53:07.921929+0000', 'last_change': '2024-09-13T17:53:07.921929+0000', 'last_active': '2024-09-13T17:53:07.906764+0000', 'last_peered': '2024-09-13T17:53:07.906764+0000', 'last_clean': '2024-09-13T17:53:07.906764+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T17:53:07.921929+0000', 'last_undegraded': '2024-09-13T17:53:07.921929+0000', 'last_fullsized': '2024-09-13T17:53:07.921929+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'last_clean_scrub_stamp': '2024-09-13T17:53:07.906764+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T17:59:48.932531+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T17:53:13.133 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T17:53:13.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.287+0000 7f69a5200640 1 Processor -- start 2024-09-13T17:53:13.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.287+0000 7f69a5200640 1 -- start start 2024-09-13T17:53:13.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.287+0000 7f69a5200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f69a015c720 0x7f69a0098a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:13.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.287+0000 7f69a5200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f69a006eb40 0x7f69a0098fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:13.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.287+0000 7f69a5200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69a0099c80 0x7f69a0160140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:13.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.287+0000 7f69a5200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69a015db20 con 0x7f69a015c720 2024-09-13T17:53:13.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.287+0000 7f69a5200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69a015cf10 con 0x7f69a006eb40 2024-09-13T17:53:13.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.287+0000 7f69a5200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a015d1f0 con 0x7f69a0099c80 2024-09-13T17:53:13.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.287+0000 7f699de00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f69a015c720 0x7f69a0098a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:13.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.287+0000 7f699de00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f69a015c720 0x7f69a0098a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53980/0 (socket says 172.21.15.114:53980) 2024-09-13T17:53:13.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.287+0000 7f699de00640 1 -- 172.21.15.114:0/3077059818 learned_addr learned my addr 172.21.15.114:0/3077059818 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:13.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.287+0000 7f6997e00640 1 --2- 172.21.15.114:0/3077059818 >> v2:172.21.15.134:3300/0 conn(0x7f69a006eb40 0x7f69a0098fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:13.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.287+0000 7f699e800640 1 --2- 172.21.15.114:0/3077059818 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69a0099c80 0x7f69a0160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:13.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.287+0000 7f699de00640 1 -- 172.21.15.114:0/3077059818 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69a0099c80 msgr2=0x7f69a0160140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:13.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.287+0000 7f699de00640 1 --2- 172.21.15.114:0/3077059818 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69a0099c80 0x7f69a0160140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:13.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.287+0000 7f699de00640 1 -- 172.21.15.114:0/3077059818 >> v2:172.21.15.134:3300/0 conn(0x7f69a006eb40 msgr2=0x7f69a0098fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:13.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.287+0000 7f699de00640 1 --2- 172.21.15.114:0/3077059818 >> v2:172.21.15.134:3300/0 conn(0x7f69a006eb40 0x7f69a0098fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:13.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.287+0000 7f699de00640 1 -- 172.21.15.114:0/3077059818 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a015d4d0 con 0x7f69a015c720 2024-09-13T17:53:13.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.291+0000 7f699de00640 1 --2- 172.21.15.114:0/3077059818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69a015c720 0x7f69a0098a70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f69a00ccc50 tx=0x7f699001c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a63287ade8464d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:13.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.291+0000 7f699d400640 1 -- 172.21.15.114:0/3077059818 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69900a4ea0 con 0x7f69a015c720 2024-09-13T17:53:13.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.291+0000 7f699d400640 1 -- 172.21.15.114:0/3077059818 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69900a7050 con 0x7f69a015c720 2024-09-13T17:53:13.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.291+0000 7f699d400640 1 -- 172.21.15.114:0/3077059818 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a015cd10 con 0x7f69a015c720 2024-09-13T17:53:13.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.291+0000 7f69a5200640 1 -- 172.21.15.114:0/3077059818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69a015c720 msgr2=0x7f69a0098a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:13.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.291+0000 7f69a5200640 1 --2- 172.21.15.114:0/3077059818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69a015c720 0x7f69a0098a70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f69a00ccc50 tx=0x7f699001c230 comp rx=0 tx=0).stop 2024-09-13T17:53:13.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.291+0000 7f69a5200640 1 -- 172.21.15.114:0/3077059818 shutdown_connections 2024-09-13T17:53:13.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.291+0000 7f69a5200640 1 --2- 172.21.15.114:0/3077059818 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69a0099c80 0x7f69a0160140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:13.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.291+0000 7f69a5200640 1 --2- 172.21.15.114:0/3077059818 >> v2:172.21.15.134:3300/0 conn(0x7f69a006eb40 0x7f69a0098fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:13.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.291+0000 7f69a5200640 1 --2- 172.21.15.114:0/3077059818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69a015c720 0x7f69a0098a70 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:13.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.291+0000 7f69a5200640 1 -- 172.21.15.114:0/3077059818 >> 172.21.15.114:0/3077059818 conn(0x7f69a00b2080 msgr2=0x7f69a00b2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:13.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.291+0000 7f69a5200640 1 -- 172.21.15.114:0/3077059818 shutdown_connections 2024-09-13T17:53:13.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.291+0000 7f69a5200640 1 -- 172.21.15.114:0/3077059818 wait complete. 2024-09-13T17:53:13.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.295+0000 7f69a5200640 1 Processor -- start 2024-09-13T17:53:13.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.295+0000 7f69a5200640 1 -- start start 2024-09-13T17:53:13.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.295+0000 7f69a5200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69a006eb40 0x7f69a00cea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:13.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.295+0000 7f69a5200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69a0099c80 0x7f69a00cb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:13.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.295+0000 7f69a5200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69a015c720 0x7f69a00c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:13.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.295+0000 7f69a5200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a00caba0 con 0x7f69a006eb40 2024-09-13T17:53:13.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.295+0000 7f69a5200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a00c9f90 con 0x7f69a015c720 2024-09-13T17:53:13.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.295+0000 7f69a5200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a00ca270 con 0x7f69a0099c80 2024-09-13T17:53:13.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.295+0000 7f699de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69a006eb40 0x7f69a00cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:13.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.295+0000 7f699de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69a006eb40 0x7f69a00cea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53984/0 (socket says 172.21.15.114:53984) 2024-09-13T17:53:13.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.295+0000 7f699de00640 1 -- 172.21.15.114:0/277263537 learned_addr learned my addr 172.21.15.114:0/277263537 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:13.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.295+0000 7f6997e00640 1 --2- 172.21.15.114:0/277263537 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69a0099c80 0x7f69a00cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:13.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.295+0000 7f699e800640 1 --2- 172.21.15.114:0/277263537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69a015c720 0x7f69a00c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:13.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.295+0000 7f699de00640 1 -- 172.21.15.114:0/277263537 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69a0099c80 msgr2=0x7f69a00cb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:13.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.295+0000 7f699de00640 1 --2- 172.21.15.114:0/277263537 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69a0099c80 0x7f69a00cb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:13.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.295+0000 7f699de00640 1 -- 172.21.15.114:0/277263537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69a015c720 msgr2=0x7f69a00c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:13.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.295+0000 7f699de00640 1 --2- 172.21.15.114:0/277263537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69a015c720 0x7f69a00c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:13.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.295+0000 7f699de00640 1 -- 172.21.15.114:0/277263537 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69900094d0 con 0x7f69a006eb40 2024-09-13T17:53:13.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.295+0000 7f6997e00640 1 --2- 172.21.15.114:0/277263537 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69a0099c80 0x7f69a00cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:13.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.295+0000 7f699e800640 1 --2- 172.21.15.114:0/277263537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69a015c720 0x7f69a00c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:13.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.295+0000 7f699de00640 1 --2- 172.21.15.114:0/277263537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69a006eb40 0x7f69a00cea10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f69900ae040 tx=0x7f699001aa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:13.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.295+0000 7f6996000640 1 -- 172.21.15.114:0/277263537 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69900b6620 con 0x7f69a006eb40 2024-09-13T17:53:13.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.295+0000 7f6996000640 1 -- 172.21.15.114:0/277263537 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69900b67a0 con 0x7f69a006eb40 2024-09-13T17:53:13.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.295+0000 7f69a5200640 1 -- 172.21.15.114:0/277263537 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a00ca550 con 0x7f69a006eb40 2024-09-13T17:53:13.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.295+0000 7f6996000640 1 -- 172.21.15.114:0/277263537 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69900b6b50 con 0x7f69a006eb40 2024-09-13T17:53:13.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.295+0000 7f69a5200640 1 -- 172.21.15.114:0/277263537 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a00c9c80 con 0x7f69a006eb40 2024-09-13T17:53:13.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.295+0000 7f69a5200640 1 -- 172.21.15.114:0/277263537 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69a0160140 con 0x7f69a006eb40 2024-09-13T17:53:13.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.299+0000 7f6996000640 1 -- 172.21.15.114:0/277263537 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f69900b2040 con 0x7f69a006eb40 2024-09-13T17:53:13.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.299+0000 7f6996000640 1 --2- 172.21.15.114:0/277263537 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f697c066690 0x7f697c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:13.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.299+0000 7f6996000640 1 -- 172.21.15.114:0/277263537 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f699011e630 con 0x7f69a006eb40 2024-09-13T17:53:13.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.299+0000 7f6997e00640 1 --2- 172.21.15.114:0/277263537 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f697c066690 0x7f697c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:13.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.299+0000 7f6997e00640 1 --2- 172.21.15.114:0/277263537 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f697c066690 0x7f697c068b50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f69a0150210 tx=0x7f6988008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:13.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.303+0000 7f6996000640 1 -- 172.21.15.114:0/277263537 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f69900eb850 con 0x7f69a006eb40 2024-09-13T17:53:13.433 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:53:13.437 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:53:13.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.511+0000 7f69a5200640 1 -- 172.21.15.114:0/277263537 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f69a0070670 con 0x7f69a006eb40 2024-09-13T17:53:13.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.511+0000 7f6996000640 1 -- 172.21.15.114:0/277263537 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1033 (secure 0 0 0) 0x7f69900eee70 con 0x7f69a006eb40 2024-09-13T17:53:13.517 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:13.517 INFO:teuthology.orchestra.run.smithi114.stdout:{"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":108,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":39,"num_osds":8,"num_up_osds":8,"osd_up_since":1726249897,"num_in_osds":8,"osd_in_since":1726249887,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225845248,"bytes_avail":772868268032,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"d","status":"up:active","gid":5316}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-09-13T17:52:55.949729+0000","services":{}},"progress_events":{}} 2024-09-13T17:53:13.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.515+0000 7f69a5200640 1 -- 172.21.15.114:0/277263537 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f697c066690 msgr2=0x7f697c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:13.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.515+0000 7f69a5200640 1 --2- 172.21.15.114:0/277263537 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f697c066690 0x7f697c068b50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f69a0150210 tx=0x7f6988008040 comp rx=0 tx=0).stop 2024-09-13T17:53:13.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.515+0000 7f69a5200640 1 -- 172.21.15.114:0/277263537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69a006eb40 msgr2=0x7f69a00cea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:13.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.515+0000 7f69a5200640 1 --2- 172.21.15.114:0/277263537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69a006eb40 0x7f69a00cea10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f69900ae040 tx=0x7f699001aa70 comp rx=0 tx=0).stop 2024-09-13T17:53:13.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.515+0000 7f69a5200640 1 -- 172.21.15.114:0/277263537 shutdown_connections 2024-09-13T17:53:13.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.515+0000 7f69a5200640 1 --2- 172.21.15.114:0/277263537 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f697c066690 0x7f697c068b50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:13.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.515+0000 7f69a5200640 1 --2- 172.21.15.114:0/277263537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69a015c720 0x7f69a00c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:13.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.515+0000 7f69a5200640 1 --2- 172.21.15.114:0/277263537 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f69a0099c80 0x7f69a00cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:13.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.515+0000 7f69a5200640 1 --2- 172.21.15.114:0/277263537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69a006eb40 0x7f69a00cea10 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:13.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.515+0000 7f69a5200640 1 -- 172.21.15.114:0/277263537 >> 172.21.15.114:0/277263537 conn(0x7f69a00b2080 msgr2=0x7f69a01564b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:13.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.515+0000 7f69a5200640 1 -- 172.21.15.114:0/277263537 shutdown_connections 2024-09-13T17:53:13.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.515+0000 7f69a5200640 1 -- 172.21.15.114:0/277263537 wait complete. 2024-09-13T17:53:13.538 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T17:53:13.539 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:53:13.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.671+0000 7f43e6200640 1 Processor -- start 2024-09-13T17:53:13.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.671+0000 7f43e6200640 1 -- start start 2024-09-13T17:53:13.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.671+0000 7f43e6200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f43e00ce750 0x7f43e015d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:13.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.671+0000 7f43e6200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43e00b1c60 0x7f43e00b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:13.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.671+0000 7f43e6200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f43e006cd60 0x7f43e006d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:13.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.671+0000 7f43e6200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e00b25e0 con 0x7f43e00ce750 2024-09-13T17:53:13.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.671+0000 7f43e6200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e015dbb0 con 0x7f43e006cd60 2024-09-13T17:53:13.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.671+0000 7f43e6200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e0160630 con 0x7f43e00b1c60 2024-09-13T17:53:13.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.671+0000 7f43df400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f43e00ce750 0x7f43e015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:13.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.671+0000 7f43df400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f43e00ce750 0x7f43e015d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54000/0 (socket says 172.21.15.114:54000) 2024-09-13T17:53:13.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.671+0000 7f43df400640 1 -- 172.21.15.114:0/231409595 learned_addr learned my addr 172.21.15.114:0/231409595 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:13.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.671+0000 7f43dfe00640 1 --2- 172.21.15.114:0/231409595 >> v2:172.21.15.134:3300/0 conn(0x7f43e006cd60 0x7f43e006d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:13.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.671+0000 7f43dea00640 1 --2- 172.21.15.114:0/231409595 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43e00b1c60 0x7f43e00b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:13.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.671+0000 7f43df400640 1 -- 172.21.15.114:0/231409595 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43e00b1c60 msgr2=0x7f43e00b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:13.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.671+0000 7f43df400640 1 --2- 172.21.15.114:0/231409595 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43e00b1c60 0x7f43e00b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:13.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.671+0000 7f43df400640 1 -- 172.21.15.114:0/231409595 >> v2:172.21.15.134:3300/0 conn(0x7f43e006cd60 msgr2=0x7f43e006d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:13.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.671+0000 7f43df400640 1 --2- 172.21.15.114:0/231409595 >> v2:172.21.15.134:3300/0 conn(0x7f43e006cd60 0x7f43e006d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:13.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.671+0000 7f43df400640 1 -- 172.21.15.114:0/231409595 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e0160910 con 0x7f43e00ce750 2024-09-13T17:53:13.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.671+0000 7f43dfe00640 1 --2- 172.21.15.114:0/231409595 >> v2:172.21.15.134:3300/0 conn(0x7f43e006cd60 0x7f43e006d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:13.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.671+0000 7f43dea00640 1 --2- 172.21.15.114:0/231409595 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43e00b1c60 0x7f43e00b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:13.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.675+0000 7f43df400640 1 --2- 172.21.15.114:0/231409595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43e00ce750 0x7f43e015d670 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f43e00cfc90 tx=0x7f43d001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=243af9ffa6faaad1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:13.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.675+0000 7f43de000640 1 -- 172.21.15.114:0/231409595 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d00aa430 con 0x7f43e00ce750 2024-09-13T17:53:13.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.675+0000 7f43de000640 1 -- 172.21.15.114:0/231409595 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d00aa590 con 0x7f43e00ce750 2024-09-13T17:53:13.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.675+0000 7f43de000640 1 -- 172.21.15.114:0/231409595 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d00aa920 con 0x7f43e00ce750 2024-09-13T17:53:13.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.675+0000 7f43e6200640 1 -- 172.21.15.114:0/231409595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43e00ce750 msgr2=0x7f43e015d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:13.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.675+0000 7f43e6200640 1 --2- 172.21.15.114:0/231409595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43e00ce750 0x7f43e015d670 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f43e00cfc90 tx=0x7f43d001c4f0 comp rx=0 tx=0).stop 2024-09-13T17:53:13.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.675+0000 7f43e6200640 1 -- 172.21.15.114:0/231409595 shutdown_connections 2024-09-13T17:53:13.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.675+0000 7f43e6200640 1 --2- 172.21.15.114:0/231409595 >> v2:172.21.15.134:3300/0 conn(0x7f43e006cd60 0x7f43e006d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:13.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.675+0000 7f43e6200640 1 --2- 172.21.15.114:0/231409595 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43e00b1c60 0x7f43e00b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:13.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.675+0000 7f43e6200640 1 --2- 172.21.15.114:0/231409595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43e00ce750 0x7f43e015d670 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:13.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.675+0000 7f43e6200640 1 -- 172.21.15.114:0/231409595 >> 172.21.15.114:0/231409595 conn(0x7f43e00b0f60 msgr2=0x7f43e00cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:13.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.675+0000 7f43e6200640 1 -- 172.21.15.114:0/231409595 shutdown_connections 2024-09-13T17:53:13.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.675+0000 7f43e6200640 1 -- 172.21.15.114:0/231409595 wait complete. 2024-09-13T17:53:13.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.675+0000 7f43e6200640 1 Processor -- start 2024-09-13T17:53:13.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.675+0000 7f43e6200640 1 -- start start 2024-09-13T17:53:13.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.679+0000 7f43e6200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43e006cd60 0x7f43e014a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.679+0000 7f43e6200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43e00b1c60 0x7f43e01527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.679+0000 7f43e6200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43e00ce750 0x7f43e00af9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.679+0000 7f43e6200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e01531a0 con 0x7f43e00b1c60 2024-09-13T17:53:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.679+0000 7f43e6200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e014e6c0 con 0x7f43e00ce750 2024-09-13T17:53:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.679+0000 7f43e6200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e014e9a0 con 0x7f43e006cd60 2024-09-13T17:53:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.679+0000 7f43dea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43e00b1c60 0x7f43e01527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.679+0000 7f43dea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43e00b1c60 0x7f43e01527c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54012/0 (socket says 172.21.15.114:54012) 2024-09-13T17:53:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.679+0000 7f43dea00640 1 -- 172.21.15.114:0/1789695324 learned_addr learned my addr 172.21.15.114:0/1789695324 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.679+0000 7f43df400640 1 --2- 172.21.15.114:0/1789695324 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43e006cd60 0x7f43e014a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.679+0000 7f43dfe00640 1 --2- 172.21.15.114:0/1789695324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43e00ce750 0x7f43e00af9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.679+0000 7f43dea00640 1 -- 172.21.15.114:0/1789695324 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43e006cd60 msgr2=0x7f43e014a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.679+0000 7f43dea00640 1 --2- 172.21.15.114:0/1789695324 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43e006cd60 0x7f43e014a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.679+0000 7f43dea00640 1 -- 172.21.15.114:0/1789695324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43e00ce750 msgr2=0x7f43e00af9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.679+0000 7f43dea00640 1 --2- 172.21.15.114:0/1789695324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43e00ce750 0x7f43e00af9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.679+0000 7f43dea00640 1 -- 172.21.15.114:0/1789695324 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d00094d0 con 0x7f43e00b1c60 2024-09-13T17:53:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.679+0000 7f43dfe00640 1 --2- 172.21.15.114:0/1789695324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43e00ce750 0x7f43e00af9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.679+0000 7f43dea00640 1 --2- 172.21.15.114:0/1789695324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43e00b1c60 0x7f43e01527c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f43cc00d7d0 tx=0x7f43cc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.679+0000 7f43d7400640 1 -- 172.21.15.114:0/1789695324 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc0096a0 con 0x7f43e00b1c60 2024-09-13T17:53:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.679+0000 7f43d7400640 1 -- 172.21.15.114:0/1789695324 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc009800 con 0x7f43e00b1c60 2024-09-13T17:53:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.679+0000 7f43d7400640 1 -- 172.21.15.114:0/1789695324 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc009bb0 con 0x7f43e00b1c60 2024-09-13T17:53:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.679+0000 7f43e6200640 1 -- 172.21.15.114:0/1789695324 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e014ec80 con 0x7f43e00b1c60 2024-09-13T17:53:13.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.679+0000 7f43e6200640 1 -- 172.21.15.114:0/1789695324 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e014ac00 con 0x7f43e00b1c60 2024-09-13T17:53:13.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.679+0000 7f43e6200640 1 -- 172.21.15.114:0/1789695324 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e015c780 con 0x7f43e00b1c60 2024-09-13T17:53:13.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.679+0000 7f43d7400640 1 -- 172.21.15.114:0/1789695324 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f43cc009d10 con 0x7f43e00b1c60 2024-09-13T17:53:13.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.683+0000 7f43d7400640 1 --2- 172.21.15.114:0/1789695324 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f43c0066690 0x7f43c0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:13.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.683+0000 7f43d7400640 1 -- 172.21.15.114:0/1789695324 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f43cc084920 con 0x7f43e00b1c60 2024-09-13T17:53:13.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.683+0000 7f43df400640 1 --2- 172.21.15.114:0/1789695324 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f43c0066690 0x7f43c0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:13.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.683+0000 7f43df400640 1 --2- 172.21.15.114:0/1789695324 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f43c0066690 0x7f43c0068b50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f43d00ae000 tx=0x7f43d00b5040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:13.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.687+0000 7f43d7400640 1 -- 172.21.15.114:0/1789695324 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f43cc051b40 con 0x7f43e00b1c60 2024-09-13T17:53:13.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.839+0000 7f43e6200640 1 -- 172.21.15.114:0/1789695324 --> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f43e00ae700 con 0x7f43c0066690 2024-09-13T17:53:13.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.843+0000 7f43d7400640 1 -- 172.21.15.114:0/1789695324 <== mgr.4102 v2:172.21.15.114:6832/137691478 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285650 (secure 0 0 0) 0x7f43e00ae700 con 0x7f43c0066690 2024-09-13T17:53:13.852 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:13.854 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-13T17:53:13.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.847+0000 7f43e6200640 1 -- 172.21.15.114:0/1789695324 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f43c0066690 msgr2=0x7f43c0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:13.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.847+0000 7f43e6200640 1 --2- 172.21.15.114:0/1789695324 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f43c0066690 0x7f43c0068b50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f43d00ae000 tx=0x7f43d00b5040 comp rx=0 tx=0).stop 2024-09-13T17:53:13.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.847+0000 7f43e6200640 1 -- 172.21.15.114:0/1789695324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43e00b1c60 msgr2=0x7f43e01527c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:13.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.847+0000 7f43e6200640 1 --2- 172.21.15.114:0/1789695324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43e00b1c60 0x7f43e01527c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f43cc00d7d0 tx=0x7f43cc00dc90 comp rx=0 tx=0).stop 2024-09-13T17:53:13.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.847+0000 7f43e6200640 1 -- 172.21.15.114:0/1789695324 shutdown_connections 2024-09-13T17:53:13.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.847+0000 7f43e6200640 1 --2- 172.21.15.114:0/1789695324 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f43c0066690 0x7f43c0068b50 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:13.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.847+0000 7f43e6200640 1 --2- 172.21.15.114:0/1789695324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43e00ce750 0x7f43e00af9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:13.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.847+0000 7f43e6200640 1 --2- 172.21.15.114:0/1789695324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43e00b1c60 0x7f43e01527c0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:13.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.847+0000 7f43e6200640 1 --2- 172.21.15.114:0/1789695324 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f43e006cd60 0x7f43e014a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:13.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.847+0000 7f43e6200640 1 -- 172.21.15.114:0/1789695324 >> 172.21.15.114:0/1789695324 conn(0x7f43e00b0f60 msgr2=0x7f43e00adff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:13.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.847+0000 7f43e6200640 1 -- 172.21.15.114:0/1789695324 shutdown_connections 2024-09-13T17:53:13.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:13.847+0000 7f43e6200640 1 -- 172.21.15.114:0/1789695324 wait complete. 2024-09-13T17:53:13.874 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-09-13T17:53:11.952036+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220552,"kb_used_data":4392,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754168,"statfs":{"total":773094113280,"available":772868268032,"internally_reserved":0,"allocated":4497408,"data_stored":2571176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.044607"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.913592+0000","last_change":"2024-09-13T17:53:07.913592+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.913592+0000","last_undegraded":"2024-09-13T17:53:07.913592+0000","last_fullsized":"2024-09-13T17:53:07.913592+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:02.633358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.914181+0000","last_change":"2024-09-13T17:53:07.914181+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.914181+0000","last_undegraded":"2024-09-13T17:53:07.914181+0000","last_fullsized":"2024-09-13T17:53:07.914181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:11.750011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.922409+0000","last_change":"2024-09-13T17:53:07.922409+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.922409+0000","last_undegraded":"2024-09-13T17:53:07.922409+0000","last_fullsized":"2024-09-13T17:53:07.922409+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:29.844579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.918289+0000","last_change":"2024-09-13T17:53:07.918289+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.918289+0000","last_undegraded":"2024-09-13T17:53:07.918289+0000","last_fullsized":"2024-09-13T17:53:07.918289+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:04:50.600660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.917372+0000","last_change":"2024-09-13T17:53:07.917372+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.917372+0000","last_undegraded":"2024-09-13T17:53:07.917372+0000","last_fullsized":"2024-09-13T17:53:07.917372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:15.795161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.920013+0000","last_change":"2024-09-13T17:53:07.920013+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.920013+0000","last_undegraded":"2024-09-13T17:53:07.920013+0000","last_fullsized":"2024-09-13T17:53:07.920013+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:15.154333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.922040+0000","last_change":"2024-09-13T17:53:07.922040+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.922040+0000","last_undegraded":"2024-09-13T17:53:07.922040+0000","last_fullsized":"2024-09-13T17:53:07.922040+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:00.206010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.913515+0000","last_change":"2024-09-13T17:53:07.913515+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.913515+0000","last_undegraded":"2024-09-13T17:53:07.913515+0000","last_fullsized":"2024-09-13T17:53:07.913515+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:39.920002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.921842+0000","last_change":"2024-09-13T17:53:07.921842+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.921842+0000","last_undegraded":"2024-09-13T17:53:07.921842+0000","last_fullsized":"2024-09-13T17:53:07.921842+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:58.339595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.921409+0000","last_change":"2024-09-13T17:53:07.921409+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.921409+0000","last_undegraded":"2024-09-13T17:53:07.921409+0000","last_fullsized":"2024-09-13T17:53:07.921409+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:08.746286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.920282+0000","last_change":"2024-09-13T17:53:07.920282+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.920282+0000","last_undegraded":"2024-09-13T17:53:07.920282+0000","last_fullsized":"2024-09-13T17:53:07.920282+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:02.660007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.922001+0000","last_change":"2024-09-13T17:53:07.922001+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.922001+0000","last_undegraded":"2024-09-13T17:53:07.922001+0000","last_fullsized":"2024-09-13T17:53:07.922001+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:24.523487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.919785+0000","last_change":"2024-09-13T17:53:07.919785+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.919785+0000","last_undegraded":"2024-09-13T17:53:07.919785+0000","last_fullsized":"2024-09-13T17:53:07.919785+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:24.523487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.923536+0000","last_change":"2024-09-13T17:53:07.923536+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.923536+0000","last_undegraded":"2024-09-13T17:53:07.923536+0000","last_fullsized":"2024-09-13T17:53:07.923536+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:51.440182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.919382+0000","last_change":"2024-09-13T17:53:07.919382+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.919382+0000","last_undegraded":"2024-09-13T17:53:07.919382+0000","last_fullsized":"2024-09-13T17:53:07.919382+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:16.635091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.934811+0000","last_change":"2024-09-13T17:53:07.934811+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.934811+0000","last_undegraded":"2024-09-13T17:53:07.934811+0000","last_fullsized":"2024-09-13T17:53:07.934811+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:42.945540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.932902+0000","last_change":"2024-09-13T17:53:07.932902+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.932902+0000","last_undegraded":"2024-09-13T17:53:07.932902+0000","last_fullsized":"2024-09-13T17:53:07.932902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:43.484986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.914267+0000","last_change":"2024-09-13T17:53:07.914267+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.914267+0000","last_undegraded":"2024-09-13T17:53:07.914267+0000","last_fullsized":"2024-09-13T17:53:07.914267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:09.561563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.916812+0000","last_change":"2024-09-13T17:53:07.916812+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.916812+0000","last_undegraded":"2024-09-13T17:53:07.916812+0000","last_fullsized":"2024-09-13T17:53:07.916812+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:46.004449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.915214+0000","last_change":"2024-09-13T17:53:07.915214+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.915214+0000","last_undegraded":"2024-09-13T17:53:07.915214+0000","last_fullsized":"2024-09-13T17:53:07.915214+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:30.620140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.919237+0000","last_change":"2024-09-13T17:53:07.919237+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.919237+0000","last_undegraded":"2024-09-13T17:53:07.919237+0000","last_fullsized":"2024-09-13T17:53:07.919237+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:51.440182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.918246+0000","last_change":"2024-09-13T17:53:07.918246+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.918246+0000","last_undegraded":"2024-09-13T17:53:07.918246+0000","last_fullsized":"2024-09-13T17:53:07.918246+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:02.621171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.932894+0000","last_change":"2024-09-13T17:53:07.932894+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.932894+0000","last_undegraded":"2024-09-13T17:53:07.932894+0000","last_fullsized":"2024-09-13T17:53:07.932894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:02.660007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.917294+0000","last_change":"2024-09-13T17:53:07.917294+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.917294+0000","last_undegraded":"2024-09-13T17:53:07.917294+0000","last_fullsized":"2024-09-13T17:53:07.917294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:39.411729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.915293+0000","last_change":"2024-09-13T17:53:07.915293+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.915293+0000","last_undegraded":"2024-09-13T17:53:07.915293+0000","last_fullsized":"2024-09-13T17:53:07.915293+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:19.636768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.924894+0000","last_change":"2024-09-13T17:53:07.924894+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.924894+0000","last_undegraded":"2024-09-13T17:53:07.924894+0000","last_fullsized":"2024-09-13T17:53:07.924894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:05.172827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.914373+0000","last_change":"2024-09-13T17:53:07.914373+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.914373+0000","last_undegraded":"2024-09-13T17:53:07.914373+0000","last_fullsized":"2024-09-13T17:53:07.914373+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:05.594213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.918522+0000","last_change":"2024-09-13T17:53:07.918522+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.918522+0000","last_undegraded":"2024-09-13T17:53:07.918522+0000","last_fullsized":"2024-09-13T17:53:07.918522+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:55.588582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.914463+0000","last_change":"2024-09-13T17:53:07.914463+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.914463+0000","last_undegraded":"2024-09-13T17:53:07.914463+0000","last_fullsized":"2024-09-13T17:53:07.914463+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:07.544794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.915528+0000","last_change":"2024-09-13T17:53:07.915528+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.915528+0000","last_undegraded":"2024-09-13T17:53:07.915528+0000","last_fullsized":"2024-09-13T17:53:07.915528+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:06.338741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.925481+0000","last_change":"2024-09-13T17:53:07.925481+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.925481+0000","last_undegraded":"2024-09-13T17:53:07.925481+0000","last_fullsized":"2024-09-13T17:53:07.925481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:15.154333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.924668+0000","last_change":"2024-09-13T17:53:07.924668+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.924668+0000","last_undegraded":"2024-09-13T17:53:07.924668+0000","last_fullsized":"2024-09-13T17:53:07.924668+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:42.945540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.924863+0000","last_change":"2024-09-13T17:53:07.924863+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.924863+0000","last_undegraded":"2024-09-13T17:53:07.924863+0000","last_fullsized":"2024-09-13T17:53:07.924863+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:05.297506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.931791+0000","last_change":"2024-09-13T17:53:07.927772+0000","last_active":"2024-09-13T17:53:07.931791+0000","last_peered":"2024-09-13T17:53:07.931791+0000","last_clean":"2024-09-13T17:53:07.931791+0000","last_became_active":"2024-09-13T17:53:07.926833+0000","last_became_peered":"2024-09-13T17:53:07.926833+0000","last_unstale":"2024-09-13T17:53:07.931791+0000","last_undegraded":"2024-09-13T17:53:07.931791+0000","last_fullsized":"2024-09-13T17:53:07.931791+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:26.713460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.925979+0000","last_change":"2024-09-13T17:53:07.925979+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.925979+0000","last_undegraded":"2024-09-13T17:53:07.925979+0000","last_fullsized":"2024-09-13T17:53:07.925979+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:00.206010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.943737+0000","last_change":"2024-09-13T17:53:07.942858+0000","last_active":"2024-09-13T17:53:07.943737+0000","last_peered":"2024-09-13T17:53:07.943737+0000","last_clean":"2024-09-13T17:53:07.943737+0000","last_became_active":"2024-09-13T17:53:07.942331+0000","last_became_peered":"2024-09-13T17:53:07.942331+0000","last_unstale":"2024-09-13T17:53:07.943737+0000","last_undegraded":"2024-09-13T17:53:07.943737+0000","last_fullsized":"2024-09-13T17:53:07.943737+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:52.434464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.919076+0000","last_change":"2024-09-13T17:53:07.919076+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.919076+0000","last_undegraded":"2024-09-13T17:53:07.919076+0000","last_fullsized":"2024-09-13T17:53:07.919076+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:58.339595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.945322+0000","last_change":"2024-09-13T17:53:07.942677+0000","last_active":"2024-09-13T17:53:07.945322+0000","last_peered":"2024-09-13T17:53:07.945322+0000","last_clean":"2024-09-13T17:53:07.945322+0000","last_became_active":"2024-09-13T17:53:07.942426+0000","last_became_peered":"2024-09-13T17:53:07.942426+0000","last_unstale":"2024-09-13T17:53:07.945322+0000","last_undegraded":"2024-09-13T17:53:07.945322+0000","last_fullsized":"2024-09-13T17:53:07.945322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:08.554504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.914136+0000","last_change":"2024-09-13T17:53:07.914136+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.914136+0000","last_undegraded":"2024-09-13T17:53:07.914136+0000","last_fullsized":"2024-09-13T17:53:07.914136+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:13.404809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.932523+0000","last_change":"2024-09-13T17:53:07.931288+0000","last_active":"2024-09-13T17:53:07.932523+0000","last_peered":"2024-09-13T17:53:07.932523+0000","last_clean":"2024-09-13T17:53:07.932523+0000","last_became_active":"2024-09-13T17:53:07.929489+0000","last_became_peered":"2024-09-13T17:53:07.929489+0000","last_unstale":"2024-09-13T17:53:07.932523+0000","last_undegraded":"2024-09-13T17:53:07.932523+0000","last_fullsized":"2024-09-13T17:53:07.932523+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:42.477927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.921904+0000","last_change":"2024-09-13T17:53:07.921904+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.921904+0000","last_undegraded":"2024-09-13T17:53:07.921904+0000","last_fullsized":"2024-09-13T17:53:07.921904+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:51.440182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.934706+0000","last_change":"2024-09-13T17:53:07.930059+0000","last_active":"2024-09-13T17:53:07.934706+0000","last_peered":"2024-09-13T17:53:07.934706+0000","last_clean":"2024-09-13T17:53:07.934706+0000","last_became_active":"2024-09-13T17:53:07.929603+0000","last_became_peered":"2024-09-13T17:53:07.929603+0000","last_unstale":"2024-09-13T17:53:07.934706+0000","last_undegraded":"2024-09-13T17:53:07.934706+0000","last_fullsized":"2024-09-13T17:53:07.934706+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:18.629709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.917742+0000","last_change":"2024-09-13T17:53:07.917742+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.917742+0000","last_undegraded":"2024-09-13T17:53:07.917742+0000","last_fullsized":"2024-09-13T17:53:07.917742+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:58.339595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.945225+0000","last_change":"2024-09-13T17:53:07.943158+0000","last_active":"2024-09-13T17:53:07.945225+0000","last_peered":"2024-09-13T17:53:07.945225+0000","last_clean":"2024-09-13T17:53:07.945225+0000","last_became_active":"2024-09-13T17:53:07.942861+0000","last_became_peered":"2024-09-13T17:53:07.942861+0000","last_unstale":"2024-09-13T17:53:07.945225+0000","last_undegraded":"2024-09-13T17:53:07.945225+0000","last_fullsized":"2024-09-13T17:53:07.945225+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:38.404670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.922633+0000","last_change":"2024-09-13T17:53:07.922633+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.922633+0000","last_undegraded":"2024-09-13T17:53:07.922633+0000","last_fullsized":"2024-09-13T17:53:07.922633+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:42.232554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.941716+0000","last_change":"2024-09-13T17:53:07.940289+0000","last_active":"2024-09-13T17:53:07.941716+0000","last_peered":"2024-09-13T17:53:07.941716+0000","last_clean":"2024-09-13T17:53:07.941716+0000","last_became_active":"2024-09-13T17:53:07.940047+0000","last_became_peered":"2024-09-13T17:53:07.940047+0000","last_unstale":"2024-09-13T17:53:07.941716+0000","last_undegraded":"2024-09-13T17:53:07.941716+0000","last_fullsized":"2024-09-13T17:53:07.941716+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:29.613081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.914998+0000","last_change":"2024-09-13T17:53:07.914998+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.914998+0000","last_undegraded":"2024-09-13T17:53:07.914998+0000","last_fullsized":"2024-09-13T17:53:07.914998+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:26.764647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.931749+0000","last_change":"2024-09-13T17:53:07.930024+0000","last_active":"2024-09-13T17:53:07.931749+0000","last_peered":"2024-09-13T17:53:07.931749+0000","last_clean":"2024-09-13T17:53:07.931749+0000","last_became_active":"2024-09-13T17:53:07.927170+0000","last_became_peered":"2024-09-13T17:53:07.927170+0000","last_unstale":"2024-09-13T17:53:07.931749+0000","last_undegraded":"2024-09-13T17:53:07.931749+0000","last_fullsized":"2024-09-13T17:53:07.931749+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:15.690853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.916643+0000","last_change":"2024-09-13T17:53:07.916643+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.916643+0000","last_undegraded":"2024-09-13T17:53:07.916643+0000","last_fullsized":"2024-09-13T17:53:07.916643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:24.556344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.935831+0000","last_change":"2024-09-13T17:53:07.933052+0000","last_active":"2024-09-13T17:53:07.935831+0000","last_peered":"2024-09-13T17:53:07.935831+0000","last_clean":"2024-09-13T17:53:07.935831+0000","last_became_active":"2024-09-13T17:53:07.932754+0000","last_became_peered":"2024-09-13T17:53:07.932754+0000","last_unstale":"2024-09-13T17:53:07.935831+0000","last_undegraded":"2024-09-13T17:53:07.935831+0000","last_fullsized":"2024-09-13T17:53:07.935831+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:01.652948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.924440+0000","last_change":"2024-09-13T17:53:07.924440+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.924440+0000","last_undegraded":"2024-09-13T17:53:07.924440+0000","last_fullsized":"2024-09-13T17:53:07.924440+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:00.206010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.935213+0000","last_change":"2024-09-13T17:53:07.933774+0000","last_active":"2024-09-13T17:53:07.935213+0000","last_peered":"2024-09-13T17:53:07.935213+0000","last_clean":"2024-09-13T17:53:07.935213+0000","last_became_active":"2024-09-13T17:53:07.933487+0000","last_became_peered":"2024-09-13T17:53:07.933487+0000","last_unstale":"2024-09-13T17:53:07.935213+0000","last_undegraded":"2024-09-13T17:53:07.935213+0000","last_fullsized":"2024-09-13T17:53:07.935213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:48.805157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.923052+0000","last_change":"2024-09-13T17:53:07.923052+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.923052+0000","last_undegraded":"2024-09-13T17:53:07.923052+0000","last_fullsized":"2024-09-13T17:53:07.923052+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:42.232554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.943462+0000","last_change":"2024-09-13T17:53:07.939168+0000","last_active":"2024-09-13T17:53:07.943462+0000","last_peered":"2024-09-13T17:53:07.943462+0000","last_clean":"2024-09-13T17:53:07.943462+0000","last_became_active":"2024-09-13T17:53:07.938879+0000","last_became_peered":"2024-09-13T17:53:07.938879+0000","last_unstale":"2024-09-13T17:53:07.943462+0000","last_undegraded":"2024-09-13T17:53:07.943462+0000","last_fullsized":"2024-09-13T17:53:07.943462+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:04.587154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.922383+0000","last_change":"2024-09-13T17:53:07.922383+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.922383+0000","last_undegraded":"2024-09-13T17:53:07.922383+0000","last_fullsized":"2024-09-13T17:53:07.922383+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:13.895602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.943376+0000","last_change":"2024-09-13T17:53:07.940964+0000","last_active":"2024-09-13T17:53:07.943376+0000","last_peered":"2024-09-13T17:53:07.943376+0000","last_clean":"2024-09-13T17:53:07.943376+0000","last_became_active":"2024-09-13T17:53:07.940717+0000","last_became_peered":"2024-09-13T17:53:07.940717+0000","last_unstale":"2024-09-13T17:53:07.943376+0000","last_undegraded":"2024-09-13T17:53:07.943376+0000","last_fullsized":"2024-09-13T17:53:07.943376+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:50.212192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.921446+0000","last_change":"2024-09-13T17:53:07.921446+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.921446+0000","last_undegraded":"2024-09-13T17:53:07.921446+0000","last_fullsized":"2024-09-13T17:53:07.921446+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:02.621171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.933384+0000","last_change":"2024-09-13T17:53:07.929999+0000","last_active":"2024-09-13T17:53:07.933384+0000","last_peered":"2024-09-13T17:53:07.933384+0000","last_clean":"2024-09-13T17:53:07.933384+0000","last_became_active":"2024-09-13T17:53:07.929747+0000","last_became_peered":"2024-09-13T17:53:07.929747+0000","last_unstale":"2024-09-13T17:53:07.933384+0000","last_undegraded":"2024-09-13T17:53:07.933384+0000","last_fullsized":"2024-09-13T17:53:07.933384+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:04.165768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.913474+0000","last_change":"2024-09-13T17:53:07.913474+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.913474+0000","last_undegraded":"2024-09-13T17:53:07.913474+0000","last_fullsized":"2024-09-13T17:53:07.913474+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:13.042839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.943645+0000","last_change":"2024-09-13T17:53:07.941959+0000","last_active":"2024-09-13T17:53:07.943645+0000","last_peered":"2024-09-13T17:53:07.943645+0000","last_clean":"2024-09-13T17:53:07.943645+0000","last_became_active":"2024-09-13T17:53:07.941576+0000","last_became_peered":"2024-09-13T17:53:07.941576+0000","last_unstale":"2024-09-13T17:53:07.943645+0000","last_undegraded":"2024-09-13T17:53:07.943645+0000","last_fullsized":"2024-09-13T17:53:07.943645+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:04.911527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.923630+0000","last_change":"2024-09-13T17:53:07.923630+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.923630+0000","last_undegraded":"2024-09-13T17:53:07.923630+0000","last_fullsized":"2024-09-13T17:53:07.923630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:51.219251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.931545+0000","last_change":"2024-09-13T17:53:07.927302+0000","last_active":"2024-09-13T17:53:07.931545+0000","last_peered":"2024-09-13T17:53:07.931545+0000","last_clean":"2024-09-13T17:53:07.931545+0000","last_became_active":"2024-09-13T17:53:07.927010+0000","last_became_peered":"2024-09-13T17:53:07.927010+0000","last_unstale":"2024-09-13T17:53:07.931545+0000","last_undegraded":"2024-09-13T17:53:07.931545+0000","last_fullsized":"2024-09-13T17:53:07.931545+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:58:48.383731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.914556+0000","last_change":"2024-09-13T17:53:07.914556+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.914556+0000","last_undegraded":"2024-09-13T17:53:07.914556+0000","last_fullsized":"2024-09-13T17:53:07.914556+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:22.069383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.944634+0000","last_change":"2024-09-13T17:53:07.941904+0000","last_active":"2024-09-13T17:53:07.944634+0000","last_peered":"2024-09-13T17:53:07.944634+0000","last_clean":"2024-09-13T17:53:07.944634+0000","last_became_active":"2024-09-13T17:53:07.940899+0000","last_became_peered":"2024-09-13T17:53:07.940899+0000","last_unstale":"2024-09-13T17:53:07.944634+0000","last_undegraded":"2024-09-13T17:53:07.944634+0000","last_fullsized":"2024-09-13T17:53:07.944634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:29.355126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.913545+0000","last_change":"2024-09-13T17:53:07.913545+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.913545+0000","last_undegraded":"2024-09-13T17:53:07.913545+0000","last_fullsized":"2024-09-13T17:53:07.913545+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:12.327579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.938893+0000","last_change":"2024-09-13T17:53:07.935326+0000","last_active":"2024-09-13T17:53:07.938893+0000","last_peered":"2024-09-13T17:53:07.938893+0000","last_clean":"2024-09-13T17:53:07.938893+0000","last_became_active":"2024-09-13T17:53:07.934994+0000","last_became_peered":"2024-09-13T17:53:07.934994+0000","last_unstale":"2024-09-13T17:53:07.938893+0000","last_undegraded":"2024-09-13T17:53:07.938893+0000","last_fullsized":"2024-09-13T17:53:07.938893+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:05.331682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.919760+0000","last_change":"2024-09-13T17:53:07.919760+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.919760+0000","last_undegraded":"2024-09-13T17:53:07.919760+0000","last_fullsized":"2024-09-13T17:53:07.919760+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:02.621171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.939039+0000","last_change":"2024-09-13T17:53:07.937200+0000","last_active":"2024-09-13T17:53:07.939039+0000","last_peered":"2024-09-13T17:53:07.939039+0000","last_clean":"2024-09-13T17:53:07.939039+0000","last_became_active":"2024-09-13T17:53:07.936933+0000","last_became_peered":"2024-09-13T17:53:07.936933+0000","last_unstale":"2024-09-13T17:53:07.939039+0000","last_undegraded":"2024-09-13T17:53:07.939039+0000","last_fullsized":"2024-09-13T17:53:07.939039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:41.938481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.919610+0000","last_change":"2024-09-13T17:53:07.919610+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.919610+0000","last_undegraded":"2024-09-13T17:53:07.919610+0000","last_fullsized":"2024-09-13T17:53:07.919610+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:29.844579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.941365+0000","last_change":"2024-09-13T17:53:07.940232+0000","last_active":"2024-09-13T17:53:07.941365+0000","last_peered":"2024-09-13T17:53:07.941365+0000","last_clean":"2024-09-13T17:53:07.941365+0000","last_became_active":"2024-09-13T17:53:07.939995+0000","last_became_peered":"2024-09-13T17:53:07.939995+0000","last_unstale":"2024-09-13T17:53:07.941365+0000","last_undegraded":"2024-09-13T17:53:07.941365+0000","last_fullsized":"2024-09-13T17:53:07.941365+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:30:28.756119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.916956+0000","last_change":"2024-09-13T17:53:07.916956+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.916956+0000","last_undegraded":"2024-09-13T17:53:07.916956+0000","last_fullsized":"2024-09-13T17:53:07.916956+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:27.720519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.938354+0000","last_change":"2024-09-13T17:53:07.935565+0000","last_active":"2024-09-13T17:53:07.938354+0000","last_peered":"2024-09-13T17:53:07.938354+0000","last_clean":"2024-09-13T17:53:07.938354+0000","last_became_active":"2024-09-13T17:53:07.935314+0000","last_became_peered":"2024-09-13T17:53:07.935314+0000","last_unstale":"2024-09-13T17:53:07.938354+0000","last_undegraded":"2024-09-13T17:53:07.938354+0000","last_fullsized":"2024-09-13T17:53:07.938354+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:18.629709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.934206+0000","last_change":"2024-09-13T17:53:07.934206+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.934206+0000","last_undegraded":"2024-09-13T17:53:07.934206+0000","last_fullsized":"2024-09-13T17:53:07.934206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:16.635091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.931778+0000","last_change":"2024-09-13T17:53:07.930426+0000","last_active":"2024-09-13T17:53:07.931778+0000","last_peered":"2024-09-13T17:53:07.931778+0000","last_clean":"2024-09-13T17:53:07.931778+0000","last_became_active":"2024-09-13T17:53:07.929700+0000","last_became_peered":"2024-09-13T17:53:07.929700+0000","last_unstale":"2024-09-13T17:53:07.931778+0000","last_undegraded":"2024-09-13T17:53:07.931778+0000","last_fullsized":"2024-09-13T17:53:07.931778+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:14.633970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.921349+0000","last_change":"2024-09-13T17:53:07.921349+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.921349+0000","last_undegraded":"2024-09-13T17:53:07.921349+0000","last_fullsized":"2024-09-13T17:53:07.921349+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:13.895602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.931395+0000","last_change":"2024-09-13T17:53:07.928071+0000","last_active":"2024-09-13T17:53:07.931395+0000","last_peered":"2024-09-13T17:53:07.931395+0000","last_clean":"2024-09-13T17:53:07.931395+0000","last_became_active":"2024-09-13T17:53:07.927826+0000","last_became_peered":"2024-09-13T17:53:07.927826+0000","last_unstale":"2024-09-13T17:53:07.931395+0000","last_undegraded":"2024-09-13T17:53:07.931395+0000","last_fullsized":"2024-09-13T17:53:07.931395+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:57.190801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.919083+0000","last_change":"2024-09-13T17:53:07.919083+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.919083+0000","last_undegraded":"2024-09-13T17:53:07.919083+0000","last_fullsized":"2024-09-13T17:53:07.919083+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:41.690036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.945642+0000","last_change":"2024-09-13T17:53:07.944383+0000","last_active":"2024-09-13T17:53:07.945642+0000","last_peered":"2024-09-13T17:53:07.945642+0000","last_clean":"2024-09-13T17:53:07.945642+0000","last_became_active":"2024-09-13T17:53:07.944063+0000","last_became_peered":"2024-09-13T17:53:07.944063+0000","last_unstale":"2024-09-13T17:53:07.945642+0000","last_undegraded":"2024-09-13T17:53:07.945642+0000","last_fullsized":"2024-09-13T17:53:07.945642+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:46.511108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.913575+0000","last_change":"2024-09-13T17:53:07.913575+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.913575+0000","last_undegraded":"2024-09-13T17:53:07.913575+0000","last_fullsized":"2024-09-13T17:53:07.913575+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:00.024100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.927652+0000","last_change":"2024-09-13T17:53:07.924570+0000","last_active":"2024-09-13T17:53:07.927652+0000","last_peered":"2024-09-13T17:53:07.927652+0000","last_clean":"2024-09-13T17:53:07.927652+0000","last_became_active":"2024-09-13T17:53:07.924332+0000","last_became_peered":"2024-09-13T17:53:07.924332+0000","last_unstale":"2024-09-13T17:53:07.927652+0000","last_undegraded":"2024-09-13T17:53:07.927652+0000","last_fullsized":"2024-09-13T17:53:07.927652+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:54.256684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.926469+0000","last_change":"2024-09-13T17:53:07.926469+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.926469+0000","last_undegraded":"2024-09-13T17:53:07.926469+0000","last_fullsized":"2024-09-13T17:53:07.926469+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:48.932531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.943010+0000","last_change":"2024-09-13T17:53:07.939026+0000","last_active":"2024-09-13T17:53:07.943010+0000","last_peered":"2024-09-13T17:53:07.943010+0000","last_clean":"2024-09-13T17:53:07.943010+0000","last_became_active":"2024-09-13T17:53:07.938709+0000","last_became_peered":"2024-09-13T17:53:07.938709+0000","last_unstale":"2024-09-13T17:53:07.943010+0000","last_undegraded":"2024-09-13T17:53:07.943010+0000","last_fullsized":"2024-09-13T17:53:07.943010+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:08.554504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.924008+0000","last_change":"2024-09-13T17:53:07.924008+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.924008+0000","last_undegraded":"2024-09-13T17:53:07.924008+0000","last_fullsized":"2024-09-13T17:53:07.924008+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:05.172827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.940487+0000","last_change":"2024-09-13T17:53:07.939210+0000","last_active":"2024-09-13T17:53:07.940487+0000","last_peered":"2024-09-13T17:53:07.940487+0000","last_clean":"2024-09-13T17:53:07.940487+0000","last_became_active":"2024-09-13T17:53:07.938689+0000","last_became_peered":"2024-09-13T17:53:07.938689+0000","last_unstale":"2024-09-13T17:53:07.940487+0000","last_undegraded":"2024-09-13T17:53:07.940487+0000","last_fullsized":"2024-09-13T17:53:07.940487+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:30.156095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.913549+0000","last_change":"2024-09-13T17:53:07.913549+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.913549+0000","last_undegraded":"2024-09-13T17:53:07.913549+0000","last_fullsized":"2024-09-13T17:53:07.913549+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:24.057582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.936014+0000","last_change":"2024-09-13T17:53:07.933119+0000","last_active":"2024-09-13T17:53:07.936014+0000","last_peered":"2024-09-13T17:53:07.936014+0000","last_clean":"2024-09-13T17:53:07.936014+0000","last_became_active":"2024-09-13T17:53:07.932786+0000","last_became_peered":"2024-09-13T17:53:07.932786+0000","last_unstale":"2024-09-13T17:53:07.936014+0000","last_undegraded":"2024-09-13T17:53:07.936014+0000","last_fullsized":"2024-09-13T17:53:07.936014+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:54.581523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.920940+0000","last_change":"2024-09-13T17:53:07.920940+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.920940+0000","last_undegraded":"2024-09-13T17:53:07.920940+0000","last_fullsized":"2024-09-13T17:53:07.920940+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:08.746286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.932047+0000","last_change":"2024-09-13T17:53:07.929110+0000","last_active":"2024-09-13T17:53:07.932047+0000","last_peered":"2024-09-13T17:53:07.932047+0000","last_clean":"2024-09-13T17:53:07.932047+0000","last_became_active":"2024-09-13T17:53:07.928830+0000","last_became_peered":"2024-09-13T17:53:07.928830+0000","last_unstale":"2024-09-13T17:53:07.932047+0000","last_undegraded":"2024-09-13T17:53:07.932047+0000","last_fullsized":"2024-09-13T17:53:07.932047+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:42.477927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.920803+0000","last_change":"2024-09-13T17:53:07.920803+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.920803+0000","last_undegraded":"2024-09-13T17:53:07.920803+0000","last_fullsized":"2024-09-13T17:53:07.920803+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:02.660007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.933680+0000","last_change":"2024-09-13T17:53:07.928968+0000","last_active":"2024-09-13T17:53:07.933680+0000","last_peered":"2024-09-13T17:53:07.933680+0000","last_clean":"2024-09-13T17:53:07.933680+0000","last_became_active":"2024-09-13T17:53:07.928753+0000","last_became_peered":"2024-09-13T17:53:07.928753+0000","last_unstale":"2024-09-13T17:53:07.933680+0000","last_undegraded":"2024-09-13T17:53:07.933680+0000","last_fullsized":"2024-09-13T17:53:07.933680+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:14.788101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.923036+0000","last_change":"2024-09-13T17:53:07.923036+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.923036+0000","last_undegraded":"2024-09-13T17:53:07.923036+0000","last_fullsized":"2024-09-13T17:53:07.923036+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:24.523487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.927850+0000","last_change":"2024-09-13T17:53:07.923741+0000","last_active":"2024-09-13T17:53:07.927850+0000","last_peered":"2024-09-13T17:53:07.927850+0000","last_clean":"2024-09-13T17:53:07.927850+0000","last_became_active":"2024-09-13T17:53:07.922391+0000","last_became_peered":"2024-09-13T17:53:07.922391+0000","last_unstale":"2024-09-13T17:53:07.927850+0000","last_undegraded":"2024-09-13T17:53:07.927850+0000","last_fullsized":"2024-09-13T17:53:07.927850+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:54.581523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.933495+0000","last_change":"2024-09-13T17:53:07.933495+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.933495+0000","last_undegraded":"2024-09-13T17:53:07.933495+0000","last_fullsized":"2024-09-13T17:53:07.933495+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:48.932531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.932247+0000","last_change":"2024-09-13T17:53:07.928173+0000","last_active":"2024-09-13T17:53:07.932247+0000","last_peered":"2024-09-13T17:53:07.932247+0000","last_clean":"2024-09-13T17:53:07.932247+0000","last_became_active":"2024-09-13T17:53:07.927902+0000","last_became_peered":"2024-09-13T17:53:07.927902+0000","last_unstale":"2024-09-13T17:53:07.932247+0000","last_undegraded":"2024-09-13T17:53:07.932247+0000","last_fullsized":"2024-09-13T17:53:07.932247+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:14.147274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-13T17:53:07.921929+0000","last_change":"2024-09-13T17:53:07.921929+0000","last_active":"2024-09-13T17:53:07.906764+0000","last_peered":"2024-09-13T17:53:07.906764+0000","last_clean":"2024-09-13T17:53:07.906764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T17:53:07.921929+0000","last_undegraded":"2024-09-13T17:53:07.921929+0000","last_fullsized":"2024-09-13T17:53:07.921929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:48.932531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T17:53:07.945260+0000","last_change":"2024-09-13T17:53:07.943953+0000","last_active":"2024-09-13T17:53:07.945260+0000","last_peered":"2024-09-13T17:53:07.945260+0000","last_clean":"2024-09-13T17:53:07.945260+0000","last_became_active":"2024-09-13T17:53:07.943699+0000","last_became_peered":"2024-09-13T17:53:07.943699+0000","last_unstale":"2024-09-13T17:53:07.945260+0000","last_undegraded":"2024-09-13T17:53:07.945260+0000","last_fullsized":"2024-09-13T17:53:07.945260+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:44.997390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T17:53:06.912481+0000","last_change":"2024-09-13T17:51:40.205691+0000","last_active":"2024-09-13T17:53:06.912481+0000","last_peered":"2024-09-13T17:53:06.912481+0000","last_clean":"2024-09-13T17:53:06.912481+0000","last_became_active":"2024-09-13T17:51:40.204577+0000","last_became_peered":"2024-09-13T17:51:40.204577+0000","last_unstale":"2024-09-13T17:53:06.912481+0000","last_undegraded":"2024-09-13T17:53:06.912481+0000","last_fullsized":"2024-09-13T17:53:06.912481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_clean_scrub_stamp":"2024-09-13T17:51:38.340495+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:37.899275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":764173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.68400000000000005}]},{"osd":1,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.73999999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.75600000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.81299999999999994}]},{"osd":4,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.52200000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.63500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.63500000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.66500000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.82699999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.76000000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.90300000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.94899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.65700000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.62},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.53900000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.0910000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.63600000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.55500000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.71499999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.74299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.59099999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.624},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.78000000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.72699999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.61699999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.85299999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.65300000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.745},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.91200000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":4.2460000000000004,"5min":4.2460000000000004,"15min":4.2460000000000004},"last":0.434}]},{"osd":1,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.008,"5min":5.008,"15min":5.008},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.38100000000000001}]},{"osd":2,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":4.8570000000000002,"5min":4.8570000000000002,"15min":4.8570000000000002},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":4.8399999999999999,"5min":4.8399999999999999,"15min":4.8399999999999999},"last":0.41599999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":4.4450000000000003,"5min":4.4450000000000003,"15min":4.4450000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":4.9000000000000004,"5min":4.9000000000000004,"15min":4.9000000000000004},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.624},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":0.59099999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":4.9710000000000001,"5min":4.9710000000000001,"15min":4.9710000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.755}]},{"osd":7,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":4.4029999999999996,"5min":4.4029999999999996,"15min":4.4029999999999996},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":4.9349999999999996,"5min":4.9349999999999996,"15min":4.9349999999999996},"last":0.69599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":5.5010000000000003,"5min":5.5010000000000003,"15min":5.5010000000000003},"last":0.311},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":4.3689999999999998,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.54500000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":5.3799999999999999,"5min":5.3799999999999999,"15min":5.3799999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":4.2329999999999997,"5min":4.2329999999999997,"15min":4.2329999999999997},"last":0.442}]},{"osd":3,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":5.032,"5min":5.032,"15min":5.032},"last":0.33100000000000002},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":5.4189999999999996,"5min":5.4189999999999996,"15min":5.4189999999999996},"last":0.47699999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":5.4480000000000004,"5min":5.4480000000000004,"15min":5.4480000000000004},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":4.7460000000000004,"5min":4.7460000000000004,"15min":4.7460000000000004},"last":0.84299999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":4.4710000000000001,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":5.4749999999999996,"5min":5.4749999999999996,"15min":5.4749999999999996},"last":0.76200000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":4.7789999999999999,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":4.9859999999999998,"5min":4.9859999999999998,"15min":4.9859999999999998},"last":0.85599999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":4.8200000000000003,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":4.8879999999999999,"5min":4.8879999999999999,"15min":4.8879999999999999},"last":0.89700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":173805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.35599999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.40999999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.373}]},{"osd":4,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.73599999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.77200000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.746}]},{"osd":7,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.75700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":764173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.41599999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.44},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.502},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.51700000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.0350000000000001,"5min":3.0350000000000001,"15min":3.0350000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":0.68300000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.9119999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.754},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.75,"5min":2.75,"15min":2.75},"last":0.76700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:53:16.880 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:53:17.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.023+0000 7ff6ca400640 1 Processor -- start 2024-09-13T17:53:17.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.023+0000 7ff6ca400640 1 -- start start 2024-09-13T17:53:17.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.023+0000 7ff6ca400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff6c413c240 0x7ff6c413f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:17.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.023+0000 7ff6ca400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6c413c980 0x7ff6c406d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:17.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.023+0000 7ff6ca400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff6c406da90 0x7ff6c40cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:17.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.023+0000 7ff6ca400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c40cd220 con 0x7ff6c413c240 2024-09-13T17:53:17.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.023+0000 7ff6ca400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c413f960 con 0x7ff6c406da90 2024-09-13T17:53:17.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.023+0000 7ff6ca400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c406ded0 con 0x7ff6c413c980 2024-09-13T17:53:17.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.023+0000 7ff6c3400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff6c413c240 0x7ff6c413f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:17.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.023+0000 7ff6c3400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff6c413c240 0x7ff6c413f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54026/0 (socket says 172.21.15.114:54026) 2024-09-13T17:53:17.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.023+0000 7ff6c3400640 1 -- 172.21.15.114:0/1442244240 learned_addr learned my addr 172.21.15.114:0/1442244240 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:17.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.023+0000 7ff6c2a00640 1 --2- 172.21.15.114:0/1442244240 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6c413c980 0x7ff6c406d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:17.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.023+0000 7ff6c3e00640 1 --2- 172.21.15.114:0/1442244240 >> v2:172.21.15.134:3300/0 conn(0x7ff6c406da90 0x7ff6c40cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:17.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.023+0000 7ff6c3400640 1 -- 172.21.15.114:0/1442244240 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6c413c980 msgr2=0x7ff6c406d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:17.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.023+0000 7ff6c3400640 1 --2- 172.21.15.114:0/1442244240 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6c413c980 0x7ff6c406d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:17.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.023+0000 7ff6c3400640 1 -- 172.21.15.114:0/1442244240 >> v2:172.21.15.134:3300/0 conn(0x7ff6c406da90 msgr2=0x7ff6c40cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:17.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.023+0000 7ff6c3400640 1 --2- 172.21.15.114:0/1442244240 >> v2:172.21.15.134:3300/0 conn(0x7ff6c406da90 0x7ff6c40cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:17.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.023+0000 7ff6c3400640 1 -- 172.21.15.114:0/1442244240 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c415a740 con 0x7ff6c413c240 2024-09-13T17:53:17.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.023+0000 7ff6c3e00640 1 --2- 172.21.15.114:0/1442244240 >> v2:172.21.15.134:3300/0 conn(0x7ff6c406da90 0x7ff6c40cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:17.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.027+0000 7ff6c3400640 1 --2- 172.21.15.114:0/1442244240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6c413c240 0x7ff6c413f420 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4157350 tx=0x7ff6b401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4620044c2775707f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:17.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.027+0000 7ff6c2000640 1 -- 172.21.15.114:0/1442244240 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b40a5840 con 0x7ff6c413c240 2024-09-13T17:53:17.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.027+0000 7ff6c2000640 1 -- 172.21.15.114:0/1442244240 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b40a59a0 con 0x7ff6c413c240 2024-09-13T17:53:17.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.027+0000 7ff6c2000640 1 -- 172.21.15.114:0/1442244240 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b40a5d30 con 0x7ff6c413c240 2024-09-13T17:53:17.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.027+0000 7ff6ca400640 1 -- 172.21.15.114:0/1442244240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6c413c240 msgr2=0x7ff6c413f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:17.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.027+0000 7ff6ca400640 1 --2- 172.21.15.114:0/1442244240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6c413c240 0x7ff6c413f420 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4157350 tx=0x7ff6b401c9c0 comp rx=0 tx=0).stop 2024-09-13T17:53:17.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.027+0000 7ff6ca400640 1 -- 172.21.15.114:0/1442244240 shutdown_connections 2024-09-13T17:53:17.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.027+0000 7ff6ca400640 1 --2- 172.21.15.114:0/1442244240 >> v2:172.21.15.134:3300/0 conn(0x7ff6c406da90 0x7ff6c40cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:17.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.027+0000 7ff6ca400640 1 --2- 172.21.15.114:0/1442244240 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6c413c980 0x7ff6c406d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:17.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.027+0000 7ff6ca400640 1 --2- 172.21.15.114:0/1442244240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6c413c240 0x7ff6c413f420 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:17.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.027+0000 7ff6ca400640 1 -- 172.21.15.114:0/1442244240 >> 172.21.15.114:0/1442244240 conn(0x7ff6c40660b0 msgr2=0x7ff6c4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:17.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.027+0000 7ff6ca400640 1 -- 172.21.15.114:0/1442244240 shutdown_connections 2024-09-13T17:53:17.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.027+0000 7ff6ca400640 1 -- 172.21.15.114:0/1442244240 wait complete. 2024-09-13T17:53:17.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.031+0000 7ff6ca400640 1 Processor -- start 2024-09-13T17:53:17.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.031+0000 7ff6ca400640 1 -- start start 2024-09-13T17:53:17.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.031+0000 7ff6ca400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6c406da90 0x7ff6c40a74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:17.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.031+0000 7ff6ca400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6c413c240 0x7ff6c4153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:17.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.031+0000 7ff6ca400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6c413c980 0x7ff6c406c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:17.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.031+0000 7ff6ca400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c4154780 con 0x7ff6c413c240 2024-09-13T17:53:17.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.031+0000 7ff6ca400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c40aebc0 con 0x7ff6c413c980 2024-09-13T17:53:17.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.031+0000 7ff6ca400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c40adc60 con 0x7ff6c406da90 2024-09-13T17:53:17.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.031+0000 7ff6c2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6c413c240 0x7ff6c4153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:17.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.031+0000 7ff6c2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6c413c240 0x7ff6c4153c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54030/0 (socket says 172.21.15.114:54030) 2024-09-13T17:53:17.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.031+0000 7ff6c2a00640 1 -- 172.21.15.114:0/618275709 learned_addr learned my addr 172.21.15.114:0/618275709 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:17.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.031+0000 7ff6c3400640 1 --2- 172.21.15.114:0/618275709 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6c406da90 0x7ff6c40a74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:17.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.031+0000 7ff6c3e00640 1 --2- 172.21.15.114:0/618275709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6c413c980 0x7ff6c406c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:17.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.031+0000 7ff6c2a00640 1 -- 172.21.15.114:0/618275709 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6c406da90 msgr2=0x7ff6c40a74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:17.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.031+0000 7ff6c2a00640 1 --2- 172.21.15.114:0/618275709 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6c406da90 0x7ff6c40a74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:17.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.031+0000 7ff6c2a00640 1 -- 172.21.15.114:0/618275709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6c413c980 msgr2=0x7ff6c406c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:17.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.031+0000 7ff6c2a00640 1 --2- 172.21.15.114:0/618275709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6c413c980 0x7ff6c406c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:17.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.031+0000 7ff6c2a00640 1 -- 172.21.15.114:0/618275709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b4009b30 con 0x7ff6c413c240 2024-09-13T17:53:17.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.031+0000 7ff6c2a00640 1 --2- 172.21.15.114:0/618275709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6c413c240 0x7ff6c4153c20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff6b000d5f0 tx=0x7ff6b000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:17.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.031+0000 7ff6bb400640 1 -- 172.21.15.114:0/618275709 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b00125f0 con 0x7ff6c413c240 2024-09-13T17:53:17.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.031+0000 7ff6bb400640 1 -- 172.21.15.114:0/618275709 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b0012750 con 0x7ff6c413c240 2024-09-13T17:53:17.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.031+0000 7ff6bb400640 1 -- 172.21.15.114:0/618275709 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0012ae0 con 0x7ff6c413c240 2024-09-13T17:53:17.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.031+0000 7ff6ca400640 1 -- 172.21.15.114:0/618275709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c415a230 con 0x7ff6c413c240 2024-09-13T17:53:17.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.031+0000 7ff6ca400640 1 -- 172.21.15.114:0/618275709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c40ae570 con 0x7ff6c413c240 2024-09-13T17:53:17.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.031+0000 7ff6ca400640 1 -- 172.21.15.114:0/618275709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c40aed30 con 0x7ff6c413c240 2024-09-13T17:53:17.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.035+0000 7ff6bb400640 1 -- 172.21.15.114:0/618275709 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff6b0012c40 con 0x7ff6c413c240 2024-09-13T17:53:17.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.035+0000 7ff6bb400640 1 --2- 172.21.15.114:0/618275709 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff6a40666c0 0x7ff6a4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:17.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.035+0000 7ff6bb400640 1 -- 172.21.15.114:0/618275709 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff6b0084660 con 0x7ff6c413c240 2024-09-13T17:53:17.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.035+0000 7ff6c3400640 1 --2- 172.21.15.114:0/618275709 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff6a40666c0 0x7ff6a4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:17.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.035+0000 7ff6c3400640 1 --2- 172.21.15.114:0/618275709 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff6a40666c0 0x7ff6a4068b80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40ae000 tx=0x7ff6b4004ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:17.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.039+0000 7ff6bb400640 1 -- 172.21.15.114:0/618275709 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff6b0051930 con 0x7ff6c413c240 2024-09-13T17:53:17.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.191+0000 7ff6ca400640 1 -- 172.21.15.114:0/618275709 --> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff6c413c620 con 0x7ff6a40666c0 2024-09-13T17:53:17.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.199+0000 7ff6bb400640 1 -- 172.21.15.114:0/618275709 <== mgr.4102 v2:172.21.15.114:6832/137691478 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288591 (secure 0 0 0) 0x7ff6b4009510 con 0x7ff6a40666c0 2024-09-13T17:53:17.205 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:17.207 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-13T17:53:17.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.203+0000 7ff6ca400640 1 -- 172.21.15.114:0/618275709 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff6a40666c0 msgr2=0x7ff6a4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:17.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.203+0000 7ff6ca400640 1 --2- 172.21.15.114:0/618275709 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff6a40666c0 0x7ff6a4068b80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40ae000 tx=0x7ff6b4004ac0 comp rx=0 tx=0).stop 2024-09-13T17:53:17.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.203+0000 7ff6ca400640 1 -- 172.21.15.114:0/618275709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6c413c240 msgr2=0x7ff6c4153c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:17.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.203+0000 7ff6ca400640 1 --2- 172.21.15.114:0/618275709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6c413c240 0x7ff6c4153c20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff6b000d5f0 tx=0x7ff6b000dab0 comp rx=0 tx=0).stop 2024-09-13T17:53:17.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.203+0000 7ff6ca400640 1 -- 172.21.15.114:0/618275709 shutdown_connections 2024-09-13T17:53:17.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.203+0000 7ff6ca400640 1 --2- 172.21.15.114:0/618275709 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff6a40666c0 0x7ff6a4068b80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:17.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.203+0000 7ff6ca400640 1 --2- 172.21.15.114:0/618275709 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6c413c980 0x7ff6c406c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:17.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.203+0000 7ff6ca400640 1 --2- 172.21.15.114:0/618275709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6c413c240 0x7ff6c4153c20 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:17.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.203+0000 7ff6ca400640 1 --2- 172.21.15.114:0/618275709 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff6c406da90 0x7ff6c40a74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:17.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.203+0000 7ff6ca400640 1 -- 172.21.15.114:0/618275709 >> 172.21.15.114:0/618275709 conn(0x7ff6c40660b0 msgr2=0x7ff6c413e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:17.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.203+0000 7ff6ca400640 1 -- 172.21.15.114:0/618275709 shutdown_connections 2024-09-13T17:53:17.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.203+0000 7ff6ca400640 1 -- 172.21.15.114:0/618275709 wait complete. 2024-09-13T17:53:17.226 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2024-09-13T17:53:15.952810+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220916,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753804,"statfs":{"total":773094113280,"available":772867895296,"internally_reserved":0,"allocated":4857856,"data_stored":2738380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001441"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.333727+0000","last_change":"2024-09-13T17:53:08.328059+0000","last_active":"2024-09-13T17:53:08.333727+0000","last_peered":"2024-09-13T17:53:08.333727+0000","last_clean":"2024-09-13T17:53:08.333727+0000","last_became_active":"2024-09-13T17:53:08.326969+0000","last_became_peered":"2024-09-13T17:53:08.326969+0000","last_unstale":"2024-09-13T17:53:08.333727+0000","last_undegraded":"2024-09-13T17:53:08.333727+0000","last_fullsized":"2024-09-13T17:53:08.333727+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:02.633358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.329827+0000","last_change":"2024-09-13T17:53:08.322031+0000","last_active":"2024-09-13T17:53:08.329827+0000","last_peered":"2024-09-13T17:53:08.329827+0000","last_clean":"2024-09-13T17:53:08.329827+0000","last_became_active":"2024-09-13T17:53:08.320784+0000","last_became_peered":"2024-09-13T17:53:08.320784+0000","last_unstale":"2024-09-13T17:53:08.329827+0000","last_undegraded":"2024-09-13T17:53:08.329827+0000","last_fullsized":"2024-09-13T17:53:08.329827+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:11.750011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.342511+0000","last_change":"2024-09-13T17:53:08.337321+0000","last_active":"2024-09-13T17:53:08.342511+0000","last_peered":"2024-09-13T17:53:08.342511+0000","last_clean":"2024-09-13T17:53:08.342511+0000","last_became_active":"2024-09-13T17:53:08.337068+0000","last_became_peered":"2024-09-13T17:53:08.337068+0000","last_unstale":"2024-09-13T17:53:08.342511+0000","last_undegraded":"2024-09-13T17:53:08.342511+0000","last_fullsized":"2024-09-13T17:53:08.342511+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:29.844579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.342006+0000","last_change":"2024-09-13T17:53:08.338221+0000","last_active":"2024-09-13T17:53:08.342006+0000","last_peered":"2024-09-13T17:53:08.342006+0000","last_clean":"2024-09-13T17:53:08.342006+0000","last_became_active":"2024-09-13T17:53:08.337670+0000","last_became_peered":"2024-09-13T17:53:08.337670+0000","last_unstale":"2024-09-13T17:53:08.342006+0000","last_undegraded":"2024-09-13T17:53:08.342006+0000","last_fullsized":"2024-09-13T17:53:08.342006+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:04:50.600660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.342049+0000","last_change":"2024-09-13T17:53:08.338777+0000","last_active":"2024-09-13T17:53:08.342049+0000","last_peered":"2024-09-13T17:53:08.342049+0000","last_clean":"2024-09-13T17:53:08.342049+0000","last_became_active":"2024-09-13T17:53:08.338519+0000","last_became_peered":"2024-09-13T17:53:08.338519+0000","last_unstale":"2024-09-13T17:53:08.342049+0000","last_undegraded":"2024-09-13T17:53:08.342049+0000","last_fullsized":"2024-09-13T17:53:08.342049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:15.795161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.326034+0000","last_change":"2024-09-13T17:53:08.321284+0000","last_active":"2024-09-13T17:53:08.326034+0000","last_peered":"2024-09-13T17:53:08.326034+0000","last_clean":"2024-09-13T17:53:08.326034+0000","last_became_active":"2024-09-13T17:53:08.321012+0000","last_became_peered":"2024-09-13T17:53:08.321012+0000","last_unstale":"2024-09-13T17:53:08.326034+0000","last_undegraded":"2024-09-13T17:53:08.326034+0000","last_fullsized":"2024-09-13T17:53:08.326034+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:15.154333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.339540+0000","last_change":"2024-09-13T17:53:08.331121+0000","last_active":"2024-09-13T17:53:08.339540+0000","last_peered":"2024-09-13T17:53:08.339540+0000","last_clean":"2024-09-13T17:53:08.339540+0000","last_became_active":"2024-09-13T17:53:08.327083+0000","last_became_peered":"2024-09-13T17:53:08.327083+0000","last_unstale":"2024-09-13T17:53:08.339540+0000","last_undegraded":"2024-09-13T17:53:08.339540+0000","last_fullsized":"2024-09-13T17:53:08.339540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:00.206010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.337019+0000","last_change":"2024-09-13T17:53:08.334438+0000","last_active":"2024-09-13T17:53:08.337019+0000","last_peered":"2024-09-13T17:53:08.337019+0000","last_clean":"2024-09-13T17:53:08.337019+0000","last_became_active":"2024-09-13T17:53:08.334269+0000","last_became_peered":"2024-09-13T17:53:08.334269+0000","last_unstale":"2024-09-13T17:53:08.337019+0000","last_undegraded":"2024-09-13T17:53:08.337019+0000","last_fullsized":"2024-09-13T17:53:08.337019+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:39.920002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.342634+0000","last_change":"2024-09-13T17:53:08.338160+0000","last_active":"2024-09-13T17:53:08.342634+0000","last_peered":"2024-09-13T17:53:08.342634+0000","last_clean":"2024-09-13T17:53:08.342634+0000","last_became_active":"2024-09-13T17:53:08.337915+0000","last_became_peered":"2024-09-13T17:53:08.337915+0000","last_unstale":"2024-09-13T17:53:08.342634+0000","last_undegraded":"2024-09-13T17:53:08.342634+0000","last_fullsized":"2024-09-13T17:53:08.342634+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:58.339595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.341862+0000","last_change":"2024-09-13T17:53:08.336931+0000","last_active":"2024-09-13T17:53:08.341862+0000","last_peered":"2024-09-13T17:53:08.341862+0000","last_clean":"2024-09-13T17:53:08.341862+0000","last_became_active":"2024-09-13T17:53:08.336690+0000","last_became_peered":"2024-09-13T17:53:08.336690+0000","last_unstale":"2024-09-13T17:53:08.341862+0000","last_undegraded":"2024-09-13T17:53:08.341862+0000","last_fullsized":"2024-09-13T17:53:08.341862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:08.746286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.342006+0000","last_change":"2024-09-13T17:53:08.337969+0000","last_active":"2024-09-13T17:53:08.342006+0000","last_peered":"2024-09-13T17:53:08.342006+0000","last_clean":"2024-09-13T17:53:08.342006+0000","last_became_active":"2024-09-13T17:53:08.337697+0000","last_became_peered":"2024-09-13T17:53:08.337697+0000","last_unstale":"2024-09-13T17:53:08.342006+0000","last_undegraded":"2024-09-13T17:53:08.342006+0000","last_fullsized":"2024-09-13T17:53:08.342006+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:02.660007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.317405+0000","last_change":"2024-09-13T17:53:08.311528+0000","last_active":"2024-09-13T17:53:08.317405+0000","last_peered":"2024-09-13T17:53:08.317405+0000","last_clean":"2024-09-13T17:53:08.317405+0000","last_became_active":"2024-09-13T17:53:08.311275+0000","last_became_peered":"2024-09-13T17:53:08.311275+0000","last_unstale":"2024-09-13T17:53:08.317405+0000","last_undegraded":"2024-09-13T17:53:08.317405+0000","last_fullsized":"2024-09-13T17:53:08.317405+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:24.523487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.341935+0000","last_change":"2024-09-13T17:53:08.337826+0000","last_active":"2024-09-13T17:53:08.341935+0000","last_peered":"2024-09-13T17:53:08.341935+0000","last_clean":"2024-09-13T17:53:08.341935+0000","last_became_active":"2024-09-13T17:53:08.337542+0000","last_became_peered":"2024-09-13T17:53:08.337542+0000","last_unstale":"2024-09-13T17:53:08.341935+0000","last_undegraded":"2024-09-13T17:53:08.341935+0000","last_fullsized":"2024-09-13T17:53:08.341935+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:24.523487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.344067+0000","last_change":"2024-09-13T17:53:08.338046+0000","last_active":"2024-09-13T17:53:08.344067+0000","last_peered":"2024-09-13T17:53:08.344067+0000","last_clean":"2024-09-13T17:53:08.344067+0000","last_became_active":"2024-09-13T17:53:08.336636+0000","last_became_peered":"2024-09-13T17:53:08.336636+0000","last_unstale":"2024-09-13T17:53:08.344067+0000","last_undegraded":"2024-09-13T17:53:08.344067+0000","last_fullsized":"2024-09-13T17:53:08.344067+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:51.440182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.339504+0000","last_change":"2024-09-13T17:53:08.328609+0000","last_active":"2024-09-13T17:53:08.339504+0000","last_peered":"2024-09-13T17:53:08.339504+0000","last_clean":"2024-09-13T17:53:08.339504+0000","last_became_active":"2024-09-13T17:53:08.326748+0000","last_became_peered":"2024-09-13T17:53:08.326748+0000","last_unstale":"2024-09-13T17:53:08.339504+0000","last_undegraded":"2024-09-13T17:53:08.339504+0000","last_fullsized":"2024-09-13T17:53:08.339504+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:16.635091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.341651+0000","last_change":"2024-09-13T17:53:08.337201+0000","last_active":"2024-09-13T17:53:08.341651+0000","last_peered":"2024-09-13T17:53:08.341651+0000","last_clean":"2024-09-13T17:53:08.341651+0000","last_became_active":"2024-09-13T17:53:08.336928+0000","last_became_peered":"2024-09-13T17:53:08.336928+0000","last_unstale":"2024-09-13T17:53:08.341651+0000","last_undegraded":"2024-09-13T17:53:08.341651+0000","last_fullsized":"2024-09-13T17:53:08.341651+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:42.945540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.342179+0000","last_change":"2024-09-13T17:53:08.337600+0000","last_active":"2024-09-13T17:53:08.342179+0000","last_peered":"2024-09-13T17:53:08.342179+0000","last_clean":"2024-09-13T17:53:08.342179+0000","last_became_active":"2024-09-13T17:53:08.337322+0000","last_became_peered":"2024-09-13T17:53:08.337322+0000","last_unstale":"2024-09-13T17:53:08.342179+0000","last_undegraded":"2024-09-13T17:53:08.342179+0000","last_fullsized":"2024-09-13T17:53:08.342179+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:43.484986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.344589+0000","last_change":"2024-09-13T17:53:08.339093+0000","last_active":"2024-09-13T17:53:08.344589+0000","last_peered":"2024-09-13T17:53:08.344589+0000","last_clean":"2024-09-13T17:53:08.344589+0000","last_became_active":"2024-09-13T17:53:08.338846+0000","last_became_peered":"2024-09-13T17:53:08.338846+0000","last_unstale":"2024-09-13T17:53:08.344589+0000","last_undegraded":"2024-09-13T17:53:08.344589+0000","last_fullsized":"2024-09-13T17:53:08.344589+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:09.561563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.319257+0000","last_change":"2024-09-13T17:53:08.312823+0000","last_active":"2024-09-13T17:53:08.319257+0000","last_peered":"2024-09-13T17:53:08.319257+0000","last_clean":"2024-09-13T17:53:08.319257+0000","last_became_active":"2024-09-13T17:53:08.312559+0000","last_became_peered":"2024-09-13T17:53:08.312559+0000","last_unstale":"2024-09-13T17:53:08.319257+0000","last_undegraded":"2024-09-13T17:53:08.319257+0000","last_fullsized":"2024-09-13T17:53:08.319257+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:46.004449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.341710+0000","last_change":"2024-09-13T17:53:08.334938+0000","last_active":"2024-09-13T17:53:08.341710+0000","last_peered":"2024-09-13T17:53:08.341710+0000","last_clean":"2024-09-13T17:53:08.341710+0000","last_became_active":"2024-09-13T17:53:08.334693+0000","last_became_peered":"2024-09-13T17:53:08.334693+0000","last_unstale":"2024-09-13T17:53:08.341710+0000","last_undegraded":"2024-09-13T17:53:08.341710+0000","last_fullsized":"2024-09-13T17:53:08.341710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:30.620140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.335045+0000","last_change":"2024-09-13T17:53:08.325433+0000","last_active":"2024-09-13T17:53:08.335045+0000","last_peered":"2024-09-13T17:53:08.335045+0000","last_clean":"2024-09-13T17:53:08.335045+0000","last_became_active":"2024-09-13T17:53:08.325098+0000","last_became_peered":"2024-09-13T17:53:08.325098+0000","last_unstale":"2024-09-13T17:53:08.335045+0000","last_undegraded":"2024-09-13T17:53:08.335045+0000","last_fullsized":"2024-09-13T17:53:08.335045+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:51.440182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.340110+0000","last_change":"2024-09-13T17:53:08.328964+0000","last_active":"2024-09-13T17:53:08.340110+0000","last_peered":"2024-09-13T17:53:08.340110+0000","last_clean":"2024-09-13T17:53:08.340110+0000","last_became_active":"2024-09-13T17:53:08.328655+0000","last_became_peered":"2024-09-13T17:53:08.328655+0000","last_unstale":"2024-09-13T17:53:08.340110+0000","last_undegraded":"2024-09-13T17:53:08.340110+0000","last_fullsized":"2024-09-13T17:53:08.340110+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:02.621171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.330985+0000","last_change":"2024-09-13T17:53:08.322892+0000","last_active":"2024-09-13T17:53:08.330985+0000","last_peered":"2024-09-13T17:53:08.330985+0000","last_clean":"2024-09-13T17:53:08.330985+0000","last_became_active":"2024-09-13T17:53:08.322249+0000","last_became_peered":"2024-09-13T17:53:08.322249+0000","last_unstale":"2024-09-13T17:53:08.330985+0000","last_undegraded":"2024-09-13T17:53:08.330985+0000","last_fullsized":"2024-09-13T17:53:08.330985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:02.660007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.318961+0000","last_change":"2024-09-13T17:53:08.313280+0000","last_active":"2024-09-13T17:53:08.318961+0000","last_peered":"2024-09-13T17:53:08.318961+0000","last_clean":"2024-09-13T17:53:08.318961+0000","last_became_active":"2024-09-13T17:53:08.312956+0000","last_became_peered":"2024-09-13T17:53:08.312956+0000","last_unstale":"2024-09-13T17:53:08.318961+0000","last_undegraded":"2024-09-13T17:53:08.318961+0000","last_fullsized":"2024-09-13T17:53:08.318961+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:39.411729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.326024+0000","last_change":"2024-09-13T17:53:08.320097+0000","last_active":"2024-09-13T17:53:08.326024+0000","last_peered":"2024-09-13T17:53:08.326024+0000","last_clean":"2024-09-13T17:53:08.326024+0000","last_became_active":"2024-09-13T17:53:08.319867+0000","last_became_peered":"2024-09-13T17:53:08.319867+0000","last_unstale":"2024-09-13T17:53:08.326024+0000","last_undegraded":"2024-09-13T17:53:08.326024+0000","last_fullsized":"2024-09-13T17:53:08.326024+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:19.636768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.341687+0000","last_change":"2024-09-13T17:53:08.334357+0000","last_active":"2024-09-13T17:53:08.341687+0000","last_peered":"2024-09-13T17:53:08.341687+0000","last_clean":"2024-09-13T17:53:08.341687+0000","last_became_active":"2024-09-13T17:53:08.334113+0000","last_became_peered":"2024-09-13T17:53:08.334113+0000","last_unstale":"2024-09-13T17:53:08.341687+0000","last_undegraded":"2024-09-13T17:53:08.341687+0000","last_fullsized":"2024-09-13T17:53:08.341687+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:05.172827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.325870+0000","last_change":"2024-09-13T17:53:08.319476+0000","last_active":"2024-09-13T17:53:08.325870+0000","last_peered":"2024-09-13T17:53:08.325870+0000","last_clean":"2024-09-13T17:53:08.325870+0000","last_became_active":"2024-09-13T17:53:08.319209+0000","last_became_peered":"2024-09-13T17:53:08.319209+0000","last_unstale":"2024-09-13T17:53:08.325870+0000","last_undegraded":"2024-09-13T17:53:08.325870+0000","last_fullsized":"2024-09-13T17:53:08.325870+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:05.594213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.340497+0000","last_change":"2024-09-13T17:53:08.333716+0000","last_active":"2024-09-13T17:53:08.340497+0000","last_peered":"2024-09-13T17:53:08.340497+0000","last_clean":"2024-09-13T17:53:08.340497+0000","last_became_active":"2024-09-13T17:53:08.333394+0000","last_became_peered":"2024-09-13T17:53:08.333394+0000","last_unstale":"2024-09-13T17:53:08.340497+0000","last_undegraded":"2024-09-13T17:53:08.340497+0000","last_fullsized":"2024-09-13T17:53:08.340497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:55.588582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.330804+0000","last_change":"2024-09-13T17:53:08.328272+0000","last_active":"2024-09-13T17:53:08.330804+0000","last_peered":"2024-09-13T17:53:08.330804+0000","last_clean":"2024-09-13T17:53:08.330804+0000","last_became_active":"2024-09-13T17:53:08.328006+0000","last_became_peered":"2024-09-13T17:53:08.328006+0000","last_unstale":"2024-09-13T17:53:08.330804+0000","last_undegraded":"2024-09-13T17:53:08.330804+0000","last_fullsized":"2024-09-13T17:53:08.330804+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:07.544794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.326070+0000","last_change":"2024-09-13T17:53:08.319778+0000","last_active":"2024-09-13T17:53:08.326070+0000","last_peered":"2024-09-13T17:53:08.326070+0000","last_clean":"2024-09-13T17:53:08.326070+0000","last_became_active":"2024-09-13T17:53:08.319511+0000","last_became_peered":"2024-09-13T17:53:08.319511+0000","last_unstale":"2024-09-13T17:53:08.326070+0000","last_undegraded":"2024-09-13T17:53:08.326070+0000","last_fullsized":"2024-09-13T17:53:08.326070+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:06.338741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.331025+0000","last_change":"2024-09-13T17:53:08.324346+0000","last_active":"2024-09-13T17:53:08.331025+0000","last_peered":"2024-09-13T17:53:08.331025+0000","last_clean":"2024-09-13T17:53:08.331025+0000","last_became_active":"2024-09-13T17:53:08.322572+0000","last_became_peered":"2024-09-13T17:53:08.322572+0000","last_unstale":"2024-09-13T17:53:08.331025+0000","last_undegraded":"2024-09-13T17:53:08.331025+0000","last_fullsized":"2024-09-13T17:53:08.331025+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:15.154333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.316402+0000","last_change":"2024-09-13T17:53:08.312904+0000","last_active":"2024-09-13T17:53:08.316402+0000","last_peered":"2024-09-13T17:53:08.316402+0000","last_clean":"2024-09-13T17:53:08.316402+0000","last_became_active":"2024-09-13T17:53:08.312650+0000","last_became_peered":"2024-09-13T17:53:08.312650+0000","last_unstale":"2024-09-13T17:53:08.316402+0000","last_undegraded":"2024-09-13T17:53:08.316402+0000","last_fullsized":"2024-09-13T17:53:08.316402+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:42.945540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.341828+0000","last_change":"2024-09-13T17:53:08.337215+0000","last_active":"2024-09-13T17:53:08.341828+0000","last_peered":"2024-09-13T17:53:08.341828+0000","last_clean":"2024-09-13T17:53:08.341828+0000","last_became_active":"2024-09-13T17:53:08.336968+0000","last_became_peered":"2024-09-13T17:53:08.336968+0000","last_unstale":"2024-09-13T17:53:08.341828+0000","last_undegraded":"2024-09-13T17:53:08.341828+0000","last_fullsized":"2024-09-13T17:53:08.341828+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:05.297506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.342488+0000","last_change":"2024-09-13T17:53:07.927772+0000","last_active":"2024-09-13T17:53:08.342488+0000","last_peered":"2024-09-13T17:53:08.342488+0000","last_clean":"2024-09-13T17:53:08.342488+0000","last_became_active":"2024-09-13T17:53:07.926833+0000","last_became_peered":"2024-09-13T17:53:07.926833+0000","last_unstale":"2024-09-13T17:53:08.342488+0000","last_undegraded":"2024-09-13T17:53:08.342488+0000","last_fullsized":"2024-09-13T17:53:08.342488+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:26.713460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.334577+0000","last_change":"2024-09-13T17:53:08.331531+0000","last_active":"2024-09-13T17:53:08.334577+0000","last_peered":"2024-09-13T17:53:08.334577+0000","last_clean":"2024-09-13T17:53:08.334577+0000","last_became_active":"2024-09-13T17:53:08.330415+0000","last_became_peered":"2024-09-13T17:53:08.330415+0000","last_unstale":"2024-09-13T17:53:08.334577+0000","last_undegraded":"2024-09-13T17:53:08.334577+0000","last_fullsized":"2024-09-13T17:53:08.334577+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:00.206010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.331840+0000","last_change":"2024-09-13T17:53:07.942858+0000","last_active":"2024-09-13T17:53:08.331840+0000","last_peered":"2024-09-13T17:53:08.331840+0000","last_clean":"2024-09-13T17:53:08.331840+0000","last_became_active":"2024-09-13T17:53:07.942331+0000","last_became_peered":"2024-09-13T17:53:07.942331+0000","last_unstale":"2024-09-13T17:53:08.331840+0000","last_undegraded":"2024-09-13T17:53:08.331840+0000","last_fullsized":"2024-09-13T17:53:08.331840+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:52.434464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.342294+0000","last_change":"2024-09-13T17:53:08.336301+0000","last_active":"2024-09-13T17:53:08.342294+0000","last_peered":"2024-09-13T17:53:08.342294+0000","last_clean":"2024-09-13T17:53:08.342294+0000","last_became_active":"2024-09-13T17:53:08.336060+0000","last_became_peered":"2024-09-13T17:53:08.336060+0000","last_unstale":"2024-09-13T17:53:08.342294+0000","last_undegraded":"2024-09-13T17:53:08.342294+0000","last_fullsized":"2024-09-13T17:53:08.342294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:58.339595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.337908+0000","last_change":"2024-09-13T17:53:07.942677+0000","last_active":"2024-09-13T17:53:08.337908+0000","last_peered":"2024-09-13T17:53:08.337908+0000","last_clean":"2024-09-13T17:53:08.337908+0000","last_became_active":"2024-09-13T17:53:07.942426+0000","last_became_peered":"2024-09-13T17:53:07.942426+0000","last_unstale":"2024-09-13T17:53:08.337908+0000","last_undegraded":"2024-09-13T17:53:08.337908+0000","last_fullsized":"2024-09-13T17:53:08.337908+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:08.554504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.333692+0000","last_change":"2024-09-13T17:53:08.327801+0000","last_active":"2024-09-13T17:53:08.333692+0000","last_peered":"2024-09-13T17:53:08.333692+0000","last_clean":"2024-09-13T17:53:08.333692+0000","last_became_active":"2024-09-13T17:53:08.326766+0000","last_became_peered":"2024-09-13T17:53:08.326766+0000","last_unstale":"2024-09-13T17:53:08.333692+0000","last_undegraded":"2024-09-13T17:53:08.333692+0000","last_fullsized":"2024-09-13T17:53:08.333692+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:13.404809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.340032+0000","last_change":"2024-09-13T17:53:07.931288+0000","last_active":"2024-09-13T17:53:08.340032+0000","last_peered":"2024-09-13T17:53:08.340032+0000","last_clean":"2024-09-13T17:53:08.340032+0000","last_became_active":"2024-09-13T17:53:07.929489+0000","last_became_peered":"2024-09-13T17:53:07.929489+0000","last_unstale":"2024-09-13T17:53:08.340032+0000","last_undegraded":"2024-09-13T17:53:08.340032+0000","last_fullsized":"2024-09-13T17:53:08.340032+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:42.477927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.318231+0000","last_change":"2024-09-13T17:53:08.311242+0000","last_active":"2024-09-13T17:53:08.318231+0000","last_peered":"2024-09-13T17:53:08.318231+0000","last_clean":"2024-09-13T17:53:08.318231+0000","last_became_active":"2024-09-13T17:53:08.310973+0000","last_became_peered":"2024-09-13T17:53:08.310973+0000","last_unstale":"2024-09-13T17:53:08.318231+0000","last_undegraded":"2024-09-13T17:53:08.318231+0000","last_fullsized":"2024-09-13T17:53:08.318231+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:51.440182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.342554+0000","last_change":"2024-09-13T17:53:07.930059+0000","last_active":"2024-09-13T17:53:08.342554+0000","last_peered":"2024-09-13T17:53:08.342554+0000","last_clean":"2024-09-13T17:53:08.342554+0000","last_became_active":"2024-09-13T17:53:07.929603+0000","last_became_peered":"2024-09-13T17:53:07.929603+0000","last_unstale":"2024-09-13T17:53:08.342554+0000","last_undegraded":"2024-09-13T17:53:08.342554+0000","last_fullsized":"2024-09-13T17:53:08.342554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:18.629709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.339523+0000","last_change":"2024-09-13T17:53:08.330061+0000","last_active":"2024-09-13T17:53:08.339523+0000","last_peered":"2024-09-13T17:53:08.339523+0000","last_clean":"2024-09-13T17:53:08.339523+0000","last_became_active":"2024-09-13T17:53:08.328372+0000","last_became_peered":"2024-09-13T17:53:08.328372+0000","last_unstale":"2024-09-13T17:53:08.339523+0000","last_undegraded":"2024-09-13T17:53:08.339523+0000","last_fullsized":"2024-09-13T17:53:08.339523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:58.339595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.342843+0000","last_change":"2024-09-13T17:53:07.943158+0000","last_active":"2024-09-13T17:53:08.342843+0000","last_peered":"2024-09-13T17:53:08.342843+0000","last_clean":"2024-09-13T17:53:08.342843+0000","last_became_active":"2024-09-13T17:53:07.942861+0000","last_became_peered":"2024-09-13T17:53:07.942861+0000","last_unstale":"2024-09-13T17:53:08.342843+0000","last_undegraded":"2024-09-13T17:53:08.342843+0000","last_fullsized":"2024-09-13T17:53:08.342843+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:38.404670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.340126+0000","last_change":"2024-09-13T17:53:08.336069+0000","last_active":"2024-09-13T17:53:08.340126+0000","last_peered":"2024-09-13T17:53:08.340126+0000","last_clean":"2024-09-13T17:53:08.340126+0000","last_became_active":"2024-09-13T17:53:08.334174+0000","last_became_peered":"2024-09-13T17:53:08.334174+0000","last_unstale":"2024-09-13T17:53:08.340126+0000","last_undegraded":"2024-09-13T17:53:08.340126+0000","last_fullsized":"2024-09-13T17:53:08.340126+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:42.232554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.309277+0000","last_change":"2024-09-13T17:53:07.940289+0000","last_active":"2024-09-13T17:53:08.309277+0000","last_peered":"2024-09-13T17:53:08.309277+0000","last_clean":"2024-09-13T17:53:08.309277+0000","last_became_active":"2024-09-13T17:53:07.940047+0000","last_became_peered":"2024-09-13T17:53:07.940047+0000","last_unstale":"2024-09-13T17:53:08.309277+0000","last_undegraded":"2024-09-13T17:53:08.309277+0000","last_fullsized":"2024-09-13T17:53:08.309277+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:29.613081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.333754+0000","last_change":"2024-09-13T17:53:08.328602+0000","last_active":"2024-09-13T17:53:08.333754+0000","last_peered":"2024-09-13T17:53:08.333754+0000","last_clean":"2024-09-13T17:53:08.333754+0000","last_became_active":"2024-09-13T17:53:08.328360+0000","last_became_peered":"2024-09-13T17:53:08.328360+0000","last_unstale":"2024-09-13T17:53:08.333754+0000","last_undegraded":"2024-09-13T17:53:08.333754+0000","last_fullsized":"2024-09-13T17:53:08.333754+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:26.764647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.322836+0000","last_change":"2024-09-13T17:53:07.930024+0000","last_active":"2024-09-13T17:53:08.322836+0000","last_peered":"2024-09-13T17:53:08.322836+0000","last_clean":"2024-09-13T17:53:08.322836+0000","last_became_active":"2024-09-13T17:53:07.927170+0000","last_became_peered":"2024-09-13T17:53:07.927170+0000","last_unstale":"2024-09-13T17:53:08.322836+0000","last_undegraded":"2024-09-13T17:53:08.322836+0000","last_fullsized":"2024-09-13T17:53:08.322836+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:15.690853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.342017+0000","last_change":"2024-09-13T17:53:08.338365+0000","last_active":"2024-09-13T17:53:08.342017+0000","last_peered":"2024-09-13T17:53:08.342017+0000","last_clean":"2024-09-13T17:53:08.342017+0000","last_became_active":"2024-09-13T17:53:08.337999+0000","last_became_peered":"2024-09-13T17:53:08.337999+0000","last_unstale":"2024-09-13T17:53:08.342017+0000","last_undegraded":"2024-09-13T17:53:08.342017+0000","last_fullsized":"2024-09-13T17:53:08.342017+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:24.556344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.315845+0000","last_change":"2024-09-13T17:53:07.933052+0000","last_active":"2024-09-13T17:53:08.315845+0000","last_peered":"2024-09-13T17:53:08.315845+0000","last_clean":"2024-09-13T17:53:08.315845+0000","last_became_active":"2024-09-13T17:53:07.932754+0000","last_became_peered":"2024-09-13T17:53:07.932754+0000","last_unstale":"2024-09-13T17:53:08.315845+0000","last_undegraded":"2024-09-13T17:53:08.315845+0000","last_fullsized":"2024-09-13T17:53:08.315845+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:01.652948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.337300+0000","last_change":"2024-09-13T17:53:08.331696+0000","last_active":"2024-09-13T17:53:08.337300+0000","last_peered":"2024-09-13T17:53:08.337300+0000","last_clean":"2024-09-13T17:53:08.337300+0000","last_became_active":"2024-09-13T17:53:08.331416+0000","last_became_peered":"2024-09-13T17:53:08.331416+0000","last_unstale":"2024-09-13T17:53:08.337300+0000","last_undegraded":"2024-09-13T17:53:08.337300+0000","last_fullsized":"2024-09-13T17:53:08.337300+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:00.206010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.325067+0000","last_change":"2024-09-13T17:53:07.933774+0000","last_active":"2024-09-13T17:53:08.325067+0000","last_peered":"2024-09-13T17:53:08.325067+0000","last_clean":"2024-09-13T17:53:08.325067+0000","last_became_active":"2024-09-13T17:53:07.933487+0000","last_became_peered":"2024-09-13T17:53:07.933487+0000","last_unstale":"2024-09-13T17:53:08.325067+0000","last_undegraded":"2024-09-13T17:53:08.325067+0000","last_fullsized":"2024-09-13T17:53:08.325067+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:48.805157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.317989+0000","last_change":"2024-09-13T17:53:08.311743+0000","last_active":"2024-09-13T17:53:08.317989+0000","last_peered":"2024-09-13T17:53:08.317989+0000","last_clean":"2024-09-13T17:53:08.317989+0000","last_became_active":"2024-09-13T17:53:08.311510+0000","last_became_peered":"2024-09-13T17:53:08.311510+0000","last_unstale":"2024-09-13T17:53:08.317989+0000","last_undegraded":"2024-09-13T17:53:08.317989+0000","last_fullsized":"2024-09-13T17:53:08.317989+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:42.232554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.339443+0000","last_change":"2024-09-13T17:53:07.939168+0000","last_active":"2024-09-13T17:53:08.339443+0000","last_peered":"2024-09-13T17:53:08.339443+0000","last_clean":"2024-09-13T17:53:08.339443+0000","last_became_active":"2024-09-13T17:53:07.938879+0000","last_became_peered":"2024-09-13T17:53:07.938879+0000","last_unstale":"2024-09-13T17:53:08.339443+0000","last_undegraded":"2024-09-13T17:53:08.339443+0000","last_fullsized":"2024-09-13T17:53:08.339443+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:04.587154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.341441+0000","last_change":"2024-09-13T17:53:08.335396+0000","last_active":"2024-09-13T17:53:08.341441+0000","last_peered":"2024-09-13T17:53:08.341441+0000","last_clean":"2024-09-13T17:53:08.341441+0000","last_became_active":"2024-09-13T17:53:08.333738+0000","last_became_peered":"2024-09-13T17:53:08.333738+0000","last_unstale":"2024-09-13T17:53:08.341441+0000","last_undegraded":"2024-09-13T17:53:08.341441+0000","last_fullsized":"2024-09-13T17:53:08.341441+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:13.895602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.347597+0000","last_change":"2024-09-13T17:53:07.940964+0000","last_active":"2024-09-13T17:53:08.347597+0000","last_peered":"2024-09-13T17:53:08.347597+0000","last_clean":"2024-09-13T17:53:08.347597+0000","last_became_active":"2024-09-13T17:53:07.940717+0000","last_became_peered":"2024-09-13T17:53:07.940717+0000","last_unstale":"2024-09-13T17:53:08.347597+0000","last_undegraded":"2024-09-13T17:53:08.347597+0000","last_fullsized":"2024-09-13T17:53:08.347597+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:50.212192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.342585+0000","last_change":"2024-09-13T17:53:08.337881+0000","last_active":"2024-09-13T17:53:08.342585+0000","last_peered":"2024-09-13T17:53:08.342585+0000","last_clean":"2024-09-13T17:53:08.342585+0000","last_became_active":"2024-09-13T17:53:08.337599+0000","last_became_peered":"2024-09-13T17:53:08.337599+0000","last_unstale":"2024-09-13T17:53:08.342585+0000","last_undegraded":"2024-09-13T17:53:08.342585+0000","last_fullsized":"2024-09-13T17:53:08.342585+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:02.621171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.331305+0000","last_change":"2024-09-13T17:53:07.929999+0000","last_active":"2024-09-13T17:53:08.331305+0000","last_peered":"2024-09-13T17:53:08.331305+0000","last_clean":"2024-09-13T17:53:08.331305+0000","last_became_active":"2024-09-13T17:53:07.929747+0000","last_became_peered":"2024-09-13T17:53:07.929747+0000","last_unstale":"2024-09-13T17:53:08.331305+0000","last_undegraded":"2024-09-13T17:53:08.331305+0000","last_fullsized":"2024-09-13T17:53:08.331305+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:04.165768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.329930+0000","last_change":"2024-09-13T17:53:08.323246+0000","last_active":"2024-09-13T17:53:08.329930+0000","last_peered":"2024-09-13T17:53:08.329930+0000","last_clean":"2024-09-13T17:53:08.329930+0000","last_became_active":"2024-09-13T17:53:08.322991+0000","last_became_peered":"2024-09-13T17:53:08.322991+0000","last_unstale":"2024-09-13T17:53:08.329930+0000","last_undegraded":"2024-09-13T17:53:08.329930+0000","last_fullsized":"2024-09-13T17:53:08.329930+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:13.042839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.309319+0000","last_change":"2024-09-13T17:53:07.941959+0000","last_active":"2024-09-13T17:53:08.309319+0000","last_peered":"2024-09-13T17:53:08.309319+0000","last_clean":"2024-09-13T17:53:08.309319+0000","last_became_active":"2024-09-13T17:53:07.941576+0000","last_became_peered":"2024-09-13T17:53:07.941576+0000","last_unstale":"2024-09-13T17:53:08.309319+0000","last_undegraded":"2024-09-13T17:53:08.309319+0000","last_fullsized":"2024-09-13T17:53:08.309319+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:04.911527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.329979+0000","last_change":"2024-09-13T17:53:08.321715+0000","last_active":"2024-09-13T17:53:08.329979+0000","last_peered":"2024-09-13T17:53:08.329979+0000","last_clean":"2024-09-13T17:53:08.329979+0000","last_became_active":"2024-09-13T17:53:08.321408+0000","last_became_peered":"2024-09-13T17:53:08.321408+0000","last_unstale":"2024-09-13T17:53:08.329979+0000","last_undegraded":"2024-09-13T17:53:08.329979+0000","last_fullsized":"2024-09-13T17:53:08.329979+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:51.219251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.311276+0000","last_change":"2024-09-13T17:53:07.927302+0000","last_active":"2024-09-13T17:53:08.311276+0000","last_peered":"2024-09-13T17:53:08.311276+0000","last_clean":"2024-09-13T17:53:08.311276+0000","last_became_active":"2024-09-13T17:53:07.927010+0000","last_became_peered":"2024-09-13T17:53:07.927010+0000","last_unstale":"2024-09-13T17:53:08.311276+0000","last_undegraded":"2024-09-13T17:53:08.311276+0000","last_fullsized":"2024-09-13T17:53:08.311276+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:58:48.383731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.333717+0000","last_change":"2024-09-13T17:53:08.327193+0000","last_active":"2024-09-13T17:53:08.333717+0000","last_peered":"2024-09-13T17:53:08.333717+0000","last_clean":"2024-09-13T17:53:08.333717+0000","last_became_active":"2024-09-13T17:53:08.326966+0000","last_became_peered":"2024-09-13T17:53:08.326966+0000","last_unstale":"2024-09-13T17:53:08.333717+0000","last_undegraded":"2024-09-13T17:53:08.333717+0000","last_fullsized":"2024-09-13T17:53:08.333717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:22.069383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.343584+0000","last_change":"2024-09-13T17:53:07.941904+0000","last_active":"2024-09-13T17:53:08.343584+0000","last_peered":"2024-09-13T17:53:08.343584+0000","last_clean":"2024-09-13T17:53:08.343584+0000","last_became_active":"2024-09-13T17:53:07.940899+0000","last_became_peered":"2024-09-13T17:53:07.940899+0000","last_unstale":"2024-09-13T17:53:08.343584+0000","last_undegraded":"2024-09-13T17:53:08.343584+0000","last_fullsized":"2024-09-13T17:53:08.343584+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:29.355126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.333737+0000","last_change":"2024-09-13T17:53:08.325292+0000","last_active":"2024-09-13T17:53:08.333737+0000","last_peered":"2024-09-13T17:53:08.333737+0000","last_clean":"2024-09-13T17:53:08.333737+0000","last_became_active":"2024-09-13T17:53:08.325045+0000","last_became_peered":"2024-09-13T17:53:08.325045+0000","last_unstale":"2024-09-13T17:53:08.333737+0000","last_undegraded":"2024-09-13T17:53:08.333737+0000","last_fullsized":"2024-09-13T17:53:08.333737+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:12.327579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.343363+0000","last_change":"2024-09-13T17:53:07.935326+0000","last_active":"2024-09-13T17:53:08.343363+0000","last_peered":"2024-09-13T17:53:08.343363+0000","last_clean":"2024-09-13T17:53:08.343363+0000","last_became_active":"2024-09-13T17:53:07.934994+0000","last_became_peered":"2024-09-13T17:53:07.934994+0000","last_unstale":"2024-09-13T17:53:08.343363+0000","last_undegraded":"2024-09-13T17:53:08.343363+0000","last_fullsized":"2024-09-13T17:53:08.343363+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:05.331682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.335504+0000","last_change":"2024-09-13T17:53:08.326430+0000","last_active":"2024-09-13T17:53:08.335504+0000","last_peered":"2024-09-13T17:53:08.335504+0000","last_clean":"2024-09-13T17:53:08.335504+0000","last_became_active":"2024-09-13T17:53:08.325310+0000","last_became_peered":"2024-09-13T17:53:08.325310+0000","last_unstale":"2024-09-13T17:53:08.335504+0000","last_undegraded":"2024-09-13T17:53:08.335504+0000","last_fullsized":"2024-09-13T17:53:08.335504+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:02.621171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.342236+0000","last_change":"2024-09-13T17:53:07.937200+0000","last_active":"2024-09-13T17:53:08.342236+0000","last_peered":"2024-09-13T17:53:08.342236+0000","last_clean":"2024-09-13T17:53:08.342236+0000","last_became_active":"2024-09-13T17:53:07.936933+0000","last_became_peered":"2024-09-13T17:53:07.936933+0000","last_unstale":"2024-09-13T17:53:08.342236+0000","last_undegraded":"2024-09-13T17:53:08.342236+0000","last_fullsized":"2024-09-13T17:53:08.342236+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:41.938481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.342175+0000","last_change":"2024-09-13T17:53:08.329094+0000","last_active":"2024-09-13T17:53:08.342175+0000","last_peered":"2024-09-13T17:53:08.342175+0000","last_clean":"2024-09-13T17:53:08.342175+0000","last_became_active":"2024-09-13T17:53:08.328558+0000","last_became_peered":"2024-09-13T17:53:08.328558+0000","last_unstale":"2024-09-13T17:53:08.342175+0000","last_undegraded":"2024-09-13T17:53:08.342175+0000","last_fullsized":"2024-09-13T17:53:08.342175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:29.844579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.332048+0000","last_change":"2024-09-13T17:53:07.940232+0000","last_active":"2024-09-13T17:53:08.332048+0000","last_peered":"2024-09-13T17:53:08.332048+0000","last_clean":"2024-09-13T17:53:08.332048+0000","last_became_active":"2024-09-13T17:53:07.939995+0000","last_became_peered":"2024-09-13T17:53:07.939995+0000","last_unstale":"2024-09-13T17:53:08.332048+0000","last_undegraded":"2024-09-13T17:53:08.332048+0000","last_fullsized":"2024-09-13T17:53:08.332048+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:30:28.756119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.325309+0000","last_change":"2024-09-13T17:53:08.320956+0000","last_active":"2024-09-13T17:53:08.325309+0000","last_peered":"2024-09-13T17:53:08.325309+0000","last_clean":"2024-09-13T17:53:08.325309+0000","last_became_active":"2024-09-13T17:53:08.320328+0000","last_became_peered":"2024-09-13T17:53:08.320328+0000","last_unstale":"2024-09-13T17:53:08.325309+0000","last_undegraded":"2024-09-13T17:53:08.325309+0000","last_fullsized":"2024-09-13T17:53:08.325309+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:27.720519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.309385+0000","last_change":"2024-09-13T17:53:07.935565+0000","last_active":"2024-09-13T17:53:08.309385+0000","last_peered":"2024-09-13T17:53:08.309385+0000","last_clean":"2024-09-13T17:53:08.309385+0000","last_became_active":"2024-09-13T17:53:07.935314+0000","last_became_peered":"2024-09-13T17:53:07.935314+0000","last_unstale":"2024-09-13T17:53:08.309385+0000","last_undegraded":"2024-09-13T17:53:08.309385+0000","last_fullsized":"2024-09-13T17:53:08.309385+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:18.629709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.330935+0000","last_change":"2024-09-13T17:53:08.324597+0000","last_active":"2024-09-13T17:53:08.330935+0000","last_peered":"2024-09-13T17:53:08.330935+0000","last_clean":"2024-09-13T17:53:08.330935+0000","last_became_active":"2024-09-13T17:53:08.324266+0000","last_became_peered":"2024-09-13T17:53:08.324266+0000","last_unstale":"2024-09-13T17:53:08.330935+0000","last_undegraded":"2024-09-13T17:53:08.330935+0000","last_fullsized":"2024-09-13T17:53:08.330935+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:16.635091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.319801+0000","last_change":"2024-09-13T17:53:07.930426+0000","last_active":"2024-09-13T17:53:08.319801+0000","last_peered":"2024-09-13T17:53:08.319801+0000","last_clean":"2024-09-13T17:53:08.319801+0000","last_became_active":"2024-09-13T17:53:07.929700+0000","last_became_peered":"2024-09-13T17:53:07.929700+0000","last_unstale":"2024-09-13T17:53:08.319801+0000","last_undegraded":"2024-09-13T17:53:08.319801+0000","last_fullsized":"2024-09-13T17:53:08.319801+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:14.633970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.317595+0000","last_change":"2024-09-13T17:53:08.311668+0000","last_active":"2024-09-13T17:53:08.317595+0000","last_peered":"2024-09-13T17:53:08.317595+0000","last_clean":"2024-09-13T17:53:08.317595+0000","last_became_active":"2024-09-13T17:53:08.311402+0000","last_became_peered":"2024-09-13T17:53:08.311402+0000","last_unstale":"2024-09-13T17:53:08.317595+0000","last_undegraded":"2024-09-13T17:53:08.317595+0000","last_fullsized":"2024-09-13T17:53:08.317595+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:13.895602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.303333+0000","last_change":"2024-09-13T17:53:07.928071+0000","last_active":"2024-09-13T17:53:08.303333+0000","last_peered":"2024-09-13T17:53:08.303333+0000","last_clean":"2024-09-13T17:53:08.303333+0000","last_became_active":"2024-09-13T17:53:07.927826+0000","last_became_peered":"2024-09-13T17:53:07.927826+0000","last_unstale":"2024-09-13T17:53:08.303333+0000","last_undegraded":"2024-09-13T17:53:08.303333+0000","last_fullsized":"2024-09-13T17:53:08.303333+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:57.190801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.337952+0000","last_change":"2024-09-13T17:53:08.326807+0000","last_active":"2024-09-13T17:53:08.337952+0000","last_peered":"2024-09-13T17:53:08.337952+0000","last_clean":"2024-09-13T17:53:08.337952+0000","last_became_active":"2024-09-13T17:53:08.326532+0000","last_became_peered":"2024-09-13T17:53:08.326532+0000","last_unstale":"2024-09-13T17:53:08.337952+0000","last_undegraded":"2024-09-13T17:53:08.337952+0000","last_fullsized":"2024-09-13T17:53:08.337952+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:41.690036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.309459+0000","last_change":"2024-09-13T17:53:07.944383+0000","last_active":"2024-09-13T17:53:08.309459+0000","last_peered":"2024-09-13T17:53:08.309459+0000","last_clean":"2024-09-13T17:53:08.309459+0000","last_became_active":"2024-09-13T17:53:07.944063+0000","last_became_peered":"2024-09-13T17:53:07.944063+0000","last_unstale":"2024-09-13T17:53:08.309459+0000","last_undegraded":"2024-09-13T17:53:08.309459+0000","last_fullsized":"2024-09-13T17:53:08.309459+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:46.511108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.333738+0000","last_change":"2024-09-13T17:53:08.328577+0000","last_active":"2024-09-13T17:53:08.333738+0000","last_peered":"2024-09-13T17:53:08.333738+0000","last_clean":"2024-09-13T17:53:08.333738+0000","last_became_active":"2024-09-13T17:53:08.328314+0000","last_became_peered":"2024-09-13T17:53:08.328314+0000","last_unstale":"2024-09-13T17:53:08.333738+0000","last_undegraded":"2024-09-13T17:53:08.333738+0000","last_fullsized":"2024-09-13T17:53:08.333738+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:00.024100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.303326+0000","last_change":"2024-09-13T17:53:07.924570+0000","last_active":"2024-09-13T17:53:08.303326+0000","last_peered":"2024-09-13T17:53:08.303326+0000","last_clean":"2024-09-13T17:53:08.303326+0000","last_became_active":"2024-09-13T17:53:07.924332+0000","last_became_peered":"2024-09-13T17:53:07.924332+0000","last_unstale":"2024-09-13T17:53:08.303326+0000","last_undegraded":"2024-09-13T17:53:08.303326+0000","last_fullsized":"2024-09-13T17:53:08.303326+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:54.256684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.341721+0000","last_change":"2024-09-13T17:53:08.335343+0000","last_active":"2024-09-13T17:53:08.341721+0000","last_peered":"2024-09-13T17:53:08.341721+0000","last_clean":"2024-09-13T17:53:08.341721+0000","last_became_active":"2024-09-13T17:53:08.335164+0000","last_became_peered":"2024-09-13T17:53:08.335164+0000","last_unstale":"2024-09-13T17:53:08.341721+0000","last_undegraded":"2024-09-13T17:53:08.341721+0000","last_fullsized":"2024-09-13T17:53:08.341721+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:48.932531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.340301+0000","last_change":"2024-09-13T17:53:07.939026+0000","last_active":"2024-09-13T17:53:08.340301+0000","last_peered":"2024-09-13T17:53:08.340301+0000","last_clean":"2024-09-13T17:53:08.340301+0000","last_became_active":"2024-09-13T17:53:07.938709+0000","last_became_peered":"2024-09-13T17:53:07.938709+0000","last_unstale":"2024-09-13T17:53:08.340301+0000","last_undegraded":"2024-09-13T17:53:08.340301+0000","last_fullsized":"2024-09-13T17:53:08.340301+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:08.554504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.339422+0000","last_change":"2024-09-13T17:53:08.335764+0000","last_active":"2024-09-13T17:53:08.339422+0000","last_peered":"2024-09-13T17:53:08.339422+0000","last_clean":"2024-09-13T17:53:08.339422+0000","last_became_active":"2024-09-13T17:53:08.331745+0000","last_became_peered":"2024-09-13T17:53:08.331745+0000","last_unstale":"2024-09-13T17:53:08.339422+0000","last_undegraded":"2024-09-13T17:53:08.339422+0000","last_fullsized":"2024-09-13T17:53:08.339422+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:05.172827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-13T17:53:10.209205+0000","last_change":"2024-09-13T17:53:07.939210+0000","last_active":"2024-09-13T17:53:10.209205+0000","last_peered":"2024-09-13T17:53:10.209205+0000","last_clean":"2024-09-13T17:53:10.209205+0000","last_became_active":"2024-09-13T17:53:07.938689+0000","last_became_peered":"2024-09-13T17:53:07.938689+0000","last_unstale":"2024-09-13T17:53:10.209205+0000","last_undegraded":"2024-09-13T17:53:10.209205+0000","last_fullsized":"2024-09-13T17:53:10.209205+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:30.156095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.342598+0000","last_change":"2024-09-13T17:53:08.338753+0000","last_active":"2024-09-13T17:53:08.342598+0000","last_peered":"2024-09-13T17:53:08.342598+0000","last_clean":"2024-09-13T17:53:08.342598+0000","last_became_active":"2024-09-13T17:53:08.338513+0000","last_became_peered":"2024-09-13T17:53:08.338513+0000","last_unstale":"2024-09-13T17:53:08.342598+0000","last_undegraded":"2024-09-13T17:53:08.342598+0000","last_fullsized":"2024-09-13T17:53:08.342598+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:24.057582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.308238+0000","last_change":"2024-09-13T17:53:07.933119+0000","last_active":"2024-09-13T17:53:08.308238+0000","last_peered":"2024-09-13T17:53:08.308238+0000","last_clean":"2024-09-13T17:53:08.308238+0000","last_became_active":"2024-09-13T17:53:07.932786+0000","last_became_peered":"2024-09-13T17:53:07.932786+0000","last_unstale":"2024-09-13T17:53:08.308238+0000","last_undegraded":"2024-09-13T17:53:08.308238+0000","last_fullsized":"2024-09-13T17:53:08.308238+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:54.581523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.325035+0000","last_change":"2024-09-13T17:53:08.321422+0000","last_active":"2024-09-13T17:53:08.325035+0000","last_peered":"2024-09-13T17:53:08.325035+0000","last_clean":"2024-09-13T17:53:08.325035+0000","last_became_active":"2024-09-13T17:53:08.319507+0000","last_became_peered":"2024-09-13T17:53:08.319507+0000","last_unstale":"2024-09-13T17:53:08.325035+0000","last_undegraded":"2024-09-13T17:53:08.325035+0000","last_fullsized":"2024-09-13T17:53:08.325035+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:08.746286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.307626+0000","last_change":"2024-09-13T17:53:07.929110+0000","last_active":"2024-09-13T17:53:08.307626+0000","last_peered":"2024-09-13T17:53:08.307626+0000","last_clean":"2024-09-13T17:53:08.307626+0000","last_became_active":"2024-09-13T17:53:07.928830+0000","last_became_peered":"2024-09-13T17:53:07.928830+0000","last_unstale":"2024-09-13T17:53:08.307626+0000","last_undegraded":"2024-09-13T17:53:08.307626+0000","last_fullsized":"2024-09-13T17:53:08.307626+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:42.477927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.325794+0000","last_change":"2024-09-13T17:53:08.316509+0000","last_active":"2024-09-13T17:53:08.325794+0000","last_peered":"2024-09-13T17:53:08.325794+0000","last_clean":"2024-09-13T17:53:08.325794+0000","last_became_active":"2024-09-13T17:53:08.316323+0000","last_became_peered":"2024-09-13T17:53:08.316323+0000","last_unstale":"2024-09-13T17:53:08.325794+0000","last_undegraded":"2024-09-13T17:53:08.325794+0000","last_fullsized":"2024-09-13T17:53:08.325794+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:02.660007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.311278+0000","last_change":"2024-09-13T17:53:07.928968+0000","last_active":"2024-09-13T17:53:08.311278+0000","last_peered":"2024-09-13T17:53:08.311278+0000","last_clean":"2024-09-13T17:53:08.311278+0000","last_became_active":"2024-09-13T17:53:07.928753+0000","last_became_peered":"2024-09-13T17:53:07.928753+0000","last_unstale":"2024-09-13T17:53:08.311278+0000","last_undegraded":"2024-09-13T17:53:08.311278+0000","last_fullsized":"2024-09-13T17:53:08.311278+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:14.788101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.344045+0000","last_change":"2024-09-13T17:53:08.337370+0000","last_active":"2024-09-13T17:53:08.344045+0000","last_peered":"2024-09-13T17:53:08.344045+0000","last_clean":"2024-09-13T17:53:08.344045+0000","last_became_active":"2024-09-13T17:53:08.335729+0000","last_became_peered":"2024-09-13T17:53:08.335729+0000","last_unstale":"2024-09-13T17:53:08.344045+0000","last_undegraded":"2024-09-13T17:53:08.344045+0000","last_fullsized":"2024-09-13T17:53:08.344045+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:24.523487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.322818+0000","last_change":"2024-09-13T17:53:07.923741+0000","last_active":"2024-09-13T17:53:08.322818+0000","last_peered":"2024-09-13T17:53:08.322818+0000","last_clean":"2024-09-13T17:53:08.322818+0000","last_became_active":"2024-09-13T17:53:07.922391+0000","last_became_peered":"2024-09-13T17:53:07.922391+0000","last_unstale":"2024-09-13T17:53:08.322818+0000","last_undegraded":"2024-09-13T17:53:08.322818+0000","last_fullsized":"2024-09-13T17:53:08.322818+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:54.581523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.334204+0000","last_change":"2024-09-13T17:53:08.330564+0000","last_active":"2024-09-13T17:53:08.334204+0000","last_peered":"2024-09-13T17:53:08.334204+0000","last_clean":"2024-09-13T17:53:08.334204+0000","last_became_active":"2024-09-13T17:53:08.326426+0000","last_became_peered":"2024-09-13T17:53:08.326426+0000","last_unstale":"2024-09-13T17:53:08.334204+0000","last_undegraded":"2024-09-13T17:53:08.334204+0000","last_fullsized":"2024-09-13T17:53:08.334204+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:48.932531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.317350+0000","last_change":"2024-09-13T17:53:07.928173+0000","last_active":"2024-09-13T17:53:08.317350+0000","last_peered":"2024-09-13T17:53:08.317350+0000","last_clean":"2024-09-13T17:53:08.317350+0000","last_became_active":"2024-09-13T17:53:07.927902+0000","last_became_peered":"2024-09-13T17:53:07.927902+0000","last_unstale":"2024-09-13T17:53:08.317350+0000","last_undegraded":"2024-09-13T17:53:08.317350+0000","last_fullsized":"2024-09-13T17:53:08.317350+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:14.147274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.341753+0000","last_change":"2024-09-13T17:53:08.335357+0000","last_active":"2024-09-13T17:53:08.341753+0000","last_peered":"2024-09-13T17:53:08.341753+0000","last_clean":"2024-09-13T17:53:08.341753+0000","last_became_active":"2024-09-13T17:53:08.334939+0000","last_became_peered":"2024-09-13T17:53:08.334939+0000","last_unstale":"2024-09-13T17:53:08.341753+0000","last_undegraded":"2024-09-13T17:53:08.341753+0000","last_fullsized":"2024-09-13T17:53:08.341753+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:48.932531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.310220+0000","last_change":"2024-09-13T17:53:07.943953+0000","last_active":"2024-09-13T17:53:08.310220+0000","last_peered":"2024-09-13T17:53:08.310220+0000","last_clean":"2024-09-13T17:53:08.310220+0000","last_became_active":"2024-09-13T17:53:07.943699+0000","last_became_peered":"2024-09-13T17:53:07.943699+0000","last_unstale":"2024-09-13T17:53:08.310220+0000","last_undegraded":"2024-09-13T17:53:08.310220+0000","last_fullsized":"2024-09-13T17:53:08.310220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:44.997390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T17:53:08.308718+0000","last_change":"2024-09-13T17:51:40.205691+0000","last_active":"2024-09-13T17:53:08.308718+0000","last_peered":"2024-09-13T17:53:08.308718+0000","last_clean":"2024-09-13T17:53:08.308718+0000","last_became_active":"2024-09-13T17:51:40.204577+0000","last_became_peered":"2024-09-13T17:51:40.204577+0000","last_unstale":"2024-09-13T17:53:08.308718+0000","last_undegraded":"2024-09-13T17:53:08.308718+0000","last_fullsized":"2024-09-13T17:53:08.308718+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_clean_scrub_stamp":"2024-09-13T17:51:38.340495+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:37.899275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":786117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.56100000000000005}]},{"osd":1,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.60699999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.66100000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.626}]},{"osd":4,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.72599999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.70099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":194697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.91100000000000003}]},{"osd":1,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.81000000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.86399999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.89300000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.622},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.55700000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.70799999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.72999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":194227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.623},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.749}]},{"osd":1,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.79700000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.0910000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.71299999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.81200000000000006}]},{"osd":4,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.72899999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.77300000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.83899999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":194719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.72699999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.63}]},{"osd":2,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.65400000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.76200000000000001}]},{"osd":5,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.79800000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.78200000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.75},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.59499999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":195713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.501},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":4.2460000000000004,"5min":4.2460000000000004,"15min":4.2460000000000004},"last":0.32100000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.008,"5min":5.008,"15min":5.008},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":4.8570000000000002,"5min":4.8570000000000002,"15min":4.8570000000000002},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":4.8399999999999999,"5min":4.8399999999999999,"15min":4.8399999999999999},"last":0.46700000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":4.4450000000000003,"5min":4.4450000000000003,"15min":4.4450000000000003},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":4.9000000000000004,"5min":4.9000000000000004,"15min":4.9000000000000004},"last":0.80400000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":0.746}]},{"osd":6,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":4.9710000000000001,"5min":4.9710000000000001,"15min":4.9710000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.59999999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":4.4029999999999996,"5min":4.4029999999999996,"15min":4.4029999999999996},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":4.9349999999999996,"5min":4.9349999999999996,"15min":4.9349999999999996},"last":0.76100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":194185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":5.5010000000000003,"5min":5.5010000000000003,"15min":5.5010000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":4.3689999999999998,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":5.3799999999999999,"5min":5.3799999999999999,"15min":5.3799999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":4.2329999999999997,"5min":4.2329999999999997,"15min":4.2329999999999997},"last":0.46999999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":5.032,"5min":5.032,"15min":5.032},"last":0.49199999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":5.4189999999999996,"5min":5.4189999999999996,"15min":5.4189999999999996},"last":0.48699999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":5.4480000000000004,"5min":5.4480000000000004,"15min":5.4480000000000004},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":4.7460000000000004,"5min":4.7460000000000004,"15min":4.7460000000000004},"last":0.69599999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":4.4710000000000001,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.748},{"interface":"front","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":5.4749999999999996,"5min":5.4749999999999996,"15min":5.4749999999999996},"last":0.56899999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":4.7789999999999999,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":4.9859999999999998,"5min":4.9859999999999998,"15min":4.9859999999999998},"last":0.66800000000000004}]},{"osd":7,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":4.8200000000000003,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.60499999999999998},{"interface":"front","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":4.8879999999999999,"5min":4.8879999999999999,"15min":4.8879999999999999},"last":0.71099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":194205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.69899999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.89800000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":1.054},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.57999999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":1.105}]},{"osd":5,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":1.115},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.0760000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.1799999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.96399999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.202},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.997}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":784517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.48499999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.45900000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.51500000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.0350000000000001,"5min":3.0350000000000001,"15min":3.0350000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.68500000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":0.75800000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.69399999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.9119999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.75,"5min":2.75,"15min":2.75},"last":0.73299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:53:17.230 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T17:53:17.231 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T17:53:17.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.407+0000 7fe607000640 1 Processor -- start 2024-09-13T17:53:17.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.407+0000 7fe607000640 1 -- start start 2024-09-13T17:53:17.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.407+0000 7fe607000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe600158a70 0x7fe600070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:17.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.407+0000 7fe607000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6000b2490 con 0x7fe6000b1c20 2024-09-13T17:53:17.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.407+0000 7fe607000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe600158e50 con 0x7fe600159be0 2024-09-13T17:53:17.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.407+0000 7fe607000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6000b21b0 con 0x7fe600158a70 2024-09-13T17:53:17.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.407+0000 7fe5ffe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe600158a70 0x7fe600070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:17.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.407+0000 7fe5ffe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe600158a70 0x7fe600070cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54040/0 (socket says 172.21.15.114:54040) 2024-09-13T17:53:17.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.407+0000 7fe605000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe6000b1c20 0x7fe6000cc910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52638/0 (socket says 172.21.15.114:52638) 2024-09-13T17:53:17.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.407+0000 7fe5ffe00640 1 -- 172.21.15.114:0/1133574204 learned_addr learned my addr 172.21.15.114:0/1133574204 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:17.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.407+0000 7fe5ffe00640 1 -- 172.21.15.114:0/1133574204 >> v1:172.21.15.134:6789/0 conn(0x7fe600159be0 legacy=0x7fe6000b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:17.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.407+0000 7fe5ffe00640 1 -- 172.21.15.114:0/1133574204 >> v1:172.21.15.114:6789/0 conn(0x7fe6000b1c20 legacy=0x7fe6000cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:17.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.407+0000 7fe5ffe00640 1 -- 172.21.15.114:0/1133574204 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe600159100 con 0x7fe600158a70 2024-09-13T17:53:17.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.411+0000 7fe5ffe00640 1 --2- 172.21.15.114:0/1133574204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe600158a70 0x7fe600070cb0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe5f000aa10 tx=0x7fe5f001d870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca7f1633911c2596 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:17.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.411+0000 7fe5ff400640 1 -- 172.21.15.114:0/1133574204 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f00a67d0 con 0x7fe600158a70 2024-09-13T17:53:17.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.411+0000 7fe5ff400640 1 -- 172.21.15.114:0/1133574204 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f00a6930 con 0x7fe600158a70 2024-09-13T17:53:17.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.411+0000 7fe5ff400640 1 -- 172.21.15.114:0/1133574204 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f00a6cc0 con 0x7fe600158a70 2024-09-13T17:53:17.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.411+0000 7fe607000640 1 -- 172.21.15.114:0/1133574204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe600158a70 msgr2=0x7fe600070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:17.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.411+0000 7fe607000640 1 --2- 172.21.15.114:0/1133574204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe600158a70 0x7fe600070cb0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe5f000aa10 tx=0x7fe5f001d870 comp rx=0 tx=0).stop 2024-09-13T17:53:17.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.411+0000 7fe607000640 1 -- 172.21.15.114:0/1133574204 shutdown_connections 2024-09-13T17:53:17.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.411+0000 7fe607000640 1 --2- 172.21.15.114:0/1133574204 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe600158a70 0x7fe600070cb0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:17.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.411+0000 7fe607000640 1 -- 172.21.15.114:0/1133574204 >> 172.21.15.114:0/1133574204 conn(0x7fe6000660b0 msgr2=0x7fe600069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:17.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.411+0000 7fe607000640 1 -- 172.21.15.114:0/1133574204 shutdown_connections 2024-09-13T17:53:17.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.411+0000 7fe607000640 1 -- 172.21.15.114:0/1133574204 wait complete. 2024-09-13T17:53:17.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.411+0000 7fe607000640 1 Processor -- start 2024-09-13T17:53:17.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.411+0000 7fe607000640 1 -- start start 2024-09-13T17:53:17.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.415+0000 7fe607000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6000b1c20 0x7fe60013ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:17.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.415+0000 7fe607000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe600158a70 0x7fe600152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:17.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.415+0000 7fe607000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe600159be0 0x7fe600154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:17.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.415+0000 7fe607000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60013b1d0 con 0x7fe6000b1c20 2024-09-13T17:53:17.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.415+0000 7fe607000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60014a9e0 con 0x7fe600158a70 2024-09-13T17:53:17.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.415+0000 7fe607000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe600153530 con 0x7fe600159be0 2024-09-13T17:53:17.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.415+0000 7fe5ffe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6000b1c20 0x7fe60013ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:17.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.415+0000 7fe5ffe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6000b1c20 0x7fe60013ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54048/0 (socket says 172.21.15.114:54048) 2024-09-13T17:53:17.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.415+0000 7fe5ffe00640 1 -- 172.21.15.114:0/2291201443 learned_addr learned my addr 172.21.15.114:0/2291201443 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:17.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.415+0000 7fe5f7400640 1 --2- 172.21.15.114:0/2291201443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe600158a70 0x7fe600152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:17.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.415+0000 7fe605000640 1 --2- 172.21.15.114:0/2291201443 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe600159be0 0x7fe600154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:17.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.415+0000 7fe5ffe00640 1 -- 172.21.15.114:0/2291201443 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe600159be0 msgr2=0x7fe600154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:17.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.415+0000 7fe5ffe00640 1 --2- 172.21.15.114:0/2291201443 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe600159be0 0x7fe600154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:17.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.415+0000 7fe5ffe00640 1 -- 172.21.15.114:0/2291201443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe600158a70 msgr2=0x7fe600152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:17.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.415+0000 7fe5ffe00640 1 --2- 172.21.15.114:0/2291201443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe600158a70 0x7fe600152a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:17.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.415+0000 7fe5ffe00640 1 -- 172.21.15.114:0/2291201443 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f000a670 con 0x7fe6000b1c20 2024-09-13T17:53:17.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.415+0000 7fe5ffe00640 1 --2- 172.21.15.114:0/2291201443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6000b1c20 0x7fe60013ac90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe5f000a1c0 tx=0x7fe5f001c0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:17.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.415+0000 7fe5fcc00640 1 -- 172.21.15.114:0/2291201443 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f00ae950 con 0x7fe6000b1c20 2024-09-13T17:53:17.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.415+0000 7fe5fcc00640 1 -- 172.21.15.114:0/2291201443 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f00aeab0 con 0x7fe6000b1c20 2024-09-13T17:53:17.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.415+0000 7fe5fcc00640 1 -- 172.21.15.114:0/2291201443 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f00aee60 con 0x7fe6000b1c20 2024-09-13T17:53:17.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.415+0000 7fe607000640 1 -- 172.21.15.114:0/2291201443 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe60014aca0 con 0x7fe6000b1c20 2024-09-13T17:53:17.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.415+0000 7fe607000640 1 -- 172.21.15.114:0/2291201443 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe60014b260 con 0x7fe6000b1c20 2024-09-13T17:53:17.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.415+0000 7fe607000640 1 -- 172.21.15.114:0/2291201443 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe600070cb0 con 0x7fe6000b1c20 2024-09-13T17:53:17.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.415+0000 7fe5fcc00640 1 -- 172.21.15.114:0/2291201443 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe5f00b5070 con 0x7fe6000b1c20 2024-09-13T17:53:17.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.419+0000 7fe5fcc00640 1 --2- 172.21.15.114:0/2291201443 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe5dc066690 0x7fe5dc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:17.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.419+0000 7fe5fcc00640 1 -- 172.21.15.114:0/2291201443 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe5f011f0c0 con 0x7fe6000b1c20 2024-09-13T17:53:17.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.419+0000 7fe5f7400640 1 --2- 172.21.15.114:0/2291201443 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe5dc066690 0x7fe5dc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:17.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.419+0000 7fe5f7400640 1 --2- 172.21.15.114:0/2291201443 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe5dc066690 0x7fe5dc068b50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe6000afef0 tx=0x7fe5e8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:17.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.423+0000 7fe5fcc00640 1 -- 172.21.15.114:0/2291201443 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe5f00ec2e0 con 0x7fe6000b1c20 2024-09-13T17:53:17.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.631+0000 7fe607000640 1 -- 172.21.15.114:0/2291201443 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe600150c50 con 0x7fe6000b1c20 2024-09-13T17:53:17.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.635+0000 7fe5fcc00640 1 -- 172.21.15.114:0/2291201443 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7fe5f00ef900 con 0x7fe6000b1c20 2024-09-13T17:53:17.640 INFO:teuthology.orchestra.run.smithi114.stderr:updated caps for client.0 2024-09-13T17:53:17.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.635+0000 7fe607000640 1 -- 172.21.15.114:0/2291201443 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe5dc066690 msgr2=0x7fe5dc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:17.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.635+0000 7fe607000640 1 --2- 172.21.15.114:0/2291201443 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe5dc066690 0x7fe5dc068b50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe6000afef0 tx=0x7fe5e8009040 comp rx=0 tx=0).stop 2024-09-13T17:53:17.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.635+0000 7fe607000640 1 -- 172.21.15.114:0/2291201443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6000b1c20 msgr2=0x7fe60013ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:17.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.635+0000 7fe607000640 1 --2- 172.21.15.114:0/2291201443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6000b1c20 0x7fe60013ac90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe5f000a1c0 tx=0x7fe5f001c0b0 comp rx=0 tx=0).stop 2024-09-13T17:53:17.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.635+0000 7fe607000640 1 -- 172.21.15.114:0/2291201443 shutdown_connections 2024-09-13T17:53:17.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.635+0000 7fe607000640 1 --2- 172.21.15.114:0/2291201443 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe5dc066690 0x7fe5dc068b50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:17.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.635+0000 7fe607000640 1 --2- 172.21.15.114:0/2291201443 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe600159be0 0x7fe600154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:17.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.635+0000 7fe607000640 1 --2- 172.21.15.114:0/2291201443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe600158a70 0x7fe600152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:17.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.635+0000 7fe607000640 1 --2- 172.21.15.114:0/2291201443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6000b1c20 0x7fe60013ac90 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:17.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.635+0000 7fe607000640 1 -- 172.21.15.114:0/2291201443 >> 172.21.15.114:0/2291201443 conn(0x7fe6000660b0 msgr2=0x7fe6000b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:17.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.639+0000 7fe607000640 1 -- 172.21.15.114:0/2291201443 shutdown_connections 2024-09-13T17:53:17.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.639+0000 7fe607000640 1 -- 172.21.15.114:0/2291201443 wait complete. 2024-09-13T17:53:17.661 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:53:17.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.791+0000 7fb0f2a00640 1 Processor -- start 2024-09-13T17:53:17.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.791+0000 7fb0f2a00640 1 -- start start 2024-09-13T17:53:17.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.791+0000 7fb0f2a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb0ec13f420 0x7fb0ec06d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:17.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.791+0000 7fb0f2a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb0ec06da90 0x7fb0ec0cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:17.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.791+0000 7fb0f2a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0ec0cd220 con 0x7fb0ec13c240 2024-09-13T17:53:17.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.791+0000 7fb0f2a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0ec06df40 con 0x7fb0ec13f420 2024-09-13T17:53:17.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.791+0000 7fb0f2a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec15a740 con 0x7fb0ec06da90 2024-09-13T17:53:17.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.791+0000 7fb0ebe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb0ec13c240 0x7fb0ec13c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52644/0 (socket says 172.21.15.114:52644) 2024-09-13T17:53:17.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.791+0000 7fb0ebe00640 1 -- 172.21.15.114:0/492441423 learned_addr learned my addr 172.21.15.114:0/492441423 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:17.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.791+0000 7fb0e3400640 1 --2- 172.21.15.114:0/492441423 >> v2:172.21.15.114:3300/0 conn(0x7fb0ec13f420 0x7fb0ec06d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:17.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.791+0000 7fb0f0a00640 1 --2- 172.21.15.114:0/492441423 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb0ec06da90 0x7fb0ec0cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:17.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.791+0000 7fb0eb400640 1 -- 172.21.15.114:0/492441423 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3392167516 0 0) 0x7fb0ec0cd220 con 0x7fb0ec13c240 2024-09-13T17:53:17.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.791+0000 7fb0eb400640 1 -- 172.21.15.114:0/492441423 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0d0003530 con 0x7fb0ec13c240 2024-09-13T17:53:17.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.791+0000 7fb0e3400640 1 -- 172.21.15.114:0/492441423 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb0ec06da90 msgr2=0x7fb0ec0cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:17.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.791+0000 7fb0e3400640 1 --2- 172.21.15.114:0/492441423 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb0ec06da90 0x7fb0ec0cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:17.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.791+0000 7fb0e3400640 1 -- 172.21.15.114:0/492441423 >> v1:172.21.15.114:6789/0 conn(0x7fb0ec13c240 legacy=0x7fb0ec13c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:17.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.791+0000 7fb0e3400640 1 -- 172.21.15.114:0/492441423 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ec159bc0 con 0x7fb0ec13f420 2024-09-13T17:53:17.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.795+0000 7fb0e3400640 1 --2- 172.21.15.114:0/492441423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0ec13f420 0x7fb0ec06d550 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb0d40097c0 tx=0x7fb0d401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2a2bdbd6a2595b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:17.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.795+0000 7fb0eb400640 1 -- 172.21.15.114:0/492441423 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d40ab670 con 0x7fb0ec13f420 2024-09-13T17:53:17.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.795+0000 7fb0eb400640 1 -- 172.21.15.114:0/492441423 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d40ab7d0 con 0x7fb0ec13f420 2024-09-13T17:53:17.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.795+0000 7fb0eb400640 1 -- 172.21.15.114:0/492441423 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d40abb60 con 0x7fb0ec13f420 2024-09-13T17:53:17.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.795+0000 7fb0f2a00640 1 -- 172.21.15.114:0/492441423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0ec13f420 msgr2=0x7fb0ec06d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:17.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.795+0000 7fb0f2a00640 1 --2- 172.21.15.114:0/492441423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0ec13f420 0x7fb0ec06d550 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb0d40097c0 tx=0x7fb0d401c470 comp rx=0 tx=0).stop 2024-09-13T17:53:17.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.795+0000 7fb0f2a00640 1 -- 172.21.15.114:0/492441423 shutdown_connections 2024-09-13T17:53:17.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.795+0000 7fb0f2a00640 1 --2- 172.21.15.114:0/492441423 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb0ec06da90 0x7fb0ec0cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:17.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.795+0000 7fb0f2a00640 1 --2- 172.21.15.114:0/492441423 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0ec13f420 0x7fb0ec06d550 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:17.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.795+0000 7fb0f2a00640 1 -- 172.21.15.114:0/492441423 >> 172.21.15.114:0/492441423 conn(0x7fb0ec0660b0 msgr2=0x7fb0ec069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:17.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.795+0000 7fb0f2a00640 1 -- 172.21.15.114:0/492441423 shutdown_connections 2024-09-13T17:53:17.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.795+0000 7fb0f2a00640 1 -- 172.21.15.114:0/492441423 wait complete. 2024-09-13T17:53:17.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.799+0000 7fb0f2a00640 1 Processor -- start 2024-09-13T17:53:17.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.799+0000 7fb0f2a00640 1 -- start start 2024-09-13T17:53:17.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.799+0000 7fb0f2a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0ec06da90 0x7fb0ec13c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:17.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.799+0000 7fb0f2a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb0ec13c240 0x7fb0ec14e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:17.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.799+0000 7fb0f2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0ec13f420 0x7fb0ec138890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:17.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.799+0000 7fb0f2a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec14dc50 con 0x7fb0ec13f420 2024-09-13T17:53:17.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.799+0000 7fb0f2a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec14f270 con 0x7fb0ec06da90 2024-09-13T17:53:17.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.799+0000 7fb0f2a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec14ed50 con 0x7fb0ec13c240 2024-09-13T17:53:17.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.799+0000 7fb0f0a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0ec13f420 0x7fb0ec138890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:17.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.799+0000 7fb0ebe00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0ec06da90 0x7fb0ec13c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:17.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.799+0000 7fb0f0a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0ec13f420 0x7fb0ec138890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54066/0 (socket says 172.21.15.114:54066) 2024-09-13T17:53:17.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.799+0000 7fb0ebe00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0ec06da90 0x7fb0ec13c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:33582/0 (socket says 172.21.15.114:33582) 2024-09-13T17:53:17.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.799+0000 7fb0f0a00640 1 -- 172.21.15.114:0/714017543 learned_addr learned my addr 172.21.15.114:0/714017543 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:17.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.799+0000 7fb0e3400640 1 --2- 172.21.15.114:0/714017543 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb0ec13c240 0x7fb0ec14e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:17.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.799+0000 7fb0f0a00640 1 -- 172.21.15.114:0/714017543 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb0ec13c240 msgr2=0x7fb0ec14e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:17.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.799+0000 7fb0f0a00640 1 --2- 172.21.15.114:0/714017543 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb0ec13c240 0x7fb0ec14e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:17.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.799+0000 7fb0f0a00640 1 -- 172.21.15.114:0/714017543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0ec06da90 msgr2=0x7fb0ec13c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:17.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.799+0000 7fb0f0a00640 1 --2- 172.21.15.114:0/714017543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0ec06da90 0x7fb0ec13c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:17.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.799+0000 7fb0f0a00640 1 -- 172.21.15.114:0/714017543 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d4009420 con 0x7fb0ec13f420 2024-09-13T17:53:17.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.799+0000 7fb0f0a00640 1 --2- 172.21.15.114:0/714017543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0ec13f420 0x7fb0ec138890 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4007e40 tx=0x7fb0e400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:17.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.799+0000 7fb0e8c00640 1 -- 172.21.15.114:0/714017543 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e4014620 con 0x7fb0ec13f420 2024-09-13T17:53:17.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.799+0000 7fb0e8c00640 1 -- 172.21.15.114:0/714017543 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e400ee90 con 0x7fb0ec13f420 2024-09-13T17:53:17.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.799+0000 7fb0f2a00640 1 -- 172.21.15.114:0/714017543 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0ec14f480 con 0x7fb0ec13f420 2024-09-13T17:53:17.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.799+0000 7fb0e8c00640 1 -- 172.21.15.114:0/714017543 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e40149e0 con 0x7fb0ec13f420 2024-09-13T17:53:17.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.799+0000 7fb0f2a00640 1 -- 172.21.15.114:0/714017543 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0ec14d970 con 0x7fb0ec13f420 2024-09-13T17:53:17.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.803+0000 7fb0f2a00640 1 -- 172.21.15.114:0/714017543 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0ec159790 con 0x7fb0ec13f420 2024-09-13T17:53:17.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.803+0000 7fb0e8c00640 1 -- 172.21.15.114:0/714017543 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb0e4014b40 con 0x7fb0ec13f420 2024-09-13T17:53:17.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.803+0000 7fb0e8c00640 1 --2- 172.21.15.114:0/714017543 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb0c8066690 0x7fb0c8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:17.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.803+0000 7fb0e8c00640 1 -- 172.21.15.114:0/714017543 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb0e4084b40 con 0x7fb0ec13f420 2024-09-13T17:53:17.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.803+0000 7fb0ebe00640 1 --2- 172.21.15.114:0/714017543 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb0c8066690 0x7fb0c8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:17.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.803+0000 7fb0ebe00640 1 --2- 172.21.15.114:0/714017543 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb0c8066690 0x7fb0c8068b50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc0011f0 tx=0x7fb0dc007d40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:17.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.807+0000 7fb0e8c00640 1 -- 172.21.15.114:0/714017543 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb0e4051e10 con 0x7fb0ec13f420 2024-09-13T17:53:18.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.995+0000 7fb0f2a00640 1 -- 172.21.15.114:0/714017543 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0ec13b190 con 0x7fb0ec13f420 2024-09-13T17:53:18.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.995+0000 7fb0e8c00640 1 -- 172.21.15.114:0/714017543 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4743 (secure 0 0 0) 0x7fb0e4055430 con 0x7fb0ec13f420 2024-09-13T17:53:18.001 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:18.001 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4940,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/895508060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":895508060},{"type":"v1","addr":"172.21.15.134:6834","nonce":895508060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5230,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1163188146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":1163188146},{"type":"v1","addr":"172.21.15.114:6837","nonce":1163188146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5313,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1106595705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1106595705},{"type":"v1","addr":"172.21.15.114:6835","nonce":1106595705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:53:08.298484+0000","modified":"2024-09-13T17:53:11.309977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5316},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5316":{"gid":5316,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/1239035445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":1239035445},{"type":"v1","addr":"172.21.15.134:6835","nonce":1239035445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T17:53:18.001 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 17 2024-09-13T17:53:18.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.999+0000 7fb0f2a00640 1 -- 172.21.15.114:0/714017543 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb0c8066690 msgr2=0x7fb0c8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:18.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.999+0000 7fb0f2a00640 1 --2- 172.21.15.114:0/714017543 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb0c8066690 0x7fb0c8068b50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc0011f0 tx=0x7fb0dc007d40 comp rx=0 tx=0).stop 2024-09-13T17:53:18.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.999+0000 7fb0f2a00640 1 -- 172.21.15.114:0/714017543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0ec13f420 msgr2=0x7fb0ec138890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:18.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.999+0000 7fb0f2a00640 1 --2- 172.21.15.114:0/714017543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0ec13f420 0x7fb0ec138890 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4007e40 tx=0x7fb0e400e4b0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.999+0000 7fb0f2a00640 1 -- 172.21.15.114:0/714017543 shutdown_connections 2024-09-13T17:53:18.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.999+0000 7fb0f2a00640 1 --2- 172.21.15.114:0/714017543 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb0c8066690 0x7fb0c8068b50 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.999+0000 7fb0f2a00640 1 --2- 172.21.15.114:0/714017543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0ec13f420 0x7fb0ec138890 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.999+0000 7fb0f2a00640 1 --2- 172.21.15.114:0/714017543 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb0ec13c240 0x7fb0ec14e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.999+0000 7fb0f2a00640 1 --2- 172.21.15.114:0/714017543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0ec06da90 0x7fb0ec13c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.999+0000 7fb0f2a00640 1 -- 172.21.15.114:0/714017543 >> 172.21.15.114:0/714017543 conn(0x7fb0ec0660b0 msgr2=0x7fb0ec14ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:18.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.999+0000 7fb0f2a00640 1 -- 172.21.15.114:0/714017543 shutdown_connections 2024-09-13T17:53:18.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:17.999+0000 7fb0f2a00640 1 -- 172.21.15.114:0/714017543 wait complete. 2024-09-13T17:53:18.425 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:53:08.298484+0000', 'modified': '2024-09-13T17:53:11.309977+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5316}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5316': {'gid': 5316, 'name': 'd', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.134:6835/1239035445', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6833', 'nonce': 1239035445}, {'type': 'v1', 'addr': '172.21.15.134:6835', 'nonce': 1239035445}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:53:18.425 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T17:53:18.425 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-13T17:53:18.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba82400640 1 Processor -- start 2024-09-13T17:53:18.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba82400640 1 -- start start 2024-09-13T17:53:18.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba82400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fba7c06bfc0 0x7fba7c0d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba82400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7c0ca980 con 0x7fba7c15c880 2024-09-13T17:53:18.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba82400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7c06c450 con 0x7fba7c099180 2024-09-13T17:53:18.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba82400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7c15cc60 con 0x7fba7c06bfc0 2024-09-13T17:53:18.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba81000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fba7c15c880 0x7fba7c098a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52648/0 (socket says 172.21.15.114:52648) 2024-09-13T17:53:18.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba81000640 1 -- 172.21.15.114:0/3444485183 learned_addr learned my addr 172.21.15.114:0/3444485183 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:18.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba7be00640 1 --2- 172.21.15.114:0/3444485183 >> v2:172.21.15.134:3300/0 conn(0x7fba7c06bfc0 0x7fba7c0d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba7b400640 1 -- 172.21.15.114:0/3444485183 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2023187793 0 0) 0x7fba7c0ca980 con 0x7fba7c15c880 2024-09-13T17:53:18.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba7b400640 1 -- 172.21.15.114:0/3444485183 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba60003530 con 0x7fba7c15c880 2024-09-13T17:53:18.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba7b400640 1 -- 172.21.15.114:0/3444485183 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2330953844 0 0) 0x7fba60003530 con 0x7fba7c15c880 2024-09-13T17:53:18.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba7b400640 1 -- 172.21.15.114:0/3444485183 >> v2:172.21.15.134:3300/0 conn(0x7fba7c06bfc0 msgr2=0x7fba7c0d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:18.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba7b400640 1 --2- 172.21.15.114:0/3444485183 >> v2:172.21.15.134:3300/0 conn(0x7fba7c06bfc0 0x7fba7c0d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba7b400640 1 -- 172.21.15.114:0/3444485183 >> v1:172.21.15.134:6789/0 conn(0x7fba7c099180 legacy=0x7fba7c0cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:18.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba7b400640 1 -- 172.21.15.114:0/3444485183 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c06c730 con 0x7fba7c15c880 2024-09-13T17:53:18.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba7b400640 1 -- 172.21.15.114:0/3444485183 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7fba6c001680 con 0x7fba7c15c880 2024-09-13T17:53:18.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba7b400640 1 -- 172.21.15.114:0/3444485183 >> v1:172.21.15.114:6789/0 conn(0x7fba7c15c880 legacy=0x7fba7c098a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:18.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba7b400640 1 --2- 172.21.15.114:0/3444485183 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba60003980 0x7fba60003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba7b400640 1 --2- 172.21.15.114:0/3444485183 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba600047d0 0x7fba60004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba7b400640 1 --2- 172.21.15.114:0/3444485183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba60005190 0x7fba6000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba7b400640 1 -- 172.21.15.114:0/3444485183 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c15cc60 con 0x7fba600047d0 2024-09-13T17:53:18.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba7b400640 1 -- 172.21.15.114:0/3444485183 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6000c130 con 0x7fba60005190 2024-09-13T17:53:18.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba7b400640 1 -- 172.21.15.114:0/3444485183 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba6000c2f0 con 0x7fba60003980 2024-09-13T17:53:18.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba7be00640 1 --2- 172.21.15.114:0/3444485183 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba600047d0 0x7fba60004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba81000640 1 --2- 172.21.15.114:0/3444485183 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba60003980 0x7fba60003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba81a00640 1 --2- 172.21.15.114:0/3444485183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba60005190 0x7fba6000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba7be00640 1 -- 172.21.15.114:0/3444485183 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba60003980 msgr2=0x7fba60003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:18.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba7be00640 1 --2- 172.21.15.114:0/3444485183 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba60003980 0x7fba60003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba7be00640 1 -- 172.21.15.114:0/3444485183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba60005190 msgr2=0x7fba6000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:18.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba7be00640 1 --2- 172.21.15.114:0/3444485183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba60005190 0x7fba6000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba7be00640 1 -- 172.21.15.114:0/3444485183 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba60003530 con 0x7fba600047d0 2024-09-13T17:53:18.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba81000640 1 --2- 172.21.15.114:0/3444485183 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba60003980 0x7fba60003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:18.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.559+0000 7fba81a00640 1 --2- 172.21.15.114:0/3444485183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba60005190 0x7fba6000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:18.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.563+0000 7fba81a00640 1 -- 172.21.15.114:0/3444485183 reap_dead start 2024-09-13T17:53:18.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.563+0000 7fba7be00640 1 --2- 172.21.15.114:0/3444485183 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba600047d0 0x7fba60004c50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fba68009ae0 tx=0x7fba6801ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=315e38d6fc532916 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:18.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.563+0000 7fba7b400640 1 -- 172.21.15.114:0/3444485183 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba680a5520 con 0x7fba600047d0 2024-09-13T17:53:18.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.563+0000 7fba7b400640 1 -- 172.21.15.114:0/3444485183 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba680a5680 con 0x7fba600047d0 2024-09-13T17:53:18.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.563+0000 7fba7b400640 1 -- 172.21.15.114:0/3444485183 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba680a5a30 con 0x7fba600047d0 2024-09-13T17:53:18.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.563+0000 7fba82400640 1 -- 172.21.15.114:0/3444485183 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba600047d0 msgr2=0x7fba60004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:18.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.563+0000 7fba82400640 1 --2- 172.21.15.114:0/3444485183 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba600047d0 0x7fba60004c50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fba68009ae0 tx=0x7fba6801ca40 comp rx=0 tx=0).stop 2024-09-13T17:53:18.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.563+0000 7fba82400640 1 -- 172.21.15.114:0/3444485183 shutdown_connections 2024-09-13T17:53:18.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.563+0000 7fba82400640 1 --2- 172.21.15.114:0/3444485183 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba600047d0 0x7fba60004c50 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.563+0000 7fba82400640 1 -- 172.21.15.114:0/3444485183 >> 172.21.15.114:0/3444485183 conn(0x7fba7c0d0330 msgr2=0x7fba7c0d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:18.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.563+0000 7fba82400640 1 -- 172.21.15.114:0/3444485183 shutdown_connections 2024-09-13T17:53:18.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.563+0000 7fba82400640 1 -- 172.21.15.114:0/3444485183 wait complete. 2024-09-13T17:53:18.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.567+0000 7fba82400640 1 Processor -- start 2024-09-13T17:53:18.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.567+0000 7fba82400640 1 -- start start 2024-09-13T17:53:18.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.567+0000 7fba82400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba600047d0 0x7fba7c0c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.567+0000 7fba82400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba7c15aee0 0x7fba7c15f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.567+0000 7fba82400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba7c152440 0x7fba7c1528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.567+0000 7fba82400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c152e00 con 0x7fba600047d0 2024-09-13T17:53:18.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.567+0000 7fba82400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0c9e90 con 0x7fba7c15aee0 2024-09-13T17:53:18.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.567+0000 7fba82400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0c98d0 con 0x7fba7c152440 2024-09-13T17:53:18.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.567+0000 7fba81000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba600047d0 0x7fba7c0c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.567+0000 7fba81000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba600047d0 0x7fba7c0c92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54084/0 (socket says 172.21.15.114:54084) 2024-09-13T17:53:18.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.567+0000 7fba81000640 1 -- 172.21.15.114:0/2496778651 learned_addr learned my addr 172.21.15.114:0/2496778651 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:18.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.567+0000 7fba7be00640 1 --2- 172.21.15.114:0/2496778651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba7c15aee0 0x7fba7c15f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.567+0000 7fba81a00640 1 --2- 172.21.15.114:0/2496778651 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba7c152440 0x7fba7c1528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.567+0000 7fba81000640 1 -- 172.21.15.114:0/2496778651 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba7c152440 msgr2=0x7fba7c1528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:18.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.567+0000 7fba81000640 1 --2- 172.21.15.114:0/2496778651 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba7c152440 0x7fba7c1528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.567+0000 7fba81000640 1 -- 172.21.15.114:0/2496778651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba7c15aee0 msgr2=0x7fba7c15f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:18.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.567+0000 7fba81000640 1 --2- 172.21.15.114:0/2496778651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba7c15aee0 0x7fba7c15f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.567+0000 7fba81000640 1 -- 172.21.15.114:0/2496778651 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c0c9bb0 con 0x7fba600047d0 2024-09-13T17:53:18.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.567+0000 7fba81a00640 1 --2- 172.21.15.114:0/2496778651 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba7c152440 0x7fba7c1528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:18.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.567+0000 7fba7be00640 1 --2- 172.21.15.114:0/2496778651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba7c15aee0 0x7fba7c15f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:18.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.567+0000 7fba81000640 1 --2- 172.21.15.114:0/2496778651 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba600047d0 0x7fba7c0c92f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fba6c001210 tx=0x7fba6c00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:18.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.567+0000 7fba78c00640 1 -- 172.21.15.114:0/2496778651 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c00ee60 con 0x7fba600047d0 2024-09-13T17:53:18.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.567+0000 7fba78c00640 1 -- 172.21.15.114:0/2496778651 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6c00c840 con 0x7fba600047d0 2024-09-13T17:53:18.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.567+0000 7fba82400640 1 -- 172.21.15.114:0/2496778651 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7c15ced0 con 0x7fba600047d0 2024-09-13T17:53:18.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.567+0000 7fba78c00640 1 -- 172.21.15.114:0/2496778651 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c00cbb0 con 0x7fba600047d0 2024-09-13T17:53:18.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.567+0000 7fba82400640 1 -- 172.21.15.114:0/2496778651 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7c15b360 con 0x7fba600047d0 2024-09-13T17:53:18.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.571+0000 7fba78c00640 1 -- 172.21.15.114:0/2496778651 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fba6c00cd10 con 0x7fba600047d0 2024-09-13T17:53:18.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.571+0000 7fba78c00640 1 --2- 172.21.15.114:0/2496778651 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fba5c0666c0 0x7fba5c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.571+0000 7fba78c00640 1 -- 172.21.15.114:0/2496778651 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fba6c083f00 con 0x7fba600047d0 2024-09-13T17:53:18.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.571+0000 7fba7be00640 1 --2- 172.21.15.114:0/2496778651 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fba5c0666c0 0x7fba5c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.571+0000 7fba86e6b000 1 Processor -- start 2024-09-13T17:53:18.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.571+0000 7fba86e6b000 1 -- start start 2024-09-13T17:53:18.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.571+0000 7fba7be00640 1 --2- 172.21.15.114:0/2496778651 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fba5c0666c0 0x7fba5c068b80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fba680af000 tx=0x7fba68008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:18.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba86e6b000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f60dda21f0 0x55f60dda25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba86e6b000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f60dda2b10 0x55f60dd58200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba86e6b000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f60dd58740 0x55f60dd58b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba86e6b000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f60dc20e80 con 0x55f60dda21f0 2024-09-13T17:53:18.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba86e6b000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f60dbaeaf0 con 0x55f60dda2b10 2024-09-13T17:53:18.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba86e6b000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f60dbac0c0 con 0x55f60dd58740 2024-09-13T17:53:18.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba81000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f60dda21f0 0x55f60dda25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba81000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f60dda21f0 0x55f60dda25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54100/0 (socket says 172.21.15.114:54100) 2024-09-13T17:53:18.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba81000640 1 -- 172.21.15.114:0/3494050555 learned_addr learned my addr 172.21.15.114:0/3494050555 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:18.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba81a00640 1 --2- 172.21.15.114:0/3494050555 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f60dd58740 0x55f60dd58b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba7be00640 1 --2- 172.21.15.114:0/3494050555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f60dda2b10 0x55f60dd58200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba81000640 1 -- 172.21.15.114:0/3494050555 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f60dd58740 msgr2=0x55f60dd58b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:18.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba81000640 1 --2- 172.21.15.114:0/3494050555 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f60dd58740 0x55f60dd58b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba81000640 1 -- 172.21.15.114:0/3494050555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f60dda2b10 msgr2=0x55f60dd58200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:18.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba81000640 1 --2- 172.21.15.114:0/3494050555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f60dda2b10 0x55f60dd58200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba81000640 1 -- 172.21.15.114:0/3494050555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f60d8a3890 con 0x55f60dda21f0 2024-09-13T17:53:18.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba81000640 1 --2- 172.21.15.114:0/3494050555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f60dda21f0 0x55f60dda25d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fba6c05cca0 tx=0x7fba6c054a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c50eb94181a3b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:18.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba71600640 1 -- 172.21.15.114:0/3494050555 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c058c10 con 0x55f60dda21f0 2024-09-13T17:53:18.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba71600640 1 -- 172.21.15.114:0/3494050555 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6c05d1d0 con 0x55f60dda21f0 2024-09-13T17:53:18.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba71600640 1 -- 172.21.15.114:0/3494050555 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c053180 con 0x55f60dda21f0 2024-09-13T17:53:18.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba86e6b000 1 -- 172.21.15.114:0/3494050555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f60dda21f0 msgr2=0x55f60dda25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:18.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba86e6b000 1 --2- 172.21.15.114:0/3494050555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f60dda21f0 0x55f60dda25d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fba6c05cca0 tx=0x7fba6c054a50 comp rx=0 tx=0).stop 2024-09-13T17:53:18.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba86e6b000 1 -- 172.21.15.114:0/3494050555 shutdown_connections 2024-09-13T17:53:18.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba86e6b000 1 --2- 172.21.15.114:0/3494050555 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f60dd58740 0x55f60dd58b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba86e6b000 1 --2- 172.21.15.114:0/3494050555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f60dda2b10 0x55f60dd58200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba86e6b000 1 --2- 172.21.15.114:0/3494050555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f60dda21f0 0x55f60dda25d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba86e6b000 1 -- 172.21.15.114:0/3494050555 >> 172.21.15.114:0/3494050555 conn(0x55f60dd5efb0 msgr2=0x55f60dd5f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:18.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba86e6b000 1 -- 172.21.15.114:0/3494050555 shutdown_connections 2024-09-13T17:53:18.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba86e6b000 1 -- 172.21.15.114:0/3494050555 wait complete. 2024-09-13T17:53:18.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba86e6b000 1 -- start start 2024-09-13T17:53:18.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba86e6b000 1 Processor -- start 2024-09-13T17:53:18.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba86e6b000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f60dd58740 0x55f60dd63fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba86e6b000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f60dda21f0 0x55f60dd644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba86e6b000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f60dda2b10 0x55f60dd64a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba86e6b000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f60dba79b0 con 0x55f60dda21f0 2024-09-13T17:53:18.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba86e6b000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f60db46c00 con 0x55f60dd58740 2024-09-13T17:53:18.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba86e6b000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f60db65070 con 0x55f60dda2b10 2024-09-13T17:53:18.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba86e6b000 10 client.0 _ll_register_callbacks cb 0x55f60dd44ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:53:18.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.575+0000 7fba7be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f60dda21f0 0x55f60dd644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba7be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f60dda21f0 0x55f60dd644f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54104/0 (socket says 172.21.15.114:54104) 2024-09-13T17:53:18.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba7be00640 1 -- 172.21.15.114:0/712249658 learned_addr learned my addr 172.21.15.114:0/712249658 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:18.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba81000640 1 --2- 172.21.15.114:0/712249658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f60dd58740 0x55f60dd63fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba81a00640 1 --2- 172.21.15.114:0/712249658 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f60dda2b10 0x55f60dd64a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba7be00640 1 -- 172.21.15.114:0/712249658 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f60dda2b10 msgr2=0x55f60dd64a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:18.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba7be00640 1 --2- 172.21.15.114:0/712249658 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f60dda2b10 0x55f60dd64a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba7be00640 1 -- 172.21.15.114:0/712249658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f60dd58740 msgr2=0x55f60dd63fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:18.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba7be00640 1 --2- 172.21.15.114:0/712249658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f60dd58740 0x55f60dd63fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba7be00640 1 -- 172.21.15.114:0/712249658 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7c15b360 con 0x55f60dda21f0 2024-09-13T17:53:18.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba7be00640 1 --2- 172.21.15.114:0/712249658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f60dda21f0 0x55f60dd644f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fba68000c10 tx=0x7fba680197e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de399fafb964374 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:18.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba66000640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-13T17:53:18.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba66000640 1 -- 172.21.15.114:0/712249658 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba680ad640 con 0x55f60dda21f0 2024-09-13T17:53:18.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba86e6b000 1 -- 172.21.15.114:0/712249658 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f60db645f0 con 0x55f60dda21f0 2024-09-13T17:53:18.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba66000640 1 -- 172.21.15.114:0/712249658 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fba680ad7a0 con 0x55f60dda21f0 2024-09-13T17:53:18.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba66000640 1 -- 172.21.15.114:0/712249658 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba680ad9a0 con 0x55f60dda21f0 2024-09-13T17:53:18.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba86e6b000 10 client.5517 fetch_fsmap learned FSMap version 17 2024-09-13T17:53:18.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba86e6b000 1 -- 172.21.15.114:0/712249658 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55f60db6cab0 con 0x55f60dda21f0 2024-09-13T17:53:18.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba66000640 1 -- 172.21.15.114:0/712249658 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f60db645f0 con 0x55f60dda21f0 2024-09-13T17:53:18.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba66000640 1 -- 172.21.15.114:0/712249658 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fba680adb00 con 0x55f60dda21f0 2024-09-13T17:53:18.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba86e6b000 10 client.5517 fetch_fsmap finished waiting for FSMap version 17 2024-09-13T17:53:18.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba86e6b000 10 client.5517 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T17:53:18.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba86e6b000 20 client.5517 populate_metadata read hostname 'smithi114' 2024-09-13T17:53:18.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba86e6b000 1 --2- 172.21.15.114:0/712249658 >> [v2:172.21.15.134:6833/1239035445,v1:172.21.15.134:6835/1239035445] conn(0x55f60dd65440 0x55f60ddb42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba86e6b000 4 client.5517 mds_command: new command op to 5316 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:53:18.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba86e6b000 1 -- 172.21.15.114:0/712249658 --> [v2:172.21.15.134:6833/1239035445,v1:172.21.15.134:6835/1239035445] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f60dba4790 con 0x55f60dd65440 2024-09-13T17:53:18.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba81000640 1 --2- 172.21.15.114:0/712249658 >> [v2:172.21.15.134:6833/1239035445,v1:172.21.15.134:6835/1239035445] conn(0x55f60dd65440 0x55f60ddb42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba81000640 1 --2- 172.21.15.114:0/712249658 >> [v2:172.21.15.134:6833/1239035445,v1:172.21.15.134:6835/1239035445] conn(0x55f60dd65440 0x55f60ddb42a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f93a716d72f3a3ef server_cookie=81ab0482fec0a76b in_seq=0 out_seq=0 2024-09-13T17:53:18.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba66000640 10 client.5517 ms_handle_connect on v2:172.21.15.134:6833/1239035445 2024-09-13T17:53:18.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba66000640 1 -- 172.21.15.114:0/712249658 <== mds.0 v2:172.21.15.134:6833/1239035445 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55f60dba4790 con 0x55f60dd65440 2024-09-13T17:53:18.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba66000640 10 client.5517 handle_command_reply: tid=0 2024-09-13T17:53:18.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba86e6b000 1 client.5517 shutdown 2024-09-13T17:53:18.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba86e6b000 1 -- 172.21.15.114:0/712249658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f60dda21f0 msgr2=0x55f60dd644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:18.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.579+0000 7fba86e6b000 1 --2- 172.21.15.114:0/712249658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f60dda21f0 0x55f60dd644f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fba68000c10 tx=0x7fba680197e0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.583+0000 7fba86e6b000 1 -- 172.21.15.114:0/712249658 shutdown_connections 2024-09-13T17:53:18.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.583+0000 7fba86e6b000 1 --2- 172.21.15.114:0/712249658 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f60dda2b10 0x55f60dd64a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.583+0000 7fba86e6b000 1 --2- 172.21.15.114:0/712249658 >> [v2:172.21.15.134:6833/1239035445,v1:172.21.15.134:6835/1239035445] conn(0x55f60dd65440 0x55f60ddb42a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.583+0000 7fba86e6b000 1 --2- 172.21.15.114:0/712249658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f60dda21f0 0x55f60dd644f0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.583+0000 7fba86e6b000 1 --2- 172.21.15.114:0/712249658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f60dd58740 0x55f60dd63fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.583+0000 7fba66000640 0 client.5517 ms_handle_reset on v2:172.21.15.134:6833/1239035445 2024-09-13T17:53:18.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.583+0000 7fba86e6b000 1 -- 172.21.15.114:0/712249658 >> 172.21.15.114:0/712249658 conn(0x55f60dd5efb0 msgr2=0x55f60dd571f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:18.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.583+0000 7fba86e6b000 1 -- 172.21.15.114:0/712249658 shutdown_connections 2024-09-13T17:53:18.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.583+0000 7fba86e6b000 1 -- 172.21.15.114:0/712249658 wait complete. 2024-09-13T17:53:18.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.583+0000 7fba86e6b000 20 client.5517 trim_cache size 0 max 16384 2024-09-13T17:53:18.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.595+0000 7fba86e6b000 1 Processor -- start 2024-09-13T17:53:18.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.595+0000 7fba86e6b000 1 -- start start 2024-09-13T17:53:18.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba86e6b000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f60dd58740 0x55f60ddfe330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba86e6b000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f60dda21f0 0x55f60ddfe870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba86e6b000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f60dda2b10 0x55f60ddfedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba86e6b000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f60d864940 con 0x55f60dda2b10 2024-09-13T17:53:18.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba86e6b000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f60ddb8f90 con 0x55f60dda21f0 2024-09-13T17:53:18.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba86e6b000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f60dd506d0 con 0x55f60dd58740 2024-09-13T17:53:18.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba81a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f60dda2b10 0x55f60ddfedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba81a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f60dda2b10 0x55f60ddfedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54116/0 (socket says 172.21.15.114:54116) 2024-09-13T17:53:18.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba81a00640 1 -- 172.21.15.114:0/3780299239 learned_addr learned my addr 172.21.15.114:0/3780299239 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:18.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba7be00640 1 --2- 172.21.15.114:0/3780299239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f60dda21f0 0x55f60ddfe870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba81000640 1 --2- 172.21.15.114:0/3780299239 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f60dd58740 0x55f60ddfe330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba81a00640 1 -- 172.21.15.114:0/3780299239 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f60dd58740 msgr2=0x55f60ddfe330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:18.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba81a00640 1 --2- 172.21.15.114:0/3780299239 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f60dd58740 0x55f60ddfe330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba81a00640 1 -- 172.21.15.114:0/3780299239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f60dda21f0 msgr2=0x55f60ddfe870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:18.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba81a00640 1 --2- 172.21.15.114:0/3780299239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f60dda21f0 0x55f60ddfe870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba81a00640 1 -- 172.21.15.114:0/3780299239 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f60db52c00 con 0x55f60dda2b10 2024-09-13T17:53:18.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba81a00640 1 --2- 172.21.15.114:0/3780299239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f60dda2b10 0x55f60ddfedb0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0720e0 tx=0x7fba74005420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320bbb29f82b4ec6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:18.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba72000640 1 -- 172.21.15.114:0/3780299239 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba74001a90 con 0x55f60dda2b10 2024-09-13T17:53:18.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba72000640 1 -- 172.21.15.114:0/3780299239 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7400d030 con 0x55f60dda2b10 2024-09-13T17:53:18.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba72000640 1 -- 172.21.15.114:0/3780299239 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba74001e10 con 0x55f60dda2b10 2024-09-13T17:53:18.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba86e6b000 1 -- 172.21.15.114:0/3780299239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f60dda2b10 msgr2=0x55f60ddfedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:18.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba86e6b000 1 --2- 172.21.15.114:0/3780299239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f60dda2b10 0x55f60ddfedb0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0720e0 tx=0x7fba74005420 comp rx=0 tx=0).stop 2024-09-13T17:53:18.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba86e6b000 1 -- 172.21.15.114:0/3780299239 shutdown_connections 2024-09-13T17:53:18.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba86e6b000 1 --2- 172.21.15.114:0/3780299239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f60dda2b10 0x55f60ddfedb0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba86e6b000 1 --2- 172.21.15.114:0/3780299239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f60dda21f0 0x55f60ddfe870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba86e6b000 1 --2- 172.21.15.114:0/3780299239 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f60dd58740 0x55f60ddfe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba86e6b000 1 -- 172.21.15.114:0/3780299239 >> 172.21.15.114:0/3780299239 conn(0x55f60dd5efb0 msgr2=0x55f60dd569d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:18.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba86e6b000 1 -- 172.21.15.114:0/3780299239 shutdown_connections 2024-09-13T17:53:18.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba86e6b000 1 -- 172.21.15.114:0/3780299239 wait complete. 2024-09-13T17:53:18.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba86e6b000 1 -- start start 2024-09-13T17:53:18.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba86e6b000 1 Processor -- start 2024-09-13T17:53:18.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba86e6b000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f60dd58740 0x55f60de04090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba86e6b000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f60dda21f0 0x55f60de045d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba86e6b000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f60dda2b10 0x55f60dde7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba86e6b000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f60dbab9b0 con 0x55f60dd58740 2024-09-13T17:53:18.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba86e6b000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f60db9c4d0 con 0x55f60dda21f0 2024-09-13T17:53:18.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba86e6b000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f60dba51c0 con 0x55f60dda2b10 2024-09-13T17:53:18.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.599+0000 7fba86e6b000 10 client.0 _ll_register_callbacks cb 0x7fba6c051120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:53:18.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba81000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f60dd58740 0x55f60de04090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba81000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f60dd58740 0x55f60de04090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54130/0 (socket says 172.21.15.114:54130) 2024-09-13T17:53:18.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba81000640 1 -- 172.21.15.114:0/1350938669 learned_addr learned my addr 172.21.15.114:0/1350938669 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:18.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba7be00640 1 --2- 172.21.15.114:0/1350938669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f60dda21f0 0x55f60de045d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba81a00640 1 --2- 172.21.15.114:0/1350938669 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f60dda2b10 0x55f60dde7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba81000640 1 -- 172.21.15.114:0/1350938669 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f60dda2b10 msgr2=0x55f60dde7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:18.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba81000640 1 --2- 172.21.15.114:0/1350938669 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f60dda2b10 0x55f60dde7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba81000640 1 -- 172.21.15.114:0/1350938669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f60dda21f0 msgr2=0x55f60de045d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:18.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba81000640 1 --2- 172.21.15.114:0/1350938669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f60dda21f0 0x55f60de045d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba81000640 1 -- 172.21.15.114:0/1350938669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7c06c450 con 0x55f60dd58740 2024-09-13T17:53:18.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba81a00640 1 --2- 172.21.15.114:0/1350938669 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f60dda2b10 0x55f60dde7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:18.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba81000640 1 --2- 172.21.15.114:0/1350938669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f60dd58740 0x55f60de04090 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fba6c054ae0 tx=0x7fba6c001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad88b15e9c496002 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:18.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba66000640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-13T17:53:18.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba66000640 1 -- 172.21.15.114:0/1350938669 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c001780 con 0x55f60dd58740 2024-09-13T17:53:18.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba66000640 1 -- 172.21.15.114:0/1350938669 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fba6c053180 con 0x55f60dd58740 2024-09-13T17:53:18.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba86e6b000 1 -- 172.21.15.114:0/1350938669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f60db77460 con 0x55f60dd58740 2024-09-13T17:53:18.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba66000640 1 -- 172.21.15.114:0/1350938669 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba6c082360 con 0x55f60dd58740 2024-09-13T17:53:18.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba86e6b000 10 client.5523 fetch_fsmap learned FSMap version 17 2024-09-13T17:53:18.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba86e6b000 1 -- 172.21.15.114:0/1350938669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55f60d8a3cc0 con 0x55f60dd58740 2024-09-13T17:53:18.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba66000640 1 -- 172.21.15.114:0/1350938669 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f60db77460 con 0x55f60dd58740 2024-09-13T17:53:18.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba66000640 1 -- 172.21.15.114:0/1350938669 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fba6c0514f0 con 0x55f60dd58740 2024-09-13T17:53:18.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba86e6b000 10 client.5523 fetch_fsmap finished waiting for FSMap version 17 2024-09-13T17:53:18.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba86e6b000 10 client.5523 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T17:53:18.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba86e6b000 20 client.5523 populate_metadata read hostname 'smithi114' 2024-09-13T17:53:18.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba86e6b000 1 --2- 172.21.15.114:0/1350938669 >> [v2:172.21.15.134:6833/1239035445,v1:172.21.15.134:6835/1239035445] conn(0x55f60dde8230 0x55f60dde8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba86e6b000 4 client.5523 mds_command: new command op to 5316 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:53:18.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba86e6b000 1 -- 172.21.15.114:0/1350938669 --> [v2:172.21.15.134:6833/1239035445,v1:172.21.15.134:6835/1239035445] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f60db709c0 con 0x55f60dde8230 2024-09-13T17:53:18.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba7be00640 1 --2- 172.21.15.114:0/1350938669 >> [v2:172.21.15.134:6833/1239035445,v1:172.21.15.134:6835/1239035445] conn(0x55f60dde8230 0x55f60dde8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba7be00640 1 --2- 172.21.15.114:0/1350938669 >> [v2:172.21.15.134:6833/1239035445,v1:172.21.15.134:6835/1239035445] conn(0x55f60dde8230 0x55f60dde8610 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ea9a1d0aad8211d server_cookie=5f2108ff6728c088 in_seq=0 out_seq=0 2024-09-13T17:53:18.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba66000640 10 client.5523 ms_handle_connect on v2:172.21.15.134:6833/1239035445 2024-09-13T17:53:18.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba66000640 1 -- 172.21.15.114:0/1350938669 <== mds.0 v2:172.21.15.134:6833/1239035445 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55f60db709c0 con 0x55f60dde8230 2024-09-13T17:53:18.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba66000640 10 client.5523 handle_command_reply: tid=0 2024-09-13T17:53:18.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba86e6b000 1 client.5523 shutdown 2024-09-13T17:53:18.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba86e6b000 1 -- 172.21.15.114:0/1350938669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f60dd58740 msgr2=0x55f60de04090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:18.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba86e6b000 1 --2- 172.21.15.114:0/1350938669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f60dd58740 0x55f60de04090 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fba6c054ae0 tx=0x7fba6c001a10 comp rx=0 tx=0).stop 2024-09-13T17:53:18.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba86e6b000 1 -- 172.21.15.114:0/1350938669 shutdown_connections 2024-09-13T17:53:18.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba86e6b000 1 --2- 172.21.15.114:0/1350938669 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55f60dda2b10 0x55f60dde7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba86e6b000 1 --2- 172.21.15.114:0/1350938669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f60dda21f0 0x55f60de045d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba86e6b000 1 --2- 172.21.15.114:0/1350938669 >> [v2:172.21.15.134:6833/1239035445,v1:172.21.15.134:6835/1239035445] conn(0x55f60dde8230 0x55f60dde8610 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba86e6b000 1 --2- 172.21.15.114:0/1350938669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55f60dd58740 0x55f60de04090 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba66000640 0 client.5523 ms_handle_reset on v2:172.21.15.134:6833/1239035445 2024-09-13T17:53:18.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba86e6b000 1 -- 172.21.15.114:0/1350938669 >> 172.21.15.114:0/1350938669 conn(0x55f60dd5efb0 msgr2=0x55f60dd571f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:18.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba86e6b000 1 -- 172.21.15.114:0/1350938669 shutdown_connections 2024-09-13T17:53:18.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba86e6b000 1 -- 172.21.15.114:0/1350938669 wait complete. 2024-09-13T17:53:18.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba86e6b000 20 client.5523 trim_cache size 0 max 16384 2024-09-13T17:53:18.618 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-13T17:53:18.619 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d730423f-882d-4061-b746-f6a7dc2544e0", 2024-09-13T17:53:18.619 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2024-09-13T17:53:18.619 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 5316, 2024-09-13T17:53:18.619 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2024-09-13T17:53:18.619 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2024-09-13T17:53:18.619 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2024-09-13T17:53:18.619 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 10.306713332999999, 2024-09-13T17:53:18.619 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 17, 2024-09-13T17:53:18.619 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 39, 2024-09-13T17:53:18.620 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 39, 2024-09-13T17:53:18.620 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 17.539409746 2024-09-13T17:53:18.620 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-13T17:53:18.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba82400640 1 -- 172.21.15.114:0/2496778651 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fba5c0666c0 msgr2=0x7fba5c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:18.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba82400640 1 --2- 172.21.15.114:0/2496778651 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fba5c0666c0 0x7fba5c068b80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fba680af000 tx=0x7fba68008040 comp rx=0 tx=0).stop 2024-09-13T17:53:18.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba82400640 1 -- 172.21.15.114:0/2496778651 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba600047d0 msgr2=0x7fba7c0c92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:18.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba82400640 1 --2- 172.21.15.114:0/2496778651 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba600047d0 0x7fba7c0c92f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fba6c001210 tx=0x7fba6c00ec10 comp rx=0 tx=0).stop 2024-09-13T17:53:18.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba82400640 1 -- 172.21.15.114:0/2496778651 shutdown_connections 2024-09-13T17:53:18.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba82400640 1 --2- 172.21.15.114:0/2496778651 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fba5c0666c0 0x7fba5c068b80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba82400640 1 --2- 172.21.15.114:0/2496778651 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fba7c152440 0x7fba7c1528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba82400640 1 --2- 172.21.15.114:0/2496778651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba7c15aee0 0x7fba7c15f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba82400640 1 --2- 172.21.15.114:0/2496778651 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba600047d0 0x7fba7c0c92f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba82400640 1 -- 172.21.15.114:0/2496778651 >> 172.21.15.114:0/2496778651 conn(0x7fba7c0d0330 msgr2=0x7fba7c0cd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:18.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba82400640 1 -- 172.21.15.114:0/2496778651 shutdown_connections 2024-09-13T17:53:18.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.603+0000 7fba82400640 1 -- 172.21.15.114:0/2496778651 wait complete. 2024-09-13T17:53:18.628 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:53:18.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.759+0000 7fc8dd800640 1 Processor -- start 2024-09-13T17:53:18.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.759+0000 7fc8dd800640 1 -- start start 2024-09-13T17:53:18.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.759+0000 7fc8dd800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8d806d740 0x7fc8d80708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.759+0000 7fc8dd800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d80adfb0 con 0x7fc8d8070420 2024-09-13T17:53:18.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.759+0000 7fc8dd800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d80adcd0 con 0x7fc8d80cdad0 2024-09-13T17:53:18.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.759+0000 7fc8dd800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d806cc10 con 0x7fc8d806d740 2024-09-13T17:53:18.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.763+0000 7fc8ce000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc8d8070420 0x7fc8d806d030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52654/0 (socket says 172.21.15.114:52654) 2024-09-13T17:53:18.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.763+0000 7fc8ce000640 1 -- 172.21.15.114:0/693344807 learned_addr learned my addr 172.21.15.114:0/693344807 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:18.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.763+0000 7fc8d7400640 1 --2- 172.21.15.114:0/693344807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8d806d740 0x7fc8d80708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.763+0000 7fc8d6000640 1 -- 172.21.15.114:0/693344807 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 876152599 0 0) 0x7fc8d80adfb0 con 0x7fc8d8070420 2024-09-13T17:53:18.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.763+0000 7fc8d6000640 1 -- 172.21.15.114:0/693344807 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8bc003530 con 0x7fc8d8070420 2024-09-13T17:53:18.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.763+0000 7fc8d6000640 1 -- 172.21.15.114:0/693344807 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 758493357 0 0) 0x7fc8bc003530 con 0x7fc8d8070420 2024-09-13T17:53:18.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.763+0000 7fc8d6000640 1 -- 172.21.15.114:0/693344807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8d806d740 msgr2=0x7fc8d80708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:18.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.763+0000 7fc8d6000640 1 --2- 172.21.15.114:0/693344807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8d806d740 0x7fc8d80708b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.763+0000 7fc8d6000640 1 -- 172.21.15.114:0/693344807 >> v1:172.21.15.134:6789/0 conn(0x7fc8d80cdad0 legacy=0x7fc8d80ad4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:18.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.763+0000 7fc8d6000640 1 -- 172.21.15.114:0/693344807 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d806c550 con 0x7fc8d8070420 2024-09-13T17:53:18.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.763+0000 7fc8d6000640 1 -- 172.21.15.114:0/693344807 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7fc8c0001680 con 0x7fc8d8070420 2024-09-13T17:53:18.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.763+0000 7fc8d6000640 1 -- 172.21.15.114:0/693344807 >> v1:172.21.15.114:6789/0 conn(0x7fc8d8070420 legacy=0x7fc8d806d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:18.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.763+0000 7fc8d6000640 1 --2- 172.21.15.114:0/693344807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8bc0039b0 0x7fc8bc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.763+0000 7fc8d6000640 1 --2- 172.21.15.114:0/693344807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8bc004360 0x7fc8bc004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.763+0000 7fc8d6000640 1 --2- 172.21.15.114:0/693344807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8d806d740 0x7fc8bc005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.763+0000 7fc8d6000640 1 -- 172.21.15.114:0/693344807 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d806cc10 con 0x7fc8bc004360 2024-09-13T17:53:18.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.763+0000 7fc8d6000640 1 -- 172.21.15.114:0/693344807 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc00ba70 con 0x7fc8bc0039b0 2024-09-13T17:53:18.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.763+0000 7fc8d6000640 1 -- 172.21.15.114:0/693344807 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc00bc30 con 0x7fc8d806d740 2024-09-13T17:53:18.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.763+0000 7fc8ce000640 1 --2- 172.21.15.114:0/693344807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8bc004360 0x7fc8bc004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.763+0000 7fc8d6a00640 1 --2- 172.21.15.114:0/693344807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8bc0039b0 0x7fc8bc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.763+0000 7fc8d7400640 1 --2- 172.21.15.114:0/693344807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8d806d740 0x7fc8bc005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.763+0000 7fc8ce000640 1 -- 172.21.15.114:0/693344807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8d806d740 msgr2=0x7fc8bc005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:18.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.763+0000 7fc8ce000640 1 --2- 172.21.15.114:0/693344807 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8d806d740 0x7fc8bc005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.763+0000 7fc8ce000640 1 -- 172.21.15.114:0/693344807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8bc0039b0 msgr2=0x7fc8bc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:18.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.763+0000 7fc8ce000640 1 --2- 172.21.15.114:0/693344807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8bc0039b0 0x7fc8bc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.763+0000 7fc8ce000640 1 -- 172.21.15.114:0/693344807 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc003530 con 0x7fc8bc004360 2024-09-13T17:53:18.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.767+0000 7fc8ce000640 1 --2- 172.21.15.114:0/693344807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8bc004360 0x7fc8bc004830 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc8c000c1c0 tx=0x7fc8c001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b437a8af936b5747 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:18.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.767+0000 7fc8d6000640 1 -- 172.21.15.114:0/693344807 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c00a5b10 con 0x7fc8bc004360 2024-09-13T17:53:18.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.767+0000 7fc8d6000640 1 -- 172.21.15.114:0/693344807 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c00a5c70 con 0x7fc8bc004360 2024-09-13T17:53:18.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.767+0000 7fc8d6000640 1 -- 172.21.15.114:0/693344807 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c00058e0 con 0x7fc8bc004360 2024-09-13T17:53:18.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.767+0000 7fc8dd800640 1 -- 172.21.15.114:0/693344807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8bc004360 msgr2=0x7fc8bc004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:18.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.767+0000 7fc8dd800640 1 --2- 172.21.15.114:0/693344807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8bc004360 0x7fc8bc004830 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc8c000c1c0 tx=0x7fc8c001cc10 comp rx=0 tx=0).stop 2024-09-13T17:53:18.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.767+0000 7fc8d7400640 1 -- 172.21.15.114:0/693344807 reap_dead start 2024-09-13T17:53:18.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.767+0000 7fc8dd800640 1 -- 172.21.15.114:0/693344807 shutdown_connections 2024-09-13T17:53:18.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.767+0000 7fc8dd800640 1 -- 172.21.15.114:0/693344807 >> 172.21.15.114:0/693344807 conn(0x7fc8d80660b0 msgr2=0x7fc8d8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:18.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.767+0000 7fc8dd800640 1 -- 172.21.15.114:0/693344807 shutdown_connections 2024-09-13T17:53:18.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.767+0000 7fc8dd800640 1 -- 172.21.15.114:0/693344807 wait complete. 2024-09-13T17:53:18.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.767+0000 7fc8dd800640 1 Processor -- start 2024-09-13T17:53:18.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.767+0000 7fc8dd800640 1 -- start start 2024-09-13T17:53:18.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.771+0000 7fc8dd800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8bc004360 0x7fc8d8149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.771+0000 7fc8dd800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8d80ae280 0x7fc8d80ae700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.771+0000 7fc8dd800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8d8155110 0x7fc8d8155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.771+0000 7fc8dd800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d80aec40 con 0x7fc8d80ae280 2024-09-13T17:53:18.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.771+0000 7fc8dd800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d8155e40 con 0x7fc8d8155110 2024-09-13T17:53:18.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.771+0000 7fc8dd800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d8156120 con 0x7fc8bc004360 2024-09-13T17:53:18.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.771+0000 7fc8ce000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8d80ae280 0x7fc8d80ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.771+0000 7fc8ce000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8d80ae280 0x7fc8d80ae700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54138/0 (socket says 172.21.15.114:54138) 2024-09-13T17:53:18.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.771+0000 7fc8ce000640 1 -- 172.21.15.114:0/3810231894 learned_addr learned my addr 172.21.15.114:0/3810231894 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:18.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.771+0000 7fc8d6a00640 1 --2- 172.21.15.114:0/3810231894 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8bc004360 0x7fc8d8149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.771+0000 7fc8d7400640 1 --2- 172.21.15.114:0/3810231894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8d8155110 0x7fc8d8155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.771+0000 7fc8ce000640 1 -- 172.21.15.114:0/3810231894 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8bc004360 msgr2=0x7fc8d8149cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:18.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.771+0000 7fc8ce000640 1 --2- 172.21.15.114:0/3810231894 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8bc004360 0x7fc8d8149cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.771+0000 7fc8ce000640 1 -- 172.21.15.114:0/3810231894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8d8155110 msgr2=0x7fc8d8155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:18.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.771+0000 7fc8ce000640 1 --2- 172.21.15.114:0/3810231894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8d8155110 0x7fc8d8155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.771+0000 7fc8ce000640 1 -- 172.21.15.114:0/3810231894 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d8156400 con 0x7fc8d80ae280 2024-09-13T17:53:18.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.771+0000 7fc8ce000640 1 --2- 172.21.15.114:0/3810231894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8d80ae280 0x7fc8d80ae700 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc8c000c1c0 tx=0x7fc8bc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:18.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.771+0000 7fc8cf400640 1 -- 172.21.15.114:0/3810231894 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c00b4070 con 0x7fc8d80ae280 2024-09-13T17:53:18.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.771+0000 7fc8cf400640 1 -- 172.21.15.114:0/3810231894 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c0001010 con 0x7fc8d80ae280 2024-09-13T17:53:18.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.771+0000 7fc8cf400640 1 -- 172.21.15.114:0/3810231894 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c00047f0 con 0x7fc8d80ae280 2024-09-13T17:53:18.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.771+0000 7fc8dd800640 1 -- 172.21.15.114:0/3810231894 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d81566e0 con 0x7fc8d80ae280 2024-09-13T17:53:18.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.771+0000 7fc8dd800640 1 -- 172.21.15.114:0/3810231894 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d8155ad0 con 0x7fc8d80ae280 2024-09-13T17:53:18.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.771+0000 7fc8dd800640 1 -- 172.21.15.114:0/3810231894 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d8066e90 con 0x7fc8d80ae280 2024-09-13T17:53:18.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.771+0000 7fc8cf400640 1 -- 172.21.15.114:0/3810231894 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc8c0004950 con 0x7fc8d80ae280 2024-09-13T17:53:18.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.775+0000 7fc8cf400640 1 --2- 172.21.15.114:0/3810231894 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc8b4066690 0x7fc8b4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:18.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.775+0000 7fc8cf400640 1 -- 172.21.15.114:0/3810231894 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc8c011dad0 con 0x7fc8d80ae280 2024-09-13T17:53:18.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.775+0000 7fc8d6a00640 1 --2- 172.21.15.114:0/3810231894 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc8b4066690 0x7fc8b4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:18.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.775+0000 7fc8d6a00640 1 --2- 172.21.15.114:0/3810231894 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc8b4066690 0x7fc8b4068b50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8007fd0 tx=0x7fc8c8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:18.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.779+0000 7fc8cf400640 1 -- 172.21.15.114:0/3810231894 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc8c00ead10 con 0x7fc8d80ae280 2024-09-13T17:53:18.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.963+0000 7fc8dd800640 1 -- 172.21.15.114:0/3810231894 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc8d806d030 con 0x7fc8d80ae280 2024-09-13T17:53:18.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.967+0000 7fc8cf400640 1 -- 172.21.15.114:0/3810231894 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc8c00ee330 con 0x7fc8d80ae280 2024-09-13T17:53:18.970 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:53:18.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.967+0000 7fc8dd800640 1 -- 172.21.15.114:0/3810231894 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc8b4066690 msgr2=0x7fc8b4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:18.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.967+0000 7fc8dd800640 1 --2- 172.21.15.114:0/3810231894 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc8b4066690 0x7fc8b4068b50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8007fd0 tx=0x7fc8c8009040 comp rx=0 tx=0).stop 2024-09-13T17:53:18.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.967+0000 7fc8dd800640 1 -- 172.21.15.114:0/3810231894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8d80ae280 msgr2=0x7fc8d80ae700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:18.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.967+0000 7fc8dd800640 1 --2- 172.21.15.114:0/3810231894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8d80ae280 0x7fc8d80ae700 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc8c000c1c0 tx=0x7fc8bc005800 comp rx=0 tx=0).stop 2024-09-13T17:53:18.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.967+0000 7fc8dd800640 1 -- 172.21.15.114:0/3810231894 shutdown_connections 2024-09-13T17:53:18.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.967+0000 7fc8dd800640 1 --2- 172.21.15.114:0/3810231894 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc8b4066690 0x7fc8b4068b50 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.967+0000 7fc8dd800640 1 --2- 172.21.15.114:0/3810231894 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8d8155110 0x7fc8d8155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.967+0000 7fc8dd800640 1 --2- 172.21.15.114:0/3810231894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8d80ae280 0x7fc8d80ae700 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.967+0000 7fc8dd800640 1 --2- 172.21.15.114:0/3810231894 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc8bc004360 0x7fc8d8149cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:18.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.967+0000 7fc8dd800640 1 -- 172.21.15.114:0/3810231894 >> 172.21.15.114:0/3810231894 conn(0x7fc8d80660b0 msgr2=0x7fc8d815ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:18.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.967+0000 7fc8dd800640 1 -- 172.21.15.114:0/3810231894 shutdown_connections 2024-09-13T17:53:18.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:18.967+0000 7fc8dd800640 1 -- 172.21.15.114:0/3810231894 wait complete. 2024-09-13T17:53:18.990 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T17:53:18.990 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:53:18.990 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-09-13T17:53:18.990 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T17:53:18.990 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:53:18.990 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T17:53:18.991 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T17:53:18.991 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:53:18.991 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:53:18.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:53:18.991 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-09-13T17:53:19.000 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:53:19.000 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:53:19.000 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:53:19.000 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:53:19.000 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-09-13T17:53:19.000 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:53:19.000 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:53:19.000 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:53:19.000 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-09-13T17:53:19.000 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:53:19.001 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:53:19.001 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-09-13T17:53:19.001 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:53:19.001 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:53:19.001 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:53:19.001 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:53:19.001 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:53:19.001 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42372sec preferred_lft 42372sec 2024-09-13T17:53:19.001 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-09-13T17:53:19.001 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:53:19.001 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:53:19.001 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:0f:6c:f2:fc brd ff:ff:ff:ff:ff:ff 2024-09-13T17:53:19.001 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:53:19.001 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:53:19.002 INFO:teuthology.orchestra.run.smithi114.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:53:19.002 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T17:53:19.002 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:53:19.002 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:53:19.002 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-13T17:53:19.002 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:53:19.002 INFO:teuthology.orchestra.run.smithi114.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:53:19.002 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:53:19.002 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T17:53:19.002 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:53:19.002 INFO:teuthology.orchestra.run.smithi114.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:53:19.002 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T17:53:19.002 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-13T17:53:19.002 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:53:19.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:53:19.005 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:53:19.067 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-09-13T17:53:19.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:53:19.069 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-09-13T17:53:19.125 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-09-13T17:53:19.125 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:53:19.125 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:53:19.125 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:53:19.126 INFO:teuthology.orchestra.run.smithi114.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-13T17:53:19.126 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:53:19.126 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T17:53:19.126 INFO:teuthology.orchestra.run.smithi114.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:53:19.126 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:53:19.126 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:53:19.126 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:53:19.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:53:19.126 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2024-09-13T17:53:19.126 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-13T17:53:19.127 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:53:19.127 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:53:19.127 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:53:19.127 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-13T17:53:19.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:53:19.213 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-13T17:53:19.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:53:19.221 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T17:53:19.221 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:53:19.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:53:19.222 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-09-13T17:53:19.285 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:53:19.285 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T17:53:19.337 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:53:19.337 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:53:19.338 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:53:19.389 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T17:53:19.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:53:19.390 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T17:53:19.485 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T17:53:19.485 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T17:53:19.499 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T17:53:19.499 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T17:53:19.500 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.134:3300,172.21.15.134:3301" 2024-09-13T17:53:19.500 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with new device syntax: 0@d730423f-882d-4061-b746-f6a7dc2544e0.cephfs=/ 2024-09-13T17:53:19.500 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.114:3300/172.21.15.134:3300/172.21.15.134:3301" will pass to kernel 2024-09-13T17:53:19.503 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T17:53:19.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:53:19.504 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:53:19.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:53:19.524 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:53:19.585 INFO:teuthology.orchestra.run.smithi114.stdout:client5087 2024-09-13T17:53:19.585 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:53:19.586 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:53:19.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:53:19.638 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-13T17:53:19.700 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:53:19.700 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:53:19.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:53:19.749 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=subdir/sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-09-13T17:53:19.879 INFO:teuthology.orchestra.run.smithi114.stderr:6+0 records in 2024-09-13T17:53:19.879 INFO:teuthology.orchestra.run.smithi114.stderr:6+0 records out 2024-09-13T17:53:19.879 INFO:teuthology.orchestra.run.smithi114.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0757398 s, 83.1 MB/s 2024-09-13T17:53:19.881 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:53:19.881 DEBUG:teuthology.orchestra.run.smithi114:> import os 2024-09-13T17:53:19.881 DEBUG:teuthology.orchestra.run.smithi114:> import stat 2024-09-13T17:53:19.881 DEBUG:teuthology.orchestra.run.smithi114:> import json 2024-09-13T17:53:19.881 DEBUG:teuthology.orchestra.run.smithi114:> import sys 2024-09-13T17:53:19.881 DEBUG:teuthology.orchestra.run.smithi114:> 2024-09-13T17:53:19.881 DEBUG:teuthology.orchestra.run.smithi114:> try: 2024-09-13T17:53:19.881 DEBUG:teuthology.orchestra.run.smithi114:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-09-13T17:53:19.881 DEBUG:teuthology.orchestra.run.smithi114:> except OSError as e: 2024-09-13T17:53:19.881 DEBUG:teuthology.orchestra.run.smithi114:> sys.exit(e.errno) 2024-09-13T17:53:19.882 DEBUG:teuthology.orchestra.run.smithi114:> 2024-09-13T17:53:19.882 DEBUG:teuthology.orchestra.run.smithi114:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-13T17:53:19.882 DEBUG:teuthology.orchestra.run.smithi114:> print(json.dumps( 2024-09-13T17:53:19.882 DEBUG:teuthology.orchestra.run.smithi114:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-13T17:53:19.882 DEBUG:teuthology.orchestra.run.smithi114:> indent=2)) 2024-09-13T17:53:19.882 DEBUG:teuthology.orchestra.run.smithi114:> ' 2024-09-13T17:53:19.949 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-13T17:53:19.949 INFO:teuthology.orchestra.run.smithi114.stdout: "st_mode": 33204, 2024-09-13T17:53:19.949 INFO:teuthology.orchestra.run.smithi114.stdout: "st_ino": 1099511627777, 2024-09-13T17:53:19.950 INFO:teuthology.orchestra.run.smithi114.stdout: "st_dev": 44, 2024-09-13T17:53:19.950 INFO:teuthology.orchestra.run.smithi114.stdout: "st_nlink": 1, 2024-09-13T17:53:19.950 INFO:teuthology.orchestra.run.smithi114.stdout: "st_uid": 1000, 2024-09-13T17:53:19.950 INFO:teuthology.orchestra.run.smithi114.stdout: "st_gid": 1271, 2024-09-13T17:53:19.950 INFO:teuthology.orchestra.run.smithi114.stdout: "st_size": 6291456, 2024-09-13T17:53:19.950 INFO:teuthology.orchestra.run.smithi114.stdout: "st_atime": 1726249999.7950222, 2024-09-13T17:53:19.950 INFO:teuthology.orchestra.run.smithi114.stdout: "st_mtime": 1726249999.8350217, 2024-09-13T17:53:19.950 INFO:teuthology.orchestra.run.smithi114.stdout: "st_ctime": 1726249999.8350217 2024-09-13T17:53:19.950 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-13T17:53:20.135 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:53:20.135 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:53:20.186 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:53:20.186 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:53:20.238 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:53:20.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.411+0000 7f164dc00640 1 Processor -- start 2024-09-13T17:53:20.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.411+0000 7f164dc00640 1 -- start start 2024-09-13T17:53:20.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.411+0000 7f164dc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1648070380 0x7f164806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:20.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.411+0000 7f164dc00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1648099160 con 0x7f16480ce500 2024-09-13T17:53:20.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.411+0000 7f164dc00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164815ef90 con 0x7f164815dd60 2024-09-13T17:53:20.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.411+0000 7f164dc00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164815e140 con 0x7f1648070380 2024-09-13T17:53:20.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.411+0000 7f1647400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f16480ce500 0x7f16480995f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52670/0 (socket says 172.21.15.114:52670) 2024-09-13T17:53:20.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.411+0000 7f1647400640 1 -- 172.21.15.114:0/1629713560 learned_addr learned my addr 172.21.15.114:0/1629713560 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:20.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.411+0000 7f163e000640 1 --2- 172.21.15.114:0/1629713560 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1648070380 0x7f164806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:20.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.411+0000 7f1646000640 1 -- 172.21.15.114:0/1629713560 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3344060398 0 0) 0x7f1648099160 con 0x7f16480ce500 2024-09-13T17:53:20.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.411+0000 7f1646000640 1 -- 172.21.15.114:0/1629713560 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f162c003530 con 0x7f16480ce500 2024-09-13T17:53:20.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.411+0000 7f1646000640 1 -- 172.21.15.114:0/1629713560 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3010939972 0 0) 0x7f162c003530 con 0x7f16480ce500 2024-09-13T17:53:20.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.411+0000 7f1646000640 1 -- 172.21.15.114:0/1629713560 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1648070380 msgr2=0x7f164806f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:20.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.411+0000 7f1646000640 1 --2- 172.21.15.114:0/1629713560 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1648070380 0x7f164806f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:20.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.411+0000 7f1646000640 1 -- 172.21.15.114:0/1629713560 >> v1:172.21.15.134:6789/0 conn(0x7f164815dd60 legacy=0x7f16480caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:20.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.411+0000 7f1646000640 1 -- 172.21.15.114:0/1629713560 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1648098b10 con 0x7f16480ce500 2024-09-13T17:53:20.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.411+0000 7f1646000640 1 -- 172.21.15.114:0/1629713560 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7f1640001a00 con 0x7f16480ce500 2024-09-13T17:53:20.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.411+0000 7f163e000640 1 --2- 172.21.15.114:0/1629713560 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1648070380 0x7f164806f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:53:20.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.411+0000 7f1646000640 1 -- 172.21.15.114:0/1629713560 >> v1:172.21.15.114:6789/0 conn(0x7f16480ce500 legacy=0x7f16480995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:20.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.411+0000 7f1646000640 1 --2- 172.21.15.114:0/1629713560 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f162c0039b0 0x7f162c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:20.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.411+0000 7f1646000640 1 --2- 172.21.15.114:0/1629713560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f162c004360 0x7f162c004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:20.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.415+0000 7f1646000640 1 --2- 172.21.15.114:0/1629713560 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1648070380 0x7f162c005050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:20.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.415+0000 7f1646000640 1 -- 172.21.15.114:0/1629713560 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164815e140 con 0x7f162c0039b0 2024-09-13T17:53:20.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.415+0000 7f1646000640 1 -- 172.21.15.114:0/1629713560 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c00b990 con 0x7f162c004360 2024-09-13T17:53:20.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.415+0000 7f1646000640 1 -- 172.21.15.114:0/1629713560 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162c00bb50 con 0x7f1648070380 2024-09-13T17:53:20.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.415+0000 7f1646a00640 1 --2- 172.21.15.114:0/1629713560 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f162c0039b0 0x7f162c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:20.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.415+0000 7f163e000640 1 --2- 172.21.15.114:0/1629713560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f162c004360 0x7f162c004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:20.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.415+0000 7f1647400640 1 --2- 172.21.15.114:0/1629713560 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1648070380 0x7f162c005050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:20.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.415+0000 7f1646a00640 1 -- 172.21.15.114:0/1629713560 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1648070380 msgr2=0x7f162c005050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:20.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.415+0000 7f1646a00640 1 --2- 172.21.15.114:0/1629713560 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1648070380 0x7f162c005050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:20.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.415+0000 7f1646a00640 1 -- 172.21.15.114:0/1629713560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f162c004360 msgr2=0x7f162c004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:20.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.415+0000 7f1646a00640 1 --2- 172.21.15.114:0/1629713560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f162c004360 0x7f162c004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:20.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.415+0000 7f1646a00640 1 -- 172.21.15.114:0/1629713560 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1630009420 con 0x7f162c0039b0 2024-09-13T17:53:20.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.415+0000 7f1646a00640 1 --2- 172.21.15.114:0/1629713560 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f162c0039b0 0x7f162c003d90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1638001910 tx=0x7f163801c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b533a7714fa0425e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:20.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.415+0000 7f1646000640 1 -- 172.21.15.114:0/1629713560 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16380ad680 con 0x7f162c0039b0 2024-09-13T17:53:20.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.415+0000 7f1646000640 1 -- 172.21.15.114:0/1629713560 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16380ad800 con 0x7f162c0039b0 2024-09-13T17:53:20.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.415+0000 7f1646000640 1 -- 172.21.15.114:0/1629713560 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16380adbb0 con 0x7f162c0039b0 2024-09-13T17:53:20.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.419+0000 7f164dc00640 1 -- 172.21.15.114:0/1629713560 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f162c0039b0 msgr2=0x7f162c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:20.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.419+0000 7f164dc00640 1 --2- 172.21.15.114:0/1629713560 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f162c0039b0 0x7f162c003d90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1638001910 tx=0x7f163801c550 comp rx=0 tx=0).stop 2024-09-13T17:53:20.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.419+0000 7f1647400640 1 -- 172.21.15.114:0/1629713560 reap_dead start 2024-09-13T17:53:20.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.419+0000 7f164dc00640 1 -- 172.21.15.114:0/1629713560 shutdown_connections 2024-09-13T17:53:20.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.419+0000 7f164dc00640 1 -- 172.21.15.114:0/1629713560 >> 172.21.15.114:0/1629713560 conn(0x7f16480d0570 msgr2=0x7f16480d0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:20.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.419+0000 7f164dc00640 1 -- 172.21.15.114:0/1629713560 shutdown_connections 2024-09-13T17:53:20.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.419+0000 7f164dc00640 1 -- 172.21.15.114:0/1629713560 wait complete. 2024-09-13T17:53:20.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.419+0000 7f164dc00640 1 Processor -- start 2024-09-13T17:53:20.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.419+0000 7f164dc00640 1 -- start start 2024-09-13T17:53:20.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.419+0000 7f164dc00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f162c0039b0 0x7f164814aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:20.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.419+0000 7f164dc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f164814a0c0 0x7f164814a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:20.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.419+0000 7f164dc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16480c7640 0x7f16480c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:20.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.419+0000 7f164dc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16480c5ea0 con 0x7f16480c7640 2024-09-13T17:53:20.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.419+0000 7f164dc00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16480c8000 con 0x7f162c0039b0 2024-09-13T17:53:20.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.419+0000 7f164dc00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16480c5220 con 0x7f164814a0c0 2024-09-13T17:53:20.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.419+0000 7f1647400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16480c7640 0x7f16480c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:20.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.419+0000 7f1647400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16480c7640 0x7f16480c7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54166/0 (socket says 172.21.15.114:54166) 2024-09-13T17:53:20.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.419+0000 7f1647400640 1 -- 172.21.15.114:0/4161282282 learned_addr learned my addr 172.21.15.114:0/4161282282 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:20.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.419+0000 7f1646a00640 1 --2- 172.21.15.114:0/4161282282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f162c0039b0 0x7f164814aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:20.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.419+0000 7f163e000640 1 --2- 172.21.15.114:0/4161282282 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f164814a0c0 0x7f164814a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:20.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.419+0000 7f1647400640 1 -- 172.21.15.114:0/4161282282 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f164814a0c0 msgr2=0x7f164814a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:20.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.419+0000 7f1647400640 1 --2- 172.21.15.114:0/4161282282 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f164814a0c0 0x7f164814a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:20.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.419+0000 7f1647400640 1 -- 172.21.15.114:0/4161282282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f162c0039b0 msgr2=0x7f164814aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:20.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.419+0000 7f1647400640 1 --2- 172.21.15.114:0/4161282282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f162c0039b0 0x7f164814aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:20.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.419+0000 7f1647400640 1 -- 172.21.15.114:0/4161282282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16480c5500 con 0x7f16480c7640 2024-09-13T17:53:20.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.423+0000 7f1647400640 1 --2- 172.21.15.114:0/4161282282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16480c7640 0x7f16480c7ac0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1648071800 tx=0x7f164000a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:20.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.423+0000 7f163f400640 1 -- 172.21.15.114:0/4161282282 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164000ae90 con 0x7f16480c7640 2024-09-13T17:53:20.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.423+0000 7f163f400640 1 -- 172.21.15.114:0/4161282282 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1640007af0 con 0x7f16480c7640 2024-09-13T17:53:20.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.423+0000 7f163f400640 1 -- 172.21.15.114:0/4161282282 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640013610 con 0x7f16480c7640 2024-09-13T17:53:20.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.423+0000 7f164dc00640 1 -- 172.21.15.114:0/4161282282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16480c57e0 con 0x7f16480c7640 2024-09-13T17:53:20.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.423+0000 7f164dc00640 1 -- 172.21.15.114:0/4161282282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164814b0e0 con 0x7f16480c7640 2024-09-13T17:53:20.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.423+0000 7f164dc00640 1 -- 172.21.15.114:0/4161282282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16480673b0 con 0x7f16480c7640 2024-09-13T17:53:20.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.423+0000 7f163f400640 1 -- 172.21.15.114:0/4161282282 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1640013770 con 0x7f16480c7640 2024-09-13T17:53:20.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.423+0000 7f163f400640 1 --2- 172.21.15.114:0/4161282282 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1624066690 0x7f1624068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:20.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.423+0000 7f163f400640 1 -- 172.21.15.114:0/4161282282 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1640084ba0 con 0x7f16480c7640 2024-09-13T17:53:20.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.423+0000 7f1646a00640 1 --2- 172.21.15.114:0/4161282282 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1624066690 0x7f1624068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:20.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.423+0000 7f1646a00640 1 --2- 172.21.15.114:0/4161282282 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1624066690 0x7f1624068b50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f16380af000 tx=0x7f1638001330 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:20.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.427+0000 7f163f400640 1 -- 172.21.15.114:0/4161282282 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1640051e70 con 0x7f16480c7640 2024-09-13T17:53:20.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.583+0000 7f164dc00640 1 -- 172.21.15.114:0/4161282282 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16480c5fe0 con 0x7f16480c7640 2024-09-13T17:53:20.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.583+0000 7f163f400640 1 -- 172.21.15.114:0/4161282282 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16822 (secure 0 0 0) 0x7f16480c5fe0 con 0x7f16480c7640 2024-09-13T17:53:20.589 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:20.589 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":39,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:53:09.301327+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:53:06.185439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:53:07.297633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:53:20.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.587+0000 7f164dc00640 1 -- 172.21.15.114:0/4161282282 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1624066690 msgr2=0x7f1624068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:20.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.587+0000 7f164dc00640 1 --2- 172.21.15.114:0/4161282282 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1624066690 0x7f1624068b50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f16380af000 tx=0x7f1638001330 comp rx=0 tx=0).stop 2024-09-13T17:53:20.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.587+0000 7f164dc00640 1 -- 172.21.15.114:0/4161282282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16480c7640 msgr2=0x7f16480c7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:20.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.587+0000 7f164dc00640 1 --2- 172.21.15.114:0/4161282282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16480c7640 0x7f16480c7ac0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1648071800 tx=0x7f164000a6a0 comp rx=0 tx=0).stop 2024-09-13T17:53:20.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.587+0000 7f164dc00640 1 -- 172.21.15.114:0/4161282282 shutdown_connections 2024-09-13T17:53:20.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.587+0000 7f164dc00640 1 --2- 172.21.15.114:0/4161282282 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1624066690 0x7f1624068b50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:20.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.587+0000 7f164dc00640 1 --2- 172.21.15.114:0/4161282282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16480c7640 0x7f16480c7ac0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:20.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.587+0000 7f164dc00640 1 --2- 172.21.15.114:0/4161282282 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f164814a0c0 0x7f164814a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:20.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.587+0000 7f164dc00640 1 --2- 172.21.15.114:0/4161282282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f162c0039b0 0x7f164814aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:20.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.587+0000 7f164dc00640 1 -- 172.21.15.114:0/4161282282 >> 172.21.15.114:0/4161282282 conn(0x7f16480d0570 msgr2=0x7f16480cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:20.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.587+0000 7f164dc00640 1 -- 172.21.15.114:0/4161282282 shutdown_connections 2024-09-13T17:53:20.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.587+0000 7f164dc00640 1 -- 172.21.15.114:0/4161282282 wait complete. 2024-09-13T17:53:20.610 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:51:37.996254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:53:06.185439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:53:07.297633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:53:20.611 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:53:20.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.743+0000 7f9213400640 1 Processor -- start 2024-09-13T17:53:20.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.743+0000 7f9213400640 1 -- start start 2024-09-13T17:53:20.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.747+0000 7f9213400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f920c151420 0x7f920c0cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:20.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.747+0000 7f9213400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f920c151800 con 0x7f920c070b30 2024-09-13T17:53:20.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.747+0000 7f9213400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f920c0cafb0 con 0x7f920c0ccba0 2024-09-13T17:53:20.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.747+0000 7f9213400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f920c0cbc30 con 0x7f920c151420 2024-09-13T17:53:20.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.747+0000 7f9211400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f920c070b30 0x7f920c06c540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52680/0 (socket says 172.21.15.114:52680) 2024-09-13T17:53:20.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.747+0000 7f9211400640 1 -- 172.21.15.114:0/1689610855 learned_addr learned my addr 172.21.15.114:0/1689610855 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:20.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.747+0000 7f9210a00640 1 --2- 172.21.15.114:0/1689610855 >> v2:172.21.15.134:3300/0 conn(0x7f920c151420 0x7f920c0cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:20.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.747+0000 7f920be00640 1 -- 172.21.15.114:0/1689610855 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2587148704 0 0) 0x7f920c151800 con 0x7f920c070b30 2024-09-13T17:53:20.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.747+0000 7f920be00640 1 -- 172.21.15.114:0/1689610855 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91f0003530 con 0x7f920c070b30 2024-09-13T17:53:20.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.747+0000 7f920be00640 1 -- 172.21.15.114:0/1689610855 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3922192229 0 0) 0x7f920c0cafb0 con 0x7f920c0ccba0 2024-09-13T17:53:20.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.747+0000 7f920be00640 1 -- 172.21.15.114:0/1689610855 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f920c151800 con 0x7f920c0ccba0 2024-09-13T17:53:20.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.747+0000 7f9210a00640 1 -- 172.21.15.114:0/1689610855 >> v1:172.21.15.134:6789/0 conn(0x7f920c0ccba0 legacy=0x7f920c070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:20.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.747+0000 7f9210a00640 1 -- 172.21.15.114:0/1689610855 >> v1:172.21.15.114:6789/0 conn(0x7f920c070b30 legacy=0x7f920c06c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:20.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.747+0000 7f9210a00640 1 -- 172.21.15.114:0/1689610855 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f920c0cb290 con 0x7f920c151420 2024-09-13T17:53:20.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.751+0000 7f9210a00640 1 --2- 172.21.15.114:0/1689610855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f920c151420 0x7f920c0cc660 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0097c0 tx=0x7f91fc01c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91ad55784ed9bf4e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:20.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.751+0000 7f920be00640 1 -- 172.21.15.114:0/1689610855 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc004230 con 0x7f920c151420 2024-09-13T17:53:20.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.751+0000 7f920be00640 1 -- 172.21.15.114:0/1689610855 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91fc0a7050 con 0x7f920c151420 2024-09-13T17:53:20.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.751+0000 7f920be00640 1 -- 172.21.15.114:0/1689610855 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc003620 con 0x7f920c151420 2024-09-13T17:53:20.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.751+0000 7f9213400640 1 -- 172.21.15.114:0/1689610855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f920c151420 msgr2=0x7f920c0cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:20.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.751+0000 7f9213400640 1 --2- 172.21.15.114:0/1689610855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f920c151420 0x7f920c0cc660 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0097c0 tx=0x7f91fc01c350 comp rx=0 tx=0).stop 2024-09-13T17:53:20.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.751+0000 7f9213400640 1 -- 172.21.15.114:0/1689610855 shutdown_connections 2024-09-13T17:53:20.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.751+0000 7f9213400640 1 --2- 172.21.15.114:0/1689610855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f920c151420 0x7f920c0cc660 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:20.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.751+0000 7f9213400640 1 -- 172.21.15.114:0/1689610855 >> 172.21.15.114:0/1689610855 conn(0x7f920c0660b0 msgr2=0x7f920c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:20.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.751+0000 7f9213400640 1 -- 172.21.15.114:0/1689610855 shutdown_connections 2024-09-13T17:53:20.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.751+0000 7f9213400640 1 -- 172.21.15.114:0/1689610855 wait complete. 2024-09-13T17:53:20.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.751+0000 7f9213400640 1 Processor -- start 2024-09-13T17:53:20.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.751+0000 7f9213400640 1 -- start start 2024-09-13T17:53:20.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.755+0000 7f9213400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f920c070b30 0x7f920c148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:20.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.755+0000 7f9213400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f920c0ccba0 0x7f920c148720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:20.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.755+0000 7f9213400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f920c151420 0x7f920c158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:20.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.755+0000 7f9213400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920c1485a0 con 0x7f920c151420 2024-09-13T17:53:20.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.755+0000 7f9213400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920c0ad980 con 0x7f920c0ccba0 2024-09-13T17:53:20.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.755+0000 7f9213400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920c1543d0 con 0x7f920c070b30 2024-09-13T17:53:20.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.755+0000 7f9211400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f920c151420 0x7f920c158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:20.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.755+0000 7f9211400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f920c151420 0x7f920c158df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54168/0 (socket says 172.21.15.114:54168) 2024-09-13T17:53:20.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.755+0000 7f9211400640 1 -- 172.21.15.114:0/4172278628 learned_addr learned my addr 172.21.15.114:0/4172278628 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:20.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.755+0000 7f9210a00640 1 --2- 172.21.15.114:0/4172278628 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f920c070b30 0x7f920c148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:20.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.755+0000 7f9203e00640 1 --2- 172.21.15.114:0/4172278628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f920c0ccba0 0x7f920c148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:20.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.755+0000 7f9211400640 1 -- 172.21.15.114:0/4172278628 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f920c070b30 msgr2=0x7f920c148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:20.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.755+0000 7f9211400640 1 --2- 172.21.15.114:0/4172278628 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f920c070b30 0x7f920c148060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:20.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.755+0000 7f9211400640 1 -- 172.21.15.114:0/4172278628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f920c0ccba0 msgr2=0x7f920c148720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:20.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.755+0000 7f9211400640 1 --2- 172.21.15.114:0/4172278628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f920c0ccba0 0x7f920c148720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:20.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.755+0000 7f9211400640 1 -- 172.21.15.114:0/4172278628 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc009420 con 0x7f920c151420 2024-09-13T17:53:20.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.755+0000 7f9211400640 1 --2- 172.21.15.114:0/4172278628 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f920c151420 0x7f920c158df0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f920400cab0 tx=0x7f920400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:20.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.755+0000 7f9209600640 1 -- 172.21.15.114:0/4172278628 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920400abd0 con 0x7f920c151420 2024-09-13T17:53:20.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.755+0000 7f9209600640 1 -- 172.21.15.114:0/4172278628 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920400ad30 con 0x7f920c151420 2024-09-13T17:53:20.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.755+0000 7f9213400640 1 -- 172.21.15.114:0/4172278628 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f920c14a3e0 con 0x7f920c151420 2024-09-13T17:53:20.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.755+0000 7f9209600640 1 -- 172.21.15.114:0/4172278628 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920400aea0 con 0x7f920c151420 2024-09-13T17:53:20.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.755+0000 7f9213400640 1 -- 172.21.15.114:0/4172278628 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f920c154900 con 0x7f920c151420 2024-09-13T17:53:20.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.755+0000 7f9213400640 1 -- 172.21.15.114:0/4172278628 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f920c0cc660 con 0x7f920c151420 2024-09-13T17:53:20.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.759+0000 7f9209600640 1 -- 172.21.15.114:0/4172278628 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9204007070 con 0x7f920c151420 2024-09-13T17:53:20.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.759+0000 7f9209600640 1 --2- 172.21.15.114:0/4172278628 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f91e8066690 0x7f91e8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:20.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.759+0000 7f9209600640 1 -- 172.21.15.114:0/4172278628 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9204084060 con 0x7f920c151420 2024-09-13T17:53:20.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.759+0000 7f9210a00640 1 --2- 172.21.15.114:0/4172278628 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f91e8066690 0x7f91e8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:20.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.759+0000 7f9210a00640 1 --2- 172.21.15.114:0/4172278628 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f91e8066690 0x7f91e8068b50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0ad000 tx=0x7f91fc0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:20.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.763+0000 7f9209600640 1 -- 172.21.15.114:0/4172278628 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f92040b5db0 con 0x7f920c151420 2024-09-13T17:53:20.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.915+0000 7f9213400640 1 -- 172.21.15.114:0/4172278628 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f920c15d340 con 0x7f920c151420 2024-09-13T17:53:20.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.915+0000 7f9209600640 1 -- 172.21.15.114:0/4172278628 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f92040170a0 con 0x7f920c151420 2024-09-13T17:53:20.920 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-13T17:53:20.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.919+0000 7f9213400640 1 -- 172.21.15.114:0/4172278628 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f91e8066690 msgr2=0x7f91e8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:20.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.919+0000 7f9213400640 1 --2- 172.21.15.114:0/4172278628 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f91e8066690 0x7f91e8068b50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0ad000 tx=0x7f91fc0a6000 comp rx=0 tx=0).stop 2024-09-13T17:53:20.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.919+0000 7f9213400640 1 -- 172.21.15.114:0/4172278628 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f920c151420 msgr2=0x7f920c158df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:20.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.919+0000 7f9213400640 1 --2- 172.21.15.114:0/4172278628 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f920c151420 0x7f920c158df0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f920400cab0 tx=0x7f920400cf70 comp rx=0 tx=0).stop 2024-09-13T17:53:20.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.919+0000 7f9213400640 1 -- 172.21.15.114:0/4172278628 shutdown_connections 2024-09-13T17:53:20.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.919+0000 7f9213400640 1 --2- 172.21.15.114:0/4172278628 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f91e8066690 0x7f91e8068b50 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:20.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.919+0000 7f9213400640 1 --2- 172.21.15.114:0/4172278628 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f920c151420 0x7f920c158df0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:20.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.919+0000 7f9213400640 1 --2- 172.21.15.114:0/4172278628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f920c0ccba0 0x7f920c148720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:20.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.919+0000 7f9213400640 1 --2- 172.21.15.114:0/4172278628 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f920c070b30 0x7f920c148060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:20.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.919+0000 7f9213400640 1 -- 172.21.15.114:0/4172278628 >> 172.21.15.114:0/4172278628 conn(0x7f920c0660b0 msgr2=0x7f920c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:20.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.919+0000 7f9213400640 1 -- 172.21.15.114:0/4172278628 shutdown_connections 2024-09-13T17:53:20.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:20.919+0000 7f9213400640 1 -- 172.21.15.114:0/4172278628 wait complete. 2024-09-13T17:53:20.942 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:53:21.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.078+0000 7fa123000640 1 Processor -- start 2024-09-13T17:53:21.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.078+0000 7fa123000640 1 -- start start 2024-09-13T17:53:21.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.078+0000 7fa123000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa11c13c240 0x7fa11c13f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:21.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.078+0000 7fa123000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa11c13c980 0x7fa11c06d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:21.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.078+0000 7fa123000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa11c0cd220 con 0x7fa11c06da90 2024-09-13T17:53:21.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.078+0000 7fa123000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa11c06df40 con 0x7fa11c13c240 2024-09-13T17:53:21.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.078+0000 7fa123000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa11c13f960 con 0x7fa11c13c980 2024-09-13T17:53:21.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.078+0000 7fa11be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa11c13c240 0x7fa11c13f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:21.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.078+0000 7fa11be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa11c13c240 0x7fa11c13f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36488/0 (socket says 172.21.15.114:36488) 2024-09-13T17:53:21.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.078+0000 7fa11be00640 1 -- 172.21.15.114:0/2976391852 learned_addr learned my addr 172.21.15.114:0/2976391852 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:21.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.078+0000 7fa11b400640 1 --2- 172.21.15.114:0/2976391852 >> v2:172.21.15.134:3300/0 conn(0x7fa11c13c980 0x7fa11c06d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:21.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.078+0000 7fa11be00640 1 -- 172.21.15.114:0/2976391852 >> v2:172.21.15.134:3300/0 conn(0x7fa11c13c980 msgr2=0x7fa11c06d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:21.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.078+0000 7fa11be00640 1 --2- 172.21.15.114:0/2976391852 >> v2:172.21.15.134:3300/0 conn(0x7fa11c13c980 0x7fa11c06d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.078+0000 7fa11be00640 1 -- 172.21.15.114:0/2976391852 >> v1:172.21.15.134:6789/0 conn(0x7fa11c06da90 legacy=0x7fa11c0cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:21.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.078+0000 7fa11be00640 1 -- 172.21.15.114:0/2976391852 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11c15a740 con 0x7fa11c13c240 2024-09-13T17:53:21.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.082+0000 7fa11be00640 1 --2- 172.21.15.114:0/2976391852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa11c13c240 0x7fa11c13f420 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa11c0ae130 tx=0x7fa10c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a048f603aafddad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:21.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.082+0000 7fa11aa00640 1 -- 172.21.15.114:0/2976391852 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c0a5880 con 0x7fa11c13c240 2024-09-13T17:53:21.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.082+0000 7fa11aa00640 1 -- 172.21.15.114:0/2976391852 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10c0a59e0 con 0x7fa11c13c240 2024-09-13T17:53:21.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.082+0000 7fa11aa00640 1 -- 172.21.15.114:0/2976391852 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c0a5d70 con 0x7fa11c13c240 2024-09-13T17:53:21.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.082+0000 7fa123000640 1 -- 172.21.15.114:0/2976391852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa11c13c240 msgr2=0x7fa11c13f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:21.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.082+0000 7fa123000640 1 --2- 172.21.15.114:0/2976391852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa11c13c240 0x7fa11c13f420 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa11c0ae130 tx=0x7fa10c01c9c0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.082+0000 7fa123000640 1 -- 172.21.15.114:0/2976391852 shutdown_connections 2024-09-13T17:53:21.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.082+0000 7fa123000640 1 --2- 172.21.15.114:0/2976391852 >> v2:172.21.15.134:3300/0 conn(0x7fa11c13c980 0x7fa11c06d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.082+0000 7fa123000640 1 --2- 172.21.15.114:0/2976391852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa11c13c240 0x7fa11c13f420 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.082+0000 7fa123000640 1 -- 172.21.15.114:0/2976391852 >> 172.21.15.114:0/2976391852 conn(0x7fa11c0660b0 msgr2=0x7fa11c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:21.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.082+0000 7fa123000640 1 -- 172.21.15.114:0/2976391852 shutdown_connections 2024-09-13T17:53:21.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.082+0000 7fa123000640 1 -- 172.21.15.114:0/2976391852 wait complete. 2024-09-13T17:53:21.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.086+0000 7fa123000640 1 Processor -- start 2024-09-13T17:53:21.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.086+0000 7fa123000640 1 -- start start 2024-09-13T17:53:21.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.086+0000 7fa123000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa11c06da90 0x7fa11c163860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:21.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.086+0000 7fa123000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa11c13c240 0x7fa11c0afe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:21.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.086+0000 7fa123000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa11c13c980 0x7fa11c0ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:21.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.086+0000 7fa123000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11c13e080 con 0x7fa11c13c980 2024-09-13T17:53:21.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.086+0000 7fa123000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11c13b650 con 0x7fa11c13c240 2024-09-13T17:53:21.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.086+0000 7fa123000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11c0aef70 con 0x7fa11c06da90 2024-09-13T17:53:21.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.086+0000 7fa121000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa11c13c980 0x7fa11c0ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:21.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.086+0000 7fa11b400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa11c13c240 0x7fa11c0afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:21.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.086+0000 7fa11be00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa11c06da90 0x7fa11c163860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:21.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.086+0000 7fa121000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa11c13c980 0x7fa11c0ae180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36494/0 (socket says 172.21.15.114:36494) 2024-09-13T17:53:21.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.086+0000 7fa121000640 1 -- 172.21.15.114:0/90872257 learned_addr learned my addr 172.21.15.114:0/90872257 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:21.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.086+0000 7fa121000640 1 -- 172.21.15.114:0/90872257 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa11c06da90 msgr2=0x7fa11c163860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:21.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.086+0000 7fa121000640 1 --2- 172.21.15.114:0/90872257 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa11c06da90 0x7fa11c163860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.086+0000 7fa121000640 1 -- 172.21.15.114:0/90872257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa11c13c240 msgr2=0x7fa11c0afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:21.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.086+0000 7fa121000640 1 --2- 172.21.15.114:0/90872257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa11c13c240 0x7fa11c0afe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.086+0000 7fa121000640 1 -- 172.21.15.114:0/90872257 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10c009b30 con 0x7fa11c13c980 2024-09-13T17:53:21.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.086+0000 7fa121000640 1 --2- 172.21.15.114:0/90872257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa11c13c980 0x7fa11c0ae180 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa11400c430 tx=0x7fa11400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:21.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.086+0000 7fa113e00640 1 -- 172.21.15.114:0/90872257 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa114005220 con 0x7fa11c13c980 2024-09-13T17:53:21.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.086+0000 7fa113e00640 1 -- 172.21.15.114:0/90872257 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa114005380 con 0x7fa11c13c980 2024-09-13T17:53:21.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.086+0000 7fa123000640 1 -- 172.21.15.114:0/90872257 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa11c0af250 con 0x7fa11c13c980 2024-09-13T17:53:21.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.086+0000 7fa113e00640 1 -- 172.21.15.114:0/90872257 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa114007270 con 0x7fa11c13c980 2024-09-13T17:53:21.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.086+0000 7fa123000640 1 -- 172.21.15.114:0/90872257 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa11c0b03b0 con 0x7fa11c13c980 2024-09-13T17:53:21.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.086+0000 7fa123000640 1 -- 172.21.15.114:0/90872257 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa11c13e1f0 con 0x7fa11c13c980 2024-09-13T17:53:21.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.090+0000 7fa113e00640 1 -- 172.21.15.114:0/90872257 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa1140073d0 con 0x7fa11c13c980 2024-09-13T17:53:21.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.090+0000 7fa113e00640 1 --2- 172.21.15.114:0/90872257 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa0fc066690 0x7fa0fc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:21.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.090+0000 7fa113e00640 1 -- 172.21.15.114:0/90872257 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa114083750 con 0x7fa11c13c980 2024-09-13T17:53:21.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.090+0000 7fa11be00640 1 --2- 172.21.15.114:0/90872257 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa0fc066690 0x7fa0fc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:21.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.090+0000 7fa11be00640 1 --2- 172.21.15.114:0/90872257 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa0fc066690 0x7fa0fc068b50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa10c0ae000 tx=0x7fa10c0a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:21.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.094+0000 7fa113e00640 1 -- 172.21.15.114:0/90872257 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa114050a20 con 0x7fa11c13c980 2024-09-13T17:53:21.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.246+0000 7fa123000640 1 -- 172.21.15.114:0/90872257 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa11c070620 con 0x7fa11c13c980 2024-09-13T17:53:21.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.246+0000 7fa113e00640 1 -- 172.21.15.114:0/90872257 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa114054040 con 0x7fa11c13c980 2024-09-13T17:53:21.254 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:53:21.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.250+0000 7fa123000640 1 -- 172.21.15.114:0/90872257 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa0fc066690 msgr2=0x7fa0fc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:21.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.250+0000 7fa123000640 1 --2- 172.21.15.114:0/90872257 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa0fc066690 0x7fa0fc068b50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa10c0ae000 tx=0x7fa10c0a7070 comp rx=0 tx=0).stop 2024-09-13T17:53:21.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.250+0000 7fa123000640 1 -- 172.21.15.114:0/90872257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa11c13c980 msgr2=0x7fa11c0ae180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:21.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.250+0000 7fa123000640 1 --2- 172.21.15.114:0/90872257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa11c13c980 0x7fa11c0ae180 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa11400c430 tx=0x7fa11400c8f0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.250+0000 7fa123000640 1 -- 172.21.15.114:0/90872257 shutdown_connections 2024-09-13T17:53:21.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.250+0000 7fa123000640 1 --2- 172.21.15.114:0/90872257 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa0fc066690 0x7fa0fc068b50 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.250+0000 7fa123000640 1 --2- 172.21.15.114:0/90872257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa11c13c980 0x7fa11c0ae180 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.250+0000 7fa123000640 1 --2- 172.21.15.114:0/90872257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa11c13c240 0x7fa11c0afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.250+0000 7fa123000640 1 --2- 172.21.15.114:0/90872257 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa11c06da90 0x7fa11c163860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.250+0000 7fa123000640 1 -- 172.21.15.114:0/90872257 >> 172.21.15.114:0/90872257 conn(0x7fa11c0660b0 msgr2=0x7fa11c0b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:21.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.250+0000 7fa123000640 1 -- 172.21.15.114:0/90872257 shutdown_connections 2024-09-13T17:53:21.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.250+0000 7fa123000640 1 -- 172.21.15.114:0/90872257 wait complete. 2024-09-13T17:53:21.274 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:53:21.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.406+0000 7f2d0b600640 1 Processor -- start 2024-09-13T17:53:21.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.406+0000 7f2d0b600640 1 -- start start 2024-09-13T17:53:21.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.406+0000 7f2d0b600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d0413f420 0x7f2d0406d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:21.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.406+0000 7f2d0b600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2d0406da90 0x7f2d040cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:21.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.406+0000 7f2d0b600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d040cd220 con 0x7f2d0413c240 2024-09-13T17:53:21.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.406+0000 7f2d0b600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0406ded0 con 0x7f2d0406da90 2024-09-13T17:53:21.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.406+0000 7f2d0b600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0415a740 con 0x7f2d0413f420 2024-09-13T17:53:21.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.406+0000 7f2d09600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2d0406da90 0x7f2d040cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:21.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.406+0000 7f2d08c00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2d0413c240 0x7f2d0413c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47616/0 (socket says 172.21.15.114:47616) 2024-09-13T17:53:21.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.406+0000 7f2d08c00640 1 -- 172.21.15.114:0/802118622 learned_addr learned my addr 172.21.15.114:0/802118622 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:21.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.406+0000 7f2cfbe00640 1 --2- 172.21.15.114:0/802118622 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d0413f420 0x7f2d0406d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:21.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.410+0000 7f2d09600640 1 -- 172.21.15.114:0/802118622 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d0413f420 msgr2=0x7f2d0406d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:21.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.410+0000 7f2d09600640 1 --2- 172.21.15.114:0/802118622 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d0413f420 0x7f2d0406d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.410+0000 7f2d09600640 1 -- 172.21.15.114:0/802118622 >> v1:172.21.15.114:6789/0 conn(0x7f2d0413c240 legacy=0x7f2d0413c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:21.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.410+0000 7f2d09600640 1 -- 172.21.15.114:0/802118622 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d04159bc0 con 0x7f2d0406da90 2024-09-13T17:53:21.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.410+0000 7f2d03e00640 1 -- 172.21.15.114:0/802118622 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1668562210 0 0) 0x7f2d040cd220 con 0x7f2d0413c240 2024-09-13T17:53:21.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.410+0000 7f2d09600640 1 --2- 172.21.15.114:0/802118622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d0406da90 0x7f2d040cd650 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00bfa0 tx=0x7f2cfc01eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb67b1c41c2a0ad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:21.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.410+0000 7f2d03e00640 1 -- 172.21.15.114:0/802118622 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc00b2d0 con 0x7f2d0406da90 2024-09-13T17:53:21.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.410+0000 7f2d03e00640 1 -- 172.21.15.114:0/802118622 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cfc0a7a10 con 0x7f2d0406da90 2024-09-13T17:53:21.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.410+0000 7f2d03e00640 1 -- 172.21.15.114:0/802118622 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc0a7da0 con 0x7f2d0406da90 2024-09-13T17:53:21.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.410+0000 7f2d0b600640 1 -- 172.21.15.114:0/802118622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d0406da90 msgr2=0x7f2d040cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:21.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.410+0000 7f2d0b600640 1 --2- 172.21.15.114:0/802118622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d0406da90 0x7f2d040cd650 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00bfa0 tx=0x7f2cfc01eb40 comp rx=0 tx=0).stop 2024-09-13T17:53:21.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.414+0000 7f2d0b600640 1 -- 172.21.15.114:0/802118622 shutdown_connections 2024-09-13T17:53:21.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.414+0000 7f2d0b600640 1 --2- 172.21.15.114:0/802118622 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d0406da90 0x7f2d040cd650 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.414+0000 7f2d0b600640 1 --2- 172.21.15.114:0/802118622 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d0413f420 0x7f2d0406d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.414+0000 7f2d0b600640 1 -- 172.21.15.114:0/802118622 >> 172.21.15.114:0/802118622 conn(0x7f2d040660b0 msgr2=0x7f2d04069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:21.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.414+0000 7f2d0b600640 1 -- 172.21.15.114:0/802118622 shutdown_connections 2024-09-13T17:53:21.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.414+0000 7f2d0b600640 1 -- 172.21.15.114:0/802118622 wait complete. 2024-09-13T17:53:21.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.414+0000 7f2d0b600640 1 Processor -- start 2024-09-13T17:53:21.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.414+0000 7f2d0b600640 1 -- start start 2024-09-13T17:53:21.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.414+0000 7f2d0b600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d0406da90 0x7f2d04138d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:21.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.414+0000 7f2d0b600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d0413c240 0x7f2d0413ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:21.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.414+0000 7f2d0b600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d0413f420 0x7f2d04154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:21.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.414+0000 7f2d0b600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d040ae490 con 0x7f2d0406da90 2024-09-13T17:53:21.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.414+0000 7f2d0b600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d040b1160 con 0x7f2d0413f420 2024-09-13T17:53:21.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.414+0000 7f2d0b600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d040b08e0 con 0x7f2d0413c240 2024-09-13T17:53:21.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.414+0000 7f2d08c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d0406da90 0x7f2d04138d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:21.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.414+0000 7f2d08c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d0406da90 0x7f2d04138d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36524/0 (socket says 172.21.15.114:36524) 2024-09-13T17:53:21.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.414+0000 7f2d08c00640 1 -- 172.21.15.114:0/264554101 learned_addr learned my addr 172.21.15.114:0/264554101 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:21.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.414+0000 7f2cfbe00640 1 --2- 172.21.15.114:0/264554101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d0413c240 0x7f2d0413ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:21.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.414+0000 7f2d08c00640 1 -- 172.21.15.114:0/264554101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d0413c240 msgr2=0x7f2d0413ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:21.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.414+0000 7f2d08c00640 1 --2- 172.21.15.114:0/264554101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d0413c240 0x7f2d0413ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.414+0000 7f2d08c00640 1 -- 172.21.15.114:0/264554101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d0413f420 msgr2=0x7f2d04154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:21.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.414+0000 7f2d08c00640 1 --2- 172.21.15.114:0/264554101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d0413f420 0x7f2d04154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.414+0000 7f2d08c00640 1 -- 172.21.15.114:0/264554101 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cfc00bc80 con 0x7f2d0406da90 2024-09-13T17:53:21.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.414+0000 7f2d08c00640 1 --2- 172.21.15.114:0/264554101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d0406da90 0x7f2d04138d70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2cf40011f0 tx=0x7f2cf400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:21.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.418+0000 7f2d01600640 1 -- 172.21.15.114:0/264554101 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf40074e0 con 0x7f2d0406da90 2024-09-13T17:53:21.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.418+0000 7f2d01600640 1 -- 172.21.15.114:0/264554101 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf4007640 con 0x7f2d0406da90 2024-09-13T17:53:21.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.418+0000 7f2d0b600640 1 -- 172.21.15.114:0/264554101 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d040b0ba0 con 0x7f2d0406da90 2024-09-13T17:53:21.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.418+0000 7f2d01600640 1 -- 172.21.15.114:0/264554101 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf4004a10 con 0x7f2d0406da90 2024-09-13T17:53:21.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.418+0000 7f2d0b600640 1 -- 172.21.15.114:0/264554101 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0413c9d0 con 0x7f2d0406da90 2024-09-13T17:53:21.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.418+0000 7f2d0b600640 1 -- 172.21.15.114:0/264554101 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d0413c830 con 0x7f2d0406da90 2024-09-13T17:53:21.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.418+0000 7f2d01600640 1 -- 172.21.15.114:0/264554101 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2cf4004b70 con 0x7f2d0406da90 2024-09-13T17:53:21.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.418+0000 7f2d01600640 1 --2- 172.21.15.114:0/264554101 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2ce0066690 0x7f2ce0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:21.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.418+0000 7f2d01600640 1 -- 172.21.15.114:0/264554101 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2cf4083820 con 0x7f2d0406da90 2024-09-13T17:53:21.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.418+0000 7f2cfbe00640 1 --2- 172.21.15.114:0/264554101 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2ce0066690 0x7f2ce0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:21.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.418+0000 7f2cfbe00640 1 --2- 172.21.15.114:0/264554101 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2ce0066690 0x7f2ce0068b50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2d04159000 tx=0x7f2cec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:21.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.422+0000 7f2d01600640 1 -- 172.21.15.114:0/264554101 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2d0413c830 con 0x7f2d0406da90 2024-09-13T17:53:21.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.574+0000 7f2d0b600640 1 -- 172.21.15.114:0/264554101 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2d0413c830 con 0x7f2d0406da90 2024-09-13T17:53:21.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.574+0000 7f2d01600640 1 -- 172.21.15.114:0/264554101 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2cf4018020 con 0x7f2d0406da90 2024-09-13T17:53:21.581 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-09-13T17:53:21.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.578+0000 7f2d0b600640 1 -- 172.21.15.114:0/264554101 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2ce0066690 msgr2=0x7f2ce0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:21.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.578+0000 7f2d0b600640 1 --2- 172.21.15.114:0/264554101 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2ce0066690 0x7f2ce0068b50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2d04159000 tx=0x7f2cec008040 comp rx=0 tx=0).stop 2024-09-13T17:53:21.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.578+0000 7f2d0b600640 1 -- 172.21.15.114:0/264554101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d0406da90 msgr2=0x7f2d04138d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:21.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.578+0000 7f2d0b600640 1 --2- 172.21.15.114:0/264554101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d0406da90 0x7f2d04138d70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2cf40011f0 tx=0x7f2cf400c9b0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.578+0000 7f2d0b600640 1 -- 172.21.15.114:0/264554101 shutdown_connections 2024-09-13T17:53:21.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.578+0000 7f2d0b600640 1 --2- 172.21.15.114:0/264554101 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2ce0066690 0x7f2ce0068b50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.578+0000 7f2d0b600640 1 --2- 172.21.15.114:0/264554101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d0413f420 0x7f2d04154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.578+0000 7f2d0b600640 1 --2- 172.21.15.114:0/264554101 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2d0413c240 0x7f2d0413ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.578+0000 7f2d0b600640 1 --2- 172.21.15.114:0/264554101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d0406da90 0x7f2d04138d70 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.578+0000 7f2d0b600640 1 -- 172.21.15.114:0/264554101 >> 172.21.15.114:0/264554101 conn(0x7f2d040660b0 msgr2=0x7f2d0406c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:21.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.578+0000 7f2d0b600640 1 -- 172.21.15.114:0/264554101 shutdown_connections 2024-09-13T17:53:21.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.578+0000 7f2d0b600640 1 -- 172.21.15.114:0/264554101 wait complete. 2024-09-13T17:53:21.604 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:53:21.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.734+0000 7f569fe00640 1 Processor -- start 2024-09-13T17:53:21.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.734+0000 7f569fe00640 1 -- start start 2024-09-13T17:53:21.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.734+0000 7f569fe00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f56980ce650 0x7f5698099480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:21.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.734+0000 7f569fe00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f569806e680 0x7f569806eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:21.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.734+0000 7f569fe00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56980cebe0 con 0x7f56981602e0 2024-09-13T17:53:21.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.734+0000 7f569fe00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56980ceec0 con 0x7f56980ce650 2024-09-13T17:53:21.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.734+0000 7f569fe00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56980cf1a0 con 0x7f569806e680 2024-09-13T17:53:21.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.734+0000 7f569d400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f56981602e0 0x7f56981606c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47630/0 (socket says 172.21.15.114:47630) 2024-09-13T17:53:21.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.734+0000 7f569d400640 1 -- 172.21.15.114:0/2713069692 learned_addr learned my addr 172.21.15.114:0/2713069692 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:21.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.734+0000 7f569de00640 1 --2- 172.21.15.114:0/2713069692 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f569806e680 0x7f569806eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:21.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.734+0000 7f569ca00640 1 --2- 172.21.15.114:0/2713069692 >> v2:172.21.15.134:3300/0 conn(0x7f56980ce650 0x7f5698099480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:21.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.734+0000 7f5697e00640 1 -- 172.21.15.114:0/2713069692 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3444244135 0 0) 0x7f56980cebe0 con 0x7f56981602e0 2024-09-13T17:53:21.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.734+0000 7f5697e00640 1 -- 172.21.15.114:0/2713069692 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5680003530 con 0x7f56981602e0 2024-09-13T17:53:21.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.734+0000 7f569de00640 1 -- 172.21.15.114:0/2713069692 >> v2:172.21.15.134:3300/0 conn(0x7f56980ce650 msgr2=0x7f5698099480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:21.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.734+0000 7f569de00640 1 --2- 172.21.15.114:0/2713069692 >> v2:172.21.15.134:3300/0 conn(0x7f56980ce650 0x7f5698099480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.734+0000 7f569de00640 1 -- 172.21.15.114:0/2713069692 >> v1:172.21.15.114:6789/0 conn(0x7f56981602e0 legacy=0x7f56981606c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:21.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.734+0000 7f569de00640 1 -- 172.21.15.114:0/2713069692 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56980cf480 con 0x7f569806e680 2024-09-13T17:53:21.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.738+0000 7f569de00640 1 --2- 172.21.15.114:0/2713069692 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f569806e680 0x7f569806eb10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5690009d90 tx=0x7f569001c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=470ab02d813f851f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:21.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.738+0000 7f5697e00640 1 -- 172.21.15.114:0/2713069692 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56900a5990 con 0x7f569806e680 2024-09-13T17:53:21.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.738+0000 7f5697e00640 1 -- 172.21.15.114:0/2713069692 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56900a5af0 con 0x7f569806e680 2024-09-13T17:53:21.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.738+0000 7f5697e00640 1 -- 172.21.15.114:0/2713069692 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56900a5e60 con 0x7f569806e680 2024-09-13T17:53:21.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.738+0000 7f569fe00640 1 -- 172.21.15.114:0/2713069692 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f569806e680 msgr2=0x7f569806eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:21.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.738+0000 7f569fe00640 1 --2- 172.21.15.114:0/2713069692 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f569806e680 0x7f569806eb10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5690009d90 tx=0x7f569001c8b0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.738+0000 7f569fe00640 1 -- 172.21.15.114:0/2713069692 shutdown_connections 2024-09-13T17:53:21.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.738+0000 7f569fe00640 1 --2- 172.21.15.114:0/2713069692 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f569806e680 0x7f569806eb10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.738+0000 7f569fe00640 1 --2- 172.21.15.114:0/2713069692 >> v2:172.21.15.134:3300/0 conn(0x7f56980ce650 0x7f5698099480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.738+0000 7f569fe00640 1 -- 172.21.15.114:0/2713069692 >> 172.21.15.114:0/2713069692 conn(0x7f56980d04e0 msgr2=0x7f56980d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:21.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.738+0000 7f569fe00640 1 -- 172.21.15.114:0/2713069692 shutdown_connections 2024-09-13T17:53:21.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.738+0000 7f569fe00640 1 -- 172.21.15.114:0/2713069692 wait complete. 2024-09-13T17:53:21.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.742+0000 7f569fe00640 1 Processor -- start 2024-09-13T17:53:21.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.742+0000 7f569fe00640 1 -- start start 2024-09-13T17:53:21.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.742+0000 7f569fe00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f569806e680 0x7f56980aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:21.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.742+0000 7f569fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56980ce650 0x7f5698157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:21.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.742+0000 7f569fe00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56981602e0 0x7f5698150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:21.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.742+0000 7f569fe00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5698160170 con 0x7f56980ce650 2024-09-13T17:53:21.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.742+0000 7f569fe00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569815f930 con 0x7f56981602e0 2024-09-13T17:53:21.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.742+0000 7f569fe00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569815e470 con 0x7f569806e680 2024-09-13T17:53:21.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.742+0000 7f569ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56980ce650 0x7f5698157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:21.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.742+0000 7f569ca00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56980ce650 0x7f5698157d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36526/0 (socket says 172.21.15.114:36526) 2024-09-13T17:53:21.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.742+0000 7f569ca00640 1 -- 172.21.15.114:0/3161100889 learned_addr learned my addr 172.21.15.114:0/3161100889 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:21.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.742+0000 7f569d400640 1 --2- 172.21.15.114:0/3161100889 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f569806e680 0x7f56980aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:21.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.742+0000 7f569de00640 1 --2- 172.21.15.114:0/3161100889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56981602e0 0x7f5698150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:21.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.742+0000 7f569ca00640 1 -- 172.21.15.114:0/3161100889 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f569806e680 msgr2=0x7f56980aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:21.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.742+0000 7f569ca00640 1 --2- 172.21.15.114:0/3161100889 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f569806e680 0x7f56980aeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.742+0000 7f569ca00640 1 -- 172.21.15.114:0/3161100889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56981602e0 msgr2=0x7f5698150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:21.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.742+0000 7f569ca00640 1 --2- 172.21.15.114:0/3161100889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56981602e0 0x7f5698150280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.742+0000 7f569ca00640 1 -- 172.21.15.114:0/3161100889 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5690009a70 con 0x7f56980ce650 2024-09-13T17:53:21.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.742+0000 7f569ca00640 1 --2- 172.21.15.114:0/3161100889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56980ce650 0x7f5698157d40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f568400e930 tx=0x7f568400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:21.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.742+0000 7f5695600640 1 -- 172.21.15.114:0/3161100889 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5684009690 con 0x7f56980ce650 2024-09-13T17:53:21.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.742+0000 7f5695600640 1 -- 172.21.15.114:0/3161100889 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568400ca00 con 0x7f56980ce650 2024-09-13T17:53:21.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.742+0000 7f569fe00640 1 -- 172.21.15.114:0/3161100889 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f569815fbb0 con 0x7f56980ce650 2024-09-13T17:53:21.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.742+0000 7f5695600640 1 -- 172.21.15.114:0/3161100889 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568400cd70 con 0x7f56980ce650 2024-09-13T17:53:21.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.742+0000 7f569fe00640 1 -- 172.21.15.114:0/3161100889 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56980ae990 con 0x7f56980ce650 2024-09-13T17:53:21.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.746+0000 7f569fe00640 1 -- 172.21.15.114:0/3161100889 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569806eb10 con 0x7f56980ce650 2024-09-13T17:53:21.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.746+0000 7f5695600640 1 -- 172.21.15.114:0/3161100889 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5684013470 con 0x7f56980ce650 2024-09-13T17:53:21.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.746+0000 7f5695600640 1 --2- 172.21.15.114:0/3161100889 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f56780666c0 0x7f5678068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:21.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.746+0000 7f5695600640 1 -- 172.21.15.114:0/3161100889 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f56840848b0 con 0x7f56980ce650 2024-09-13T17:53:21.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.746+0000 7f569d400640 1 --2- 172.21.15.114:0/3161100889 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f56780666c0 0x7f5678068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:21.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.746+0000 7f569d400640 1 --2- 172.21.15.114:0/3161100889 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f56780666c0 0x7f5678068b80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f568c005890 tx=0x7f568c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:21.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.750+0000 7f5695600640 1 -- 172.21.15.114:0/3161100889 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5684051ba0 con 0x7f56980ce650 2024-09-13T17:53:21.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.918+0000 7f569fe00640 1 -- 172.21.15.114:0/3161100889 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f56981673f0 con 0x7f56980ce650 2024-09-13T17:53:21.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.918+0000 7f5695600640 1 -- 172.21.15.114:0/3161100889 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5684017080 con 0x7f56980ce650 2024-09-13T17:53:21.923 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2024-09-13T17:53:21.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.918+0000 7f569fe00640 1 -- 172.21.15.114:0/3161100889 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f56780666c0 msgr2=0x7f5678068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:21.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.918+0000 7f569fe00640 1 --2- 172.21.15.114:0/3161100889 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f56780666c0 0x7f5678068b80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f568c005890 tx=0x7f568c009040 comp rx=0 tx=0).stop 2024-09-13T17:53:21.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.918+0000 7f569fe00640 1 -- 172.21.15.114:0/3161100889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56980ce650 msgr2=0x7f5698157d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:21.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.918+0000 7f569fe00640 1 --2- 172.21.15.114:0/3161100889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56980ce650 0x7f5698157d40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f568400e930 tx=0x7f568400edf0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.918+0000 7f569fe00640 1 -- 172.21.15.114:0/3161100889 shutdown_connections 2024-09-13T17:53:21.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.918+0000 7f569fe00640 1 --2- 172.21.15.114:0/3161100889 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f56780666c0 0x7f5678068b80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.918+0000 7f569fe00640 1 --2- 172.21.15.114:0/3161100889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56981602e0 0x7f5698150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.918+0000 7f569fe00640 1 --2- 172.21.15.114:0/3161100889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f56980ce650 0x7f5698157d40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.918+0000 7f569fe00640 1 --2- 172.21.15.114:0/3161100889 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f569806e680 0x7f56980aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:21.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.918+0000 7f569fe00640 1 -- 172.21.15.114:0/3161100889 >> 172.21.15.114:0/3161100889 conn(0x7f56980d04e0 msgr2=0x7f56980cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:21.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.918+0000 7f569fe00640 1 -- 172.21.15.114:0/3161100889 shutdown_connections 2024-09-13T17:53:21.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:21.918+0000 7f569fe00640 1 -- 172.21.15.114:0/3161100889 wait complete. 2024-09-13T17:53:21.943 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T17:53:21.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:53:21.944 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T17:53:22.007 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-09-13T17:53:22.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:53:22.007 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:53:22.019 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:53:22.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.190+0000 7fbb9ee00640 1 Processor -- start 2024-09-13T17:53:22.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.190+0000 7fbb9ee00640 1 -- start start 2024-09-13T17:53:22.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.190+0000 7fbb9ee00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb980b2370 0x7fbb9815d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:22.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.190+0000 7fbb9ee00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb9806d8a0 con 0x7fbb980cf2c0 2024-09-13T17:53:22.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.190+0000 7fbb9ee00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb9806cf70 con 0x7fbb980ae480 2024-09-13T17:53:22.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.190+0000 7fbb9ee00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb98157200 con 0x7fbb980b2370 2024-09-13T17:53:22.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.190+0000 7fbb9ce00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbb980cf2c0 0x7fbb98069f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47634/0 (socket says 172.21.15.114:47634) 2024-09-13T17:53:22.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.190+0000 7fbb9ce00640 1 -- 172.21.15.114:0/1093948826 learned_addr learned my addr 172.21.15.114:0/1093948826 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:22.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.190+0000 7fbb8f400640 1 --2- 172.21.15.114:0/1093948826 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb980b2370 0x7fbb9815d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:22.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.190+0000 7fbb97400640 1 -- 172.21.15.114:0/1093948826 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232152299 0 0) 0x7fbb9806d8a0 con 0x7fbb980cf2c0 2024-09-13T17:53:22.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.190+0000 7fbb97400640 1 -- 172.21.15.114:0/1093948826 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb7c003530 con 0x7fbb980cf2c0 2024-09-13T17:53:22.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.190+0000 7fbb97400640 1 -- 172.21.15.114:0/1093948826 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571464508 0 0) 0x7fbb9806cf70 con 0x7fbb980ae480 2024-09-13T17:53:22.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.190+0000 7fbb97400640 1 -- 172.21.15.114:0/1093948826 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb9806d8a0 con 0x7fbb980ae480 2024-09-13T17:53:22.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.190+0000 7fbb8f400640 1 -- 172.21.15.114:0/1093948826 >> v1:172.21.15.134:6789/0 conn(0x7fbb980ae480 legacy=0x7fbb980b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:22.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.190+0000 7fbb8f400640 1 -- 172.21.15.114:0/1093948826 >> v1:172.21.15.114:6789/0 conn(0x7fbb980cf2c0 legacy=0x7fbb98069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:22.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.190+0000 7fbb8f400640 1 -- 172.21.15.114:0/1093948826 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9806d250 con 0x7fbb980b2370 2024-09-13T17:53:22.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.194+0000 7fbb8f400640 1 --2- 172.21.15.114:0/1093948826 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb980b2370 0x7fbb9815d730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbb800097f0 tx=0x7fbb8001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32cd17fa228e93ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:22.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.194+0000 7fbb97400640 1 -- 172.21.15.114:0/1093948826 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb800ab600 con 0x7fbb980b2370 2024-09-13T17:53:22.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.194+0000 7fbb97400640 1 -- 172.21.15.114:0/1093948826 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb800a7050 con 0x7fbb980b2370 2024-09-13T17:53:22.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.194+0000 7fbb97400640 1 -- 172.21.15.114:0/1093948826 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb800ab980 con 0x7fbb980b2370 2024-09-13T17:53:22.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.194+0000 7fbb9ee00640 1 -- 172.21.15.114:0/1093948826 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb980b2370 msgr2=0x7fbb9815d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:22.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.194+0000 7fbb9ee00640 1 --2- 172.21.15.114:0/1093948826 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb980b2370 0x7fbb9815d730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbb800097f0 tx=0x7fbb8001c450 comp rx=0 tx=0).stop 2024-09-13T17:53:22.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.194+0000 7fbb9ee00640 1 -- 172.21.15.114:0/1093948826 shutdown_connections 2024-09-13T17:53:22.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.194+0000 7fbb9ee00640 1 --2- 172.21.15.114:0/1093948826 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb980b2370 0x7fbb9815d730 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:22.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.194+0000 7fbb9ee00640 1 -- 172.21.15.114:0/1093948826 >> 172.21.15.114:0/1093948826 conn(0x7fbb980b0f60 msgr2=0x7fbb980cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:22.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.194+0000 7fbb9ee00640 1 -- 172.21.15.114:0/1093948826 shutdown_connections 2024-09-13T17:53:22.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.194+0000 7fbb9ee00640 1 -- 172.21.15.114:0/1093948826 wait complete. 2024-09-13T17:53:22.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.198+0000 7fbb9ee00640 1 Processor -- start 2024-09-13T17:53:22.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.198+0000 7fbb9ee00640 1 -- start start 2024-09-13T17:53:22.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.198+0000 7fbb9ee00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb980ae480 0x7fbb98157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:22.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.198+0000 7fbb9ee00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb980b2370 0x7fbb98158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:22.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.198+0000 7fbb9ee00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb980cf2c0 0x7fbb98150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:22.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.198+0000 7fbb9ee00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9815a0a0 con 0x7fbb980ae480 2024-09-13T17:53:22.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.198+0000 7fbb9ee00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb980ac120 con 0x7fbb980cf2c0 2024-09-13T17:53:22.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.198+0000 7fbb9ee00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb980ac400 con 0x7fbb980b2370 2024-09-13T17:53:22.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.198+0000 7fbb97e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb980ae480 0x7fbb98157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:22.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.198+0000 7fbb97e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb980ae480 0x7fbb98157b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36536/0 (socket says 172.21.15.114:36536) 2024-09-13T17:53:22.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.198+0000 7fbb97e00640 1 -- 172.21.15.114:0/2913237086 learned_addr learned my addr 172.21.15.114:0/2913237086 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:22.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.198+0000 7fbb9ce00640 1 --2- 172.21.15.114:0/2913237086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb980cf2c0 0x7fbb98150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:22.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.198+0000 7fbb8f400640 1 --2- 172.21.15.114:0/2913237086 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb980b2370 0x7fbb98158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:22.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.198+0000 7fbb97e00640 1 -- 172.21.15.114:0/2913237086 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb980b2370 msgr2=0x7fbb98158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:22.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.198+0000 7fbb97e00640 1 --2- 172.21.15.114:0/2913237086 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb980b2370 0x7fbb98158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:22.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.198+0000 7fbb97e00640 1 -- 172.21.15.114:0/2913237086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb980cf2c0 msgr2=0x7fbb98150320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:22.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.198+0000 7fbb97e00640 1 --2- 172.21.15.114:0/2913237086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb980cf2c0 0x7fbb98150320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:22.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.198+0000 7fbb97e00640 1 -- 172.21.15.114:0/2913237086 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb80009420 con 0x7fbb980ae480 2024-09-13T17:53:22.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.198+0000 7fbb9ce00640 1 --2- 172.21.15.114:0/2913237086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb980cf2c0 0x7fbb98150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:22.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.198+0000 7fbb97e00640 1 --2- 172.21.15.114:0/2913237086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb980ae480 0x7fbb98157b00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800c430 tx=0x7fbb8800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:22.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.198+0000 7fbb94c00640 1 -- 172.21.15.114:0/2913237086 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb880052d0 con 0x7fbb980ae480 2024-09-13T17:53:22.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.198+0000 7fbb94c00640 1 -- 172.21.15.114:0/2913237086 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb88005450 con 0x7fbb980ae480 2024-09-13T17:53:22.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.198+0000 7fbb94c00640 1 -- 172.21.15.114:0/2913237086 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb88003840 con 0x7fbb980ae480 2024-09-13T17:53:22.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.198+0000 7fbb9ee00640 1 -- 172.21.15.114:0/2913237086 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb980ac6e0 con 0x7fbb980ae480 2024-09-13T17:53:22.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.198+0000 7fbb9ee00640 1 -- 172.21.15.114:0/2913237086 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb980cb4d0 con 0x7fbb980ae480 2024-09-13T17:53:22.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.202+0000 7fbb9ee00640 1 -- 172.21.15.114:0/2913237086 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb980abf80 con 0x7fbb980ae480 2024-09-13T17:53:22.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.202+0000 7fbb94c00640 1 -- 172.21.15.114:0/2913237086 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbb880039a0 con 0x7fbb980ae480 2024-09-13T17:53:22.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.202+0000 7fbb94c00640 1 --2- 172.21.15.114:0/2913237086 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbb74066690 0x7fbb74068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:22.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.202+0000 7fbb94c00640 1 -- 172.21.15.114:0/2913237086 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbb880837f0 con 0x7fbb980ae480 2024-09-13T17:53:22.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.202+0000 7fbb8f400640 1 --2- 172.21.15.114:0/2913237086 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbb74066690 0x7fbb74068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:22.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.202+0000 7fbb8f400640 1 --2- 172.21.15.114:0/2913237086 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbb74066690 0x7fbb74068b50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbb800ad000 tx=0x7fbb80008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:22.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.206+0000 7fbb94c00640 1 -- 172.21.15.114:0/2913237086 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbb980abf80 con 0x7fbb980ae480 2024-09-13T17:53:22.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.390+0000 7fbb9ee00640 1 -- 172.21.15.114:0/2913237086 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb980abf80 con 0x7fbb980ae480 2024-09-13T17:53:22.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.390+0000 7fbb94c00640 1 -- 172.21.15.114:0/2913237086 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4743 (secure 0 0 0) 0x7fbb980abf80 con 0x7fbb980ae480 2024-09-13T17:53:22.399 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:22.399 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4940,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6834/895508060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":895508060},{"type":"v1","addr":"172.21.15.134:6834","nonce":895508060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5230,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/1163188146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6836","nonce":1163188146},{"type":"v1","addr":"172.21.15.114:6837","nonce":1163188146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5313,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/1106595705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1106595705},{"type":"v1","addr":"172.21.15.114:6835","nonce":1106595705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:53:08.298484+0000","modified":"2024-09-13T17:53:11.309977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5316},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5316":{"gid":5316,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.134:6835/1239035445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6833","nonce":1239035445},{"type":"v1","addr":"172.21.15.134:6835","nonce":1239035445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T17:53:22.401 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 17 2024-09-13T17:53:22.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.394+0000 7fbb9ee00640 1 -- 172.21.15.114:0/2913237086 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbb74066690 msgr2=0x7fbb74068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:22.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.394+0000 7fbb9ee00640 1 --2- 172.21.15.114:0/2913237086 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbb74066690 0x7fbb74068b50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbb800ad000 tx=0x7fbb80008040 comp rx=0 tx=0).stop 2024-09-13T17:53:22.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.394+0000 7fbb9ee00640 1 -- 172.21.15.114:0/2913237086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb980ae480 msgr2=0x7fbb98157b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:22.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.394+0000 7fbb9ee00640 1 --2- 172.21.15.114:0/2913237086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb980ae480 0x7fbb98157b00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800c430 tx=0x7fbb8800c8f0 comp rx=0 tx=0).stop 2024-09-13T17:53:22.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.394+0000 7fbb9ee00640 1 -- 172.21.15.114:0/2913237086 shutdown_connections 2024-09-13T17:53:22.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.394+0000 7fbb9ee00640 1 --2- 172.21.15.114:0/2913237086 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbb74066690 0x7fbb74068b50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:22.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.394+0000 7fbb9ee00640 1 --2- 172.21.15.114:0/2913237086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb980cf2c0 0x7fbb98150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:22.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.394+0000 7fbb9ee00640 1 --2- 172.21.15.114:0/2913237086 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb980b2370 0x7fbb98158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:22.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.394+0000 7fbb9ee00640 1 --2- 172.21.15.114:0/2913237086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb980ae480 0x7fbb98157b00 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:22.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.394+0000 7fbb9ee00640 1 -- 172.21.15.114:0/2913237086 >> 172.21.15.114:0/2913237086 conn(0x7fbb980b0f60 msgr2=0x7fbb980cacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:22.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.394+0000 7fbb9ee00640 1 -- 172.21.15.114:0/2913237086 shutdown_connections 2024-09-13T17:53:22.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.394+0000 7fbb9ee00640 1 -- 172.21.15.114:0/2913237086 wait complete. 2024-09-13T17:53:22.420 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-09-13T17:53:22.591 INFO:teuthology.orchestra.run.smithi134.stdout:{"message":"","return_code":0} 2024-09-13T17:53:22.591 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-13T17:53:22.592 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T17:53:22.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.722+0000 7f8e20800640 1 Processor -- start 2024-09-13T17:53:22.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.722+0000 7f8e20800640 1 -- start start 2024-09-13T17:53:22.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.722+0000 7f8e20800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8e1813f420 0x7f8e1806d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:22.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.722+0000 7f8e20800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8e1806da90 0x7f8e180cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:22.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.722+0000 7f8e20800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e180cd220 con 0x7f8e1813c240 2024-09-13T17:53:22.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.722+0000 7f8e20800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e1806df40 con 0x7f8e1806da90 2024-09-13T17:53:22.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.722+0000 7f8e20800640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e1815a740 con 0x7f8e1813f420 2024-09-13T17:53:22.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.722+0000 7f8e1e800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8e1806da90 0x7f8e180cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:22.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.722+0000 7f8e1e800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8e1806da90 0x7f8e180cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36548/0 (socket says 172.21.15.114:36548) 2024-09-13T17:53:22.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.722+0000 7f8e1de00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8e1813c240 0x7f8e1813c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47640/0 (socket says 172.21.15.114:47640) 2024-09-13T17:53:22.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.722+0000 7f8e1e800640 1 -- 172.21.15.114:0/2869150771 learned_addr learned my addr 172.21.15.114:0/2869150771 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:22.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.722+0000 7f8e1d400640 1 --2- 172.21.15.114:0/2869150771 >> v2:172.21.15.134:3300/0 conn(0x7f8e1813f420 0x7f8e1806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:22.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.726+0000 7f8e1e800640 1 -- 172.21.15.114:0/2869150771 >> v2:172.21.15.134:3300/0 conn(0x7f8e1813f420 msgr2=0x7f8e1806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:22.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.726+0000 7f8e1e800640 1 --2- 172.21.15.114:0/2869150771 >> v2:172.21.15.134:3300/0 conn(0x7f8e1813f420 0x7f8e1806d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:22.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.726+0000 7f8e1e800640 1 -- 172.21.15.114:0/2869150771 >> v1:172.21.15.114:6789/0 conn(0x7f8e1813c240 legacy=0x7f8e1813c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:22.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.726+0000 7f8e1e800640 1 -- 172.21.15.114:0/2869150771 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e18159bc0 con 0x7f8e1806da90 2024-09-13T17:53:22.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.726+0000 7f8e1ca00640 1 -- 172.21.15.114:0/2869150771 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 372071391 0 0) 0x7f8e180cd220 con 0x7f8e1813c240 2024-09-13T17:53:22.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.726+0000 7f8e1e800640 1 --2- 172.21.15.114:0/2869150771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e1806da90 0x7f8e180cd650 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8e180ae130 tx=0x7f8e1401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f186eea3dfc5e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:22.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.726+0000 7f8e1ca00640 1 -- 172.21.15.114:0/2869150771 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e140a5880 con 0x7f8e1806da90 2024-09-13T17:53:22.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.726+0000 7f8e1ca00640 1 -- 172.21.15.114:0/2869150771 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e140a59e0 con 0x7f8e1806da90 2024-09-13T17:53:22.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.726+0000 7f8e1ca00640 1 -- 172.21.15.114:0/2869150771 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e140a5d70 con 0x7f8e1806da90 2024-09-13T17:53:22.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.726+0000 7f8e20800640 1 -- 172.21.15.114:0/2869150771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e1806da90 msgr2=0x7f8e180cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:22.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.726+0000 7f8e20800640 1 --2- 172.21.15.114:0/2869150771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e1806da90 0x7f8e180cd650 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8e180ae130 tx=0x7f8e1401c9c0 comp rx=0 tx=0).stop 2024-09-13T17:53:22.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.726+0000 7f8e20800640 1 -- 172.21.15.114:0/2869150771 shutdown_connections 2024-09-13T17:53:22.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.726+0000 7f8e20800640 1 --2- 172.21.15.114:0/2869150771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e1806da90 0x7f8e180cd650 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:22.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.726+0000 7f8e20800640 1 --2- 172.21.15.114:0/2869150771 >> v2:172.21.15.134:3300/0 conn(0x7f8e1813f420 0x7f8e1806d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:22.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.726+0000 7f8e20800640 1 -- 172.21.15.114:0/2869150771 >> 172.21.15.114:0/2869150771 conn(0x7f8e180660b0 msgr2=0x7f8e18069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:22.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.726+0000 7f8e20800640 1 -- 172.21.15.114:0/2869150771 shutdown_connections 2024-09-13T17:53:22.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.726+0000 7f8e20800640 1 -- 172.21.15.114:0/2869150771 wait complete. 2024-09-13T17:53:22.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.730+0000 7f8e20800640 1 Processor -- start 2024-09-13T17:53:22.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.730+0000 7f8e20800640 1 -- start start 2024-09-13T17:53:22.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.730+0000 7f8e20800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e1806da90 0x7f8e1813d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:22.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.730+0000 7f8e20800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e1813c240 0x7f8e1813e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:22.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.730+0000 7f8e20800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e1813f420 0x7f8e180aca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:22.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.730+0000 7f8e20800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e180ab980 con 0x7f8e1806da90 2024-09-13T17:53:22.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.730+0000 7f8e20800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e180abc60 con 0x7f8e1813f420 2024-09-13T17:53:22.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.730+0000 7f8e20800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e180abf40 con 0x7f8e1813c240 2024-09-13T17:53:22.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.730+0000 7f8e1de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e1806da90 0x7f8e1813d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:22.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.730+0000 7f8e1de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e1806da90 0x7f8e1813d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36560/0 (socket says 172.21.15.114:36560) 2024-09-13T17:53:22.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.730+0000 7f8e1de00640 1 -- 172.21.15.114:0/3839833778 learned_addr learned my addr 172.21.15.114:0/3839833778 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:22.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.730+0000 7f8e1e800640 1 --2- 172.21.15.114:0/3839833778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e1813f420 0x7f8e180aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:22.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.730+0000 7f8e1d400640 1 --2- 172.21.15.114:0/3839833778 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e1813c240 0x7f8e1813e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:22.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.730+0000 7f8e1de00640 1 -- 172.21.15.114:0/3839833778 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e1813c240 msgr2=0x7f8e1813e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:22.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.730+0000 7f8e1de00640 1 --2- 172.21.15.114:0/3839833778 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e1813c240 0x7f8e1813e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:22.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.730+0000 7f8e1de00640 1 -- 172.21.15.114:0/3839833778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e1813f420 msgr2=0x7f8e180aca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:22.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.730+0000 7f8e1de00640 1 --2- 172.21.15.114:0/3839833778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e1813f420 0x7f8e180aca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:22.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.730+0000 7f8e1de00640 1 -- 172.21.15.114:0/3839833778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e14009b30 con 0x7f8e1806da90 2024-09-13T17:53:22.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.730+0000 7f8e1de00640 1 --2- 172.21.15.114:0/3839833778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e1806da90 0x7f8e1813d090 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0011f0 tx=0x7f8e0c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:22.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.730+0000 7f8e12000640 1 -- 172.21.15.114:0/3839833778 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c0074e0 con 0x7f8e1806da90 2024-09-13T17:53:22.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.730+0000 7f8e12000640 1 -- 172.21.15.114:0/3839833778 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0c007640 con 0x7f8e1806da90 2024-09-13T17:53:22.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.730+0000 7f8e20800640 1 -- 172.21.15.114:0/3839833778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e180ac220 con 0x7f8e1806da90 2024-09-13T17:53:22.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.730+0000 7f8e12000640 1 -- 172.21.15.114:0/3839833778 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c004a10 con 0x7f8e1806da90 2024-09-13T17:53:22.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.734+0000 7f8e20800640 1 -- 172.21.15.114:0/3839833778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e1813e8c0 con 0x7f8e1806da90 2024-09-13T17:53:22.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.734+0000 7f8e20800640 1 -- 172.21.15.114:0/3839833778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e18159790 con 0x7f8e1806da90 2024-09-13T17:53:22.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.734+0000 7f8e12000640 1 -- 172.21.15.114:0/3839833778 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8e0c004b70 con 0x7f8e1806da90 2024-09-13T17:53:22.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.734+0000 7f8e12000640 1 --2- 172.21.15.114:0/3839833778 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8dfc066690 0x7f8dfc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:22.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.734+0000 7f8e12000640 1 -- 172.21.15.114:0/3839833778 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8e0c0838f0 con 0x7f8e1806da90 2024-09-13T17:53:22.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.734+0000 7f8e1d400640 1 --2- 172.21.15.114:0/3839833778 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8dfc066690 0x7f8dfc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:22.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.734+0000 7f8e1d400640 1 --2- 172.21.15.114:0/3839833778 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8dfc066690 0x7f8dfc068b50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8e1814bd60 tx=0x7f8e08008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:22.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.738+0000 7f8e12000640 1 -- 172.21.15.114:0/3839833778 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8e0c050a80 con 0x7f8e1806da90 2024-09-13T17:53:22.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.922+0000 7f8e20800640 1 -- 172.21.15.114:0/3839833778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8e1813d750 con 0x7f8e1806da90 2024-09-13T17:53:22.929 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-09-13T17:53:22.926+0000 7f67ad800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:53:22.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.930+0000 7f8e12000640 1 -- 172.21.15.114:0/3839833778 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8e0c018020 con 0x7f8e1806da90 2024-09-13T17:53:22.937 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T17:53:22.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.934+0000 7f8e20800640 1 -- 172.21.15.114:0/3839833778 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8dfc066690 msgr2=0x7f8dfc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:22.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.934+0000 7f8e20800640 1 --2- 172.21.15.114:0/3839833778 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8dfc066690 0x7f8dfc068b50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8e1814bd60 tx=0x7f8e08008040 comp rx=0 tx=0).stop 2024-09-13T17:53:22.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.934+0000 7f8e20800640 1 -- 172.21.15.114:0/3839833778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e1806da90 msgr2=0x7f8e1813d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:22.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.934+0000 7f8e20800640 1 --2- 172.21.15.114:0/3839833778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e1806da90 0x7f8e1813d090 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0011f0 tx=0x7f8e0c00c9b0 comp rx=0 tx=0).stop 2024-09-13T17:53:22.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.934+0000 7f8e20800640 1 -- 172.21.15.114:0/3839833778 shutdown_connections 2024-09-13T17:53:22.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.934+0000 7f8e20800640 1 --2- 172.21.15.114:0/3839833778 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8dfc066690 0x7f8dfc068b50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:22.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.934+0000 7f8e20800640 1 --2- 172.21.15.114:0/3839833778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e1813f420 0x7f8e180aca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:22.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.934+0000 7f8e20800640 1 --2- 172.21.15.114:0/3839833778 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8e1813c240 0x7f8e1813e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:22.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.934+0000 7f8e20800640 1 --2- 172.21.15.114:0/3839833778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e1806da90 0x7f8e1813d090 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:22.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.934+0000 7f8e20800640 1 -- 172.21.15.114:0/3839833778 >> 172.21.15.114:0/3839833778 conn(0x7f8e180660b0 msgr2=0x7f8e18156840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:22.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.934+0000 7f8e20800640 1 -- 172.21.15.114:0/3839833778 shutdown_connections 2024-09-13T17:53:22.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:22.934+0000 7f8e20800640 1 -- 172.21.15.114:0/3839833778 wait complete. 2024-09-13T17:53:22.945 INFO:tasks.ceph.mds.d.smithi134.stderr: -4251> 2024-09-13T17:53:11.887+0000 7fe311000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:53:22.960 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T17:53:22.963 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T17:53:22.994 INFO:tasks.ceph.mds.d.smithi134.stdout:starting mds.d at 2024-09-13T17:53:23.003 INFO:teuthology.orchestra.run.smithi114.stdout:[global] 2024-09-13T17:53:23.003 INFO:teuthology.orchestra.run.smithi114.stdout: chdir = "" 2024-09-13T17:53:23.003 INFO:teuthology.orchestra.run.smithi114.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T17:53:23.003 INFO:teuthology.orchestra.run.smithi114.stdout: auth supported = cephx 2024-09-13T17:53:23.003 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.004 INFO:teuthology.orchestra.run.smithi114.stdout: filestore xattr use omap = true 2024-09-13T17:53:23.004 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.004 INFO:teuthology.orchestra.run.smithi114.stdout: mon clock drift allowed = 1.000 2024-09-13T17:53:23.004 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.004 INFO:teuthology.orchestra.run.smithi114.stdout: osd crush chooseleaf type = 0 2024-09-13T17:53:23.004 INFO:teuthology.orchestra.run.smithi114.stdout: auth debug = true 2024-09-13T17:53:23.004 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.004 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on old message = true 2024-09-13T17:53:23.004 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on bug = true 2024-09-13T17:53:23.005 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.005 INFO:teuthology.orchestra.run.smithi114.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T17:53:23.005 INFO:teuthology.orchestra.run.smithi114.stdout: mon pg warn max object skew = 0 2024-09-13T17:53:23.005 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.005 INFO:teuthology.orchestra.run.smithi114.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T17:53:23.005 INFO:teuthology.orchestra.run.smithi114.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T17:53:23.005 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.005 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default size = 2 2024-09-13T17:53:23.005 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.005 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow primary affinity = true 2024-09-13T17:53:23.005 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow pg remap = true 2024-09-13T17:53:23.005 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on legacy crush tunables = false 2024-09-13T17:53:23.006 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on crush straw calc version zero = false 2024-09-13T17:53:23.006 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on no sortbitwise = false 2024-09-13T17:53:23.006 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on osd down out interval zero = false 2024-09-13T17:53:23.006 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on too few osds = false 2024-09-13T17:53:23.006 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T17:53:23.006 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T17:53:23.006 INFO:teuthology.orchestra.run.smithi114.stdout: mon_allow_pool_size_one = true 2024-09-13T17:53:23.006 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.006 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T17:53:23.006 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.006 INFO:teuthology.orchestra.run.smithi114.stdout: osd default data pool replay window = 5 2024-09-13T17:53:23.006 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.007 INFO:teuthology.orchestra.run.smithi114.stdout: mon allow pool delete = true 2024-09-13T17:53:23.007 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.007 INFO:teuthology.orchestra.run.smithi114.stdout: mon cluster log file level = debug 2024-09-13T17:53:23.007 INFO:teuthology.orchestra.run.smithi114.stdout: debug asserts on shutdown = true 2024-09-13T17:53:23.007 INFO:teuthology.orchestra.run.smithi114.stdout: mon health detail to clog = false 2024-09-13T17:53:23.007 INFO:teuthology.orchestra.run.smithi114.stdout: mon host = "172.21.15.114,172.21.15.134,[v2:172.21.15.134:3301,v1:172.21.15.134:6790]" 2024-09-13T17:53:23.007 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on skipped message = False 2024-09-13T17:53:23.007 INFO:teuthology.orchestra.run.smithi114.stdout: fsid = d730423f-882d-4061-b746-f6a7dc2544e0 2024-09-13T17:53:23.007 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.007 INFO:teuthology.orchestra.run.smithi114.stdout:[osd] 2024-09-13T17:53:23.008 INFO:teuthology.orchestra.run.smithi114.stdout: osd journal size = 100 2024-09-13T17:53:23.008 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.008 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub load threshold = 5.0 2024-09-13T17:53:23.008 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub max interval = 600 2024-09-13T17:53:23.008 INFO:teuthology.orchestra.run.smithi114.stdout: osd mclock profile = high_recovery_ops 2024-09-13T17:53:23.008 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.008 INFO:teuthology.orchestra.run.smithi114.stdout: osd recover clone overlap = true 2024-09-13T17:53:23.008 INFO:teuthology.orchestra.run.smithi114.stdout: osd recovery max chunk = 1048576 2024-09-13T17:53:23.008 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.008 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug shutdown = true 2024-09-13T17:53:23.008 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug op order = true 2024-09-13T17:53:23.008 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug verify stray on activate = true 2024-09-13T17:53:23.008 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.009 INFO:teuthology.orchestra.run.smithi114.stdout: osd open classes on start = true 2024-09-13T17:53:23.009 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug pg log writeout = true 2024-09-13T17:53:23.009 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.009 INFO:teuthology.orchestra.run.smithi114.stdout: osd deep scrub update digest min age = 30 2024-09-13T17:53:23.009 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.009 INFO:teuthology.orchestra.run.smithi114.stdout: osd map max advance = 10 2024-09-13T17:53:23.009 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.009 INFO:teuthology.orchestra.run.smithi114.stdout: journal zero on create = true 2024-09-13T17:53:23.009 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.009 INFO:teuthology.orchestra.run.smithi114.stdout: filestore ondisk finisher threads = 3 2024-09-13T17:53:23.009 INFO:teuthology.orchestra.run.smithi114.stdout: filestore apply finisher threads = 3 2024-09-13T17:53:23.009 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.009 INFO:teuthology.orchestra.run.smithi114.stdout: bdev debug aio = true 2024-09-13T17:53:23.010 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug misdirected ops = true 2024-09-13T17:53:23.010 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore block size = 96636764160 2024-09-13T17:53:23.010 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore fsck on mount = True 2024-09-13T17:53:23.010 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluefs = 20 2024-09-13T17:53:23.010 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluestore = 20 2024-09-13T17:53:23.010 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-09-13T17:53:23.010 INFO:teuthology.orchestra.run.smithi114.stdout: debug osd = 20 2024-09-13T17:53:23.010 INFO:teuthology.orchestra.run.smithi114.stdout: debug rocksdb = 10 2024-09-13T17:53:23.010 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T17:53:23.010 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd full ratio = 0.9 2024-09-13T17:53:23.010 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd nearfull ratio = 0.8 2024-09-13T17:53:23.010 INFO:teuthology.orchestra.run.smithi114.stdout: osd failsafe full ratio = 0.95 2024-09-13T17:53:23.010 INFO:teuthology.orchestra.run.smithi114.stdout: osd objectstore = bluestore 2024-09-13T17:53:23.010 INFO:teuthology.orchestra.run.smithi114.stdout: osd op complaint time = 180 2024-09-13T17:53:23.011 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.011 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr] 2024-09-13T17:53:23.011 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-09-13T17:53:23.011 INFO:teuthology.orchestra.run.smithi114.stdout: debug mgr = 20 2024-09-13T17:53:23.011 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2024-09-13T17:53:23.011 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2024-09-13T17:53:23.011 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:53:23.011 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:53:23.011 INFO:teuthology.orchestra.run.smithi114.stdout: mgr/telemetry/nag = false 2024-09-13T17:53:23.011 INFO:teuthology.orchestra.run.smithi114.stdout: debug client = 20 2024-09-13T17:53:23.011 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.011 INFO:teuthology.orchestra.run.smithi114.stdout:[mon] 2024-09-13T17:53:23.011 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-09-13T17:53:23.011 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2024-09-13T17:53:23.012 INFO:teuthology.orchestra.run.smithi114.stdout: debug paxos = 20 2024-09-13T17:53:23.012 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2024-09-13T17:53:23.012 INFO:teuthology.orchestra.run.smithi114.stdout: mon data avail warn = 5 2024-09-13T17:53:23.012 INFO:teuthology.orchestra.run.smithi114.stdout: mon mgr mkfs grace = 240 2024-09-13T17:53:23.012 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:53:23.012 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd reporter subtree level = osd 2024-09-13T17:53:23.012 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd prime pg temp = true 2024-09-13T17:53:23.012 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:53:23.012 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.012 INFO:teuthology.orchestra.run.smithi114.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T17:53:23.012 INFO:teuthology.orchestra.run.smithi114.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T17:53:23.012 INFO:teuthology.orchestra.run.smithi114.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T17:53:23.012 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.012 INFO:teuthology.orchestra.run.smithi114.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T17:53:23.013 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T17:53:23.013 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T17:53:23.013 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.013 INFO:teuthology.orchestra.run.smithi114.stdout: # 1m isn't quite enough 2024-09-13T17:53:23.013 INFO:teuthology.orchestra.run.smithi114.stdout: mon_down_mkfs_grace = 2m 2024-09-13T17:53:23.013 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.013 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_filestore_osds = false 2024-09-13T17:53:23.013 INFO:teuthology.orchestra.run.smithi114.stdout: mon op complaint time = 120 2024-09-13T17:53:23.013 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on pool no app = False 2024-09-13T17:53:23.013 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.013 INFO:teuthology.orchestra.run.smithi114.stdout:[client] 2024-09-13T17:53:23.013 INFO:teuthology.orchestra.run.smithi114.stdout: rgw cache enabled = true 2024-09-13T17:53:23.013 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable ops log = true 2024-09-13T17:53:23.013 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable usage log = true 2024-09-13T17:53:23.013 INFO:teuthology.orchestra.run.smithi114.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T17:53:23.014 INFO:teuthology.orchestra.run.smithi114.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T17:53:23.014 INFO:teuthology.orchestra.run.smithi114.stdout: client mount timeout = 600 2024-09-13T17:53:23.014 INFO:teuthology.orchestra.run.smithi114.stdout: debug client = 20 2024-09-13T17:53:23.014 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-09-13T17:53:23.014 INFO:teuthology.orchestra.run.smithi114.stdout: pid file = "" 2024-09-13T17:53:23.014 INFO:teuthology.orchestra.run.smithi114.stdout: rados mon op timeout = 900 2024-09-13T17:53:23.014 INFO:teuthology.orchestra.run.smithi114.stdout: rados osd op timeout = 900 2024-09-13T17:53:23.014 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.a] 2024-09-13T17:53:23.014 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.b] 2024-09-13T17:53:23.014 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.c] 2024-09-13T17:53:23.014 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.a] 2024-09-13T17:53:23.014 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.c] 2024-09-13T17:53:23.014 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.b] 2024-09-13T17:53:23.014 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.d] 2024-09-13T17:53:23.014 INFO:teuthology.orchestra.run.smithi114.stdout:[mds] 2024-09-13T17:53:23.015 INFO:teuthology.orchestra.run.smithi114.stdout: debug mds = 20 2024-09-13T17:53:23.015 INFO:teuthology.orchestra.run.smithi114.stdout: debug mds balancer = 20 2024-09-13T17:53:23.015 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-09-13T17:53:23.015 INFO:teuthology.orchestra.run.smithi114.stdout: mds debug frag = True 2024-09-13T17:53:23.015 INFO:teuthology.orchestra.run.smithi114.stdout: mds debug scatterstat = True 2024-09-13T17:53:23.015 INFO:teuthology.orchestra.run.smithi114.stdout: mds op complaint time = 180 2024-09-13T17:53:23.015 INFO:teuthology.orchestra.run.smithi114.stdout: mds verify scatter = False 2024-09-13T17:53:23.015 INFO:teuthology.orchestra.run.smithi114.stdout: osd op complaint time = 180 2024-09-13T17:53:23.015 INFO:teuthology.orchestra.run.smithi114.stdout: rados mon op timeout = 900 2024-09-13T17:53:23.015 INFO:teuthology.orchestra.run.smithi114.stdout: rados osd op timeout = 900 2024-09-13T17:53:23.016 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2024-09-13T17:53:23.016 INFO:teuthology.orchestra.run.smithi134.stdout: chdir = "" 2024-09-13T17:53:23.016 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T17:53:23.016 INFO:teuthology.orchestra.run.smithi134.stdout: auth supported = cephx 2024-09-13T17:53:23.016 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.016 INFO:teuthology.orchestra.run.smithi134.stdout: filestore xattr use omap = true 2024-09-13T17:53:23.016 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.016 INFO:teuthology.orchestra.run.smithi134.stdout: mon clock drift allowed = 1.000 2024-09-13T17:53:23.016 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: osd crush chooseleaf type = 0 2024-09-13T17:53:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: auth debug = true 2024-09-13T17:53:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on old message = true 2024-09-13T17:53:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on bug = true 2024-09-13T17:53:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T17:53:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: mon pg warn max object skew = 0 2024-09-13T17:53:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T17:53:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T17:53:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default size = 2 2024-09-13T17:53:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow primary affinity = true 2024-09-13T17:53:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow pg remap = true 2024-09-13T17:53:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on legacy crush tunables = false 2024-09-13T17:53:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on crush straw calc version zero = false 2024-09-13T17:53:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on no sortbitwise = false 2024-09-13T17:53:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on osd down out interval zero = false 2024-09-13T17:53:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on too few osds = false 2024-09-13T17:53:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T17:53:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T17:53:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: mon_allow_pool_size_one = true 2024-09-13T17:53:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T17:53:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: osd default data pool replay window = 5 2024-09-13T17:53:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: mon allow pool delete = true 2024-09-13T17:53:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: mon cluster log file level = debug 2024-09-13T17:53:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: debug asserts on shutdown = true 2024-09-13T17:53:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: mon health detail to clog = false 2024-09-13T17:53:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: mon host = "172.21.15.114,172.21.15.134,[v2:172.21.15.134:3301,v1:172.21.15.134:6790]" 2024-09-13T17:53:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on skipped message = False 2024-09-13T17:53:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = d730423f-882d-4061-b746-f6a7dc2544e0 2024-09-13T17:53:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.019 INFO:teuthology.orchestra.run.smithi134.stdout:[osd] 2024-09-13T17:53:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: osd journal size = 100 2024-09-13T17:53:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub load threshold = 5.0 2024-09-13T17:53:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub max interval = 600 2024-09-13T17:53:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: osd mclock profile = high_recovery_ops 2024-09-13T17:53:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: osd recover clone overlap = true 2024-09-13T17:53:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: osd recovery max chunk = 1048576 2024-09-13T17:53:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug shutdown = true 2024-09-13T17:53:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug op order = true 2024-09-13T17:53:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify stray on activate = true 2024-09-13T17:53:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: osd open classes on start = true 2024-09-13T17:53:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug pg log writeout = true 2024-09-13T17:53:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: osd deep scrub update digest min age = 30 2024-09-13T17:53:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: osd map max advance = 10 2024-09-13T17:53:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: journal zero on create = true 2024-09-13T17:53:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: filestore ondisk finisher threads = 3 2024-09-13T17:53:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: filestore apply finisher threads = 3 2024-09-13T17:53:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: bdev debug aio = true 2024-09-13T17:53:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug misdirected ops = true 2024-09-13T17:53:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore block size = 96636764160 2024-09-13T17:53:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore fsck on mount = True 2024-09-13T17:53:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluefs = 20 2024-09-13T17:53:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluestore = 20 2024-09-13T17:53:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-13T17:53:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: debug osd = 20 2024-09-13T17:53:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: debug rocksdb = 10 2024-09-13T17:53:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T17:53:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd full ratio = 0.9 2024-09-13T17:53:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd nearfull ratio = 0.8 2024-09-13T17:53:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: osd failsafe full ratio = 0.95 2024-09-13T17:53:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: osd objectstore = bluestore 2024-09-13T17:53:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: osd op complaint time = 180 2024-09-13T17:53:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.022 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr] 2024-09-13T17:53:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-13T17:53:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgr = 20 2024-09-13T17:53:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-09-13T17:53:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-09-13T17:53:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:53:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:53:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: mgr/telemetry/nag = false 2024-09-13T17:53:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: debug client = 20 2024-09-13T17:53:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.023 INFO:teuthology.orchestra.run.smithi134.stdout:[mon] 2024-09-13T17:53:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-13T17:53:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-09-13T17:53:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: debug paxos = 20 2024-09-13T17:53:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-09-13T17:53:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: mon data avail warn = 5 2024-09-13T17:53:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: mon mgr mkfs grace = 240 2024-09-13T17:53:23.024 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:53:23.024 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd reporter subtree level = osd 2024-09-13T17:53:23.024 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd prime pg temp = true 2024-09-13T17:53:23.024 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:53:23.024 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.024 INFO:teuthology.orchestra.run.smithi134.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T17:53:23.024 INFO:teuthology.orchestra.run.smithi134.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T17:53:23.024 INFO:teuthology.orchestra.run.smithi134.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T17:53:23.024 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.024 INFO:teuthology.orchestra.run.smithi134.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T17:53:23.024 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T17:53:23.024 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T17:53:23.024 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.024 INFO:teuthology.orchestra.run.smithi134.stdout: # 1m isn't quite enough 2024-09-13T17:53:23.025 INFO:teuthology.orchestra.run.smithi134.stdout: mon_down_mkfs_grace = 2m 2024-09-13T17:53:23.025 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.025 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_filestore_osds = false 2024-09-13T17:53:23.025 INFO:teuthology.orchestra.run.smithi134.stdout: mon op complaint time = 120 2024-09-13T17:53:23.025 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on pool no app = False 2024-09-13T17:53:23.025 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.025 INFO:teuthology.orchestra.run.smithi134.stdout:[client] 2024-09-13T17:53:23.025 INFO:teuthology.orchestra.run.smithi134.stdout: rgw cache enabled = true 2024-09-13T17:53:23.025 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable ops log = true 2024-09-13T17:53:23.025 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable usage log = true 2024-09-13T17:53:23.025 INFO:teuthology.orchestra.run.smithi134.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T17:53:23.025 INFO:teuthology.orchestra.run.smithi134.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T17:53:23.025 INFO:teuthology.orchestra.run.smithi134.stdout: client mount timeout = 600 2024-09-13T17:53:23.026 INFO:teuthology.orchestra.run.smithi134.stdout: debug client = 20 2024-09-13T17:53:23.026 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-13T17:53:23.026 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = "" 2024-09-13T17:53:23.026 INFO:teuthology.orchestra.run.smithi134.stdout: rados mon op timeout = 900 2024-09-13T17:53:23.026 INFO:teuthology.orchestra.run.smithi134.stdout: rados osd op timeout = 900 2024-09-13T17:53:23.026 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.a] 2024-09-13T17:53:23.026 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.b] 2024-09-13T17:53:23.026 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.c] 2024-09-13T17:53:23.026 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2024-09-13T17:53:23.026 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.c] 2024-09-13T17:53:23.026 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.b] 2024-09-13T17:53:23.026 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.d] 2024-09-13T17:53:23.026 INFO:teuthology.orchestra.run.smithi134.stdout:[mds] 2024-09-13T17:53:23.026 INFO:teuthology.orchestra.run.smithi134.stdout: debug mds = 20 2024-09-13T17:53:23.027 INFO:teuthology.orchestra.run.smithi134.stdout: debug mds balancer = 20 2024-09-13T17:53:23.027 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-13T17:53:23.027 INFO:teuthology.orchestra.run.smithi134.stdout: mds debug frag = True 2024-09-13T17:53:23.027 INFO:teuthology.orchestra.run.smithi134.stdout: mds debug scatterstat = True 2024-09-13T17:53:23.027 INFO:teuthology.orchestra.run.smithi134.stdout: mds op complaint time = 180 2024-09-13T17:53:23.027 INFO:teuthology.orchestra.run.smithi134.stdout: mds verify scatter = False 2024-09-13T17:53:23.027 INFO:teuthology.orchestra.run.smithi134.stdout: osd op complaint time = 180 2024-09-13T17:53:23.027 INFO:teuthology.orchestra.run.smithi134.stdout: rados mon op timeout = 900 2024-09-13T17:53:23.027 INFO:teuthology.orchestra.run.smithi134.stdout: rados osd op timeout = 900 2024-09-13T17:53:23.030 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T17:53:23.072 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T17:53:23.111 INFO:teuthology.orchestra.run.smithi114.stdout:[global] 2024-09-13T17:53:23.111 INFO:teuthology.orchestra.run.smithi114.stdout: chdir = "" 2024-09-13T17:53:23.111 INFO:teuthology.orchestra.run.smithi114.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T17:53:23.111 INFO:teuthology.orchestra.run.smithi114.stdout: auth supported = cephx 2024-09-13T17:53:23.112 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.112 INFO:teuthology.orchestra.run.smithi114.stdout: filestore xattr use omap = true 2024-09-13T17:53:23.112 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.112 INFO:teuthology.orchestra.run.smithi114.stdout: mon clock drift allowed = 1.000 2024-09-13T17:53:23.112 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.112 INFO:teuthology.orchestra.run.smithi114.stdout: osd crush chooseleaf type = 0 2024-09-13T17:53:23.112 INFO:teuthology.orchestra.run.smithi114.stdout: auth debug = true 2024-09-13T17:53:23.112 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.112 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on old message = true 2024-09-13T17:53:23.112 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on bug = true 2024-09-13T17:53:23.112 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.112 INFO:teuthology.orchestra.run.smithi114.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T17:53:23.112 INFO:teuthology.orchestra.run.smithi114.stdout: mon pg warn max object skew = 0 2024-09-13T17:53:23.113 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.113 INFO:teuthology.orchestra.run.smithi114.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T17:53:23.113 INFO:teuthology.orchestra.run.smithi114.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T17:53:23.113 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.113 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default size = 2 2024-09-13T17:53:23.113 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.113 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow primary affinity = true 2024-09-13T17:53:23.113 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow pg remap = true 2024-09-13T17:53:23.113 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on legacy crush tunables = false 2024-09-13T17:53:23.114 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on crush straw calc version zero = false 2024-09-13T17:53:23.114 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on no sortbitwise = false 2024-09-13T17:53:23.114 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on osd down out interval zero = false 2024-09-13T17:53:23.114 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on too few osds = false 2024-09-13T17:53:23.114 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T17:53:23.114 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T17:53:23.114 INFO:teuthology.orchestra.run.smithi114.stdout: mon_allow_pool_size_one = true 2024-09-13T17:53:23.114 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.114 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T17:53:23.114 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.114 INFO:teuthology.orchestra.run.smithi114.stdout: osd default data pool replay window = 5 2024-09-13T17:53:23.114 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.114 INFO:teuthology.orchestra.run.smithi114.stdout: mon allow pool delete = true 2024-09-13T17:53:23.114 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.115 INFO:teuthology.orchestra.run.smithi114.stdout: mon cluster log file level = debug 2024-09-13T17:53:23.115 INFO:teuthology.orchestra.run.smithi114.stdout: debug asserts on shutdown = true 2024-09-13T17:53:23.115 INFO:teuthology.orchestra.run.smithi114.stdout: mon health detail to clog = false 2024-09-13T17:53:23.115 INFO:teuthology.orchestra.run.smithi114.stdout: mon host = "172.21.15.114,172.21.15.134,[v2:172.21.15.134:3301,v1:172.21.15.134:6790]" 2024-09-13T17:53:23.115 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on skipped message = False 2024-09-13T17:53:23.115 INFO:teuthology.orchestra.run.smithi114.stdout: fsid = d730423f-882d-4061-b746-f6a7dc2544e0 2024-09-13T17:53:23.115 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.115 INFO:teuthology.orchestra.run.smithi114.stdout:[osd] 2024-09-13T17:53:23.115 INFO:teuthology.orchestra.run.smithi114.stdout: osd journal size = 100 2024-09-13T17:53:23.115 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.115 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub load threshold = 5.0 2024-09-13T17:53:23.115 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub max interval = 600 2024-09-13T17:53:23.115 INFO:teuthology.orchestra.run.smithi114.stdout: osd mclock profile = high_recovery_ops 2024-09-13T17:53:23.116 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.116 INFO:teuthology.orchestra.run.smithi114.stdout: osd recover clone overlap = true 2024-09-13T17:53:23.116 INFO:teuthology.orchestra.run.smithi114.stdout: osd recovery max chunk = 1048576 2024-09-13T17:53:23.116 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.116 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug shutdown = true 2024-09-13T17:53:23.116 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug op order = true 2024-09-13T17:53:23.116 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug verify stray on activate = true 2024-09-13T17:53:23.116 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.116 INFO:teuthology.orchestra.run.smithi114.stdout: osd open classes on start = true 2024-09-13T17:53:23.116 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug pg log writeout = true 2024-09-13T17:53:23.116 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.116 INFO:teuthology.orchestra.run.smithi114.stdout: osd deep scrub update digest min age = 30 2024-09-13T17:53:23.116 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.116 INFO:teuthology.orchestra.run.smithi114.stdout: osd map max advance = 10 2024-09-13T17:53:23.117 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.117 INFO:teuthology.orchestra.run.smithi114.stdout: journal zero on create = true 2024-09-13T17:53:23.117 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.117 INFO:teuthology.orchestra.run.smithi114.stdout: filestore ondisk finisher threads = 3 2024-09-13T17:53:23.117 INFO:teuthology.orchestra.run.smithi114.stdout: filestore apply finisher threads = 3 2024-09-13T17:53:23.117 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.117 INFO:teuthology.orchestra.run.smithi114.stdout: bdev debug aio = true 2024-09-13T17:53:23.117 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug misdirected ops = true 2024-09-13T17:53:23.117 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore block size = 96636764160 2024-09-13T17:53:23.117 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore fsck on mount = True 2024-09-13T17:53:23.117 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluefs = 20 2024-09-13T17:53:23.117 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluestore = 20 2024-09-13T17:53:23.117 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-09-13T17:53:23.117 INFO:teuthology.orchestra.run.smithi114.stdout: debug osd = 20 2024-09-13T17:53:23.118 INFO:teuthology.orchestra.run.smithi114.stdout: debug rocksdb = 10 2024-09-13T17:53:23.118 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T17:53:23.118 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd full ratio = 0.9 2024-09-13T17:53:23.118 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd nearfull ratio = 0.8 2024-09-13T17:53:23.118 INFO:teuthology.orchestra.run.smithi114.stdout: osd failsafe full ratio = 0.95 2024-09-13T17:53:23.118 INFO:teuthology.orchestra.run.smithi114.stdout: osd objectstore = bluestore 2024-09-13T17:53:23.118 INFO:teuthology.orchestra.run.smithi114.stdout: osd op complaint time = 180 2024-09-13T17:53:23.118 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.118 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr] 2024-09-13T17:53:23.118 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-09-13T17:53:23.118 INFO:teuthology.orchestra.run.smithi114.stdout: debug mgr = 20 2024-09-13T17:53:23.118 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2024-09-13T17:53:23.119 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2024-09-13T17:53:23.119 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:53:23.119 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:53:23.119 INFO:teuthology.orchestra.run.smithi114.stdout: mgr/telemetry/nag = false 2024-09-13T17:53:23.119 INFO:teuthology.orchestra.run.smithi114.stdout: debug client = 20 2024-09-13T17:53:23.119 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.119 INFO:teuthology.orchestra.run.smithi114.stdout:[mon] 2024-09-13T17:53:23.119 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-09-13T17:53:23.119 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2024-09-13T17:53:23.119 INFO:teuthology.orchestra.run.smithi114.stdout: debug paxos = 20 2024-09-13T17:53:23.119 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2024-09-13T17:53:23.119 INFO:teuthology.orchestra.run.smithi114.stdout: mon data avail warn = 5 2024-09-13T17:53:23.119 INFO:teuthology.orchestra.run.smithi114.stdout: mon mgr mkfs grace = 240 2024-09-13T17:53:23.120 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:53:23.120 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd reporter subtree level = osd 2024-09-13T17:53:23.120 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd prime pg temp = true 2024-09-13T17:53:23.120 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:53:23.120 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.120 INFO:teuthology.orchestra.run.smithi114.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T17:53:23.120 INFO:teuthology.orchestra.run.smithi114.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T17:53:23.120 INFO:teuthology.orchestra.run.smithi114.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T17:53:23.120 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.120 INFO:teuthology.orchestra.run.smithi114.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T17:53:23.120 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T17:53:23.120 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T17:53:23.120 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.120 INFO:teuthology.orchestra.run.smithi114.stdout: # 1m isn't quite enough 2024-09-13T17:53:23.121 INFO:teuthology.orchestra.run.smithi114.stdout: mon_down_mkfs_grace = 2m 2024-09-13T17:53:23.121 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.121 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_filestore_osds = false 2024-09-13T17:53:23.121 INFO:teuthology.orchestra.run.smithi114.stdout: mon op complaint time = 120 2024-09-13T17:53:23.121 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on pool no app = False 2024-09-13T17:53:23.121 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:23.121 INFO:teuthology.orchestra.run.smithi114.stdout:[client] 2024-09-13T17:53:23.121 INFO:teuthology.orchestra.run.smithi114.stdout: rgw cache enabled = true 2024-09-13T17:53:23.121 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable ops log = true 2024-09-13T17:53:23.121 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable usage log = true 2024-09-13T17:53:23.121 INFO:teuthology.orchestra.run.smithi114.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T17:53:23.121 INFO:teuthology.orchestra.run.smithi114.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T17:53:23.121 INFO:teuthology.orchestra.run.smithi114.stdout: client mount timeout = 600 2024-09-13T17:53:23.122 INFO:teuthology.orchestra.run.smithi114.stdout: debug client = 20 2024-09-13T17:53:23.122 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-09-13T17:53:23.122 INFO:teuthology.orchestra.run.smithi114.stdout: pid file = "" 2024-09-13T17:53:23.122 INFO:teuthology.orchestra.run.smithi114.stdout: rados mon op timeout = 900 2024-09-13T17:53:23.122 INFO:teuthology.orchestra.run.smithi114.stdout: rados osd op timeout = 900 2024-09-13T17:53:23.122 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.a] 2024-09-13T17:53:23.122 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.b] 2024-09-13T17:53:23.122 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.c] 2024-09-13T17:53:23.122 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.a] 2024-09-13T17:53:23.122 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.c] 2024-09-13T17:53:23.122 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.b] 2024-09-13T17:53:23.122 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.d] 2024-09-13T17:53:23.122 INFO:teuthology.orchestra.run.smithi114.stdout:[mds] 2024-09-13T17:53:23.123 INFO:teuthology.orchestra.run.smithi114.stdout: debug mds = 20 2024-09-13T17:53:23.123 INFO:teuthology.orchestra.run.smithi114.stdout: debug mds balancer = 20 2024-09-13T17:53:23.123 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-09-13T17:53:23.123 INFO:teuthology.orchestra.run.smithi114.stdout: mds debug frag = True 2024-09-13T17:53:23.123 INFO:teuthology.orchestra.run.smithi114.stdout: mds debug scatterstat = False 2024-09-13T17:53:23.123 INFO:teuthology.orchestra.run.smithi114.stdout: mds op complaint time = 180 2024-09-13T17:53:23.123 INFO:teuthology.orchestra.run.smithi114.stdout: mds verify scatter = False 2024-09-13T17:53:23.124 INFO:teuthology.orchestra.run.smithi114.stdout: osd op complaint time = 180 2024-09-13T17:53:23.124 INFO:teuthology.orchestra.run.smithi114.stdout: rados mon op timeout = 900 2024-09-13T17:53:23.124 INFO:teuthology.orchestra.run.smithi114.stdout: rados osd op timeout = 900 2024-09-13T17:53:23.124 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2024-09-13T17:53:23.124 INFO:teuthology.orchestra.run.smithi134.stdout: chdir = "" 2024-09-13T17:53:23.125 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T17:53:23.125 INFO:teuthology.orchestra.run.smithi134.stdout: auth supported = cephx 2024-09-13T17:53:23.125 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.125 INFO:teuthology.orchestra.run.smithi134.stdout: filestore xattr use omap = true 2024-09-13T17:53:23.125 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.125 INFO:teuthology.orchestra.run.smithi134.stdout: mon clock drift allowed = 1.000 2024-09-13T17:53:23.125 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.125 INFO:teuthology.orchestra.run.smithi134.stdout: osd crush chooseleaf type = 0 2024-09-13T17:53:23.125 INFO:teuthology.orchestra.run.smithi134.stdout: auth debug = true 2024-09-13T17:53:23.125 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.125 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on old message = true 2024-09-13T17:53:23.125 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on bug = true 2024-09-13T17:53:23.125 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.126 INFO:teuthology.orchestra.run.smithi134.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T17:53:23.126 INFO:teuthology.orchestra.run.smithi134.stdout: mon pg warn max object skew = 0 2024-09-13T17:53:23.126 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.126 INFO:teuthology.orchestra.run.smithi134.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T17:53:23.126 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T17:53:23.126 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.126 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default size = 2 2024-09-13T17:53:23.126 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.126 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow primary affinity = true 2024-09-13T17:53:23.126 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow pg remap = true 2024-09-13T17:53:23.126 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on legacy crush tunables = false 2024-09-13T17:53:23.126 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on crush straw calc version zero = false 2024-09-13T17:53:23.126 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on no sortbitwise = false 2024-09-13T17:53:23.126 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on osd down out interval zero = false 2024-09-13T17:53:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on too few osds = false 2024-09-13T17:53:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T17:53:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T17:53:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: mon_allow_pool_size_one = true 2024-09-13T17:53:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T17:53:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: osd default data pool replay window = 5 2024-09-13T17:53:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: mon allow pool delete = true 2024-09-13T17:53:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: mon cluster log file level = debug 2024-09-13T17:53:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: debug asserts on shutdown = true 2024-09-13T17:53:23.128 INFO:teuthology.orchestra.run.smithi134.stdout: mon health detail to clog = false 2024-09-13T17:53:23.128 INFO:teuthology.orchestra.run.smithi134.stdout: mon host = "172.21.15.114,172.21.15.134,[v2:172.21.15.134:3301,v1:172.21.15.134:6790]" 2024-09-13T17:53:23.128 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on skipped message = False 2024-09-13T17:53:23.128 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = d730423f-882d-4061-b746-f6a7dc2544e0 2024-09-13T17:53:23.128 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.128 INFO:teuthology.orchestra.run.smithi134.stdout:[osd] 2024-09-13T17:53:23.128 INFO:teuthology.orchestra.run.smithi134.stdout: osd journal size = 100 2024-09-13T17:53:23.128 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.128 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub load threshold = 5.0 2024-09-13T17:53:23.128 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub max interval = 600 2024-09-13T17:53:23.128 INFO:teuthology.orchestra.run.smithi134.stdout: osd mclock profile = high_recovery_ops 2024-09-13T17:53:23.128 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.128 INFO:teuthology.orchestra.run.smithi134.stdout: osd recover clone overlap = true 2024-09-13T17:53:23.128 INFO:teuthology.orchestra.run.smithi134.stdout: osd recovery max chunk = 1048576 2024-09-13T17:53:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug shutdown = true 2024-09-13T17:53:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug op order = true 2024-09-13T17:53:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify stray on activate = true 2024-09-13T17:53:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: osd open classes on start = true 2024-09-13T17:53:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug pg log writeout = true 2024-09-13T17:53:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: osd deep scrub update digest min age = 30 2024-09-13T17:53:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: osd map max advance = 10 2024-09-13T17:53:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: journal zero on create = true 2024-09-13T17:53:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: filestore ondisk finisher threads = 3 2024-09-13T17:53:23.130 INFO:teuthology.orchestra.run.smithi134.stdout: filestore apply finisher threads = 3 2024-09-13T17:53:23.130 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.130 INFO:teuthology.orchestra.run.smithi134.stdout: bdev debug aio = true 2024-09-13T17:53:23.130 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug misdirected ops = true 2024-09-13T17:53:23.130 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore block size = 96636764160 2024-09-13T17:53:23.130 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore fsck on mount = True 2024-09-13T17:53:23.130 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluefs = 20 2024-09-13T17:53:23.130 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluestore = 20 2024-09-13T17:53:23.130 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-13T17:53:23.130 INFO:teuthology.orchestra.run.smithi134.stdout: debug osd = 20 2024-09-13T17:53:23.130 INFO:teuthology.orchestra.run.smithi134.stdout: debug rocksdb = 10 2024-09-13T17:53:23.130 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T17:53:23.130 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd full ratio = 0.9 2024-09-13T17:53:23.130 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd nearfull ratio = 0.8 2024-09-13T17:53:23.130 INFO:teuthology.orchestra.run.smithi134.stdout: osd failsafe full ratio = 0.95 2024-09-13T17:53:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: osd objectstore = bluestore 2024-09-13T17:53:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: osd op complaint time = 180 2024-09-13T17:53:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.131 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr] 2024-09-13T17:53:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-13T17:53:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgr = 20 2024-09-13T17:53:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-09-13T17:53:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-09-13T17:53:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:53:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:53:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: mgr/telemetry/nag = false 2024-09-13T17:53:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: debug client = 20 2024-09-13T17:53:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.131 INFO:teuthology.orchestra.run.smithi134.stdout:[mon] 2024-09-13T17:53:23.132 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-13T17:53:23.132 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-09-13T17:53:23.132 INFO:teuthology.orchestra.run.smithi134.stdout: debug paxos = 20 2024-09-13T17:53:23.132 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-09-13T17:53:23.132 INFO:teuthology.orchestra.run.smithi134.stdout: mon data avail warn = 5 2024-09-13T17:53:23.132 INFO:teuthology.orchestra.run.smithi134.stdout: mon mgr mkfs grace = 240 2024-09-13T17:53:23.132 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-09-13T17:53:23.132 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd reporter subtree level = osd 2024-09-13T17:53:23.132 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd prime pg temp = true 2024-09-13T17:53:23.132 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-09-13T17:53:23.133 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.133 INFO:teuthology.orchestra.run.smithi134.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T17:53:23.133 INFO:teuthology.orchestra.run.smithi134.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T17:53:23.133 INFO:teuthology.orchestra.run.smithi134.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T17:53:23.133 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.133 INFO:teuthology.orchestra.run.smithi134.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T17:53:23.133 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T17:53:23.133 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T17:53:23.133 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.133 INFO:teuthology.orchestra.run.smithi134.stdout: # 1m isn't quite enough 2024-09-13T17:53:23.133 INFO:teuthology.orchestra.run.smithi134.stdout: mon_down_mkfs_grace = 2m 2024-09-13T17:53:23.134 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.134 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_filestore_osds = false 2024-09-13T17:53:23.134 INFO:teuthology.orchestra.run.smithi134.stdout: mon op complaint time = 120 2024-09-13T17:53:23.134 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on pool no app = False 2024-09-13T17:53:23.134 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-13T17:53:23.134 INFO:teuthology.orchestra.run.smithi134.stdout:[client] 2024-09-13T17:53:23.135 INFO:teuthology.orchestra.run.smithi134.stdout: rgw cache enabled = true 2024-09-13T17:53:23.135 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable ops log = true 2024-09-13T17:53:23.135 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable usage log = true 2024-09-13T17:53:23.135 INFO:teuthology.orchestra.run.smithi134.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T17:53:23.135 INFO:teuthology.orchestra.run.smithi134.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T17:53:23.135 INFO:teuthology.orchestra.run.smithi134.stdout: client mount timeout = 600 2024-09-13T17:53:23.135 INFO:teuthology.orchestra.run.smithi134.stdout: debug client = 20 2024-09-13T17:53:23.135 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-13T17:53:23.135 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = "" 2024-09-13T17:53:23.136 INFO:teuthology.orchestra.run.smithi134.stdout: rados mon op timeout = 900 2024-09-13T17:53:23.136 INFO:teuthology.orchestra.run.smithi134.stdout: rados osd op timeout = 900 2024-09-13T17:53:23.136 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.a] 2024-09-13T17:53:23.136 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.b] 2024-09-13T17:53:23.136 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.c] 2024-09-13T17:53:23.136 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2024-09-13T17:53:23.136 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.c] 2024-09-13T17:53:23.136 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.b] 2024-09-13T17:53:23.136 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.d] 2024-09-13T17:53:23.136 INFO:teuthology.orchestra.run.smithi134.stdout:[mds] 2024-09-13T17:53:23.136 INFO:teuthology.orchestra.run.smithi134.stdout: debug mds = 20 2024-09-13T17:53:23.136 INFO:teuthology.orchestra.run.smithi134.stdout: debug mds balancer = 20 2024-09-13T17:53:23.136 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-13T17:53:23.136 INFO:teuthology.orchestra.run.smithi134.stdout: mds debug frag = True 2024-09-13T17:53:23.137 INFO:teuthology.orchestra.run.smithi134.stdout: mds debug scatterstat = False 2024-09-13T17:53:23.137 INFO:teuthology.orchestra.run.smithi134.stdout: mds op complaint time = 180 2024-09-13T17:53:23.137 INFO:teuthology.orchestra.run.smithi134.stdout: mds verify scatter = False 2024-09-13T17:53:23.137 INFO:teuthology.orchestra.run.smithi134.stdout: osd op complaint time = 180 2024-09-13T17:53:23.137 INFO:teuthology.orchestra.run.smithi134.stdout: rados mon op timeout = 900 2024-09-13T17:53:23.137 INFO:teuthology.orchestra.run.smithi134.stdout: rados osd op timeout = 900 2024-09-13T17:53:23.139 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T17:53:23.139 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T17:53:23.139 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T17:53:23.139 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:53:23.140 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T17:53:23.140 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T17:53:23.140 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T17:53:23.140 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:53:23.140 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T17:53:23.141 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T17:53:23.141 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T17:53:23.141 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:53:23.141 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T17:53:23.141 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T17:53:23.141 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T17:53:23.141 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:53:23.195 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T17:53:23.195 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T17:53:23.197 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T17:53:23.197 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T17:53:23.198 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T17:53:23.198 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T17:53:23.240 INFO:tasks.ceph.mds.d:Started 2024-09-13T17:53:23.240 DEBUG:teuthology.parallel:result is None 2024-09-13T17:53:23.248 INFO:tasks.ceph.mds.c:Started 2024-09-13T17:53:23.248 DEBUG:teuthology.parallel:result is None 2024-09-13T17:53:23.249 INFO:tasks.ceph.mds.a:Started 2024-09-13T17:53:23.249 DEBUG:teuthology.parallel:result is None 2024-09-13T17:53:23.322 INFO:tasks.ceph.mds.d.smithi134.stdout:starting mds.d at 2024-09-13T17:53:23.334 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2024-09-13T17:53:23.334 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-09-13T17:53:23.396 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-13T17:53:29.194 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T17:53:29.195 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T17:53:29.199 INFO:tasks.ceph.mds.b:Started 2024-09-13T17:53:29.199 DEBUG:teuthology.parallel:result is None 2024-09-13T17:53:29.199 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph purge cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T17:53:29.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.242+0000 7f17205be080 1 Processor -- start 2024-09-13T17:53:29.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.242+0000 7f17205be080 1 -- start start 2024-09-13T17:53:29.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f17205be080 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56060c1dc410 0x56060c27bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:29.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f17205be080 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56060c29b340 0x56060c227800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:29.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f17205be080 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56060c29b720 0x56060c29d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:29.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f17205be080 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x56060c18a1e0 con 0x56060c29b340 2024-09-13T17:53:29.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f17205be080 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x56060c125960 con 0x56060c1dc410 2024-09-13T17:53:29.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f17205be080 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x56060c125600 con 0x56060c29b720 2024-09-13T17:53:29.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f171ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56060c29b340 0x56060c227800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:29.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f171d800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56060c1dc410 0x56060c27bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:29.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f171ce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56060c29b340 0x56060c227800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36622/0 (socket says 172.21.15.114:36622) 2024-09-13T17:53:29.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f171ce00640 1 -- 172.21.15.114:0/1271751145 learned_addr learned my addr 172.21.15.114:0/1271751145 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:29.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f171e200640 1 --2- 172.21.15.114:0/1271751145 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56060c29b720 0x56060c29d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:29.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f171d800640 1 -- 172.21.15.114:0/1271751145 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56060c29b720 msgr2=0x56060c29d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:29.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f171d800640 1 --2- 172.21.15.114:0/1271751145 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56060c29b720 0x56060c29d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f171d800640 1 -- 172.21.15.114:0/1271751145 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56060c29b340 msgr2=0x56060c227800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:29.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f171d800640 1 --2- 172.21.15.114:0/1271751145 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56060c29b340 0x56060c227800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f171d800640 1 -- 172.21.15.114:0/1271751145 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1710005d30 con 0x56060c1dc410 2024-09-13T17:53:29.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f171d800640 1 --2- 172.21.15.114:0/1271751145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56060c1dc410 0x56060c27bda0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1710009920 tx=0x7f1710005a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e005a577a551b2f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:29.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f1717400640 1 -- 172.21.15.114:0/1271751145 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171000f040 con 0x56060c1dc410 2024-09-13T17:53:29.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f1717400640 1 -- 172.21.15.114:0/1271751145 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1710008da0 con 0x56060c1dc410 2024-09-13T17:53:29.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f1717400640 1 -- 172.21.15.114:0/1271751145 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1710013620 con 0x56060c1dc410 2024-09-13T17:53:29.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f17205be080 1 -- 172.21.15.114:0/1271751145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56060c1dc410 msgr2=0x56060c27bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:29.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f17205be080 1 --2- 172.21.15.114:0/1271751145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56060c1dc410 0x56060c27bda0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1710009920 tx=0x7f1710005a10 comp rx=0 tx=0).stop 2024-09-13T17:53:29.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f17205be080 1 -- 172.21.15.114:0/1271751145 shutdown_connections 2024-09-13T17:53:29.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f17205be080 1 --2- 172.21.15.114:0/1271751145 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56060c29b720 0x56060c29d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f17205be080 1 --2- 172.21.15.114:0/1271751145 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56060c29b340 0x56060c227800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f17205be080 1 --2- 172.21.15.114:0/1271751145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56060c1dc410 0x56060c27bda0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f17205be080 1 -- 172.21.15.114:0/1271751145 >> 172.21.15.114:0/1271751145 conn(0x56060c1dd520 msgr2=0x56060c27b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:29.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f17205be080 1 -- 172.21.15.114:0/1271751145 shutdown_connections 2024-09-13T17:53:29.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f17205be080 1 -- 172.21.15.114:0/1271751145 wait complete. 2024-09-13T17:53:29.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.246+0000 7f17205be080 1 Processor -- start 2024-09-13T17:53:29.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.250+0000 7f17205be080 1 -- start start 2024-09-13T17:53:29.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.250+0000 7f17205be080 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56060c1dc410 0x56060c29a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:29.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.250+0000 7f17205be080 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56060c29b340 0x56060c226a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:29.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.250+0000 7f17205be080 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56060c29b720 0x56060c2b5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:29.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.250+0000 7f17205be080 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x56060c11c690 con 0x56060c1dc410 2024-09-13T17:53:29.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.250+0000 7f17205be080 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x56060c27a4e0 con 0x56060c29b720 2024-09-13T17:53:29.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.250+0000 7f17205be080 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x56060c2b6320 con 0x56060c29b340 2024-09-13T17:53:29.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.250+0000 7f171d800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56060c1dc410 0x56060c29a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:29.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.250+0000 7f171d800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56060c1dc410 0x56060c29a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36624/0 (socket says 172.21.15.114:36624) 2024-09-13T17:53:29.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.250+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 learned_addr learned my addr 172.21.15.114:0/3152597014 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:29.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.250+0000 7f171ce00640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56060c29b340 0x56060c226a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:29.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.250+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56060c29b340 msgr2=0x56060c226a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:29.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.250+0000 7f171d800640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x56060c29b340 0x56060c226a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.250+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56060c29b720 msgr2=0x56060c2b5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:29.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.250+0000 7f171d800640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56060c29b720 0x56060c2b5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.250+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1710009520 con 0x56060c1dc410 2024-09-13T17:53:29.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.250+0000 7f171d800640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56060c1dc410 0x56060c29a380 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1710008780 tx=0x7f1710003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:29.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.250+0000 7f1716000640 1 -- 172.21.15.114:0/3152597014 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171000f040 con 0x56060c1dc410 2024-09-13T17:53:29.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.250+0000 7f1716000640 1 -- 172.21.15.114:0/3152597014 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17100056d0 con 0x56060c1dc410 2024-09-13T17:53:29.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.250+0000 7f1716000640 1 -- 172.21.15.114:0/3152597014 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171001d410 con 0x56060c1dc410 2024-09-13T17:53:29.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.250+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f171800a1c0 con 0x56060c1dc410 2024-09-13T17:53:29.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.250+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56060c1348c0 con 0x56060c1dc410 2024-09-13T17:53:29.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.254+0000 7f1716000640 1 -- 172.21.15.114:0/3152597014 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f171001d570 con 0x56060c1dc410 2024-09-13T17:53:29.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.254+0000 7f1716000640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1700065070 0x7f1700067530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:29.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.254+0000 7f1716000640 1 -- 172.21.15.114:0/3152597014 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f1710085270 con 0x56060c1dc410 2024-09-13T17:53:29.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.254+0000 7f171ce00640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1700065070 0x7f1700067530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:29.260 INFO:teuthology.orchestra.run.smithi114.stdout:Warning: using slow linear search 2024-09-13T17:53:29.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.254+0000 7f17205be080 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x56060c226f50 0x56060c35b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:29.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.254+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:1 5.0 5:00000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x56060c226f50 2024-09-13T17:53:29.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.254+0000 7f171e200640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x56060c226f50 0x56060c35b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:29.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.254+0000 7f171ce00640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1700065070 0x7f1700067530 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f170c011570 tx=0x7f170c001860 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:29.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.254+0000 7f171e200640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x56060c226f50 0x56060c35b140 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:29.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.254+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 <== osd.3 v2:172.21.15.114:6824/1824187331 1 ==== osd_op_reply(1 [pgnls start_epoch 43 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f17180a8070 con 0x56060c226f50 2024-09-13T17:53:29.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.254+0000 7f171e200640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x7f17180b7040 0x7f17180b5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:29.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.254+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:2 5.10 5:08000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x7f17180b7040 2024-09-13T17:53:29.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.254+0000 7f171d800640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x7f17180b7040 0x7f17180b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:29.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.258+0000 7f171d800640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x7f17180b7040 0x7f17180b5920 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:29.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.258+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 <== osd.7 v2:172.21.15.134:6816/874939117 1 ==== osd_op_reply(2 [pgnls start_epoch 43 out=177b] v39'10 uv10 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x7f1710083670 con 0x7f17180b7040 2024-09-13T17:53:29.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.258+0000 7f171d800640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x7f1710009040 0x7f1710056ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:29.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.258+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:3 5.8 5:10000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x7f1710009040 2024-09-13T17:53:29.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.258+0000 7f171ce00640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x7f1710009040 0x7f1710056ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:29.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.258+0000 7f171ce00640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x7f1710009040 0x7f1710056ba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:29.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.258+0000 7f171ce00640 1 -- 172.21.15.114:0/3152597014 <== osd.2 v2:172.21.15.114:6800/1009667871 1 ==== osd_op_reply(3 [pgnls start_epoch 43 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f170c017040 con 0x7f1710009040 2024-09-13T17:53:29.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.258+0000 7f171ce00640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x7f170c01f940 0x7f170c01e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:29.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.258+0000 7f171ce00640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:4 5.18 5:18000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x7f170c01f940 2024-09-13T17:53:29.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.258+0000 7f171e200640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x7f170c01f940 0x7f170c01e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:29.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.258+0000 7f171e200640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x7f170c01f940 0x7f170c01e3c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:29.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.258+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 <== osd.4 v2:172.21.15.134:6808/3210409298 1 ==== osd_op_reply(4 [pgnls start_epoch 43 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f17180c1040 con 0x7f170c01f940 2024-09-13T17:53:29.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.258+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:5 5.4 5:20000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x7f17180b7040 2024-09-13T17:53:29.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.258+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 <== osd.7 v2:172.21.15.134:6816/874939117 2 ==== osd_op_reply(5 [pgnls start_epoch 43 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1710083670 con 0x7f17180b7040 2024-09-13T17:53:29.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.258+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:6 5.14 5:28000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x56060c226f50 2024-09-13T17:53:29.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.258+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 <== osd.3 v2:172.21.15.114:6824/1824187331 2 ==== osd_op_reply(6 [pgnls start_epoch 43 out=149b] v39'18 uv18 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x7f17180c1040 con 0x56060c226f50 2024-09-13T17:53:29.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.262+0000 7f171e200640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x7f17180ab030 0x7f17180b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:29.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.262+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:7 5.c 5:30000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x7f17180ab030 2024-09-13T17:53:29.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.262+0000 7f171d800640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x7f17180ab030 0x7f17180b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:29.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.262+0000 7f171d800640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x7f17180ab030 0x7f17180b63b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:29.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.262+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 <== osd.1 v2:172.21.15.114:6816/2809354915 1 ==== osd_op_reply(7 [pgnls start_epoch 43 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1710083670 con 0x7f17180ab030 2024-09-13T17:53:29.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.262+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:8 5.1c 5:38000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x7f170c01f940 2024-09-13T17:53:29.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.262+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 <== osd.4 v2:172.21.15.134:6808/3210409298 2 ==== osd_op_reply(8 [pgnls start_epoch 43 out=73b] v38'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f17180c1040 con 0x7f170c01f940 2024-09-13T17:53:29.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.262+0000 7f171e200640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x7f17180ab7e0 0x7f17180c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:29.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.262+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:9 5.2 5:40000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x7f17180ab7e0 2024-09-13T17:53:29.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.262+0000 7f171ce00640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x7f17180ab7e0 0x7f17180c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:29.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.262+0000 7f171ce00640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x7f17180ab7e0 0x7f17180c6450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:29.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.262+0000 7f171ce00640 1 -- 172.21.15.114:0/3152597014 <== osd.6 v2:172.21.15.134:6824/1813072387 1 ==== osd_op_reply(9 [pgnls start_epoch 43 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f170c017040 con 0x7f17180ab7e0 2024-09-13T17:53:29.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.262+0000 7f171ce00640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:10 5.12 5:48000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x7f17180ab030 2024-09-13T17:53:29.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.262+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 <== osd.1 v2:172.21.15.114:6816/2809354915 2 ==== osd_op_reply(10 [pgnls start_epoch 43 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1710083670 con 0x7f17180ab030 2024-09-13T17:53:29.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.262+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:11 5.a 5:50000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x7f1710009040 2024-09-13T17:53:29.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.262+0000 7f171ce00640 1 -- 172.21.15.114:0/3152597014 <== osd.2 v2:172.21.15.114:6800/1009667871 2 ==== osd_op_reply(11 [pgnls start_epoch 43 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f170c017040 con 0x7f1710009040 2024-09-13T17:53:29.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.262+0000 7f171ce00640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:12 5.1a 5:58000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x7f17180b7040 2024-09-13T17:53:29.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.266+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 <== osd.7 v2:172.21.15.134:6816/874939117 3 ==== osd_op_reply(12 [pgnls start_epoch 43 out=49b] v38'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1710083670 con 0x7f17180b7040 2024-09-13T17:53:29.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.266+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:13 5.6 5:60000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x7f1710009040 2024-09-13T17:53:29.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.266+0000 7f171ce00640 1 -- 172.21.15.114:0/3152597014 <== osd.2 v2:172.21.15.114:6800/1009667871 3 ==== osd_op_reply(13 [pgnls start_epoch 43 out=77b] v39'3 uv3 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x7f170c017040 con 0x7f1710009040 2024-09-13T17:53:29.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.266+0000 7f171ce00640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x7f170c02f8f0 0x7f170c00f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:29.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.266+0000 7f171ce00640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:14 5.16 5:68000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x7f170c02f8f0 2024-09-13T17:53:29.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.266+0000 7f171e200640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x7f170c02f8f0 0x7f170c00f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:29.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.266+0000 7f171e200640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x7f170c02f8f0 0x7f170c00f3b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:29.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.266+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 <== osd.5 v2:172.21.15.134:6800/3340754489 1 ==== osd_op_reply(14 [pgnls start_epoch 43 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f17180c1040 con 0x7f170c02f8f0 2024-09-13T17:53:29.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.266+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:15 5.e 5:70000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x7f170c01f940 2024-09-13T17:53:29.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.266+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 <== osd.4 v2:172.21.15.134:6808/3210409298 3 ==== osd_op_reply(15 [pgnls start_epoch 43 out=73b] v38'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f17180c1040 con 0x7f170c01f940 2024-09-13T17:53:29.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.266+0000 7f171e200640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x7f17180d5040 0x7f17180aa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:29.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.266+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:16 5.1e 5:78000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x7f17180d5040 2024-09-13T17:53:29.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.266+0000 7f171d800640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x7f17180d5040 0x7f17180aa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:29.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.270+0000 7f171d800640 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x7f17180d5040 0x7f17180aa3b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:29.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.270+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 <== osd.0 v2:172.21.15.114:6808/4163905135 1 ==== osd_op_reply(16 [pgnls start_epoch 43 out=49b] v38'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1710083670 con 0x7f17180d5040 2024-09-13T17:53:29.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.270+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:17 5.1 5:80000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x7f170c01f940 2024-09-13T17:53:29.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.270+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 <== osd.4 v2:172.21.15.134:6808/3210409298 4 ==== osd_op_reply(17 [pgnls start_epoch 43 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f17180c1040 con 0x7f170c01f940 2024-09-13T17:53:29.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.270+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:18 5.11 5:88000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x7f17180ab7e0 2024-09-13T17:53:29.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.270+0000 7f171ce00640 1 -- 172.21.15.114:0/3152597014 <== osd.6 v2:172.21.15.134:6824/1813072387 2 ==== osd_op_reply(18 [pgnls start_epoch 43 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f170c017040 con 0x7f17180ab7e0 2024-09-13T17:53:29.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.270+0000 7f171ce00640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:19 5.9 5:90000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x7f17180b7040 2024-09-13T17:53:29.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.270+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 <== osd.7 v2:172.21.15.134:6816/874939117 4 ==== osd_op_reply(19 [pgnls start_epoch 43 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1710083670 con 0x7f17180b7040 2024-09-13T17:53:29.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.270+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:20 5.19 5:98000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x7f17180ab030 2024-09-13T17:53:29.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.270+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 <== osd.1 v2:172.21.15.114:6816/2809354915 3 ==== osd_op_reply(20 [pgnls start_epoch 43 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1710083670 con 0x7f17180ab030 2024-09-13T17:53:29.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.270+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:21 5.5 5:a0000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x7f17180d5040 2024-09-13T17:53:29.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.270+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 <== osd.0 v2:172.21.15.114:6808/4163905135 2 ==== osd_op_reply(21 [pgnls start_epoch 43 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1710083670 con 0x7f17180d5040 2024-09-13T17:53:29.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.270+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:22 5.15 5:a8000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x7f170c02f8f0 2024-09-13T17:53:29.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.270+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 <== osd.5 v2:172.21.15.134:6800/3340754489 2 ==== osd_op_reply(22 [pgnls start_epoch 43 out=97b] v38'3 uv3 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x7f17180c1040 con 0x7f170c02f8f0 2024-09-13T17:53:29.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.270+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:23 5.d 5:b0000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x7f1710009040 2024-09-13T17:53:29.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.270+0000 7f171ce00640 1 -- 172.21.15.114:0/3152597014 <== osd.2 v2:172.21.15.114:6800/1009667871 4 ==== osd_op_reply(23 [pgnls start_epoch 43 out=74b] v38'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f170c017040 con 0x7f1710009040 2024-09-13T17:53:29.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.270+0000 7f171ce00640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:24 5.1d 5:b8000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x7f17180ab030 2024-09-13T17:53:29.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.270+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 <== osd.1 v2:172.21.15.114:6816/2809354915 4 ==== osd_op_reply(24 [pgnls start_epoch 43 out=73b] v38'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f1710083670 con 0x7f17180ab030 2024-09-13T17:53:29.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.270+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:25 5.3 5:c0000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x7f17180d5040 2024-09-13T17:53:29.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 <== osd.0 v2:172.21.15.114:6808/4163905135 3 ==== osd_op_reply(25 [pgnls start_epoch 43 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1710083670 con 0x7f17180d5040 2024-09-13T17:53:29.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:26 5.13 5:c8000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x56060c226f50 2024-09-13T17:53:29.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 <== osd.3 v2:172.21.15.114:6824/1824187331 3 ==== osd_op_reply(26 [pgnls start_epoch 43 out=98b] v39'3 uv3 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x7f17180c1040 con 0x56060c226f50 2024-09-13T17:53:29.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:27 5.b 5:d0000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x7f1710009040 2024-09-13T17:53:29.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f171ce00640 1 -- 172.21.15.114:0/3152597014 <== osd.2 v2:172.21.15.114:6800/1009667871 5 ==== osd_op_reply(27 [pgnls start_epoch 43 out=76b] v39'3 uv3 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x7f170c017040 con 0x7f1710009040 2024-09-13T17:53:29.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f171ce00640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:28 5.1b 5:d8000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x7f170c02f8f0 2024-09-13T17:53:29.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 <== osd.5 v2:172.21.15.134:6800/3340754489 3 ==== osd_op_reply(28 [pgnls start_epoch 43 out=49b] v38'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f17180c1040 con 0x7f170c02f8f0 2024-09-13T17:53:29.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:29 5.7 5:e0000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x7f170c02f8f0 2024-09-13T17:53:29.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 <== osd.5 v2:172.21.15.134:6800/3340754489 4 ==== osd_op_reply(29 [pgnls start_epoch 43 out=73b] v38'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f17180c1040 con 0x7f170c02f8f0 2024-09-13T17:53:29.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:30 5.17 5:e8000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x56060c226f50 2024-09-13T17:53:29.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 <== osd.3 v2:172.21.15.114:6824/1824187331 4 ==== osd_op_reply(30 [pgnls start_epoch 43 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f17180c1040 con 0x56060c226f50 2024-09-13T17:53:29.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:31 5.f 5:f0000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x7f170c02f8f0 2024-09-13T17:53:29.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 <== osd.5 v2:172.21.15.134:6800/3340754489 5 ==== osd_op_reply(31 [pgnls start_epoch 43 out=73b] v38'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f17180c1040 con 0x7f170c02f8f0 2024-09-13T17:53:29.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:32 5.1f 5:f8000000:%01:::head [pgnls start_epoch 43 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e43) v8 -- 0x56060c27c0c0 con 0x7f17180ab7e0 2024-09-13T17:53:29.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f171ce00640 1 -- 172.21.15.114:0/3152597014 <== osd.6 v2:172.21.15.134:6824/1813072387 3 ==== osd_op_reply(32 [pgnls start_epoch 43 out=101b] v39'6 uv6 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x7f170c017040 con 0x7f17180ab7e0 2024-09-13T17:53:29.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:33 5.10 5:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e43) v8 -- 0x56060c296dc0 con 0x7f17180b7040 2024-09-13T17:53:29.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:34 5.10 5:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e43) v8 -- 0x56060c297970 con 0x7f17180b7040 2024-09-13T17:53:29.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:35 5.10 5:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e43) v8 -- 0x56060c35b680 con 0x7f17180b7040 2024-09-13T17:53:29.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:36 5.10 5:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e43) v8 -- 0x56060c35bf20 con 0x7f17180b7040 2024-09-13T17:53:29.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:37 5.10 5:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e43) v8 -- 0x56060c35c7c0 con 0x7f17180b7040 2024-09-13T17:53:29.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:38 5.14 5:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e43) v8 -- 0x56060c35d060 con 0x56060c226f50 2024-09-13T17:53:29.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:39 5.14 5:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e43) v8 -- 0x56060c35d900 con 0x56060c226f50 2024-09-13T17:53:29.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:40 5.14 5:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e43) v8 -- 0x56060c35e1a0 con 0x56060c226f50 2024-09-13T17:53:29.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:41 5.14 5:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e43) v8 -- 0x56060c35ea40 con 0x56060c226f50 2024-09-13T17:53:29.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:42 5.1c 5:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e43) v8 -- 0x56060c35f340 con 0x7f170c01f940 2024-09-13T17:53:29.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:43 5.6 5:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e43) v8 -- 0x56060c35ff10 con 0x7f1710009040 2024-09-13T17:53:29.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:44 5.e 5:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e43) v8 -- 0x56060c360a30 con 0x7f170c01f940 2024-09-13T17:53:29.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:45 5.15 5:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e43) v8 -- 0x56060c3615c0 con 0x7f170c02f8f0 2024-09-13T17:53:29.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:46 5.15 5:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e43) v8 -- 0x56060c362100 con 0x7f170c02f8f0 2024-09-13T17:53:29.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:47 5.d 5:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e43) v8 -- 0x56060c362c90 con 0x7f1710009040 2024-09-13T17:53:29.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.274+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:48 5.1d 5:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e43) v8 -- 0x56060c363780 con 0x7f17180ab030 2024-09-13T17:53:29.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.278+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 <== osd.5 v2:172.21.15.134:6800/3340754489 6 ==== osd_op_reply(45 604.00000000 [delete] v43'4 uv4 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f17180c1040 con 0x7f170c02f8f0 2024-09-13T17:53:29.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.278+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:49 5.13 5:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e43) v8 -- 0x56060c363bb0 con 0x56060c226f50 2024-09-13T17:53:29.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.278+0000 7f171ce00640 1 -- 172.21.15.114:0/3152597014 <== osd.2 v2:172.21.15.114:6800/1009667871 6 ==== osd_op_reply(43 mds0_openfiles.0 [delete] v43'4 uv4 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f170c03b040 con 0x7f1710009040 2024-09-13T17:53:29.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.278+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:50 5.13 5:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e43) v8 -- 0x56060c363bb0 con 0x56060c226f50 2024-09-13T17:53:29.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.278+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 <== osd.5 v2:172.21.15.134:6800/3340754489 7 ==== osd_op_reply(46 500.00000000 [delete] v43'5 uv5 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f17180c1040 con 0x7f170c02f8f0 2024-09-13T17:53:29.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.278+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:51 5.b 5:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e43) v8 -- 0x56060c363bb0 con 0x7f1710009040 2024-09-13T17:53:29.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.282+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 <== osd.4 v2:172.21.15.134:6808/3210409298 5 ==== osd_op_reply(44 608.00000000 [delete] v43'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f17180c1040 con 0x7f170c01f940 2024-09-13T17:53:29.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.282+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:52 5.7 5:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e43) v8 -- 0x56060c363f60 con 0x7f170c02f8f0 2024-09-13T17:53:29.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.282+0000 7f171ce00640 1 -- 172.21.15.114:0/3152597014 <== osd.2 v2:172.21.15.114:6800/1009667871 7 ==== osd_op_reply(47 mds_snaptable [delete] v43'2 uv2 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f170c03b040 con 0x7f1710009040 2024-09-13T17:53:29.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.282+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 <== osd.1 v2:172.21.15.114:6816/2809354915 5 ==== osd_op_reply(48 605.00000000 [delete] v43'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1710083670 con 0x7f17180ab030 2024-09-13T17:53:29.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.282+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 <== osd.7 v2:172.21.15.134:6816/874939117 5 ==== osd_op_reply(33 601.00000000 [delete] v43'11 uv11 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1710083670 con 0x7f17180b7040 2024-09-13T17:53:29.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.282+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 <== osd.3 v2:172.21.15.114:6824/1824187331 5 ==== osd_op_reply(38 1.00000000.inode [delete] v43'19 uv19 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f17180c1040 con 0x56060c226f50 2024-09-13T17:53:29.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.282+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:53 5.f 5:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e43) v8 -- 0x56060c2b5b40 con 0x7f170c02f8f0 2024-09-13T17:53:29.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.282+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 <== osd.3 v2:172.21.15.114:6824/1824187331 6 ==== osd_op_reply(39 200.00000000 [delete] v43'20 uv20 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f17180c1040 con 0x56060c226f50 2024-09-13T17:53:29.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.282+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:54 5.1f 5:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e43) v8 -- 0x56060c363190 con 0x7f17180ab7e0 2024-09-13T17:53:29.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.282+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:55 5.1f 5:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e43) v8 -- 0x56060c363f60 con 0x7f17180ab7e0 2024-09-13T17:53:29.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.282+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 <== osd.7 v2:172.21.15.134:6816/874939117 6 ==== osd_op_reply(34 602.00000000 [delete] v43'12 uv12 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1710083670 con 0x7f17180b7040 2024-09-13T17:53:29.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.282+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 <== osd.7 v2:172.21.15.134:6816/874939117 7 ==== osd_op_reply(35 10000000000.00000000 [delete] v43'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f1710083670 con 0x7f17180b7040 2024-09-13T17:53:29.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.282+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 <== osd.7 v2:172.21.15.134:6816/874939117 8 ==== osd_op_reply(36 600.00000000 [delete] v43'14 uv14 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1710083670 con 0x7f17180b7040 2024-09-13T17:53:29.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.282+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 <== osd.3 v2:172.21.15.114:6824/1824187331 7 ==== osd_op_reply(40 200.00000001 [delete] v43'21 uv21 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f17180c1040 con 0x56060c226f50 2024-09-13T17:53:29.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.282+0000 7f171d800640 1 -- 172.21.15.114:0/3152597014 <== osd.7 v2:172.21.15.134:6816/874939117 9 ==== osd_op_reply(37 603.00000000 [delete] v43'15 uv15 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1710083670 con 0x7f17180b7040 2024-09-13T17:53:29.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.282+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 <== osd.3 v2:172.21.15.114:6824/1824187331 8 ==== osd_op_reply(41 606.00000000 [delete] v43'22 uv22 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f17180c1040 con 0x56060c226f50 2024-09-13T17:53:29.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.282+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 <== osd.4 v2:172.21.15.134:6808/3210409298 6 ==== osd_op_reply(42 607.00000000 [delete] v43'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f17180c1040 con 0x7f170c01f940 2024-09-13T17:53:29.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.282+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 <== osd.3 v2:172.21.15.114:6824/1824187331 9 ==== osd_op_reply(49 mds0_inotable [delete] v43'4 uv4 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f17180c1040 con 0x56060c226f50 2024-09-13T17:53:29.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.282+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 <== osd.5 v2:172.21.15.134:6800/3340754489 8 ==== osd_op_reply(52 609.00000000 [delete] v43'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f17180c1040 con 0x7f170c02f8f0 2024-09-13T17:53:29.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.282+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 <== osd.3 v2:172.21.15.114:6824/1824187331 10 ==== osd_op_reply(50 100.00000000 [delete] v43'5 uv5 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f17180c1040 con 0x56060c226f50 2024-09-13T17:53:29.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.282+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 <== osd.5 v2:172.21.15.134:6800/3340754489 9 ==== osd_op_reply(53 400.00000000 [delete] v43'2 uv2 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f17180c1040 con 0x7f170c02f8f0 2024-09-13T17:53:29.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.282+0000 7f171ce00640 1 -- 172.21.15.114:0/3152597014 <== osd.6 v2:172.21.15.134:6824/1813072387 4 ==== osd_op_reply(54 100.00000000.inode [delete] v43'7 uv7 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f170c03b040 con 0x7f17180ab7e0 2024-09-13T17:53:29.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.282+0000 7f171ce00640 1 -- 172.21.15.114:0/3152597014 <== osd.6 v2:172.21.15.134:6824/1813072387 5 ==== osd_op_reply(55 1.00000000 [delete] v43'8 uv8 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f170c03b040 con 0x7f17180ab7e0 2024-09-13T17:53:29.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.286+0000 7f171ce00640 1 -- 172.21.15.114:0/3152597014 <== osd.2 v2:172.21.15.114:6800/1009667871 8 ==== osd_op_reply(51 mds0_sessionmap [delete] v43'4 uv4 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f170c03b040 con 0x7f1710009040 2024-09-13T17:53:29.291 INFO:teuthology.orchestra.run.smithi114.stdout:Removed 23 objects 2024-09-13T17:53:29.291 INFO:teuthology.orchestra.run.smithi114.stdout:successfully purged pool cephfs_metadata 2024-09-13T17:53:29.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.286+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x7f17180d5040 msgr2=0x7f17180aa3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:29.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.286+0000 7f17205be080 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x7f17180d5040 0x7f17180aa3b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.286+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x7f17180ab030 msgr2=0x7f17180b63b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:29.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.286+0000 7f17205be080 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x7f17180ab030 0x7f17180b63b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.286+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x7f1710009040 msgr2=0x7f1710056ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:29.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.286+0000 7f17205be080 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x7f1710009040 0x7f1710056ba0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.286+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x56060c226f50 msgr2=0x56060c35b140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:29.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.286+0000 7f17205be080 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x56060c226f50 0x56060c35b140 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.286+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x7f170c01f940 msgr2=0x7f170c01e3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:29.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.286+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 reap_dead start 2024-09-13T17:53:29.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.286+0000 7f17205be080 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x7f170c01f940 0x7f170c01e3c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.286+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 reap_dead start 2024-09-13T17:53:29.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.286+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x7f170c02f8f0 msgr2=0x7f170c00f3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:29.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.286+0000 7f17205be080 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x7f170c02f8f0 0x7f170c00f3b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.286+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x7f17180ab7e0 msgr2=0x7f17180c6450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:29.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.286+0000 7f17205be080 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x7f17180ab7e0 0x7f17180c6450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.286+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x7f17180b7040 msgr2=0x7f17180b5920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:29.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.286+0000 7f17205be080 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x7f17180b7040 0x7f17180b5920 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.286+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1700065070 msgr2=0x7f1700067530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:29.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.286+0000 7f17205be080 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1700065070 0x7f1700067530 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f170c011570 tx=0x7f170c001860 comp rx=0 tx=0).stop 2024-09-13T17:53:29.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.286+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56060c1dc410 msgr2=0x56060c29a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:29.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.286+0000 7f17205be080 1 --2- 172.21.15.114:0/3152597014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56060c1dc410 0x56060c29a380 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1710008780 tx=0x7f1710003030 comp rx=0 tx=0).stop 2024-09-13T17:53:29.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.286+0000 7f171e200640 1 -- 172.21.15.114:0/3152597014 reap_dead start 2024-09-13T17:53:29.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.286+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 shutdown_connections 2024-09-13T17:53:29.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.286+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 >> 172.21.15.114:0/3152597014 conn(0x56060c1dd520 msgr2=0x56060c227800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:29.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.286+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 shutdown_connections 2024-09-13T17:53:29.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.286+0000 7f17205be080 1 -- 172.21.15.114:0/3152597014 wait complete. 2024-09-13T17:53:29.294 INFO:tasks.ceph.mds.b.smithi134.stdout:starting mds.b at 2024-09-13T17:53:29.297 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:53:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.474+0000 7fddac000640 1 Processor -- start 2024-09-13T17:53:29.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.474+0000 7fddac000640 1 -- start start 2024-09-13T17:53:29.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.474+0000 7fddac000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdda413f420 0x7fdda406d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:29.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.474+0000 7fddac000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda40cd220 con 0x7fdda406da90 2024-09-13T17:53:29.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.474+0000 7fddac000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda415a740 con 0x7fdda413c240 2024-09-13T17:53:29.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.474+0000 7fddac000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda406df40 con 0x7fdda413f420 2024-09-13T17:53:29.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.474+0000 7fdda8c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdda413f420 0x7fdda406d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:29.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.474+0000 7fddaa000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fdda406da90 0x7fdda40cd650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47656/0 (socket says 172.21.15.114:47656) 2024-09-13T17:53:29.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.474+0000 7fddaa000640 1 -- 172.21.15.114:0/3651375150 learned_addr learned my addr 172.21.15.114:0/3651375150 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:29.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.474+0000 7fdda8c00640 1 -- 172.21.15.114:0/3651375150 >> v1:172.21.15.134:6789/0 conn(0x7fdda413c240 legacy=0x7fdda413c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:29.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.474+0000 7fdda8c00640 1 -- 172.21.15.114:0/3651375150 >> v1:172.21.15.114:6789/0 conn(0x7fdda406da90 legacy=0x7fdda40cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:29.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.474+0000 7fdda8c00640 1 -- 172.21.15.114:0/3651375150 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda4159bc0 con 0x7fdda413f420 2024-09-13T17:53:29.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.478+0000 7fdda8c00640 1 --2- 172.21.15.114:0/3651375150 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdda413f420 0x7fdda406d550 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdd900097c0 tx=0x7fdd9001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca67c0d999e8948 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:29.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.478+0000 7fdda3e00640 1 -- 172.21.15.114:0/3651375150 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd900ab670 con 0x7fdda413f420 2024-09-13T17:53:29.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.478+0000 7fdda3e00640 1 -- 172.21.15.114:0/3651375150 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd900ab7d0 con 0x7fdda413f420 2024-09-13T17:53:29.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.478+0000 7fdda3e00640 1 -- 172.21.15.114:0/3651375150 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd900abb60 con 0x7fdda413f420 2024-09-13T17:53:29.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.478+0000 7fddac000640 1 -- 172.21.15.114:0/3651375150 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdda413f420 msgr2=0x7fdda406d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:29.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.478+0000 7fddac000640 1 --2- 172.21.15.114:0/3651375150 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdda413f420 0x7fdda406d550 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdd900097c0 tx=0x7fdd9001c470 comp rx=0 tx=0).stop 2024-09-13T17:53:29.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.478+0000 7fddac000640 1 -- 172.21.15.114:0/3651375150 shutdown_connections 2024-09-13T17:53:29.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.478+0000 7fddac000640 1 --2- 172.21.15.114:0/3651375150 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdda413f420 0x7fdda406d550 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.478+0000 7fddac000640 1 -- 172.21.15.114:0/3651375150 >> 172.21.15.114:0/3651375150 conn(0x7fdda40660b0 msgr2=0x7fdda4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:29.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.478+0000 7fddac000640 1 -- 172.21.15.114:0/3651375150 shutdown_connections 2024-09-13T17:53:29.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.478+0000 7fddac000640 1 -- 172.21.15.114:0/3651375150 wait complete. 2024-09-13T17:53:29.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.482+0000 7fddac000640 1 Processor -- start 2024-09-13T17:53:29.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.482+0000 7fddac000640 1 -- start start 2024-09-13T17:53:29.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.482+0000 7fddac000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdda406da90 0x7fdda4135e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:29.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.482+0000 7fddac000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdda413c240 0x7fdda41578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:29.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.482+0000 7fddac000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdda413f420 0x7fdda4157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:29.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.482+0000 7fddac000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda4136350 con 0x7fdda406da90 2024-09-13T17:53:29.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.482+0000 7fddac000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda40ad480 con 0x7fdda413f420 2024-09-13T17:53:29.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.482+0000 7fddac000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda40ac870 con 0x7fdda413c240 2024-09-13T17:53:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.482+0000 7fdda9600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdda406da90 0x7fdda4135e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.482+0000 7fdda9600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdda406da90 0x7fdda4135e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36636/0 (socket says 172.21.15.114:36636) 2024-09-13T17:53:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.482+0000 7fdda9600640 1 -- 172.21.15.114:0/2700566780 learned_addr learned my addr 172.21.15.114:0/2700566780 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.482+0000 7fdda8c00640 1 --2- 172.21.15.114:0/2700566780 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdda413c240 0x7fdda41578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.482+0000 7fdda9600640 1 -- 172.21.15.114:0/2700566780 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdda413c240 msgr2=0x7fdda41578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.482+0000 7fdda9600640 1 --2- 172.21.15.114:0/2700566780 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdda413c240 0x7fdda41578e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.482+0000 7fdda9600640 1 -- 172.21.15.114:0/2700566780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdda413f420 msgr2=0x7fdda4157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.482+0000 7fdda9600640 1 --2- 172.21.15.114:0/2700566780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdda413f420 0x7fdda4157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.482+0000 7fdda9600640 1 -- 172.21.15.114:0/2700566780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd90009420 con 0x7fdda406da90 2024-09-13T17:53:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.482+0000 7fdda9600640 1 --2- 172.21.15.114:0/2700566780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdda406da90 0x7fdda4135e10 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fdd9800c500 tx=0x7fdd9800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.482+0000 7fdda1600640 1 -- 172.21.15.114:0/2700566780 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd98005220 con 0x7fdda406da90 2024-09-13T17:53:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.482+0000 7fdda1600640 1 -- 172.21.15.114:0/2700566780 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd98005380 con 0x7fdda406da90 2024-09-13T17:53:29.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.482+0000 7fddac000640 1 -- 172.21.15.114:0/2700566780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda40acb50 con 0x7fdda406da90 2024-09-13T17:53:29.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.482+0000 7fdda1600640 1 -- 172.21.15.114:0/2700566780 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd98007270 con 0x7fdda406da90 2024-09-13T17:53:29.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.482+0000 7fddac000640 1 -- 172.21.15.114:0/2700566780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda40ad110 con 0x7fdda406da90 2024-09-13T17:53:29.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.482+0000 7fddac000640 1 -- 172.21.15.114:0/2700566780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda40667b0 con 0x7fdda406da90 2024-09-13T17:53:29.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.486+0000 7fdda1600640 1 -- 172.21.15.114:0/2700566780 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdd980073d0 con 0x7fdda406da90 2024-09-13T17:53:29.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.486+0000 7fdda1600640 1 --2- 172.21.15.114:0/2700566780 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdd84066690 0x7fdd84068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:29.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.486+0000 7fdda1600640 1 -- 172.21.15.114:0/2700566780 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6115+0+0 (secure 0 0 0) 0x7fdd98083bd0 con 0x7fdda406da90 2024-09-13T17:53:29.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.486+0000 7fdda8c00640 1 --2- 172.21.15.114:0/2700566780 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdd84066690 0x7fdd84068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:29.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.486+0000 7fdda8c00640 1 --2- 172.21.15.114:0/2700566780 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdd84066690 0x7fdd84068b50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdd900af000 tx=0x7fdd900a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:29.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.490+0000 7fdda1600640 1 -- 172.21.15.114:0/2700566780 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdd98050db0 con 0x7fdda406da90 2024-09-13T17:53:29.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.642+0000 7fddac000640 1 -- 172.21.15.114:0/2700566780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdda413c660 con 0x7fdda406da90 2024-09-13T17:53:29.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.646+0000 7fdda1600640 1 -- 172.21.15.114:0/2700566780 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+16953 (secure 0 0 0) 0x7fdd980543d0 con 0x7fdda406da90 2024-09-13T17:53:29.650 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:29.650 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":44,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:53:29.300457+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:53:06.185439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:53:07.297633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6835/1239035445":"2024-09-14T17:53:22.929223+0000","172.21.15.134:6833/1239035445":"2024-09-14T17:53:22.929223+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:53:29.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.646+0000 7fddac000640 1 -- 172.21.15.114:0/2700566780 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdd84066690 msgr2=0x7fdd84068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:29.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.646+0000 7fddac000640 1 --2- 172.21.15.114:0/2700566780 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdd84066690 0x7fdd84068b50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdd900af000 tx=0x7fdd900a7000 comp rx=0 tx=0).stop 2024-09-13T17:53:29.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.646+0000 7fddac000640 1 -- 172.21.15.114:0/2700566780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdda406da90 msgr2=0x7fdda4135e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:29.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.646+0000 7fddac000640 1 --2- 172.21.15.114:0/2700566780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdda406da90 0x7fdda4135e10 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fdd9800c500 tx=0x7fdd9800c9c0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.646+0000 7fddac000640 1 -- 172.21.15.114:0/2700566780 shutdown_connections 2024-09-13T17:53:29.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.646+0000 7fddac000640 1 --2- 172.21.15.114:0/2700566780 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdd84066690 0x7fdd84068b50 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.646+0000 7fddac000640 1 --2- 172.21.15.114:0/2700566780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdda413f420 0x7fdda4157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.646+0000 7fddac000640 1 --2- 172.21.15.114:0/2700566780 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdda413c240 0x7fdda41578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.646+0000 7fddac000640 1 --2- 172.21.15.114:0/2700566780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdda406da90 0x7fdda4135e10 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.646+0000 7fddac000640 1 -- 172.21.15.114:0/2700566780 >> 172.21.15.114:0/2700566780 conn(0x7fdda40660b0 msgr2=0x7fdda4151010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:29.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.646+0000 7fddac000640 1 -- 172.21.15.114:0/2700566780 shutdown_connections 2024-09-13T17:53:29.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.646+0000 7fddac000640 1 -- 172.21.15.114:0/2700566780 wait complete. 2024-09-13T17:53:29.671 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:51:37.996254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:53:06.185439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:53:07.297633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:53:29.671 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:53:29.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.806+0000 7fafe7a00640 1 Processor -- start 2024-09-13T17:53:29.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.806+0000 7fafe7a00640 1 -- start start 2024-09-13T17:53:29.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.806+0000 7fafe7a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fafe013f420 0x7fafe006d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:29.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.806+0000 7fafe7a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafe006da90 0x7fafe00cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:29.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.806+0000 7fafe7a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe00cd220 con 0x7fafe013c240 2024-09-13T17:53:29.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.806+0000 7fafe7a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe006df40 con 0x7fafe013f420 2024-09-13T17:53:29.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.806+0000 7fafe7a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe015a740 con 0x7fafe006da90 2024-09-13T17:53:29.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.806+0000 7fafe5000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fafe013c240 0x7fafe013c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47668/0 (socket says 172.21.15.114:47668) 2024-09-13T17:53:29.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.806+0000 7fafe5000640 1 -- 172.21.15.114:0/2505001428 learned_addr learned my addr 172.21.15.114:0/2505001428 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:29.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.806+0000 7fafdfe00640 1 --2- 172.21.15.114:0/2505001428 >> v2:172.21.15.114:3300/0 conn(0x7fafe013f420 0x7fafe006d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:29.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.806+0000 7fafdf400640 1 -- 172.21.15.114:0/2505001428 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2733280786 0 0) 0x7fafe00cd220 con 0x7fafe013c240 2024-09-13T17:53:29.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.806+0000 7fafdf400640 1 -- 172.21.15.114:0/2505001428 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafc4003530 con 0x7fafe013c240 2024-09-13T17:53:29.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.806+0000 7fafdfe00640 1 -- 172.21.15.114:0/2505001428 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafe006da90 msgr2=0x7fafe00cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:29.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.806+0000 7fafdfe00640 1 --2- 172.21.15.114:0/2505001428 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafe006da90 0x7fafe00cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.806+0000 7fafdfe00640 1 -- 172.21.15.114:0/2505001428 >> v1:172.21.15.114:6789/0 conn(0x7fafe013c240 legacy=0x7fafe013c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:29.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.806+0000 7fafdf400640 1 -- 172.21.15.114:0/2505001428 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1695473917 0 0) 0x7fafc4003530 con 0x7fafe013c240 2024-09-13T17:53:29.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.806+0000 7fafdfe00640 1 -- 172.21.15.114:0/2505001428 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe0159bc0 con 0x7fafe013f420 2024-09-13T17:53:29.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.810+0000 7fafdfe00640 1 --2- 172.21.15.114:0/2505001428 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafe013f420 0x7fafe006d550 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fafcc0097c0 tx=0x7fafcc01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd0608a1fa5e97e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:29.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.810+0000 7fafdf400640 1 -- 172.21.15.114:0/2505001428 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd0001680 con 0x7fafe013f420 2024-09-13T17:53:29.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.810+0000 7fafdf400640 1 -- 172.21.15.114:0/2505001428 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafcc0a7050 con 0x7fafe013f420 2024-09-13T17:53:29.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.810+0000 7fafdf400640 1 -- 172.21.15.114:0/2505001428 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc0ab620 con 0x7fafe013f420 2024-09-13T17:53:29.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.810+0000 7fafe7a00640 1 -- 172.21.15.114:0/2505001428 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafe013f420 msgr2=0x7fafe006d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:29.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.810+0000 7fafe7a00640 1 --2- 172.21.15.114:0/2505001428 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafe013f420 0x7fafe006d550 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fafcc0097c0 tx=0x7fafcc01c390 comp rx=0 tx=0).stop 2024-09-13T17:53:29.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.810+0000 7fafe7a00640 1 -- 172.21.15.114:0/2505001428 shutdown_connections 2024-09-13T17:53:29.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.810+0000 7fafe7a00640 1 --2- 172.21.15.114:0/2505001428 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafe006da90 0x7fafe00cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.810+0000 7fafe7a00640 1 --2- 172.21.15.114:0/2505001428 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafe013f420 0x7fafe006d550 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.810+0000 7fafe7a00640 1 -- 172.21.15.114:0/2505001428 >> 172.21.15.114:0/2505001428 conn(0x7fafe00660b0 msgr2=0x7fafe0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:29.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.810+0000 7fafe7a00640 1 -- 172.21.15.114:0/2505001428 shutdown_connections 2024-09-13T17:53:29.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.810+0000 7fafe7a00640 1 -- 172.21.15.114:0/2505001428 wait complete. 2024-09-13T17:53:29.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.814+0000 7fafe7a00640 1 Processor -- start 2024-09-13T17:53:29.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.814+0000 7fafe7a00640 1 -- start start 2024-09-13T17:53:29.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.814+0000 7fafe7a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafe006da90 0x7fafe01569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:29.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.814+0000 7fafe7a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafe013c240 0x7fafe0153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:29.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.814+0000 7fafe7a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafe013f420 0x7fafe01f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:29.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.814+0000 7fafe7a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe0156f10 con 0x7fafe006da90 2024-09-13T17:53:29.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.814+0000 7fafe7a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe0157160 con 0x7fafe013f420 2024-09-13T17:53:29.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.814+0000 7fafe7a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe0153d80 con 0x7fafe013c240 2024-09-13T17:53:29.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.814+0000 7fafe5000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafe006da90 0x7fafe01569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:29.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.814+0000 7fafe5000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafe006da90 0x7fafe01569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36660/0 (socket says 172.21.15.114:36660) 2024-09-13T17:53:29.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.814+0000 7fafe5000640 1 -- 172.21.15.114:0/3846786998 learned_addr learned my addr 172.21.15.114:0/3846786998 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:29.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.814+0000 7fafdfe00640 1 --2- 172.21.15.114:0/3846786998 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafe013c240 0x7fafe0153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:29.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.814+0000 7fafe5a00640 1 --2- 172.21.15.114:0/3846786998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafe013f420 0x7fafe01f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:29.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.814+0000 7fafe5000640 1 -- 172.21.15.114:0/3846786998 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafe013c240 msgr2=0x7fafe0153840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:29.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.814+0000 7fafe5000640 1 --2- 172.21.15.114:0/3846786998 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafe013c240 0x7fafe0153840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.814+0000 7fafe5000640 1 -- 172.21.15.114:0/3846786998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafe013f420 msgr2=0x7fafe01f4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:29.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.814+0000 7fafe5000640 1 --2- 172.21.15.114:0/3846786998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafe013f420 0x7fafe01f4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.814+0000 7fafe5000640 1 -- 172.21.15.114:0/3846786998 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc009420 con 0x7fafe006da90 2024-09-13T17:53:29.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.814+0000 7fafe5000640 1 --2- 172.21.15.114:0/3846786998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafe006da90 0x7fafe01569d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fafd000c780 tx=0x7fafd000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:29.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.814+0000 7fafdcc00640 1 -- 172.21.15.114:0/3846786998 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd0005cf0 con 0x7fafe006da90 2024-09-13T17:53:29.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.814+0000 7fafdcc00640 1 -- 172.21.15.114:0/3846786998 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd0005e50 con 0x7fafe006da90 2024-09-13T17:53:29.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.814+0000 7fafdcc00640 1 -- 172.21.15.114:0/3846786998 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd00072b0 con 0x7fafe006da90 2024-09-13T17:53:29.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.814+0000 7fafe7a00640 1 -- 172.21.15.114:0/3846786998 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe00af720 con 0x7fafe006da90 2024-09-13T17:53:29.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.814+0000 7fafe7a00640 1 -- 172.21.15.114:0/3846786998 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe00afce0 con 0x7fafe006da90 2024-09-13T17:53:29.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.814+0000 7fafe7a00640 1 -- 172.21.15.114:0/3846786998 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe0159820 con 0x7fafe006da90 2024-09-13T17:53:29.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.818+0000 7fafdcc00640 1 -- 172.21.15.114:0/3846786998 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fafd0007410 con 0x7fafe006da90 2024-09-13T17:53:29.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.818+0000 7fafdcc00640 1 --2- 172.21.15.114:0/3846786998 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fafc00666c0 0x7fafc0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:29.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.818+0000 7fafdcc00640 1 -- 172.21.15.114:0/3846786998 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6115+0+0 (secure 0 0 0) 0x7fafd0084170 con 0x7fafe006da90 2024-09-13T17:53:29.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.818+0000 7fafdfe00640 1 --2- 172.21.15.114:0/3846786998 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fafc00666c0 0x7fafc0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:29.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.818+0000 7fafdfe00640 1 --2- 172.21.15.114:0/3846786998 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fafc00666c0 0x7fafc0068b80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fafcc0ad000 tx=0x7fafcc004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:29.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.822+0000 7fafdcc00640 1 -- 172.21.15.114:0/3846786998 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fafd00512a0 con 0x7fafe006da90 2024-09-13T17:53:29.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.978+0000 7fafe7a00640 1 -- 172.21.15.114:0/3846786998 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fafe00b1b50 con 0x7fafe006da90 2024-09-13T17:53:29.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.978+0000 7fafdcc00640 1 -- 172.21.15.114:0/3846786998 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7fafd00548c0 con 0x7fafe006da90 2024-09-13T17:53:29.984 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-13T17:53:29.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.982+0000 7fafe7a00640 1 -- 172.21.15.114:0/3846786998 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fafc00666c0 msgr2=0x7fafc0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:29.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.982+0000 7fafe7a00640 1 --2- 172.21.15.114:0/3846786998 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fafc00666c0 0x7fafc0068b80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fafcc0ad000 tx=0x7fafcc004740 comp rx=0 tx=0).stop 2024-09-13T17:53:29.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.982+0000 7fafe7a00640 1 -- 172.21.15.114:0/3846786998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafe006da90 msgr2=0x7fafe01569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:29.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.982+0000 7fafe7a00640 1 --2- 172.21.15.114:0/3846786998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafe006da90 0x7fafe01569d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fafd000c780 tx=0x7fafd000cc40 comp rx=0 tx=0).stop 2024-09-13T17:53:29.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.982+0000 7fafe7a00640 1 -- 172.21.15.114:0/3846786998 shutdown_connections 2024-09-13T17:53:29.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.982+0000 7fafe7a00640 1 --2- 172.21.15.114:0/3846786998 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fafc00666c0 0x7fafc0068b80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.982+0000 7fafe7a00640 1 --2- 172.21.15.114:0/3846786998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafe013f420 0x7fafe01f4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.982+0000 7fafe7a00640 1 --2- 172.21.15.114:0/3846786998 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fafe013c240 0x7fafe0153840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.982+0000 7fafe7a00640 1 --2- 172.21.15.114:0/3846786998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fafe006da90 0x7fafe01569d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:29.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.982+0000 7fafe7a00640 1 -- 172.21.15.114:0/3846786998 >> 172.21.15.114:0/3846786998 conn(0x7fafe00660b0 msgr2=0x7fafe0158420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:29.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.982+0000 7fafe7a00640 1 -- 172.21.15.114:0/3846786998 shutdown_connections 2024-09-13T17:53:29.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:29.982+0000 7fafe7a00640 1 -- 172.21.15.114:0/3846786998 wait complete. 2024-09-13T17:53:30.007 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:53:30.107 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-13T17:53:30.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.138+0000 7f44a3200640 1 Processor -- start 2024-09-13T17:53:30.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.138+0000 7f44a3200640 1 -- start start 2024-09-13T17:53:30.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.142+0000 7f44a3200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f449c13f420 0x7f449c06d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:30.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.142+0000 7f44a3200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449c0cd220 con 0x7f449c13c240 2024-09-13T17:53:30.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.142+0000 7f44a3200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449c15a740 con 0x7f449c06da90 2024-09-13T17:53:30.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.142+0000 7f44a3200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f449c06df40 con 0x7f449c13f420 2024-09-13T17:53:30.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.142+0000 7f449be00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f449c13c240 0x7f449c13c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47672/0 (socket says 172.21.15.114:47672) 2024-09-13T17:53:30.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.142+0000 7f449be00640 1 -- 172.21.15.114:0/380939883 learned_addr learned my addr 172.21.15.114:0/380939883 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:30.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.142+0000 7f4493400640 1 --2- 172.21.15.114:0/380939883 >> v2:172.21.15.134:3300/0 conn(0x7f449c13f420 0x7f449c06d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:30.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.142+0000 7f449b400640 1 -- 172.21.15.114:0/380939883 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1250851667 0 0) 0x7f449c0cd220 con 0x7f449c13c240 2024-09-13T17:53:30.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.142+0000 7f449b400640 1 -- 172.21.15.114:0/380939883 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4480003530 con 0x7f449c13c240 2024-09-13T17:53:30.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.142+0000 7f4493400640 1 -- 172.21.15.114:0/380939883 >> v1:172.21.15.134:6789/0 conn(0x7f449c06da90 legacy=0x7f449c0cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:30.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.142+0000 7f4493400640 1 -- 172.21.15.114:0/380939883 >> v1:172.21.15.114:6789/0 conn(0x7f449c13c240 legacy=0x7f449c13c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:30.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.142+0000 7f4493400640 1 -- 172.21.15.114:0/380939883 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c159bc0 con 0x7f449c13f420 2024-09-13T17:53:30.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.146+0000 7f4493400640 1 --2- 172.21.15.114:0/380939883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f449c13f420 0x7f449c06d550 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f44840097c0 tx=0x7f448401c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=faeb0cc5cf7ed6c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:30.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.146+0000 7f449b400640 1 -- 172.21.15.114:0/380939883 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44840a7070 con 0x7f449c13f420 2024-09-13T17:53:30.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.146+0000 7f449b400640 1 -- 172.21.15.114:0/380939883 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44840ab430 con 0x7f449c13f420 2024-09-13T17:53:30.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.146+0000 7f449b400640 1 -- 172.21.15.114:0/380939883 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44840ab7a0 con 0x7f449c13f420 2024-09-13T17:53:30.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.146+0000 7f44a3200640 1 -- 172.21.15.114:0/380939883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f449c13f420 msgr2=0x7f449c06d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:30.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.146+0000 7f44a3200640 1 --2- 172.21.15.114:0/380939883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f449c13f420 0x7f449c06d550 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f44840097c0 tx=0x7f448401c430 comp rx=0 tx=0).stop 2024-09-13T17:53:30.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.146+0000 7f44a3200640 1 -- 172.21.15.114:0/380939883 shutdown_connections 2024-09-13T17:53:30.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.146+0000 7f44a3200640 1 --2- 172.21.15.114:0/380939883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f449c13f420 0x7f449c06d550 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:30.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.146+0000 7f44a3200640 1 -- 172.21.15.114:0/380939883 >> 172.21.15.114:0/380939883 conn(0x7f449c0660b0 msgr2=0x7f449c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:30.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.146+0000 7f44a3200640 1 -- 172.21.15.114:0/380939883 shutdown_connections 2024-09-13T17:53:30.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.146+0000 7f44a3200640 1 -- 172.21.15.114:0/380939883 wait complete. 2024-09-13T17:53:30.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.146+0000 7f44a3200640 1 Processor -- start 2024-09-13T17:53:30.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.150+0000 7f44a3200640 1 -- start start 2024-09-13T17:53:30.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.150+0000 7f44a3200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f449c06da90 0x7f449c145be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:30.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.150+0000 7f44a3200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f449c13c240 0x7f449c139a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:30.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.150+0000 7f44a3200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f449c13f420 0x7f449c0c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:30.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.150+0000 7f44a3200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449c146120 con 0x7f449c13f420 2024-09-13T17:53:30.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.150+0000 7f44a3200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449c146f40 con 0x7f449c13c240 2024-09-13T17:53:30.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.150+0000 7f44a3200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449c1f4c70 con 0x7f449c06da90 2024-09-13T17:53:30.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.150+0000 7f44a1200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f449c13f420 0x7f449c0c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:30.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.150+0000 7f449be00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f449c06da90 0x7f449c145be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:30.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.150+0000 7f44a1200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f449c13f420 0x7f449c0c7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36676/0 (socket says 172.21.15.114:36676) 2024-09-13T17:53:30.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.150+0000 7f44a1200640 1 -- 172.21.15.114:0/3054127155 learned_addr learned my addr 172.21.15.114:0/3054127155 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:30.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.150+0000 7f4493400640 1 --2- 172.21.15.114:0/3054127155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f449c13c240 0x7f449c139a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:30.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.150+0000 7f44a1200640 1 -- 172.21.15.114:0/3054127155 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f449c06da90 msgr2=0x7f449c145be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:30.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.150+0000 7f44a1200640 1 --2- 172.21.15.114:0/3054127155 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f449c06da90 0x7f449c145be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:30.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.150+0000 7f44a1200640 1 -- 172.21.15.114:0/3054127155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f449c13c240 msgr2=0x7f449c139a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:30.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.150+0000 7f44a1200640 1 --2- 172.21.15.114:0/3054127155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f449c13c240 0x7f449c139a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:30.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.150+0000 7f44a1200640 1 -- 172.21.15.114:0/3054127155 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4484009420 con 0x7f449c13f420 2024-09-13T17:53:30.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.150+0000 7f44a1200640 1 --2- 172.21.15.114:0/3054127155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f449c13f420 0x7f449c0c7890 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f449400c780 tx=0x7f449400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:30.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.150+0000 7f4498c00640 1 -- 172.21.15.114:0/3054127155 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4494003d90 con 0x7f449c13f420 2024-09-13T17:53:30.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.150+0000 7f4498c00640 1 -- 172.21.15.114:0/3054127155 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449400ce90 con 0x7f449c13f420 2024-09-13T17:53:30.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.150+0000 7f44a3200640 1 -- 172.21.15.114:0/3054127155 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f449c146330 con 0x7f449c13f420 2024-09-13T17:53:30.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.150+0000 7f4498c00640 1 -- 172.21.15.114:0/3054127155 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44940052b0 con 0x7f449c13f420 2024-09-13T17:53:30.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.150+0000 7f44a3200640 1 -- 172.21.15.114:0/3054127155 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f449c1468f0 con 0x7f449c13f420 2024-09-13T17:53:30.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.150+0000 7f44a3200640 1 -- 172.21.15.114:0/3054127155 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f449c1470d0 con 0x7f449c13f420 2024-09-13T17:53:30.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.154+0000 7f4498c00640 1 -- 172.21.15.114:0/3054127155 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4494005410 con 0x7f449c13f420 2024-09-13T17:53:30.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.154+0000 7f4498c00640 1 --2- 172.21.15.114:0/3054127155 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f44780666c0 0x7f4478068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:30.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.154+0000 7f4498c00640 1 -- 172.21.15.114:0/3054127155 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f4494083b80 con 0x7f449c13f420 2024-09-13T17:53:30.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.154+0000 7f449be00640 1 --2- 172.21.15.114:0/3054127155 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f44780666c0 0x7f4478068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:30.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.154+0000 7f449be00640 1 --2- 172.21.15.114:0/3054127155 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f44780666c0 0x7f4478068b80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f448c007fd0 tx=0x7f448c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:30.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.158+0000 7f4498c00640 1 -- 172.21.15.114:0/3054127155 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4494050d60 con 0x7f449c13f420 2024-09-13T17:53:30.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.314+0000 7f44a3200640 1 -- 172.21.15.114:0/3054127155 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f449c15a4c0 con 0x7f449c13f420 2024-09-13T17:53:30.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.314+0000 7f4498c00640 1 -- 172.21.15.114:0/3054127155 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4494083e60 con 0x7f449c13f420 2024-09-13T17:53:30.319 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:53:30.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.314+0000 7f44a3200640 1 -- 172.21.15.114:0/3054127155 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f44780666c0 msgr2=0x7f4478068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:30.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.314+0000 7f44a3200640 1 --2- 172.21.15.114:0/3054127155 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f44780666c0 0x7f4478068b80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f448c007fd0 tx=0x7f448c009040 comp rx=0 tx=0).stop 2024-09-13T17:53:30.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.314+0000 7f44a3200640 1 -- 172.21.15.114:0/3054127155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f449c13f420 msgr2=0x7f449c0c7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:30.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.314+0000 7f44a3200640 1 --2- 172.21.15.114:0/3054127155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f449c13f420 0x7f449c0c7890 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f449400c780 tx=0x7f449400cc40 comp rx=0 tx=0).stop 2024-09-13T17:53:30.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.314+0000 7f44a3200640 1 -- 172.21.15.114:0/3054127155 shutdown_connections 2024-09-13T17:53:30.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.314+0000 7f44a3200640 1 --2- 172.21.15.114:0/3054127155 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f44780666c0 0x7f4478068b80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:30.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.314+0000 7f44a3200640 1 --2- 172.21.15.114:0/3054127155 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f449c13f420 0x7f449c0c7890 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:30.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.314+0000 7f44a3200640 1 --2- 172.21.15.114:0/3054127155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f449c13c240 0x7f449c139a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:30.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.314+0000 7f44a3200640 1 --2- 172.21.15.114:0/3054127155 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f449c06da90 0x7f449c145be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:30.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.314+0000 7f44a3200640 1 -- 172.21.15.114:0/3054127155 >> 172.21.15.114:0/3054127155 conn(0x7f449c0660b0 msgr2=0x7f449c0cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:30.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.314+0000 7f44a3200640 1 -- 172.21.15.114:0/3054127155 shutdown_connections 2024-09-13T17:53:30.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.314+0000 7f44a3200640 1 -- 172.21.15.114:0/3054127155 wait complete. 2024-09-13T17:53:30.341 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:53:30.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.474+0000 7f1b26000640 1 Processor -- start 2024-09-13T17:53:30.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.478+0000 7f1b26000640 1 -- start start 2024-09-13T17:53:30.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.478+0000 7f1b26000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1b20151420 0x7f1b200cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:30.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.478+0000 7f1b26000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1b20070b30 0x7f1b2006c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:30.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.478+0000 7f1b26000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b20151800 con 0x7f1b200ccba0 2024-09-13T17:53:30.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.478+0000 7f1b26000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b200cbc30 con 0x7f1b20070b30 2024-09-13T17:53:30.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.478+0000 7f1b26000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b200cafb0 con 0x7f1b20151420 2024-09-13T17:53:30.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.478+0000 7f1b1fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1b20070b30 0x7f1b2006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:30.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.478+0000 7f1b1fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1b20070b30 0x7f1b2006c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36686/0 (socket says 172.21.15.114:36686) 2024-09-13T17:53:30.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.478+0000 7f1b1fe00640 1 -- 172.21.15.114:0/4045565298 learned_addr learned my addr 172.21.15.114:0/4045565298 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:30.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.478+0000 7f1b1f400640 1 --2- 172.21.15.114:0/4045565298 >> v2:172.21.15.134:3300/0 conn(0x7f1b20151420 0x7f1b200cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:30.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.478+0000 7f1b1fe00640 1 -- 172.21.15.114:0/4045565298 >> v2:172.21.15.134:3300/0 conn(0x7f1b20151420 msgr2=0x7f1b200cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:30.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.478+0000 7f1b1fe00640 1 --2- 172.21.15.114:0/4045565298 >> v2:172.21.15.134:3300/0 conn(0x7f1b20151420 0x7f1b200cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:30.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.478+0000 7f1b1fe00640 1 -- 172.21.15.114:0/4045565298 >> v1:172.21.15.134:6789/0 conn(0x7f1b200ccba0 legacy=0x7f1b20070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:30.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.478+0000 7f1b1fe00640 1 -- 172.21.15.114:0/4045565298 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b200cb290 con 0x7f1b20070b30 2024-09-13T17:53:30.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.482+0000 7f1b1fe00640 1 --2- 172.21.15.114:0/4045565298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b20070b30 0x7f1b2006c540 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f1b200b3980 tx=0x7f1b1801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe4e1bef7b1c66b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:30.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.482+0000 7f1b1e000640 1 -- 172.21.15.114:0/4045565298 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b180ac630 con 0x7f1b20070b30 2024-09-13T17:53:30.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.482+0000 7f1b1e000640 1 -- 172.21.15.114:0/4045565298 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b180ac790 con 0x7f1b20070b30 2024-09-13T17:53:30.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.482+0000 7f1b1e000640 1 -- 172.21.15.114:0/4045565298 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b180acb20 con 0x7f1b20070b30 2024-09-13T17:53:30.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.482+0000 7f1b26000640 1 -- 172.21.15.114:0/4045565298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b20070b30 msgr2=0x7f1b2006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:30.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.482+0000 7f1b26000640 1 --2- 172.21.15.114:0/4045565298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b20070b30 0x7f1b2006c540 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f1b200b3980 tx=0x7f1b1801c3d0 comp rx=0 tx=0).stop 2024-09-13T17:53:30.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.482+0000 7f1b26000640 1 -- 172.21.15.114:0/4045565298 shutdown_connections 2024-09-13T17:53:30.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.482+0000 7f1b26000640 1 --2- 172.21.15.114:0/4045565298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b20070b30 0x7f1b2006c540 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:30.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.482+0000 7f1b26000640 1 --2- 172.21.15.114:0/4045565298 >> v2:172.21.15.134:3300/0 conn(0x7f1b20151420 0x7f1b200cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:30.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.482+0000 7f1b26000640 1 -- 172.21.15.114:0/4045565298 >> 172.21.15.114:0/4045565298 conn(0x7f1b200660b0 msgr2=0x7f1b20069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:30.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.482+0000 7f1b26000640 1 -- 172.21.15.114:0/4045565298 shutdown_connections 2024-09-13T17:53:30.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.482+0000 7f1b26000640 1 -- 172.21.15.114:0/4045565298 wait complete. 2024-09-13T17:53:30.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.482+0000 7f1b26000640 1 Processor -- start 2024-09-13T17:53:30.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.482+0000 7f1b26000640 1 -- start start 2024-09-13T17:53:30.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.486+0000 7f1b26000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b20070b30 0x7f1b201f7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:30.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.486+0000 7f1b26000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b200ccba0 0x7f1b20147c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:30.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.486+0000 7f1b26000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b20151420 0x7f1b20163440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:30.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.486+0000 7f1b26000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b201f7c70 con 0x7f1b200ccba0 2024-09-13T17:53:30.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.486+0000 7f1b26000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b20146930 con 0x7f1b20070b30 2024-09-13T17:53:30.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.486+0000 7f1b26000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b20146b80 con 0x7f1b20151420 2024-09-13T17:53:30.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.486+0000 7f1b1ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b200ccba0 0x7f1b20147c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:30.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.486+0000 7f1b1ea00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b200ccba0 0x7f1b20147c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36702/0 (socket says 172.21.15.114:36702) 2024-09-13T17:53:30.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.486+0000 7f1b1ea00640 1 -- 172.21.15.114:0/2506324638 learned_addr learned my addr 172.21.15.114:0/2506324638 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:30.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.486+0000 7f1b1f400640 1 --2- 172.21.15.114:0/2506324638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b20070b30 0x7f1b201f7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:30.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.486+0000 7f1b1fe00640 1 --2- 172.21.15.114:0/2506324638 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b20151420 0x7f1b20163440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:30.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.486+0000 7f1b1ea00640 1 -- 172.21.15.114:0/2506324638 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b20151420 msgr2=0x7f1b20163440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:30.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.486+0000 7f1b1ea00640 1 --2- 172.21.15.114:0/2506324638 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b20151420 0x7f1b20163440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:30.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.486+0000 7f1b1ea00640 1 -- 172.21.15.114:0/2506324638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b20070b30 msgr2=0x7f1b201f7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:30.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.486+0000 7f1b1ea00640 1 --2- 172.21.15.114:0/2506324638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b20070b30 0x7f1b201f7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:30.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.486+0000 7f1b1ea00640 1 -- 172.21.15.114:0/2506324638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b180094d0 con 0x7f1b200ccba0 2024-09-13T17:53:30.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.486+0000 7f1b1ea00640 1 --2- 172.21.15.114:0/2506324638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b200ccba0 0x7f1b20147c20 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c00c450 tx=0x7f1b0c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:30.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.486+0000 7f1b17400640 1 -- 172.21.15.114:0/2506324638 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c0052d0 con 0x7f1b200ccba0 2024-09-13T17:53:30.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.486+0000 7f1b17400640 1 -- 172.21.15.114:0/2506324638 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0c005450 con 0x7f1b200ccba0 2024-09-13T17:53:30.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.486+0000 7f1b26000640 1 -- 172.21.15.114:0/2506324638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b20146e60 con 0x7f1b200ccba0 2024-09-13T17:53:30.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.486+0000 7f1b17400640 1 -- 172.21.15.114:0/2506324638 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c012870 con 0x7f1b200ccba0 2024-09-13T17:53:30.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.486+0000 7f1b26000640 1 -- 172.21.15.114:0/2506324638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b20147420 con 0x7f1b200ccba0 2024-09-13T17:53:30.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.486+0000 7f1b26000640 1 -- 172.21.15.114:0/2506324638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b2006c540 con 0x7f1b200ccba0 2024-09-13T17:53:30.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.486+0000 7f1b17400640 1 -- 172.21.15.114:0/2506324638 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1b0c0129d0 con 0x7f1b200ccba0 2024-09-13T17:53:30.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.490+0000 7f1b17400640 1 --2- 172.21.15.114:0/2506324638 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1b000666c0 0x7f1b00068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:30.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.490+0000 7f1b17400640 1 -- 172.21.15.114:0/2506324638 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f1b0c083d60 con 0x7f1b200ccba0 2024-09-13T17:53:30.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.490+0000 7f1b1f400640 1 --2- 172.21.15.114:0/2506324638 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1b000666c0 0x7f1b00068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:30.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.490+0000 7f1b1f400640 1 --2- 172.21.15.114:0/2506324638 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1b000666c0 0x7f1b00068b80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1b10003ab0 tx=0x7f1b10009830 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:30.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.494+0000 7f1b17400640 1 -- 172.21.15.114:0/2506324638 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1b0c050fe0 con 0x7f1b200ccba0 2024-09-13T17:53:30.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.646+0000 7f1b26000640 1 -- 172.21.15.114:0/2506324638 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1b2006b400 con 0x7f1b200ccba0 2024-09-13T17:53:30.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.646+0000 7f1b17400640 1 -- 172.21.15.114:0/2506324638 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v45) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1b0c054600 con 0x7f1b200ccba0 2024-09-13T17:53:30.652 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-09-13T17:53:30.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.650+0000 7f1b26000640 1 -- 172.21.15.114:0/2506324638 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1b000666c0 msgr2=0x7f1b00068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:30.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.650+0000 7f1b26000640 1 --2- 172.21.15.114:0/2506324638 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1b000666c0 0x7f1b00068b80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1b10003ab0 tx=0x7f1b10009830 comp rx=0 tx=0).stop 2024-09-13T17:53:30.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.650+0000 7f1b26000640 1 -- 172.21.15.114:0/2506324638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b200ccba0 msgr2=0x7f1b20147c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:30.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.650+0000 7f1b26000640 1 --2- 172.21.15.114:0/2506324638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b200ccba0 0x7f1b20147c20 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c00c450 tx=0x7f1b0c00c910 comp rx=0 tx=0).stop 2024-09-13T17:53:30.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.650+0000 7f1b26000640 1 -- 172.21.15.114:0/2506324638 shutdown_connections 2024-09-13T17:53:30.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.650+0000 7f1b26000640 1 --2- 172.21.15.114:0/2506324638 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1b000666c0 0x7f1b00068b80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:30.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.650+0000 7f1b26000640 1 --2- 172.21.15.114:0/2506324638 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1b20151420 0x7f1b20163440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:30.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.650+0000 7f1b26000640 1 --2- 172.21.15.114:0/2506324638 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b200ccba0 0x7f1b20147c20 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:30.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.650+0000 7f1b26000640 1 --2- 172.21.15.114:0/2506324638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b20070b30 0x7f1b201f7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:30.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.650+0000 7f1b26000640 1 -- 172.21.15.114:0/2506324638 >> 172.21.15.114:0/2506324638 conn(0x7f1b200660b0 msgr2=0x7f1b20069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:30.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.650+0000 7f1b26000640 1 -- 172.21.15.114:0/2506324638 shutdown_connections 2024-09-13T17:53:30.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.650+0000 7f1b26000640 1 -- 172.21.15.114:0/2506324638 wait complete. 2024-09-13T17:53:30.673 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'recovery_fs' 2024-09-13T17:53:30.674 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create recovery_fs_metadata --pg_num_min 64 2024-09-13T17:53:30.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.806+0000 7fcfb0200640 1 Processor -- start 2024-09-13T17:53:30.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.806+0000 7fcfb0200640 1 -- start start 2024-09-13T17:53:30.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.806+0000 7fcfb0200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcfa813f420 0x7fcfa806d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:30.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.806+0000 7fcfb0200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcfa806da90 0x7fcfa80cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:30.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.806+0000 7fcfb0200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa80cd220 con 0x7fcfa813c240 2024-09-13T17:53:30.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.806+0000 7fcfb0200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa806df40 con 0x7fcfa813f420 2024-09-13T17:53:30.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.810+0000 7fcfb0200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa815a740 con 0x7fcfa806da90 2024-09-13T17:53:30.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.810+0000 7fcface00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcfa813f420 0x7fcfa806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:30.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.810+0000 7fcfad800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fcfa813c240 0x7fcfa813c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47678/0 (socket says 172.21.15.114:47678) 2024-09-13T17:53:30.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.810+0000 7fcfad800640 1 -- 172.21.15.114:0/556288851 learned_addr learned my addr 172.21.15.114:0/556288851 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:30.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.810+0000 7fcfae200640 1 --2- 172.21.15.114:0/556288851 >> v2:172.21.15.134:3300/0 conn(0x7fcfa806da90 0x7fcfa80cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:30.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.810+0000 7fcface00640 1 -- 172.21.15.114:0/556288851 >> v2:172.21.15.134:3300/0 conn(0x7fcfa806da90 msgr2=0x7fcfa80cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:30.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.810+0000 7fcface00640 1 --2- 172.21.15.114:0/556288851 >> v2:172.21.15.134:3300/0 conn(0x7fcfa806da90 0x7fcfa80cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:30.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.810+0000 7fcface00640 1 -- 172.21.15.114:0/556288851 >> v1:172.21.15.114:6789/0 conn(0x7fcfa813c240 legacy=0x7fcfa813c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:30.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.810+0000 7fcface00640 1 -- 172.21.15.114:0/556288851 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa8159bc0 con 0x7fcfa813f420 2024-09-13T17:53:30.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.810+0000 7fcfa7e00640 1 -- 172.21.15.114:0/556288851 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3123742051 0 0) 0x7fcfa80cd220 con 0x7fcfa813c240 2024-09-13T17:53:30.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.810+0000 7fcface00640 1 --2- 172.21.15.114:0/556288851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfa813f420 0x7fcfa806d550 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80cc4f0 tx=0x7fcf9401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23315d3ceefb9062 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:30.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.810+0000 7fcfa7e00640 1 -- 172.21.15.114:0/556288851 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf940ab650 con 0x7fcfa813f420 2024-09-13T17:53:30.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.810+0000 7fcfa7e00640 1 -- 172.21.15.114:0/556288851 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf940ab7b0 con 0x7fcfa813f420 2024-09-13T17:53:30.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.810+0000 7fcfa7e00640 1 -- 172.21.15.114:0/556288851 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf940abb40 con 0x7fcfa813f420 2024-09-13T17:53:30.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.814+0000 7fcfb0200640 1 -- 172.21.15.114:0/556288851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfa813f420 msgr2=0x7fcfa806d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:30.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.814+0000 7fcfb0200640 1 --2- 172.21.15.114:0/556288851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfa813f420 0x7fcfa806d550 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80cc4f0 tx=0x7fcf9401c450 comp rx=0 tx=0).stop 2024-09-13T17:53:30.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.814+0000 7fcfb0200640 1 -- 172.21.15.114:0/556288851 shutdown_connections 2024-09-13T17:53:30.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.814+0000 7fcfb0200640 1 --2- 172.21.15.114:0/556288851 >> v2:172.21.15.134:3300/0 conn(0x7fcfa806da90 0x7fcfa80cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:30.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.814+0000 7fcfb0200640 1 --2- 172.21.15.114:0/556288851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfa813f420 0x7fcfa806d550 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:30.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.814+0000 7fcfb0200640 1 -- 172.21.15.114:0/556288851 >> 172.21.15.114:0/556288851 conn(0x7fcfa80660b0 msgr2=0x7fcfa8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:30.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.814+0000 7fcfb0200640 1 -- 172.21.15.114:0/556288851 shutdown_connections 2024-09-13T17:53:30.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.814+0000 7fcfb0200640 1 -- 172.21.15.114:0/556288851 wait complete. 2024-09-13T17:53:30.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.814+0000 7fcfb0200640 1 Processor -- start 2024-09-13T17:53:30.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.814+0000 7fcfb0200640 1 -- start start 2024-09-13T17:53:30.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.814+0000 7fcfb0200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfa806da90 0x7fcfa81392a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:30.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.814+0000 7fcfb0200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfa813c240 0x7fcfa813d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:30.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.814+0000 7fcfb0200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfa813f420 0x7fcfa813de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:30.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.814+0000 7fcfb0200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa815a9c0 con 0x7fcfa813c240 2024-09-13T17:53:30.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.814+0000 7fcfb0200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa813d050 con 0x7fcfa813f420 2024-09-13T17:53:30.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.814+0000 7fcfb0200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa813d2f0 con 0x7fcfa806da90 2024-09-13T17:53:30.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.814+0000 7fcface00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfa813c240 0x7fcfa813d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:30.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.814+0000 7fcface00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfa813c240 0x7fcfa813d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36722/0 (socket says 172.21.15.114:36722) 2024-09-13T17:53:30.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.814+0000 7fcface00640 1 -- 172.21.15.114:0/4112184921 learned_addr learned my addr 172.21.15.114:0/4112184921 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:30.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.814+0000 7fcfad800640 1 --2- 172.21.15.114:0/4112184921 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfa806da90 0x7fcfa81392a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:30.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.814+0000 7fcfae200640 1 --2- 172.21.15.114:0/4112184921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfa813f420 0x7fcfa813de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:30.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.814+0000 7fcface00640 1 -- 172.21.15.114:0/4112184921 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfa806da90 msgr2=0x7fcfa81392a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:30.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.814+0000 7fcface00640 1 --2- 172.21.15.114:0/4112184921 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfa806da90 0x7fcfa81392a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:30.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.814+0000 7fcface00640 1 -- 172.21.15.114:0/4112184921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfa813f420 msgr2=0x7fcfa813de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:30.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.814+0000 7fcface00640 1 --2- 172.21.15.114:0/4112184921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfa813f420 0x7fcfa813de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:30.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.814+0000 7fcface00640 1 -- 172.21.15.114:0/4112184921 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf94009420 con 0x7fcfa813c240 2024-09-13T17:53:30.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.818+0000 7fcface00640 1 --2- 172.21.15.114:0/4112184921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfa813c240 0x7fcfa813d920 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fcf940ad040 tx=0x7fcf940191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:30.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.818+0000 7fcfa5600640 1 -- 172.21.15.114:0/4112184921 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf940bf610 con 0x7fcfa813c240 2024-09-13T17:53:30.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.818+0000 7fcfa5600640 1 -- 172.21.15.114:0/4112184921 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf940bf770 con 0x7fcfa813c240 2024-09-13T17:53:30.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.818+0000 7fcfa5600640 1 -- 172.21.15.114:0/4112184921 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf940bfb20 con 0x7fcfa813c240 2024-09-13T17:53:30.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.818+0000 7fcfb0200640 1 -- 172.21.15.114:0/4112184921 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa813d5d0 con 0x7fcfa813c240 2024-09-13T17:53:30.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.818+0000 7fcfb0200640 1 -- 172.21.15.114:0/4112184921 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa813e3a0 con 0x7fcfa813c240 2024-09-13T17:53:30.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.818+0000 7fcfb0200640 1 -- 172.21.15.114:0/4112184921 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa80705d0 con 0x7fcfa813c240 2024-09-13T17:53:30.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.818+0000 7fcfa5600640 1 -- 172.21.15.114:0/4112184921 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcf940bfc80 con 0x7fcfa813c240 2024-09-13T17:53:30.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.818+0000 7fcfa5600640 1 --2- 172.21.15.114:0/4112184921 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fcf880666c0 0x7fcf88068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:30.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.818+0000 7fcfa5600640 1 -- 172.21.15.114:0/4112184921 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fcf9411ed10 con 0x7fcfa813c240 2024-09-13T17:53:30.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.818+0000 7fcfad800640 1 --2- 172.21.15.114:0/4112184921 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fcf880666c0 0x7fcf88068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:30.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.822+0000 7fcfad800640 1 --2- 172.21.15.114:0/4112184921 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fcf880666c0 0x7fcf88068b80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c000f70 tx=0x7fcf9c007b60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:30.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.822+0000 7fcfa5600640 1 -- 172.21.15.114:0/4112184921 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcf940ebe50 con 0x7fcfa813c240 2024-09-13T17:53:30.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:30.978+0000 7fcfb0200640 1 -- 172.21.15.114:0/4112184921 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "recovery_fs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcfa8159790 con 0x7fcfa813c240 2024-09-13T17:53:31.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.370+0000 7fcfa5600640 1 -- 172.21.15.114:0/4112184921 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "recovery_fs_metadata", "pg_num_min": 64}]=0 pool 'recovery_fs_metadata' created v46) v1 ==== 148+0+0 (secure 0 0 0) 0x7fcf940ef470 con 0x7fcfa813c240 2024-09-13T17:53:31.375 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'recovery_fs_metadata' created 2024-09-13T17:53:31.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.374+0000 7fcfb0200640 1 -- 172.21.15.114:0/4112184921 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fcf880666c0 msgr2=0x7fcf88068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:31.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.374+0000 7fcfb0200640 1 --2- 172.21.15.114:0/4112184921 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fcf880666c0 0x7fcf88068b80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c000f70 tx=0x7fcf9c007b60 comp rx=0 tx=0).stop 2024-09-13T17:53:31.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.374+0000 7fcfb0200640 1 -- 172.21.15.114:0/4112184921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfa813c240 msgr2=0x7fcfa813d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:31.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.374+0000 7fcfb0200640 1 --2- 172.21.15.114:0/4112184921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfa813c240 0x7fcfa813d920 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fcf940ad040 tx=0x7fcf940191f0 comp rx=0 tx=0).stop 2024-09-13T17:53:31.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.374+0000 7fcfb0200640 1 -- 172.21.15.114:0/4112184921 shutdown_connections 2024-09-13T17:53:31.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.374+0000 7fcfb0200640 1 --2- 172.21.15.114:0/4112184921 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fcf880666c0 0x7fcf88068b80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:31.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.374+0000 7fcfb0200640 1 --2- 172.21.15.114:0/4112184921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfa813f420 0x7fcfa813de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:31.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.374+0000 7fcfb0200640 1 --2- 172.21.15.114:0/4112184921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcfa813c240 0x7fcfa813d920 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:31.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.374+0000 7fcfb0200640 1 --2- 172.21.15.114:0/4112184921 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fcfa806da90 0x7fcfa81392a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:31.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.374+0000 7fcfb0200640 1 -- 172.21.15.114:0/4112184921 >> 172.21.15.114:0/4112184921 conn(0x7fcfa80660b0 msgr2=0x7fcfa813a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:31.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.378+0000 7fcfb0200640 1 -- 172.21.15.114:0/4112184921 shutdown_connections 2024-09-13T17:53:31.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.378+0000 7fcfb0200640 1 -- 172.21.15.114:0/4112184921 wait complete. 2024-09-13T17:53:31.404 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T17:53:31.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.538+0000 7f2277c00640 1 Processor -- start 2024-09-13T17:53:31.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.538+0000 7f2277c00640 1 -- start start 2024-09-13T17:53:31.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.542+0000 7f2277c00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f22700ce650 0x7f2270099480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:31.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.542+0000 7f2277c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f227006e680 0x7f227006eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:31.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.542+0000 7f2277c00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22700cebe0 con 0x7f22701602e0 2024-09-13T17:53:31.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.542+0000 7f2277c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22700ceec0 con 0x7f227006e680 2024-09-13T17:53:31.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.542+0000 7f2277c00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22700cf1a0 con 0x7f22700ce650 2024-09-13T17:53:31.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.542+0000 7f2275c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f227006e680 0x7f227006eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:31.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.542+0000 7f2275c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f227006e680 0x7f227006eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43666/0 (socket says 172.21.15.114:43666) 2024-09-13T17:53:31.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.542+0000 7f2275c00640 1 -- 172.21.15.114:0/2070716730 learned_addr learned my addr 172.21.15.114:0/2070716730 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:31.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.542+0000 7f2267e00640 1 --2- 172.21.15.114:0/2070716730 >> v2:172.21.15.134:3300/0 conn(0x7f22700ce650 0x7f2270099480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:31.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.542+0000 7f2275c00640 1 -- 172.21.15.114:0/2070716730 >> v2:172.21.15.134:3300/0 conn(0x7f22700ce650 msgr2=0x7f2270099480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:31.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.542+0000 7f2275c00640 1 --2- 172.21.15.114:0/2070716730 >> v2:172.21.15.134:3300/0 conn(0x7f22700ce650 0x7f2270099480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:31.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.542+0000 7f2275c00640 1 -- 172.21.15.114:0/2070716730 >> v1:172.21.15.134:6789/0 conn(0x7f22701602e0 legacy=0x7f22701606c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:31.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.542+0000 7f2275c00640 1 -- 172.21.15.114:0/2070716730 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22700cf480 con 0x7f227006e680 2024-09-13T17:53:31.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.546+0000 7f2275c00640 1 --2- 172.21.15.114:0/2070716730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f227006e680 0x7f227006eb10 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2270071b10 tx=0x7f226801c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53a031b725fb5b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:31.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.546+0000 7f226fe00640 1 -- 172.21.15.114:0/2070716730 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22680a57d0 con 0x7f227006e680 2024-09-13T17:53:31.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.546+0000 7f226fe00640 1 -- 172.21.15.114:0/2070716730 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22680a5930 con 0x7f227006e680 2024-09-13T17:53:31.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.546+0000 7f226fe00640 1 -- 172.21.15.114:0/2070716730 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22680a5cc0 con 0x7f227006e680 2024-09-13T17:53:31.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.546+0000 7f2277c00640 1 -- 172.21.15.114:0/2070716730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f227006e680 msgr2=0x7f227006eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:31.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.546+0000 7f2277c00640 1 --2- 172.21.15.114:0/2070716730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f227006e680 0x7f227006eb10 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2270071b10 tx=0x7f226801c8f0 comp rx=0 tx=0).stop 2024-09-13T17:53:31.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.546+0000 7f2277c00640 1 -- 172.21.15.114:0/2070716730 shutdown_connections 2024-09-13T17:53:31.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.546+0000 7f2277c00640 1 --2- 172.21.15.114:0/2070716730 >> v2:172.21.15.134:3300/0 conn(0x7f22700ce650 0x7f2270099480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:31.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.546+0000 7f2277c00640 1 --2- 172.21.15.114:0/2070716730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f227006e680 0x7f227006eb10 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:31.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.546+0000 7f2277c00640 1 -- 172.21.15.114:0/2070716730 >> 172.21.15.114:0/2070716730 conn(0x7f22700d04e0 msgr2=0x7f22700d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:31.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.546+0000 7f2277c00640 1 -- 172.21.15.114:0/2070716730 shutdown_connections 2024-09-13T17:53:31.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.546+0000 7f2277c00640 1 -- 172.21.15.114:0/2070716730 wait complete. 2024-09-13T17:53:31.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.546+0000 7f2277c00640 1 Processor -- start 2024-09-13T17:53:31.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.546+0000 7f2277c00640 1 -- start start 2024-09-13T17:53:31.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.550+0000 7f2277c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f227006e680 0x7f22701587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:31.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.550+0000 7f2277c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22700ce650 0x7f22700ae400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:31.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.550+0000 7f2277c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22701602e0 0x7f22700c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:31.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.550+0000 7f2277c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22700c4200 con 0x7f227006e680 2024-09-13T17:53:31.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.550+0000 7f2277c00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22700c7070 con 0x7f22701602e0 2024-09-13T17:53:31.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.550+0000 7f2277c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2270158ce0 con 0x7f22700ce650 2024-09-13T17:53:31.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.550+0000 7f2275200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f227006e680 0x7f22701587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:31.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.550+0000 7f2275200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f227006e680 0x7f22701587a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43668/0 (socket says 172.21.15.114:43668) 2024-09-13T17:53:31.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.550+0000 7f2275200640 1 -- 172.21.15.114:0/3606655115 learned_addr learned my addr 172.21.15.114:0/3606655115 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:31.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.550+0000 7f2275c00640 1 --2- 172.21.15.114:0/3606655115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22701602e0 0x7f22700c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:31.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.550+0000 7f2267e00640 1 --2- 172.21.15.114:0/3606655115 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22700ce650 0x7f22700ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:31.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.550+0000 7f2275200640 1 -- 172.21.15.114:0/3606655115 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22700ce650 msgr2=0x7f22700ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:31.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.550+0000 7f2275200640 1 --2- 172.21.15.114:0/3606655115 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22700ce650 0x7f22700ae400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:31.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.550+0000 7f2275200640 1 -- 172.21.15.114:0/3606655115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22701602e0 msgr2=0x7f22700c4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:31.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.550+0000 7f2275200640 1 --2- 172.21.15.114:0/3606655115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22701602e0 0x7f22700c4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:31.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.550+0000 7f2275200640 1 -- 172.21.15.114:0/3606655115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2268009b30 con 0x7f227006e680 2024-09-13T17:53:31.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.550+0000 7f2275200640 1 --2- 172.21.15.114:0/3606655115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f227006e680 0x7f22701587a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f226000c4b0 tx=0x7f226000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:31.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.550+0000 7f226d600640 1 -- 172.21.15.114:0/3606655115 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2260012830 con 0x7f227006e680 2024-09-13T17:53:31.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.550+0000 7f226d600640 1 -- 172.21.15.114:0/3606655115 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22600129b0 con 0x7f227006e680 2024-09-13T17:53:31.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.550+0000 7f226d600640 1 -- 172.21.15.114:0/3606655115 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2260012d60 con 0x7f227006e680 2024-09-13T17:53:31.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.550+0000 7f2277c00640 1 -- 172.21.15.114:0/3606655115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22700c4450 con 0x7f227006e680 2024-09-13T17:53:31.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.550+0000 7f2277c00640 1 -- 172.21.15.114:0/3606655115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22700c69f0 con 0x7f227006e680 2024-09-13T17:53:31.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.550+0000 7f2277c00640 1 -- 172.21.15.114:0/3606655115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22700cffc0 con 0x7f227006e680 2024-09-13T17:53:31.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.554+0000 7f226d600640 1 -- 172.21.15.114:0/3606655115 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f226001c460 con 0x7f227006e680 2024-09-13T17:53:31.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.554+0000 7f226d600640 1 --2- 172.21.15.114:0/3606655115 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f224c066690 0x7f224c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:31.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.554+0000 7f226d600640 1 -- 172.21.15.114:0/3606655115 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f2260084d00 con 0x7f227006e680 2024-09-13T17:53:31.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.554+0000 7f2267e00640 1 --2- 172.21.15.114:0/3606655115 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f224c066690 0x7f224c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:31.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.554+0000 7f2267e00640 1 --2- 172.21.15.114:0/3606655115 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f224c066690 0x7f224c068b50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f22700b0a70 tx=0x7f2258008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:31.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.558+0000 7f226d600640 1 -- 172.21.15.114:0/3606655115 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2260051e60 con 0x7f227006e680 2024-09-13T17:53:31.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.710+0000 7f2277c00640 1 -- 172.21.15.114:0/3606655115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f227006eb10 con 0x7f227006e680 2024-09-13T17:53:31.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.714+0000 7f226d600640 1 -- 172.21.15.114:0/3606655115 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' already exists v46) v1 ==== 177+0+0 (secure 0 0 0) 0x7f2260055480 con 0x7f227006e680 2024-09-13T17:53:31.718 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' already exists 2024-09-13T17:53:31.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.714+0000 7f2277c00640 1 -- 172.21.15.114:0/3606655115 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f224c066690 msgr2=0x7f224c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:31.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.714+0000 7f2277c00640 1 --2- 172.21.15.114:0/3606655115 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f224c066690 0x7f224c068b50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f22700b0a70 tx=0x7f2258008040 comp rx=0 tx=0).stop 2024-09-13T17:53:31.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.714+0000 7f2277c00640 1 -- 172.21.15.114:0/3606655115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f227006e680 msgr2=0x7f22701587a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:31.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.714+0000 7f2277c00640 1 --2- 172.21.15.114:0/3606655115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f227006e680 0x7f22701587a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f226000c4b0 tx=0x7f226000c970 comp rx=0 tx=0).stop 2024-09-13T17:53:31.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.714+0000 7f2277c00640 1 -- 172.21.15.114:0/3606655115 shutdown_connections 2024-09-13T17:53:31.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.714+0000 7f2277c00640 1 --2- 172.21.15.114:0/3606655115 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f224c066690 0x7f224c068b50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:31.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.714+0000 7f2277c00640 1 --2- 172.21.15.114:0/3606655115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22701602e0 0x7f22700c4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:31.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.714+0000 7f2277c00640 1 --2- 172.21.15.114:0/3606655115 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f22700ce650 0x7f22700ae400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:31.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.714+0000 7f2277c00640 1 --2- 172.21.15.114:0/3606655115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f227006e680 0x7f22701587a0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:31.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.714+0000 7f2277c00640 1 -- 172.21.15.114:0/3606655115 >> 172.21.15.114:0/3606655115 conn(0x7f22700d04e0 msgr2=0x7f227006c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:31.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.714+0000 7f2277c00640 1 -- 172.21.15.114:0/3606655115 shutdown_connections 2024-09-13T17:53:31.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.714+0000 7f2277c00640 1 -- 172.21.15.114:0/3606655115 wait complete. 2024-09-13T17:53:31.740 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new recovery_fs recovery_fs_metadata cephfs_data --recover --allow-dangerous-metadata-overlay 2024-09-13T17:53:31.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.874+0000 7fc982000640 1 Processor -- start 2024-09-13T17:53:31.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.874+0000 7fc982000640 1 -- start start 2024-09-13T17:53:31.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.874+0000 7fc982000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc97c13c240 0x7fc97c13f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:31.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.874+0000 7fc982000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc97c13c980 0x7fc97c06d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:31.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.874+0000 7fc982000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc97c06da90 0x7fc97c0cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:31.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.874+0000 7fc982000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc97c06df40 con 0x7fc97c13c980 2024-09-13T17:53:31.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.874+0000 7fc982000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc97c0cd220 con 0x7fc97c13c240 2024-09-13T17:53:31.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.874+0000 7fc982000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c13f960 con 0x7fc97c06da90 2024-09-13T17:53:31.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.878+0000 7fc972a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc97c13c980 0x7fc97c06d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:31.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.878+0000 7fc972a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc97c13c980 0x7fc97c06d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43684/0 (socket says 172.21.15.114:43684) 2024-09-13T17:53:31.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.878+0000 7fc972a00640 1 -- 172.21.15.114:0/845399661 learned_addr learned my addr 172.21.15.114:0/845399661 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:31.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.878+0000 7fc97b400640 1 --2- 172.21.15.114:0/845399661 >> v2:172.21.15.134:3300/0 conn(0x7fc97c13c240 0x7fc97c13f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:31.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.878+0000 7fc97be00640 1 --2- 172.21.15.114:0/845399661 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc97c06da90 0x7fc97c0cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:31.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.878+0000 7fc972a00640 1 -- 172.21.15.114:0/845399661 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc97c06da90 msgr2=0x7fc97c0cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:31.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.878+0000 7fc972a00640 1 --2- 172.21.15.114:0/845399661 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc97c06da90 0x7fc97c0cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:31.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.878+0000 7fc972a00640 1 -- 172.21.15.114:0/845399661 >> v2:172.21.15.134:3300/0 conn(0x7fc97c13c240 msgr2=0x7fc97c13f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:31.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.878+0000 7fc972a00640 1 --2- 172.21.15.114:0/845399661 >> v2:172.21.15.134:3300/0 conn(0x7fc97c13c240 0x7fc97c13f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:31.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.878+0000 7fc972a00640 1 -- 172.21.15.114:0/845399661 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97c15a740 con 0x7fc97c13c980 2024-09-13T17:53:31.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.878+0000 7fc972a00640 1 --2- 172.21.15.114:0/845399661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc97c13c980 0x7fc97c06d550 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc97c06e720 tx=0x7fc96401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af09f02f2eca3b52 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:31.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.878+0000 7fc97aa00640 1 -- 172.21.15.114:0/845399661 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9640aa610 con 0x7fc97c13c980 2024-09-13T17:53:31.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.878+0000 7fc97aa00640 1 -- 172.21.15.114:0/845399661 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9640a6040 con 0x7fc97c13c980 2024-09-13T17:53:31.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.878+0000 7fc97aa00640 1 -- 172.21.15.114:0/845399661 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9640aa990 con 0x7fc97c13c980 2024-09-13T17:53:31.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.882+0000 7fc982000640 1 -- 172.21.15.114:0/845399661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc97c13c980 msgr2=0x7fc97c06d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:31.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.882+0000 7fc982000640 1 --2- 172.21.15.114:0/845399661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc97c13c980 0x7fc97c06d550 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc97c06e720 tx=0x7fc96401c4f0 comp rx=0 tx=0).stop 2024-09-13T17:53:31.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.882+0000 7fc982000640 1 -- 172.21.15.114:0/845399661 shutdown_connections 2024-09-13T17:53:31.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.882+0000 7fc982000640 1 --2- 172.21.15.114:0/845399661 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc97c06da90 0x7fc97c0cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:31.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.882+0000 7fc982000640 1 --2- 172.21.15.114:0/845399661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc97c13c980 0x7fc97c06d550 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:31.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.882+0000 7fc982000640 1 --2- 172.21.15.114:0/845399661 >> v2:172.21.15.134:3300/0 conn(0x7fc97c13c240 0x7fc97c13f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:31.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.882+0000 7fc982000640 1 -- 172.21.15.114:0/845399661 >> 172.21.15.114:0/845399661 conn(0x7fc97c0660b0 msgr2=0x7fc97c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:31.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.882+0000 7fc982000640 1 -- 172.21.15.114:0/845399661 shutdown_connections 2024-09-13T17:53:31.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.882+0000 7fc982000640 1 -- 172.21.15.114:0/845399661 wait complete. 2024-09-13T17:53:31.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.882+0000 7fc982000640 1 Processor -- start 2024-09-13T17:53:31.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.882+0000 7fc982000640 1 -- start start 2024-09-13T17:53:31.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.882+0000 7fc982000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc97c06da90 0x7fc97c0ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:31.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.882+0000 7fc982000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc97c13c240 0x7fc97c138de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:31.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.882+0000 7fc982000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc97c13c980 0x7fc97c0ad4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:31.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.882+0000 7fc982000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c0ad0d0 con 0x7fc97c13c240 2024-09-13T17:53:31.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.882+0000 7fc982000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c0ae6c0 con 0x7fc97c06da90 2024-09-13T17:53:31.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.882+0000 7fc982000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c0ac450 con 0x7fc97c13c980 2024-09-13T17:53:31.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.882+0000 7fc972a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc97c13c240 0x7fc97c138de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:31.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.882+0000 7fc972a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc97c13c240 0x7fc97c138de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43692/0 (socket says 172.21.15.114:43692) 2024-09-13T17:53:31.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.882+0000 7fc972a00640 1 -- 172.21.15.114:0/881773286 learned_addr learned my addr 172.21.15.114:0/881773286 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:31.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.882+0000 7fc97b400640 1 --2- 172.21.15.114:0/881773286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc97c06da90 0x7fc97c0ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:31.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.882+0000 7fc97be00640 1 --2- 172.21.15.114:0/881773286 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc97c13c980 0x7fc97c0ad4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:31.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.882+0000 7fc972a00640 1 -- 172.21.15.114:0/881773286 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc97c13c980 msgr2=0x7fc97c0ad4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:31.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.882+0000 7fc972a00640 1 --2- 172.21.15.114:0/881773286 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc97c13c980 0x7fc97c0ad4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:31.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.882+0000 7fc972a00640 1 -- 172.21.15.114:0/881773286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc97c06da90 msgr2=0x7fc97c0ae180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:31.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.882+0000 7fc972a00640 1 --2- 172.21.15.114:0/881773286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc97c06da90 0x7fc97c0ae180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:31.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.882+0000 7fc972a00640 1 -- 172.21.15.114:0/881773286 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9640094d0 con 0x7fc97c13c240 2024-09-13T17:53:31.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.882+0000 7fc972a00640 1 --2- 172.21.15.114:0/881773286 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc97c13c240 0x7fc97c138de0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc9640ac040 tx=0x7fc964019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:31.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.886+0000 7fc973e00640 1 -- 172.21.15.114:0/881773286 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9640bd5f0 con 0x7fc97c13c240 2024-09-13T17:53:31.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.886+0000 7fc973e00640 1 -- 172.21.15.114:0/881773286 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9640bd770 con 0x7fc97c13c240 2024-09-13T17:53:31.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.886+0000 7fc982000640 1 -- 172.21.15.114:0/881773286 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc97c15a230 con 0x7fc97c13c240 2024-09-13T17:53:31.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.886+0000 7fc973e00640 1 -- 172.21.15.114:0/881773286 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9640bdb20 con 0x7fc97c13c240 2024-09-13T17:53:31.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.886+0000 7fc982000640 1 -- 172.21.15.114:0/881773286 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc97c0aca10 con 0x7fc97c13c240 2024-09-13T17:53:31.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.886+0000 7fc982000640 1 -- 172.21.15.114:0/881773286 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc97c0ad210 con 0x7fc97c13c240 2024-09-13T17:53:31.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.886+0000 7fc973e00640 1 -- 172.21.15.114:0/881773286 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc9640b33f0 con 0x7fc97c13c240 2024-09-13T17:53:31.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.886+0000 7fc973e00640 1 --2- 172.21.15.114:0/881773286 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc9580666c0 0x7fc958068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:31.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.886+0000 7fc973e00640 1 -- 172.21.15.114:0/881773286 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6519+0+0 (secure 0 0 0) 0x7fc96411f4b0 con 0x7fc97c13c240 2024-09-13T17:53:31.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.886+0000 7fc97b400640 1 --2- 172.21.15.114:0/881773286 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc9580666c0 0x7fc958068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:31.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.886+0000 7fc97b400640 1 --2- 172.21.15.114:0/881773286 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc9580666c0 0x7fc958068b80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc96c003b90 tx=0x7fc96c0098d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:31.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:31.890+0000 7fc973e00640 1 -- 172.21.15.114:0/881773286 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc97c0ad210 con 0x7fc97c13c240 2024-09-13T17:53:32.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.078+0000 7fc982000640 1 -- 172.21.15.114:0/881773286 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "recovery_fs", "metadata": "recovery_fs_metadata", "data": "cephfs_data", "recover": true, "allow_dangerous_metadata_overlay": true} v 0) v1 -- 0x7fc97c0ad210 con 0x7fc97c13c240 2024-09-13T17:53:32.086 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-09-13T17:53:32.082+0000 7f67ad800640 -1 log_channel(cluster) log [ERR] : Health check update: 2 filesystems are offline (MDS_ALL_DOWN) 2024-09-13T17:53:32.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.090+0000 7fc973e00640 1 -- 172.21.15.114:0/881773286 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "recovery_fs", "metadata": "recovery_fs_metadata", "data": "cephfs_data", "recover": true, "allow_dangerous_metadata_overlay": true}]=0 new fs with metadata pool 7 and data pool 6 v21) v1 ==== 241+0+0 (secure 0 0 0) 0x7fc97c0ad210 con 0x7fc97c13c240 2024-09-13T17:53:32.095 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 7 and data pool 6 2024-09-13T17:53:32.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.094+0000 7fc982000640 1 -- 172.21.15.114:0/881773286 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc9580666c0 msgr2=0x7fc958068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:32.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.094+0000 7fc982000640 1 --2- 172.21.15.114:0/881773286 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc9580666c0 0x7fc958068b80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc96c003b90 tx=0x7fc96c0098d0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.094+0000 7fc982000640 1 -- 172.21.15.114:0/881773286 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc97c13c240 msgr2=0x7fc97c138de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:32.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.094+0000 7fc982000640 1 --2- 172.21.15.114:0/881773286 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc97c13c240 0x7fc97c138de0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc9640ac040 tx=0x7fc964019290 comp rx=0 tx=0).stop 2024-09-13T17:53:32.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.094+0000 7fc982000640 1 -- 172.21.15.114:0/881773286 shutdown_connections 2024-09-13T17:53:32.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.094+0000 7fc982000640 1 --2- 172.21.15.114:0/881773286 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc9580666c0 0x7fc958068b80 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.094+0000 7fc982000640 1 --2- 172.21.15.114:0/881773286 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc97c13c980 0x7fc97c0ad4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.094+0000 7fc982000640 1 --2- 172.21.15.114:0/881773286 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc97c13c240 0x7fc97c138de0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.094+0000 7fc982000640 1 --2- 172.21.15.114:0/881773286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc97c06da90 0x7fc97c0ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.094+0000 7fc982000640 1 -- 172.21.15.114:0/881773286 >> 172.21.15.114:0/881773286 conn(0x7fc97c0660b0 msgr2=0x7fc97c1578f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:32.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.098+0000 7fc982000640 1 -- 172.21.15.114:0/881773286 shutdown_connections 2024-09-13T17:53:32.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.098+0000 7fc982000640 1 -- 172.21.15.114:0/881773286 wait complete. 2024-09-13T17:53:32.129 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:53:32.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.258+0000 7f4f5b000640 1 Processor -- start 2024-09-13T17:53:32.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.262+0000 7f4f5b000640 1 -- start start 2024-09-13T17:53:32.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.262+0000 7f4f5b000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4f5415c7e0 0x7f4f54071890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:32.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.262+0000 7f4f5b000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f540aec90 con 0x7f4f54069f80 2024-09-13T17:53:32.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.262+0000 7f4f5b000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f5406a540 con 0x7f4f540af750 2024-09-13T17:53:32.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.262+0000 7f4f5b000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f5415cbc0 con 0x7f4f5415c7e0 2024-09-13T17:53:32.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.262+0000 7f4f59c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4f5415c7e0 0x7f4f54071890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:32.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.262+0000 7f4f59200640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4f54069f80 0x7f4f541608e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51062/0 (socket says 172.21.15.114:51062) 2024-09-13T17:53:32.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.262+0000 7f4f59200640 1 -- 172.21.15.114:0/1622875875 learned_addr learned my addr 172.21.15.114:0/1622875875 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:32.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.262+0000 7f4f59c00640 1 -- 172.21.15.114:0/1622875875 >> v1:172.21.15.134:6789/0 conn(0x7f4f540af750 legacy=0x7f4f540cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:32.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.262+0000 7f4f59c00640 1 -- 172.21.15.114:0/1622875875 >> v1:172.21.15.114:6789/0 conn(0x7f4f54069f80 legacy=0x7f4f541608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:32.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.262+0000 7f4f59c00640 1 -- 172.21.15.114:0/1622875875 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5406a820 con 0x7f4f5415c7e0 2024-09-13T17:53:32.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.262+0000 7f4f53e00640 1 -- 172.21.15.114:0/1622875875 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 192346127 0 0) 0x7f4f540aec90 con 0x7f4f54069f80 2024-09-13T17:53:32.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.266+0000 7f4f59c00640 1 --2- 172.21.15.114:0/1622875875 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f5415c7e0 0x7f4f54071890 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4f480097c0 tx=0x7f4f4801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e73b5ebc38b1d94 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:32.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.266+0000 7f4f53e00640 1 -- 172.21.15.114:0/1622875875 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f480a6040 con 0x7f4f5415c7e0 2024-09-13T17:53:32.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.266+0000 7f4f53e00640 1 -- 172.21.15.114:0/1622875875 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f480aa600 con 0x7f4f5415c7e0 2024-09-13T17:53:32.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.266+0000 7f4f53e00640 1 -- 172.21.15.114:0/1622875875 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f480aa990 con 0x7f4f5415c7e0 2024-09-13T17:53:32.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.266+0000 7f4f5b000640 1 -- 172.21.15.114:0/1622875875 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f5415c7e0 msgr2=0x7f4f54071890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:32.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.266+0000 7f4f5b000640 1 --2- 172.21.15.114:0/1622875875 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f5415c7e0 0x7f4f54071890 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4f480097c0 tx=0x7f4f4801c4a0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.266+0000 7f4f5b000640 1 -- 172.21.15.114:0/1622875875 shutdown_connections 2024-09-13T17:53:32.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.266+0000 7f4f5b000640 1 --2- 172.21.15.114:0/1622875875 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f5415c7e0 0x7f4f54071890 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.266+0000 7f4f5b000640 1 -- 172.21.15.114:0/1622875875 >> 172.21.15.114:0/1622875875 conn(0x7f4f540b4a30 msgr2=0x7f4f54098a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:32.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.266+0000 7f4f5b000640 1 -- 172.21.15.114:0/1622875875 shutdown_connections 2024-09-13T17:53:32.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.266+0000 7f4f5b000640 1 -- 172.21.15.114:0/1622875875 wait complete. 2024-09-13T17:53:32.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.266+0000 7f4f5b000640 1 Processor -- start 2024-09-13T17:53:32.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.266+0000 7f4f5b000640 1 -- start start 2024-09-13T17:53:32.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.270+0000 7f4f5b000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f54069f80 0x7f4f541540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:32.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.270+0000 7f4f5b000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f540af750 0x7f4f5414ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:32.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.270+0000 7f4f5b000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f5415c7e0 0x7f4f5414f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:32.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.270+0000 7f4f5b000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f54151340 con 0x7f4f54069f80 2024-09-13T17:53:32.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.270+0000 7f4f5b000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f54151620 con 0x7f4f540af750 2024-09-13T17:53:32.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.270+0000 7f4f5b000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f54151900 con 0x7f4f5415c7e0 2024-09-13T17:53:32.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.270+0000 7f4f59c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f54069f80 0x7f4f541540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:32.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.270+0000 7f4f59c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f54069f80 0x7f4f541540b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43712/0 (socket says 172.21.15.114:43712) 2024-09-13T17:53:32.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.270+0000 7f4f59c00640 1 -- 172.21.15.114:0/167163655 learned_addr learned my addr 172.21.15.114:0/167163655 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:32.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.270+0000 7f4f59c00640 1 -- 172.21.15.114:0/167163655 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f5415c7e0 msgr2=0x7f4f5414f390 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T17:53:32.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.270+0000 7f4f59c00640 1 --2- 172.21.15.114:0/167163655 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f5415c7e0 0x7f4f5414f390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.270+0000 7f4f59c00640 1 -- 172.21.15.114:0/167163655 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f540af750 msgr2=0x7f4f5414ee50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T17:53:32.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.270+0000 7f4f59c00640 1 --2- 172.21.15.114:0/167163655 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f540af750 0x7f4f5414ee50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.270+0000 7f4f59c00640 1 -- 172.21.15.114:0/167163655 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f48009420 con 0x7f4f54069f80 2024-09-13T17:53:32.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.270+0000 7f4f59c00640 1 --2- 172.21.15.114:0/167163655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f54069f80 0x7f4f541540b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4f480190b0 tx=0x7f4f4801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:32.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.270+0000 7f4f51600640 1 -- 172.21.15.114:0/167163655 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f480b3800 con 0x7f4f54069f80 2024-09-13T17:53:32.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.270+0000 7f4f51600640 1 -- 172.21.15.114:0/167163655 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f480b3960 con 0x7f4f54069f80 2024-09-13T17:53:32.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.270+0000 7f4f51600640 1 -- 172.21.15.114:0/167163655 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f480b3cd0 con 0x7f4f54069f80 2024-09-13T17:53:32.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.270+0000 7f4f5b000640 1 -- 172.21.15.114:0/167163655 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f540b00f0 con 0x7f4f54069f80 2024-09-13T17:53:32.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.270+0000 7f4f5b000640 1 -- 172.21.15.114:0/167163655 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f54151ec0 con 0x7f4f54069f80 2024-09-13T17:53:32.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.270+0000 7f4f5b000640 1 -- 172.21.15.114:0/167163655 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f54071890 con 0x7f4f54069f80 2024-09-13T17:53:32.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.270+0000 7f4f51600640 1 -- 172.21.15.114:0/167163655 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4f480b2380 con 0x7f4f54069f80 2024-09-13T17:53:32.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.274+0000 7f4f51600640 1 --2- 172.21.15.114:0/167163655 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4f34066690 0x7f4f34068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:32.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.274+0000 7f4f51600640 1 -- 172.21.15.114:0/167163655 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f4f4811e8e0 con 0x7f4f54069f80 2024-09-13T17:53:32.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.274+0000 7f4f59200640 1 --2- 172.21.15.114:0/167163655 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4f34066690 0x7f4f34068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:32.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.274+0000 7f4f59200640 1 --2- 172.21.15.114:0/167163655 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4f34066690 0x7f4f34068b50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4f40000c10 tx=0x7f4f400079d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:32.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.278+0000 7f4f51600640 1 -- 172.21.15.114:0/167163655 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4f480eb8c0 con 0x7f4f54069f80 2024-09-13T17:53:32.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.450+0000 7f4f5b000640 1 -- 172.21.15.114:0/167163655 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f54071630 con 0x7f4f54069f80 2024-09-13T17:53:32.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.450+0000 7f4f51600640 1 -- 172.21.15.114:0/167163655 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+18808 (secure 0 0 0) 0x7f4f480eeee0 con 0x7f4f54069f80 2024-09-13T17:53:32.457 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:32.457 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":47,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:53:32.085761+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:53:06.185439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:53:07.297633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2024-09-13T17:53:31.026998+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.35","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6835/1239035445":"2024-09-14T17:53:22.929223+0000","172.21.15.134:6833/1239035445":"2024-09-14T17:53:22.929223+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:53:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.454+0000 7f4f5b000640 1 -- 172.21.15.114:0/167163655 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4f34066690 msgr2=0x7f4f34068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.454+0000 7f4f5b000640 1 --2- 172.21.15.114:0/167163655 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4f34066690 0x7f4f34068b50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4f40000c10 tx=0x7f4f400079d0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.454+0000 7f4f5b000640 1 -- 172.21.15.114:0/167163655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f54069f80 msgr2=0x7f4f541540b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.454+0000 7f4f5b000640 1 --2- 172.21.15.114:0/167163655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f54069f80 0x7f4f541540b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4f480190b0 tx=0x7f4f4801ace0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.454+0000 7f4f5b000640 1 -- 172.21.15.114:0/167163655 shutdown_connections 2024-09-13T17:53:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.454+0000 7f4f5b000640 1 --2- 172.21.15.114:0/167163655 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4f34066690 0x7f4f34068b50 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.454+0000 7f4f5b000640 1 --2- 172.21.15.114:0/167163655 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f5415c7e0 0x7f4f5414f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.454+0000 7f4f5b000640 1 --2- 172.21.15.114:0/167163655 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f540af750 0x7f4f5414ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.454+0000 7f4f5b000640 1 --2- 172.21.15.114:0/167163655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f54069f80 0x7f4f541540b0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.454+0000 7f4f5b000640 1 -- 172.21.15.114:0/167163655 >> 172.21.15.114:0/167163655 conn(0x7f4f540b4a30 msgr2=0x7f4f5406ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:32.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.454+0000 7f4f5b000640 1 -- 172.21.15.114:0/167163655 shutdown_connections 2024-09-13T17:53:32.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.454+0000 7f4f5b000640 1 -- 172.21.15.114:0/167163655 wait complete. 2024-09-13T17:53:32.478 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:53:32.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.606+0000 7f4b57e00640 1 Processor -- start 2024-09-13T17:53:32.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.606+0000 7f4b57e00640 1 -- start start 2024-09-13T17:53:32.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.610+0000 7f4b57e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4b50158a70 0x7f4b50070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:32.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.610+0000 7f4b57e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b500b2490 con 0x7f4b500b1c20 2024-09-13T17:53:32.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.610+0000 7f4b57e00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b50158e50 con 0x7f4b50159be0 2024-09-13T17:53:32.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.610+0000 7f4b57e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b500b21b0 con 0x7f4b50158a70 2024-09-13T17:53:32.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.610+0000 7f4b55400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4b50158a70 0x7f4b50070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:32.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.610+0000 7f4b55e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4b500b1c20 0x7f4b500cc910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51070/0 (socket says 172.21.15.114:51070) 2024-09-13T17:53:32.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.610+0000 7f4b55e00640 1 -- 172.21.15.114:0/3666453658 learned_addr learned my addr 172.21.15.114:0/3666453658 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:32.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.610+0000 7f4b55400640 1 -- 172.21.15.114:0/3666453658 >> v1:172.21.15.134:6789/0 conn(0x7f4b50159be0 legacy=0x7f4b500b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:32.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.610+0000 7f4b55400640 1 -- 172.21.15.114:0/3666453658 >> v1:172.21.15.114:6789/0 conn(0x7f4b500b1c20 legacy=0x7f4b500cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:32.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.610+0000 7f4b55400640 1 -- 172.21.15.114:0/3666453658 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b50159100 con 0x7f4b50158a70 2024-09-13T17:53:32.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.610+0000 7f4b4fe00640 1 -- 172.21.15.114:0/3666453658 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 708860652 0 0) 0x7f4b500b2490 con 0x7f4b500b1c20 2024-09-13T17:53:32.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.614+0000 7f4b55400640 1 --2- 172.21.15.114:0/3666453658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b50158a70 0x7f4b50070cb0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f4b440097c0 tx=0x7f4b4401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=177b69387084ad92 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:32.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.614+0000 7f4b4fe00640 1 -- 172.21.15.114:0/3666453658 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b440ab600 con 0x7f4b50158a70 2024-09-13T17:53:32.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.614+0000 7f4b4fe00640 1 -- 172.21.15.114:0/3666453658 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b440a7050 con 0x7f4b50158a70 2024-09-13T17:53:32.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.614+0000 7f4b4fe00640 1 -- 172.21.15.114:0/3666453658 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b440ab980 con 0x7f4b50158a70 2024-09-13T17:53:32.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.614+0000 7f4b57e00640 1 -- 172.21.15.114:0/3666453658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b50158a70 msgr2=0x7f4b50070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:32.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.614+0000 7f4b57e00640 1 --2- 172.21.15.114:0/3666453658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b50158a70 0x7f4b50070cb0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f4b440097c0 tx=0x7f4b4401c3e0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.614+0000 7f4b57e00640 1 -- 172.21.15.114:0/3666453658 shutdown_connections 2024-09-13T17:53:32.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.614+0000 7f4b57e00640 1 --2- 172.21.15.114:0/3666453658 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b50158a70 0x7f4b50070cb0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.614+0000 7f4b57e00640 1 -- 172.21.15.114:0/3666453658 >> 172.21.15.114:0/3666453658 conn(0x7f4b500660b0 msgr2=0x7f4b50069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:32.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.614+0000 7f4b57e00640 1 -- 172.21.15.114:0/3666453658 shutdown_connections 2024-09-13T17:53:32.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.614+0000 7f4b57e00640 1 -- 172.21.15.114:0/3666453658 wait complete. 2024-09-13T17:53:32.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.614+0000 7f4b57e00640 1 Processor -- start 2024-09-13T17:53:32.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.614+0000 7f4b57e00640 1 -- start start 2024-09-13T17:53:32.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.614+0000 7f4b57e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b500b1c20 0x7f4b5014c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:32.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.614+0000 7f4b57e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b50158a70 0x7f4b501472a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:32.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.614+0000 7f4b57e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b50159be0 0x7f4b50148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:32.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.614+0000 7f4b57e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b50155df0 con 0x7f4b50159be0 2024-09-13T17:53:32.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.614+0000 7f4b57e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b50155960 con 0x7f4b500b1c20 2024-09-13T17:53:32.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.614+0000 7f4b57e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b50154db0 con 0x7f4b50158a70 2024-09-13T17:53:32.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.618+0000 7f4b55e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b50159be0 0x7f4b50148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:32.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.618+0000 7f4b55e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b50159be0 0x7f4b50148bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43728/0 (socket says 172.21.15.114:43728) 2024-09-13T17:53:32.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.618+0000 7f4b55e00640 1 -- 172.21.15.114:0/3219044276 learned_addr learned my addr 172.21.15.114:0/3219044276 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:32.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.618+0000 7f4b55400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b500b1c20 0x7f4b5014c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:32.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.618+0000 7f4b54a00640 1 --2- 172.21.15.114:0/3219044276 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b50158a70 0x7f4b501472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:32.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.618+0000 7f4b55e00640 1 -- 172.21.15.114:0/3219044276 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b50158a70 msgr2=0x7f4b501472a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:32.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.618+0000 7f4b55e00640 1 --2- 172.21.15.114:0/3219044276 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b50158a70 0x7f4b501472a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.618+0000 7f4b55e00640 1 -- 172.21.15.114:0/3219044276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b500b1c20 msgr2=0x7f4b5014c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:32.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.618+0000 7f4b55e00640 1 --2- 172.21.15.114:0/3219044276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b500b1c20 0x7f4b5014c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.618+0000 7f4b55e00640 1 -- 172.21.15.114:0/3219044276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b44009420 con 0x7f4b50159be0 2024-09-13T17:53:32.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.618+0000 7f4b55e00640 1 --2- 172.21.15.114:0/3219044276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b50159be0 0x7f4b50148bf0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4b4800c810 tx=0x7f4b4800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:32.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.618+0000 7f4b4d600640 1 -- 172.21.15.114:0/3219044276 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4800a640 con 0x7f4b50159be0 2024-09-13T17:53:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.618+0000 7f4b4d600640 1 -- 172.21.15.114:0/3219044276 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4800a7c0 con 0x7f4b50159be0 2024-09-13T17:53:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.618+0000 7f4b4d600640 1 -- 172.21.15.114:0/3219044276 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4800ab70 con 0x7f4b50159be0 2024-09-13T17:53:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.618+0000 7f4b57e00640 1 -- 172.21.15.114:0/3219044276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b50155030 con 0x7f4b50159be0 2024-09-13T17:53:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.618+0000 7f4b57e00640 1 -- 172.21.15.114:0/3219044276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b501555f0 con 0x7f4b50159be0 2024-09-13T17:53:32.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.618+0000 7f4b57e00640 1 -- 172.21.15.114:0/3219044276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b50155b10 con 0x7f4b50159be0 2024-09-13T17:53:32.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.618+0000 7f4b4d600640 1 -- 172.21.15.114:0/3219044276 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4b4800acd0 con 0x7f4b50159be0 2024-09-13T17:53:32.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.618+0000 7f4b4d600640 1 --2- 172.21.15.114:0/3219044276 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4b30066690 0x7f4b30068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:32.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.622+0000 7f4b4d600640 1 -- 172.21.15.114:0/3219044276 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f4b480838f0 con 0x7f4b50159be0 2024-09-13T17:53:32.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.622+0000 7f4b55400640 1 --2- 172.21.15.114:0/3219044276 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4b30066690 0x7f4b30068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:32.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.622+0000 7f4b55400640 1 --2- 172.21.15.114:0/3219044276 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4b30066690 0x7f4b30068b50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4b440ad000 tx=0x7f4b440a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:32.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.626+0000 7f4b4d600640 1 -- 172.21.15.114:0/3219044276 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4b50155b10 con 0x7f4b50159be0 2024-09-13T17:53:32.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.778+0000 7f4b57e00640 1 -- 172.21.15.114:0/3219044276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b50155b10 con 0x7f4b50159be0 2024-09-13T17:53:32.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.778+0000 7f4b4d600640 1 -- 172.21.15.114:0/3219044276 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+18808 (secure 0 0 0) 0x7f4b50155b10 con 0x7f4b50159be0 2024-09-13T17:53:32.785 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:32.785 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":47,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:53:32.085761+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:53:06.185439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:53:07.297633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2024-09-13T17:53:31.026998+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.35","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6835/1239035445":"2024-09-14T17:53:22.929223+0000","172.21.15.134:6833/1239035445":"2024-09-14T17:53:22.929223+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:53:32.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.782+0000 7f4b57e00640 1 -- 172.21.15.114:0/3219044276 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4b30066690 msgr2=0x7f4b30068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:32.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.782+0000 7f4b57e00640 1 --2- 172.21.15.114:0/3219044276 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4b30066690 0x7f4b30068b50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4b440ad000 tx=0x7f4b440a6000 comp rx=0 tx=0).stop 2024-09-13T17:53:32.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.782+0000 7f4b57e00640 1 -- 172.21.15.114:0/3219044276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b50159be0 msgr2=0x7f4b50148bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:32.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.782+0000 7f4b57e00640 1 --2- 172.21.15.114:0/3219044276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b50159be0 0x7f4b50148bf0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4b4800c810 tx=0x7f4b4800ccd0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.782+0000 7f4b57e00640 1 -- 172.21.15.114:0/3219044276 shutdown_connections 2024-09-13T17:53:32.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.782+0000 7f4b57e00640 1 --2- 172.21.15.114:0/3219044276 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4b30066690 0x7f4b30068b50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.782+0000 7f4b57e00640 1 --2- 172.21.15.114:0/3219044276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b50159be0 0x7f4b50148bf0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.782+0000 7f4b57e00640 1 --2- 172.21.15.114:0/3219044276 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4b50158a70 0x7f4b501472a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.782+0000 7f4b57e00640 1 --2- 172.21.15.114:0/3219044276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b500b1c20 0x7f4b5014c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.782+0000 7f4b57e00640 1 -- 172.21.15.114:0/3219044276 >> 172.21.15.114:0/3219044276 conn(0x7f4b500660b0 msgr2=0x7f4b5006c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:32.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.782+0000 7f4b57e00640 1 -- 172.21.15.114:0/3219044276 shutdown_connections 2024-09-13T17:53:32.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.782+0000 7f4b57e00640 1 -- 172.21.15.114:0/3219044276 wait complete. 2024-09-13T17:53:32.806 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set recovery_fs standby_count_wanted 0 2024-09-13T17:53:32.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.938+0000 7f1fd5e00640 1 Processor -- start 2024-09-13T17:53:32.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.938+0000 7f1fd5e00640 1 -- start start 2024-09-13T17:53:32.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.938+0000 7f1fd5e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1fd0151420 0x7f1fd00cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:32.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.938+0000 7f1fd5e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1fd00ccba0 0x7f1fd0070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:32.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.938+0000 7f1fd5e00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd0151800 con 0x7f1fd0070960 2024-09-13T17:53:32.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.938+0000 7f1fd5e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd00cbc30 con 0x7f1fd0151420 2024-09-13T17:53:32.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.938+0000 7f1fd5e00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd0070d80 con 0x7f1fd00ccba0 2024-09-13T17:53:32.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.938+0000 7f1fcea00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1fd0151420 0x7f1fd00cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:32.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.938+0000 7f1fcea00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1fd0151420 0x7f1fd00cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43744/0 (socket says 172.21.15.114:43744) 2024-09-13T17:53:32.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.938+0000 7f1fcea00640 1 -- 172.21.15.114:0/1420322762 learned_addr learned my addr 172.21.15.114:0/1420322762 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:32.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.938+0000 7f1fc6000640 1 --2- 172.21.15.114:0/1420322762 >> v2:172.21.15.134:3300/0 conn(0x7f1fd00ccba0 0x7f1fd0070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:32.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.938+0000 7f1fcea00640 1 -- 172.21.15.114:0/1420322762 >> v2:172.21.15.134:3300/0 conn(0x7f1fd00ccba0 msgr2=0x7f1fd0070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:32.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.938+0000 7f1fcea00640 1 --2- 172.21.15.114:0/1420322762 >> v2:172.21.15.134:3300/0 conn(0x7f1fd00ccba0 0x7f1fd0070420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.938+0000 7f1fcea00640 1 -- 172.21.15.114:0/1420322762 >> v1:172.21.15.134:6789/0 conn(0x7f1fd0070960 legacy=0x7f1fd015df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:32.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.938+0000 7f1fcea00640 1 -- 172.21.15.114:0/1420322762 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd00cafb0 con 0x7f1fd0151420 2024-09-13T17:53:32.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.942+0000 7f1fcea00640 1 --2- 172.21.15.114:0/1420322762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fd0151420 0x7f1fd00cc660 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f1fd006dbc0 tx=0x7f1fc001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842dece3b5813763 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:32.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.942+0000 7f1fce000640 1 -- 172.21.15.114:0/1420322762 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc00a5760 con 0x7f1fd0151420 2024-09-13T17:53:32.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.942+0000 7f1fce000640 1 -- 172.21.15.114:0/1420322762 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc00a58c0 con 0x7f1fd0151420 2024-09-13T17:53:32.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.942+0000 7f1fce000640 1 -- 172.21.15.114:0/1420322762 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc00a5c50 con 0x7f1fd0151420 2024-09-13T17:53:32.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.942+0000 7f1fd5e00640 1 -- 172.21.15.114:0/1420322762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fd0151420 msgr2=0x7f1fd00cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:32.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.942+0000 7f1fd5e00640 1 --2- 172.21.15.114:0/1420322762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fd0151420 0x7f1fd00cc660 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f1fd006dbc0 tx=0x7f1fc001c8a0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.942+0000 7f1fd5e00640 1 -- 172.21.15.114:0/1420322762 shutdown_connections 2024-09-13T17:53:32.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.942+0000 7f1fd5e00640 1 --2- 172.21.15.114:0/1420322762 >> v2:172.21.15.134:3300/0 conn(0x7f1fd00ccba0 0x7f1fd0070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.942+0000 7f1fd5e00640 1 --2- 172.21.15.114:0/1420322762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fd0151420 0x7f1fd00cc660 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.942+0000 7f1fd5e00640 1 -- 172.21.15.114:0/1420322762 >> 172.21.15.114:0/1420322762 conn(0x7f1fd00660b0 msgr2=0x7f1fd0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:32.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.942+0000 7f1fd5e00640 1 -- 172.21.15.114:0/1420322762 shutdown_connections 2024-09-13T17:53:32.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.942+0000 7f1fd5e00640 1 -- 172.21.15.114:0/1420322762 wait complete. 2024-09-13T17:53:32.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.942+0000 7f1fd5e00640 1 Processor -- start 2024-09-13T17:53:32.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.942+0000 7f1fd5e00640 1 -- start start 2024-09-13T17:53:32.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.946+0000 7f1fd5e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1fd0070960 0x7f1fd00ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:32.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.946+0000 7f1fd5e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fd00ccba0 0x7f1fd0163440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:32.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.946+0000 7f1fd5e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fd0151420 0x7f1fd0163980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:32.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.946+0000 7f1fd5e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd00aea30 con 0x7f1fd00ccba0 2024-09-13T17:53:32.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.946+0000 7f1fd5e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd014c830 con 0x7f1fd0151420 2024-09-13T17:53:32.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.946+0000 7f1fd5e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd00b0dc0 con 0x7f1fd0070960 2024-09-13T17:53:32.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.946+0000 7f1fc6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fd00ccba0 0x7f1fd0163440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:32.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.946+0000 7f1fc6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fd00ccba0 0x7f1fd0163440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43752/0 (socket says 172.21.15.114:43752) 2024-09-13T17:53:32.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.946+0000 7f1fc6000640 1 -- 172.21.15.114:0/1863735915 learned_addr learned my addr 172.21.15.114:0/1863735915 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:32.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.946+0000 7f1fcf400640 1 --2- 172.21.15.114:0/1863735915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fd0151420 0x7f1fd0163980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:32.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.946+0000 7f1fc6000640 1 -- 172.21.15.114:0/1863735915 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1fd0070960 msgr2=0x7f1fd00ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:32.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.946+0000 7f1fc6000640 1 --2- 172.21.15.114:0/1863735915 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1fd0070960 0x7f1fd00ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.946+0000 7f1fc6000640 1 -- 172.21.15.114:0/1863735915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fd0151420 msgr2=0x7f1fd0163980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:32.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.946+0000 7f1fc6000640 1 --2- 172.21.15.114:0/1863735915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fd0151420 0x7f1fd0163980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:32.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.946+0000 7f1fc6000640 1 -- 172.21.15.114:0/1863735915 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc0009b30 con 0x7f1fd00ccba0 2024-09-13T17:53:32.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.946+0000 7f1fcf400640 1 --2- 172.21.15.114:0/1863735915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fd0151420 0x7f1fd0163980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:32.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.946+0000 7f1fc6000640 1 --2- 172.21.15.114:0/1863735915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fd00ccba0 0x7f1fd0163440 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f1fb800d5f0 tx=0x7f1fb800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:32.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.946+0000 7f1fc7e00640 1 -- 172.21.15.114:0/1863735915 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb80125f0 con 0x7f1fd00ccba0 2024-09-13T17:53:32.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.946+0000 7f1fc7e00640 1 -- 172.21.15.114:0/1863735915 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb8012750 con 0x7f1fd00ccba0 2024-09-13T17:53:32.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.946+0000 7f1fc7e00640 1 -- 172.21.15.114:0/1863735915 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8012ae0 con 0x7f1fd00ccba0 2024-09-13T17:53:32.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.946+0000 7f1fd5e00640 1 -- 172.21.15.114:0/1863735915 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd014ca80 con 0x7f1fd00ccba0 2024-09-13T17:53:32.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.946+0000 7f1fd5e00640 1 -- 172.21.15.114:0/1863735915 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd014d040 con 0x7f1fd00ccba0 2024-09-13T17:53:32.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.946+0000 7f1fd5e00640 1 -- 172.21.15.114:0/1863735915 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd0070400 con 0x7f1fd00ccba0 2024-09-13T17:53:32.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.946+0000 7f1fc7e00640 1 -- 172.21.15.114:0/1863735915 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1fb8012c40 con 0x7f1fd00ccba0 2024-09-13T17:53:32.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.950+0000 7f1fc7e00640 1 --2- 172.21.15.114:0/1863735915 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1fac066690 0x7f1fac068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:32.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.950+0000 7f1fc7e00640 1 -- 172.21.15.114:0/1863735915 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f1fb8084900 con 0x7f1fd00ccba0 2024-09-13T17:53:32.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.950+0000 7f1fcea00640 1 --2- 172.21.15.114:0/1863735915 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1fac066690 0x7f1fac068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:32.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.950+0000 7f1fcea00640 1 --2- 172.21.15.114:0/1863735915 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1fac066690 0x7f1fac068b50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1fc00ae000 tx=0x7f1fc0004ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:32.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:32.954+0000 7f1fc7e00640 1 -- 172.21.15.114:0/1863735915 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1fb8051980 con 0x7f1fd00ccba0 2024-09-13T17:53:33.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:33.142+0000 7f1fd5e00640 1 -- 172.21.15.114:0/1863735915 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "recovery_fs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1fd006a450 con 0x7f1fd00ccba0 2024-09-13T17:53:34.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.090+0000 7f1fc7e00640 1 -- 172.21.15.114:0/1863735915 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "recovery_fs", "var": "standby_count_wanted", "val": "0"}]=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7f1fb8007380 con 0x7f1fd00ccba0 2024-09-13T17:53:34.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.090+0000 7f1fd5e00640 1 -- 172.21.15.114:0/1863735915 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1fac066690 msgr2=0x7f1fac068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:34.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.090+0000 7f1fd5e00640 1 --2- 172.21.15.114:0/1863735915 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1fac066690 0x7f1fac068b50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1fc00ae000 tx=0x7f1fc0004ac0 comp rx=0 tx=0).stop 2024-09-13T17:53:34.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.090+0000 7f1fd5e00640 1 -- 172.21.15.114:0/1863735915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fd00ccba0 msgr2=0x7f1fd0163440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:34.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.090+0000 7f1fd5e00640 1 --2- 172.21.15.114:0/1863735915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fd00ccba0 0x7f1fd0163440 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f1fb800d5f0 tx=0x7f1fb800dab0 comp rx=0 tx=0).stop 2024-09-13T17:53:34.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.090+0000 7f1fd5e00640 1 -- 172.21.15.114:0/1863735915 shutdown_connections 2024-09-13T17:53:34.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.090+0000 7f1fd5e00640 1 --2- 172.21.15.114:0/1863735915 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f1fac066690 0x7f1fac068b50 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:34.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.090+0000 7f1fd5e00640 1 --2- 172.21.15.114:0/1863735915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fd0151420 0x7f1fd0163980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:34.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.090+0000 7f1fd5e00640 1 --2- 172.21.15.114:0/1863735915 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fd00ccba0 0x7f1fd0163440 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:34.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.090+0000 7f1fd5e00640 1 --2- 172.21.15.114:0/1863735915 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1fd0070960 0x7f1fd00ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:34.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.090+0000 7f1fd5e00640 1 -- 172.21.15.114:0/1863735915 >> 172.21.15.114:0/1863735915 conn(0x7f1fd00660b0 msgr2=0x7f1fd015a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:34.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.094+0000 7f1fd5e00640 1 -- 172.21.15.114:0/1863735915 shutdown_connections 2024-09-13T17:53:34.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.094+0000 7f1fd5e00640 1 -- 172.21.15.114:0/1863735915 wait complete. 2024-09-13T17:53:34.120 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T17:53:34.121 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set recovery_fs allow_standby_replay false 2024-09-13T17:53:34.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.254+0000 7f5492e00640 1 Processor -- start 2024-09-13T17:53:34.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.254+0000 7f5492e00640 1 -- start start 2024-09-13T17:53:34.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f5492e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f548c13c240 0x7f548c13f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:34.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f5492e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f548c0cd220 con 0x7f548c06dc60 2024-09-13T17:53:34.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f5492e00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f548c13f960 con 0x7f548c13c980 2024-09-13T17:53:34.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f5492e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548c15a740 con 0x7f548c13c240 2024-09-13T17:53:34.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f5490e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f548c06dc60 0x7f548c0cd650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51074/0 (socket says 172.21.15.114:51074) 2024-09-13T17:53:34.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f5490e00640 1 -- 172.21.15.114:0/1827109543 learned_addr learned my addr 172.21.15.114:0/1827109543 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f548be00640 1 --2- 172.21.15.114:0/1827109543 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f548c13c240 0x7f548c13f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f548aa00640 1 -- 172.21.15.114:0/1827109543 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 668796617 0 0) 0x7f548c0cd220 con 0x7f548c06dc60 2024-09-13T17:53:34.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f548aa00640 1 -- 172.21.15.114:0/1827109543 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5470003530 con 0x7f548c06dc60 2024-09-13T17:53:34.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f548aa00640 1 -- 172.21.15.114:0/1827109543 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3202504802 0 0) 0x7f5470003530 con 0x7f548c06dc60 2024-09-13T17:53:34.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f548aa00640 1 -- 172.21.15.114:0/1827109543 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f548c13c240 msgr2=0x7f548c13f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:34.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f548aa00640 1 --2- 172.21.15.114:0/1827109543 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f548c13c240 0x7f548c13f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:34.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f548aa00640 1 -- 172.21.15.114:0/1827109543 >> v1:172.21.15.134:6789/0 conn(0x7f548c13c980 legacy=0x7f548c06d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:34.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f548aa00640 1 -- 172.21.15.114:0/1827109543 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c159bc0 con 0x7f548c06dc60 2024-09-13T17:53:34.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f548aa00640 1 -- 172.21.15.114:0/1827109543 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7f5484001a00 con 0x7f548c06dc60 2024-09-13T17:53:34.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f548aa00640 1 -- 172.21.15.114:0/1827109543 >> v1:172.21.15.114:6789/0 conn(0x7f548c06dc60 legacy=0x7f548c0cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:34.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f548aa00640 1 --2- 172.21.15.114:0/1827109543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54700039b0 0x7f5470003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:34.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f548aa00640 1 --2- 172.21.15.114:0/1827109543 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f548c13c240 0x7f54700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:34.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f548aa00640 1 --2- 172.21.15.114:0/1827109543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5470004d10 0x7f5470005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:34.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f548aa00640 1 -- 172.21.15.114:0/1827109543 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c15a740 con 0x7f5470004d10 2024-09-13T17:53:34.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f548aa00640 1 -- 172.21.15.114:0/1827109543 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547000ba40 con 0x7f54700039b0 2024-09-13T17:53:34.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f548aa00640 1 -- 172.21.15.114:0/1827109543 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547000de10 con 0x7f548c13c240 2024-09-13T17:53:34.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f5490e00640 1 --2- 172.21.15.114:0/1827109543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5470004d10 0x7f5470005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:34.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f548be00640 1 --2- 172.21.15.114:0/1827109543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54700039b0 0x7f5470003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:34.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f548b400640 1 --2- 172.21.15.114:0/1827109543 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f548c13c240 0x7f54700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:34.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f5490e00640 1 -- 172.21.15.114:0/1827109543 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f548c13c240 msgr2=0x7f54700047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:34.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f5490e00640 1 --2- 172.21.15.114:0/1827109543 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f548c13c240 0x7f54700047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:34.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f5490e00640 1 -- 172.21.15.114:0/1827109543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54700039b0 msgr2=0x7f5470003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:34.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f5490e00640 1 --2- 172.21.15.114:0/1827109543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54700039b0 0x7f5470003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:34.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.258+0000 7f5490e00640 1 -- 172.21.15.114:0/1827109543 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5470003530 con 0x7f5470004d10 2024-09-13T17:53:34.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.262+0000 7f5490e00640 1 --2- 172.21.15.114:0/1827109543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5470004d10 0x7f5470005190 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f548400a800 tx=0x7f548401d320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169dad7bb95af2b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:34.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.262+0000 7f548aa00640 1 -- 172.21.15.114:0/1827109543 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54840072d0 con 0x7f5470004d10 2024-09-13T17:53:34.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.262+0000 7f548aa00640 1 -- 172.21.15.114:0/1827109543 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54840a8070 con 0x7f5470004d10 2024-09-13T17:53:34.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.262+0000 7f548aa00640 1 -- 172.21.15.114:0/1827109543 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5484007690 con 0x7f5470004d10 2024-09-13T17:53:34.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.262+0000 7f5492e00640 1 -- 172.21.15.114:0/1827109543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5470004d10 msgr2=0x7f5470005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:34.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.262+0000 7f5492e00640 1 --2- 172.21.15.114:0/1827109543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5470004d10 0x7f5470005190 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f548400a800 tx=0x7f548401d320 comp rx=0 tx=0).stop 2024-09-13T17:53:34.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.262+0000 7f5490e00640 1 -- 172.21.15.114:0/1827109543 reap_dead start 2024-09-13T17:53:34.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.262+0000 7f5492e00640 1 -- 172.21.15.114:0/1827109543 shutdown_connections 2024-09-13T17:53:34.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.262+0000 7f5492e00640 1 -- 172.21.15.114:0/1827109543 >> 172.21.15.114:0/1827109543 conn(0x7f548c0660b0 msgr2=0x7f548c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:34.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.262+0000 7f5492e00640 1 -- 172.21.15.114:0/1827109543 shutdown_connections 2024-09-13T17:53:34.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.262+0000 7f5492e00640 1 -- 172.21.15.114:0/1827109543 wait complete. 2024-09-13T17:53:34.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.266+0000 7f5492e00640 1 Processor -- start 2024-09-13T17:53:34.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.266+0000 7f5492e00640 1 -- start start 2024-09-13T17:53:34.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.266+0000 7f5492e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5470004d10 0x7f548c1eeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:34.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.266+0000 7f5492e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f548c1edb20 0x7f548c1f1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:34.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.266+0000 7f5492e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f548c0ca400 0x7f548c15bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:34.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.266+0000 7f5492e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c1e1e30 con 0x7f548c0ca400 2024-09-13T17:53:34.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.266+0000 7f5492e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c1f18c0 con 0x7f548c1edb20 2024-09-13T17:53:34.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.266+0000 7f5492e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548c1f1ba0 con 0x7f5470004d10 2024-09-13T17:53:34.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.266+0000 7f5490e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f548c0ca400 0x7f548c15bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:34.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.266+0000 7f5490e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f548c0ca400 0x7f548c15bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43768/0 (socket says 172.21.15.114:43768) 2024-09-13T17:53:34.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.266+0000 7f5490e00640 1 -- 172.21.15.114:0/1305641142 learned_addr learned my addr 172.21.15.114:0/1305641142 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:34.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.266+0000 7f548b400640 1 --2- 172.21.15.114:0/1305641142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f548c1edb20 0x7f548c1f1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:34.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.266+0000 7f548be00640 1 --2- 172.21.15.114:0/1305641142 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5470004d10 0x7f548c1eeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:34.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.266+0000 7f5490e00640 1 -- 172.21.15.114:0/1305641142 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5470004d10 msgr2=0x7f548c1eeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:34.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.266+0000 7f5490e00640 1 --2- 172.21.15.114:0/1305641142 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5470004d10 0x7f548c1eeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:34.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.266+0000 7f5490e00640 1 -- 172.21.15.114:0/1305641142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f548c1edb20 msgr2=0x7f548c1f1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:34.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.266+0000 7f5490e00640 1 --2- 172.21.15.114:0/1305641142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f548c1edb20 0x7f548c1f1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:34.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.266+0000 7f5490e00640 1 -- 172.21.15.114:0/1305641142 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c1f1e80 con 0x7f548c0ca400 2024-09-13T17:53:34.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.266+0000 7f548be00640 1 --2- 172.21.15.114:0/1305641142 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5470004d10 0x7f548c1eeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:34.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.266+0000 7f5490e00640 1 --2- 172.21.15.114:0/1305641142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f548c0ca400 0x7f548c15bdc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f548401d150 tx=0x7f5470005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:34.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.266+0000 7f5483e00640 1 -- 172.21.15.114:0/1305641142 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54840011d0 con 0x7f548c0ca400 2024-09-13T17:53:34.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.266+0000 7f5483e00640 1 -- 172.21.15.114:0/1305641142 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54840017c0 con 0x7f548c0ca400 2024-09-13T17:53:34.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.266+0000 7f5483e00640 1 -- 172.21.15.114:0/1305641142 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5484004b70 con 0x7f548c0ca400 2024-09-13T17:53:34.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.266+0000 7f5492e00640 1 -- 172.21.15.114:0/1305641142 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548c1e1ac0 con 0x7f548c0ca400 2024-09-13T17:53:34.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.266+0000 7f5492e00640 1 -- 172.21.15.114:0/1305641142 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548c0ca880 con 0x7f548c0ca400 2024-09-13T17:53:34.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.266+0000 7f5492e00640 1 -- 172.21.15.114:0/1305641142 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f548c0caa70 con 0x7f548c0ca400 2024-09-13T17:53:34.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.270+0000 7f5483e00640 1 -- 172.21.15.114:0/1305641142 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f54840aa030 con 0x7f548c0ca400 2024-09-13T17:53:34.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.270+0000 7f5483e00640 1 --2- 172.21.15.114:0/1305641142 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f546c0666c0 0x7f546c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:34.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.270+0000 7f5483e00640 1 -- 172.21.15.114:0/1305641142 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f548411d150 con 0x7f548c0ca400 2024-09-13T17:53:34.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.270+0000 7f548be00640 1 --2- 172.21.15.114:0/1305641142 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f546c0666c0 0x7f546c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:34.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.270+0000 7f548be00640 1 --2- 172.21.15.114:0/1305641142 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f546c0666c0 0x7f546c068b80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f548c1eb5a0 tx=0x7f547c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:34.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.274+0000 7f5483e00640 1 -- 172.21.15.114:0/1305641142 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f548c0caa70 con 0x7f548c0ca400 2024-09-13T17:53:34.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:34.462+0000 7f5492e00640 1 -- 172.21.15.114:0/1305641142 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "recovery_fs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f548c0caa70 con 0x7f548c0ca400 2024-09-13T17:53:35.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.386+0000 7f5483e00640 1 -- 172.21.15.114:0/1305641142 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "recovery_fs", "var": "allow_standby_replay", "val": "false"}]=0 v23) v1 ==== 127+0+0 (secure 0 0 0) 0x7f548c0caa70 con 0x7f548c0ca400 2024-09-13T17:53:35.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.390+0000 7f5492e00640 1 -- 172.21.15.114:0/1305641142 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f546c0666c0 msgr2=0x7f546c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:35.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.390+0000 7f5492e00640 1 --2- 172.21.15.114:0/1305641142 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f546c0666c0 0x7f546c068b80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f548c1eb5a0 tx=0x7f547c008040 comp rx=0 tx=0).stop 2024-09-13T17:53:35.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.390+0000 7f5492e00640 1 -- 172.21.15.114:0/1305641142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f548c0ca400 msgr2=0x7f548c15bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:35.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.390+0000 7f5492e00640 1 --2- 172.21.15.114:0/1305641142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f548c0ca400 0x7f548c15bdc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f548401d150 tx=0x7f5470005800 comp rx=0 tx=0).stop 2024-09-13T17:53:35.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.390+0000 7f5492e00640 1 -- 172.21.15.114:0/1305641142 shutdown_connections 2024-09-13T17:53:35.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.390+0000 7f5492e00640 1 --2- 172.21.15.114:0/1305641142 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f546c0666c0 0x7f546c068b80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:35.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.390+0000 7f5492e00640 1 --2- 172.21.15.114:0/1305641142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f548c0ca400 0x7f548c15bdc0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:35.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.390+0000 7f5492e00640 1 --2- 172.21.15.114:0/1305641142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f548c1edb20 0x7f548c1f1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:35.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.390+0000 7f5492e00640 1 --2- 172.21.15.114:0/1305641142 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f5470004d10 0x7f548c1eeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:35.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.390+0000 7f5492e00640 1 -- 172.21.15.114:0/1305641142 >> 172.21.15.114:0/1305641142 conn(0x7f548c0660b0 msgr2=0x7f548c0cdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:35.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.390+0000 7f5492e00640 1 -- 172.21.15.114:0/1305641142 shutdown_connections 2024-09-13T17:53:35.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.390+0000 7f5492e00640 1 -- 172.21.15.114:0/1305641142 wait complete. 2024-09-13T17:53:35.417 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'recovery_fs' 2024-09-13T17:53:35.418 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:53:35.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.554+0000 7f61baa00640 1 Processor -- start 2024-09-13T17:53:35.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.554+0000 7f61baa00640 1 -- start start 2024-09-13T17:53:35.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.554+0000 7f61baa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f61b415c880 0x7f61b40d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:35.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.554+0000 7f61baa00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61b40ca980 con 0x7f61b406bfc0 2024-09-13T17:53:35.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.554+0000 7f61baa00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61b406c450 con 0x7f61b4099180 2024-09-13T17:53:35.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.554+0000 7f61baa00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b415cc60 con 0x7f61b415c880 2024-09-13T17:53:35.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.554+0000 7f61b8c00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f61b406bfc0 0x7f61b4098a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51090/0 (socket says 172.21.15.114:51090) 2024-09-13T17:53:35.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.554+0000 7f61b8c00640 1 -- 172.21.15.114:0/2621210282 learned_addr learned my addr 172.21.15.114:0/2621210282 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:35.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.554+0000 7f61b9600640 1 --2- 172.21.15.114:0/2621210282 >> v2:172.21.15.114:3300/0 conn(0x7f61b415c880 0x7f61b40d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:35.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.554+0000 7f61b3e00640 1 -- 172.21.15.114:0/2621210282 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055430778 0 0) 0x7f61b40ca980 con 0x7f61b406bfc0 2024-09-13T17:53:35.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.554+0000 7f61b9600640 1 -- 172.21.15.114:0/2621210282 >> v1:172.21.15.134:6789/0 conn(0x7f61b4099180 legacy=0x7f61b40cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:35.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.554+0000 7f61b9600640 1 -- 172.21.15.114:0/2621210282 >> v1:172.21.15.114:6789/0 conn(0x7f61b406bfc0 legacy=0x7f61b4098a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:35.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.554+0000 7f61b9600640 1 -- 172.21.15.114:0/2621210282 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b406c730 con 0x7f61b415c880 2024-09-13T17:53:35.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.558+0000 7f61b9600640 1 --2- 172.21.15.114:0/2621210282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b415c880 0x7f61b40d0e50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f61a80097c0 tx=0x7f61a801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc9fb4883f8ed7a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:35.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.558+0000 7f61b3e00640 1 -- 172.21.15.114:0/2621210282 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a80ac640 con 0x7f61b415c880 2024-09-13T17:53:35.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.558+0000 7f61b3e00640 1 -- 172.21.15.114:0/2621210282 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a80ac7a0 con 0x7f61b415c880 2024-09-13T17:53:35.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.558+0000 7f61b3e00640 1 -- 172.21.15.114:0/2621210282 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a80acb30 con 0x7f61b415c880 2024-09-13T17:53:35.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.558+0000 7f61baa00640 1 -- 172.21.15.114:0/2621210282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b415c880 msgr2=0x7f61b40d0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:35.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.558+0000 7f61baa00640 1 --2- 172.21.15.114:0/2621210282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b415c880 0x7f61b40d0e50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f61a80097c0 tx=0x7f61a801c3e0 comp rx=0 tx=0).stop 2024-09-13T17:53:35.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.558+0000 7f61baa00640 1 -- 172.21.15.114:0/2621210282 shutdown_connections 2024-09-13T17:53:35.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.558+0000 7f61baa00640 1 --2- 172.21.15.114:0/2621210282 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b415c880 0x7f61b40d0e50 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:35.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.558+0000 7f61baa00640 1 -- 172.21.15.114:0/2621210282 >> 172.21.15.114:0/2621210282 conn(0x7f61b40d0330 msgr2=0x7f61b40d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:35.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.558+0000 7f61baa00640 1 -- 172.21.15.114:0/2621210282 shutdown_connections 2024-09-13T17:53:35.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.558+0000 7f61baa00640 1 -- 172.21.15.114:0/2621210282 wait complete. 2024-09-13T17:53:35.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.558+0000 7f61baa00640 1 Processor -- start 2024-09-13T17:53:35.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.558+0000 7f61baa00640 1 -- start start 2024-09-13T17:53:35.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.562+0000 7f61baa00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61b4099180 0x7f61b41586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:35.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.562+0000 7f61baa00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61b415c880 0x7f61b40b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:35.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.562+0000 7f61baa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b414c620 0x7f61b414cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:35.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.562+0000 7f61baa00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b414d010 con 0x7f61b414c620 2024-09-13T17:53:35.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.562+0000 7f61baa00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b40c95a0 con 0x7f61b415c880 2024-09-13T17:53:35.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.562+0000 7f61baa00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b40c9880 con 0x7f61b4099180 2024-09-13T17:53:35.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.562+0000 7f61ba000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b414c620 0x7f61b414cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:35.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.562+0000 7f61ba000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b414c620 0x7f61b414cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43782/0 (socket says 172.21.15.114:43782) 2024-09-13T17:53:35.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.562+0000 7f61ba000640 1 -- 172.21.15.114:0/2968480931 learned_addr learned my addr 172.21.15.114:0/2968480931 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:35.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.562+0000 7f61b9600640 1 --2- 172.21.15.114:0/2968480931 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61b4099180 0x7f61b41586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:35.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.562+0000 7f61b8c00640 1 --2- 172.21.15.114:0/2968480931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61b415c880 0x7f61b40b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:35.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.562+0000 7f61ba000640 1 -- 172.21.15.114:0/2968480931 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61b4099180 msgr2=0x7f61b41586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:35.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.562+0000 7f61ba000640 1 --2- 172.21.15.114:0/2968480931 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61b4099180 0x7f61b41586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:35.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.562+0000 7f61ba000640 1 -- 172.21.15.114:0/2968480931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61b415c880 msgr2=0x7f61b40b55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:35.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.562+0000 7f61ba000640 1 --2- 172.21.15.114:0/2968480931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61b415c880 0x7f61b40b55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:35.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.562+0000 7f61ba000640 1 -- 172.21.15.114:0/2968480931 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a8009420 con 0x7f61b414c620 2024-09-13T17:53:35.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.562+0000 7f61b9600640 1 --2- 172.21.15.114:0/2968480931 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61b4099180 0x7f61b41586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:35.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.562+0000 7f61b8c00640 1 --2- 172.21.15.114:0/2968480931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61b415c880 0x7f61b40b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:35.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.562+0000 7f61ba000640 1 --2- 172.21.15.114:0/2968480931 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b414c620 0x7f61b414cad0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00c730 tx=0x7f61ac00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:35.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.562+0000 7f61b1600640 1 -- 172.21.15.114:0/2968480931 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac003b80 con 0x7f61b414c620 2024-09-13T17:53:35.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.562+0000 7f61b1600640 1 -- 172.21.15.114:0/2968480931 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ac003ce0 con 0x7f61b414c620 2024-09-13T17:53:35.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.562+0000 7f61b1600640 1 -- 172.21.15.114:0/2968480931 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ac005310 con 0x7f61b414c620 2024-09-13T17:53:35.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.562+0000 7f61baa00640 1 -- 172.21.15.114:0/2968480931 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b40c9b60 con 0x7f61b414c620 2024-09-13T17:53:35.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.562+0000 7f61baa00640 1 -- 172.21.15.114:0/2968480931 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b40ca120 con 0x7f61b414c620 2024-09-13T17:53:35.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.562+0000 7f61baa00640 1 -- 172.21.15.114:0/2968480931 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b40ca2e0 con 0x7f61b414c620 2024-09-13T17:53:35.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.562+0000 7f61b1600640 1 -- 172.21.15.114:0/2968480931 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f61ac005680 con 0x7f61b414c620 2024-09-13T17:53:35.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.566+0000 7f61b1600640 1 --2- 172.21.15.114:0/2968480931 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6194066690 0x7f6194068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:35.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.566+0000 7f61b1600640 1 -- 172.21.15.114:0/2968480931 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f61ac084510 con 0x7f61b414c620 2024-09-13T17:53:35.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.566+0000 7f61b9600640 1 --2- 172.21.15.114:0/2968480931 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6194066690 0x7f6194068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:35.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.566+0000 7f61b9600640 1 --2- 172.21.15.114:0/2968480931 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6194066690 0x7f6194068b50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f61a80ae000 tx=0x7f61a8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:35.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.570+0000 7f61b1600640 1 -- 172.21.15.114:0/2968480931 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f61ac051460 con 0x7f61b414c620 2024-09-13T17:53:35.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.754+0000 7f61baa00640 1 -- 172.21.15.114:0/2968480931 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61b40c6f20 con 0x7f61b414c620 2024-09-13T17:53:35.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.754+0000 7f61b1600640 1 -- 172.21.15.114:0/2968480931 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+5943 (secure 0 0 0) 0x7f61ac054a80 con 0x7f61b414c620 2024-09-13T17:53:35.760 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:35.760 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/1758700058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1758700058},{"type":"v1","addr":"172.21.15.134:6833","nonce":1758700058}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/4015015784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4015015784},{"type":"v1","addr":"172.21.15.134:6835","nonce":4015015784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2696640153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2696640153},{"type":"v1","addr":"172.21.15.114:6836","nonce":2696640153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/2697286380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2697286380},{"type":"v1","addr":"172.21.15.114:6837","nonce":2697286380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:53:08.298484+0000","modified":"2024-09-13T17:53:22.929771+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":23,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:53:32.086012+0000","modified":"2024-09-13T17:53:35.386830+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T17:53:35.760 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 23 2024-09-13T17:53:35.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.754+0000 7f61baa00640 1 -- 172.21.15.114:0/2968480931 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6194066690 msgr2=0x7f6194068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:35.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.754+0000 7f61baa00640 1 --2- 172.21.15.114:0/2968480931 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6194066690 0x7f6194068b50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f61a80ae000 tx=0x7f61a8008040 comp rx=0 tx=0).stop 2024-09-13T17:53:35.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.754+0000 7f61baa00640 1 -- 172.21.15.114:0/2968480931 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b414c620 msgr2=0x7f61b414cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:35.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.754+0000 7f61baa00640 1 --2- 172.21.15.114:0/2968480931 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b414c620 0x7f61b414cad0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00c730 tx=0x7f61ac00cbf0 comp rx=0 tx=0).stop 2024-09-13T17:53:35.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.758+0000 7f61baa00640 1 -- 172.21.15.114:0/2968480931 shutdown_connections 2024-09-13T17:53:35.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.758+0000 7f61baa00640 1 --2- 172.21.15.114:0/2968480931 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6194066690 0x7f6194068b50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:35.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.758+0000 7f61baa00640 1 --2- 172.21.15.114:0/2968480931 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61b414c620 0x7f61b414cad0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:35.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.758+0000 7f61baa00640 1 --2- 172.21.15.114:0/2968480931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61b415c880 0x7f61b40b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:35.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.758+0000 7f61baa00640 1 --2- 172.21.15.114:0/2968480931 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f61b4099180 0x7f61b41586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:35.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.758+0000 7f61baa00640 1 -- 172.21.15.114:0/2968480931 >> 172.21.15.114:0/2968480931 conn(0x7f61b40d0330 msgr2=0x7f61b40b3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:35.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.758+0000 7f61baa00640 1 -- 172.21.15.114:0/2968480931 shutdown_connections 2024-09-13T17:53:35.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.758+0000 7f61baa00640 1 -- 172.21.15.114:0/2968480931 wait complete. 2024-09-13T17:53:35.781 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:53:35.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.910+0000 7fd8fb200640 1 Processor -- start 2024-09-13T17:53:35.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.910+0000 7fd8fb200640 1 -- start start 2024-09-13T17:53:35.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.914+0000 7fd8fb200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd8fc15a4a0 0x7fd8fc0ce230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:35.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.914+0000 7fd8fb200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd8fc0ce770 0x7fd8fc0cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:35.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.914+0000 7fd8fb200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8fc099d70 con 0x7fd8fc0b3aa0 2024-09-13T17:53:35.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.914+0000 7fd8fb200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8fc0997b0 con 0x7fd8fc0ce770 2024-09-13T17:53:35.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.914+0000 7fd8fb200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8fc099a90 con 0x7fd8fc15a4a0 2024-09-13T17:53:35.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.914+0000 7fd8f1400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd8fc0ce770 0x7fd8fc0cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:35.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.914+0000 7fd8f1400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd8fc0ce770 0x7fd8fc0cebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43784/0 (socket says 172.21.15.114:43784) 2024-09-13T17:53:35.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.914+0000 7fd8f1400640 1 -- 172.21.15.114:0/4144906568 learned_addr learned my addr 172.21.15.114:0/4144906568 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:35.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.914+0000 7fd8f9e00640 1 --2- 172.21.15.114:0/4144906568 >> v2:172.21.15.134:3300/0 conn(0x7fd8fc15a4a0 0x7fd8fc0ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:35.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.914+0000 7fd8f1400640 1 -- 172.21.15.114:0/4144906568 >> v2:172.21.15.134:3300/0 conn(0x7fd8fc15a4a0 msgr2=0x7fd8fc0ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:35.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.914+0000 7fd8f1400640 1 --2- 172.21.15.114:0/4144906568 >> v2:172.21.15.134:3300/0 conn(0x7fd8fc15a4a0 0x7fd8fc0ce230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:35.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.914+0000 7fd8f1400640 1 -- 172.21.15.114:0/4144906568 >> v1:172.21.15.134:6789/0 conn(0x7fd8fc0b3aa0 legacy=0x7fd8fc0b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:35.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.914+0000 7fd8f1400640 1 -- 172.21.15.114:0/4144906568 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8fc0b32a0 con 0x7fd8fc0ce770 2024-09-13T17:53:35.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.918+0000 7fd8f1400640 1 --2- 172.21.15.114:0/4144906568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8fc0ce770 0x7fd8fc0cebd0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0719d0 tx=0x7fd8e401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d0c98af17daf57 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:35.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.918+0000 7fd8f9400640 1 -- 172.21.15.114:0/4144906568 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e40ab600 con 0x7fd8fc0ce770 2024-09-13T17:53:35.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.918+0000 7fd8f9400640 1 -- 172.21.15.114:0/4144906568 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e40a7050 con 0x7fd8fc0ce770 2024-09-13T17:53:35.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.918+0000 7fd8f9400640 1 -- 172.21.15.114:0/4144906568 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e40ab980 con 0x7fd8fc0ce770 2024-09-13T17:53:35.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.918+0000 7fd8fb200640 1 -- 172.21.15.114:0/4144906568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8fc0ce770 msgr2=0x7fd8fc0cebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:35.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.918+0000 7fd8fb200640 1 --2- 172.21.15.114:0/4144906568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8fc0ce770 0x7fd8fc0cebd0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0719d0 tx=0x7fd8e401c520 comp rx=0 tx=0).stop 2024-09-13T17:53:35.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.918+0000 7fd8fb200640 1 -- 172.21.15.114:0/4144906568 shutdown_connections 2024-09-13T17:53:35.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.918+0000 7fd8fb200640 1 --2- 172.21.15.114:0/4144906568 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8fc0ce770 0x7fd8fc0cebd0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:35.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.918+0000 7fd8fb200640 1 --2- 172.21.15.114:0/4144906568 >> v2:172.21.15.134:3300/0 conn(0x7fd8fc15a4a0 0x7fd8fc0ce230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:35.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.918+0000 7fd8fb200640 1 -- 172.21.15.114:0/4144906568 >> 172.21.15.114:0/4144906568 conn(0x7fd8fc0d0330 msgr2=0x7fd8fc0d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:35.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.918+0000 7fd8fb200640 1 -- 172.21.15.114:0/4144906568 shutdown_connections 2024-09-13T17:53:35.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.918+0000 7fd8fb200640 1 -- 172.21.15.114:0/4144906568 wait complete. 2024-09-13T17:53:35.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.918+0000 7fd8fb200640 1 Processor -- start 2024-09-13T17:53:35.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.918+0000 7fd8fb200640 1 -- start start 2024-09-13T17:53:35.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.918+0000 7fd8fb200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8fc0b3aa0 0x7fd8fc0c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:35.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.918+0000 7fd8fb200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd8fc0ce770 0x7fd8fc0c3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:35.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.918+0000 7fd8fb200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8fc15a4a0 0x7fd8fc142350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:35.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.918+0000 7fd8fb200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc153c60 con 0x7fd8fc0b3aa0 2024-09-13T17:53:35.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.918+0000 7fd8fb200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc143270 con 0x7fd8fc15a4a0 2024-09-13T17:53:35.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.918+0000 7fd8fb200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc142f90 con 0x7fd8fc0ce770 2024-09-13T17:53:35.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.918+0000 7fd8f9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8fc0b3aa0 0x7fd8fc0c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:35.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.922+0000 7fd8f9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8fc0b3aa0 0x7fd8fc0c3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43794/0 (socket says 172.21.15.114:43794) 2024-09-13T17:53:35.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.922+0000 7fd8f9e00640 1 -- 172.21.15.114:0/1631074212 learned_addr learned my addr 172.21.15.114:0/1631074212 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:35.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.922+0000 7fd8f1400640 1 --2- 172.21.15.114:0/1631074212 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd8fc0ce770 0x7fd8fc0c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:35.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.922+0000 7fd8fa800640 1 --2- 172.21.15.114:0/1631074212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8fc15a4a0 0x7fd8fc142350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:35.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.922+0000 7fd8f9e00640 1 -- 172.21.15.114:0/1631074212 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd8fc0ce770 msgr2=0x7fd8fc0c3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:35.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.922+0000 7fd8f9e00640 1 --2- 172.21.15.114:0/1631074212 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd8fc0ce770 0x7fd8fc0c3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:35.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.922+0000 7fd8f9e00640 1 -- 172.21.15.114:0/1631074212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8fc15a4a0 msgr2=0x7fd8fc142350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:35.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.922+0000 7fd8f9e00640 1 --2- 172.21.15.114:0/1631074212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8fc15a4a0 0x7fd8fc142350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:35.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.922+0000 7fd8f9e00640 1 -- 172.21.15.114:0/1631074212 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e40094d0 con 0x7fd8fc0b3aa0 2024-09-13T17:53:35.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.922+0000 7fd8fa800640 1 --2- 172.21.15.114:0/1631074212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8fc15a4a0 0x7fd8fc142350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:35.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.922+0000 7fd8f9e00640 1 --2- 172.21.15.114:0/1631074212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8fc0b3aa0 0x7fd8fc0c3db0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00e870 tx=0x7fd8ec00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:35.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.922+0000 7fd8f2a00640 1 -- 172.21.15.114:0/1631074212 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec009510 con 0x7fd8fc0b3aa0 2024-09-13T17:53:35.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.922+0000 7fd8f2a00640 1 -- 172.21.15.114:0/1631074212 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec00eec0 con 0x7fd8fc0b3aa0 2024-09-13T17:53:35.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.922+0000 7fd8f2a00640 1 -- 172.21.15.114:0/1631074212 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec00cb40 con 0x7fd8fc0b3aa0 2024-09-13T17:53:35.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.922+0000 7fd8fb200640 1 -- 172.21.15.114:0/1631074212 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8fc0c9f70 con 0x7fd8fc0b3aa0 2024-09-13T17:53:35.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.922+0000 7fd8fb200640 1 -- 172.21.15.114:0/1631074212 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8fc0c3670 con 0x7fd8fc0b3aa0 2024-09-13T17:53:35.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.922+0000 7fd8fb200640 1 -- 172.21.15.114:0/1631074212 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8fc0cebd0 con 0x7fd8fc0b3aa0 2024-09-13T17:53:35.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.922+0000 7fd8f2a00640 1 -- 172.21.15.114:0/1631074212 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd8ec00cca0 con 0x7fd8fc0b3aa0 2024-09-13T17:53:35.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.926+0000 7fd8f2a00640 1 --2- 172.21.15.114:0/1631074212 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd8d8066690 0x7fd8d8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:35.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.926+0000 7fd8f2a00640 1 -- 172.21.15.114:0/1631074212 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7fd8ec084950 con 0x7fd8fc0b3aa0 2024-09-13T17:53:35.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.926+0000 7fd8f1400640 1 --2- 172.21.15.114:0/1631074212 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd8d8066690 0x7fd8d8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:35.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.926+0000 7fd8f1400640 1 --2- 172.21.15.114:0/1631074212 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd8d8066690 0x7fd8d8068b50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd8e40ad000 tx=0x7fd8e40a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:35.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:35.930+0000 7fd8f2a00640 1 -- 172.21.15.114:0/1631074212 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd8ec0519e0 con 0x7fd8fc0b3aa0 2024-09-13T17:53:36.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.086+0000 7fd8fb200640 1 -- 172.21.15.114:0/1631074212 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8fc0b1970 con 0x7fd8fc0b3aa0 2024-09-13T17:53:36.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.086+0000 7fd8f2a00640 1 -- 172.21.15.114:0/1631074212 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+18795 (secure 0 0 0) 0x7fd8ec055000 con 0x7fd8fc0b3aa0 2024-09-13T17:53:36.093 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:36.093 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":48,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:53:33.088316+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:53:06.185439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:53:07.297633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2024-09-13T17:53:31.026998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.35","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6835/1239035445":"2024-09-14T17:53:22.929223+0000","172.21.15.134:6833/1239035445":"2024-09-14T17:53:22.929223+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:53:36.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.090+0000 7fd8fb200640 1 -- 172.21.15.114:0/1631074212 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd8d8066690 msgr2=0x7fd8d8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:36.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.090+0000 7fd8fb200640 1 --2- 172.21.15.114:0/1631074212 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd8d8066690 0x7fd8d8068b50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd8e40ad000 tx=0x7fd8e40a6000 comp rx=0 tx=0).stop 2024-09-13T17:53:36.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.090+0000 7fd8fb200640 1 -- 172.21.15.114:0/1631074212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8fc0b3aa0 msgr2=0x7fd8fc0c3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:36.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.090+0000 7fd8fb200640 1 --2- 172.21.15.114:0/1631074212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8fc0b3aa0 0x7fd8fc0c3db0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00e870 tx=0x7fd8ec00ec70 comp rx=0 tx=0).stop 2024-09-13T17:53:36.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.090+0000 7fd8fb200640 1 -- 172.21.15.114:0/1631074212 shutdown_connections 2024-09-13T17:53:36.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.090+0000 7fd8fb200640 1 --2- 172.21.15.114:0/1631074212 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd8d8066690 0x7fd8d8068b50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:36.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.090+0000 7fd8fb200640 1 --2- 172.21.15.114:0/1631074212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8fc15a4a0 0x7fd8fc142350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:36.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.090+0000 7fd8fb200640 1 --2- 172.21.15.114:0/1631074212 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd8fc0ce770 0x7fd8fc0c3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:36.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.090+0000 7fd8fb200640 1 --2- 172.21.15.114:0/1631074212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8fc0b3aa0 0x7fd8fc0c3db0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:36.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.090+0000 7fd8fb200640 1 -- 172.21.15.114:0/1631074212 >> 172.21.15.114:0/1631074212 conn(0x7fd8fc0d0330 msgr2=0x7fd8fc06f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:36.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.090+0000 7fd8fb200640 1 -- 172.21.15.114:0/1631074212 shutdown_connections 2024-09-13T17:53:36.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.090+0000 7fd8fb200640 1 -- 172.21.15.114:0/1631074212 wait complete. 2024-09-13T17:53:36.114 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T17:53:36.115 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:53:36.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.246+0000 7fe033600640 1 Processor -- start 2024-09-13T17:53:36.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.246+0000 7fe033600640 1 -- start start 2024-09-13T17:53:36.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.246+0000 7fe033600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe02c15a650 0x7fe02c099480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:36.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.246+0000 7fe033600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe02c0ce540 con 0x7fe02c0ce0b0 2024-09-13T17:53:36.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.246+0000 7fe033600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe02c0ce820 con 0x7fe02c15e7c0 2024-09-13T17:53:36.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.246+0000 7fe033600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe02c15ba40 con 0x7fe02c15a650 2024-09-13T17:53:36.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.246+0000 7fe023e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe02c0ce0b0 0x7fe02c15e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51102/0 (socket says 172.21.15.114:51102) 2024-09-13T17:53:36.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.246+0000 7fe023e00640 1 -- 172.21.15.114:0/571015046 learned_addr learned my addr 172.21.15.114:0/571015046 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:36.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.246+0000 7fe030c00640 1 --2- 172.21.15.114:0/571015046 >> v2:172.21.15.134:3300/0 conn(0x7fe02c15a650 0x7fe02c099480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:36.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.246+0000 7fe02be00640 1 -- 172.21.15.114:0/571015046 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4210357936 0 0) 0x7fe02c0ce540 con 0x7fe02c0ce0b0 2024-09-13T17:53:36.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.246+0000 7fe02be00640 1 -- 172.21.15.114:0/571015046 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe010003530 con 0x7fe02c0ce0b0 2024-09-13T17:53:36.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.246+0000 7fe02be00640 1 -- 172.21.15.114:0/571015046 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1717053601 0 0) 0x7fe010003530 con 0x7fe02c0ce0b0 2024-09-13T17:53:36.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.246+0000 7fe02be00640 1 -- 172.21.15.114:0/571015046 >> v2:172.21.15.134:3300/0 conn(0x7fe02c15a650 msgr2=0x7fe02c099480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:36.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.246+0000 7fe02be00640 1 --2- 172.21.15.114:0/571015046 >> v2:172.21.15.134:3300/0 conn(0x7fe02c15a650 0x7fe02c099480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:36.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.246+0000 7fe02be00640 1 -- 172.21.15.114:0/571015046 >> v1:172.21.15.134:6789/0 conn(0x7fe02c15e7c0 legacy=0x7fe02c0cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:36.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.246+0000 7fe02be00640 1 -- 172.21.15.114:0/571015046 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02c0ceb00 con 0x7fe02c0ce0b0 2024-09-13T17:53:36.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.246+0000 7fe02be00640 1 -- 172.21.15.114:0/571015046 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7fe014001680 con 0x7fe02c0ce0b0 2024-09-13T17:53:36.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.246+0000 7fe02be00640 1 -- 172.21.15.114:0/571015046 >> v1:172.21.15.114:6789/0 conn(0x7fe02c0ce0b0 legacy=0x7fe02c15e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:36.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.246+0000 7fe02be00640 1 --2- 172.21.15.114:0/571015046 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe010003980 0x7fe010003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:36.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.246+0000 7fe02be00640 1 --2- 172.21.15.114:0/571015046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0100047d0 0x7fe010004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:36.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.246+0000 7fe02be00640 1 --2- 172.21.15.114:0/571015046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe010005190 0x7fe01000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:36.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.246+0000 7fe02be00640 1 -- 172.21.15.114:0/571015046 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c15ba40 con 0x7fe010005190 2024-09-13T17:53:36.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.246+0000 7fe02be00640 1 -- 172.21.15.114:0/571015046 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01000c030 con 0x7fe0100047d0 2024-09-13T17:53:36.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.246+0000 7fe02be00640 1 -- 172.21.15.114:0/571015046 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01000c1f0 con 0x7fe010003980 2024-09-13T17:53:36.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.246+0000 7fe031600640 1 --2- 172.21.15.114:0/571015046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe010005190 0x7fe01000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:36.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.246+0000 7fe023e00640 1 --2- 172.21.15.114:0/571015046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0100047d0 0x7fe010004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:36.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.246+0000 7fe030c00640 1 --2- 172.21.15.114:0/571015046 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe010003980 0x7fe010003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:36.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.250+0000 7fe031600640 1 -- 172.21.15.114:0/571015046 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe010003980 msgr2=0x7fe010003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:36.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.250+0000 7fe031600640 1 --2- 172.21.15.114:0/571015046 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe010003980 0x7fe010003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:36.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.250+0000 7fe031600640 1 -- 172.21.15.114:0/571015046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0100047d0 msgr2=0x7fe010004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:36.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.250+0000 7fe031600640 1 --2- 172.21.15.114:0/571015046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0100047d0 0x7fe010004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:36.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.250+0000 7fe031600640 1 -- 172.21.15.114:0/571015046 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe010003530 con 0x7fe010005190 2024-09-13T17:53:36.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.250+0000 7fe031600640 1 -- 172.21.15.114:0/571015046 reap_dead start 2024-09-13T17:53:36.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.250+0000 7fe031600640 1 --2- 172.21.15.114:0/571015046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe010005190 0x7fe01000b990 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe024001e70 tx=0x7fe02401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1422206ac874763c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:36.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.250+0000 7fe02be00640 1 -- 172.21.15.114:0/571015046 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe024003b80 con 0x7fe010005190 2024-09-13T17:53:36.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.250+0000 7fe02be00640 1 -- 172.21.15.114:0/571015046 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe024003d00 con 0x7fe010005190 2024-09-13T17:53:36.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.250+0000 7fe02be00640 1 -- 172.21.15.114:0/571015046 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe024005260 con 0x7fe010005190 2024-09-13T17:53:36.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.250+0000 7fe033600640 1 -- 172.21.15.114:0/571015046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe010005190 msgr2=0x7fe01000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:36.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.250+0000 7fe033600640 1 --2- 172.21.15.114:0/571015046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe010005190 0x7fe01000b990 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe024001e70 tx=0x7fe02401c780 comp rx=0 tx=0).stop 2024-09-13T17:53:36.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.250+0000 7fe033600640 1 -- 172.21.15.114:0/571015046 shutdown_connections 2024-09-13T17:53:36.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.250+0000 7fe033600640 1 --2- 172.21.15.114:0/571015046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe010005190 0x7fe01000b990 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:36.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.250+0000 7fe033600640 1 -- 172.21.15.114:0/571015046 >> 172.21.15.114:0/571015046 conn(0x7fe02c0d04e0 msgr2=0x7fe02c0d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:36.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.250+0000 7fe033600640 1 -- 172.21.15.114:0/571015046 shutdown_connections 2024-09-13T17:53:36.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.250+0000 7fe033600640 1 -- 172.21.15.114:0/571015046 wait complete. 2024-09-13T17:53:36.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.254+0000 7fe033600640 1 Processor -- start 2024-09-13T17:53:36.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.254+0000 7fe033600640 1 -- start start 2024-09-13T17:53:36.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.254+0000 7fe033600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe010005190 0x7fe02c1f2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:36.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.254+0000 7fe033600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe02c0b33a0 0x7fe02c0c6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:36.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.254+0000 7fe033600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe02c06b930 0x7fe02c0ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:36.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.254+0000 7fe033600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c1f31f0 con 0x7fe02c06b930 2024-09-13T17:53:36.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.254+0000 7fe033600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c0af360 con 0x7fe02c0b33a0 2024-09-13T17:53:36.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.254+0000 7fe033600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c0af640 con 0x7fe010005190 2024-09-13T17:53:36.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.254+0000 7fe031600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe02c06b930 0x7fe02c0ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:36.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.254+0000 7fe031600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe02c06b930 0x7fe02c0ad2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43810/0 (socket says 172.21.15.114:43810) 2024-09-13T17:53:36.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.254+0000 7fe031600640 1 -- 172.21.15.114:0/2266532417 learned_addr learned my addr 172.21.15.114:0/2266532417 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:36.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.254+0000 7fe031600640 1 -- 172.21.15.114:0/2266532417 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe010005190 msgr2=0x7fe02c1f2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:36.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.254+0000 7fe031600640 1 --2- 172.21.15.114:0/2266532417 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe010005190 0x7fe02c1f2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:36.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.254+0000 7fe031600640 1 -- 172.21.15.114:0/2266532417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe02c0b33a0 msgr2=0x7fe02c0c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:36.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.254+0000 7fe031600640 1 --2- 172.21.15.114:0/2266532417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe02c0b33a0 0x7fe02c0c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:36.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.254+0000 7fe031600640 1 -- 172.21.15.114:0/2266532417 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02c0af920 con 0x7fe02c06b930 2024-09-13T17:53:36.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.254+0000 7fe031600640 1 --2- 172.21.15.114:0/2266532417 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe02c06b930 0x7fe02c0ad2d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe02401c5b0 tx=0x7fe010005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:36.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.254+0000 7fe029600640 1 -- 172.21.15.114:0/2266532417 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0240ac070 con 0x7fe02c06b930 2024-09-13T17:53:36.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.254+0000 7fe029600640 1 -- 172.21.15.114:0/2266532417 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe024003b90 con 0x7fe02c06b930 2024-09-13T17:53:36.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.254+0000 7fe029600640 1 -- 172.21.15.114:0/2266532417 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe024006da0 con 0x7fe02c06b930 2024-09-13T17:53:36.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.254+0000 7fe033600640 1 -- 172.21.15.114:0/2266532417 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe02c06b130 con 0x7fe02c06b930 2024-09-13T17:53:36.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.254+0000 7fe033600640 1 -- 172.21.15.114:0/2266532417 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe02c0c68d0 con 0x7fe02c06b930 2024-09-13T17:53:36.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.258+0000 7fe033600640 1 -- 172.21.15.114:0/2266532417 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe02c0d1380 con 0x7fe02c06b930 2024-09-13T17:53:36.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.258+0000 7fe029600640 1 -- 172.21.15.114:0/2266532417 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe0240a6480 con 0x7fe02c06b930 2024-09-13T17:53:36.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.258+0000 7fe029600640 1 --2- 172.21.15.114:0/2266532417 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe008066690 0x7fe008068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:36.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.258+0000 7fe029600640 1 -- 172.21.15.114:0/2266532417 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7fe02411d6d0 con 0x7fe02c06b930 2024-09-13T17:53:36.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.258+0000 7fe030c00640 1 --2- 172.21.15.114:0/2266532417 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe008066690 0x7fe008068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:36.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.258+0000 7fe030c00640 1 --2- 172.21.15.114:0/2266532417 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe008066690 0x7fe008068b50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe02c15da00 tx=0x7fe01c009340 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:36.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.262+0000 7fe029600640 1 -- 172.21.15.114:0/2266532417 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe0240ea6d0 con 0x7fe02c06b930 2024-09-13T17:53:36.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.426+0000 7fe033600640 1 -- 172.21.15.114:0/2266532417 --> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe02c0c6ac0 con 0x7fe008066690 2024-09-13T17:53:36.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.438+0000 7fe029600640 1 -- 172.21.15.114:0/2266532417 <== mgr.4102 v2:172.21.15.114:6832/137691478 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369195 (secure 0 0 0) 0x7fe02c0c6ac0 con 0x7fe008066690 2024-09-13T17:53:36.451 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:36.454 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-13T17:53:36.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.442+0000 7fe033600640 1 -- 172.21.15.114:0/2266532417 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe008066690 msgr2=0x7fe008068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:36.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.442+0000 7fe033600640 1 --2- 172.21.15.114:0/2266532417 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe008066690 0x7fe008068b50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe02c15da00 tx=0x7fe01c009340 comp rx=0 tx=0).stop 2024-09-13T17:53:36.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.442+0000 7fe033600640 1 -- 172.21.15.114:0/2266532417 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe02c06b930 msgr2=0x7fe02c0ad2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:36.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.442+0000 7fe033600640 1 --2- 172.21.15.114:0/2266532417 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe02c06b930 0x7fe02c0ad2d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe02401c5b0 tx=0x7fe010005800 comp rx=0 tx=0).stop 2024-09-13T17:53:36.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.442+0000 7fe033600640 1 -- 172.21.15.114:0/2266532417 shutdown_connections 2024-09-13T17:53:36.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.442+0000 7fe033600640 1 --2- 172.21.15.114:0/2266532417 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe008066690 0x7fe008068b50 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:36.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.442+0000 7fe033600640 1 --2- 172.21.15.114:0/2266532417 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe02c06b930 0x7fe02c0ad2d0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:36.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.442+0000 7fe033600640 1 --2- 172.21.15.114:0/2266532417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe02c0b33a0 0x7fe02c0c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:36.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.442+0000 7fe033600640 1 --2- 172.21.15.114:0/2266532417 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe010005190 0x7fe02c1f2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:36.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.442+0000 7fe033600640 1 -- 172.21.15.114:0/2266532417 >> 172.21.15.114:0/2266532417 conn(0x7fe02c0d04e0 msgr2=0x7fe02c0d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:36.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.442+0000 7fe033600640 1 -- 172.21.15.114:0/2266532417 shutdown_connections 2024-09-13T17:53:36.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.442+0000 7fe033600640 1 -- 172.21.15.114:0/2266532417 wait complete. 2024-09-13T17:53:36.467 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2024-09-13T17:53:35.956742+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6881824,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":100,"num_write":258,"num_write_kb":8601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":703,"ondisk_log_size":703,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":199,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233948,"kb_used_data":17724,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754740772,"statfs":{"total":773094113280,"available":772854550528,"internally_reserved":0,"allocated":18149376,"data_stored":15731527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-18808,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.591272"},"pg_stats":[{"pgid":"6.3f","version":"39'8","reported_seq":25,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381981+0000","last_change":"2024-09-13T17:53:08.328059+0000","last_active":"2024-09-13T17:53:31.381981+0000","last_peered":"2024-09-13T17:53:31.381981+0000","last_clean":"2024-09-13T17:53:31.381981+0000","last_became_active":"2024-09-13T17:53:08.326969+0000","last_became_peered":"2024-09-13T17:53:08.326969+0000","last_unstale":"2024-09-13T17:53:31.381981+0000","last_undegraded":"2024-09-13T17:53:31.381981+0000","last_fullsized":"2024-09-13T17:53:31.381981+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:02.633358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"39'4","reported_seq":21,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381368+0000","last_change":"2024-09-13T17:53:08.322031+0000","last_active":"2024-09-13T17:53:31.381368+0000","last_peered":"2024-09-13T17:53:31.381368+0000","last_clean":"2024-09-13T17:53:31.381368+0000","last_became_active":"2024-09-13T17:53:08.320784+0000","last_became_peered":"2024-09-13T17:53:08.320784+0000","last_unstale":"2024-09-13T17:53:31.381368+0000","last_undegraded":"2024-09-13T17:53:31.381368+0000","last_fullsized":"2024-09-13T17:53:31.381368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:11.750011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"39'7","reported_seq":23,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.385235+0000","last_change":"2024-09-13T17:53:08.337321+0000","last_active":"2024-09-13T17:53:31.385235+0000","last_peered":"2024-09-13T17:53:31.385235+0000","last_clean":"2024-09-13T17:53:31.385235+0000","last_became_active":"2024-09-13T17:53:08.337068+0000","last_became_peered":"2024-09-13T17:53:08.337068+0000","last_unstale":"2024-09-13T17:53:31.385235+0000","last_undegraded":"2024-09-13T17:53:31.385235+0000","last_fullsized":"2024-09-13T17:53:31.385235+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:29.844579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"39'8","reported_seq":25,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.374732+0000","last_change":"2024-09-13T17:53:08.338221+0000","last_active":"2024-09-13T17:53:31.374732+0000","last_peered":"2024-09-13T17:53:31.374732+0000","last_clean":"2024-09-13T17:53:31.374732+0000","last_became_active":"2024-09-13T17:53:08.337670+0000","last_became_peered":"2024-09-13T17:53:08.337670+0000","last_unstale":"2024-09-13T17:53:31.374732+0000","last_undegraded":"2024-09-13T17:53:31.374732+0000","last_fullsized":"2024-09-13T17:53:31.374732+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:04:50.600660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"39'4","reported_seq":21,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.374446+0000","last_change":"2024-09-13T17:53:08.338777+0000","last_active":"2024-09-13T17:53:31.374446+0000","last_peered":"2024-09-13T17:53:31.374446+0000","last_clean":"2024-09-13T17:53:31.374446+0000","last_became_active":"2024-09-13T17:53:08.338519+0000","last_became_peered":"2024-09-13T17:53:08.338519+0000","last_unstale":"2024-09-13T17:53:31.374446+0000","last_undegraded":"2024-09-13T17:53:31.374446+0000","last_fullsized":"2024-09-13T17:53:31.374446+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:15.795161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"39'6","reported_seq":23,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.380622+0000","last_change":"2024-09-13T17:53:08.321284+0000","last_active":"2024-09-13T17:53:31.380622+0000","last_peered":"2024-09-13T17:53:31.380622+0000","last_clean":"2024-09-13T17:53:31.380622+0000","last_became_active":"2024-09-13T17:53:08.321012+0000","last_became_peered":"2024-09-13T17:53:08.321012+0000","last_unstale":"2024-09-13T17:53:31.380622+0000","last_undegraded":"2024-09-13T17:53:31.380622+0000","last_fullsized":"2024-09-13T17:53:31.380622+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:15.154333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"39'5","reported_seq":21,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376087+0000","last_change":"2024-09-13T17:53:08.331121+0000","last_active":"2024-09-13T17:53:31.376087+0000","last_peered":"2024-09-13T17:53:31.376087+0000","last_clean":"2024-09-13T17:53:31.376087+0000","last_became_active":"2024-09-13T17:53:08.327083+0000","last_became_peered":"2024-09-13T17:53:08.327083+0000","last_unstale":"2024-09-13T17:53:31.376087+0000","last_undegraded":"2024-09-13T17:53:31.376087+0000","last_fullsized":"2024-09-13T17:53:31.376087+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:00.206010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"39'9","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.380377+0000","last_change":"2024-09-13T17:53:08.334438+0000","last_active":"2024-09-13T17:53:31.380377+0000","last_peered":"2024-09-13T17:53:31.380377+0000","last_clean":"2024-09-13T17:53:31.380377+0000","last_became_active":"2024-09-13T17:53:08.334269+0000","last_became_peered":"2024-09-13T17:53:08.334269+0000","last_unstale":"2024-09-13T17:53:31.380377+0000","last_undegraded":"2024-09-13T17:53:31.380377+0000","last_fullsized":"2024-09-13T17:53:31.380377+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:39.920002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"39'11","reported_seq":27,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.384882+0000","last_change":"2024-09-13T17:53:08.338160+0000","last_active":"2024-09-13T17:53:31.384882+0000","last_peered":"2024-09-13T17:53:31.384882+0000","last_clean":"2024-09-13T17:53:31.384882+0000","last_became_active":"2024-09-13T17:53:08.337915+0000","last_became_peered":"2024-09-13T17:53:08.337915+0000","last_unstale":"2024-09-13T17:53:31.384882+0000","last_undegraded":"2024-09-13T17:53:31.384882+0000","last_fullsized":"2024-09-13T17:53:31.384882+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:58.339595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"39'15","reported_seq":31,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.377424+0000","last_change":"2024-09-13T17:53:08.336931+0000","last_active":"2024-09-13T17:53:31.377424+0000","last_peered":"2024-09-13T17:53:31.377424+0000","last_clean":"2024-09-13T17:53:31.377424+0000","last_became_active":"2024-09-13T17:53:08.336690+0000","last_became_peered":"2024-09-13T17:53:08.336690+0000","last_unstale":"2024-09-13T17:53:31.377424+0000","last_undegraded":"2024-09-13T17:53:31.377424+0000","last_fullsized":"2024-09-13T17:53:31.377424+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:08.746286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"39'6","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.093989+0000","last_change":"2024-09-13T17:53:31.385152+0000","last_active":"2024-09-13T17:53:32.093989+0000","last_peered":"2024-09-13T17:53:32.093989+0000","last_clean":"2024-09-13T17:53:32.093989+0000","last_became_active":"2024-09-13T17:53:31.384866+0000","last_became_peered":"2024-09-13T17:53:31.384866+0000","last_unstale":"2024-09-13T17:53:32.093989+0000","last_undegraded":"2024-09-13T17:53:32.093989+0000","last_fullsized":"2024-09-13T17:53:32.093989+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:11.437251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"39'7","reported_seq":23,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.384630+0000","last_change":"2024-09-13T17:53:08.311528+0000","last_active":"2024-09-13T17:53:31.384630+0000","last_peered":"2024-09-13T17:53:31.384630+0000","last_clean":"2024-09-13T17:53:31.384630+0000","last_became_active":"2024-09-13T17:53:08.311275+0000","last_became_peered":"2024-09-13T17:53:08.311275+0000","last_unstale":"2024-09-13T17:53:31.384630+0000","last_undegraded":"2024-09-13T17:53:31.384630+0000","last_fullsized":"2024-09-13T17:53:31.384630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:24.523487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"39'10","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376396+0000","last_change":"2024-09-13T17:53:08.337826+0000","last_active":"2024-09-13T17:53:31.376396+0000","last_peered":"2024-09-13T17:53:31.376396+0000","last_clean":"2024-09-13T17:53:31.376396+0000","last_became_active":"2024-09-13T17:53:08.337542+0000","last_became_peered":"2024-09-13T17:53:08.337542+0000","last_unstale":"2024-09-13T17:53:31.376396+0000","last_undegraded":"2024-09-13T17:53:31.376396+0000","last_fullsized":"2024-09-13T17:53:31.376396+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:24.523487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"39'8","reported_seq":24,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376202+0000","last_change":"2024-09-13T17:53:08.338046+0000","last_active":"2024-09-13T17:53:31.376202+0000","last_peered":"2024-09-13T17:53:31.376202+0000","last_clean":"2024-09-13T17:53:31.376202+0000","last_became_active":"2024-09-13T17:53:08.336636+0000","last_became_peered":"2024-09-13T17:53:08.336636+0000","last_unstale":"2024-09-13T17:53:31.376202+0000","last_undegraded":"2024-09-13T17:53:31.376202+0000","last_fullsized":"2024-09-13T17:53:31.376202+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:51.440182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"39'7","reported_seq":23,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376188+0000","last_change":"2024-09-13T17:53:08.328609+0000","last_active":"2024-09-13T17:53:31.376188+0000","last_peered":"2024-09-13T17:53:31.376188+0000","last_clean":"2024-09-13T17:53:31.376188+0000","last_became_active":"2024-09-13T17:53:08.326748+0000","last_became_peered":"2024-09-13T17:53:08.326748+0000","last_unstale":"2024-09-13T17:53:31.376188+0000","last_undegraded":"2024-09-13T17:53:31.376188+0000","last_fullsized":"2024-09-13T17:53:31.376188+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:16.635091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"39'9","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381390+0000","last_change":"2024-09-13T17:53:08.337201+0000","last_active":"2024-09-13T17:53:31.381390+0000","last_peered":"2024-09-13T17:53:31.381390+0000","last_clean":"2024-09-13T17:53:31.381390+0000","last_became_active":"2024-09-13T17:53:08.336928+0000","last_became_peered":"2024-09-13T17:53:08.336928+0000","last_unstale":"2024-09-13T17:53:31.381390+0000","last_undegraded":"2024-09-13T17:53:31.381390+0000","last_fullsized":"2024-09-13T17:53:31.381390+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:42.945540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"39'9","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.384315+0000","last_change":"2024-09-13T17:53:08.337600+0000","last_active":"2024-09-13T17:53:31.384315+0000","last_peered":"2024-09-13T17:53:31.384315+0000","last_clean":"2024-09-13T17:53:31.384315+0000","last_became_active":"2024-09-13T17:53:08.337322+0000","last_became_peered":"2024-09-13T17:53:08.337322+0000","last_unstale":"2024-09-13T17:53:31.384315+0000","last_undegraded":"2024-09-13T17:53:31.384315+0000","last_fullsized":"2024-09-13T17:53:31.384315+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:43.484986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"39'10","reported_seq":28,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382965+0000","last_change":"2024-09-13T17:53:08.339093+0000","last_active":"2024-09-13T17:53:31.382965+0000","last_peered":"2024-09-13T17:53:31.382965+0000","last_clean":"2024-09-13T17:53:31.382965+0000","last_became_active":"2024-09-13T17:53:08.338846+0000","last_became_peered":"2024-09-13T17:53:08.338846+0000","last_unstale":"2024-09-13T17:53:31.382965+0000","last_undegraded":"2024-09-13T17:53:31.382965+0000","last_fullsized":"2024-09-13T17:53:31.382965+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:09.561563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"39'7","reported_seq":24,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.374521+0000","last_change":"2024-09-13T17:53:08.312823+0000","last_active":"2024-09-13T17:53:31.374521+0000","last_peered":"2024-09-13T17:53:31.374521+0000","last_clean":"2024-09-13T17:53:31.374521+0000","last_became_active":"2024-09-13T17:53:08.312559+0000","last_became_peered":"2024-09-13T17:53:08.312559+0000","last_unstale":"2024-09-13T17:53:31.374521+0000","last_undegraded":"2024-09-13T17:53:31.374521+0000","last_fullsized":"2024-09-13T17:53:31.374521+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:46.004449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"39'8","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.383288+0000","last_change":"2024-09-13T17:53:08.334938+0000","last_active":"2024-09-13T17:53:31.383288+0000","last_peered":"2024-09-13T17:53:31.383288+0000","last_clean":"2024-09-13T17:53:31.383288+0000","last_became_active":"2024-09-13T17:53:08.334693+0000","last_became_peered":"2024-09-13T17:53:08.334693+0000","last_unstale":"2024-09-13T17:53:31.383288+0000","last_undegraded":"2024-09-13T17:53:31.383288+0000","last_fullsized":"2024-09-13T17:53:31.383288+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:30.620140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"39'11","reported_seq":27,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376492+0000","last_change":"2024-09-13T17:53:08.325433+0000","last_active":"2024-09-13T17:53:31.376492+0000","last_peered":"2024-09-13T17:53:31.376492+0000","last_clean":"2024-09-13T17:53:31.376492+0000","last_became_active":"2024-09-13T17:53:08.325098+0000","last_became_peered":"2024-09-13T17:53:08.325098+0000","last_unstale":"2024-09-13T17:53:31.376492+0000","last_undegraded":"2024-09-13T17:53:31.376492+0000","last_fullsized":"2024-09-13T17:53:31.376492+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:51.440182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"39'9","reported_seq":25,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376675+0000","last_change":"2024-09-13T17:53:08.328964+0000","last_active":"2024-09-13T17:53:31.376675+0000","last_peered":"2024-09-13T17:53:31.376675+0000","last_clean":"2024-09-13T17:53:31.376675+0000","last_became_active":"2024-09-13T17:53:08.328655+0000","last_became_peered":"2024-09-13T17:53:08.328655+0000","last_unstale":"2024-09-13T17:53:31.376675+0000","last_undegraded":"2024-09-13T17:53:31.376675+0000","last_fullsized":"2024-09-13T17:53:31.376675+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:02.621171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"39'8","reported_seq":25,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382204+0000","last_change":"2024-09-13T17:53:08.322892+0000","last_active":"2024-09-13T17:53:31.382204+0000","last_peered":"2024-09-13T17:53:31.382204+0000","last_clean":"2024-09-13T17:53:31.382204+0000","last_became_active":"2024-09-13T17:53:08.322249+0000","last_became_peered":"2024-09-13T17:53:08.322249+0000","last_unstale":"2024-09-13T17:53:31.382204+0000","last_undegraded":"2024-09-13T17:53:31.382204+0000","last_fullsized":"2024-09-13T17:53:31.382204+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:02.660007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"39'6","reported_seq":23,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.374047+0000","last_change":"2024-09-13T17:53:08.313280+0000","last_active":"2024-09-13T17:53:31.374047+0000","last_peered":"2024-09-13T17:53:31.374047+0000","last_clean":"2024-09-13T17:53:31.374047+0000","last_became_active":"2024-09-13T17:53:08.312956+0000","last_became_peered":"2024-09-13T17:53:08.312956+0000","last_unstale":"2024-09-13T17:53:31.374047+0000","last_undegraded":"2024-09-13T17:53:31.374047+0000","last_fullsized":"2024-09-13T17:53:31.374047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:39.411729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"39'2","reported_seq":20,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.383260+0000","last_change":"2024-09-13T17:53:08.320097+0000","last_active":"2024-09-13T17:53:31.383260+0000","last_peered":"2024-09-13T17:53:31.383260+0000","last_clean":"2024-09-13T17:53:31.383260+0000","last_became_active":"2024-09-13T17:53:08.319867+0000","last_became_peered":"2024-09-13T17:53:08.319867+0000","last_unstale":"2024-09-13T17:53:31.383260+0000","last_undegraded":"2024-09-13T17:53:31.383260+0000","last_fullsized":"2024-09-13T17:53:31.383260+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:19.636768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"39'15","reported_seq":32,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382694+0000","last_change":"2024-09-13T17:53:08.334357+0000","last_active":"2024-09-13T17:53:31.382694+0000","last_peered":"2024-09-13T17:53:31.382694+0000","last_clean":"2024-09-13T17:53:31.382694+0000","last_became_active":"2024-09-13T17:53:08.334113+0000","last_became_peered":"2024-09-13T17:53:08.334113+0000","last_unstale":"2024-09-13T17:53:31.382694+0000","last_undegraded":"2024-09-13T17:53:31.382694+0000","last_fullsized":"2024-09-13T17:53:31.382694+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:05.172827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"39'6","reported_seq":24,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.383065+0000","last_change":"2024-09-13T17:53:08.319476+0000","last_active":"2024-09-13T17:53:31.383065+0000","last_peered":"2024-09-13T17:53:31.383065+0000","last_clean":"2024-09-13T17:53:31.383065+0000","last_became_active":"2024-09-13T17:53:08.319209+0000","last_became_peered":"2024-09-13T17:53:08.319209+0000","last_unstale":"2024-09-13T17:53:31.383065+0000","last_undegraded":"2024-09-13T17:53:31.383065+0000","last_fullsized":"2024-09-13T17:53:31.383065+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:05.594213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"39'4","reported_seq":20,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.377097+0000","last_change":"2024-09-13T17:53:08.333716+0000","last_active":"2024-09-13T17:53:31.377097+0000","last_peered":"2024-09-13T17:53:31.377097+0000","last_clean":"2024-09-13T17:53:31.377097+0000","last_became_active":"2024-09-13T17:53:08.333394+0000","last_became_peered":"2024-09-13T17:53:08.333394+0000","last_unstale":"2024-09-13T17:53:31.377097+0000","last_undegraded":"2024-09-13T17:53:31.377097+0000","last_fullsized":"2024-09-13T17:53:31.377097+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:55.588582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"39'7","reported_seq":25,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382908+0000","last_change":"2024-09-13T17:53:08.328272+0000","last_active":"2024-09-13T17:53:31.382908+0000","last_peered":"2024-09-13T17:53:31.382908+0000","last_clean":"2024-09-13T17:53:31.382908+0000","last_became_active":"2024-09-13T17:53:08.328006+0000","last_became_peered":"2024-09-13T17:53:08.328006+0000","last_unstale":"2024-09-13T17:53:31.382908+0000","last_undegraded":"2024-09-13T17:53:31.382908+0000","last_fullsized":"2024-09-13T17:53:31.382908+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:07.544794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"39'8","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382909+0000","last_change":"2024-09-13T17:53:08.319778+0000","last_active":"2024-09-13T17:53:31.382909+0000","last_peered":"2024-09-13T17:53:31.382909+0000","last_clean":"2024-09-13T17:53:31.382909+0000","last_became_active":"2024-09-13T17:53:08.319511+0000","last_became_peered":"2024-09-13T17:53:08.319511+0000","last_unstale":"2024-09-13T17:53:31.382909+0000","last_undegraded":"2024-09-13T17:53:31.382909+0000","last_fullsized":"2024-09-13T17:53:31.382909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:06.338741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"39'12","reported_seq":29,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382297+0000","last_change":"2024-09-13T17:53:08.324346+0000","last_active":"2024-09-13T17:53:31.382297+0000","last_peered":"2024-09-13T17:53:31.382297+0000","last_clean":"2024-09-13T17:53:31.382297+0000","last_became_active":"2024-09-13T17:53:08.322572+0000","last_became_peered":"2024-09-13T17:53:08.322572+0000","last_unstale":"2024-09-13T17:53:31.382297+0000","last_undegraded":"2024-09-13T17:53:31.382297+0000","last_fullsized":"2024-09-13T17:53:31.382297+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:15.154333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"39'9","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.380501+0000","last_change":"2024-09-13T17:53:08.312904+0000","last_active":"2024-09-13T17:53:31.380501+0000","last_peered":"2024-09-13T17:53:31.380501+0000","last_clean":"2024-09-13T17:53:31.380501+0000","last_became_active":"2024-09-13T17:53:08.312650+0000","last_became_peered":"2024-09-13T17:53:08.312650+0000","last_unstale":"2024-09-13T17:53:31.380501+0000","last_undegraded":"2024-09-13T17:53:31.380501+0000","last_fullsized":"2024-09-13T17:53:31.380501+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:42.945540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.108313+0000","last_change":"2024-09-13T17:53:32.105631+0000","last_active":"2024-09-13T17:53:32.108313+0000","last_peered":"2024-09-13T17:53:32.108313+0000","last_clean":"2024-09-13T17:53:32.108313+0000","last_became_active":"2024-09-13T17:53:32.105383+0000","last_became_peered":"2024-09-13T17:53:32.105383+0000","last_unstale":"2024-09-13T17:53:32.108313+0000","last_undegraded":"2024-09-13T17:53:32.108313+0000","last_fullsized":"2024-09-13T17:53:32.108313+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:22.821973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"39'9","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381985+0000","last_change":"2024-09-13T17:53:08.337215+0000","last_active":"2024-09-13T17:53:31.381985+0000","last_peered":"2024-09-13T17:53:31.381985+0000","last_clean":"2024-09-13T17:53:31.381985+0000","last_became_active":"2024-09-13T17:53:08.336968+0000","last_became_peered":"2024-09-13T17:53:08.336968+0000","last_unstale":"2024-09-13T17:53:31.381985+0000","last_undegraded":"2024-09-13T17:53:31.381985+0000","last_fullsized":"2024-09-13T17:53:31.381985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:05.297506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"43'8","reported_seq":27,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.383367+0000","last_change":"2024-09-13T17:53:07.927772+0000","last_active":"2024-09-13T17:53:31.383367+0000","last_peered":"2024-09-13T17:53:31.383367+0000","last_clean":"2024-09-13T17:53:31.383367+0000","last_became_active":"2024-09-13T17:53:07.926833+0000","last_became_peered":"2024-09-13T17:53:07.926833+0000","last_unstale":"2024-09-13T17:53:31.383367+0000","last_undegraded":"2024-09-13T17:53:31.383367+0000","last_fullsized":"2024-09-13T17:53:31.383367+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:26.713460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.109383+0000","last_change":"2024-09-13T17:53:32.108163+0000","last_active":"2024-09-13T17:53:32.109383+0000","last_peered":"2024-09-13T17:53:32.109383+0000","last_clean":"2024-09-13T17:53:32.109383+0000","last_became_active":"2024-09-13T17:53:32.107884+0000","last_became_peered":"2024-09-13T17:53:32.107884+0000","last_unstale":"2024-09-13T17:53:32.109383+0000","last_undegraded":"2024-09-13T17:53:32.109383+0000","last_fullsized":"2024-09-13T17:53:32.109383+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:12.344228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"39'15","reported_seq":32,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381928+0000","last_change":"2024-09-13T17:53:08.331531+0000","last_active":"2024-09-13T17:53:31.381928+0000","last_peered":"2024-09-13T17:53:31.381928+0000","last_clean":"2024-09-13T17:53:31.381928+0000","last_became_active":"2024-09-13T17:53:08.330415+0000","last_became_peered":"2024-09-13T17:53:08.330415+0000","last_unstale":"2024-09-13T17:53:31.381928+0000","last_undegraded":"2024-09-13T17:53:31.381928+0000","last_fullsized":"2024-09-13T17:53:31.381928+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:00.206010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.384809+0000","last_change":"2024-09-13T17:53:07.942858+0000","last_active":"2024-09-13T17:53:31.384809+0000","last_peered":"2024-09-13T17:53:31.384809+0000","last_clean":"2024-09-13T17:53:31.384809+0000","last_became_active":"2024-09-13T17:53:07.942331+0000","last_became_peered":"2024-09-13T17:53:07.942331+0000","last_unstale":"2024-09-13T17:53:31.384809+0000","last_undegraded":"2024-09-13T17:53:31.384809+0000","last_fullsized":"2024-09-13T17:53:31.384809+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:52.434464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.104780+0000","last_change":"2024-09-13T17:53:32.102967+0000","last_active":"2024-09-13T17:53:32.104780+0000","last_peered":"2024-09-13T17:53:32.104780+0000","last_clean":"2024-09-13T17:53:32.104780+0000","last_became_active":"2024-09-13T17:53:32.102424+0000","last_became_peered":"2024-09-13T17:53:32.102424+0000","last_unstale":"2024-09-13T17:53:32.104780+0000","last_undegraded":"2024-09-13T17:53:32.104780+0000","last_fullsized":"2024-09-13T17:53:32.104780+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:40.956685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"39'5","reported_seq":21,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376822+0000","last_change":"2024-09-13T17:53:08.336301+0000","last_active":"2024-09-13T17:53:31.376822+0000","last_peered":"2024-09-13T17:53:31.376822+0000","last_clean":"2024-09-13T17:53:31.376822+0000","last_became_active":"2024-09-13T17:53:08.336060+0000","last_became_peered":"2024-09-13T17:53:08.336060+0000","last_unstale":"2024-09-13T17:53:31.376822+0000","last_undegraded":"2024-09-13T17:53:31.376822+0000","last_fullsized":"2024-09-13T17:53:31.376822+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:58.339595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"43'3","reported_seq":21,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382119+0000","last_change":"2024-09-13T17:53:07.942677+0000","last_active":"2024-09-13T17:53:31.382119+0000","last_peered":"2024-09-13T17:53:31.382119+0000","last_clean":"2024-09-13T17:53:31.382119+0000","last_became_active":"2024-09-13T17:53:07.942426+0000","last_became_peered":"2024-09-13T17:53:07.942426+0000","last_unstale":"2024-09-13T17:53:31.382119+0000","last_undegraded":"2024-09-13T17:53:31.382119+0000","last_fullsized":"2024-09-13T17:53:31.382119+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:08.554504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.111043+0000","last_change":"2024-09-13T17:53:32.107197+0000","last_active":"2024-09-13T17:53:32.111043+0000","last_peered":"2024-09-13T17:53:32.111043+0000","last_clean":"2024-09-13T17:53:32.111043+0000","last_became_active":"2024-09-13T17:53:32.106633+0000","last_became_peered":"2024-09-13T17:53:32.106633+0000","last_unstale":"2024-09-13T17:53:32.111043+0000","last_undegraded":"2024-09-13T17:53:32.111043+0000","last_fullsized":"2024-09-13T17:53:32.111043+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:13.184083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"39'6","reported_seq":23,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381967+0000","last_change":"2024-09-13T17:53:08.327801+0000","last_active":"2024-09-13T17:53:31.381967+0000","last_peered":"2024-09-13T17:53:31.381967+0000","last_clean":"2024-09-13T17:53:31.381967+0000","last_became_active":"2024-09-13T17:53:08.326766+0000","last_became_peered":"2024-09-13T17:53:08.326766+0000","last_unstale":"2024-09-13T17:53:31.381967+0000","last_undegraded":"2024-09-13T17:53:31.381967+0000","last_fullsized":"2024-09-13T17:53:31.381967+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:13.404809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"43'3","reported_seq":20,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376604+0000","last_change":"2024-09-13T17:53:07.931288+0000","last_active":"2024-09-13T17:53:31.376604+0000","last_peered":"2024-09-13T17:53:31.376604+0000","last_clean":"2024-09-13T17:53:31.376604+0000","last_became_active":"2024-09-13T17:53:07.929489+0000","last_became_peered":"2024-09-13T17:53:07.929489+0000","last_unstale":"2024-09-13T17:53:31.376604+0000","last_undegraded":"2024-09-13T17:53:31.376604+0000","last_fullsized":"2024-09-13T17:53:31.376604+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:42.477927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.103840+0000","last_change":"2024-09-13T17:53:32.102337+0000","last_active":"2024-09-13T17:53:32.103840+0000","last_peered":"2024-09-13T17:53:32.103840+0000","last_clean":"2024-09-13T17:53:32.103840+0000","last_became_active":"2024-09-13T17:53:32.102048+0000","last_became_peered":"2024-09-13T17:53:32.102048+0000","last_unstale":"2024-09-13T17:53:32.103840+0000","last_undegraded":"2024-09-13T17:53:32.103840+0000","last_fullsized":"2024-09-13T17:53:32.103840+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:06.380167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"39'8","reported_seq":24,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382427+0000","last_change":"2024-09-13T17:53:08.311242+0000","last_active":"2024-09-13T17:53:31.382427+0000","last_peered":"2024-09-13T17:53:31.382427+0000","last_clean":"2024-09-13T17:53:31.382427+0000","last_became_active":"2024-09-13T17:53:08.310973+0000","last_became_peered":"2024-09-13T17:53:08.310973+0000","last_unstale":"2024-09-13T17:53:31.382427+0000","last_undegraded":"2024-09-13T17:53:31.382427+0000","last_fullsized":"2024-09-13T17:53:31.382427+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:51.440182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376592+0000","last_change":"2024-09-13T17:53:07.930059+0000","last_active":"2024-09-13T17:53:31.376592+0000","last_peered":"2024-09-13T17:53:31.376592+0000","last_clean":"2024-09-13T17:53:31.376592+0000","last_became_active":"2024-09-13T17:53:07.929603+0000","last_became_peered":"2024-09-13T17:53:07.929603+0000","last_unstale":"2024-09-13T17:53:31.376592+0000","last_undegraded":"2024-09-13T17:53:31.376592+0000","last_fullsized":"2024-09-13T17:53:31.376592+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:18.629709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.111583+0000","last_change":"2024-09-13T17:53:32.103405+0000","last_active":"2024-09-13T17:53:32.111583+0000","last_peered":"2024-09-13T17:53:32.111583+0000","last_clean":"2024-09-13T17:53:32.111583+0000","last_became_active":"2024-09-13T17:53:32.103148+0000","last_became_peered":"2024-09-13T17:53:32.103148+0000","last_unstale":"2024-09-13T17:53:32.111583+0000","last_undegraded":"2024-09-13T17:53:32.111583+0000","last_fullsized":"2024-09-13T17:53:32.111583+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:14.259580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"39'10","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376283+0000","last_change":"2024-09-13T17:53:08.330061+0000","last_active":"2024-09-13T17:53:31.376283+0000","last_peered":"2024-09-13T17:53:31.376283+0000","last_clean":"2024-09-13T17:53:31.376283+0000","last_became_active":"2024-09-13T17:53:08.328372+0000","last_became_peered":"2024-09-13T17:53:08.328372+0000","last_unstale":"2024-09-13T17:53:31.376283+0000","last_undegraded":"2024-09-13T17:53:31.376283+0000","last_fullsized":"2024-09-13T17:53:31.376283+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:58.339595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":19,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382009+0000","last_change":"2024-09-13T17:53:07.943158+0000","last_active":"2024-09-13T17:53:31.382009+0000","last_peered":"2024-09-13T17:53:31.382009+0000","last_clean":"2024-09-13T17:53:31.382009+0000","last_became_active":"2024-09-13T17:53:07.942861+0000","last_became_peered":"2024-09-13T17:53:07.942861+0000","last_unstale":"2024-09-13T17:53:31.382009+0000","last_undegraded":"2024-09-13T17:53:31.382009+0000","last_fullsized":"2024-09-13T17:53:31.382009+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:38.404670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.114275+0000","last_change":"2024-09-13T17:53:32.110823+0000","last_active":"2024-09-13T17:53:32.114275+0000","last_peered":"2024-09-13T17:53:32.114275+0000","last_clean":"2024-09-13T17:53:32.114275+0000","last_became_active":"2024-09-13T17:53:32.110474+0000","last_became_peered":"2024-09-13T17:53:32.110474+0000","last_unstale":"2024-09-13T17:53:32.114275+0000","last_undegraded":"2024-09-13T17:53:32.114275+0000","last_fullsized":"2024-09-13T17:53:32.114275+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:11.000415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"39'7","reported_seq":23,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376429+0000","last_change":"2024-09-13T17:53:08.336069+0000","last_active":"2024-09-13T17:53:31.376429+0000","last_peered":"2024-09-13T17:53:31.376429+0000","last_clean":"2024-09-13T17:53:31.376429+0000","last_became_active":"2024-09-13T17:53:08.334174+0000","last_became_peered":"2024-09-13T17:53:08.334174+0000","last_unstale":"2024-09-13T17:53:31.376429+0000","last_undegraded":"2024-09-13T17:53:31.376429+0000","last_fullsized":"2024-09-13T17:53:31.376429+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:42.232554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.380883+0000","last_change":"2024-09-13T17:53:07.940289+0000","last_active":"2024-09-13T17:53:31.380883+0000","last_peered":"2024-09-13T17:53:31.380883+0000","last_clean":"2024-09-13T17:53:31.380883+0000","last_became_active":"2024-09-13T17:53:07.940047+0000","last_became_peered":"2024-09-13T17:53:07.940047+0000","last_unstale":"2024-09-13T17:53:31.380883+0000","last_undegraded":"2024-09-13T17:53:31.380883+0000","last_fullsized":"2024-09-13T17:53:31.380883+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:29.613081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.105410+0000","last_change":"2024-09-13T17:53:32.103595+0000","last_active":"2024-09-13T17:53:32.105410+0000","last_peered":"2024-09-13T17:53:32.105410+0000","last_clean":"2024-09-13T17:53:32.105410+0000","last_became_active":"2024-09-13T17:53:32.103338+0000","last_became_peered":"2024-09-13T17:53:32.103338+0000","last_unstale":"2024-09-13T17:53:32.105410+0000","last_undegraded":"2024-09-13T17:53:32.105410+0000","last_fullsized":"2024-09-13T17:53:32.105410+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:01:32.915840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"39'8","reported_seq":25,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381449+0000","last_change":"2024-09-13T17:53:08.328602+0000","last_active":"2024-09-13T17:53:31.381449+0000","last_peered":"2024-09-13T17:53:31.381449+0000","last_clean":"2024-09-13T17:53:31.381449+0000","last_became_active":"2024-09-13T17:53:08.328360+0000","last_became_peered":"2024-09-13T17:53:08.328360+0000","last_unstale":"2024-09-13T17:53:31.381449+0000","last_undegraded":"2024-09-13T17:53:31.381449+0000","last_fullsized":"2024-09-13T17:53:31.381449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:26.764647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376095+0000","last_change":"2024-09-13T17:53:07.930024+0000","last_active":"2024-09-13T17:53:31.376095+0000","last_peered":"2024-09-13T17:53:31.376095+0000","last_clean":"2024-09-13T17:53:31.376095+0000","last_became_active":"2024-09-13T17:53:07.927170+0000","last_became_peered":"2024-09-13T17:53:07.927170+0000","last_unstale":"2024-09-13T17:53:31.376095+0000","last_undegraded":"2024-09-13T17:53:31.376095+0000","last_fullsized":"2024-09-13T17:53:31.376095+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:15.690853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.109002+0000","last_change":"2024-09-13T17:53:32.108096+0000","last_active":"2024-09-13T17:53:32.109002+0000","last_peered":"2024-09-13T17:53:32.109002+0000","last_clean":"2024-09-13T17:53:32.109002+0000","last_became_active":"2024-09-13T17:53:32.107826+0000","last_became_peered":"2024-09-13T17:53:32.107826+0000","last_unstale":"2024-09-13T17:53:32.109002+0000","last_undegraded":"2024-09-13T17:53:32.109002+0000","last_fullsized":"2024-09-13T17:53:32.109002+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:00.765392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"39'11","reported_seq":28,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.374778+0000","last_change":"2024-09-13T17:53:08.338365+0000","last_active":"2024-09-13T17:53:31.374778+0000","last_peered":"2024-09-13T17:53:31.374778+0000","last_clean":"2024-09-13T17:53:31.374778+0000","last_became_active":"2024-09-13T17:53:08.337999+0000","last_became_peered":"2024-09-13T17:53:08.337999+0000","last_unstale":"2024-09-13T17:53:31.374778+0000","last_undegraded":"2024-09-13T17:53:31.374778+0000","last_fullsized":"2024-09-13T17:53:31.374778+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:24.556344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382039+0000","last_change":"2024-09-13T17:53:07.933052+0000","last_active":"2024-09-13T17:53:31.382039+0000","last_peered":"2024-09-13T17:53:31.382039+0000","last_clean":"2024-09-13T17:53:31.382039+0000","last_became_active":"2024-09-13T17:53:07.932754+0000","last_became_peered":"2024-09-13T17:53:07.932754+0000","last_unstale":"2024-09-13T17:53:31.382039+0000","last_undegraded":"2024-09-13T17:53:31.382039+0000","last_fullsized":"2024-09-13T17:53:31.382039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:01.652948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.116616+0000","last_change":"2024-09-13T17:53:32.111276+0000","last_active":"2024-09-13T17:53:32.116616+0000","last_peered":"2024-09-13T17:53:32.116616+0000","last_clean":"2024-09-13T17:53:32.116616+0000","last_became_active":"2024-09-13T17:53:32.111042+0000","last_became_peered":"2024-09-13T17:53:32.111042+0000","last_unstale":"2024-09-13T17:53:32.116616+0000","last_undegraded":"2024-09-13T17:53:32.116616+0000","last_fullsized":"2024-09-13T17:53:32.116616+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:14.259580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"39'6","reported_seq":23,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.383724+0000","last_change":"2024-09-13T17:53:08.331696+0000","last_active":"2024-09-13T17:53:31.383724+0000","last_peered":"2024-09-13T17:53:31.383724+0000","last_clean":"2024-09-13T17:53:31.383724+0000","last_became_active":"2024-09-13T17:53:08.331416+0000","last_became_peered":"2024-09-13T17:53:08.331416+0000","last_unstale":"2024-09-13T17:53:31.383724+0000","last_undegraded":"2024-09-13T17:53:31.383724+0000","last_fullsized":"2024-09-13T17:53:31.383724+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:00.206010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.377753+0000","last_change":"2024-09-13T17:53:07.933774+0000","last_active":"2024-09-13T17:53:31.377753+0000","last_peered":"2024-09-13T17:53:31.377753+0000","last_clean":"2024-09-13T17:53:31.377753+0000","last_became_active":"2024-09-13T17:53:07.933487+0000","last_became_peered":"2024-09-13T17:53:07.933487+0000","last_unstale":"2024-09-13T17:53:31.377753+0000","last_undegraded":"2024-09-13T17:53:31.377753+0000","last_fullsized":"2024-09-13T17:53:31.377753+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:48.805157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.102158+0000","last_change":"2024-09-13T17:53:32.100642+0000","last_active":"2024-09-13T17:53:32.102158+0000","last_peered":"2024-09-13T17:53:32.102158+0000","last_clean":"2024-09-13T17:53:32.102158+0000","last_became_active":"2024-09-13T17:53:32.100346+0000","last_became_peered":"2024-09-13T17:53:32.100346+0000","last_unstale":"2024-09-13T17:53:32.102158+0000","last_undegraded":"2024-09-13T17:53:32.102158+0000","last_fullsized":"2024-09-13T17:53:32.102158+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:13:26.439602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"39'10","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.384728+0000","last_change":"2024-09-13T17:53:08.311743+0000","last_active":"2024-09-13T17:53:31.384728+0000","last_peered":"2024-09-13T17:53:31.384728+0000","last_clean":"2024-09-13T17:53:31.384728+0000","last_became_active":"2024-09-13T17:53:08.311510+0000","last_became_peered":"2024-09-13T17:53:08.311510+0000","last_unstale":"2024-09-13T17:53:31.384728+0000","last_undegraded":"2024-09-13T17:53:31.384728+0000","last_fullsized":"2024-09-13T17:53:31.384728+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:42.232554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"43'5","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.377383+0000","last_change":"2024-09-13T17:53:07.939168+0000","last_active":"2024-09-13T17:53:31.377383+0000","last_peered":"2024-09-13T17:53:31.377383+0000","last_clean":"2024-09-13T17:53:31.377383+0000","last_became_active":"2024-09-13T17:53:07.938879+0000","last_became_peered":"2024-09-13T17:53:07.938879+0000","last_unstale":"2024-09-13T17:53:31.377383+0000","last_undegraded":"2024-09-13T17:53:31.377383+0000","last_fullsized":"2024-09-13T17:53:31.377383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:04.587154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.099364+0000","last_change":"2024-09-13T17:53:32.096172+0000","last_active":"2024-09-13T17:53:32.099364+0000","last_peered":"2024-09-13T17:53:32.099364+0000","last_clean":"2024-09-13T17:53:32.099364+0000","last_became_active":"2024-09-13T17:53:32.095911+0000","last_became_peered":"2024-09-13T17:53:32.095911+0000","last_unstale":"2024-09-13T17:53:32.099364+0000","last_undegraded":"2024-09-13T17:53:32.099364+0000","last_fullsized":"2024-09-13T17:53:32.099364+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:34.896020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"39'9","reported_seq":25,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376384+0000","last_change":"2024-09-13T17:53:08.335396+0000","last_active":"2024-09-13T17:53:31.376384+0000","last_peered":"2024-09-13T17:53:31.376384+0000","last_clean":"2024-09-13T17:53:31.376384+0000","last_became_active":"2024-09-13T17:53:08.333738+0000","last_became_peered":"2024-09-13T17:53:08.333738+0000","last_unstale":"2024-09-13T17:53:31.376384+0000","last_undegraded":"2024-09-13T17:53:31.376384+0000","last_fullsized":"2024-09-13T17:53:31.376384+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:13.895602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"43'22","reported_seq":40,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381464+0000","last_change":"2024-09-13T17:53:07.940964+0000","last_active":"2024-09-13T17:53:31.381464+0000","last_peered":"2024-09-13T17:53:31.381464+0000","last_clean":"2024-09-13T17:53:31.381464+0000","last_became_active":"2024-09-13T17:53:07.940717+0000","last_became_peered":"2024-09-13T17:53:07.940717+0000","last_unstale":"2024-09-13T17:53:31.381464+0000","last_undegraded":"2024-09-13T17:53:31.381464+0000","last_fullsized":"2024-09-13T17:53:31.381464+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:50.212192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.104565+0000","last_change":"2024-09-13T17:53:32.102489+0000","last_active":"2024-09-13T17:53:32.104565+0000","last_peered":"2024-09-13T17:53:32.104565+0000","last_clean":"2024-09-13T17:53:32.104565+0000","last_became_active":"2024-09-13T17:53:32.102114+0000","last_became_peered":"2024-09-13T17:53:32.102114+0000","last_unstale":"2024-09-13T17:53:32.104565+0000","last_undegraded":"2024-09-13T17:53:32.104565+0000","last_fullsized":"2024-09-13T17:53:32.104565+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:12.344228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"39'6","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382519+0000","last_change":"2024-09-13T17:53:08.337881+0000","last_active":"2024-09-13T17:53:31.382519+0000","last_peered":"2024-09-13T17:53:31.382519+0000","last_clean":"2024-09-13T17:53:31.382519+0000","last_became_active":"2024-09-13T17:53:08.337599+0000","last_became_peered":"2024-09-13T17:53:08.337599+0000","last_unstale":"2024-09-13T17:53:31.382519+0000","last_undegraded":"2024-09-13T17:53:31.382519+0000","last_fullsized":"2024-09-13T17:53:31.382519+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:02.621171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"43'5","reported_seq":23,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381637+0000","last_change":"2024-09-13T17:53:07.929999+0000","last_active":"2024-09-13T17:53:31.381637+0000","last_peered":"2024-09-13T17:53:31.381637+0000","last_clean":"2024-09-13T17:53:31.381637+0000","last_became_active":"2024-09-13T17:53:07.929747+0000","last_became_peered":"2024-09-13T17:53:07.929747+0000","last_unstale":"2024-09-13T17:53:31.381637+0000","last_undegraded":"2024-09-13T17:53:31.381637+0000","last_fullsized":"2024-09-13T17:53:31.381637+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:04.165768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.116696+0000","last_change":"2024-09-13T17:53:32.112299+0000","last_active":"2024-09-13T17:53:32.116696+0000","last_peered":"2024-09-13T17:53:32.116696+0000","last_clean":"2024-09-13T17:53:32.116696+0000","last_became_active":"2024-09-13T17:53:32.111832+0000","last_became_peered":"2024-09-13T17:53:32.111832+0000","last_unstale":"2024-09-13T17:53:32.116696+0000","last_undegraded":"2024-09-13T17:53:32.116696+0000","last_fullsized":"2024-09-13T17:53:32.116696+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:11.000415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"39'6","reported_seq":23,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.380365+0000","last_change":"2024-09-13T17:53:08.323246+0000","last_active":"2024-09-13T17:53:31.380365+0000","last_peered":"2024-09-13T17:53:31.380365+0000","last_clean":"2024-09-13T17:53:31.380365+0000","last_became_active":"2024-09-13T17:53:08.322991+0000","last_became_peered":"2024-09-13T17:53:08.322991+0000","last_unstale":"2024-09-13T17:53:31.380365+0000","last_undegraded":"2024-09-13T17:53:31.380365+0000","last_fullsized":"2024-09-13T17:53:31.380365+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:13.042839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.380709+0000","last_change":"2024-09-13T17:53:07.941959+0000","last_active":"2024-09-13T17:53:31.380709+0000","last_peered":"2024-09-13T17:53:31.380709+0000","last_clean":"2024-09-13T17:53:31.380709+0000","last_became_active":"2024-09-13T17:53:07.941576+0000","last_became_peered":"2024-09-13T17:53:07.941576+0000","last_unstale":"2024-09-13T17:53:31.380709+0000","last_undegraded":"2024-09-13T17:53:31.380709+0000","last_fullsized":"2024-09-13T17:53:31.380709+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:04.911527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.107883+0000","last_change":"2024-09-13T17:53:32.101849+0000","last_active":"2024-09-13T17:53:32.107883+0000","last_peered":"2024-09-13T17:53:32.107883+0000","last_clean":"2024-09-13T17:53:32.107883+0000","last_became_active":"2024-09-13T17:53:32.101578+0000","last_became_peered":"2024-09-13T17:53:32.101578+0000","last_unstale":"2024-09-13T17:53:32.107883+0000","last_undegraded":"2024-09-13T17:53:32.107883+0000","last_fullsized":"2024-09-13T17:53:32.107883+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.850731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"39'10","reported_seq":27,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381914+0000","last_change":"2024-09-13T17:53:08.321715+0000","last_active":"2024-09-13T17:53:31.381914+0000","last_peered":"2024-09-13T17:53:31.381914+0000","last_clean":"2024-09-13T17:53:31.381914+0000","last_became_active":"2024-09-13T17:53:08.321408+0000","last_became_peered":"2024-09-13T17:53:08.321408+0000","last_unstale":"2024-09-13T17:53:31.381914+0000","last_undegraded":"2024-09-13T17:53:31.381914+0000","last_fullsized":"2024-09-13T17:53:31.381914+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:51.219251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":19,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382868+0000","last_change":"2024-09-13T17:53:07.927302+0000","last_active":"2024-09-13T17:53:31.382868+0000","last_peered":"2024-09-13T17:53:31.382868+0000","last_clean":"2024-09-13T17:53:31.382868+0000","last_became_active":"2024-09-13T17:53:07.927010+0000","last_became_peered":"2024-09-13T17:53:07.927010+0000","last_unstale":"2024-09-13T17:53:31.382868+0000","last_undegraded":"2024-09-13T17:53:31.382868+0000","last_fullsized":"2024-09-13T17:53:31.382868+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:58:48.383731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.111930+0000","last_change":"2024-09-13T17:53:32.110907+0000","last_active":"2024-09-13T17:53:32.111930+0000","last_peered":"2024-09-13T17:53:32.111930+0000","last_clean":"2024-09-13T17:53:32.111930+0000","last_became_active":"2024-09-13T17:53:32.110619+0000","last_became_peered":"2024-09-13T17:53:32.110619+0000","last_unstale":"2024-09-13T17:53:32.111930+0000","last_undegraded":"2024-09-13T17:53:32.111930+0000","last_fullsized":"2024-09-13T17:53:32.111930+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:25.801618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"39'15","reported_seq":32,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381546+0000","last_change":"2024-09-13T17:53:08.327193+0000","last_active":"2024-09-13T17:53:31.381546+0000","last_peered":"2024-09-13T17:53:31.381546+0000","last_clean":"2024-09-13T17:53:31.381546+0000","last_became_active":"2024-09-13T17:53:08.326966+0000","last_became_peered":"2024-09-13T17:53:08.326966+0000","last_unstale":"2024-09-13T17:53:31.381546+0000","last_undegraded":"2024-09-13T17:53:31.381546+0000","last_fullsized":"2024-09-13T17:53:31.381546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:22.069383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"43'15","reported_seq":33,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381490+0000","last_change":"2024-09-13T17:53:07.941904+0000","last_active":"2024-09-13T17:53:31.381490+0000","last_peered":"2024-09-13T17:53:31.381490+0000","last_clean":"2024-09-13T17:53:31.381490+0000","last_became_active":"2024-09-13T17:53:07.940899+0000","last_became_peered":"2024-09-13T17:53:07.940899+0000","last_unstale":"2024-09-13T17:53:31.381490+0000","last_undegraded":"2024-09-13T17:53:31.381490+0000","last_fullsized":"2024-09-13T17:53:31.381490+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:29.355126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.109955+0000","last_change":"2024-09-13T17:53:32.108178+0000","last_active":"2024-09-13T17:53:32.109955+0000","last_peered":"2024-09-13T17:53:32.109955+0000","last_clean":"2024-09-13T17:53:32.109955+0000","last_became_active":"2024-09-13T17:53:32.107919+0000","last_became_peered":"2024-09-13T17:53:32.107919+0000","last_unstale":"2024-09-13T17:53:32.109955+0000","last_undegraded":"2024-09-13T17:53:32.109955+0000","last_fullsized":"2024-09-13T17:53:32.109955+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:39.400832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"39'6","reported_seq":23,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381411+0000","last_change":"2024-09-13T17:53:08.325292+0000","last_active":"2024-09-13T17:53:31.381411+0000","last_peered":"2024-09-13T17:53:31.381411+0000","last_clean":"2024-09-13T17:53:31.381411+0000","last_became_active":"2024-09-13T17:53:08.325045+0000","last_became_peered":"2024-09-13T17:53:08.325045+0000","last_unstale":"2024-09-13T17:53:31.381411+0000","last_undegraded":"2024-09-13T17:53:31.381411+0000","last_fullsized":"2024-09-13T17:53:31.381411+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:12.327579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"43'2","reported_seq":19,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.378044+0000","last_change":"2024-09-13T17:53:07.935326+0000","last_active":"2024-09-13T17:53:31.378044+0000","last_peered":"2024-09-13T17:53:31.378044+0000","last_clean":"2024-09-13T17:53:31.378044+0000","last_became_active":"2024-09-13T17:53:07.934994+0000","last_became_peered":"2024-09-13T17:53:07.934994+0000","last_unstale":"2024-09-13T17:53:31.378044+0000","last_undegraded":"2024-09-13T17:53:31.378044+0000","last_fullsized":"2024-09-13T17:53:31.378044+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:05.331682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.109965+0000","last_change":"2024-09-13T17:53:32.107646+0000","last_active":"2024-09-13T17:53:32.109965+0000","last_peered":"2024-09-13T17:53:32.109965+0000","last_clean":"2024-09-13T17:53:32.109965+0000","last_became_active":"2024-09-13T17:53:32.107310+0000","last_became_peered":"2024-09-13T17:53:32.107310+0000","last_unstale":"2024-09-13T17:53:32.109965+0000","last_undegraded":"2024-09-13T17:53:32.109965+0000","last_fullsized":"2024-09-13T17:53:32.109965+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:09.114104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"39'7","reported_seq":23,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.377244+0000","last_change":"2024-09-13T17:53:08.326430+0000","last_active":"2024-09-13T17:53:31.377244+0000","last_peered":"2024-09-13T17:53:31.377244+0000","last_clean":"2024-09-13T17:53:31.377244+0000","last_became_active":"2024-09-13T17:53:08.325310+0000","last_became_peered":"2024-09-13T17:53:08.325310+0000","last_unstale":"2024-09-13T17:53:31.377244+0000","last_undegraded":"2024-09-13T17:53:31.377244+0000","last_fullsized":"2024-09-13T17:53:31.377244+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:02.621171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"43'3","reported_seq":20,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376910+0000","last_change":"2024-09-13T17:53:07.937200+0000","last_active":"2024-09-13T17:53:31.376910+0000","last_peered":"2024-09-13T17:53:31.376910+0000","last_clean":"2024-09-13T17:53:31.376910+0000","last_became_active":"2024-09-13T17:53:07.936933+0000","last_became_peered":"2024-09-13T17:53:07.936933+0000","last_unstale":"2024-09-13T17:53:31.376910+0000","last_undegraded":"2024-09-13T17:53:31.376910+0000","last_fullsized":"2024-09-13T17:53:31.376910+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:41.938481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.114254+0000","last_change":"2024-09-13T17:53:32.108810+0000","last_active":"2024-09-13T17:53:32.114254+0000","last_peered":"2024-09-13T17:53:32.114254+0000","last_clean":"2024-09-13T17:53:32.114254+0000","last_became_active":"2024-09-13T17:53:32.108575+0000","last_became_peered":"2024-09-13T17:53:32.108575+0000","last_unstale":"2024-09-13T17:53:32.114254+0000","last_undegraded":"2024-09-13T17:53:32.114254+0000","last_fullsized":"2024-09-13T17:53:32.114254+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:31.074632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"39'5","reported_seq":21,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376735+0000","last_change":"2024-09-13T17:53:08.329094+0000","last_active":"2024-09-13T17:53:31.376735+0000","last_peered":"2024-09-13T17:53:31.376735+0000","last_clean":"2024-09-13T17:53:31.376735+0000","last_became_active":"2024-09-13T17:53:08.328558+0000","last_became_peered":"2024-09-13T17:53:08.328558+0000","last_unstale":"2024-09-13T17:53:31.376735+0000","last_undegraded":"2024-09-13T17:53:31.376735+0000","last_fullsized":"2024-09-13T17:53:31.376735+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:29.844579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"43'2","reported_seq":20,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.374599+0000","last_change":"2024-09-13T17:53:07.940232+0000","last_active":"2024-09-13T17:53:31.374599+0000","last_peered":"2024-09-13T17:53:31.374599+0000","last_clean":"2024-09-13T17:53:31.374599+0000","last_became_active":"2024-09-13T17:53:07.939995+0000","last_became_peered":"2024-09-13T17:53:07.939995+0000","last_unstale":"2024-09-13T17:53:31.374599+0000","last_undegraded":"2024-09-13T17:53:31.374599+0000","last_fullsized":"2024-09-13T17:53:31.374599+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:30:28.756119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.113826+0000","last_change":"2024-09-13T17:53:32.108083+0000","last_active":"2024-09-13T17:53:32.113826+0000","last_peered":"2024-09-13T17:53:32.113826+0000","last_clean":"2024-09-13T17:53:32.113826+0000","last_became_active":"2024-09-13T17:53:32.107856+0000","last_became_peered":"2024-09-13T17:53:32.107856+0000","last_unstale":"2024-09-13T17:53:32.113826+0000","last_undegraded":"2024-09-13T17:53:32.113826+0000","last_fullsized":"2024-09-13T17:53:32.113826+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:35.208780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"39'9","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.374372+0000","last_change":"2024-09-13T17:53:08.320956+0000","last_active":"2024-09-13T17:53:31.374372+0000","last_peered":"2024-09-13T17:53:31.374372+0000","last_clean":"2024-09-13T17:53:31.374372+0000","last_became_active":"2024-09-13T17:53:08.320328+0000","last_became_peered":"2024-09-13T17:53:08.320328+0000","last_unstale":"2024-09-13T17:53:31.374372+0000","last_undegraded":"2024-09-13T17:53:31.374372+0000","last_fullsized":"2024-09-13T17:53:31.374372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:27.720519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381078+0000","last_change":"2024-09-13T17:53:07.935565+0000","last_active":"2024-09-13T17:53:31.381078+0000","last_peered":"2024-09-13T17:53:31.381078+0000","last_clean":"2024-09-13T17:53:31.381078+0000","last_became_active":"2024-09-13T17:53:07.935314+0000","last_became_peered":"2024-09-13T17:53:07.935314+0000","last_unstale":"2024-09-13T17:53:31.381078+0000","last_undegraded":"2024-09-13T17:53:31.381078+0000","last_fullsized":"2024-09-13T17:53:31.381078+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:18.629709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.114220+0000","last_change":"2024-09-13T17:53:32.108432+0000","last_active":"2024-09-13T17:53:32.114220+0000","last_peered":"2024-09-13T17:53:32.114220+0000","last_clean":"2024-09-13T17:53:32.114220+0000","last_became_active":"2024-09-13T17:53:32.108164+0000","last_became_peered":"2024-09-13T17:53:32.108164+0000","last_unstale":"2024-09-13T17:53:32.114220+0000","last_undegraded":"2024-09-13T17:53:32.114220+0000","last_fullsized":"2024-09-13T17:53:32.114220+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:53.326062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"39'9","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381600+0000","last_change":"2024-09-13T17:53:08.324597+0000","last_active":"2024-09-13T17:53:31.381600+0000","last_peered":"2024-09-13T17:53:31.381600+0000","last_clean":"2024-09-13T17:53:31.381600+0000","last_became_active":"2024-09-13T17:53:08.324266+0000","last_became_peered":"2024-09-13T17:53:08.324266+0000","last_unstale":"2024-09-13T17:53:31.381600+0000","last_undegraded":"2024-09-13T17:53:31.381600+0000","last_fullsized":"2024-09-13T17:53:31.381600+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:16.635091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"43'4","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.374535+0000","last_change":"2024-09-13T17:53:07.930426+0000","last_active":"2024-09-13T17:53:31.374535+0000","last_peered":"2024-09-13T17:53:31.374535+0000","last_clean":"2024-09-13T17:53:31.374535+0000","last_became_active":"2024-09-13T17:53:07.929700+0000","last_became_peered":"2024-09-13T17:53:07.929700+0000","last_unstale":"2024-09-13T17:53:31.374535+0000","last_undegraded":"2024-09-13T17:53:31.374535+0000","last_fullsized":"2024-09-13T17:53:31.374535+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:14.633970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.108673+0000","last_change":"2024-09-13T17:53:32.104602+0000","last_active":"2024-09-13T17:53:32.108673+0000","last_peered":"2024-09-13T17:53:32.108673+0000","last_clean":"2024-09-13T17:53:32.108673+0000","last_became_active":"2024-09-13T17:53:32.104158+0000","last_became_peered":"2024-09-13T17:53:32.104158+0000","last_unstale":"2024-09-13T17:53:32.108673+0000","last_undegraded":"2024-09-13T17:53:32.108673+0000","last_fullsized":"2024-09-13T17:53:32.108673+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:35.786348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"39'2","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382536+0000","last_change":"2024-09-13T17:53:08.311668+0000","last_active":"2024-09-13T17:53:31.382536+0000","last_peered":"2024-09-13T17:53:31.382536+0000","last_clean":"2024-09-13T17:53:31.382536+0000","last_became_active":"2024-09-13T17:53:08.311402+0000","last_became_peered":"2024-09-13T17:53:08.311402+0000","last_unstale":"2024-09-13T17:53:31.382536+0000","last_undegraded":"2024-09-13T17:53:31.382536+0000","last_fullsized":"2024-09-13T17:53:31.382536+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:13.895602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.374365+0000","last_change":"2024-09-13T17:53:07.928071+0000","last_active":"2024-09-13T17:53:31.374365+0000","last_peered":"2024-09-13T17:53:31.374365+0000","last_clean":"2024-09-13T17:53:31.374365+0000","last_became_active":"2024-09-13T17:53:07.927826+0000","last_became_peered":"2024-09-13T17:53:07.927826+0000","last_unstale":"2024-09-13T17:53:31.374365+0000","last_undegraded":"2024-09-13T17:53:31.374365+0000","last_fullsized":"2024-09-13T17:53:31.374365+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:57.190801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.108158+0000","last_change":"2024-09-13T17:53:32.105701+0000","last_active":"2024-09-13T17:53:32.108158+0000","last_peered":"2024-09-13T17:53:32.108158+0000","last_clean":"2024-09-13T17:53:32.108158+0000","last_became_active":"2024-09-13T17:53:32.105369+0000","last_became_peered":"2024-09-13T17:53:32.105369+0000","last_unstale":"2024-09-13T17:53:32.108158+0000","last_undegraded":"2024-09-13T17:53:32.108158+0000","last_fullsized":"2024-09-13T17:53:32.108158+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:15.108493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"39'5","reported_seq":21,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376882+0000","last_change":"2024-09-13T17:53:08.326807+0000","last_active":"2024-09-13T17:53:31.376882+0000","last_peered":"2024-09-13T17:53:31.376882+0000","last_clean":"2024-09-13T17:53:31.376882+0000","last_became_active":"2024-09-13T17:53:08.326532+0000","last_became_peered":"2024-09-13T17:53:08.326532+0000","last_unstale":"2024-09-13T17:53:31.376882+0000","last_undegraded":"2024-09-13T17:53:31.376882+0000","last_fullsized":"2024-09-13T17:53:31.376882+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:41.690036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382382+0000","last_change":"2024-09-13T17:53:07.944383+0000","last_active":"2024-09-13T17:53:31.382382+0000","last_peered":"2024-09-13T17:53:31.382382+0000","last_clean":"2024-09-13T17:53:31.382382+0000","last_became_active":"2024-09-13T17:53:07.944063+0000","last_became_peered":"2024-09-13T17:53:07.944063+0000","last_unstale":"2024-09-13T17:53:31.382382+0000","last_undegraded":"2024-09-13T17:53:31.382382+0000","last_fullsized":"2024-09-13T17:53:31.382382+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:46.511108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.111986+0000","last_change":"2024-09-13T17:53:32.106767+0000","last_active":"2024-09-13T17:53:32.111986+0000","last_peered":"2024-09-13T17:53:32.111986+0000","last_clean":"2024-09-13T17:53:32.111986+0000","last_became_active":"2024-09-13T17:53:32.106509+0000","last_became_peered":"2024-09-13T17:53:32.106509+0000","last_unstale":"2024-09-13T17:53:32.111986+0000","last_undegraded":"2024-09-13T17:53:32.111986+0000","last_fullsized":"2024-09-13T17:53:32.111986+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:31.074632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"39'8","reported_seq":25,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381578+0000","last_change":"2024-09-13T17:53:08.328577+0000","last_active":"2024-09-13T17:53:31.381578+0000","last_peered":"2024-09-13T17:53:31.381578+0000","last_clean":"2024-09-13T17:53:31.381578+0000","last_became_active":"2024-09-13T17:53:08.328314+0000","last_became_peered":"2024-09-13T17:53:08.328314+0000","last_unstale":"2024-09-13T17:53:31.381578+0000","last_undegraded":"2024-09-13T17:53:31.381578+0000","last_fullsized":"2024-09-13T17:53:31.381578+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:00.024100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.374075+0000","last_change":"2024-09-13T17:53:07.924570+0000","last_active":"2024-09-13T17:53:31.374075+0000","last_peered":"2024-09-13T17:53:31.374075+0000","last_clean":"2024-09-13T17:53:31.374075+0000","last_became_active":"2024-09-13T17:53:07.924332+0000","last_became_peered":"2024-09-13T17:53:07.924332+0000","last_unstale":"2024-09-13T17:53:31.374075+0000","last_undegraded":"2024-09-13T17:53:31.374075+0000","last_fullsized":"2024-09-13T17:53:31.374075+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:54.256684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.108822+0000","last_change":"2024-09-13T17:53:32.106757+0000","last_active":"2024-09-13T17:53:32.108822+0000","last_peered":"2024-09-13T17:53:32.108822+0000","last_clean":"2024-09-13T17:53:32.108822+0000","last_became_active":"2024-09-13T17:53:32.106473+0000","last_became_peered":"2024-09-13T17:53:32.106473+0000","last_unstale":"2024-09-13T17:53:32.108822+0000","last_undegraded":"2024-09-13T17:53:32.108822+0000","last_fullsized":"2024-09-13T17:53:32.108822+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:25.554708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"39'9","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.380996+0000","last_change":"2024-09-13T17:53:08.335343+0000","last_active":"2024-09-13T17:53:31.380996+0000","last_peered":"2024-09-13T17:53:31.380996+0000","last_clean":"2024-09-13T17:53:31.380996+0000","last_became_active":"2024-09-13T17:53:08.335164+0000","last_became_peered":"2024-09-13T17:53:08.335164+0000","last_unstale":"2024-09-13T17:53:31.380996+0000","last_undegraded":"2024-09-13T17:53:31.380996+0000","last_fullsized":"2024-09-13T17:53:31.380996+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:48.932531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"43'3","reported_seq":20,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.378203+0000","last_change":"2024-09-13T17:53:07.939026+0000","last_active":"2024-09-13T17:53:31.378203+0000","last_peered":"2024-09-13T17:53:31.378203+0000","last_clean":"2024-09-13T17:53:31.378203+0000","last_became_active":"2024-09-13T17:53:07.938709+0000","last_became_peered":"2024-09-13T17:53:07.938709+0000","last_unstale":"2024-09-13T17:53:31.378203+0000","last_undegraded":"2024-09-13T17:53:31.378203+0000","last_fullsized":"2024-09-13T17:53:31.378203+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:08.554504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.107372+0000","last_change":"2024-09-13T17:53:32.100323+0000","last_active":"2024-09-13T17:53:32.107372+0000","last_peered":"2024-09-13T17:53:32.107372+0000","last_clean":"2024-09-13T17:53:32.107372+0000","last_became_active":"2024-09-13T17:53:32.099731+0000","last_became_peered":"2024-09-13T17:53:32.099731+0000","last_unstale":"2024-09-13T17:53:32.107372+0000","last_undegraded":"2024-09-13T17:53:32.107372+0000","last_fullsized":"2024-09-13T17:53:32.107372+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:55.264342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"39'5","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.384011+0000","last_change":"2024-09-13T17:53:08.335764+0000","last_active":"2024-09-13T17:53:31.384011+0000","last_peered":"2024-09-13T17:53:31.384011+0000","last_clean":"2024-09-13T17:53:31.384011+0000","last_became_active":"2024-09-13T17:53:08.331745+0000","last_became_peered":"2024-09-13T17:53:08.331745+0000","last_unstale":"2024-09-13T17:53:31.384011+0000","last_undegraded":"2024-09-13T17:53:31.384011+0000","last_fullsized":"2024-09-13T17:53:31.384011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:05.172827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"43'4","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.374374+0000","last_change":"2024-09-13T17:53:07.939210+0000","last_active":"2024-09-13T17:53:31.374374+0000","last_peered":"2024-09-13T17:53:31.374374+0000","last_clean":"2024-09-13T17:53:31.374374+0000","last_became_active":"2024-09-13T17:53:07.938689+0000","last_became_peered":"2024-09-13T17:53:07.938689+0000","last_unstale":"2024-09-13T17:53:31.374374+0000","last_undegraded":"2024-09-13T17:53:31.374374+0000","last_fullsized":"2024-09-13T17:53:31.374374+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:30.156095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.111878+0000","last_change":"2024-09-13T17:53:32.110839+0000","last_active":"2024-09-13T17:53:32.111878+0000","last_peered":"2024-09-13T17:53:32.111878+0000","last_clean":"2024-09-13T17:53:32.111878+0000","last_became_active":"2024-09-13T17:53:32.110560+0000","last_became_peered":"2024-09-13T17:53:32.110560+0000","last_unstale":"2024-09-13T17:53:32.111878+0000","last_undegraded":"2024-09-13T17:53:32.111878+0000","last_fullsized":"2024-09-13T17:53:32.111878+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:47.101607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"39'7","reported_seq":24,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381455+0000","last_change":"2024-09-13T17:53:08.338753+0000","last_active":"2024-09-13T17:53:31.381455+0000","last_peered":"2024-09-13T17:53:31.381455+0000","last_clean":"2024-09-13T17:53:31.381455+0000","last_became_active":"2024-09-13T17:53:08.338513+0000","last_became_peered":"2024-09-13T17:53:08.338513+0000","last_unstale":"2024-09-13T17:53:31.381455+0000","last_undegraded":"2024-09-13T17:53:31.381455+0000","last_fullsized":"2024-09-13T17:53:31.381455+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:24.057582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.384689+0000","last_change":"2024-09-13T17:53:07.933119+0000","last_active":"2024-09-13T17:53:31.384689+0000","last_peered":"2024-09-13T17:53:31.384689+0000","last_clean":"2024-09-13T17:53:31.384689+0000","last_became_active":"2024-09-13T17:53:07.932786+0000","last_became_peered":"2024-09-13T17:53:07.932786+0000","last_unstale":"2024-09-13T17:53:31.384689+0000","last_undegraded":"2024-09-13T17:53:31.384689+0000","last_fullsized":"2024-09-13T17:53:31.384689+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:54.581523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.108736+0000","last_change":"2024-09-13T17:53:32.107576+0000","last_active":"2024-09-13T17:53:32.108736+0000","last_peered":"2024-09-13T17:53:32.108736+0000","last_clean":"2024-09-13T17:53:32.108736+0000","last_became_active":"2024-09-13T17:53:32.107173+0000","last_became_peered":"2024-09-13T17:53:32.107173+0000","last_unstale":"2024-09-13T17:53:32.108736+0000","last_undegraded":"2024-09-13T17:53:32.108736+0000","last_fullsized":"2024-09-13T17:53:32.108736+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:32.778630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"39'8","reported_seq":24,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382607+0000","last_change":"2024-09-13T17:53:08.321422+0000","last_active":"2024-09-13T17:53:31.382607+0000","last_peered":"2024-09-13T17:53:31.382607+0000","last_clean":"2024-09-13T17:53:31.382607+0000","last_became_active":"2024-09-13T17:53:08.319507+0000","last_became_peered":"2024-09-13T17:53:08.319507+0000","last_unstale":"2024-09-13T17:53:31.382607+0000","last_undegraded":"2024-09-13T17:53:31.382607+0000","last_fullsized":"2024-09-13T17:53:31.382607+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:08.746286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382832+0000","last_change":"2024-09-13T17:53:07.929110+0000","last_active":"2024-09-13T17:53:31.382832+0000","last_peered":"2024-09-13T17:53:31.382832+0000","last_clean":"2024-09-13T17:53:31.382832+0000","last_became_active":"2024-09-13T17:53:07.928830+0000","last_became_peered":"2024-09-13T17:53:07.928830+0000","last_unstale":"2024-09-13T17:53:31.382832+0000","last_undegraded":"2024-09-13T17:53:31.382832+0000","last_fullsized":"2024-09-13T17:53:31.382832+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:42.477927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.111729+0000","last_change":"2024-09-13T17:53:32.110535+0000","last_active":"2024-09-13T17:53:32.111729+0000","last_peered":"2024-09-13T17:53:32.111729+0000","last_clean":"2024-09-13T17:53:32.111729+0000","last_became_active":"2024-09-13T17:53:32.110153+0000","last_became_peered":"2024-09-13T17:53:32.110153+0000","last_unstale":"2024-09-13T17:53:32.111729+0000","last_undegraded":"2024-09-13T17:53:32.111729+0000","last_fullsized":"2024-09-13T17:53:32.111729+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:00.765392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"39'5","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.380800+0000","last_change":"2024-09-13T17:53:08.316509+0000","last_active":"2024-09-13T17:53:31.380800+0000","last_peered":"2024-09-13T17:53:31.380800+0000","last_clean":"2024-09-13T17:53:31.380800+0000","last_became_active":"2024-09-13T17:53:08.316323+0000","last_became_peered":"2024-09-13T17:53:08.316323+0000","last_unstale":"2024-09-13T17:53:31.380800+0000","last_undegraded":"2024-09-13T17:53:31.380800+0000","last_fullsized":"2024-09-13T17:53:31.380800+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:02.660007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":19,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.383017+0000","last_change":"2024-09-13T17:53:07.928968+0000","last_active":"2024-09-13T17:53:31.383017+0000","last_peered":"2024-09-13T17:53:31.383017+0000","last_clean":"2024-09-13T17:53:31.383017+0000","last_became_active":"2024-09-13T17:53:07.928753+0000","last_became_peered":"2024-09-13T17:53:07.928753+0000","last_unstale":"2024-09-13T17:53:31.383017+0000","last_undegraded":"2024-09-13T17:53:31.383017+0000","last_fullsized":"2024-09-13T17:53:31.383017+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:14.788101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.114041+0000","last_change":"2024-09-13T17:53:32.110324+0000","last_active":"2024-09-13T17:53:32.114041+0000","last_peered":"2024-09-13T17:53:32.114041+0000","last_clean":"2024-09-13T17:53:32.114041+0000","last_became_active":"2024-09-13T17:53:32.110069+0000","last_became_peered":"2024-09-13T17:53:32.110069+0000","last_unstale":"2024-09-13T17:53:32.114041+0000","last_undegraded":"2024-09-13T17:53:32.114041+0000","last_fullsized":"2024-09-13T17:53:32.114041+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:06.089266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"39'8","reported_seq":24,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376311+0000","last_change":"2024-09-13T17:53:08.337370+0000","last_active":"2024-09-13T17:53:31.376311+0000","last_peered":"2024-09-13T17:53:31.376311+0000","last_clean":"2024-09-13T17:53:31.376311+0000","last_became_active":"2024-09-13T17:53:08.335729+0000","last_became_peered":"2024-09-13T17:53:08.335729+0000","last_unstale":"2024-09-13T17:53:31.376311+0000","last_undegraded":"2024-09-13T17:53:31.376311+0000","last_fullsized":"2024-09-13T17:53:31.376311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:24.523487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376319+0000","last_change":"2024-09-13T17:53:07.923741+0000","last_active":"2024-09-13T17:53:31.376319+0000","last_peered":"2024-09-13T17:53:31.376319+0000","last_clean":"2024-09-13T17:53:31.376319+0000","last_became_active":"2024-09-13T17:53:07.922391+0000","last_became_peered":"2024-09-13T17:53:07.922391+0000","last_unstale":"2024-09-13T17:53:31.376319+0000","last_undegraded":"2024-09-13T17:53:31.376319+0000","last_fullsized":"2024-09-13T17:53:31.376319+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:54.581523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.114071+0000","last_change":"2024-09-13T17:53:32.109262+0000","last_active":"2024-09-13T17:53:32.114071+0000","last_peered":"2024-09-13T17:53:32.114071+0000","last_clean":"2024-09-13T17:53:32.114071+0000","last_became_active":"2024-09-13T17:53:32.109089+0000","last_became_peered":"2024-09-13T17:53:32.109089+0000","last_unstale":"2024-09-13T17:53:32.114071+0000","last_undegraded":"2024-09-13T17:53:32.114071+0000","last_fullsized":"2024-09-13T17:53:32.114071+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.850731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"39'7","reported_seq":24,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.383411+0000","last_change":"2024-09-13T17:53:08.330564+0000","last_active":"2024-09-13T17:53:31.383411+0000","last_peered":"2024-09-13T17:53:31.383411+0000","last_clean":"2024-09-13T17:53:31.383411+0000","last_became_active":"2024-09-13T17:53:08.326426+0000","last_became_peered":"2024-09-13T17:53:08.326426+0000","last_unstale":"2024-09-13T17:53:31.383411+0000","last_undegraded":"2024-09-13T17:53:31.383411+0000","last_fullsized":"2024-09-13T17:53:31.383411+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:48.932531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.380452+0000","last_change":"2024-09-13T17:53:07.928173+0000","last_active":"2024-09-13T17:53:31.380452+0000","last_peered":"2024-09-13T17:53:31.380452+0000","last_clean":"2024-09-13T17:53:31.380452+0000","last_became_active":"2024-09-13T17:53:07.927902+0000","last_became_peered":"2024-09-13T17:53:07.927902+0000","last_unstale":"2024-09-13T17:53:31.380452+0000","last_undegraded":"2024-09-13T17:53:31.380452+0000","last_fullsized":"2024-09-13T17:53:31.380452+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:14.147274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.107430+0000","last_change":"2024-09-13T17:53:32.100622+0000","last_active":"2024-09-13T17:53:32.107430+0000","last_peered":"2024-09-13T17:53:32.107430+0000","last_clean":"2024-09-13T17:53:32.107430+0000","last_became_active":"2024-09-13T17:53:32.100391+0000","last_became_peered":"2024-09-13T17:53:32.100391+0000","last_unstale":"2024-09-13T17:53:32.107430+0000","last_undegraded":"2024-09-13T17:53:32.107430+0000","last_fullsized":"2024-09-13T17:53:32.107430+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:46.775837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"39'8","reported_seq":24,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.377828+0000","last_change":"2024-09-13T17:53:08.335357+0000","last_active":"2024-09-13T17:53:31.377828+0000","last_peered":"2024-09-13T17:53:31.377828+0000","last_clean":"2024-09-13T17:53:31.377828+0000","last_became_active":"2024-09-13T17:53:08.334939+0000","last_became_peered":"2024-09-13T17:53:08.334939+0000","last_unstale":"2024-09-13T17:53:31.377828+0000","last_undegraded":"2024-09-13T17:53:31.377828+0000","last_fullsized":"2024-09-13T17:53:31.377828+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:48.932531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382199+0000","last_change":"2024-09-13T17:53:07.943953+0000","last_active":"2024-09-13T17:53:31.382199+0000","last_peered":"2024-09-13T17:53:31.382199+0000","last_clean":"2024-09-13T17:53:31.382199+0000","last_became_active":"2024-09-13T17:53:07.943699+0000","last_became_peered":"2024-09-13T17:53:07.943699+0000","last_unstale":"2024-09-13T17:53:31.382199+0000","last_undegraded":"2024-09-13T17:53:31.382199+0000","last_fullsized":"2024-09-13T17:53:31.382199+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:44.997390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381695+0000","last_change":"2024-09-13T17:51:40.205691+0000","last_active":"2024-09-13T17:53:31.381695+0000","last_peered":"2024-09-13T17:53:31.381695+0000","last_clean":"2024-09-13T17:53:31.381695+0000","last_became_active":"2024-09-13T17:51:40.204577+0000","last_became_peered":"2024-09-13T17:51:40.204577+0000","last_unstale":"2024-09-13T17:53:31.381695+0000","last_undegraded":"2024-09-13T17:53:31.381695+0000","last_fullsized":"2024-09-13T17:53:31.381695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_clean_scrub_stamp":"2024-09-13T17:51:38.340495+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:37.899275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":504,"ondisk_log_size":504,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":95,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30192,"kb_used_data":3164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341648,"statfs":{"total":96636764160,"available":96605847552,"internally_reserved":0,"allocated":3239936,"data_stored":2934464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.627},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.60699999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.873}]},{"osd":3,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.70199999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.85099999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.81699999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.755},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.72599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":548864,"data_stored":246944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.59899999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.48899999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.63400000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.57999999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.66200000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.56100000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.69299999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33696,"kb_used_data":6668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338144,"statfs":{"total":96636764160,"available":96602259456,"internally_reserved":0,"allocated":6828032,"data_stored":6530727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.76500000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.79200000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.0910000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.751},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.73999999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.68100000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.52500000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.58099999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.621}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":548864,"data_stored":246944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.64000000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.71899999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.623},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.74099999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.69199999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.76800000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.85699999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.83899999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31664,"kb_used_data":4632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340176,"statfs":{"total":96636764160,"available":96604340224,"internally_reserved":0,"allocated":4743168,"data_stored":4441248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.37},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":4.2460000000000004,"5min":4.2460000000000004,"15min":4.2460000000000004},"last":0.39100000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.008,"5min":5.008,"15min":5.008},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.41399999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":4.8570000000000002,"5min":4.8570000000000002,"15min":4.8570000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":4.8399999999999999,"5min":4.8399999999999999,"15min":4.8399999999999999},"last":0.45600000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":4.4450000000000003,"5min":4.4450000000000003,"15min":4.4450000000000003},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":4.9000000000000004,"5min":4.9000000000000004,"15min":4.9000000000000004},"last":0.67200000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":1.208},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":1.083}]},{"osd":6,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":4.9710000000000001,"5min":4.9710000000000001,"15min":4.9710000000000001},"last":1.1879999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":1.0309999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":4.4029999999999996,"5min":4.4029999999999996,"15min":4.4029999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":4.9349999999999996,"5min":4.9349999999999996,"15min":4.9349999999999996},"last":1.2270000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":548864,"data_stored":246944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":5.5010000000000003,"5min":5.5010000000000003,"15min":5.5010000000000003},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":4.3689999999999998,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.36199999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":5.3799999999999999,"5min":5.3799999999999999,"15min":5.3799999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":4.2329999999999997,"5min":4.2329999999999997,"15min":4.2329999999999997},"last":0.51100000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":5.032,"5min":5.032,"15min":5.032},"last":0.48599999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":5.4189999999999996,"5min":5.4189999999999996,"15min":5.4189999999999996},"last":0.46500000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":5.4480000000000004,"5min":5.4480000000000004,"15min":5.4480000000000004},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":4.7460000000000004,"5min":4.7460000000000004,"15min":4.7460000000000004},"last":0.70999999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":4.4710000000000001,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":5.4749999999999996,"5min":5.4749999999999996,"15min":5.4749999999999996},"last":0.71899999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":4.7789999999999999,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":4.9859999999999998,"5min":4.9859999999999998,"15min":4.9859999999999998},"last":0.80100000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":4.8200000000000003,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":4.8879999999999999,"5min":4.8879999999999999,"15min":4.8879999999999999},"last":0.85099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":548864,"data_stored":246944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.49299999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.42499999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.40400000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.65900000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.55700000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.69199999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.67700000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1142784,"data_stored":837312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.34100000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.63400000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.67000000000000004}]},{"osd":4,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.0350000000000001,"5min":3.0350000000000001,"15min":3.0350000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.68100000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.755}]},{"osd":7,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.9119999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.75,"5min":2.75,"15min":2.75},"last":0.57999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:53:36.474 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:53:36.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.638+0000 7fd27fc00640 1 Processor -- start 2024-09-13T17:53:36.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.638+0000 7fd27fc00640 1 -- start start 2024-09-13T17:53:36.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.638+0000 7fd27fc00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd27813c240 0x7fd27813f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:36.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.642+0000 7fd27fc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd27813c980 0x7fd27806d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:36.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.642+0000 7fd27fc00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2780cd220 con 0x7fd27806da90 2024-09-13T17:53:36.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.642+0000 7fd27fc00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd27813f960 con 0x7fd27813c240 2024-09-13T17:53:36.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.642+0000 7fd27fc00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27806ded0 con 0x7fd27813c980 2024-09-13T17:53:36.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.642+0000 7fd26fe00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd27813c980 0x7fd27806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:36.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.642+0000 7fd27d200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd27813c240 0x7fd27813f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:36.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.642+0000 7fd26fe00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd27813c980 0x7fd27806d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:34020/0 (socket says 172.21.15.114:34020) 2024-09-13T17:53:36.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.642+0000 7fd27d200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd27813c240 0x7fd27813f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:43784/0 (socket says 172.21.15.114:43784) 2024-09-13T17:53:36.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.642+0000 7fd26fe00640 1 -- 172.21.15.114:0/3888805816 learned_addr learned my addr 172.21.15.114:0/3888805816 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:36.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.642+0000 7fd27d200640 1 -- 172.21.15.114:0/3888805816 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd27813c980 msgr2=0x7fd27806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:36.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.642+0000 7fd27d200640 1 --2- 172.21.15.114:0/3888805816 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd27813c980 0x7fd27806d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:36.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.642+0000 7fd27d200640 1 -- 172.21.15.114:0/3888805816 >> v1:172.21.15.134:6789/0 conn(0x7fd27806da90 legacy=0x7fd2780cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:36.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.642+0000 7fd27d200640 1 -- 172.21.15.114:0/3888805816 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27815a740 con 0x7fd27813c240 2024-09-13T17:53:36.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.642+0000 7fd26fe00640 1 --2- 172.21.15.114:0/3888805816 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd27813c980 0x7fd27806d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:53:36.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.646+0000 7fd27d200640 1 --2- 172.21.15.114:0/3888805816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd27813c240 0x7fd27813f420 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd2680097c0 tx=0x7fd26801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e40fbf75fb8cc51 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:36.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.646+0000 7fd277e00640 1 -- 172.21.15.114:0/3888805816 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2680ab670 con 0x7fd27813c240 2024-09-13T17:53:36.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.646+0000 7fd277e00640 1 -- 172.21.15.114:0/3888805816 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2680ab7d0 con 0x7fd27813c240 2024-09-13T17:53:36.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.646+0000 7fd277e00640 1 -- 172.21.15.114:0/3888805816 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2680abb60 con 0x7fd27813c240 2024-09-13T17:53:36.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.646+0000 7fd27fc00640 1 -- 172.21.15.114:0/3888805816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd27813c240 msgr2=0x7fd27813f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:36.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.646+0000 7fd27fc00640 1 --2- 172.21.15.114:0/3888805816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd27813c240 0x7fd27813f420 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd2680097c0 tx=0x7fd26801c470 comp rx=0 tx=0).stop 2024-09-13T17:53:36.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.646+0000 7fd27fc00640 1 -- 172.21.15.114:0/3888805816 shutdown_connections 2024-09-13T17:53:36.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.646+0000 7fd27fc00640 1 --2- 172.21.15.114:0/3888805816 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd27813c980 0x7fd27806d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:36.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.646+0000 7fd27fc00640 1 --2- 172.21.15.114:0/3888805816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd27813c240 0x7fd27813f420 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:36.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.646+0000 7fd27fc00640 1 -- 172.21.15.114:0/3888805816 >> 172.21.15.114:0/3888805816 conn(0x7fd2780660b0 msgr2=0x7fd278069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:36.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.646+0000 7fd27fc00640 1 -- 172.21.15.114:0/3888805816 shutdown_connections 2024-09-13T17:53:36.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.646+0000 7fd27fc00640 1 -- 172.21.15.114:0/3888805816 wait complete. 2024-09-13T17:53:36.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.646+0000 7fd27fc00640 1 Processor -- start 2024-09-13T17:53:36.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.646+0000 7fd27fc00640 1 -- start start 2024-09-13T17:53:36.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.646+0000 7fd27fc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd27806da90 0x7fd2780aea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:36.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.650+0000 7fd27fc00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd27813c240 0x7fd2780b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:36.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.650+0000 7fd27fc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd27813c980 0x7fd2780b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:36.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.650+0000 7fd27fc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2780abe60 con 0x7fd27813c980 2024-09-13T17:53:36.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.650+0000 7fd27fc00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2780af070 con 0x7fd27813c240 2024-09-13T17:53:36.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.650+0000 7fd27fc00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2780af350 con 0x7fd27806da90 2024-09-13T17:53:36.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.650+0000 7fd27dc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd27813c980 0x7fd2780b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:36.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.650+0000 7fd27d200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd27806da90 0x7fd2780aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:36.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.650+0000 7fd27d200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd27806da90 0x7fd2780aea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:34024/0 (socket says 172.21.15.114:34024) 2024-09-13T17:53:36.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.650+0000 7fd27d200640 1 -- 172.21.15.114:0/3237882487 learned_addr learned my addr 172.21.15.114:0/3237882487 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:36.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.650+0000 7fd26fe00640 1 --2- 172.21.15.114:0/3237882487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd27813c240 0x7fd2780b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:36.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.650+0000 7fd27d200640 1 -- 172.21.15.114:0/3237882487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd27813c240 msgr2=0x7fd2780b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:36.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.650+0000 7fd27d200640 1 --2- 172.21.15.114:0/3237882487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd27813c240 0x7fd2780b0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:36.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.650+0000 7fd27d200640 1 -- 172.21.15.114:0/3237882487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd27813c980 msgr2=0x7fd2780b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:36.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.650+0000 7fd27d200640 1 --2- 172.21.15.114:0/3237882487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd27813c980 0x7fd2780b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:36.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.650+0000 7fd27d200640 1 -- 172.21.15.114:0/3237882487 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2600094d0 con 0x7fd27806da90 2024-09-13T17:53:36.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.650+0000 7fd27d200640 1 --2- 172.21.15.114:0/3237882487 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd27806da90 0x7fd2780aea00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd26801ab20 tx=0x7fd26801acb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:36.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.650+0000 7fd275600640 1 -- 172.21.15.114:0/3237882487 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2680bf610 con 0x7fd27806da90 2024-09-13T17:53:36.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.650+0000 7fd275600640 1 -- 172.21.15.114:0/3237882487 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2680bf790 con 0x7fd27806da90 2024-09-13T17:53:36.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.650+0000 7fd27fc00640 1 -- 172.21.15.114:0/3237882487 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd268009420 con 0x7fd27806da90 2024-09-13T17:53:36.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.650+0000 7fd275600640 1 -- 172.21.15.114:0/3237882487 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2680bfb40 con 0x7fd27806da90 2024-09-13T17:53:36.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.650+0000 7fd27fc00640 1 -- 172.21.15.114:0/3237882487 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2780b0fe0 con 0x7fd27806da90 2024-09-13T17:53:36.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.650+0000 7fd27fc00640 1 -- 172.21.15.114:0/3237882487 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2780ab8e0 con 0x7fd27806da90 2024-09-13T17:53:36.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.650+0000 7fd275600640 1 -- 172.21.15.114:0/3237882487 <== mon.2 v2:172.21.15.134:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd2680059a0 con 0x7fd27806da90 2024-09-13T17:53:36.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.654+0000 7fd275600640 1 --2- 172.21.15.114:0/3237882487 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd254066690 0x7fd254068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:36.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.654+0000 7fd275600640 1 -- 172.21.15.114:0/3237882487 <== mon.2 v2:172.21.15.134:3301/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7fd26811f820 con 0x7fd27806da90 2024-09-13T17:53:36.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.654+0000 7fd26fe00640 1 --2- 172.21.15.114:0/3237882487 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd254066690 0x7fd254068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:36.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.654+0000 7fd26fe00640 1 --2- 172.21.15.114:0/3237882487 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd254066690 0x7fd254068b50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd2781595d0 tx=0x7fd260009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:36.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.658+0000 7fd275600640 1 -- 172.21.15.114:0/3237882487 <== mon.2 v2:172.21.15.134:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd2680ec8b0 con 0x7fd27806da90 2024-09-13T17:53:36.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.810+0000 7fd27fc00640 1 -- 172.21.15.114:0/3237882487 --> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd27813c620 con 0x7fd254066690 2024-09-13T17:53:36.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.818+0000 7fd275600640 1 -- 172.21.15.114:0/3237882487 <== mgr.4102 v2:172.21.15.114:6832/137691478 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369195 (secure 0 0 0) 0x7fd2600098c0 con 0x7fd254066690 2024-09-13T17:53:36.824 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:36.830 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-13T17:53:36.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.822+0000 7fd27fc00640 1 -- 172.21.15.114:0/3237882487 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd254066690 msgr2=0x7fd254068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:36.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.822+0000 7fd27fc00640 1 --2- 172.21.15.114:0/3237882487 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd254066690 0x7fd254068b50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd2781595d0 tx=0x7fd260009240 comp rx=0 tx=0).stop 2024-09-13T17:53:36.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.822+0000 7fd27fc00640 1 -- 172.21.15.114:0/3237882487 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd27806da90 msgr2=0x7fd2780aea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:36.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.822+0000 7fd27fc00640 1 --2- 172.21.15.114:0/3237882487 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd27806da90 0x7fd2780aea00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd26801ab20 tx=0x7fd26801acb0 comp rx=0 tx=0).stop 2024-09-13T17:53:36.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.822+0000 7fd27fc00640 1 -- 172.21.15.114:0/3237882487 shutdown_connections 2024-09-13T17:53:36.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.822+0000 7fd27fc00640 1 --2- 172.21.15.114:0/3237882487 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd254066690 0x7fd254068b50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:36.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.822+0000 7fd27fc00640 1 --2- 172.21.15.114:0/3237882487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd27813c980 0x7fd2780b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:36.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.822+0000 7fd27fc00640 1 --2- 172.21.15.114:0/3237882487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd27813c240 0x7fd2780b0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:36.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.822+0000 7fd27fc00640 1 --2- 172.21.15.114:0/3237882487 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd27806da90 0x7fd2780aea00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:36.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.822+0000 7fd27fc00640 1 -- 172.21.15.114:0/3237882487 >> 172.21.15.114:0/3237882487 conn(0x7fd2780660b0 msgr2=0x7fd27806cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:36.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.822+0000 7fd27fc00640 1 -- 172.21.15.114:0/3237882487 shutdown_connections 2024-09-13T17:53:36.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:36.822+0000 7fd27fc00640 1 -- 172.21.15.114:0/3237882487 wait complete. 2024-09-13T17:53:36.847 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2024-09-13T17:53:35.956742+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6881824,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":100,"num_write":258,"num_write_kb":8601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":703,"ondisk_log_size":703,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":199,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233948,"kb_used_data":17724,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754740772,"statfs":{"total":773094113280,"available":772854550528,"internally_reserved":0,"allocated":18149376,"data_stored":15731527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-18808,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.591272"},"pg_stats":[{"pgid":"6.3f","version":"39'8","reported_seq":25,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381981+0000","last_change":"2024-09-13T17:53:08.328059+0000","last_active":"2024-09-13T17:53:31.381981+0000","last_peered":"2024-09-13T17:53:31.381981+0000","last_clean":"2024-09-13T17:53:31.381981+0000","last_became_active":"2024-09-13T17:53:08.326969+0000","last_became_peered":"2024-09-13T17:53:08.326969+0000","last_unstale":"2024-09-13T17:53:31.381981+0000","last_undegraded":"2024-09-13T17:53:31.381981+0000","last_fullsized":"2024-09-13T17:53:31.381981+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:02.633358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"39'4","reported_seq":21,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381368+0000","last_change":"2024-09-13T17:53:08.322031+0000","last_active":"2024-09-13T17:53:31.381368+0000","last_peered":"2024-09-13T17:53:31.381368+0000","last_clean":"2024-09-13T17:53:31.381368+0000","last_became_active":"2024-09-13T17:53:08.320784+0000","last_became_peered":"2024-09-13T17:53:08.320784+0000","last_unstale":"2024-09-13T17:53:31.381368+0000","last_undegraded":"2024-09-13T17:53:31.381368+0000","last_fullsized":"2024-09-13T17:53:31.381368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:11.750011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"39'7","reported_seq":23,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.385235+0000","last_change":"2024-09-13T17:53:08.337321+0000","last_active":"2024-09-13T17:53:31.385235+0000","last_peered":"2024-09-13T17:53:31.385235+0000","last_clean":"2024-09-13T17:53:31.385235+0000","last_became_active":"2024-09-13T17:53:08.337068+0000","last_became_peered":"2024-09-13T17:53:08.337068+0000","last_unstale":"2024-09-13T17:53:31.385235+0000","last_undegraded":"2024-09-13T17:53:31.385235+0000","last_fullsized":"2024-09-13T17:53:31.385235+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:29.844579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"39'8","reported_seq":25,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.374732+0000","last_change":"2024-09-13T17:53:08.338221+0000","last_active":"2024-09-13T17:53:31.374732+0000","last_peered":"2024-09-13T17:53:31.374732+0000","last_clean":"2024-09-13T17:53:31.374732+0000","last_became_active":"2024-09-13T17:53:08.337670+0000","last_became_peered":"2024-09-13T17:53:08.337670+0000","last_unstale":"2024-09-13T17:53:31.374732+0000","last_undegraded":"2024-09-13T17:53:31.374732+0000","last_fullsized":"2024-09-13T17:53:31.374732+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:04:50.600660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"39'4","reported_seq":21,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.374446+0000","last_change":"2024-09-13T17:53:08.338777+0000","last_active":"2024-09-13T17:53:31.374446+0000","last_peered":"2024-09-13T17:53:31.374446+0000","last_clean":"2024-09-13T17:53:31.374446+0000","last_became_active":"2024-09-13T17:53:08.338519+0000","last_became_peered":"2024-09-13T17:53:08.338519+0000","last_unstale":"2024-09-13T17:53:31.374446+0000","last_undegraded":"2024-09-13T17:53:31.374446+0000","last_fullsized":"2024-09-13T17:53:31.374446+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:15.795161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"39'6","reported_seq":23,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.380622+0000","last_change":"2024-09-13T17:53:08.321284+0000","last_active":"2024-09-13T17:53:31.380622+0000","last_peered":"2024-09-13T17:53:31.380622+0000","last_clean":"2024-09-13T17:53:31.380622+0000","last_became_active":"2024-09-13T17:53:08.321012+0000","last_became_peered":"2024-09-13T17:53:08.321012+0000","last_unstale":"2024-09-13T17:53:31.380622+0000","last_undegraded":"2024-09-13T17:53:31.380622+0000","last_fullsized":"2024-09-13T17:53:31.380622+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:15.154333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"39'5","reported_seq":21,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376087+0000","last_change":"2024-09-13T17:53:08.331121+0000","last_active":"2024-09-13T17:53:31.376087+0000","last_peered":"2024-09-13T17:53:31.376087+0000","last_clean":"2024-09-13T17:53:31.376087+0000","last_became_active":"2024-09-13T17:53:08.327083+0000","last_became_peered":"2024-09-13T17:53:08.327083+0000","last_unstale":"2024-09-13T17:53:31.376087+0000","last_undegraded":"2024-09-13T17:53:31.376087+0000","last_fullsized":"2024-09-13T17:53:31.376087+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:00.206010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"39'9","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.380377+0000","last_change":"2024-09-13T17:53:08.334438+0000","last_active":"2024-09-13T17:53:31.380377+0000","last_peered":"2024-09-13T17:53:31.380377+0000","last_clean":"2024-09-13T17:53:31.380377+0000","last_became_active":"2024-09-13T17:53:08.334269+0000","last_became_peered":"2024-09-13T17:53:08.334269+0000","last_unstale":"2024-09-13T17:53:31.380377+0000","last_undegraded":"2024-09-13T17:53:31.380377+0000","last_fullsized":"2024-09-13T17:53:31.380377+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:39.920002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"39'11","reported_seq":27,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.384882+0000","last_change":"2024-09-13T17:53:08.338160+0000","last_active":"2024-09-13T17:53:31.384882+0000","last_peered":"2024-09-13T17:53:31.384882+0000","last_clean":"2024-09-13T17:53:31.384882+0000","last_became_active":"2024-09-13T17:53:08.337915+0000","last_became_peered":"2024-09-13T17:53:08.337915+0000","last_unstale":"2024-09-13T17:53:31.384882+0000","last_undegraded":"2024-09-13T17:53:31.384882+0000","last_fullsized":"2024-09-13T17:53:31.384882+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:58.339595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"39'15","reported_seq":31,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.377424+0000","last_change":"2024-09-13T17:53:08.336931+0000","last_active":"2024-09-13T17:53:31.377424+0000","last_peered":"2024-09-13T17:53:31.377424+0000","last_clean":"2024-09-13T17:53:31.377424+0000","last_became_active":"2024-09-13T17:53:08.336690+0000","last_became_peered":"2024-09-13T17:53:08.336690+0000","last_unstale":"2024-09-13T17:53:31.377424+0000","last_undegraded":"2024-09-13T17:53:31.377424+0000","last_fullsized":"2024-09-13T17:53:31.377424+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:08.746286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"39'6","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.093989+0000","last_change":"2024-09-13T17:53:31.385152+0000","last_active":"2024-09-13T17:53:32.093989+0000","last_peered":"2024-09-13T17:53:32.093989+0000","last_clean":"2024-09-13T17:53:32.093989+0000","last_became_active":"2024-09-13T17:53:31.384866+0000","last_became_peered":"2024-09-13T17:53:31.384866+0000","last_unstale":"2024-09-13T17:53:32.093989+0000","last_undegraded":"2024-09-13T17:53:32.093989+0000","last_fullsized":"2024-09-13T17:53:32.093989+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:11.437251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"39'7","reported_seq":23,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.384630+0000","last_change":"2024-09-13T17:53:08.311528+0000","last_active":"2024-09-13T17:53:31.384630+0000","last_peered":"2024-09-13T17:53:31.384630+0000","last_clean":"2024-09-13T17:53:31.384630+0000","last_became_active":"2024-09-13T17:53:08.311275+0000","last_became_peered":"2024-09-13T17:53:08.311275+0000","last_unstale":"2024-09-13T17:53:31.384630+0000","last_undegraded":"2024-09-13T17:53:31.384630+0000","last_fullsized":"2024-09-13T17:53:31.384630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:24.523487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"39'10","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376396+0000","last_change":"2024-09-13T17:53:08.337826+0000","last_active":"2024-09-13T17:53:31.376396+0000","last_peered":"2024-09-13T17:53:31.376396+0000","last_clean":"2024-09-13T17:53:31.376396+0000","last_became_active":"2024-09-13T17:53:08.337542+0000","last_became_peered":"2024-09-13T17:53:08.337542+0000","last_unstale":"2024-09-13T17:53:31.376396+0000","last_undegraded":"2024-09-13T17:53:31.376396+0000","last_fullsized":"2024-09-13T17:53:31.376396+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:24.523487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"39'8","reported_seq":24,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376202+0000","last_change":"2024-09-13T17:53:08.338046+0000","last_active":"2024-09-13T17:53:31.376202+0000","last_peered":"2024-09-13T17:53:31.376202+0000","last_clean":"2024-09-13T17:53:31.376202+0000","last_became_active":"2024-09-13T17:53:08.336636+0000","last_became_peered":"2024-09-13T17:53:08.336636+0000","last_unstale":"2024-09-13T17:53:31.376202+0000","last_undegraded":"2024-09-13T17:53:31.376202+0000","last_fullsized":"2024-09-13T17:53:31.376202+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:51.440182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"39'7","reported_seq":23,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376188+0000","last_change":"2024-09-13T17:53:08.328609+0000","last_active":"2024-09-13T17:53:31.376188+0000","last_peered":"2024-09-13T17:53:31.376188+0000","last_clean":"2024-09-13T17:53:31.376188+0000","last_became_active":"2024-09-13T17:53:08.326748+0000","last_became_peered":"2024-09-13T17:53:08.326748+0000","last_unstale":"2024-09-13T17:53:31.376188+0000","last_undegraded":"2024-09-13T17:53:31.376188+0000","last_fullsized":"2024-09-13T17:53:31.376188+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:16.635091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"39'9","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381390+0000","last_change":"2024-09-13T17:53:08.337201+0000","last_active":"2024-09-13T17:53:31.381390+0000","last_peered":"2024-09-13T17:53:31.381390+0000","last_clean":"2024-09-13T17:53:31.381390+0000","last_became_active":"2024-09-13T17:53:08.336928+0000","last_became_peered":"2024-09-13T17:53:08.336928+0000","last_unstale":"2024-09-13T17:53:31.381390+0000","last_undegraded":"2024-09-13T17:53:31.381390+0000","last_fullsized":"2024-09-13T17:53:31.381390+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:42.945540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"39'9","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.384315+0000","last_change":"2024-09-13T17:53:08.337600+0000","last_active":"2024-09-13T17:53:31.384315+0000","last_peered":"2024-09-13T17:53:31.384315+0000","last_clean":"2024-09-13T17:53:31.384315+0000","last_became_active":"2024-09-13T17:53:08.337322+0000","last_became_peered":"2024-09-13T17:53:08.337322+0000","last_unstale":"2024-09-13T17:53:31.384315+0000","last_undegraded":"2024-09-13T17:53:31.384315+0000","last_fullsized":"2024-09-13T17:53:31.384315+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:43.484986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"39'10","reported_seq":28,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382965+0000","last_change":"2024-09-13T17:53:08.339093+0000","last_active":"2024-09-13T17:53:31.382965+0000","last_peered":"2024-09-13T17:53:31.382965+0000","last_clean":"2024-09-13T17:53:31.382965+0000","last_became_active":"2024-09-13T17:53:08.338846+0000","last_became_peered":"2024-09-13T17:53:08.338846+0000","last_unstale":"2024-09-13T17:53:31.382965+0000","last_undegraded":"2024-09-13T17:53:31.382965+0000","last_fullsized":"2024-09-13T17:53:31.382965+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:09.561563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"39'7","reported_seq":24,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.374521+0000","last_change":"2024-09-13T17:53:08.312823+0000","last_active":"2024-09-13T17:53:31.374521+0000","last_peered":"2024-09-13T17:53:31.374521+0000","last_clean":"2024-09-13T17:53:31.374521+0000","last_became_active":"2024-09-13T17:53:08.312559+0000","last_became_peered":"2024-09-13T17:53:08.312559+0000","last_unstale":"2024-09-13T17:53:31.374521+0000","last_undegraded":"2024-09-13T17:53:31.374521+0000","last_fullsized":"2024-09-13T17:53:31.374521+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:46.004449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"39'8","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.383288+0000","last_change":"2024-09-13T17:53:08.334938+0000","last_active":"2024-09-13T17:53:31.383288+0000","last_peered":"2024-09-13T17:53:31.383288+0000","last_clean":"2024-09-13T17:53:31.383288+0000","last_became_active":"2024-09-13T17:53:08.334693+0000","last_became_peered":"2024-09-13T17:53:08.334693+0000","last_unstale":"2024-09-13T17:53:31.383288+0000","last_undegraded":"2024-09-13T17:53:31.383288+0000","last_fullsized":"2024-09-13T17:53:31.383288+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:30.620140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"39'11","reported_seq":27,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376492+0000","last_change":"2024-09-13T17:53:08.325433+0000","last_active":"2024-09-13T17:53:31.376492+0000","last_peered":"2024-09-13T17:53:31.376492+0000","last_clean":"2024-09-13T17:53:31.376492+0000","last_became_active":"2024-09-13T17:53:08.325098+0000","last_became_peered":"2024-09-13T17:53:08.325098+0000","last_unstale":"2024-09-13T17:53:31.376492+0000","last_undegraded":"2024-09-13T17:53:31.376492+0000","last_fullsized":"2024-09-13T17:53:31.376492+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:51.440182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"39'9","reported_seq":25,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376675+0000","last_change":"2024-09-13T17:53:08.328964+0000","last_active":"2024-09-13T17:53:31.376675+0000","last_peered":"2024-09-13T17:53:31.376675+0000","last_clean":"2024-09-13T17:53:31.376675+0000","last_became_active":"2024-09-13T17:53:08.328655+0000","last_became_peered":"2024-09-13T17:53:08.328655+0000","last_unstale":"2024-09-13T17:53:31.376675+0000","last_undegraded":"2024-09-13T17:53:31.376675+0000","last_fullsized":"2024-09-13T17:53:31.376675+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:02.621171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"39'8","reported_seq":25,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382204+0000","last_change":"2024-09-13T17:53:08.322892+0000","last_active":"2024-09-13T17:53:31.382204+0000","last_peered":"2024-09-13T17:53:31.382204+0000","last_clean":"2024-09-13T17:53:31.382204+0000","last_became_active":"2024-09-13T17:53:08.322249+0000","last_became_peered":"2024-09-13T17:53:08.322249+0000","last_unstale":"2024-09-13T17:53:31.382204+0000","last_undegraded":"2024-09-13T17:53:31.382204+0000","last_fullsized":"2024-09-13T17:53:31.382204+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:02.660007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"39'6","reported_seq":23,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.374047+0000","last_change":"2024-09-13T17:53:08.313280+0000","last_active":"2024-09-13T17:53:31.374047+0000","last_peered":"2024-09-13T17:53:31.374047+0000","last_clean":"2024-09-13T17:53:31.374047+0000","last_became_active":"2024-09-13T17:53:08.312956+0000","last_became_peered":"2024-09-13T17:53:08.312956+0000","last_unstale":"2024-09-13T17:53:31.374047+0000","last_undegraded":"2024-09-13T17:53:31.374047+0000","last_fullsized":"2024-09-13T17:53:31.374047+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:39.411729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"39'2","reported_seq":20,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.383260+0000","last_change":"2024-09-13T17:53:08.320097+0000","last_active":"2024-09-13T17:53:31.383260+0000","last_peered":"2024-09-13T17:53:31.383260+0000","last_clean":"2024-09-13T17:53:31.383260+0000","last_became_active":"2024-09-13T17:53:08.319867+0000","last_became_peered":"2024-09-13T17:53:08.319867+0000","last_unstale":"2024-09-13T17:53:31.383260+0000","last_undegraded":"2024-09-13T17:53:31.383260+0000","last_fullsized":"2024-09-13T17:53:31.383260+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:19.636768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"39'15","reported_seq":32,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382694+0000","last_change":"2024-09-13T17:53:08.334357+0000","last_active":"2024-09-13T17:53:31.382694+0000","last_peered":"2024-09-13T17:53:31.382694+0000","last_clean":"2024-09-13T17:53:31.382694+0000","last_became_active":"2024-09-13T17:53:08.334113+0000","last_became_peered":"2024-09-13T17:53:08.334113+0000","last_unstale":"2024-09-13T17:53:31.382694+0000","last_undegraded":"2024-09-13T17:53:31.382694+0000","last_fullsized":"2024-09-13T17:53:31.382694+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:05.172827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"39'6","reported_seq":24,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.383065+0000","last_change":"2024-09-13T17:53:08.319476+0000","last_active":"2024-09-13T17:53:31.383065+0000","last_peered":"2024-09-13T17:53:31.383065+0000","last_clean":"2024-09-13T17:53:31.383065+0000","last_became_active":"2024-09-13T17:53:08.319209+0000","last_became_peered":"2024-09-13T17:53:08.319209+0000","last_unstale":"2024-09-13T17:53:31.383065+0000","last_undegraded":"2024-09-13T17:53:31.383065+0000","last_fullsized":"2024-09-13T17:53:31.383065+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:05.594213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"39'4","reported_seq":20,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.377097+0000","last_change":"2024-09-13T17:53:08.333716+0000","last_active":"2024-09-13T17:53:31.377097+0000","last_peered":"2024-09-13T17:53:31.377097+0000","last_clean":"2024-09-13T17:53:31.377097+0000","last_became_active":"2024-09-13T17:53:08.333394+0000","last_became_peered":"2024-09-13T17:53:08.333394+0000","last_unstale":"2024-09-13T17:53:31.377097+0000","last_undegraded":"2024-09-13T17:53:31.377097+0000","last_fullsized":"2024-09-13T17:53:31.377097+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:55.588582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"39'7","reported_seq":25,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382908+0000","last_change":"2024-09-13T17:53:08.328272+0000","last_active":"2024-09-13T17:53:31.382908+0000","last_peered":"2024-09-13T17:53:31.382908+0000","last_clean":"2024-09-13T17:53:31.382908+0000","last_became_active":"2024-09-13T17:53:08.328006+0000","last_became_peered":"2024-09-13T17:53:08.328006+0000","last_unstale":"2024-09-13T17:53:31.382908+0000","last_undegraded":"2024-09-13T17:53:31.382908+0000","last_fullsized":"2024-09-13T17:53:31.382908+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:07.544794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"39'8","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382909+0000","last_change":"2024-09-13T17:53:08.319778+0000","last_active":"2024-09-13T17:53:31.382909+0000","last_peered":"2024-09-13T17:53:31.382909+0000","last_clean":"2024-09-13T17:53:31.382909+0000","last_became_active":"2024-09-13T17:53:08.319511+0000","last_became_peered":"2024-09-13T17:53:08.319511+0000","last_unstale":"2024-09-13T17:53:31.382909+0000","last_undegraded":"2024-09-13T17:53:31.382909+0000","last_fullsized":"2024-09-13T17:53:31.382909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:06.338741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"39'12","reported_seq":29,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382297+0000","last_change":"2024-09-13T17:53:08.324346+0000","last_active":"2024-09-13T17:53:31.382297+0000","last_peered":"2024-09-13T17:53:31.382297+0000","last_clean":"2024-09-13T17:53:31.382297+0000","last_became_active":"2024-09-13T17:53:08.322572+0000","last_became_peered":"2024-09-13T17:53:08.322572+0000","last_unstale":"2024-09-13T17:53:31.382297+0000","last_undegraded":"2024-09-13T17:53:31.382297+0000","last_fullsized":"2024-09-13T17:53:31.382297+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:15.154333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"39'9","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.380501+0000","last_change":"2024-09-13T17:53:08.312904+0000","last_active":"2024-09-13T17:53:31.380501+0000","last_peered":"2024-09-13T17:53:31.380501+0000","last_clean":"2024-09-13T17:53:31.380501+0000","last_became_active":"2024-09-13T17:53:08.312650+0000","last_became_peered":"2024-09-13T17:53:08.312650+0000","last_unstale":"2024-09-13T17:53:31.380501+0000","last_undegraded":"2024-09-13T17:53:31.380501+0000","last_fullsized":"2024-09-13T17:53:31.380501+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:42.945540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.108313+0000","last_change":"2024-09-13T17:53:32.105631+0000","last_active":"2024-09-13T17:53:32.108313+0000","last_peered":"2024-09-13T17:53:32.108313+0000","last_clean":"2024-09-13T17:53:32.108313+0000","last_became_active":"2024-09-13T17:53:32.105383+0000","last_became_peered":"2024-09-13T17:53:32.105383+0000","last_unstale":"2024-09-13T17:53:32.108313+0000","last_undegraded":"2024-09-13T17:53:32.108313+0000","last_fullsized":"2024-09-13T17:53:32.108313+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:22.821973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"39'9","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381985+0000","last_change":"2024-09-13T17:53:08.337215+0000","last_active":"2024-09-13T17:53:31.381985+0000","last_peered":"2024-09-13T17:53:31.381985+0000","last_clean":"2024-09-13T17:53:31.381985+0000","last_became_active":"2024-09-13T17:53:08.336968+0000","last_became_peered":"2024-09-13T17:53:08.336968+0000","last_unstale":"2024-09-13T17:53:31.381985+0000","last_undegraded":"2024-09-13T17:53:31.381985+0000","last_fullsized":"2024-09-13T17:53:31.381985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:05.297506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"43'8","reported_seq":27,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.383367+0000","last_change":"2024-09-13T17:53:07.927772+0000","last_active":"2024-09-13T17:53:31.383367+0000","last_peered":"2024-09-13T17:53:31.383367+0000","last_clean":"2024-09-13T17:53:31.383367+0000","last_became_active":"2024-09-13T17:53:07.926833+0000","last_became_peered":"2024-09-13T17:53:07.926833+0000","last_unstale":"2024-09-13T17:53:31.383367+0000","last_undegraded":"2024-09-13T17:53:31.383367+0000","last_fullsized":"2024-09-13T17:53:31.383367+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:26.713460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.109383+0000","last_change":"2024-09-13T17:53:32.108163+0000","last_active":"2024-09-13T17:53:32.109383+0000","last_peered":"2024-09-13T17:53:32.109383+0000","last_clean":"2024-09-13T17:53:32.109383+0000","last_became_active":"2024-09-13T17:53:32.107884+0000","last_became_peered":"2024-09-13T17:53:32.107884+0000","last_unstale":"2024-09-13T17:53:32.109383+0000","last_undegraded":"2024-09-13T17:53:32.109383+0000","last_fullsized":"2024-09-13T17:53:32.109383+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:12.344228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"39'15","reported_seq":32,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381928+0000","last_change":"2024-09-13T17:53:08.331531+0000","last_active":"2024-09-13T17:53:31.381928+0000","last_peered":"2024-09-13T17:53:31.381928+0000","last_clean":"2024-09-13T17:53:31.381928+0000","last_became_active":"2024-09-13T17:53:08.330415+0000","last_became_peered":"2024-09-13T17:53:08.330415+0000","last_unstale":"2024-09-13T17:53:31.381928+0000","last_undegraded":"2024-09-13T17:53:31.381928+0000","last_fullsized":"2024-09-13T17:53:31.381928+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:00.206010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.384809+0000","last_change":"2024-09-13T17:53:07.942858+0000","last_active":"2024-09-13T17:53:31.384809+0000","last_peered":"2024-09-13T17:53:31.384809+0000","last_clean":"2024-09-13T17:53:31.384809+0000","last_became_active":"2024-09-13T17:53:07.942331+0000","last_became_peered":"2024-09-13T17:53:07.942331+0000","last_unstale":"2024-09-13T17:53:31.384809+0000","last_undegraded":"2024-09-13T17:53:31.384809+0000","last_fullsized":"2024-09-13T17:53:31.384809+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:52.434464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.104780+0000","last_change":"2024-09-13T17:53:32.102967+0000","last_active":"2024-09-13T17:53:32.104780+0000","last_peered":"2024-09-13T17:53:32.104780+0000","last_clean":"2024-09-13T17:53:32.104780+0000","last_became_active":"2024-09-13T17:53:32.102424+0000","last_became_peered":"2024-09-13T17:53:32.102424+0000","last_unstale":"2024-09-13T17:53:32.104780+0000","last_undegraded":"2024-09-13T17:53:32.104780+0000","last_fullsized":"2024-09-13T17:53:32.104780+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:23:40.956685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"39'5","reported_seq":21,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376822+0000","last_change":"2024-09-13T17:53:08.336301+0000","last_active":"2024-09-13T17:53:31.376822+0000","last_peered":"2024-09-13T17:53:31.376822+0000","last_clean":"2024-09-13T17:53:31.376822+0000","last_became_active":"2024-09-13T17:53:08.336060+0000","last_became_peered":"2024-09-13T17:53:08.336060+0000","last_unstale":"2024-09-13T17:53:31.376822+0000","last_undegraded":"2024-09-13T17:53:31.376822+0000","last_fullsized":"2024-09-13T17:53:31.376822+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:58.339595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"43'3","reported_seq":21,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382119+0000","last_change":"2024-09-13T17:53:07.942677+0000","last_active":"2024-09-13T17:53:31.382119+0000","last_peered":"2024-09-13T17:53:31.382119+0000","last_clean":"2024-09-13T17:53:31.382119+0000","last_became_active":"2024-09-13T17:53:07.942426+0000","last_became_peered":"2024-09-13T17:53:07.942426+0000","last_unstale":"2024-09-13T17:53:31.382119+0000","last_undegraded":"2024-09-13T17:53:31.382119+0000","last_fullsized":"2024-09-13T17:53:31.382119+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:08.554504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.111043+0000","last_change":"2024-09-13T17:53:32.107197+0000","last_active":"2024-09-13T17:53:32.111043+0000","last_peered":"2024-09-13T17:53:32.111043+0000","last_clean":"2024-09-13T17:53:32.111043+0000","last_became_active":"2024-09-13T17:53:32.106633+0000","last_became_peered":"2024-09-13T17:53:32.106633+0000","last_unstale":"2024-09-13T17:53:32.111043+0000","last_undegraded":"2024-09-13T17:53:32.111043+0000","last_fullsized":"2024-09-13T17:53:32.111043+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:13.184083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"39'6","reported_seq":23,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381967+0000","last_change":"2024-09-13T17:53:08.327801+0000","last_active":"2024-09-13T17:53:31.381967+0000","last_peered":"2024-09-13T17:53:31.381967+0000","last_clean":"2024-09-13T17:53:31.381967+0000","last_became_active":"2024-09-13T17:53:08.326766+0000","last_became_peered":"2024-09-13T17:53:08.326766+0000","last_unstale":"2024-09-13T17:53:31.381967+0000","last_undegraded":"2024-09-13T17:53:31.381967+0000","last_fullsized":"2024-09-13T17:53:31.381967+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:13.404809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"43'3","reported_seq":20,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376604+0000","last_change":"2024-09-13T17:53:07.931288+0000","last_active":"2024-09-13T17:53:31.376604+0000","last_peered":"2024-09-13T17:53:31.376604+0000","last_clean":"2024-09-13T17:53:31.376604+0000","last_became_active":"2024-09-13T17:53:07.929489+0000","last_became_peered":"2024-09-13T17:53:07.929489+0000","last_unstale":"2024-09-13T17:53:31.376604+0000","last_undegraded":"2024-09-13T17:53:31.376604+0000","last_fullsized":"2024-09-13T17:53:31.376604+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:42.477927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.103840+0000","last_change":"2024-09-13T17:53:32.102337+0000","last_active":"2024-09-13T17:53:32.103840+0000","last_peered":"2024-09-13T17:53:32.103840+0000","last_clean":"2024-09-13T17:53:32.103840+0000","last_became_active":"2024-09-13T17:53:32.102048+0000","last_became_peered":"2024-09-13T17:53:32.102048+0000","last_unstale":"2024-09-13T17:53:32.103840+0000","last_undegraded":"2024-09-13T17:53:32.103840+0000","last_fullsized":"2024-09-13T17:53:32.103840+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:06.380167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"39'8","reported_seq":24,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382427+0000","last_change":"2024-09-13T17:53:08.311242+0000","last_active":"2024-09-13T17:53:31.382427+0000","last_peered":"2024-09-13T17:53:31.382427+0000","last_clean":"2024-09-13T17:53:31.382427+0000","last_became_active":"2024-09-13T17:53:08.310973+0000","last_became_peered":"2024-09-13T17:53:08.310973+0000","last_unstale":"2024-09-13T17:53:31.382427+0000","last_undegraded":"2024-09-13T17:53:31.382427+0000","last_fullsized":"2024-09-13T17:53:31.382427+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:51.440182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376592+0000","last_change":"2024-09-13T17:53:07.930059+0000","last_active":"2024-09-13T17:53:31.376592+0000","last_peered":"2024-09-13T17:53:31.376592+0000","last_clean":"2024-09-13T17:53:31.376592+0000","last_became_active":"2024-09-13T17:53:07.929603+0000","last_became_peered":"2024-09-13T17:53:07.929603+0000","last_unstale":"2024-09-13T17:53:31.376592+0000","last_undegraded":"2024-09-13T17:53:31.376592+0000","last_fullsized":"2024-09-13T17:53:31.376592+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:18.629709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.111583+0000","last_change":"2024-09-13T17:53:32.103405+0000","last_active":"2024-09-13T17:53:32.111583+0000","last_peered":"2024-09-13T17:53:32.111583+0000","last_clean":"2024-09-13T17:53:32.111583+0000","last_became_active":"2024-09-13T17:53:32.103148+0000","last_became_peered":"2024-09-13T17:53:32.103148+0000","last_unstale":"2024-09-13T17:53:32.111583+0000","last_undegraded":"2024-09-13T17:53:32.111583+0000","last_fullsized":"2024-09-13T17:53:32.111583+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:14.259580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"39'10","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376283+0000","last_change":"2024-09-13T17:53:08.330061+0000","last_active":"2024-09-13T17:53:31.376283+0000","last_peered":"2024-09-13T17:53:31.376283+0000","last_clean":"2024-09-13T17:53:31.376283+0000","last_became_active":"2024-09-13T17:53:08.328372+0000","last_became_peered":"2024-09-13T17:53:08.328372+0000","last_unstale":"2024-09-13T17:53:31.376283+0000","last_undegraded":"2024-09-13T17:53:31.376283+0000","last_fullsized":"2024-09-13T17:53:31.376283+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:58.339595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":19,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382009+0000","last_change":"2024-09-13T17:53:07.943158+0000","last_active":"2024-09-13T17:53:31.382009+0000","last_peered":"2024-09-13T17:53:31.382009+0000","last_clean":"2024-09-13T17:53:31.382009+0000","last_became_active":"2024-09-13T17:53:07.942861+0000","last_became_peered":"2024-09-13T17:53:07.942861+0000","last_unstale":"2024-09-13T17:53:31.382009+0000","last_undegraded":"2024-09-13T17:53:31.382009+0000","last_fullsized":"2024-09-13T17:53:31.382009+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:38.404670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.114275+0000","last_change":"2024-09-13T17:53:32.110823+0000","last_active":"2024-09-13T17:53:32.114275+0000","last_peered":"2024-09-13T17:53:32.114275+0000","last_clean":"2024-09-13T17:53:32.114275+0000","last_became_active":"2024-09-13T17:53:32.110474+0000","last_became_peered":"2024-09-13T17:53:32.110474+0000","last_unstale":"2024-09-13T17:53:32.114275+0000","last_undegraded":"2024-09-13T17:53:32.114275+0000","last_fullsized":"2024-09-13T17:53:32.114275+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:11.000415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"39'7","reported_seq":23,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376429+0000","last_change":"2024-09-13T17:53:08.336069+0000","last_active":"2024-09-13T17:53:31.376429+0000","last_peered":"2024-09-13T17:53:31.376429+0000","last_clean":"2024-09-13T17:53:31.376429+0000","last_became_active":"2024-09-13T17:53:08.334174+0000","last_became_peered":"2024-09-13T17:53:08.334174+0000","last_unstale":"2024-09-13T17:53:31.376429+0000","last_undegraded":"2024-09-13T17:53:31.376429+0000","last_fullsized":"2024-09-13T17:53:31.376429+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:42.232554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.380883+0000","last_change":"2024-09-13T17:53:07.940289+0000","last_active":"2024-09-13T17:53:31.380883+0000","last_peered":"2024-09-13T17:53:31.380883+0000","last_clean":"2024-09-13T17:53:31.380883+0000","last_became_active":"2024-09-13T17:53:07.940047+0000","last_became_peered":"2024-09-13T17:53:07.940047+0000","last_unstale":"2024-09-13T17:53:31.380883+0000","last_undegraded":"2024-09-13T17:53:31.380883+0000","last_fullsized":"2024-09-13T17:53:31.380883+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:29.613081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.105410+0000","last_change":"2024-09-13T17:53:32.103595+0000","last_active":"2024-09-13T17:53:32.105410+0000","last_peered":"2024-09-13T17:53:32.105410+0000","last_clean":"2024-09-13T17:53:32.105410+0000","last_became_active":"2024-09-13T17:53:32.103338+0000","last_became_peered":"2024-09-13T17:53:32.103338+0000","last_unstale":"2024-09-13T17:53:32.105410+0000","last_undegraded":"2024-09-13T17:53:32.105410+0000","last_fullsized":"2024-09-13T17:53:32.105410+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:01:32.915840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"39'8","reported_seq":25,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381449+0000","last_change":"2024-09-13T17:53:08.328602+0000","last_active":"2024-09-13T17:53:31.381449+0000","last_peered":"2024-09-13T17:53:31.381449+0000","last_clean":"2024-09-13T17:53:31.381449+0000","last_became_active":"2024-09-13T17:53:08.328360+0000","last_became_peered":"2024-09-13T17:53:08.328360+0000","last_unstale":"2024-09-13T17:53:31.381449+0000","last_undegraded":"2024-09-13T17:53:31.381449+0000","last_fullsized":"2024-09-13T17:53:31.381449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:26.764647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376095+0000","last_change":"2024-09-13T17:53:07.930024+0000","last_active":"2024-09-13T17:53:31.376095+0000","last_peered":"2024-09-13T17:53:31.376095+0000","last_clean":"2024-09-13T17:53:31.376095+0000","last_became_active":"2024-09-13T17:53:07.927170+0000","last_became_peered":"2024-09-13T17:53:07.927170+0000","last_unstale":"2024-09-13T17:53:31.376095+0000","last_undegraded":"2024-09-13T17:53:31.376095+0000","last_fullsized":"2024-09-13T17:53:31.376095+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:15.690853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.109002+0000","last_change":"2024-09-13T17:53:32.108096+0000","last_active":"2024-09-13T17:53:32.109002+0000","last_peered":"2024-09-13T17:53:32.109002+0000","last_clean":"2024-09-13T17:53:32.109002+0000","last_became_active":"2024-09-13T17:53:32.107826+0000","last_became_peered":"2024-09-13T17:53:32.107826+0000","last_unstale":"2024-09-13T17:53:32.109002+0000","last_undegraded":"2024-09-13T17:53:32.109002+0000","last_fullsized":"2024-09-13T17:53:32.109002+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:00.765392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"39'11","reported_seq":28,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.374778+0000","last_change":"2024-09-13T17:53:08.338365+0000","last_active":"2024-09-13T17:53:31.374778+0000","last_peered":"2024-09-13T17:53:31.374778+0000","last_clean":"2024-09-13T17:53:31.374778+0000","last_became_active":"2024-09-13T17:53:08.337999+0000","last_became_peered":"2024-09-13T17:53:08.337999+0000","last_unstale":"2024-09-13T17:53:31.374778+0000","last_undegraded":"2024-09-13T17:53:31.374778+0000","last_fullsized":"2024-09-13T17:53:31.374778+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:24.556344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382039+0000","last_change":"2024-09-13T17:53:07.933052+0000","last_active":"2024-09-13T17:53:31.382039+0000","last_peered":"2024-09-13T17:53:31.382039+0000","last_clean":"2024-09-13T17:53:31.382039+0000","last_became_active":"2024-09-13T17:53:07.932754+0000","last_became_peered":"2024-09-13T17:53:07.932754+0000","last_unstale":"2024-09-13T17:53:31.382039+0000","last_undegraded":"2024-09-13T17:53:31.382039+0000","last_fullsized":"2024-09-13T17:53:31.382039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:01.652948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.116616+0000","last_change":"2024-09-13T17:53:32.111276+0000","last_active":"2024-09-13T17:53:32.116616+0000","last_peered":"2024-09-13T17:53:32.116616+0000","last_clean":"2024-09-13T17:53:32.116616+0000","last_became_active":"2024-09-13T17:53:32.111042+0000","last_became_peered":"2024-09-13T17:53:32.111042+0000","last_unstale":"2024-09-13T17:53:32.116616+0000","last_undegraded":"2024-09-13T17:53:32.116616+0000","last_fullsized":"2024-09-13T17:53:32.116616+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:14.259580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"39'6","reported_seq":23,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.383724+0000","last_change":"2024-09-13T17:53:08.331696+0000","last_active":"2024-09-13T17:53:31.383724+0000","last_peered":"2024-09-13T17:53:31.383724+0000","last_clean":"2024-09-13T17:53:31.383724+0000","last_became_active":"2024-09-13T17:53:08.331416+0000","last_became_peered":"2024-09-13T17:53:08.331416+0000","last_unstale":"2024-09-13T17:53:31.383724+0000","last_undegraded":"2024-09-13T17:53:31.383724+0000","last_fullsized":"2024-09-13T17:53:31.383724+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:00.206010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.377753+0000","last_change":"2024-09-13T17:53:07.933774+0000","last_active":"2024-09-13T17:53:31.377753+0000","last_peered":"2024-09-13T17:53:31.377753+0000","last_clean":"2024-09-13T17:53:31.377753+0000","last_became_active":"2024-09-13T17:53:07.933487+0000","last_became_peered":"2024-09-13T17:53:07.933487+0000","last_unstale":"2024-09-13T17:53:31.377753+0000","last_undegraded":"2024-09-13T17:53:31.377753+0000","last_fullsized":"2024-09-13T17:53:31.377753+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:48.805157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.102158+0000","last_change":"2024-09-13T17:53:32.100642+0000","last_active":"2024-09-13T17:53:32.102158+0000","last_peered":"2024-09-13T17:53:32.102158+0000","last_clean":"2024-09-13T17:53:32.102158+0000","last_became_active":"2024-09-13T17:53:32.100346+0000","last_became_peered":"2024-09-13T17:53:32.100346+0000","last_unstale":"2024-09-13T17:53:32.102158+0000","last_undegraded":"2024-09-13T17:53:32.102158+0000","last_fullsized":"2024-09-13T17:53:32.102158+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:13:26.439602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"39'10","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.384728+0000","last_change":"2024-09-13T17:53:08.311743+0000","last_active":"2024-09-13T17:53:31.384728+0000","last_peered":"2024-09-13T17:53:31.384728+0000","last_clean":"2024-09-13T17:53:31.384728+0000","last_became_active":"2024-09-13T17:53:08.311510+0000","last_became_peered":"2024-09-13T17:53:08.311510+0000","last_unstale":"2024-09-13T17:53:31.384728+0000","last_undegraded":"2024-09-13T17:53:31.384728+0000","last_fullsized":"2024-09-13T17:53:31.384728+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:42.232554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"43'5","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.377383+0000","last_change":"2024-09-13T17:53:07.939168+0000","last_active":"2024-09-13T17:53:31.377383+0000","last_peered":"2024-09-13T17:53:31.377383+0000","last_clean":"2024-09-13T17:53:31.377383+0000","last_became_active":"2024-09-13T17:53:07.938879+0000","last_became_peered":"2024-09-13T17:53:07.938879+0000","last_unstale":"2024-09-13T17:53:31.377383+0000","last_undegraded":"2024-09-13T17:53:31.377383+0000","last_fullsized":"2024-09-13T17:53:31.377383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:04.587154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.099364+0000","last_change":"2024-09-13T17:53:32.096172+0000","last_active":"2024-09-13T17:53:32.099364+0000","last_peered":"2024-09-13T17:53:32.099364+0000","last_clean":"2024-09-13T17:53:32.099364+0000","last_became_active":"2024-09-13T17:53:32.095911+0000","last_became_peered":"2024-09-13T17:53:32.095911+0000","last_unstale":"2024-09-13T17:53:32.099364+0000","last_undegraded":"2024-09-13T17:53:32.099364+0000","last_fullsized":"2024-09-13T17:53:32.099364+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:34.896020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"39'9","reported_seq":25,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376384+0000","last_change":"2024-09-13T17:53:08.335396+0000","last_active":"2024-09-13T17:53:31.376384+0000","last_peered":"2024-09-13T17:53:31.376384+0000","last_clean":"2024-09-13T17:53:31.376384+0000","last_became_active":"2024-09-13T17:53:08.333738+0000","last_became_peered":"2024-09-13T17:53:08.333738+0000","last_unstale":"2024-09-13T17:53:31.376384+0000","last_undegraded":"2024-09-13T17:53:31.376384+0000","last_fullsized":"2024-09-13T17:53:31.376384+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:13.895602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"43'22","reported_seq":40,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381464+0000","last_change":"2024-09-13T17:53:07.940964+0000","last_active":"2024-09-13T17:53:31.381464+0000","last_peered":"2024-09-13T17:53:31.381464+0000","last_clean":"2024-09-13T17:53:31.381464+0000","last_became_active":"2024-09-13T17:53:07.940717+0000","last_became_peered":"2024-09-13T17:53:07.940717+0000","last_unstale":"2024-09-13T17:53:31.381464+0000","last_undegraded":"2024-09-13T17:53:31.381464+0000","last_fullsized":"2024-09-13T17:53:31.381464+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:50.212192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.104565+0000","last_change":"2024-09-13T17:53:32.102489+0000","last_active":"2024-09-13T17:53:32.104565+0000","last_peered":"2024-09-13T17:53:32.104565+0000","last_clean":"2024-09-13T17:53:32.104565+0000","last_became_active":"2024-09-13T17:53:32.102114+0000","last_became_peered":"2024-09-13T17:53:32.102114+0000","last_unstale":"2024-09-13T17:53:32.104565+0000","last_undegraded":"2024-09-13T17:53:32.104565+0000","last_fullsized":"2024-09-13T17:53:32.104565+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:12.344228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"39'6","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382519+0000","last_change":"2024-09-13T17:53:08.337881+0000","last_active":"2024-09-13T17:53:31.382519+0000","last_peered":"2024-09-13T17:53:31.382519+0000","last_clean":"2024-09-13T17:53:31.382519+0000","last_became_active":"2024-09-13T17:53:08.337599+0000","last_became_peered":"2024-09-13T17:53:08.337599+0000","last_unstale":"2024-09-13T17:53:31.382519+0000","last_undegraded":"2024-09-13T17:53:31.382519+0000","last_fullsized":"2024-09-13T17:53:31.382519+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:02.621171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"43'5","reported_seq":23,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381637+0000","last_change":"2024-09-13T17:53:07.929999+0000","last_active":"2024-09-13T17:53:31.381637+0000","last_peered":"2024-09-13T17:53:31.381637+0000","last_clean":"2024-09-13T17:53:31.381637+0000","last_became_active":"2024-09-13T17:53:07.929747+0000","last_became_peered":"2024-09-13T17:53:07.929747+0000","last_unstale":"2024-09-13T17:53:31.381637+0000","last_undegraded":"2024-09-13T17:53:31.381637+0000","last_fullsized":"2024-09-13T17:53:31.381637+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:04.165768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.116696+0000","last_change":"2024-09-13T17:53:32.112299+0000","last_active":"2024-09-13T17:53:32.116696+0000","last_peered":"2024-09-13T17:53:32.116696+0000","last_clean":"2024-09-13T17:53:32.116696+0000","last_became_active":"2024-09-13T17:53:32.111832+0000","last_became_peered":"2024-09-13T17:53:32.111832+0000","last_unstale":"2024-09-13T17:53:32.116696+0000","last_undegraded":"2024-09-13T17:53:32.116696+0000","last_fullsized":"2024-09-13T17:53:32.116696+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:11.000415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"39'6","reported_seq":23,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.380365+0000","last_change":"2024-09-13T17:53:08.323246+0000","last_active":"2024-09-13T17:53:31.380365+0000","last_peered":"2024-09-13T17:53:31.380365+0000","last_clean":"2024-09-13T17:53:31.380365+0000","last_became_active":"2024-09-13T17:53:08.322991+0000","last_became_peered":"2024-09-13T17:53:08.322991+0000","last_unstale":"2024-09-13T17:53:31.380365+0000","last_undegraded":"2024-09-13T17:53:31.380365+0000","last_fullsized":"2024-09-13T17:53:31.380365+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:13.042839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.380709+0000","last_change":"2024-09-13T17:53:07.941959+0000","last_active":"2024-09-13T17:53:31.380709+0000","last_peered":"2024-09-13T17:53:31.380709+0000","last_clean":"2024-09-13T17:53:31.380709+0000","last_became_active":"2024-09-13T17:53:07.941576+0000","last_became_peered":"2024-09-13T17:53:07.941576+0000","last_unstale":"2024-09-13T17:53:31.380709+0000","last_undegraded":"2024-09-13T17:53:31.380709+0000","last_fullsized":"2024-09-13T17:53:31.380709+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:04.911527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.107883+0000","last_change":"2024-09-13T17:53:32.101849+0000","last_active":"2024-09-13T17:53:32.107883+0000","last_peered":"2024-09-13T17:53:32.107883+0000","last_clean":"2024-09-13T17:53:32.107883+0000","last_became_active":"2024-09-13T17:53:32.101578+0000","last_became_peered":"2024-09-13T17:53:32.101578+0000","last_unstale":"2024-09-13T17:53:32.107883+0000","last_undegraded":"2024-09-13T17:53:32.107883+0000","last_fullsized":"2024-09-13T17:53:32.107883+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.850731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"39'10","reported_seq":27,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381914+0000","last_change":"2024-09-13T17:53:08.321715+0000","last_active":"2024-09-13T17:53:31.381914+0000","last_peered":"2024-09-13T17:53:31.381914+0000","last_clean":"2024-09-13T17:53:31.381914+0000","last_became_active":"2024-09-13T17:53:08.321408+0000","last_became_peered":"2024-09-13T17:53:08.321408+0000","last_unstale":"2024-09-13T17:53:31.381914+0000","last_undegraded":"2024-09-13T17:53:31.381914+0000","last_fullsized":"2024-09-13T17:53:31.381914+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:51.219251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":19,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382868+0000","last_change":"2024-09-13T17:53:07.927302+0000","last_active":"2024-09-13T17:53:31.382868+0000","last_peered":"2024-09-13T17:53:31.382868+0000","last_clean":"2024-09-13T17:53:31.382868+0000","last_became_active":"2024-09-13T17:53:07.927010+0000","last_became_peered":"2024-09-13T17:53:07.927010+0000","last_unstale":"2024-09-13T17:53:31.382868+0000","last_undegraded":"2024-09-13T17:53:31.382868+0000","last_fullsized":"2024-09-13T17:53:31.382868+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:58:48.383731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.111930+0000","last_change":"2024-09-13T17:53:32.110907+0000","last_active":"2024-09-13T17:53:32.111930+0000","last_peered":"2024-09-13T17:53:32.111930+0000","last_clean":"2024-09-13T17:53:32.111930+0000","last_became_active":"2024-09-13T17:53:32.110619+0000","last_became_peered":"2024-09-13T17:53:32.110619+0000","last_unstale":"2024-09-13T17:53:32.111930+0000","last_undegraded":"2024-09-13T17:53:32.111930+0000","last_fullsized":"2024-09-13T17:53:32.111930+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:25.801618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"39'15","reported_seq":32,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381546+0000","last_change":"2024-09-13T17:53:08.327193+0000","last_active":"2024-09-13T17:53:31.381546+0000","last_peered":"2024-09-13T17:53:31.381546+0000","last_clean":"2024-09-13T17:53:31.381546+0000","last_became_active":"2024-09-13T17:53:08.326966+0000","last_became_peered":"2024-09-13T17:53:08.326966+0000","last_unstale":"2024-09-13T17:53:31.381546+0000","last_undegraded":"2024-09-13T17:53:31.381546+0000","last_fullsized":"2024-09-13T17:53:31.381546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:22.069383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"43'15","reported_seq":33,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381490+0000","last_change":"2024-09-13T17:53:07.941904+0000","last_active":"2024-09-13T17:53:31.381490+0000","last_peered":"2024-09-13T17:53:31.381490+0000","last_clean":"2024-09-13T17:53:31.381490+0000","last_became_active":"2024-09-13T17:53:07.940899+0000","last_became_peered":"2024-09-13T17:53:07.940899+0000","last_unstale":"2024-09-13T17:53:31.381490+0000","last_undegraded":"2024-09-13T17:53:31.381490+0000","last_fullsized":"2024-09-13T17:53:31.381490+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:29.355126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.109955+0000","last_change":"2024-09-13T17:53:32.108178+0000","last_active":"2024-09-13T17:53:32.109955+0000","last_peered":"2024-09-13T17:53:32.109955+0000","last_clean":"2024-09-13T17:53:32.109955+0000","last_became_active":"2024-09-13T17:53:32.107919+0000","last_became_peered":"2024-09-13T17:53:32.107919+0000","last_unstale":"2024-09-13T17:53:32.109955+0000","last_undegraded":"2024-09-13T17:53:32.109955+0000","last_fullsized":"2024-09-13T17:53:32.109955+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:39.400832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"39'6","reported_seq":23,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381411+0000","last_change":"2024-09-13T17:53:08.325292+0000","last_active":"2024-09-13T17:53:31.381411+0000","last_peered":"2024-09-13T17:53:31.381411+0000","last_clean":"2024-09-13T17:53:31.381411+0000","last_became_active":"2024-09-13T17:53:08.325045+0000","last_became_peered":"2024-09-13T17:53:08.325045+0000","last_unstale":"2024-09-13T17:53:31.381411+0000","last_undegraded":"2024-09-13T17:53:31.381411+0000","last_fullsized":"2024-09-13T17:53:31.381411+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:12.327579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"43'2","reported_seq":19,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.378044+0000","last_change":"2024-09-13T17:53:07.935326+0000","last_active":"2024-09-13T17:53:31.378044+0000","last_peered":"2024-09-13T17:53:31.378044+0000","last_clean":"2024-09-13T17:53:31.378044+0000","last_became_active":"2024-09-13T17:53:07.934994+0000","last_became_peered":"2024-09-13T17:53:07.934994+0000","last_unstale":"2024-09-13T17:53:31.378044+0000","last_undegraded":"2024-09-13T17:53:31.378044+0000","last_fullsized":"2024-09-13T17:53:31.378044+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:31:05.331682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.109965+0000","last_change":"2024-09-13T17:53:32.107646+0000","last_active":"2024-09-13T17:53:32.109965+0000","last_peered":"2024-09-13T17:53:32.109965+0000","last_clean":"2024-09-13T17:53:32.109965+0000","last_became_active":"2024-09-13T17:53:32.107310+0000","last_became_peered":"2024-09-13T17:53:32.107310+0000","last_unstale":"2024-09-13T17:53:32.109965+0000","last_undegraded":"2024-09-13T17:53:32.109965+0000","last_fullsized":"2024-09-13T17:53:32.109965+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:09.114104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"39'7","reported_seq":23,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.377244+0000","last_change":"2024-09-13T17:53:08.326430+0000","last_active":"2024-09-13T17:53:31.377244+0000","last_peered":"2024-09-13T17:53:31.377244+0000","last_clean":"2024-09-13T17:53:31.377244+0000","last_became_active":"2024-09-13T17:53:08.325310+0000","last_became_peered":"2024-09-13T17:53:08.325310+0000","last_unstale":"2024-09-13T17:53:31.377244+0000","last_undegraded":"2024-09-13T17:53:31.377244+0000","last_fullsized":"2024-09-13T17:53:31.377244+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:02.621171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"43'3","reported_seq":20,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376910+0000","last_change":"2024-09-13T17:53:07.937200+0000","last_active":"2024-09-13T17:53:31.376910+0000","last_peered":"2024-09-13T17:53:31.376910+0000","last_clean":"2024-09-13T17:53:31.376910+0000","last_became_active":"2024-09-13T17:53:07.936933+0000","last_became_peered":"2024-09-13T17:53:07.936933+0000","last_unstale":"2024-09-13T17:53:31.376910+0000","last_undegraded":"2024-09-13T17:53:31.376910+0000","last_fullsized":"2024-09-13T17:53:31.376910+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:41.938481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.114254+0000","last_change":"2024-09-13T17:53:32.108810+0000","last_active":"2024-09-13T17:53:32.114254+0000","last_peered":"2024-09-13T17:53:32.114254+0000","last_clean":"2024-09-13T17:53:32.114254+0000","last_became_active":"2024-09-13T17:53:32.108575+0000","last_became_peered":"2024-09-13T17:53:32.108575+0000","last_unstale":"2024-09-13T17:53:32.114254+0000","last_undegraded":"2024-09-13T17:53:32.114254+0000","last_fullsized":"2024-09-13T17:53:32.114254+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:31.074632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"39'5","reported_seq":21,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376735+0000","last_change":"2024-09-13T17:53:08.329094+0000","last_active":"2024-09-13T17:53:31.376735+0000","last_peered":"2024-09-13T17:53:31.376735+0000","last_clean":"2024-09-13T17:53:31.376735+0000","last_became_active":"2024-09-13T17:53:08.328558+0000","last_became_peered":"2024-09-13T17:53:08.328558+0000","last_unstale":"2024-09-13T17:53:31.376735+0000","last_undegraded":"2024-09-13T17:53:31.376735+0000","last_fullsized":"2024-09-13T17:53:31.376735+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:29.844579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"43'2","reported_seq":20,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.374599+0000","last_change":"2024-09-13T17:53:07.940232+0000","last_active":"2024-09-13T17:53:31.374599+0000","last_peered":"2024-09-13T17:53:31.374599+0000","last_clean":"2024-09-13T17:53:31.374599+0000","last_became_active":"2024-09-13T17:53:07.939995+0000","last_became_peered":"2024-09-13T17:53:07.939995+0000","last_unstale":"2024-09-13T17:53:31.374599+0000","last_undegraded":"2024-09-13T17:53:31.374599+0000","last_fullsized":"2024-09-13T17:53:31.374599+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:30:28.756119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.113826+0000","last_change":"2024-09-13T17:53:32.108083+0000","last_active":"2024-09-13T17:53:32.113826+0000","last_peered":"2024-09-13T17:53:32.113826+0000","last_clean":"2024-09-13T17:53:32.113826+0000","last_became_active":"2024-09-13T17:53:32.107856+0000","last_became_peered":"2024-09-13T17:53:32.107856+0000","last_unstale":"2024-09-13T17:53:32.113826+0000","last_undegraded":"2024-09-13T17:53:32.113826+0000","last_fullsized":"2024-09-13T17:53:32.113826+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:35.208780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"39'9","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.374372+0000","last_change":"2024-09-13T17:53:08.320956+0000","last_active":"2024-09-13T17:53:31.374372+0000","last_peered":"2024-09-13T17:53:31.374372+0000","last_clean":"2024-09-13T17:53:31.374372+0000","last_became_active":"2024-09-13T17:53:08.320328+0000","last_became_peered":"2024-09-13T17:53:08.320328+0000","last_unstale":"2024-09-13T17:53:31.374372+0000","last_undegraded":"2024-09-13T17:53:31.374372+0000","last_fullsized":"2024-09-13T17:53:31.374372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:27.720519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381078+0000","last_change":"2024-09-13T17:53:07.935565+0000","last_active":"2024-09-13T17:53:31.381078+0000","last_peered":"2024-09-13T17:53:31.381078+0000","last_clean":"2024-09-13T17:53:31.381078+0000","last_became_active":"2024-09-13T17:53:07.935314+0000","last_became_peered":"2024-09-13T17:53:07.935314+0000","last_unstale":"2024-09-13T17:53:31.381078+0000","last_undegraded":"2024-09-13T17:53:31.381078+0000","last_fullsized":"2024-09-13T17:53:31.381078+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:18.629709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.114220+0000","last_change":"2024-09-13T17:53:32.108432+0000","last_active":"2024-09-13T17:53:32.114220+0000","last_peered":"2024-09-13T17:53:32.114220+0000","last_clean":"2024-09-13T17:53:32.114220+0000","last_became_active":"2024-09-13T17:53:32.108164+0000","last_became_peered":"2024-09-13T17:53:32.108164+0000","last_unstale":"2024-09-13T17:53:32.114220+0000","last_undegraded":"2024-09-13T17:53:32.114220+0000","last_fullsized":"2024-09-13T17:53:32.114220+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:53.326062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"39'9","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381600+0000","last_change":"2024-09-13T17:53:08.324597+0000","last_active":"2024-09-13T17:53:31.381600+0000","last_peered":"2024-09-13T17:53:31.381600+0000","last_clean":"2024-09-13T17:53:31.381600+0000","last_became_active":"2024-09-13T17:53:08.324266+0000","last_became_peered":"2024-09-13T17:53:08.324266+0000","last_unstale":"2024-09-13T17:53:31.381600+0000","last_undegraded":"2024-09-13T17:53:31.381600+0000","last_fullsized":"2024-09-13T17:53:31.381600+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:16.635091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"43'4","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.374535+0000","last_change":"2024-09-13T17:53:07.930426+0000","last_active":"2024-09-13T17:53:31.374535+0000","last_peered":"2024-09-13T17:53:31.374535+0000","last_clean":"2024-09-13T17:53:31.374535+0000","last_became_active":"2024-09-13T17:53:07.929700+0000","last_became_peered":"2024-09-13T17:53:07.929700+0000","last_unstale":"2024-09-13T17:53:31.374535+0000","last_undegraded":"2024-09-13T17:53:31.374535+0000","last_fullsized":"2024-09-13T17:53:31.374535+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:14.633970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.108673+0000","last_change":"2024-09-13T17:53:32.104602+0000","last_active":"2024-09-13T17:53:32.108673+0000","last_peered":"2024-09-13T17:53:32.108673+0000","last_clean":"2024-09-13T17:53:32.108673+0000","last_became_active":"2024-09-13T17:53:32.104158+0000","last_became_peered":"2024-09-13T17:53:32.104158+0000","last_unstale":"2024-09-13T17:53:32.108673+0000","last_undegraded":"2024-09-13T17:53:32.108673+0000","last_fullsized":"2024-09-13T17:53:32.108673+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:35.786348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"39'2","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382536+0000","last_change":"2024-09-13T17:53:08.311668+0000","last_active":"2024-09-13T17:53:31.382536+0000","last_peered":"2024-09-13T17:53:31.382536+0000","last_clean":"2024-09-13T17:53:31.382536+0000","last_became_active":"2024-09-13T17:53:08.311402+0000","last_became_peered":"2024-09-13T17:53:08.311402+0000","last_unstale":"2024-09-13T17:53:31.382536+0000","last_undegraded":"2024-09-13T17:53:31.382536+0000","last_fullsized":"2024-09-13T17:53:31.382536+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:13.895602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.374365+0000","last_change":"2024-09-13T17:53:07.928071+0000","last_active":"2024-09-13T17:53:31.374365+0000","last_peered":"2024-09-13T17:53:31.374365+0000","last_clean":"2024-09-13T17:53:31.374365+0000","last_became_active":"2024-09-13T17:53:07.927826+0000","last_became_peered":"2024-09-13T17:53:07.927826+0000","last_unstale":"2024-09-13T17:53:31.374365+0000","last_undegraded":"2024-09-13T17:53:31.374365+0000","last_fullsized":"2024-09-13T17:53:31.374365+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:57.190801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.108158+0000","last_change":"2024-09-13T17:53:32.105701+0000","last_active":"2024-09-13T17:53:32.108158+0000","last_peered":"2024-09-13T17:53:32.108158+0000","last_clean":"2024-09-13T17:53:32.108158+0000","last_became_active":"2024-09-13T17:53:32.105369+0000","last_became_peered":"2024-09-13T17:53:32.105369+0000","last_unstale":"2024-09-13T17:53:32.108158+0000","last_undegraded":"2024-09-13T17:53:32.108158+0000","last_fullsized":"2024-09-13T17:53:32.108158+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:15.108493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"39'5","reported_seq":21,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376882+0000","last_change":"2024-09-13T17:53:08.326807+0000","last_active":"2024-09-13T17:53:31.376882+0000","last_peered":"2024-09-13T17:53:31.376882+0000","last_clean":"2024-09-13T17:53:31.376882+0000","last_became_active":"2024-09-13T17:53:08.326532+0000","last_became_peered":"2024-09-13T17:53:08.326532+0000","last_unstale":"2024-09-13T17:53:31.376882+0000","last_undegraded":"2024-09-13T17:53:31.376882+0000","last_fullsized":"2024-09-13T17:53:31.376882+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:25:41.690036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382382+0000","last_change":"2024-09-13T17:53:07.944383+0000","last_active":"2024-09-13T17:53:31.382382+0000","last_peered":"2024-09-13T17:53:31.382382+0000","last_clean":"2024-09-13T17:53:31.382382+0000","last_became_active":"2024-09-13T17:53:07.944063+0000","last_became_peered":"2024-09-13T17:53:07.944063+0000","last_unstale":"2024-09-13T17:53:31.382382+0000","last_undegraded":"2024-09-13T17:53:31.382382+0000","last_fullsized":"2024-09-13T17:53:31.382382+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:46.511108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.111986+0000","last_change":"2024-09-13T17:53:32.106767+0000","last_active":"2024-09-13T17:53:32.111986+0000","last_peered":"2024-09-13T17:53:32.111986+0000","last_clean":"2024-09-13T17:53:32.111986+0000","last_became_active":"2024-09-13T17:53:32.106509+0000","last_became_peered":"2024-09-13T17:53:32.106509+0000","last_unstale":"2024-09-13T17:53:32.111986+0000","last_undegraded":"2024-09-13T17:53:32.111986+0000","last_fullsized":"2024-09-13T17:53:32.111986+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:31.074632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"39'8","reported_seq":25,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381578+0000","last_change":"2024-09-13T17:53:08.328577+0000","last_active":"2024-09-13T17:53:31.381578+0000","last_peered":"2024-09-13T17:53:31.381578+0000","last_clean":"2024-09-13T17:53:31.381578+0000","last_became_active":"2024-09-13T17:53:08.328314+0000","last_became_peered":"2024-09-13T17:53:08.328314+0000","last_unstale":"2024-09-13T17:53:31.381578+0000","last_undegraded":"2024-09-13T17:53:31.381578+0000","last_fullsized":"2024-09-13T17:53:31.381578+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:00.024100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.374075+0000","last_change":"2024-09-13T17:53:07.924570+0000","last_active":"2024-09-13T17:53:31.374075+0000","last_peered":"2024-09-13T17:53:31.374075+0000","last_clean":"2024-09-13T17:53:31.374075+0000","last_became_active":"2024-09-13T17:53:07.924332+0000","last_became_peered":"2024-09-13T17:53:07.924332+0000","last_unstale":"2024-09-13T17:53:31.374075+0000","last_undegraded":"2024-09-13T17:53:31.374075+0000","last_fullsized":"2024-09-13T17:53:31.374075+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:54:54.256684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.108822+0000","last_change":"2024-09-13T17:53:32.106757+0000","last_active":"2024-09-13T17:53:32.108822+0000","last_peered":"2024-09-13T17:53:32.108822+0000","last_clean":"2024-09-13T17:53:32.108822+0000","last_became_active":"2024-09-13T17:53:32.106473+0000","last_became_peered":"2024-09-13T17:53:32.106473+0000","last_unstale":"2024-09-13T17:53:32.108822+0000","last_undegraded":"2024-09-13T17:53:32.108822+0000","last_fullsized":"2024-09-13T17:53:32.108822+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:25.554708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"39'9","reported_seq":26,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.380996+0000","last_change":"2024-09-13T17:53:08.335343+0000","last_active":"2024-09-13T17:53:31.380996+0000","last_peered":"2024-09-13T17:53:31.380996+0000","last_clean":"2024-09-13T17:53:31.380996+0000","last_became_active":"2024-09-13T17:53:08.335164+0000","last_became_peered":"2024-09-13T17:53:08.335164+0000","last_unstale":"2024-09-13T17:53:31.380996+0000","last_undegraded":"2024-09-13T17:53:31.380996+0000","last_fullsized":"2024-09-13T17:53:31.380996+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:48.932531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"43'3","reported_seq":20,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.378203+0000","last_change":"2024-09-13T17:53:07.939026+0000","last_active":"2024-09-13T17:53:31.378203+0000","last_peered":"2024-09-13T17:53:31.378203+0000","last_clean":"2024-09-13T17:53:31.378203+0000","last_became_active":"2024-09-13T17:53:07.938709+0000","last_became_peered":"2024-09-13T17:53:07.938709+0000","last_unstale":"2024-09-13T17:53:31.378203+0000","last_undegraded":"2024-09-13T17:53:31.378203+0000","last_fullsized":"2024-09-13T17:53:31.378203+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:08.554504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.107372+0000","last_change":"2024-09-13T17:53:32.100323+0000","last_active":"2024-09-13T17:53:32.107372+0000","last_peered":"2024-09-13T17:53:32.107372+0000","last_clean":"2024-09-13T17:53:32.107372+0000","last_became_active":"2024-09-13T17:53:32.099731+0000","last_became_peered":"2024-09-13T17:53:32.099731+0000","last_unstale":"2024-09-13T17:53:32.107372+0000","last_undegraded":"2024-09-13T17:53:32.107372+0000","last_fullsized":"2024-09-13T17:53:32.107372+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:55.264342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"39'5","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.384011+0000","last_change":"2024-09-13T17:53:08.335764+0000","last_active":"2024-09-13T17:53:31.384011+0000","last_peered":"2024-09-13T17:53:31.384011+0000","last_clean":"2024-09-13T17:53:31.384011+0000","last_became_active":"2024-09-13T17:53:08.331745+0000","last_became_peered":"2024-09-13T17:53:08.331745+0000","last_unstale":"2024-09-13T17:53:31.384011+0000","last_undegraded":"2024-09-13T17:53:31.384011+0000","last_fullsized":"2024-09-13T17:53:31.384011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:05.172827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"43'4","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.374374+0000","last_change":"2024-09-13T17:53:07.939210+0000","last_active":"2024-09-13T17:53:31.374374+0000","last_peered":"2024-09-13T17:53:31.374374+0000","last_clean":"2024-09-13T17:53:31.374374+0000","last_became_active":"2024-09-13T17:53:07.938689+0000","last_became_peered":"2024-09-13T17:53:07.938689+0000","last_unstale":"2024-09-13T17:53:31.374374+0000","last_undegraded":"2024-09-13T17:53:31.374374+0000","last_fullsized":"2024-09-13T17:53:31.374374+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:30.156095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.111878+0000","last_change":"2024-09-13T17:53:32.110839+0000","last_active":"2024-09-13T17:53:32.111878+0000","last_peered":"2024-09-13T17:53:32.111878+0000","last_clean":"2024-09-13T17:53:32.111878+0000","last_became_active":"2024-09-13T17:53:32.110560+0000","last_became_peered":"2024-09-13T17:53:32.110560+0000","last_unstale":"2024-09-13T17:53:32.111878+0000","last_undegraded":"2024-09-13T17:53:32.111878+0000","last_fullsized":"2024-09-13T17:53:32.111878+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:47.101607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"39'7","reported_seq":24,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381455+0000","last_change":"2024-09-13T17:53:08.338753+0000","last_active":"2024-09-13T17:53:31.381455+0000","last_peered":"2024-09-13T17:53:31.381455+0000","last_clean":"2024-09-13T17:53:31.381455+0000","last_became_active":"2024-09-13T17:53:08.338513+0000","last_became_peered":"2024-09-13T17:53:08.338513+0000","last_unstale":"2024-09-13T17:53:31.381455+0000","last_undegraded":"2024-09-13T17:53:31.381455+0000","last_fullsized":"2024-09-13T17:53:31.381455+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:24.057582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.384689+0000","last_change":"2024-09-13T17:53:07.933119+0000","last_active":"2024-09-13T17:53:31.384689+0000","last_peered":"2024-09-13T17:53:31.384689+0000","last_clean":"2024-09-13T17:53:31.384689+0000","last_became_active":"2024-09-13T17:53:07.932786+0000","last_became_peered":"2024-09-13T17:53:07.932786+0000","last_unstale":"2024-09-13T17:53:31.384689+0000","last_undegraded":"2024-09-13T17:53:31.384689+0000","last_fullsized":"2024-09-13T17:53:31.384689+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:54.581523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.108736+0000","last_change":"2024-09-13T17:53:32.107576+0000","last_active":"2024-09-13T17:53:32.108736+0000","last_peered":"2024-09-13T17:53:32.108736+0000","last_clean":"2024-09-13T17:53:32.108736+0000","last_became_active":"2024-09-13T17:53:32.107173+0000","last_became_peered":"2024-09-13T17:53:32.107173+0000","last_unstale":"2024-09-13T17:53:32.108736+0000","last_undegraded":"2024-09-13T17:53:32.108736+0000","last_fullsized":"2024-09-13T17:53:32.108736+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:32.778630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"39'8","reported_seq":24,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382607+0000","last_change":"2024-09-13T17:53:08.321422+0000","last_active":"2024-09-13T17:53:31.382607+0000","last_peered":"2024-09-13T17:53:31.382607+0000","last_clean":"2024-09-13T17:53:31.382607+0000","last_became_active":"2024-09-13T17:53:08.319507+0000","last_became_peered":"2024-09-13T17:53:08.319507+0000","last_unstale":"2024-09-13T17:53:31.382607+0000","last_undegraded":"2024-09-13T17:53:31.382607+0000","last_fullsized":"2024-09-13T17:53:31.382607+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:08.746286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382832+0000","last_change":"2024-09-13T17:53:07.929110+0000","last_active":"2024-09-13T17:53:31.382832+0000","last_peered":"2024-09-13T17:53:31.382832+0000","last_clean":"2024-09-13T17:53:31.382832+0000","last_became_active":"2024-09-13T17:53:07.928830+0000","last_became_peered":"2024-09-13T17:53:07.928830+0000","last_unstale":"2024-09-13T17:53:31.382832+0000","last_undegraded":"2024-09-13T17:53:31.382832+0000","last_fullsized":"2024-09-13T17:53:31.382832+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:42.477927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.111729+0000","last_change":"2024-09-13T17:53:32.110535+0000","last_active":"2024-09-13T17:53:32.111729+0000","last_peered":"2024-09-13T17:53:32.111729+0000","last_clean":"2024-09-13T17:53:32.111729+0000","last_became_active":"2024-09-13T17:53:32.110153+0000","last_became_peered":"2024-09-13T17:53:32.110153+0000","last_unstale":"2024-09-13T17:53:32.111729+0000","last_undegraded":"2024-09-13T17:53:32.111729+0000","last_fullsized":"2024-09-13T17:53:32.111729+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:57:00.765392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"39'5","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.380800+0000","last_change":"2024-09-13T17:53:08.316509+0000","last_active":"2024-09-13T17:53:31.380800+0000","last_peered":"2024-09-13T17:53:31.380800+0000","last_clean":"2024-09-13T17:53:31.380800+0000","last_became_active":"2024-09-13T17:53:08.316323+0000","last_became_peered":"2024-09-13T17:53:08.316323+0000","last_unstale":"2024-09-13T17:53:31.380800+0000","last_undegraded":"2024-09-13T17:53:31.380800+0000","last_fullsized":"2024-09-13T17:53:31.380800+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:02.660007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":19,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.383017+0000","last_change":"2024-09-13T17:53:07.928968+0000","last_active":"2024-09-13T17:53:31.383017+0000","last_peered":"2024-09-13T17:53:31.383017+0000","last_clean":"2024-09-13T17:53:31.383017+0000","last_became_active":"2024-09-13T17:53:07.928753+0000","last_became_peered":"2024-09-13T17:53:07.928753+0000","last_unstale":"2024-09-13T17:53:31.383017+0000","last_undegraded":"2024-09-13T17:53:31.383017+0000","last_fullsized":"2024-09-13T17:53:31.383017+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:14.788101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.114041+0000","last_change":"2024-09-13T17:53:32.110324+0000","last_active":"2024-09-13T17:53:32.114041+0000","last_peered":"2024-09-13T17:53:32.114041+0000","last_clean":"2024-09-13T17:53:32.114041+0000","last_became_active":"2024-09-13T17:53:32.110069+0000","last_became_peered":"2024-09-13T17:53:32.110069+0000","last_unstale":"2024-09-13T17:53:32.114041+0000","last_undegraded":"2024-09-13T17:53:32.114041+0000","last_fullsized":"2024-09-13T17:53:32.114041+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:06.089266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"39'8","reported_seq":24,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376311+0000","last_change":"2024-09-13T17:53:08.337370+0000","last_active":"2024-09-13T17:53:31.376311+0000","last_peered":"2024-09-13T17:53:31.376311+0000","last_clean":"2024-09-13T17:53:31.376311+0000","last_became_active":"2024-09-13T17:53:08.335729+0000","last_became_peered":"2024-09-13T17:53:08.335729+0000","last_unstale":"2024-09-13T17:53:31.376311+0000","last_undegraded":"2024-09-13T17:53:31.376311+0000","last_fullsized":"2024-09-13T17:53:31.376311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:24.523487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.376319+0000","last_change":"2024-09-13T17:53:07.923741+0000","last_active":"2024-09-13T17:53:31.376319+0000","last_peered":"2024-09-13T17:53:31.376319+0000","last_clean":"2024-09-13T17:53:31.376319+0000","last_became_active":"2024-09-13T17:53:07.922391+0000","last_became_peered":"2024-09-13T17:53:07.922391+0000","last_unstale":"2024-09-13T17:53:31.376319+0000","last_undegraded":"2024-09-13T17:53:31.376319+0000","last_fullsized":"2024-09-13T17:53:31.376319+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:54.581523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.114071+0000","last_change":"2024-09-13T17:53:32.109262+0000","last_active":"2024-09-13T17:53:32.114071+0000","last_peered":"2024-09-13T17:53:32.114071+0000","last_clean":"2024-09-13T17:53:32.114071+0000","last_became_active":"2024-09-13T17:53:32.109089+0000","last_became_peered":"2024-09-13T17:53:32.109089+0000","last_unstale":"2024-09-13T17:53:32.114071+0000","last_undegraded":"2024-09-13T17:53:32.114071+0000","last_fullsized":"2024-09-13T17:53:32.114071+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.850731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"39'7","reported_seq":24,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.383411+0000","last_change":"2024-09-13T17:53:08.330564+0000","last_active":"2024-09-13T17:53:31.383411+0000","last_peered":"2024-09-13T17:53:31.383411+0000","last_clean":"2024-09-13T17:53:31.383411+0000","last_became_active":"2024-09-13T17:53:08.326426+0000","last_became_peered":"2024-09-13T17:53:08.326426+0000","last_unstale":"2024-09-13T17:53:31.383411+0000","last_undegraded":"2024-09-13T17:53:31.383411+0000","last_fullsized":"2024-09-13T17:53:31.383411+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:48.932531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.380452+0000","last_change":"2024-09-13T17:53:07.928173+0000","last_active":"2024-09-13T17:53:31.380452+0000","last_peered":"2024-09-13T17:53:31.380452+0000","last_clean":"2024-09-13T17:53:31.380452+0000","last_became_active":"2024-09-13T17:53:07.927902+0000","last_became_peered":"2024-09-13T17:53:07.927902+0000","last_unstale":"2024-09-13T17:53:31.380452+0000","last_undegraded":"2024-09-13T17:53:31.380452+0000","last_fullsized":"2024-09-13T17:53:31.380452+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:14.147274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T17:53:32.107430+0000","last_change":"2024-09-13T17:53:32.100622+0000","last_active":"2024-09-13T17:53:32.107430+0000","last_peered":"2024-09-13T17:53:32.107430+0000","last_clean":"2024-09-13T17:53:32.107430+0000","last_became_active":"2024-09-13T17:53:32.100391+0000","last_became_peered":"2024-09-13T17:53:32.100391+0000","last_unstale":"2024-09-13T17:53:32.107430+0000","last_undegraded":"2024-09-13T17:53:32.107430+0000","last_fullsized":"2024-09-13T17:53:32.107430+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:31.365533+0000","last_clean_scrub_stamp":"2024-09-13T17:53:31.365533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:46.775837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"39'8","reported_seq":24,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.377828+0000","last_change":"2024-09-13T17:53:08.335357+0000","last_active":"2024-09-13T17:53:31.377828+0000","last_peered":"2024-09-13T17:53:31.377828+0000","last_clean":"2024-09-13T17:53:31.377828+0000","last_became_active":"2024-09-13T17:53:08.334939+0000","last_became_peered":"2024-09-13T17:53:08.334939+0000","last_unstale":"2024-09-13T17:53:31.377828+0000","last_undegraded":"2024-09-13T17:53:31.377828+0000","last_fullsized":"2024-09-13T17:53:31.377828+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:07.906764+0000","last_clean_scrub_stamp":"2024-09-13T17:53:07.906764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:59:48.932531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.382199+0000","last_change":"2024-09-13T17:53:07.943953+0000","last_active":"2024-09-13T17:53:31.382199+0000","last_peered":"2024-09-13T17:53:31.382199+0000","last_clean":"2024-09-13T17:53:31.382199+0000","last_became_active":"2024-09-13T17:53:07.943699+0000","last_became_peered":"2024-09-13T17:53:07.943699+0000","last_unstale":"2024-09-13T17:53:31.382199+0000","last_undegraded":"2024-09-13T17:53:31.382199+0000","last_fullsized":"2024-09-13T17:53:31.382199+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:53:06.899705+0000","last_clean_scrub_stamp":"2024-09-13T17:53:06.899705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:44.997390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-13T17:53:31.381695+0000","last_change":"2024-09-13T17:51:40.205691+0000","last_active":"2024-09-13T17:53:31.381695+0000","last_peered":"2024-09-13T17:53:31.381695+0000","last_clean":"2024-09-13T17:53:31.381695+0000","last_became_active":"2024-09-13T17:51:40.204577+0000","last_became_peered":"2024-09-13T17:51:40.204577+0000","last_unstale":"2024-09-13T17:53:31.381695+0000","last_undegraded":"2024-09-13T17:53:31.381695+0000","last_fullsized":"2024-09-13T17:53:31.381695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_clean_scrub_stamp":"2024-09-13T17:51:38.340495+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:37.899275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":504,"ondisk_log_size":504,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":95,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30192,"kb_used_data":3164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341648,"statfs":{"total":96636764160,"available":96605847552,"internally_reserved":0,"allocated":3239936,"data_stored":2934464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.627},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.60699999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.873}]},{"osd":3,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.70199999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.85099999999999998}]},{"osd":5,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.81699999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:52:39 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.755},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.72599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":548864,"data_stored":246944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.59899999999999998}]},{"osd":1,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.48899999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.63400000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.57999999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.66200000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.56100000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.69299999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33696,"kb_used_data":6668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338144,"statfs":{"total":96636764160,"available":96602259456,"internally_reserved":0,"allocated":6828032,"data_stored":6530727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.76500000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.79200000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.0910000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.751},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.73999999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.68100000000000005}]},{"osd":4,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.52500000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.58099999999999996}]},{"osd":7,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.621}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":548864,"data_stored":246944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.64000000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.71899999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.623},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.74099999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.69199999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.76800000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.85699999999999998}]},{"osd":7,"last update":"Fri Sep 13 17:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.83899999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31664,"kb_used_data":4632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340176,"statfs":{"total":96636764160,"available":96604340224,"internally_reserved":0,"allocated":4743168,"data_stored":4441248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.37},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":4.2460000000000004,"5min":4.2460000000000004,"15min":4.2460000000000004},"last":0.39100000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.008,"5min":5.008,"15min":5.008},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.41399999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":4.8570000000000002,"5min":4.8570000000000002,"15min":4.8570000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":4.8399999999999999,"5min":4.8399999999999999,"15min":4.8399999999999999},"last":0.45600000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":4.4450000000000003,"5min":4.4450000000000003,"15min":4.4450000000000003},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":4.9000000000000004,"5min":4.9000000000000004,"15min":4.9000000000000004},"last":0.67200000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":1.208},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":4.359,"5min":4.359,"15min":4.359},"last":1.083}]},{"osd":6,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":4.9710000000000001,"5min":4.9710000000000001,"15min":4.9710000000000001},"last":1.1879999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":1.0309999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":4.4029999999999996,"5min":4.4029999999999996,"15min":4.4029999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":4.9349999999999996,"5min":4.9349999999999996,"15min":4.9349999999999996},"last":1.2270000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":548864,"data_stored":246944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":5.5010000000000003,"5min":5.5010000000000003,"15min":5.5010000000000003},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":4.3689999999999998,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.36199999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":5.3799999999999999,"5min":5.3799999999999999,"15min":5.3799999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":4.2329999999999997,"5min":4.2329999999999997,"15min":4.2329999999999997},"last":0.51100000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":5.032,"5min":5.032,"15min":5.032},"last":0.48599999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":5.4189999999999996,"5min":5.4189999999999996,"15min":5.4189999999999996},"last":0.46500000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":5.4480000000000004,"5min":5.4480000000000004,"15min":5.4480000000000004},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":4.7460000000000004,"5min":4.7460000000000004,"15min":4.7460000000000004},"last":0.70999999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":4.4710000000000001,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":5.4749999999999996,"5min":5.4749999999999996,"15min":5.4749999999999996},"last":0.71899999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":4.7789999999999999,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":4.9859999999999998,"5min":4.9859999999999998,"15min":4.9859999999999998},"last":0.80100000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":4.8200000000000003,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":4.8879999999999999,"5min":4.8879999999999999,"15min":4.8879999999999999},"last":0.85099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":548864,"data_stored":246944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.49299999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.42499999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.40400000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.65900000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.55700000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.69199999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:52:37 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.67700000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1142784,"data_stored":837312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.34100000000000003}]},{"osd":2,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.63400000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.67000000000000004}]},{"osd":4,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.0350000000000001,"5min":3.0350000000000001,"15min":3.0350000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.68100000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.755}]},{"osd":7,"last update":"Fri Sep 13 17:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.9119999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.75,"5min":2.75,"15min":2.75},"last":0.57999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:53:36.853 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T17:53:36.853 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -s 2024-09-13T17:53:37.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.018+0000 7f96ca400640 1 Processor -- start 2024-09-13T17:53:37.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.018+0000 7f96ca400640 1 -- start start 2024-09-13T17:53:37.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.018+0000 7f96ca400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f96c40b2e50 0x7f96c40b3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.018+0000 7f96ca400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f96c40b2360 0x7f96c415ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.018+0000 7f96ca400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96c40b27d0 0x7f96c415d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.018+0000 7f96ca400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c40b08d0 con 0x7f96c40b2360 2024-09-13T17:53:37.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.018+0000 7f96ca400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c40b3770 con 0x7f96c40b2e50 2024-09-13T17:53:37.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.018+0000 7f96ca400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c40afcc0 con 0x7f96c40b27d0 2024-09-13T17:53:37.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.018+0000 7f96c2a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f96c40b2360 0x7f96c415ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.018+0000 7f96c2a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f96c40b2360 0x7f96c415ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43824/0 (socket says 172.21.15.114:43824) 2024-09-13T17:53:37.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.018+0000 7f96c2a00640 1 -- 172.21.15.114:0/220297210 learned_addr learned my addr 172.21.15.114:0/220297210 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:37.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.018+0000 7f96c3400640 1 --2- 172.21.15.114:0/220297210 >> v2:172.21.15.134:3300/0 conn(0x7f96c40b2e50 0x7f96c40b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.018+0000 7f96c3e00640 1 --2- 172.21.15.114:0/220297210 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96c40b27d0 0x7f96c415d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.018+0000 7f96c2a00640 1 -- 172.21.15.114:0/220297210 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96c40b27d0 msgr2=0x7f96c415d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:37.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.018+0000 7f96c2a00640 1 --2- 172.21.15.114:0/220297210 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96c40b27d0 0x7f96c415d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.018+0000 7f96c2a00640 1 -- 172.21.15.114:0/220297210 >> v2:172.21.15.134:3300/0 conn(0x7f96c40b2e50 msgr2=0x7f96c40b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:37.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.018+0000 7f96c2a00640 1 --2- 172.21.15.114:0/220297210 >> v2:172.21.15.134:3300/0 conn(0x7f96c40b2e50 0x7f96c40b3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.018+0000 7f96c2a00640 1 -- 172.21.15.114:0/220297210 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c40affa0 con 0x7f96c40b2360 2024-09-13T17:53:37.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.022+0000 7f96c2a00640 1 --2- 172.21.15.114:0/220297210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96c40b2360 0x7f96c415ce30 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f96c406d190 tx=0x7f96b001e700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e52f23e35f26f83 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.022+0000 7f96c2000640 1 -- 172.21.15.114:0/220297210 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b00ac640 con 0x7f96c40b2360 2024-09-13T17:53:37.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.022+0000 7f96c2000640 1 -- 172.21.15.114:0/220297210 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b00ac7a0 con 0x7f96c40b2360 2024-09-13T17:53:37.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.022+0000 7f96c2000640 1 -- 172.21.15.114:0/220297210 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b00acb30 con 0x7f96c40b2360 2024-09-13T17:53:37.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.022+0000 7f96ca400640 1 -- 172.21.15.114:0/220297210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96c40b2360 msgr2=0x7f96c415ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.022+0000 7f96ca400640 1 --2- 172.21.15.114:0/220297210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96c40b2360 0x7f96c415ce30 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f96c406d190 tx=0x7f96b001e700 comp rx=0 tx=0).stop 2024-09-13T17:53:37.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.022+0000 7f96ca400640 1 -- 172.21.15.114:0/220297210 shutdown_connections 2024-09-13T17:53:37.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.022+0000 7f96ca400640 1 --2- 172.21.15.114:0/220297210 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96c40b27d0 0x7f96c415d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.022+0000 7f96ca400640 1 --2- 172.21.15.114:0/220297210 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96c40b2360 0x7f96c415ce30 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.022+0000 7f96ca400640 1 --2- 172.21.15.114:0/220297210 >> v2:172.21.15.134:3300/0 conn(0x7f96c40b2e50 0x7f96c40b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.022+0000 7f96ca400640 1 -- 172.21.15.114:0/220297210 >> 172.21.15.114:0/220297210 conn(0x7f96c4098a70 msgr2=0x7f96c40b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:37.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.022+0000 7f96ca400640 1 -- 172.21.15.114:0/220297210 shutdown_connections 2024-09-13T17:53:37.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.022+0000 7f96ca400640 1 -- 172.21.15.114:0/220297210 wait complete. 2024-09-13T17:53:37.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.022+0000 7f96ca400640 1 Processor -- start 2024-09-13T17:53:37.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.026+0000 7f96ca400640 1 -- start start 2024-09-13T17:53:37.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.026+0000 7f96ca400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96c40b2360 0x7f96c4147580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.026+0000 7f96ca400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96c40b27d0 0x7f96c4153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.026+0000 7f96ca400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96c40b2e50 0x7f96c41540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.026+0000 7f96ca400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c414fed0 con 0x7f96c40b27d0 2024-09-13T17:53:37.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.026+0000 7f96ca400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c414f5c0 con 0x7f96c40b2e50 2024-09-13T17:53:37.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.026+0000 7f96ca400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c414cee0 con 0x7f96c40b2360 2024-09-13T17:53:37.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.026+0000 7f96c2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96c40b27d0 0x7f96c4153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.026+0000 7f96c2a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96c40b27d0 0x7f96c4153b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43832/0 (socket says 172.21.15.114:43832) 2024-09-13T17:53:37.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.026+0000 7f96c2a00640 1 -- 172.21.15.114:0/1781351117 learned_addr learned my addr 172.21.15.114:0/1781351117 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:37.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.026+0000 7f96c3400640 1 --2- 172.21.15.114:0/1781351117 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96c40b2360 0x7f96c4147580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.026+0000 7f96c3e00640 1 --2- 172.21.15.114:0/1781351117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96c40b2e50 0x7f96c41540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.026+0000 7f96c2a00640 1 -- 172.21.15.114:0/1781351117 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96c40b2360 msgr2=0x7f96c4147580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.026+0000 7f96c2a00640 1 --2- 172.21.15.114:0/1781351117 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96c40b2360 0x7f96c4147580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.026+0000 7f96c2a00640 1 -- 172.21.15.114:0/1781351117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96c40b2e50 msgr2=0x7f96c41540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.026+0000 7f96c2a00640 1 --2- 172.21.15.114:0/1781351117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96c40b2e50 0x7f96c41540d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.026+0000 7f96c2a00640 1 -- 172.21.15.114:0/1781351117 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b00094d0 con 0x7f96c40b27d0 2024-09-13T17:53:37.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.026+0000 7f96c3e00640 1 --2- 172.21.15.114:0/1781351117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96c40b2e50 0x7f96c41540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:37.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.026+0000 7f96c3400640 1 --2- 172.21.15.114:0/1781351117 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96c40b2360 0x7f96c4147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:37.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.026+0000 7f96c2a00640 1 --2- 172.21.15.114:0/1781351117 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96c40b27d0 0x7f96c4153b90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f96b001cdb0 tx=0x7f96b001cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.026+0000 7f96bb400640 1 -- 172.21.15.114:0/1781351117 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b00bf5f0 con 0x7f96c40b27d0 2024-09-13T17:53:37.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.026+0000 7f96bb400640 1 -- 172.21.15.114:0/1781351117 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b00bf770 con 0x7f96c40b27d0 2024-09-13T17:53:37.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.026+0000 7f96bb400640 1 -- 172.21.15.114:0/1781351117 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b00bfb20 con 0x7f96c40b27d0 2024-09-13T17:53:37.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.026+0000 7f96ca400640 1 -- 172.21.15.114:0/1781351117 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c414f810 con 0x7f96c40b27d0 2024-09-13T17:53:37.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.026+0000 7f96ca400640 1 -- 172.21.15.114:0/1781351117 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c4147ac0 con 0x7f96c40b27d0 2024-09-13T17:53:37.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.026+0000 7f96ca400640 1 -- 172.21.15.114:0/1781351117 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c4150010 con 0x7f96c40b27d0 2024-09-13T17:53:37.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.030+0000 7f96bb400640 1 -- 172.21.15.114:0/1781351117 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f96b00aa050 con 0x7f96c40b27d0 2024-09-13T17:53:37.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.030+0000 7f96bb400640 1 --2- 172.21.15.114:0/1781351117 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f96a4066690 0x7f96a4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.030+0000 7f96bb400640 1 -- 172.21.15.114:0/1781351117 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f96b011e410 con 0x7f96c40b27d0 2024-09-13T17:53:37.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.030+0000 7f96c3400640 1 --2- 172.21.15.114:0/1781351117 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f96a4066690 0x7f96a4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.030+0000 7f96c3400640 1 --2- 172.21.15.114:0/1781351117 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f96a4066690 0x7f96a4068b50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f96b4009b30 tx=0x7f96b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.034+0000 7f96bb400640 1 -- 172.21.15.114:0/1781351117 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f96c4150010 con 0x7f96c40b27d0 2024-09-13T17:53:37.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.242+0000 7f96ca400640 1 -- 172.21.15.114:0/1781351117 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f96c4150010 con 0x7f96c40b27d0 2024-09-13T17:53:37.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.242+0000 7f96bb400640 1 -- 172.21.15.114:0/1781351117 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+599 (secure 0 0 0) 0x7f96c4150010 con 0x7f96c40b27d0 2024-09-13T17:53:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: cluster: 2024-09-13T17:53:37.248 INFO:teuthology.orchestra.run.smithi114.stdout: id: d730423f-882d-4061-b746-f6a7dc2544e0 2024-09-13T17:53:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: health: HEALTH_ERR 2024-09-13T17:53:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: 2 filesystems are degraded 2024-09-13T17:53:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: 2 filesystems are offline 2024-09-13T17:53:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: services: 2024-09-13T17:53:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: mon: 3 daemons, quorum a,b,c (age 2m) 2024-09-13T17:53:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: mgr: y(active, since 2m), standbys: x 2024-09-13T17:53:37.249 INFO:teuthology.orchestra.run.smithi114.stdout: mds: 0/2 daemons up (2 failed), 4 standby 2024-09-13T17:53:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: osd: 8 osds: 8 up (since 119s), 8 in (since 2m) 2024-09-13T17:53:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: data: 2024-09-13T17:53:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: volumes: 0/2 healthy, 2 failed 2024-09-13T17:53:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: pools: 4 pools, 129 pgs 2024-09-13T17:53:37.250 INFO:teuthology.orchestra.run.smithi114.stdout: objects: 4 objects, 6.6 MiB 2024-09-13T17:53:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: usage: 228 MiB used, 720 GiB / 720 GiB avail 2024-09-13T17:53:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: pgs: 129 active+clean 2024-09-13T17:53:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: io: 2024-09-13T17:53:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: client: 0 B/s wr, 0 op/s rd, 4 op/s wr 2024-09-13T17:53:37.251 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:37.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.246+0000 7f96ca400640 1 -- 172.21.15.114:0/1781351117 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f96a4066690 msgr2=0x7f96a4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.246+0000 7f96ca400640 1 --2- 172.21.15.114:0/1781351117 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f96a4066690 0x7f96a4068b50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f96b4009b30 tx=0x7f96b4008040 comp rx=0 tx=0).stop 2024-09-13T17:53:37.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.246+0000 7f96ca400640 1 -- 172.21.15.114:0/1781351117 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96c40b27d0 msgr2=0x7f96c4153b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.246+0000 7f96ca400640 1 --2- 172.21.15.114:0/1781351117 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96c40b27d0 0x7f96c4153b90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f96b001cdb0 tx=0x7f96b001cf40 comp rx=0 tx=0).stop 2024-09-13T17:53:37.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.246+0000 7f96ca400640 1 -- 172.21.15.114:0/1781351117 shutdown_connections 2024-09-13T17:53:37.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.246+0000 7f96ca400640 1 --2- 172.21.15.114:0/1781351117 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f96a4066690 0x7f96a4068b50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.246+0000 7f96ca400640 1 --2- 172.21.15.114:0/1781351117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96c40b2e50 0x7f96c41540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.246+0000 7f96ca400640 1 --2- 172.21.15.114:0/1781351117 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96c40b27d0 0x7f96c4153b90 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.246+0000 7f96ca400640 1 --2- 172.21.15.114:0/1781351117 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f96c40b2360 0x7f96c4147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.246+0000 7f96ca400640 1 -- 172.21.15.114:0/1781351117 >> 172.21.15.114:0/1781351117 conn(0x7f96c4098a70 msgr2=0x7f96c406ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:37.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.246+0000 7f96ca400640 1 -- 172.21.15.114:0/1781351117 shutdown_connections 2024-09-13T17:53:37.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.246+0000 7f96ca400640 1 -- 172.21.15.114:0/1781351117 wait complete. 2024-09-13T17:53:37.270 DEBUG:teuthology.orchestra.run.smithi114:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 init --force-init --filesystem recovery_fs --alternate-pool recovery_fs_metadata 2024-09-13T17:53:37.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.310+0000 7f4a020bc8c0 1 -- start start 2024-09-13T17:53:37.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.310+0000 7f4a020bc8c0 1 Processor -- start 2024-09-13T17:53:37.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.310+0000 7f4a020bc8c0 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605551c9800 0x560555254580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.310+0000 7f4a020bc8c0 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5605551c9400 0x560555254b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.310+0000 7f4a020bc8c0 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605551c9000 0x560555255080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.310+0000 7f4a020bc8c0 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x560555296a00 con 0x5605551c9800 2024-09-13T17:53:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.310+0000 7f4a020bc8c0 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x560555296780 con 0x5605551c9000 2024-09-13T17:53:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.310+0000 7f4a020bc8c0 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x560555296640 con 0x5605551c9400 2024-09-13T17:53:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.310+0000 7f4a00200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605551c9800 0x560555254580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.310+0000 7f4a00200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605551c9800 0x560555254580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43850/0 (socket says 172.21.15.114:43850) 2024-09-13T17:53:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.310+0000 7f4a00200640 1 -- 172.21.15.114:0/2028578929 learned_addr learned my addr 172.21.15.114:0/2028578929 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.310+0000 7f49ff800640 1 --2- 172.21.15.114:0/2028578929 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5605551c9400 0x560555254b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.310+0000 7f4a00c00640 1 --2- 172.21.15.114:0/2028578929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605551c9000 0x560555255080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.310+0000 7f4a00200640 1 -- 172.21.15.114:0/2028578929 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5605551c9400 msgr2=0x560555254b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.310+0000 7f4a00200640 1 --2- 172.21.15.114:0/2028578929 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5605551c9400 0x560555254b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.310+0000 7f4a00200640 1 -- 172.21.15.114:0/2028578929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605551c9000 msgr2=0x560555255080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:37.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.310+0000 7f4a00200640 1 --2- 172.21.15.114:0/2028578929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605551c9000 0x560555255080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.310+0000 7f4a00200640 1 -- 172.21.15.114:0/2028578929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605551fe9c0 con 0x5605551c9800 2024-09-13T17:53:37.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.310+0000 7f4a00c00640 1 --2- 172.21.15.114:0/2028578929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605551c9000 0x560555255080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:37.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.310+0000 7f4a00200640 1 --2- 172.21.15.114:0/2028578929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605551c9800 0x560555254580 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x560556015920 tx=0x560555f824e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97981f93aa2443d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.310+0000 7f49fd000640 1 -- 172.21.15.114:0/2028578929 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56055521d600 con 0x5605551c9800 2024-09-13T17:53:37.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.310+0000 7f49fd000640 1 -- 172.21.15.114:0/2028578929 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560555226480 con 0x5605551c9800 2024-09-13T17:53:37.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.310+0000 7f49fd000640 1 -- 172.21.15.114:0/2028578929 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56055521d1e0 con 0x5605551c9800 2024-09-13T17:53:37.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.310+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/2028578929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5605551feb60 con 0x5605551c9800 2024-09-13T17:53:37.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.310+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/2028578929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5605551fe340 con 0x5605551c9800 2024-09-13T17:53:37.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.310+0000 7f4a020bc8c0 4 waiting for MDS map... 2024-09-13T17:53:37.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f49fd000640 1 -- 172.21.15.114:0/2028578929 <== mon.0 v2:172.21.15.114:3300/0 4 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x56055520ac40 con 0x5605551c9800 2024-09-13T17:53:37.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f49fd000640 1 -- 172.21.15.114:0/2028578929 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 23) v1 ==== 3691+0+0 (secure 0 0 0) 0x560555216f00 con 0x5605551c9800 2024-09-13T17:53:37.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a020bc8c0 4 Got MDS map 23 2024-09-13T17:53:37.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a020bc8c0 4 datascan.main: Using metadata pool output 2024-09-13T17:53:37.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a020bc8c0 4 datascan.main: connecting to RADOS... 2024-09-13T17:53:37.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a020bc8c0 1 Processor -- start 2024-09-13T17:53:37.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a020bc8c0 1 -- start start 2024-09-13T17:53:37.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a020bc8c0 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605560e4c00 0x560555255600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a020bc8c0 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605560e5000 0x560555255b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a020bc8c0 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5605560e5400 0x560555256100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a020bc8c0 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x56055520fe00 con 0x5605560e4c00 2024-09-13T17:53:37.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a020bc8c0 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x560555296780 con 0x5605560e5000 2024-09-13T17:53:37.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a020bc8c0 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x560555296500 con 0x5605560e5400 2024-09-13T17:53:37.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a00c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605560e4c00 0x560555255600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a00c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605560e4c00 0x560555255600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43854/0 (socket says 172.21.15.114:43854) 2024-09-13T17:53:37.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a00c00640 1 -- 172.21.15.114:0/3579051925 learned_addr learned my addr 172.21.15.114:0/3579051925 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:37.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a00200640 1 --2- 172.21.15.114:0/3579051925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605560e5000 0x560555255b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a00c00640 1 -- 172.21.15.114:0/3579051925 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5605560e5400 msgr2=0x560555256100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T17:53:37.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a00c00640 1 --2- 172.21.15.114:0/3579051925 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5605560e5400 0x560555256100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a00c00640 1 -- 172.21.15.114:0/3579051925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605560e5000 msgr2=0x560555255b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:37.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a00c00640 1 --2- 172.21.15.114:0/3579051925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605560e5000 0x560555255b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a00c00640 1 -- 172.21.15.114:0/3579051925 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605551fe000 con 0x5605560e4c00 2024-09-13T17:53:37.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a00c00640 1 --2- 172.21.15.114:0/3579051925 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605560e4c00 0x560555255600 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x560555f98930 tx=0x5605560eac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41b45d3e4a01f28 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f49fa800640 1 -- 172.21.15.114:0/3579051925 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56055521d600 con 0x5605560e4c00 2024-09-13T17:53:37.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f49fa800640 1 -- 172.21.15.114:0/3579051925 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560555f95380 con 0x5605560e4c00 2024-09-13T17:53:37.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f49fa800640 1 -- 172.21.15.114:0/3579051925 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56055521d1e0 con 0x5605560e4c00 2024-09-13T17:53:37.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/3579051925 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605560e4c00 msgr2=0x560555255600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a020bc8c0 1 --2- 172.21.15.114:0/3579051925 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605560e4c00 0x560555255600 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x560555f98930 tx=0x5605560eac00 comp rx=0 tx=0).stop 2024-09-13T17:53:37.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/3579051925 shutdown_connections 2024-09-13T17:53:37.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a020bc8c0 1 --2- 172.21.15.114:0/3579051925 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5605560e5400 0x560555256100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a020bc8c0 1 --2- 172.21.15.114:0/3579051925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605560e5000 0x560555255b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a020bc8c0 1 --2- 172.21.15.114:0/3579051925 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605560e4c00 0x560555255600 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/3579051925 >> 172.21.15.114:0/3579051925 conn(0x5605551c8c00 msgr2=0x5605551f5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:37.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/3579051925 shutdown_connections 2024-09-13T17:53:37.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.314+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/3579051925 wait complete. 2024-09-13T17:53:37.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.318+0000 7f4a020bc8c0 1 Processor -- start 2024-09-13T17:53:37.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.318+0000 7f4a020bc8c0 1 -- start start 2024-09-13T17:53:37.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.318+0000 7f4a020bc8c0 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5605560e4c00 0x560555257180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.318+0000 7f4a020bc8c0 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605560e5000 0x560555256c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.318+0000 7f4a020bc8c0 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605560e5400 0x560555256680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.318+0000 7f4a020bc8c0 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605552963c0 con 0x5605560e5400 2024-09-13T17:53:37.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.318+0000 7f4a020bc8c0 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x560555296280 con 0x5605560e5000 2024-09-13T17:53:37.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.318+0000 7f4a020bc8c0 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x560555296140 con 0x5605560e4c00 2024-09-13T17:53:37.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.318+0000 7f49ff800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605560e5400 0x560555256680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.318+0000 7f49ff800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605560e5400 0x560555256680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43858/0 (socket says 172.21.15.114:43858) 2024-09-13T17:53:37.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.318+0000 7f49ff800640 1 -- 172.21.15.114:0/1667556835 learned_addr learned my addr 172.21.15.114:0/1667556835 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:37.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.318+0000 7f4a00c00640 1 --2- 172.21.15.114:0/1667556835 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5605560e4c00 0x560555257180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.318+0000 7f49ff800640 1 -- 172.21.15.114:0/1667556835 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5605560e4c00 msgr2=0x560555257180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.318+0000 7f49ff800640 1 --2- 172.21.15.114:0/1667556835 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5605560e4c00 0x560555257180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.318+0000 7f49ff800640 1 -- 172.21.15.114:0/1667556835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605560e5000 msgr2=0x560555256c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.318+0000 7f49ff800640 1 --2- 172.21.15.114:0/1667556835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605560e5000 0x560555256c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.318+0000 7f49ff800640 1 -- 172.21.15.114:0/1667556835 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605551fe9c0 con 0x5605560e5400 2024-09-13T17:53:37.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.318+0000 7f49ff800640 1 --2- 172.21.15.114:0/1667556835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605560e5400 0x560555256680 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x560556014f60 tx=0x560555f82000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.318+0000 7f49f8a00640 1 -- 172.21.15.114:0/1667556835 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56055521d080 con 0x5605560e5400 2024-09-13T17:53:37.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.318+0000 7f49f8a00640 1 -- 172.21.15.114:0/1667556835 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560555f95680 con 0x5605560e5400 2024-09-13T17:53:37.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.318+0000 7f49f8a00640 1 -- 172.21.15.114:0/1667556835 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56055521d600 con 0x5605560e5400 2024-09-13T17:53:37.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.318+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/1667556835 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5605551feb60 con 0x5605560e5400 2024-09-13T17:53:37.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.318+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/1667556835 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5605551feea0 con 0x5605560e5400 2024-09-13T17:53:37.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.318+0000 7f4a020bc8c0 4 datascan.init: forcing metadata pool 'recovery_fs_metadata' 2024-09-13T17:53:37.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.322+0000 7f49f8a00640 1 -- 172.21.15.114:0/1667556835 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x560555203080 con 0x5605560e5400 2024-09-13T17:53:37.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.322+0000 7f49f8a00640 1 --2- 172.21.15.114:0/1667556835 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x56055614cc00 0x560555257700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.322+0000 7f49f8a00640 1 -- 172.21.15.114:0/1667556835 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x56055520aa80 con 0x5605560e5400 2024-09-13T17:53:37.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.322+0000 7f4a020bc8c0 1 --2- 172.21.15.114:0/1667556835 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x5605560e5800 0x560555256100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.322+0000 7f4a00c00640 1 --2- 172.21.15.114:0/1667556835 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x56055614cc00 0x560555257700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.322+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/1667556835 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:1 7.14 7:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x5605560e5c00 con 0x5605560e5800 2024-09-13T17:53:37.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.322+0000 7f4a00200640 1 --2- 172.21.15.114:0/1667556835 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x5605560e5800 0x560555256100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.322+0000 7f4a00c00640 1 --2- 172.21.15.114:0/1667556835 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x56055614cc00 0x560555257700 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x560555f98930 tx=0x560555f52360 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.322+0000 7f4a00200640 1 --2- 172.21.15.114:0/1667556835 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x5605560e5800 0x560555256100 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.322+0000 7f4a00200640 1 -- 172.21.15.114:0/1667556835 <== osd.3 v2:172.21.15.114:6824/1824187331 1 ==== osd_op_reply(1 1.00000000.inode [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 160+0+0 (crc 0 0 0) 0x5605560c6b40 con 0x5605560e5800 2024-09-13T17:53:37.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.322+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/1667556835 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:2 7.14 7:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) v8 -- 0x56055614d000 con 0x5605560e5800 2024-09-13T17:53:37.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.322+0000 7f4a00200640 1 -- 172.21.15.114:0/1667556835 <== osd.3 v2:172.21.15.114:6824/1824187331 2 ==== osd_op_reply(2 1.00000000.inode [writefull 0~582] v48'1 uv1 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x5605560c6b40 con 0x5605560e5800 2024-09-13T17:53:37.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.322+0000 7f4a020bc8c0 1 --2- 172.21.15.114:0/1667556835 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x56055614d400 0x560555255b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.322+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/1667556835 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:3 7.1f 7:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x56055614d800 con 0x56055614d400 2024-09-13T17:53:37.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.322+0000 7f4a00c00640 1 --2- 172.21.15.114:0/1667556835 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x56055614d400 0x560555255b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.326+0000 7f4a00c00640 1 --2- 172.21.15.114:0/1667556835 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x56055614d400 0x560555255b80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.326+0000 7f4a00c00640 1 -- 172.21.15.114:0/1667556835 <== osd.6 v2:172.21.15.134:6824/1813072387 1 ==== osd_op_reply(3 100.00000000.inode [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 162+0+0 (crc 0 0 0) 0x5605560c7200 con 0x56055614d400 2024-09-13T17:53:37.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.326+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/1667556835 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:4 7.1f 7:fe07bba1:::100.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) v8 -- 0x56055614dc00 con 0x56055614d400 2024-09-13T17:53:37.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.326+0000 7f4a00c00640 1 -- 172.21.15.114:0/1667556835 <== osd.6 v2:172.21.15.134:6824/1813072387 2 ==== osd_op_reply(4 100.00000000.inode [writefull 0~582] v48'1 uv1 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x5605560c7200 con 0x56055614d400 2024-09-13T17:53:37.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.326+0000 7f4a020bc8c0 1 --2- 172.21.15.114:0/1667556835 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x5605555a6000 0x560555255600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.326+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/1667556835 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:5 7.13 7:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x5605555a6400 con 0x5605555a6000 2024-09-13T17:53:37.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.326+0000 7f4a00200640 1 --2- 172.21.15.114:0/1667556835 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x5605555a6000 0x560555255600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.326+0000 7f4a00200640 1 --2- 172.21.15.114:0/1667556835 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x5605555a6000 0x560555255600 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a00200640 1 -- 172.21.15.114:0/1667556835 <== osd.0 v2:172.21.15.114:6808/4163905135 1 ==== osd_op_reply(5 100.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5605560c6b40 con 0x5605555a6000 2024-09-13T17:53:37.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a020bc8c0 10 datascan.find_or_create_dirfrag: read_version = 0 2024-09-13T17:53:37.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/1667556835 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:6 7.13 7:cd5a64a3:::100.00000000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) v8 -- 0x5605555a6800 con 0x5605555a6000 2024-09-13T17:53:37.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a00200640 1 -- 172.21.15.114:0/1667556835 <== osd.0 v2:172.21.15.114:6808/4163905135 2 ==== osd_op_reply(6 100.00000000 [create,omap-set-header] v48'1 uv1 ondisk = 0) v8 ==== 198+0+0 (crc 0 0 0) 0x5605560c6b40 con 0x5605555a6000 2024-09-13T17:53:37.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a020bc8c0 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x100 2024-09-13T17:53:37.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/1667556835 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x5605555a6000 msgr2=0x560555255600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a020bc8c0 1 --2- 172.21.15.114:0/1667556835 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x5605555a6000 0x560555255600 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/1667556835 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x5605560e5800 msgr2=0x560555256100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a020bc8c0 1 --2- 172.21.15.114:0/1667556835 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x5605560e5800 0x560555256100 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/1667556835 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x56055614d400 msgr2=0x560555255b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a020bc8c0 1 --2- 172.21.15.114:0/1667556835 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x56055614d400 0x560555255b80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f49ff800640 1 -- 172.21.15.114:0/1667556835 reap_dead start 2024-09-13T17:53:37.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/1667556835 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x56055614cc00 msgr2=0x560555257700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a020bc8c0 1 --2- 172.21.15.114:0/1667556835 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x56055614cc00 0x560555257700 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x560555f98930 tx=0x560555f52360 comp rx=0 tx=0).stop 2024-09-13T17:53:37.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/1667556835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605560e5400 msgr2=0x560555256680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a020bc8c0 1 --2- 172.21.15.114:0/1667556835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605560e5400 0x560555256680 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x560556014f60 tx=0x560555f82000 comp rx=0 tx=0).stop 2024-09-13T17:53:37.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/1667556835 shutdown_connections 2024-09-13T17:53:37.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a020bc8c0 1 --2- 172.21.15.114:0/1667556835 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x56055614cc00 0x560555257700 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a020bc8c0 1 --2- 172.21.15.114:0/1667556835 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605560e5400 0x560555256680 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/1667556835 >> 172.21.15.114:0/1667556835 conn(0x5605551c8c00 msgr2=0x5605551f5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:37.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/1667556835 shutdown_connections 2024-09-13T17:53:37.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/1667556835 wait complete. 2024-09-13T17:53:37.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/2028578929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605551c9800 msgr2=0x560555254580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a020bc8c0 1 --2- 172.21.15.114:0/2028578929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605551c9800 0x560555254580 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x560556015920 tx=0x560555f824e0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/2028578929 shutdown_connections 2024-09-13T17:53:37.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a020bc8c0 1 --2- 172.21.15.114:0/2028578929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605551c9000 0x560555255080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a020bc8c0 1 --2- 172.21.15.114:0/2028578929 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5605551c9400 0x560555254b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a020bc8c0 1 --2- 172.21.15.114:0/2028578929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5605551c9800 0x560555254580 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/2028578929 >> 172.21.15.114:0/2028578929 conn(0x5605551c9c00 msgr2=0x5605551f5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:37.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/2028578929 shutdown_connections 2024-09-13T17:53:37.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.330+0000 7f4a020bc8c0 1 -- 172.21.15.114:0/2028578929 wait complete. 2024-09-13T17:53:37.341 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'init', '--force-init', '--filesystem', 'recovery_fs', '--alternate-pool', 'recovery_fs_metadata'] in time 0:00:00.071594, result: 2024-09-13T17:53:37.341 DEBUG:teuthology.orchestra.run.smithi114:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 recovery_fs:0 reset session 2024-09-13T17:53:37.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.422+0000 7f5ff8953400 1 -- start start 2024-09-13T17:53:37.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.422+0000 7f5ff8953400 1 Processor -- start 2024-09-13T17:53:37.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.422+0000 7f5ff8953400 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b2f5f9800 0x558b2f684580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.422+0000 7f5ff8953400 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558b2f5f9400 0x558b2f684b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.422+0000 7f5ff8953400 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558b2f5f9000 0x558b2f685080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.422+0000 7f5ff8953400 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b2f6c6a00 con 0x558b2f5f9400 2024-09-13T17:53:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.422+0000 7f5ff8953400 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b2f6c6780 con 0x558b2f5f9800 2024-09-13T17:53:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.422+0000 7f5ff8953400 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x558b2f6c6640 con 0x558b2f5f9000 2024-09-13T17:53:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.422+0000 7f5ff6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558b2f5f9400 0x558b2f684b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.422+0000 7f5ff6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558b2f5f9400 0x558b2f684b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43886/0 (socket says 172.21.15.114:43886) 2024-09-13T17:53:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.422+0000 7f5ff6000640 1 -- 172.21.15.114:0/3725318106 learned_addr learned my addr 172.21.15.114:0/3725318106 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.422+0000 7f5ff6a00640 1 --2- 172.21.15.114:0/3725318106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b2f5f9800 0x558b2f684580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.422+0000 7f5ff7400640 1 --2- 172.21.15.114:0/3725318106 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558b2f5f9000 0x558b2f685080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.422+0000 7f5ff6000640 1 -- 172.21.15.114:0/3725318106 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558b2f5f9000 msgr2=0x558b2f685080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.422+0000 7f5ff6000640 1 --2- 172.21.15.114:0/3725318106 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558b2f5f9000 0x558b2f685080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.422+0000 7f5ff6000640 1 -- 172.21.15.114:0/3725318106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b2f5f9800 msgr2=0x558b2f684580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.422+0000 7f5ff6000640 1 --2- 172.21.15.114:0/3725318106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b2f5f9800 0x558b2f684580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.422+0000 7f5ff6000640 1 -- 172.21.15.114:0/3725318106 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b2f6309c0 con 0x558b2f5f9400 2024-09-13T17:53:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff6000640 1 --2- 172.21.15.114:0/3725318106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558b2f5f9400 0x558b2f684b00 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x558b303c23c0 tx=0x558b303ce000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9baf8c25d60216 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff3800640 1 -- 172.21.15.114:0/3725318106 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558b2f64d080 con 0x558b2f5f9400 2024-09-13T17:53:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff3800640 1 -- 172.21.15.114:0/3725318106 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558b2f656180 con 0x558b2f5f9400 2024-09-13T17:53:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff8953400 1 -- 172.21.15.114:0/3725318106 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558b2f6301a0 con 0x558b2f5f9400 2024-09-13T17:53:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff8953400 1 -- 172.21.15.114:0/3725318106 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x558b2f6309c0 con 0x558b2f5f9400 2024-09-13T17:53:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff8953400 4 waiting for MDS map... 2024-09-13T17:53:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff3800640 1 -- 172.21.15.114:0/3725318106 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558b2f64d600 con 0x558b2f5f9400 2024-09-13T17:53:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff3800640 1 -- 172.21.15.114:0/3725318106 <== mon.0 v2:172.21.15.114:3300/0 4 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x558b2f63ac40 con 0x558b2f5f9400 2024-09-13T17:53:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff3800640 1 -- 172.21.15.114:0/3725318106 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 23) v1 ==== 3691+0+0 (secure 0 0 0) 0x558b2f646f00 con 0x558b2f5f9400 2024-09-13T17:53:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff8953400 4 Got MDS map 23 2024-09-13T17:53:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff8953400 10 main: main 2024-09-13T17:53:37.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff8953400 4 main: connecting to RADOS... 2024-09-13T17:53:37.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff8953400 1 Processor -- start 2024-09-13T17:53:37.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff8953400 1 -- start start 2024-09-13T17:53:37.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff8953400 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b303cb800 0x558b2f685600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff8953400 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558b303cbc00 0x558b2f685b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff8953400 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558b30564000 0x558b2f686100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff8953400 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b2f63fe00 con 0x558b30564000 2024-09-13T17:53:37.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff8953400 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b2f6c6780 con 0x558b303cb800 2024-09-13T17:53:37.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff8953400 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x558b2f6c6a00 con 0x558b303cbc00 2024-09-13T17:53:37.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558b30564000 0x558b2f686100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff6000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558b30564000 0x558b2f686100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43892/0 (socket says 172.21.15.114:43892) 2024-09-13T17:53:37.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff6000640 1 -- 172.21.15.114:0/4197718446 learned_addr learned my addr 172.21.15.114:0/4197718446 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:37.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff7400640 1 --2- 172.21.15.114:0/4197718446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b303cb800 0x558b2f685600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff6a00640 1 --2- 172.21.15.114:0/4197718446 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558b303cbc00 0x558b2f685b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff6000640 1 -- 172.21.15.114:0/4197718446 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558b303cbc00 msgr2=0x558b2f685b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:37.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff6000640 1 --2- 172.21.15.114:0/4197718446 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558b303cbc00 0x558b2f685b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff6000640 1 -- 172.21.15.114:0/4197718446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b303cb800 msgr2=0x558b2f685600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:37.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff6000640 1 --2- 172.21.15.114:0/4197718446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b303cb800 0x558b2f685600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff6000640 1 -- 172.21.15.114:0/4197718446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b2f630b60 con 0x558b30564000 2024-09-13T17:53:37.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff6000640 1 --2- 172.21.15.114:0/4197718446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558b30564000 0x558b2f686100 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x558b305660c0 tx=0x558b303ce420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f478c103f5b0a40f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff1000640 1 -- 172.21.15.114:0/4197718446 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558b2f64d1e0 con 0x558b30564000 2024-09-13T17:53:37.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff1000640 1 -- 172.21.15.114:0/4197718446 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558b303e2c00 con 0x558b30564000 2024-09-13T17:53:37.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff1000640 1 -- 172.21.15.114:0/4197718446 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558b2f64cf20 con 0x558b30564000 2024-09-13T17:53:37.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff8953400 1 -- 172.21.15.114:0/4197718446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558b30564000 msgr2=0x558b2f686100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.426+0000 7f5ff8953400 1 --2- 172.21.15.114:0/4197718446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558b30564000 0x558b2f686100 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x558b305660c0 tx=0x558b303ce420 comp rx=0 tx=0).stop 2024-09-13T17:53:37.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5ff8953400 1 -- 172.21.15.114:0/4197718446 shutdown_connections 2024-09-13T17:53:37.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5ff8953400 1 --2- 172.21.15.114:0/4197718446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558b30564000 0x558b2f686100 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5ff8953400 1 --2- 172.21.15.114:0/4197718446 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558b303cbc00 0x558b2f685b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5ff8953400 1 --2- 172.21.15.114:0/4197718446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b303cb800 0x558b2f685600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5ff8953400 1 -- 172.21.15.114:0/4197718446 >> 172.21.15.114:0/4197718446 conn(0x558b2f5f8c00 msgr2=0x558b2f627800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:37.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5ff8953400 1 -- 172.21.15.114:0/4197718446 shutdown_connections 2024-09-13T17:53:37.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5ff8953400 1 -- 172.21.15.114:0/4197718446 wait complete. 2024-09-13T17:53:37.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5ff8953400 1 Processor -- start 2024-09-13T17:53:37.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5ff8953400 1 -- start start 2024-09-13T17:53:37.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5ff8953400 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558b303cbc00 0x558b2f687180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5ff8953400 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b303cb800 0x558b2f686c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5ff8953400 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558b30565800 0x558b2f686680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5ff8953400 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b2f6c6500 con 0x558b303cbc00 2024-09-13T17:53:37.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5ff8953400 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b2f6c63c0 con 0x558b303cb800 2024-09-13T17:53:37.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5ff8953400 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x558b2f6c6280 con 0x558b30565800 2024-09-13T17:53:37.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5ff7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558b303cbc00 0x558b2f687180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5ff7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558b303cbc00 0x558b2f687180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43902/0 (socket says 172.21.15.114:43902) 2024-09-13T17:53:37.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5ff7400640 1 -- 172.21.15.114:0/1732161005 learned_addr learned my addr 172.21.15.114:0/1732161005 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:37.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5ff6a00640 1 --2- 172.21.15.114:0/1732161005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b303cb800 0x558b2f686c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5ff7400640 1 -- 172.21.15.114:0/1732161005 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558b30565800 msgr2=0x558b2f686680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5ff7400640 1 --2- 172.21.15.114:0/1732161005 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558b30565800 0x558b2f686680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5ff7400640 1 -- 172.21.15.114:0/1732161005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b303cb800 msgr2=0x558b2f686c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5ff7400640 1 --2- 172.21.15.114:0/1732161005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b303cb800 0x558b2f686c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5ff7400640 1 -- 172.21.15.114:0/1732161005 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b2f6301a0 con 0x558b303cbc00 2024-09-13T17:53:37.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5ff7400640 1 --2- 172.21.15.114:0/1732161005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558b303cbc00 0x558b2f687180 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x558b30566ea0 tx=0x558b30526c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5fef200640 1 -- 172.21.15.114:0/1732161005 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558b2f64d1e0 con 0x558b303cbc00 2024-09-13T17:53:37.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5fef200640 1 -- 172.21.15.114:0/1732161005 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558b303e3500 con 0x558b303cbc00 2024-09-13T17:53:37.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5ff8953400 1 -- 172.21.15.114:0/1732161005 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558b2f6309c0 con 0x558b303cbc00 2024-09-13T17:53:37.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5fef200640 1 -- 172.21.15.114:0/1732161005 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558b2f64cf20 con 0x558b303cbc00 2024-09-13T17:53:37.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5ff8953400 1 -- 172.21.15.114:0/1732161005 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558b2f630b60 con 0x558b303cbc00 2024-09-13T17:53:37.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.430+0000 7f5ff8953400 4 main: resolving pool 7 2024-09-13T17:53:37.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.434+0000 7f5fef200640 1 -- 172.21.15.114:0/1732161005 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x558b2f6c4840 con 0x558b303cbc00 2024-09-13T17:53:37.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.434+0000 7f5fef200640 1 --2- 172.21.15.114:0/1732161005 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x558b2f8dac00 0x558b2f687700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.434+0000 7f5fef200640 1 -- 172.21.15.114:0/1732161005 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x558b2f63aa80 con 0x558b303cbc00 2024-09-13T17:53:37.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.434+0000 7f5ff8953400 4 main: creating IoCtx.. 2024-09-13T17:53:37.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.434+0000 7f5ff6a00640 1 --2- 172.21.15.114:0/1732161005 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x558b2f8dac00 0x558b2f687700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.434+0000 7f5ff8953400 1 --2- 172.21.15.114:0/1732161005 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x558b30565400 0x558b2f686100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.434+0000 7f5ff8953400 1 -- 172.21.15.114:0/1732161005 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:1 7.b 7:d0630e4c:::mds0_sessionmap:head [omap-clear,omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) v8 -- 0x558b30565000 con 0x558b30565400 2024-09-13T17:53:37.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.434+0000 7f5ff6000640 1 --2- 172.21.15.114:0/1732161005 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x558b30565400 0x558b2f686100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.434+0000 7f5ff6a00640 1 --2- 172.21.15.114:0/1732161005 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x558b2f8dac00 0x558b2f687700 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x558b303c40c0 tx=0x558b30527ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.434+0000 7f5ff6000640 1 --2- 172.21.15.114:0/1732161005 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x558b30565400 0x558b2f686100 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.438+0000 7f5ff6000640 1 -- 172.21.15.114:0/1732161005 <== osd.1 v2:172.21.15.114:6816/2809354915 1 ==== osd_op_reply(1 mds0_sessionmap [omap-clear,omap-set-header] v48'1 uv1 ondisk = 0) v8 ==== 201+0+0 (crc 0 0 0) 0x558b303e6b40 con 0x558b30565400 2024-09-13T17:53:37.444 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-13T17:53:37.444 INFO:teuthology.orchestra.run.smithi114.stdout: "0": { 2024-09-13T17:53:37.444 INFO:teuthology.orchestra.run.smithi114.stdout: "data": {}, 2024-09-13T17:53:37.444 INFO:teuthology.orchestra.run.smithi114.stdout: "result": 0 2024-09-13T17:53:37.445 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:37.445 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-13T17:53:37.445 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:37.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.438+0000 7f5ff8953400 1 -- 172.21.15.114:0/1732161005 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x558b30565400 msgr2=0x558b2f686100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.438+0000 7f5ff8953400 1 --2- 172.21.15.114:0/1732161005 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x558b30565400 0x558b2f686100 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.438+0000 7f5ff8953400 1 -- 172.21.15.114:0/1732161005 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x558b2f8dac00 msgr2=0x558b2f687700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.438+0000 7f5ff8953400 1 --2- 172.21.15.114:0/1732161005 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x558b2f8dac00 0x558b2f687700 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x558b303c40c0 tx=0x558b30527ec0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.438+0000 7f5ff8953400 1 -- 172.21.15.114:0/1732161005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558b303cbc00 msgr2=0x558b2f687180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.438+0000 7f5ff8953400 1 --2- 172.21.15.114:0/1732161005 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558b303cbc00 0x558b2f687180 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x558b30566ea0 tx=0x558b30526c00 comp rx=0 tx=0).stop 2024-09-13T17:53:37.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.438+0000 7f5ff6a00640 1 -- 172.21.15.114:0/1732161005 reap_dead start 2024-09-13T17:53:37.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.438+0000 7f5ff8953400 1 -- 172.21.15.114:0/1732161005 shutdown_connections 2024-09-13T17:53:37.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.438+0000 7f5ff8953400 1 -- 172.21.15.114:0/1732161005 >> 172.21.15.114:0/1732161005 conn(0x558b2f5f8c00 msgr2=0x558b2f627800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:37.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.438+0000 7f5ff8953400 1 -- 172.21.15.114:0/1732161005 shutdown_connections 2024-09-13T17:53:37.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.438+0000 7f5ff8953400 1 -- 172.21.15.114:0/1732161005 wait complete. 2024-09-13T17:53:37.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.438+0000 7f5ff8953400 1 -- 172.21.15.114:0/3725318106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558b2f5f9400 msgr2=0x558b2f684b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.438+0000 7f5ff8953400 1 --2- 172.21.15.114:0/3725318106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558b2f5f9400 0x558b2f684b00 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x558b303c23c0 tx=0x558b303ce000 comp rx=0 tx=0).stop 2024-09-13T17:53:37.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.438+0000 7f5ff8953400 1 -- 172.21.15.114:0/3725318106 shutdown_connections 2024-09-13T17:53:37.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.438+0000 7f5ff8953400 1 --2- 172.21.15.114:0/3725318106 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x558b2f5f9000 0x558b2f685080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.438+0000 7f5ff8953400 1 --2- 172.21.15.114:0/3725318106 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x558b2f5f9400 0x558b2f684b00 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.438+0000 7f5ff8953400 1 --2- 172.21.15.114:0/3725318106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b2f5f9800 0x558b2f684580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.438+0000 7f5ff8953400 1 -- 172.21.15.114:0/3725318106 >> 172.21.15.114:0/3725318106 conn(0x558b2f5f9c00 msgr2=0x558b2f627000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:37.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.438+0000 7f5ff8953400 1 -- 172.21.15.114:0/3725318106 shutdown_connections 2024-09-13T17:53:37.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.438+0000 7f5ff8953400 1 -- 172.21.15.114:0/3725318106 wait complete. 2024-09-13T17:53:37.449 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'recovery_fs:0', 'reset', 'session'] in time 0:00:00.107530, result: { "0": { "data": {}, "result": 0 } } 2024-09-13T17:53:37.449 DEBUG:teuthology.orchestra.run.smithi114:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 recovery_fs:0 reset snap 2024-09-13T17:53:37.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.530+0000 7f7733985400 1 -- start start 2024-09-13T17:53:37.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.530+0000 7f7733985400 1 Processor -- start 2024-09-13T17:53:37.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.530+0000 7f7733985400 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556281bc5800 0x556281c50580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.530+0000 7f7733985400 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556281bc5400 0x556281c50b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.530+0000 7f7733985400 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556281bc5000 0x556281c51080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.530+0000 7f7733985400 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x556281c0be00 con 0x556281bc5800 2024-09-13T17:53:37.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.530+0000 7f7733985400 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x556281c92a00 con 0x556281bc5000 2024-09-13T17:53:37.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.530+0000 7f7733985400 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x556281c92640 con 0x556281bc5400 2024-09-13T17:53:37.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.530+0000 7f7731a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556281bc5800 0x556281c50580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.530+0000 7f7731a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556281bc5800 0x556281c50580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43906/0 (socket says 172.21.15.114:43906) 2024-09-13T17:53:37.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.530+0000 7f7731a00640 1 -- 172.21.15.114:0/1075900234 learned_addr learned my addr 172.21.15.114:0/1075900234 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:37.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.530+0000 7f7731a00640 1 -- 172.21.15.114:0/1075900234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556281bc5400 msgr2=0x556281c50b00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T17:53:37.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.530+0000 7f7731a00640 1 --2- 172.21.15.114:0/1075900234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556281bc5400 0x556281c50b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.530+0000 7f7731a00640 1 -- 172.21.15.114:0/1075900234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556281bc5000 msgr2=0x556281c51080 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T17:53:37.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.530+0000 7f7731a00640 1 --2- 172.21.15.114:0/1075900234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556281bc5000 0x556281c51080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.530+0000 7f7731a00640 1 -- 172.21.15.114:0/1075900234 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556281bfc9c0 con 0x556281bc5800 2024-09-13T17:53:37.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.530+0000 7f7731a00640 1 --2- 172.21.15.114:0/1075900234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556281bc5800 0x556281c50580 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x5562829843c0 tx=0x556282992000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2726e5e4b8e30d02 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.530+0000 7f772e800640 1 -- 172.21.15.114:0/1075900234 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556281c19080 con 0x556281bc5800 2024-09-13T17:53:37.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.530+0000 7f772e800640 1 -- 172.21.15.114:0/1075900234 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556281c22480 con 0x556281bc5800 2024-09-13T17:53:37.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.530+0000 7f772e800640 1 -- 172.21.15.114:0/1075900234 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556281c19600 con 0x556281bc5800 2024-09-13T17:53:37.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.530+0000 7f7733985400 1 -- 172.21.15.114:0/1075900234 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556281bfc1a0 con 0x556281bc5800 2024-09-13T17:53:37.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.530+0000 7f7733985400 1 -- 172.21.15.114:0/1075900234 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x556281bfc9c0 con 0x556281bc5800 2024-09-13T17:53:37.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.530+0000 7f7733985400 4 waiting for MDS map... 2024-09-13T17:53:37.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.530+0000 7f772e800640 1 -- 172.21.15.114:0/1075900234 <== mon.0 v2:172.21.15.114:3300/0 4 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x556281c06c40 con 0x556281bc5800 2024-09-13T17:53:37.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.530+0000 7f772e800640 1 -- 172.21.15.114:0/1075900234 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 23) v1 ==== 3691+0+0 (secure 0 0 0) 0x556281c12f00 con 0x556281bc5800 2024-09-13T17:53:37.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.530+0000 7f7733985400 4 Got MDS map 23 2024-09-13T17:53:37.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.530+0000 7f7733985400 10 main: main 2024-09-13T17:53:37.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.530+0000 7f7733985400 4 main: connecting to RADOS... 2024-09-13T17:53:37.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f7733985400 1 Processor -- start 2024-09-13T17:53:37.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f7733985400 1 -- start start 2024-09-13T17:53:37.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f7733985400 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562829a3800 0x556281c51600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f7733985400 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5562829a3c00 0x556281c51b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f7733985400 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556282b32000 0x556281c52100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f7733985400 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x556281c92500 con 0x5562829a3800 2024-09-13T17:53:37.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f7733985400 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x556281c923c0 con 0x5562829a3c00 2024-09-13T17:53:37.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f7733985400 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x556281c92640 con 0x556282b32000 2024-09-13T17:53:37.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f7732400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562829a3800 0x556281c51600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f7732400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562829a3800 0x556281c51600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43910/0 (socket says 172.21.15.114:43910) 2024-09-13T17:53:37.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f7732400640 1 -- 172.21.15.114:0/1491353686 learned_addr learned my addr 172.21.15.114:0/1491353686 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:37.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f7732400640 1 -- 172.21.15.114:0/1491353686 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556282b32000 msgr2=0x556281c52100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:37.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f7732400640 1 --2- 172.21.15.114:0/1491353686 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556282b32000 0x556281c52100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f7732400640 1 -- 172.21.15.114:0/1491353686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5562829a3c00 msgr2=0x556281c51b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:37.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f7732400640 1 --2- 172.21.15.114:0/1491353686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5562829a3c00 0x556281c51b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f7732400640 1 -- 172.21.15.114:0/1491353686 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556281bfcb60 con 0x5562829a3800 2024-09-13T17:53:37.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f7732400640 1 --2- 172.21.15.114:0/1491353686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562829a3800 0x556281c51600 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x5562829881b0 tx=0x556282ae4d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cabb9a959a589028 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f772c000640 1 -- 172.21.15.114:0/1491353686 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556281c19080 con 0x5562829a3800 2024-09-13T17:53:37.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f772c000640 1 -- 172.21.15.114:0/1491353686 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556281c22480 con 0x5562829a3800 2024-09-13T17:53:37.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f772c000640 1 -- 172.21.15.114:0/1491353686 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556281c19600 con 0x5562829a3800 2024-09-13T17:53:37.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f7733985400 1 -- 172.21.15.114:0/1491353686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562829a3800 msgr2=0x556281c51600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f7733985400 1 --2- 172.21.15.114:0/1491353686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562829a3800 0x556281c51600 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x5562829881b0 tx=0x556282ae4d20 comp rx=0 tx=0).stop 2024-09-13T17:53:37.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f7733985400 1 -- 172.21.15.114:0/1491353686 shutdown_connections 2024-09-13T17:53:37.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f7733985400 1 --2- 172.21.15.114:0/1491353686 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556282b32000 0x556281c52100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f7733985400 1 --2- 172.21.15.114:0/1491353686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5562829a3c00 0x556281c51b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f7733985400 1 --2- 172.21.15.114:0/1491353686 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562829a3800 0x556281c51600 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f7733985400 1 -- 172.21.15.114:0/1491353686 >> 172.21.15.114:0/1491353686 conn(0x556281bc4c00 msgr2=0x556281bf1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:37.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f7733985400 1 -- 172.21.15.114:0/1491353686 shutdown_connections 2024-09-13T17:53:37.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f7733985400 1 -- 172.21.15.114:0/1491353686 wait complete. 2024-09-13T17:53:37.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f7733985400 1 Processor -- start 2024-09-13T17:53:37.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.534+0000 7f7733985400 1 -- start start 2024-09-13T17:53:37.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.538+0000 7f7733985400 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562829a3c00 0x556281c53180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.538+0000 7f7733985400 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5562829a3800 0x556281c52c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.538+0000 7f7733985400 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556282b33800 0x556281c52680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.538+0000 7f7733985400 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x556281c92280 con 0x5562829a3c00 2024-09-13T17:53:37.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.538+0000 7f7733985400 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x556281c92140 con 0x5562829a3800 2024-09-13T17:53:37.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.538+0000 7f7733985400 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x556281c92000 con 0x556282b33800 2024-09-13T17:53:37.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.538+0000 7f7732400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562829a3c00 0x556281c53180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.538+0000 7f7732400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562829a3c00 0x556281c53180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43924/0 (socket says 172.21.15.114:43924) 2024-09-13T17:53:37.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.538+0000 7f7732400640 1 -- 172.21.15.114:0/3642935336 learned_addr learned my addr 172.21.15.114:0/3642935336 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:37.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.538+0000 7f7731a00640 1 --2- 172.21.15.114:0/3642935336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5562829a3800 0x556281c52c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.538+0000 7f7731000640 1 --2- 172.21.15.114:0/3642935336 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556282b33800 0x556281c52680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.538+0000 7f7732400640 1 -- 172.21.15.114:0/3642935336 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556282b33800 msgr2=0x556281c52680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.538+0000 7f7732400640 1 --2- 172.21.15.114:0/3642935336 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556282b33800 0x556281c52680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.538+0000 7f7732400640 1 -- 172.21.15.114:0/3642935336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5562829a3800 msgr2=0x556281c52c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.538+0000 7f7732400640 1 --2- 172.21.15.114:0/3642935336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5562829a3800 0x556281c52c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.538+0000 7f7732400640 1 -- 172.21.15.114:0/3642935336 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556281bfc340 con 0x5562829a3c00 2024-09-13T17:53:37.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.538+0000 7f7732400640 1 --2- 172.21.15.114:0/3642935336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562829a3c00 0x556281c53180 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x556282988e70 tx=0x556282ae4c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.538+0000 7f772a200640 1 -- 172.21.15.114:0/3642935336 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556281c18dc0 con 0x5562829a3c00 2024-09-13T17:53:37.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.538+0000 7f772a200640 1 -- 172.21.15.114:0/3642935336 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556282998180 con 0x5562829a3c00 2024-09-13T17:53:37.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.538+0000 7f772a200640 1 -- 172.21.15.114:0/3642935336 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556281c19080 con 0x5562829a3c00 2024-09-13T17:53:37.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.538+0000 7f7733985400 1 -- 172.21.15.114:0/3642935336 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556281bfc000 con 0x5562829a3c00 2024-09-13T17:53:37.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.538+0000 7f7733985400 1 -- 172.21.15.114:0/3642935336 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556281bfcea0 con 0x5562829a3c00 2024-09-13T17:53:37.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.538+0000 7f7733985400 4 main: resolving pool 7 2024-09-13T17:53:37.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.538+0000 7f772a200640 1 -- 172.21.15.114:0/3642935336 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x556281c90840 con 0x5562829a3c00 2024-09-13T17:53:37.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.538+0000 7f772a200640 1 --2- 172.21.15.114:0/3642935336 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x556282b3c800 0x556281c53700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.538+0000 7f772a200640 1 -- 172.21.15.114:0/3642935336 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x556281c06a80 con 0x5562829a3c00 2024-09-13T17:53:37.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.538+0000 7f7733985400 4 main: creating IoCtx.. 2024-09-13T17:53:37.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.542+0000 7f7731a00640 1 --2- 172.21.15.114:0/3642935336 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x556282b3c800 0x556281c53700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.542+0000 7f7733985400 1 --2- 172.21.15.114:0/3642935336 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x556282b33400 0x556281c52100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.542+0000 7f7733985400 1 -- 172.21.15.114:0/3642935336 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:1 7.d 7:b50e409b:::mds_snaptable:head [writefull 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) v8 -- 0x556282b33000 con 0x556282b33400 2024-09-13T17:53:37.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.542+0000 7f7731000640 1 --2- 172.21.15.114:0/3642935336 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x556282b33400 0x556281c52100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.542+0000 7f7731a00640 1 --2- 172.21.15.114:0/3642935336 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x556282b3c800 0x556281c53700 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x556282987f20 tx=0x556282992300 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.542+0000 7f7731000640 1 --2- 172.21.15.114:0/3642935336 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x556282b33400 0x556281c52100 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.542+0000 7f7731000640 1 -- 172.21.15.114:0/3642935336 <== osd.6 v2:172.21.15.134:6824/1813072387 1 ==== osd_op_reply(1 mds_snaptable [writefull 0~70] v48'1 uv1 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x556282990b40 con 0x556282b33400 2024-09-13T17:53:37.555 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-13T17:53:37.555 INFO:teuthology.orchestra.run.smithi114.stdout: "result": 0 2024-09-13T17:53:37.555 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-13T17:53:37.556 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:37.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.542+0000 7f7733985400 1 -- 172.21.15.114:0/3642935336 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x556282b33400 msgr2=0x556281c52100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.542+0000 7f7733985400 1 --2- 172.21.15.114:0/3642935336 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x556282b33400 0x556281c52100 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.542+0000 7f7733985400 1 -- 172.21.15.114:0/3642935336 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x556282b3c800 msgr2=0x556281c53700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.542+0000 7f7733985400 1 --2- 172.21.15.114:0/3642935336 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x556282b3c800 0x556281c53700 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x556282987f20 tx=0x556282992300 comp rx=0 tx=0).stop 2024-09-13T17:53:37.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.542+0000 7f7733985400 1 -- 172.21.15.114:0/3642935336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562829a3c00 msgr2=0x556281c53180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.542+0000 7f7733985400 1 --2- 172.21.15.114:0/3642935336 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5562829a3c00 0x556281c53180 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x556282988e70 tx=0x556282ae4c00 comp rx=0 tx=0).stop 2024-09-13T17:53:37.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.542+0000 7f7731000640 1 -- 172.21.15.114:0/3642935336 reap_dead start 2024-09-13T17:53:37.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.542+0000 7f7733985400 1 -- 172.21.15.114:0/3642935336 shutdown_connections 2024-09-13T17:53:37.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.542+0000 7f7733985400 1 -- 172.21.15.114:0/3642935336 >> 172.21.15.114:0/3642935336 conn(0x556281bc4c00 msgr2=0x556281bf1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:37.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.542+0000 7f7733985400 1 -- 172.21.15.114:0/3642935336 shutdown_connections 2024-09-13T17:53:37.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.542+0000 7f7733985400 1 -- 172.21.15.114:0/3642935336 wait complete. 2024-09-13T17:53:37.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.542+0000 7f7733985400 1 -- 172.21.15.114:0/1075900234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556281bc5800 msgr2=0x556281c50580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.542+0000 7f7733985400 1 --2- 172.21.15.114:0/1075900234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556281bc5800 0x556281c50580 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x5562829843c0 tx=0x556282992000 comp rx=0 tx=0).stop 2024-09-13T17:53:37.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.542+0000 7f7733985400 1 -- 172.21.15.114:0/1075900234 shutdown_connections 2024-09-13T17:53:37.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.542+0000 7f7733985400 1 --2- 172.21.15.114:0/1075900234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556281bc5000 0x556281c51080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.542+0000 7f7733985400 1 --2- 172.21.15.114:0/1075900234 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x556281bc5400 0x556281c50b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.542+0000 7f7733985400 1 --2- 172.21.15.114:0/1075900234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x556281bc5800 0x556281c50580 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.542+0000 7f7733985400 1 -- 172.21.15.114:0/1075900234 >> 172.21.15.114:0/1075900234 conn(0x556281bc5c00 msgr2=0x556281bf1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:37.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.542+0000 7f7733985400 1 -- 172.21.15.114:0/1075900234 shutdown_connections 2024-09-13T17:53:37.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.542+0000 7f7733985400 1 -- 172.21.15.114:0/1075900234 wait complete. 2024-09-13T17:53:37.564 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'recovery_fs:0', 'reset', 'snap'] in time 0:00:00.114925, result: { "result": 0 } 2024-09-13T17:53:37.564 DEBUG:teuthology.orchestra.run.smithi114:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 recovery_fs:0 reset inode 2024-09-13T17:53:37.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.638+0000 7f57af62e400 1 -- start start 2024-09-13T17:53:37.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57af62e400 1 Processor -- start 2024-09-13T17:53:37.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57af62e400 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ff88a3000 0x559ff892e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57af62e400 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ff88a3400 0x559ff892eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57af62e400 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ff88a3800 0x559ff892f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57af62e400 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ff8970a00 con 0x559ff88a3800 2024-09-13T17:53:37.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57af62e400 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ff8970780 con 0x559ff88a3000 2024-09-13T17:53:37.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57af62e400 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ff8970640 con 0x559ff88a3400 2024-09-13T17:53:37.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57ad000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ff88a3800 0x559ff892f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57ad000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ff88a3800 0x559ff892f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43938/0 (socket says 172.21.15.114:43938) 2024-09-13T17:53:37.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57ad000640 1 -- 172.21.15.114:0/2612878237 learned_addr learned my addr 172.21.15.114:0/2612878237 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:37.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57abc00640 1 --2- 172.21.15.114:0/2612878237 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ff88a3400 0x559ff892eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57ac600640 1 --2- 172.21.15.114:0/2612878237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ff88a3000 0x559ff892e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57ad000640 1 -- 172.21.15.114:0/2612878237 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ff88a3400 msgr2=0x559ff892eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:37.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57ad000640 1 --2- 172.21.15.114:0/2612878237 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ff88a3400 0x559ff892eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57ad000640 1 -- 172.21.15.114:0/2612878237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ff88a3000 msgr2=0x559ff892e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:37.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57ad000640 1 --2- 172.21.15.114:0/2612878237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ff88a3000 0x559ff892e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57ad000640 1 -- 172.21.15.114:0/2612878237 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ff88da9c0 con 0x559ff88a3800 2024-09-13T17:53:37.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57ad000640 1 --2- 172.21.15.114:0/2612878237 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ff88a3800 0x559ff892f080 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x559ff972ad80 tx=0x559ff9680600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e72442505e86ba4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57a9400640 1 -- 172.21.15.114:0/2612878237 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559ff88f7600 con 0x559ff88a3800 2024-09-13T17:53:37.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57a9400640 1 -- 172.21.15.114:0/2612878237 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559ff8900480 con 0x559ff88a3800 2024-09-13T17:53:37.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57a9400640 1 -- 172.21.15.114:0/2612878237 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559ff88f71e0 con 0x559ff88a3800 2024-09-13T17:53:37.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57af62e400 1 -- 172.21.15.114:0/2612878237 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559ff88dab60 con 0x559ff88a3800 2024-09-13T17:53:37.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57af62e400 1 -- 172.21.15.114:0/2612878237 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x559ff88da340 con 0x559ff88a3800 2024-09-13T17:53:37.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57af62e400 4 waiting for MDS map... 2024-09-13T17:53:37.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57a9400640 1 -- 172.21.15.114:0/2612878237 <== mon.0 v2:172.21.15.114:3300/0 4 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x559ff88e4c40 con 0x559ff88a3800 2024-09-13T17:53:37.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57a9400640 1 -- 172.21.15.114:0/2612878237 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 23) v1 ==== 3691+0+0 (secure 0 0 0) 0x559ff88f0f00 con 0x559ff88a3800 2024-09-13T17:53:37.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57af62e400 4 Got MDS map 23 2024-09-13T17:53:37.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57af62e400 10 main: main 2024-09-13T17:53:37.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57af62e400 4 main: connecting to RADOS... 2024-09-13T17:53:37.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57af62e400 1 Processor -- start 2024-09-13T17:53:37.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.642+0000 7f57af62e400 1 -- start start 2024-09-13T17:53:37.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57af62e400 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ff9818400 0x559ff892f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57af62e400 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ff9818800 0x559ff892fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57af62e400 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ff9818c00 0x559ff8930100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57af62e400 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ff88e9e00 con 0x559ff9818400 2024-09-13T17:53:37.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57af62e400 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ff8970780 con 0x559ff9818800 2024-09-13T17:53:37.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57af62e400 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ff8970500 con 0x559ff9818c00 2024-09-13T17:53:37.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57abc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ff9818400 0x559ff892f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57abc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ff9818400 0x559ff892f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43944/0 (socket says 172.21.15.114:43944) 2024-09-13T17:53:37.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57abc00640 1 -- 172.21.15.114:0/1698005778 learned_addr learned my addr 172.21.15.114:0/1698005778 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:37.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57abc00640 1 -- 172.21.15.114:0/1698005778 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ff9818c00 msgr2=0x559ff8930100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T17:53:37.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57abc00640 1 --2- 172.21.15.114:0/1698005778 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ff9818c00 0x559ff8930100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57abc00640 1 -- 172.21.15.114:0/1698005778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ff9818800 msgr2=0x559ff892fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:37.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57abc00640 1 --2- 172.21.15.114:0/1698005778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ff9818800 0x559ff892fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57abc00640 1 -- 172.21.15.114:0/1698005778 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ff88da000 con 0x559ff9818400 2024-09-13T17:53:37.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57abc00640 1 --2- 172.21.15.114:0/1698005778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ff9818400 0x559ff892f600 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x559ff9828120 tx=0x559ff97d8c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=117f424dadb72680 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57a6c00640 1 -- 172.21.15.114:0/1698005778 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559ff88f7600 con 0x559ff9818400 2024-09-13T17:53:37.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57a6c00640 1 -- 172.21.15.114:0/1698005778 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559ff8900480 con 0x559ff9818400 2024-09-13T17:53:37.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57a6c00640 1 -- 172.21.15.114:0/1698005778 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559ff88f71e0 con 0x559ff9818400 2024-09-13T17:53:37.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57af62e400 1 -- 172.21.15.114:0/1698005778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ff9818400 msgr2=0x559ff892f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57af62e400 1 --2- 172.21.15.114:0/1698005778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ff9818400 0x559ff892f600 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x559ff9828120 tx=0x559ff97d8c00 comp rx=0 tx=0).stop 2024-09-13T17:53:37.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57af62e400 1 -- 172.21.15.114:0/1698005778 shutdown_connections 2024-09-13T17:53:37.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57af62e400 1 --2- 172.21.15.114:0/1698005778 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ff9818c00 0x559ff8930100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57af62e400 1 --2- 172.21.15.114:0/1698005778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ff9818800 0x559ff892fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57af62e400 1 --2- 172.21.15.114:0/1698005778 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ff9818400 0x559ff892f600 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57af62e400 1 -- 172.21.15.114:0/1698005778 >> 172.21.15.114:0/1698005778 conn(0x559ff9818000 msgr2=0x559ff88d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:37.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57af62e400 1 -- 172.21.15.114:0/1698005778 shutdown_connections 2024-09-13T17:53:37.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57af62e400 1 -- 172.21.15.114:0/1698005778 wait complete. 2024-09-13T17:53:37.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57af62e400 1 Processor -- start 2024-09-13T17:53:37.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57af62e400 1 -- start start 2024-09-13T17:53:37.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57af62e400 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ff9818400 0x559ff8931180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57af62e400 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ff9818800 0x559ff8930c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57af62e400 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ff9818c00 0x559ff8930680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57af62e400 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ff89703c0 con 0x559ff9818800 2024-09-13T17:53:37.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57af62e400 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ff8970280 con 0x559ff9818400 2024-09-13T17:53:37.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57af62e400 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ff8970140 con 0x559ff9818c00 2024-09-13T17:53:37.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57ac600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ff9818800 0x559ff8930c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57ac600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ff9818800 0x559ff8930c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43958/0 (socket says 172.21.15.114:43958) 2024-09-13T17:53:37.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57ac600640 1 -- 172.21.15.114:0/995374607 learned_addr learned my addr 172.21.15.114:0/995374607 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:37.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57abc00640 1 --2- 172.21.15.114:0/995374607 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ff9818400 0x559ff8931180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.646+0000 7f57abc00640 1 --2- 172.21.15.114:0/995374607 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ff9818c00 0x559ff8930680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.650+0000 7f57ac600640 1 -- 172.21.15.114:0/995374607 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ff9818c00 msgr2=0x559ff8930680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.650+0000 7f57ac600640 1 --2- 172.21.15.114:0/995374607 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ff9818c00 0x559ff8930680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.650+0000 7f57ac600640 1 -- 172.21.15.114:0/995374607 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ff9818400 msgr2=0x559ff8931180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.650+0000 7f57ac600640 1 --2- 172.21.15.114:0/995374607 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ff9818400 0x559ff8931180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.650+0000 7f57ac600640 1 -- 172.21.15.114:0/995374607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ff88da9c0 con 0x559ff9818800 2024-09-13T17:53:37.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.650+0000 7f57ac600640 1 --2- 172.21.15.114:0/995374607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ff9818800 0x559ff8930c00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x559ff98293b0 tx=0x559ff9680060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.650+0000 7f57a4e00640 1 -- 172.21.15.114:0/995374607 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559ff88f7080 con 0x559ff9818800 2024-09-13T17:53:37.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.650+0000 7f57a4e00640 1 -- 172.21.15.114:0/995374607 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559ff8900180 con 0x559ff9818800 2024-09-13T17:53:37.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.650+0000 7f57a4e00640 1 -- 172.21.15.114:0/995374607 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559ff88f7600 con 0x559ff9818800 2024-09-13T17:53:37.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.650+0000 7f57af62e400 1 -- 172.21.15.114:0/995374607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559ff88dab60 con 0x559ff9818800 2024-09-13T17:53:37.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.650+0000 7f57af62e400 1 -- 172.21.15.114:0/995374607 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559ff88da340 con 0x559ff9818800 2024-09-13T17:53:37.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.650+0000 7f57af62e400 4 main: resolving pool 7 2024-09-13T17:53:37.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.650+0000 7f57a4e00640 1 -- 172.21.15.114:0/995374607 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x559ff896e840 con 0x559ff9818800 2024-09-13T17:53:37.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.650+0000 7f57a4e00640 1 --2- 172.21.15.114:0/995374607 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x559ff9819c00 0x559ff8931700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.650+0000 7f57a4e00640 1 -- 172.21.15.114:0/995374607 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x559ff88e4a80 con 0x559ff9818800 2024-09-13T17:53:37.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.650+0000 7f57af62e400 4 main: creating IoCtx.. 2024-09-13T17:53:37.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.650+0000 7f57af62e400 1 --2- 172.21.15.114:0/995374607 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x559ff8c80000 0x559ff8930100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.650+0000 7f57af62e400 1 -- 172.21.15.114:0/995374607 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:1 7.13 7:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) v8 -- 0x559ff8c80400 con 0x559ff8c80000 2024-09-13T17:53:37.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.650+0000 7f57abc00640 1 --2- 172.21.15.114:0/995374607 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x559ff9819c00 0x559ff8931700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.650+0000 7f57abc00640 1 --2- 172.21.15.114:0/995374607 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x559ff8c80000 0x559ff8930100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.650+0000 7f57abc00640 1 --2- 172.21.15.114:0/995374607 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x559ff9819c00 0x559ff8931700 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x559ff98281b0 tx=0x559ff97d9e00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.650+0000 7f57abc00640 1 --2- 172.21.15.114:0/995374607 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x559ff8c80000 0x559ff8930100 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.654+0000 7f57abc00640 1 -- 172.21.15.114:0/995374607 <== osd.0 v2:172.21.15.114:6808/4163905135 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v48'2 uv2 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x559ff97bab40 con 0x559ff8c80000 2024-09-13T17:53:37.661 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-13T17:53:37.661 INFO:teuthology.orchestra.run.smithi114.stdout: "0": { 2024-09-13T17:53:37.661 INFO:teuthology.orchestra.run.smithi114.stdout: "data": {}, 2024-09-13T17:53:37.662 INFO:teuthology.orchestra.run.smithi114.stdout: "result": 0 2024-09-13T17:53:37.662 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-09-13T17:53:37.662 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-13T17:53:37.662 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:37.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.654+0000 7f57af62e400 1 -- 172.21.15.114:0/995374607 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x559ff8c80000 msgr2=0x559ff8930100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.654+0000 7f57af62e400 1 --2- 172.21.15.114:0/995374607 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x559ff8c80000 0x559ff8930100 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.654+0000 7f57af62e400 1 -- 172.21.15.114:0/995374607 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x559ff9819c00 msgr2=0x559ff8931700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.654+0000 7f57af62e400 1 --2- 172.21.15.114:0/995374607 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x559ff9819c00 0x559ff8931700 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x559ff98281b0 tx=0x559ff97d9e00 comp rx=0 tx=0).stop 2024-09-13T17:53:37.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.654+0000 7f57af62e400 1 -- 172.21.15.114:0/995374607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ff9818800 msgr2=0x559ff8930c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.654+0000 7f57af62e400 1 --2- 172.21.15.114:0/995374607 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ff9818800 0x559ff8930c00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x559ff98293b0 tx=0x559ff9680060 comp rx=0 tx=0).stop 2024-09-13T17:53:37.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.654+0000 7f57ac600640 1 -- 172.21.15.114:0/995374607 reap_dead start 2024-09-13T17:53:37.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.654+0000 7f57af62e400 1 -- 172.21.15.114:0/995374607 shutdown_connections 2024-09-13T17:53:37.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.654+0000 7f57af62e400 1 -- 172.21.15.114:0/995374607 >> 172.21.15.114:0/995374607 conn(0x559ff9818000 msgr2=0x559ff88d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:37.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.654+0000 7f57af62e400 1 -- 172.21.15.114:0/995374607 shutdown_connections 2024-09-13T17:53:37.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.654+0000 7f57af62e400 1 -- 172.21.15.114:0/995374607 wait complete. 2024-09-13T17:53:37.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.654+0000 7f57af62e400 1 -- 172.21.15.114:0/2612878237 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ff88a3800 msgr2=0x559ff892f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.654+0000 7f57af62e400 1 --2- 172.21.15.114:0/2612878237 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ff88a3800 0x559ff892f080 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x559ff972ad80 tx=0x559ff9680600 comp rx=0 tx=0).stop 2024-09-13T17:53:37.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.654+0000 7f57af62e400 1 -- 172.21.15.114:0/2612878237 shutdown_connections 2024-09-13T17:53:37.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.654+0000 7f57af62e400 1 --2- 172.21.15.114:0/2612878237 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x559ff88a3800 0x559ff892f080 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.654+0000 7f57af62e400 1 --2- 172.21.15.114:0/2612878237 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x559ff88a3400 0x559ff892eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.654+0000 7f57af62e400 1 --2- 172.21.15.114:0/2612878237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559ff88a3000 0x559ff892e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.654+0000 7f57af62e400 1 -- 172.21.15.114:0/2612878237 >> 172.21.15.114:0/2612878237 conn(0x559ff88a2c00 msgr2=0x559ff88cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:37.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.654+0000 7f57af62e400 1 -- 172.21.15.114:0/2612878237 shutdown_connections 2024-09-13T17:53:37.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.654+0000 7f57af62e400 1 -- 172.21.15.114:0/2612878237 wait complete. 2024-09-13T17:53:37.665 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'recovery_fs:0', 'reset', 'inode'] in time 0:00:00.100948, result: { "0": { "data": {}, "result": 0 } } 2024-09-13T17:53:37.665 DEBUG:teuthology.orchestra.run.smithi114:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents --alternate-pool recovery_fs_metadata --filesystem cephfs cephfs_data 2024-09-13T17:53:37.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.706+0000 7f1f7c6da8c0 1 -- start start 2024-09-13T17:53:37.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f7c6da8c0 1 Processor -- start 2024-09-13T17:53:37.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f7c6da8c0 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2bd250000 0x55c2bc50f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f7c6da8c0 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2bc483c00 0x55c2bc50eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f7c6da8c0 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c2bc483800 0x55c2bc50fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f7c6da8c0 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2bc550a00 con 0x55c2bd250000 2024-09-13T17:53:37.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f7c6da8c0 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2bc4c9e00 con 0x55c2bc483c00 2024-09-13T17:53:37.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f7c6da8c0 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c2bc550280 con 0x55c2bc483800 2024-09-13T17:53:37.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f7a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2bd250000 0x55c2bc50f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f7a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2bd250000 0x55c2bc50f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43976/0 (socket says 172.21.15.114:43976) 2024-09-13T17:53:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f7a800640 1 -- 172.21.15.114:0/1501838588 learned_addr learned my addr 172.21.15.114:0/1501838588 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f7b200640 1 --2- 172.21.15.114:0/1501838588 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c2bc483800 0x55c2bc50fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f79e00640 1 --2- 172.21.15.114:0/1501838588 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2bc483c00 0x55c2bc50eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f7a800640 1 -- 172.21.15.114:0/1501838588 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c2bc483800 msgr2=0x55c2bc50fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f7a800640 1 --2- 172.21.15.114:0/1501838588 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c2bc483800 0x55c2bc50fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f7a800640 1 -- 172.21.15.114:0/1501838588 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2bc483c00 msgr2=0x55c2bc50eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f7a800640 1 --2- 172.21.15.114:0/1501838588 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2bc483c00 0x55c2bc50eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f7a800640 1 -- 172.21.15.114:0/1501838588 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2bc4b8ea0 con 0x55c2bd250000 2024-09-13T17:53:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f7b200640 1 --2- 172.21.15.114:0/1501838588 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c2bc483800 0x55c2bc50fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f79e00640 1 --2- 172.21.15.114:0/1501838588 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2bc483c00 0x55c2bc50eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f7a800640 1 --2- 172.21.15.114:0/1501838588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2bd250000 0x55c2bc50f080 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x55c2bd2d3260 tx=0x55c2bd24a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ab88d2489b5a6f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f77600640 1 -- 172.21.15.114:0/1501838588 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c2bc4d6f20 con 0x55c2bd250000 2024-09-13T17:53:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f77600640 1 -- 172.21.15.114:0/1501838588 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c2bc4e0180 con 0x55c2bd250000 2024-09-13T17:53:37.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1501838588 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c2bc4b8340 con 0x55c2bd250000 2024-09-13T17:53:37.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1501838588 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55c2bc4b8b60 con 0x55c2bd250000 2024-09-13T17:53:37.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f7c6da8c0 4 waiting for MDS map... 2024-09-13T17:53:37.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f77600640 1 -- 172.21.15.114:0/1501838588 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c2bc4d7080 con 0x55c2bd250000 2024-09-13T17:53:37.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f77600640 1 -- 172.21.15.114:0/1501838588 <== mon.0 v2:172.21.15.114:3300/0 4 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x55c2bc4c4c40 con 0x55c2bd250000 2024-09-13T17:53:37.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f77600640 1 -- 172.21.15.114:0/1501838588 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 23) v1 ==== 3691+0+0 (secure 0 0 0) 0x55c2bc4d0f00 con 0x55c2bd250000 2024-09-13T17:53:37.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f7c6da8c0 4 Got MDS map 23 2024-09-13T17:53:37.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f7c6da8c0 4 datascan.main: Using metadata pool output 2024-09-13T17:53:37.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f7c6da8c0 4 datascan.main: connecting to RADOS... 2024-09-13T17:53:37.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f7c6da8c0 1 Processor -- start 2024-09-13T17:53:37.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.710+0000 7f1f7c6da8c0 1 -- start start 2024-09-13T17:53:37.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7c6da8c0 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c2bd250400 0x55c2bc50f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7c6da8c0 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2bd404000 0x55c2bc50e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7c6da8c0 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2bd404400 0x55c2bc510100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7c6da8c0 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2bc5503c0 con 0x55c2bd404400 2024-09-13T17:53:37.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7c6da8c0 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2bc550500 con 0x55c2bd404000 2024-09-13T17:53:37.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7c6da8c0 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c2bc550140 con 0x55c2bd250400 2024-09-13T17:53:37.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f79e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2bd404400 0x55c2bc510100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f79e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2bd404400 0x55c2bc510100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43978/0 (socket says 172.21.15.114:43978) 2024-09-13T17:53:37.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f79e00640 1 -- 172.21.15.114:0/3992204787 learned_addr learned my addr 172.21.15.114:0/3992204787 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:37.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7a800640 1 --2- 172.21.15.114:0/3992204787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2bd404000 0x55c2bc50e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7b200640 1 --2- 172.21.15.114:0/3992204787 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c2bd250400 0x55c2bc50f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f79e00640 1 -- 172.21.15.114:0/3992204787 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c2bd250400 msgr2=0x55c2bc50f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:37.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f79e00640 1 --2- 172.21.15.114:0/3992204787 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c2bd250400 0x55c2bc50f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f79e00640 1 -- 172.21.15.114:0/3992204787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2bd404000 msgr2=0x55c2bc50e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:37.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f79e00640 1 --2- 172.21.15.114:0/3992204787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2bd404000 0x55c2bc50e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f79e00640 1 -- 172.21.15.114:0/3992204787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2bc4b84e0 con 0x55c2bd404400 2024-09-13T17:53:37.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7b200640 1 --2- 172.21.15.114:0/3992204787 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c2bd250400 0x55c2bc50f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:37.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f79e00640 1 --2- 172.21.15.114:0/3992204787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2bd404400 0x55c2bc510100 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x55c2bd3a8a50 tx=0x55c2bd3b8c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653e8ca5460ec6ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f74e00640 1 -- 172.21.15.114:0/3992204787 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c2bc4d6f20 con 0x55c2bd404400 2024-09-13T17:53:37.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f74e00640 1 -- 172.21.15.114:0/3992204787 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c2bd3a5680 con 0x55c2bd404400 2024-09-13T17:53:37.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f74e00640 1 -- 172.21.15.114:0/3992204787 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c2bc4d7080 con 0x55c2bd404400 2024-09-13T17:53:37.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/3992204787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2bd404400 msgr2=0x55c2bc510100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7c6da8c0 1 --2- 172.21.15.114:0/3992204787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2bd404400 0x55c2bc510100 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x55c2bd3a8a50 tx=0x55c2bd3b8c00 comp rx=0 tx=0).stop 2024-09-13T17:53:37.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/3992204787 shutdown_connections 2024-09-13T17:53:37.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7c6da8c0 1 --2- 172.21.15.114:0/3992204787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2bd404400 0x55c2bc510100 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7c6da8c0 1 --2- 172.21.15.114:0/3992204787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2bd404000 0x55c2bc50e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7c6da8c0 1 --2- 172.21.15.114:0/3992204787 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c2bd250400 0x55c2bc50f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/3992204787 >> 172.21.15.114:0/3992204787 conn(0x55c2bd250800 msgr2=0x55c2bc4ad800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:37.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/3992204787 shutdown_connections 2024-09-13T17:53:37.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/3992204787 wait complete. 2024-09-13T17:53:37.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7c6da8c0 1 Processor -- start 2024-09-13T17:53:37.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7c6da8c0 1 -- start start 2024-09-13T17:53:37.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7c6da8c0 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2bd250800 0x55c2bc511180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7c6da8c0 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2bd405000 0x55c2bc510c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7c6da8c0 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c2bd404c00 0x55c2bc510680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7c6da8c0 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2bc550140 con 0x55c2bd405000 2024-09-13T17:53:37.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7c6da8c0 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2bc550500 con 0x55c2bd250800 2024-09-13T17:53:37.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7c6da8c0 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c2bc550780 con 0x55c2bd404c00 2024-09-13T17:53:37.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2bd405000 0x55c2bc510c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7a800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2bd405000 0x55c2bc510c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43992/0 (socket says 172.21.15.114:43992) 2024-09-13T17:53:37.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7a800640 1 -- 172.21.15.114:0/1752469206 learned_addr learned my addr 172.21.15.114:0/1752469206 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:37.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f79e00640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c2bd404c00 0x55c2bc510680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7b200640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2bd250800 0x55c2bc511180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7a800640 1 -- 172.21.15.114:0/1752469206 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c2bd404c00 msgr2=0x55c2bc510680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7a800640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c2bd404c00 0x55c2bc510680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7a800640 1 -- 172.21.15.114:0/1752469206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2bd250800 msgr2=0x55c2bc511180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7a800640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2bd250800 0x55c2bc511180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.714+0000 7f1f7a800640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2bc4b8ea0 con 0x55c2bd405000 2024-09-13T17:53:37.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.718+0000 7f1f7a800640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2bd405000 0x55c2bc510c00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x55c2bd3a9770 tx=0x55c2bd24a540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.718+0000 7f1f73000640 1 -- 172.21.15.114:0/1752469206 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c2bc4d7600 con 0x55c2bd405000 2024-09-13T17:53:37.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.718+0000 7f1f73000640 1 -- 172.21.15.114:0/1752469206 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c2bd3a4a80 con 0x55c2bd405000 2024-09-13T17:53:37.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.718+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c2bc770000 con 0x55c2bd405000 2024-09-13T17:53:37.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.718+0000 7f1f73000640 1 -- 172.21.15.114:0/1752469206 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c2bc4d71e0 con 0x55c2bd405000 2024-09-13T17:53:37.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.718+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c2bc7701a0 con 0x55c2bd405000 2024-09-13T17:53:37.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.718+0000 7f1f7c6da8c0 4 datascan.init: forcing metadata pool 'recovery_fs_metadata' 2024-09-13T17:53:37.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.718+0000 7f1f73000640 1 -- 172.21.15.114:0/1752469206 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x55c2bc4bd080 con 0x55c2bd405000 2024-09-13T17:53:37.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.718+0000 7f1f73000640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x55c2bc779000 0x55c2bc511700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.718+0000 7f1f73000640 1 -- 172.21.15.114:0/1752469206 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x55c2bc4c4a80 con 0x55c2bd405000 2024-09-13T17:53:37.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.718+0000 7f1f7c6da8c0 4 datascan.main: data pool 'cephfs_data' has ID 6 2024-09-13T17:53:37.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.718+0000 7f1f7c6da8c0 4 datascan.main: opening data pool 'cephfs_data' 2024-09-13T17:53:37.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.718+0000 7f1f7b200640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x55c2bc779000 0x55c2bc511700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.718+0000 7f1f7c6da8c0 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x55c2bd404800 0x55c2bc510100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.718+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:1 6.0 6:00000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bd404400 con 0x55c2bd404800 2024-09-13T17:53:37.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.718+0000 7f1f79e00640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x55c2bd404800 0x55c2bc510100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.718+0000 7f1f7b200640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x55c2bc779000 0x55c2bc511700 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55c2bc6004b0 tx=0x55c2bd3b9e00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.718+0000 7f1f79e00640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x55c2bd404800 0x55c2bc510100 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.718+0000 7f1f79e00640 1 -- 172.21.15.114:0/1752469206 <== osd.0 v2:172.21.15.114:6808/4163905135 1 ==== osd_op_reply(1 [pgnls start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256b40 con 0x55c2bd404800 2024-09-13T17:53:37.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.718+0000 7f1f74400640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x55c2bd405c00 0x55c2bc86c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.718+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:2 6.20 6:04000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bd405400 con 0x55c2bd405c00 2024-09-13T17:53:37.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.722+0000 7f1f7b200640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x55c2bd405c00 0x55c2bc86c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.722+0000 7f1f7b200640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x55c2bd405c00 0x55c2bc86c000 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.722+0000 7f1f7b200640 1 -- 172.21.15.114:0/1752469206 <== osd.1 v2:172.21.15.114:6816/2809354915 1 ==== osd_op_reply(2 [pgnls start_epoch 48 out=49b] v39'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256d80 con 0x55c2bd405c00 2024-09-13T17:53:37.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.722+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:3 6.10 6:08000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bd404400 con 0x55c2bd404800 2024-09-13T17:53:37.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.722+0000 7f1f79e00640 1 -- 172.21.15.114:0/1752469206 <== osd.0 v2:172.21.15.114:6808/4163905135 2 ==== osd_op_reply(3 [pgnls start_epoch 48 out=49b] v39'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256b40 con 0x55c2bd404800 2024-09-13T17:53:37.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.722+0000 7f1f74400640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x55c2bd405800 0x55c2bc86c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.722+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:4 6.30 6:0c000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc779400 con 0x55c2bd405800 2024-09-13T17:53:37.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.722+0000 7f1f7a800640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x55c2bd405800 0x55c2bc86c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.722+0000 7f1f7a800640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x55c2bd405800 0x55c2bc86c580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.722+0000 7f1f7a800640 1 -- 172.21.15.114:0/1752469206 <== osd.7 v2:172.21.15.134:6816/874939117 1 ==== osd_op_reply(4 [pgnls start_epoch 48 out=49b] v39'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256fc0 con 0x55c2bd405800 2024-09-13T17:53:37.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.722+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:5 6.8 6:10000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc880000 con 0x55c2bd405800 2024-09-13T17:53:37.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.722+0000 7f1f7a800640 1 -- 172.21.15.114:0/1752469206 <== osd.7 v2:172.21.15.134:6816/874939117 2 ==== osd_op_reply(5 [pgnls start_epoch 48 out=49b] v39'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256fc0 con 0x55c2bd405800 2024-09-13T17:53:37.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.722+0000 7f1f74400640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x55c2bc779800 0x55c2bc86cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.722+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:6 6.28 6:14000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc779c00 con 0x55c2bc779800 2024-09-13T17:53:37.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.722+0000 7f1f79e00640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x55c2bc779800 0x55c2bc86cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.722+0000 7f1f79e00640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x55c2bc779800 0x55c2bc86cb00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.722+0000 7f1f79e00640 1 -- 172.21.15.114:0/1752469206 <== osd.2 v2:172.21.15.114:6800/1009667871 1 ==== osd_op_reply(6 [pgnls start_epoch 48 out=49b] v39'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256b40 con 0x55c2bc779800 2024-09-13T17:53:37.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.722+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:7 6.18 6:18000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc880400 con 0x55c2bd404800 2024-09-13T17:53:37.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.726+0000 7f1f79e00640 1 -- 172.21.15.114:0/1752469206 <== osd.0 v2:172.21.15.114:6808/4163905135 3 ==== osd_op_reply(7 [pgnls start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256b40 con 0x55c2bd404800 2024-09-13T17:53:37.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.726+0000 7f1f74400640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x55c2bc880800 0x55c2bc86d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.726+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:8 6.38 6:1c000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc880c00 con 0x55c2bc880800 2024-09-13T17:53:37.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.726+0000 7f1f7b200640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x55c2bc880800 0x55c2bc86d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.726+0000 7f1f7b200640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x55c2bc880800 0x55c2bc86d080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.726+0000 7f1f7b200640 1 -- 172.21.15.114:0/1752469206 <== osd.3 v2:172.21.15.114:6824/1824187331 1 ==== osd_op_reply(8 [pgnls start_epoch 48 out=49b] v39'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256d80 con 0x55c2bc880800 2024-09-13T17:53:37.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.726+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:9 6.4 6:20000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc881800 con 0x55c2bd405c00 2024-09-13T17:53:37.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.726+0000 7f1f7b200640 1 -- 172.21.15.114:0/1752469206 <== osd.1 v2:172.21.15.114:6816/2809354915 2 ==== osd_op_reply(9 [pgnls start_epoch 48 out=49b] v39'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256d80 con 0x55c2bd405c00 2024-09-13T17:53:37.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.726+0000 7f1f74400640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x55c2bc881000 0x55c2bc86d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.726+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:10 6.24 6:24000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc881400 con 0x55c2bc881000 2024-09-13T17:53:37.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.726+0000 7f1f7a800640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x55c2bc881000 0x55c2bc86d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.726+0000 7f1f7a800640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x55c2bc881000 0x55c2bc86d600 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.726+0000 7f1f7a800640 1 -- 172.21.15.114:0/1752469206 <== osd.5 v2:172.21.15.134:6800/3340754489 1 ==== osd_op_reply(10 [pgnls start_epoch 48 out=49b] v39'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256fc0 con 0x55c2bc881000 2024-09-13T17:53:37.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.726+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:11 6.14 6:28000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc881c00 con 0x55c2bc779800 2024-09-13T17:53:37.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.726+0000 7f1f79e00640 1 -- 172.21.15.114:0/1752469206 <== osd.2 v2:172.21.15.114:6800/1009667871 2 ==== osd_op_reply(11 [pgnls start_epoch 48 out=49b] v39'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256b40 con 0x55c2bc779800 2024-09-13T17:53:37.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.726+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:12 6.34 6:2c000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc880c00 con 0x55c2bd404800 2024-09-13T17:53:37.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.726+0000 7f1f79e00640 1 -- 172.21.15.114:0/1752469206 <== osd.0 v2:172.21.15.114:6808/4163905135 4 ==== osd_op_reply(12 [pgnls start_epoch 48 out=49b] v39'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256b40 con 0x55c2bd404800 2024-09-13T17:53:37.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.726+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:13 6.c 6:30000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc880400 con 0x55c2bc880800 2024-09-13T17:53:37.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.726+0000 7f1f7b200640 1 -- 172.21.15.114:0/1752469206 <== osd.3 v2:172.21.15.114:6824/1824187331 2 ==== osd_op_reply(13 [pgnls start_epoch 48 out=49b] v39'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256d80 con 0x55c2bc880800 2024-09-13T17:53:37.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.726+0000 7f1f74400640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x55c2bc881800 0x55c2bc86db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.726+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:14 6.2c 6:34000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bd405400 con 0x55c2bc881800 2024-09-13T17:53:37.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.726+0000 7f1f79e00640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x55c2bc881800 0x55c2bc86db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.730+0000 7f1f79e00640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x55c2bc881800 0x55c2bc86db80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.730+0000 7f1f79e00640 1 -- 172.21.15.114:0/1752469206 <== osd.6 v2:172.21.15.134:6824/1813072387 1 ==== osd_op_reply(14 [pgnls start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256b40 con 0x55c2bc881800 2024-09-13T17:53:37.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.730+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:15 6.1c 6:38000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc881c00 con 0x55c2bd405800 2024-09-13T17:53:37.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.730+0000 7f1f7a800640 1 -- 172.21.15.114:0/1752469206 <== osd.7 v2:172.21.15.134:6816/874939117 3 ==== osd_op_reply(15 [pgnls start_epoch 48 out=49b] v39'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256fc0 con 0x55c2bd405800 2024-09-13T17:53:37.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.730+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:16 6.3c 6:3c000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc880c00 con 0x55c2bc779800 2024-09-13T17:53:37.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.730+0000 7f1f79e00640 1 -- 172.21.15.114:0/1752469206 <== osd.2 v2:172.21.15.114:6800/1009667871 3 ==== osd_op_reply(16 [pgnls start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256b40 con 0x55c2bc779800 2024-09-13T17:53:37.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.730+0000 7f1f74e00640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x55c2bc779c00 0x55c2bc86e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.730+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:17 6.2 6:40000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bd404400 con 0x55c2bc779c00 2024-09-13T17:53:37.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.730+0000 7f1f7b200640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x55c2bc779c00 0x55c2bc86e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.730+0000 7f1f7b200640 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x55c2bc779c00 0x55c2bc86e100 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.730+0000 7f1f7b200640 1 -- 172.21.15.114:0/1752469206 <== osd.4 v2:172.21.15.134:6808/3210409298 1 ==== osd_op_reply(17 [pgnls start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256d80 con 0x55c2bc779c00 2024-09-13T17:53:37.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.730+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:18 6.22 6:44000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc89a000 con 0x55c2bc881800 2024-09-13T17:53:37.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.730+0000 7f1f79e00640 1 -- 172.21.15.114:0/1752469206 <== osd.6 v2:172.21.15.134:6824/1813072387 2 ==== osd_op_reply(18 [pgnls start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256b40 con 0x55c2bc881800 2024-09-13T17:53:37.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.730+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:19 6.12 6:48000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc89bc00 con 0x55c2bd405800 2024-09-13T17:53:37.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.734+0000 7f1f7a800640 1 -- 172.21.15.114:0/1752469206 <== osd.7 v2:172.21.15.134:6816/874939117 4 ==== osd_op_reply(19 [pgnls start_epoch 48 out=49b] v39'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256fc0 con 0x55c2bd405800 2024-09-13T17:53:37.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.734+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:20 6.32 6:4c000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc89a400 con 0x55c2bc779c00 2024-09-13T17:53:37.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.734+0000 7f1f7b200640 1 -- 172.21.15.114:0/1752469206 <== osd.4 v2:172.21.15.134:6808/3210409298 2 ==== osd_op_reply(20 [pgnls start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256d80 con 0x55c2bc779c00 2024-09-13T17:53:37.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.734+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:21 6.a 6:50000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc89bc00 con 0x55c2bc881000 2024-09-13T17:53:37.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.734+0000 7f1f7a800640 1 -- 172.21.15.114:0/1752469206 <== osd.5 v2:172.21.15.134:6800/3340754489 2 ==== osd_op_reply(21 [pgnls start_epoch 48 out=49b] v39'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256fc0 con 0x55c2bc881000 2024-09-13T17:53:37.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.734+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:22 6.2a 6:54000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc89a800 con 0x55c2bc779c00 2024-09-13T17:53:37.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.734+0000 7f1f7b200640 1 -- 172.21.15.114:0/1752469206 <== osd.4 v2:172.21.15.134:6808/3210409298 3 ==== osd_op_reply(22 [pgnls start_epoch 48 out=49b] v39'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256d80 con 0x55c2bc779c00 2024-09-13T17:53:37.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.734+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:23 6.1a 6:58000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc880000 con 0x55c2bc779c00 2024-09-13T17:53:37.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.734+0000 7f1f7b200640 1 -- 172.21.15.114:0/1752469206 <== osd.4 v2:172.21.15.134:6808/3210409298 4 ==== osd_op_reply(23 [pgnls start_epoch 48 out=49b] v39'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256d80 con 0x55c2bc779c00 2024-09-13T17:53:37.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.734+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:24 6.3a 6:5c000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc89ac00 con 0x55c2bd405c00 2024-09-13T17:53:37.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.734+0000 7f1f7b200640 1 -- 172.21.15.114:0/1752469206 <== osd.1 v2:172.21.15.114:6816/2809354915 3 ==== osd_op_reply(24 [pgnls start_epoch 48 out=49b] v39'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256d80 con 0x55c2bd405c00 2024-09-13T17:53:37.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.734+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:25 6.6 6:60000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc881400 con 0x55c2bc880800 2024-09-13T17:53:37.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.734+0000 7f1f7b200640 1 -- 172.21.15.114:0/1752469206 <== osd.3 v2:172.21.15.114:6824/1824187331 3 ==== osd_op_reply(25 [pgnls start_epoch 48 out=49b] v39'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256d80 con 0x55c2bc880800 2024-09-13T17:53:37.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.734+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:26 6.26 6:64000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc89b000 con 0x55c2bd405c00 2024-09-13T17:53:37.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.734+0000 7f1f7b200640 1 -- 172.21.15.114:0/1752469206 <== osd.1 v2:172.21.15.114:6816/2809354915 4 ==== osd_op_reply(26 [pgnls start_epoch 48 out=49b] v39'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256d80 con 0x55c2bd405c00 2024-09-13T17:53:37.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.734+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:27 6.16 6:68000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc881c00 con 0x55c2bd404800 2024-09-13T17:53:37.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.734+0000 7f1f79e00640 1 -- 172.21.15.114:0/1752469206 <== osd.0 v2:172.21.15.114:6808/4163905135 5 ==== osd_op_reply(27 [pgnls start_epoch 48 out=49b] v39'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256b40 con 0x55c2bd404800 2024-09-13T17:53:37.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.734+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:28 6.36 6:6c000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc89b400 con 0x55c2bc881000 2024-09-13T17:53:37.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.734+0000 7f1f7a800640 1 -- 172.21.15.114:0/1752469206 <== osd.5 v2:172.21.15.134:6800/3340754489 3 ==== osd_op_reply(28 [pgnls start_epoch 48 out=49b] v39'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256fc0 con 0x55c2bc881000 2024-09-13T17:53:37.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.734+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:29 6.e 6:70000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc778c00 con 0x55c2bc779c00 2024-09-13T17:53:37.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.734+0000 7f1f7b200640 1 -- 172.21.15.114:0/1752469206 <== osd.4 v2:172.21.15.134:6808/3210409298 5 ==== osd_op_reply(29 [pgnls start_epoch 48 out=49b] v39'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256d80 con 0x55c2bc779c00 2024-09-13T17:53:37.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.734+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:30 6.2e 6:74000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc89b800 con 0x55c2bc881800 2024-09-13T17:53:37.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.738+0000 7f1f79e00640 1 -- 172.21.15.114:0/1752469206 <== osd.6 v2:172.21.15.134:6824/1813072387 3 ==== osd_op_reply(30 [pgnls start_epoch 48 out=49b] v39'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256b40 con 0x55c2bc881800 2024-09-13T17:53:37.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.738+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:31 6.1e 6:78000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc779400 con 0x55c2bc779c00 2024-09-13T17:53:37.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.738+0000 7f1f7b200640 1 -- 172.21.15.114:0/1752469206 <== osd.4 v2:172.21.15.134:6808/3210409298 6 ==== osd_op_reply(31 [pgnls start_epoch 48 out=49b] v39'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256d80 con 0x55c2bc779c00 2024-09-13T17:53:37.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.738+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:32 6.3e 6:7c000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc89ac00 con 0x55c2bc880800 2024-09-13T17:53:37.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.738+0000 7f1f7b200640 1 -- 172.21.15.114:0/1752469206 <== osd.3 v2:172.21.15.114:6824/1824187331 4 ==== osd_op_reply(32 [pgnls start_epoch 48 out=49b] v39'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256d80 con 0x55c2bc880800 2024-09-13T17:53:37.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.738+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:33 6.1 6:80000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc89a800 con 0x55c2bd405c00 2024-09-13T17:53:37.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.738+0000 7f1f7b200640 1 -- 172.21.15.114:0/1752469206 <== osd.1 v2:172.21.15.114:6816/2809354915 5 ==== osd_op_reply(33 [pgnls start_epoch 48 out=49b] v39'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256d80 con 0x55c2bd405c00 2024-09-13T17:53:37.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.738+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:34 6.21 6:84000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc89b000 con 0x55c2bd405800 2024-09-13T17:53:37.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.738+0000 7f1f7a800640 1 -- 172.21.15.114:0/1752469206 <== osd.7 v2:172.21.15.134:6816/874939117 5 ==== osd_op_reply(34 [pgnls start_epoch 48 out=49b] v39'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256fc0 con 0x55c2bd405800 2024-09-13T17:53:37.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.738+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:35 6.11 6:88000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc8a0000 con 0x55c2bc880800 2024-09-13T17:53:37.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.738+0000 7f1f7b200640 1 -- 172.21.15.114:0/1752469206 <== osd.3 v2:172.21.15.114:6824/1824187331 5 ==== osd_op_reply(35 [pgnls start_epoch 48 out=49b] v39'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256d80 con 0x55c2bc880800 2024-09-13T17:53:37.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.738+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:36 6.31 6:8c000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc89a400 con 0x55c2bc881000 2024-09-13T17:53:37.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.738+0000 7f1f7a800640 1 -- 172.21.15.114:0/1752469206 <== osd.5 v2:172.21.15.134:6800/3340754489 4 ==== osd_op_reply(36 [pgnls start_epoch 48 out=49b] v39'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256fc0 con 0x55c2bc881000 2024-09-13T17:53:37.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.738+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:37 6.9 6:90000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc8a0400 con 0x55c2bd404800 2024-09-13T17:53:37.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.738+0000 7f1f79e00640 1 -- 172.21.15.114:0/1752469206 <== osd.0 v2:172.21.15.114:6808/4163905135 6 ==== osd_op_reply(37 [pgnls start_epoch 48 out=49b] v39'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256b40 con 0x55c2bd404800 2024-09-13T17:53:37.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.738+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:38 6.29 6:94000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bd404400 con 0x55c2bd405800 2024-09-13T17:53:37.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.738+0000 7f1f7a800640 1 -- 172.21.15.114:0/1752469206 <== osd.7 v2:172.21.15.134:6816/874939117 6 ==== osd_op_reply(38 [pgnls start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256fc0 con 0x55c2bd405800 2024-09-13T17:53:37.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.738+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:39 6.19 6:98000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc8a0800 con 0x55c2bc881000 2024-09-13T17:53:37.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.738+0000 7f1f7a800640 1 -- 172.21.15.114:0/1752469206 <== osd.5 v2:172.21.15.134:6800/3340754489 5 ==== osd_op_reply(39 [pgnls start_epoch 48 out=49b] v39'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256fc0 con 0x55c2bc881000 2024-09-13T17:53:37.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.738+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:40 6.39 6:9c000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc880000 con 0x55c2bc881000 2024-09-13T17:53:37.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.738+0000 7f1f7a800640 1 -- 172.21.15.114:0/1752469206 <== osd.5 v2:172.21.15.134:6800/3340754489 6 ==== osd_op_reply(40 [pgnls start_epoch 48 out=49b] v39'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256fc0 con 0x55c2bc881000 2024-09-13T17:53:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.738+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:41 6.5 6:a0000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc8a0c00 con 0x55c2bd405800 2024-09-13T17:53:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.738+0000 7f1f7a800640 1 -- 172.21.15.114:0/1752469206 <== osd.7 v2:172.21.15.134:6816/874939117 7 ==== osd_op_reply(41 [pgnls start_epoch 48 out=49b] v39'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256fc0 con 0x55c2bd405800 2024-09-13T17:53:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.742+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:42 6.25 6:a4000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc881400 con 0x55c2bc881800 2024-09-13T17:53:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.742+0000 7f1f79e00640 1 -- 172.21.15.114:0/1752469206 <== osd.6 v2:172.21.15.134:6824/1813072387 4 ==== osd_op_reply(42 [pgnls start_epoch 48 out=49b] v39'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256b40 con 0x55c2bc881800 2024-09-13T17:53:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.742+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:43 6.15 6:a8000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc8a1000 con 0x55c2bd405800 2024-09-13T17:53:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.742+0000 7f1f7a800640 1 -- 172.21.15.114:0/1752469206 <== osd.7 v2:172.21.15.134:6816/874939117 8 ==== osd_op_reply(43 [pgnls start_epoch 48 out=49b] v39'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256fc0 con 0x55c2bd405800 2024-09-13T17:53:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.742+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:44 6.35 6:ac000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc880400 con 0x55c2bd404800 2024-09-13T17:53:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.742+0000 7f1f79e00640 1 -- 172.21.15.114:0/1752469206 <== osd.0 v2:172.21.15.114:6808/4163905135 7 ==== osd_op_reply(44 [pgnls start_epoch 48 out=49b] v39'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256b40 con 0x55c2bd404800 2024-09-13T17:53:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.742+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:45 6.d 6:b0000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc8a1400 con 0x55c2bc881000 2024-09-13T17:53:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.742+0000 7f1f7a800640 1 -- 172.21.15.114:0/1752469206 <== osd.5 v2:172.21.15.134:6800/3340754489 7 ==== osd_op_reply(45 [pgnls start_epoch 48 out=49b] v39'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256fc0 con 0x55c2bc881000 2024-09-13T17:53:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.742+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:46 6.2d 6:b4000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc778c00 con 0x55c2bc779800 2024-09-13T17:53:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.742+0000 7f1f79e00640 1 -- 172.21.15.114:0/1752469206 <== osd.2 v2:172.21.15.114:6800/1009667871 4 ==== osd_op_reply(46 [pgnls start_epoch 48 out=49b] v39'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256b40 con 0x55c2bc779800 2024-09-13T17:53:37.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.742+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:47 6.1d 6:b8000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc8a1800 con 0x55c2bd405c00 2024-09-13T17:53:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.742+0000 7f1f7b200640 1 -- 172.21.15.114:0/1752469206 <== osd.1 v2:172.21.15.114:6816/2809354915 6 ==== osd_op_reply(47 [pgnls start_epoch 48 out=49b] v39'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256d80 con 0x55c2bd405c00 2024-09-13T17:53:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.742+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:48 6.3d 6:bc000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc89bc00 con 0x55c2bd404800 2024-09-13T17:53:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.742+0000 7f1f79e00640 1 -- 172.21.15.114:0/1752469206 <== osd.0 v2:172.21.15.114:6808/4163905135 8 ==== osd_op_reply(48 [pgnls start_epoch 48 out=49b] v39'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256b40 con 0x55c2bd404800 2024-09-13T17:53:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.742+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:49 6.3 6:c0000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc8a1c00 con 0x55c2bd405800 2024-09-13T17:53:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.742+0000 7f1f7a800640 1 -- 172.21.15.114:0/1752469206 <== osd.7 v2:172.21.15.134:6816/874939117 9 ==== osd_op_reply(49 [pgnls start_epoch 48 out=49b] v39'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256fc0 con 0x55c2bd405800 2024-09-13T17:53:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.742+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:50 6.23 6:c4000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc89b400 con 0x55c2bc881800 2024-09-13T17:53:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.742+0000 7f1f79e00640 1 -- 172.21.15.114:0/1752469206 <== osd.6 v2:172.21.15.134:6824/1813072387 5 ==== osd_op_reply(50 [pgnls start_epoch 48 out=49b] v39'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256b40 con 0x55c2bc881800 2024-09-13T17:53:37.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.742+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:51 6.13 6:c8000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc8a0800 con 0x55c2bc880800 2024-09-13T17:53:37.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.742+0000 7f1f7b200640 1 -- 172.21.15.114:0/1752469206 <== osd.3 v2:172.21.15.114:6824/1824187331 6 ==== osd_op_reply(51 [pgnls start_epoch 48 out=49b] v39'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256d80 con 0x55c2bc880800 2024-09-13T17:53:37.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.742+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:52 6.33 6:cc000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc89b000 con 0x55c2bc881000 2024-09-13T17:53:37.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.746+0000 7f1f7a800640 1 -- 172.21.15.114:0/1752469206 <== osd.5 v2:172.21.15.134:6800/3340754489 8 ==== osd_op_reply(52 [pgnls start_epoch 48 out=49b] v39'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256fc0 con 0x55c2bc881000 2024-09-13T17:53:37.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.746+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:53 6.b 6:d0000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc8a0400 con 0x55c2bc880800 2024-09-13T17:53:37.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.746+0000 7f1f7b200640 1 -- 172.21.15.114:0/1752469206 <== osd.3 v2:172.21.15.114:6824/1824187331 7 ==== osd_op_reply(53 [pgnls start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256d80 con 0x55c2bc880800 2024-09-13T17:53:37.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.746+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:54 6.2b 6:d4000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc89a400 con 0x55c2bc881000 2024-09-13T17:53:37.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.746+0000 7f1f7a800640 1 -- 172.21.15.114:0/1752469206 <== osd.5 v2:172.21.15.134:6800/3340754489 9 ==== osd_op_reply(54 [pgnls start_epoch 48 out=49b] v39'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256fc0 con 0x55c2bc881000 2024-09-13T17:53:37.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.746+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:55 6.1b 6:d8000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc89a000 con 0x55c2bc880800 2024-09-13T17:53:37.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.746+0000 7f1f7b200640 1 -- 172.21.15.114:0/1752469206 <== osd.3 v2:172.21.15.114:6824/1824187331 8 ==== osd_op_reply(55 [pgnls start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256d80 con 0x55c2bc880800 2024-09-13T17:53:37.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.746+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:56 6.3b 6:dc000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc880000 con 0x55c2bc779800 2024-09-13T17:53:37.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.746+0000 7f1f79e00640 1 -- 172.21.15.114:0/1752469206 <== osd.2 v2:172.21.15.114:6800/1009667871 5 ==== osd_op_reply(56 [pgnls start_epoch 48 out=49b] v39'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256b40 con 0x55c2bc779800 2024-09-13T17:53:37.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.746+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:57 6.7 6:e0000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc89b800 con 0x55c2bc881000 2024-09-13T17:53:37.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.746+0000 7f1f7a800640 1 -- 172.21.15.114:0/1752469206 <== osd.5 v2:172.21.15.134:6800/3340754489 10 ==== osd_op_reply(57 [pgnls start_epoch 48 out=81b] v39'8 uv8 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55c2bd256fc0 con 0x55c2bc881000 2024-09-13T17:53:37.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.746+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:58 6.7 6:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bd404000 con 0x55c2bc881000 2024-09-13T17:53:37.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.746+0000 7f1f7a800640 1 -- 172.21.15.114:0/1752469206 <== osd.5 v2:172.21.15.134:6800/3340754489 11 ==== osd_op_reply(58 10000000001.00000000 [stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55c2bd256fc0 con 0x55c2bc881000 2024-09-13T17:53:37.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.746+0000 7f1f7c6da8c0 10 datascan.operator(): handling object 1099511627777.0 2024-09-13T17:53:37.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.746+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:59 6.7 6:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc8a0c00 con 0x55c2bc881000 2024-09-13T17:53:37.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.750+0000 7f1f7a800640 1 -- 172.21.15.114:0/1752469206 <== osd.5 v2:172.21.15.134:6800/3340754489 12 ==== osd_op_reply(59 10000000001.00000000 [call] v48'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55c2bd256fc0 con 0x55c2bc881000 2024-09-13T17:53:37.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.750+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:60 6.27 6:e4000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc89b000 con 0x55c2bc881800 2024-09-13T17:53:37.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.750+0000 7f1f79e00640 1 -- 172.21.15.114:0/1752469206 <== osd.6 v2:172.21.15.134:6824/1813072387 6 ==== osd_op_reply(60 [pgnls start_epoch 48 out=49b] v39'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256b40 con 0x55c2bc881800 2024-09-13T17:53:37.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.750+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:61 6.17 6:e8000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc8a1000 con 0x55c2bc779c00 2024-09-13T17:53:37.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.750+0000 7f1f7b200640 1 -- 172.21.15.114:0/1752469206 <== osd.4 v2:172.21.15.134:6808/3210409298 7 ==== osd_op_reply(61 [pgnls start_epoch 48 out=49b] v39'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256d80 con 0x55c2bc779c00 2024-09-13T17:53:37.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.750+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:62 6.37 6:ec000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc880c00 con 0x55c2bd404800 2024-09-13T17:53:37.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.750+0000 7f1f79e00640 1 -- 172.21.15.114:0/1752469206 <== osd.0 v2:172.21.15.114:6808/4163905135 9 ==== osd_op_reply(62 [pgnls start_epoch 48 out=49b] v39'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256b40 con 0x55c2bd404800 2024-09-13T17:53:37.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.750+0000 7f1f74e00640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:63 6.f 6:f0000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc8a1400 con 0x55c2bc779800 2024-09-13T17:53:37.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.750+0000 7f1f79e00640 1 -- 172.21.15.114:0/1752469206 <== osd.2 v2:172.21.15.114:6800/1009667871 6 ==== osd_op_reply(63 [pgnls start_epoch 48 out=49b] v39'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256b40 con 0x55c2bc779800 2024-09-13T17:53:37.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.750+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:64 6.2f 6:f4000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc881c00 con 0x55c2bd405800 2024-09-13T17:53:37.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.750+0000 7f1f7a800640 1 -- 172.21.15.114:0/1752469206 <== osd.7 v2:172.21.15.134:6816/874939117 10 ==== osd_op_reply(64 [pgnls start_epoch 48 out=81b] v39'9 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55c2bd256fc0 con 0x55c2bd405800 2024-09-13T17:53:37.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.750+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:65 6.2f 6:f526278d:::10000000001.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc89a400 con 0x55c2bd405800 2024-09-13T17:53:37.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.750+0000 7f1f7a800640 1 -- 172.21.15.114:0/1752469206 <== osd.7 v2:172.21.15.134:6816/874939117 11 ==== osd_op_reply(65 10000000001.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55c2bd256fc0 con 0x55c2bd405800 2024-09-13T17:53:37.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.750+0000 7f1f7c6da8c0 10 datascan.operator(): handling object 1099511627777.1 2024-09-13T17:53:37.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.750+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:66 6.7 6:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc89b800 con 0x55c2bc881000 2024-09-13T17:53:37.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7a800640 1 -- 172.21.15.114:0/1752469206 <== osd.5 v2:172.21.15.134:6800/3340754489 13 ==== osd_op_reply(66 10000000001.00000000 [call] v48'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55c2bd256fc0 con 0x55c2bc881000 2024-09-13T17:53:37.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:67 6.1f 6:f8000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bc89ac00 con 0x55c2bc880800 2024-09-13T17:53:37.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7b200640 1 -- 172.21.15.114:0/1752469206 <== osd.3 v2:172.21.15.114:6824/1824187331 9 ==== osd_op_reply(67 [pgnls start_epoch 48 out=49b] v39'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256d80 con 0x55c2bc880800 2024-09-13T17:53:37.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f74400640 1 -- 172.21.15.114:0/1752469206 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:68 6.3f 6:fc000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x55c2bd404400 con 0x55c2bc880800 2024-09-13T17:53:37.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7b200640 1 -- 172.21.15.114:0/1752469206 <== osd.3 v2:172.21.15.114:6824/1824187331 10 ==== osd_op_reply(68 [pgnls start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c2bd256d80 con 0x55c2bc880800 2024-09-13T17:53:37.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x55c2bd404800 msgr2=0x55c2bc510100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x55c2bd404800 0x55c2bc510100 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x55c2bd405c00 msgr2=0x55c2bc86c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x55c2bd405c00 0x55c2bc86c000 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x55c2bc779800 msgr2=0x55c2bc86cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x55c2bc779800 0x55c2bc86cb00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x55c2bc880800 msgr2=0x55c2bc86d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x55c2bc880800 0x55c2bc86d080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1752469206 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x55c2bc779c00 msgr2=0x55c2bc86e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x55c2bc779c00 0x55c2bc86e100 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1752469206 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x55c2bc881000 msgr2=0x55c2bc86d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x55c2bc881000 0x55c2bc86d600 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1752469206 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x55c2bc881800 msgr2=0x55c2bc86db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f79e00640 1 -- 172.21.15.114:0/1752469206 reap_dead start 2024-09-13T17:53:37.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x55c2bc881800 0x55c2bc86db80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1752469206 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x55c2bd405800 msgr2=0x55c2bc86c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x55c2bd405800 0x55c2bc86c580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f79e00640 1 -- 172.21.15.114:0/1752469206 reap_dead start 2024-09-13T17:53:37.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f79e00640 1 -- 172.21.15.114:0/1752469206 reap_dead start 2024-09-13T17:53:37.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x55c2bc779000 msgr2=0x55c2bc511700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x55c2bc779000 0x55c2bc511700 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55c2bc6004b0 tx=0x55c2bd3b9e00 comp rx=0 tx=0).stop 2024-09-13T17:53:37.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2bd405000 msgr2=0x55c2bc510c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2bd405000 0x55c2bc510c00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x55c2bd3a9770 tx=0x55c2bd24a540 comp rx=0 tx=0).stop 2024-09-13T17:53:37.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1752469206 shutdown_connections 2024-09-13T17:53:37.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x55c2bc779000 0x55c2bc511700 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 --2- 172.21.15.114:0/1752469206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2bd405000 0x55c2bc510c00 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1752469206 >> 172.21.15.114:0/1752469206 conn(0x55c2bd250400 msgr2=0x55c2bc4ad800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:37.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1752469206 shutdown_connections 2024-09-13T17:53:37.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1752469206 wait complete. 2024-09-13T17:53:37.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1501838588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2bd250000 msgr2=0x55c2bc50f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 --2- 172.21.15.114:0/1501838588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2bd250000 0x55c2bc50f080 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x55c2bd2d3260 tx=0x55c2bd24a180 comp rx=0 tx=0).stop 2024-09-13T17:53:37.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1501838588 shutdown_connections 2024-09-13T17:53:37.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 --2- 172.21.15.114:0/1501838588 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55c2bc483800 0x55c2bc50fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 --2- 172.21.15.114:0/1501838588 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c2bc483c00 0x55c2bc50eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 --2- 172.21.15.114:0/1501838588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55c2bd250000 0x55c2bc50f080 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1501838588 >> 172.21.15.114:0/1501838588 conn(0x55c2bc482c00 msgr2=0x55c2bc4ae800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:37.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1501838588 shutdown_connections 2024-09-13T17:53:37.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.754+0000 7f1f7c6da8c0 1 -- 172.21.15.114:0/1501838588 wait complete. 2024-09-13T17:53:37.764 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', '--alternate-pool', 'recovery_fs_metadata', '--filesystem', 'cephfs', 'cephfs_data'] in time 0:00:00.098853, result: 2024-09-13T17:53:37.765 DEBUG:teuthology.orchestra.run.smithi114:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes --alternate-pool recovery_fs_metadata --filesystem cephfs --force-corrupt --force-init cephfs_data 2024-09-13T17:53:37.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.806+0000 7fc0b72a78c0 1 -- start start 2024-09-13T17:53:37.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.806+0000 7fc0b72a78c0 1 Processor -- start 2024-09-13T17:53:37.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.806+0000 7fc0b72a78c0 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621fbc25800 0x5621fbcb1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.806+0000 7fc0b72a78c0 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5621fbc25400 0x5621fbcb1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.806+0000 7fc0b72a78c0 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621fbc25000 0x5621fbcb1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.806+0000 7fc0b72a78c0 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fbcf2a00 con 0x5621fbc25400 2024-09-13T17:53:37.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.806+0000 7fc0b72a78c0 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fbcf2640 con 0x5621fbc25800 2024-09-13T17:53:37.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.806+0000 7fc0b72a78c0 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x5621fbcf2500 con 0x5621fbc25000 2024-09-13T17:53:37.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.806+0000 7fc0b4a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5621fbc25400 0x5621fbcb1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.806+0000 7fc0b4a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5621fbc25400 0x5621fbcb1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44014/0 (socket says 172.21.15.114:44014) 2024-09-13T17:53:37.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.806+0000 7fc0b4a00640 1 -- 172.21.15.114:0/355787064 learned_addr learned my addr 172.21.15.114:0/355787064 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:37.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.806+0000 7fc0b5e00640 1 --2- 172.21.15.114:0/355787064 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621fbc25000 0x5621fbcb1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.806+0000 7fc0b5400640 1 --2- 172.21.15.114:0/355787064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621fbc25800 0x5621fbcb1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.806+0000 7fc0b4a00640 1 -- 172.21.15.114:0/355787064 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621fbc25000 msgr2=0x5621fbcb1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:37.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.806+0000 7fc0b4a00640 1 --2- 172.21.15.114:0/355787064 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621fbc25000 0x5621fbcb1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.806+0000 7fc0b4a00640 1 -- 172.21.15.114:0/355787064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621fbc25800 msgr2=0x5621fbcb1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:37.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.806+0000 7fc0b4a00640 1 --2- 172.21.15.114:0/355787064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621fbc25800 0x5621fbcb1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.806+0000 7fc0b4a00640 1 -- 172.21.15.114:0/355787064 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621fbc5a9c0 con 0x5621fbc25400 2024-09-13T17:53:37.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.806+0000 7fc0b5400640 1 --2- 172.21.15.114:0/355787064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621fbc25800 0x5621fbcb1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:37.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.806+0000 7fc0b4a00640 1 --2- 172.21.15.114:0/355787064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5621fbc25400 0x5621fbcb1600 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x5621fca798c0 tx=0x5621fbca0f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7337ae39cc41c932 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b2200640 1 -- 172.21.15.114:0/355787064 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5621fbc79600 con 0x5621fbc25400 2024-09-13T17:53:37.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b2200640 1 -- 172.21.15.114:0/355787064 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5621fcb46000 con 0x5621fbc25400 2024-09-13T17:53:37.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b2200640 1 -- 172.21.15.114:0/355787064 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5621fbc791e0 con 0x5621fbc25400 2024-09-13T17:53:37.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/355787064 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621fbc5ab60 con 0x5621fbc25400 2024-09-13T17:53:37.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/355787064 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5621fbc5a340 con 0x5621fbc25400 2024-09-13T17:53:37.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b72a78c0 4 waiting for MDS map... 2024-09-13T17:53:37.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b2200640 1 -- 172.21.15.114:0/355787064 <== mon.0 v2:172.21.15.114:3300/0 4 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x5621fbc66c40 con 0x5621fbc25400 2024-09-13T17:53:37.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b2200640 1 -- 172.21.15.114:0/355787064 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 23) v1 ==== 3691+0+0 (secure 0 0 0) 0x5621fbc72f00 con 0x5621fbc25400 2024-09-13T17:53:37.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b72a78c0 4 Got MDS map 23 2024-09-13T17:53:37.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b72a78c0 4 datascan.main: Using metadata pool output 2024-09-13T17:53:37.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b72a78c0 4 datascan.main: connecting to RADOS... 2024-09-13T17:53:37.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b72a78c0 1 Processor -- start 2024-09-13T17:53:37.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b72a78c0 1 -- start start 2024-09-13T17:53:37.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b72a78c0 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621fcb44c00 0x5621fbcb0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b72a78c0 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5621fcb45000 0x5621fbcb0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b72a78c0 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621fcb45400 0x5621fbcb2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b72a78c0 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fbc6be00 con 0x5621fcb45000 2024-09-13T17:53:37.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b72a78c0 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fbcf2640 con 0x5621fcb45400 2024-09-13T17:53:37.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b72a78c0 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x5621fbcf23c0 con 0x5621fcb44c00 2024-09-13T17:53:37.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b5400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5621fcb45000 0x5621fbcb0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b5400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5621fcb45000 0x5621fbcb0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44018/0 (socket says 172.21.15.114:44018) 2024-09-13T17:53:37.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b5400640 1 -- 172.21.15.114:0/2895920995 learned_addr learned my addr 172.21.15.114:0/2895920995 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:37.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b5e00640 1 --2- 172.21.15.114:0/2895920995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621fcb44c00 0x5621fbcb0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b5400640 1 -- 172.21.15.114:0/2895920995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621fcb44c00 msgr2=0x5621fbcb0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:37.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b5400640 1 --2- 172.21.15.114:0/2895920995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621fcb44c00 0x5621fbcb0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b5400640 1 -- 172.21.15.114:0/2895920995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621fcb45400 msgr2=0x5621fbcb2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:37.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b5400640 1 --2- 172.21.15.114:0/2895920995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621fcb45400 0x5621fbcb2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b5400640 1 -- 172.21.15.114:0/2895920995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621fbc5a000 con 0x5621fcb45000 2024-09-13T17:53:37.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b5e00640 1 --2- 172.21.15.114:0/2895920995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621fcb44c00 0x5621fbcb0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:37.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b5400640 1 --2- 172.21.15.114:0/2895920995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5621fcb45000 0x5621fbcb0580 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x5621fca79950 tx=0x5621fcb56c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9fe2971d2b01ced server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0afa00640 1 -- 172.21.15.114:0/2895920995 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5621fbc79600 con 0x5621fcb45000 2024-09-13T17:53:37.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0afa00640 1 -- 172.21.15.114:0/2895920995 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5621fcb46180 con 0x5621fcb45000 2024-09-13T17:53:37.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0afa00640 1 -- 172.21.15.114:0/2895920995 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5621fbc791e0 con 0x5621fcb45000 2024-09-13T17:53:37.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/2895920995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5621fcb45000 msgr2=0x5621fbcb0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b72a78c0 1 --2- 172.21.15.114:0/2895920995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5621fcb45000 0x5621fbcb0580 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x5621fca79950 tx=0x5621fcb56c00 comp rx=0 tx=0).stop 2024-09-13T17:53:37.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/2895920995 shutdown_connections 2024-09-13T17:53:37.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b72a78c0 1 --2- 172.21.15.114:0/2895920995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621fcb45400 0x5621fbcb2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b72a78c0 1 --2- 172.21.15.114:0/2895920995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5621fcb45000 0x5621fbcb0580 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b72a78c0 1 --2- 172.21.15.114:0/2895920995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621fcb44c00 0x5621fbcb0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/2895920995 >> 172.21.15.114:0/2895920995 conn(0x5621fbc24c00 msgr2=0x5621fbc51800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:37.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.810+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/2895920995 shutdown_connections 2024-09-13T17:53:37.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.814+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/2895920995 wait complete. 2024-09-13T17:53:37.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.814+0000 7fc0b72a78c0 1 Processor -- start 2024-09-13T17:53:37.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.814+0000 7fc0b72a78c0 1 -- start start 2024-09-13T17:53:37.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.814+0000 7fc0b72a78c0 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5621fcb44c00 0x5621fbcb0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.814+0000 7fc0b72a78c0 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621fcb45000 0x5621fbcb0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.814+0000 7fc0b72a78c0 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621fcb45400 0x5621fbcb2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.814+0000 7fc0b72a78c0 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fbcf2280 con 0x5621fcb44c00 2024-09-13T17:53:37.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.814+0000 7fc0b72a78c0 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621fbcf2140 con 0x5621fcb45000 2024-09-13T17:53:37.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.814+0000 7fc0b72a78c0 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x5621fbcf2000 con 0x5621fcb45400 2024-09-13T17:53:37.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.814+0000 7fc0b5e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5621fcb44c00 0x5621fbcb0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.814+0000 7fc0b5e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5621fcb44c00 0x5621fbcb0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44030/0 (socket says 172.21.15.114:44030) 2024-09-13T17:53:37.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.814+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 learned_addr learned my addr 172.21.15.114:0/4176220631 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:37.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.814+0000 7fc0b4a00640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621fcb45400 0x5621fbcb2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.814+0000 7fc0b5400640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621fcb45000 0x5621fbcb0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.814+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621fcb45400 msgr2=0x5621fbcb2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.814+0000 7fc0b5e00640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621fcb45400 0x5621fbcb2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.814+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621fcb45000 msgr2=0x5621fbcb0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.814+0000 7fc0b5e00640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621fcb45000 0x5621fbcb0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.814+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621fbc5a9c0 con 0x5621fcb44c00 2024-09-13T17:53:37.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.814+0000 7fc0b5e00640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5621fcb44c00 0x5621fbcb0b00 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x5621fca79020 tx=0x5621fc9e8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.814+0000 7fc0adc00640 1 -- 172.21.15.114:0/4176220631 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5621fbc79080 con 0x5621fcb44c00 2024-09-13T17:53:37.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.814+0000 7fc0adc00640 1 -- 172.21.15.114:0/4176220631 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5621fbc82900 con 0x5621fcb44c00 2024-09-13T17:53:37.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.814+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5621fbc5ab60 con 0x5621fcb44c00 2024-09-13T17:53:37.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.814+0000 7fc0adc00640 1 -- 172.21.15.114:0/4176220631 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5621fbc79600 con 0x5621fcb44c00 2024-09-13T17:53:37.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.814+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621fbc5aea0 con 0x5621fcb44c00 2024-09-13T17:53:37.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.814+0000 7fc0b72a78c0 4 datascan.init: forcing metadata pool 'recovery_fs_metadata' 2024-09-13T17:53:37.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.818+0000 7fc0adc00640 1 -- 172.21.15.114:0/4176220631 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x5621fbc5f080 con 0x5621fcb44c00 2024-09-13T17:53:37.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.818+0000 7fc0adc00640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x5621fbf0ac00 0x5621fbff4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.818+0000 7fc0adc00640 1 -- 172.21.15.114:0/4176220631 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x5621fbc66a80 con 0x5621fcb44c00 2024-09-13T17:53:37.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.818+0000 7fc0b72a78c0 4 datascan.main: data pool 'cephfs_data' has ID 6 2024-09-13T17:53:37.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.818+0000 7fc0b72a78c0 4 datascan.main: opening data pool 'cephfs_data' 2024-09-13T17:53:37.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.818+0000 7fc0b72a78c0 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x5621fcb45800 0x5621fbcb2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.818+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:1 7.14 7:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fcb45c00 con 0x5621fcb45800 2024-09-13T17:53:37.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.818+0000 7fc0b5400640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x5621fbf0ac00 0x5621fbff4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.818+0000 7fc0b4a00640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x5621fcb45800 0x5621fbcb2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.818+0000 7fc0b5400640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x5621fbf0ac00 0x5621fbff4000 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x5621fca79950 tx=0x5621fc9e81e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.818+0000 7fc0b4a00640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x5621fcb45800 0x5621fbcb2680 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.818+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.3 v2:172.21.15.114:6824/1824187331 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fcb45800 2024-09-13T17:53:37.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.818+0000 7fc0b72a78c0 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x5621fbf0b000 0x5621fbcb2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.818+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:2 7.1f 7:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fbf0b400 con 0x5621fbf0b000 2024-09-13T17:53:37.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.818+0000 7fc0b5e00640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x5621fbf0b000 0x5621fbcb2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.818+0000 7fc0b5e00640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x5621fbf0b000 0x5621fbcb2c00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.818+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.6 v2:172.21.15.134:6824/1813072387 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fbf0b000 2024-09-13T17:53:37.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.818+0000 7fc0b72a78c0 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x5621fbf0b800 0x5621fbcb3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.818+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:3 6.0 6:00000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fbf0bc00 con 0x5621fbf0b800 2024-09-13T17:53:37.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.818+0000 7fc0b5400640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x5621fbf0b800 0x5621fbcb3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.822+0000 7fc0b5400640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x5621fbf0b800 0x5621fbcb3180 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.822+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 <== osd.0 v2:172.21.15.114:6808/4163905135 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26fc0 con 0x5621fbf0b800 2024-09-13T17:53:37.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.822+0000 7fc0af000640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x5621fc014000 0x5621fbff4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.822+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:4 6.20 6:04000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc014400 con 0x5621fc014000 2024-09-13T17:53:37.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.822+0000 7fc0b4a00640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x5621fc014000 0x5621fbff4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.822+0000 7fc0b4a00640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x5621fc014000 0x5621fbff4580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.822+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.1 v2:172.21.15.114:6816/2809354915 1 ==== osd_op_reply(4 [pgnls-filter start_epoch 48 out=49b] v39'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014000 2024-09-13T17:53:37.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.822+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:5 6.10 6:08000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc014c00 con 0x5621fbf0b800 2024-09-13T17:53:37.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.822+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 <== osd.0 v2:172.21.15.114:6808/4163905135 2 ==== osd_op_reply(5 [pgnls-filter start_epoch 48 out=49b] v39'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26fc0 con 0x5621fbf0b800 2024-09-13T17:53:37.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.822+0000 7fc0af000640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x5621fc014800 0x5621fbff4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.822+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:6 6.30 6:0c000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc015000 con 0x5621fc014800 2024-09-13T17:53:37.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.822+0000 7fc0b5e00640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x5621fc014800 0x5621fbff4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.822+0000 7fc0b5e00640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x5621fc014800 0x5621fbff4b00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.822+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.7 v2:172.21.15.134:6816/874939117 1 ==== osd_op_reply(6 [pgnls-filter start_epoch 48 out=49b] v39'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc014800 2024-09-13T17:53:37.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.822+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:7 6.8 6:10000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc015c00 con 0x5621fc014800 2024-09-13T17:53:37.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.822+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.7 v2:172.21.15.134:6816/874939117 2 ==== osd_op_reply(7 [pgnls-filter start_epoch 48 out=49b] v39'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc014800 2024-09-13T17:53:37.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.822+0000 7fc0af000640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x5621fc015400 0x5621fbff5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.822+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:8 6.28 6:14000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc015800 con 0x5621fc015400 2024-09-13T17:53:37.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.826+0000 7fc0b5400640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x5621fc015400 0x5621fbff5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.826+0000 7fc0b5400640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x5621fc015400 0x5621fbff5080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.826+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 <== osd.2 v2:172.21.15.114:6800/1009667871 1 ==== osd_op_reply(8 [pgnls-filter start_epoch 48 out=49b] v39'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26fc0 con 0x5621fc015400 2024-09-13T17:53:37.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.826+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:9 6.18 6:18000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc014c00 con 0x5621fbf0b800 2024-09-13T17:53:37.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.826+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 <== osd.0 v2:172.21.15.114:6808/4163905135 3 ==== osd_op_reply(9 [pgnls-filter start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26fc0 con 0x5621fbf0b800 2024-09-13T17:53:37.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.826+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:10 6.38 6:1c000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc015800 con 0x5621fcb45800 2024-09-13T17:53:37.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.826+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.3 v2:172.21.15.114:6824/1824187331 2 ==== osd_op_reply(10 [pgnls-filter start_epoch 48 out=49b] v39'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fcb45800 2024-09-13T17:53:37.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.826+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:11 6.4 6:20000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fbf0a800 con 0x5621fc014000 2024-09-13T17:53:37.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.826+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.1 v2:172.21.15.114:6816/2809354915 2 ==== osd_op_reply(11 [pgnls-filter start_epoch 48 out=49b] v39'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014000 2024-09-13T17:53:37.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.826+0000 7fc0af000640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x5621fc014400 0x5621fbff5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.826+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:12 6.24 6:24000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc015800 con 0x5621fc014400 2024-09-13T17:53:37.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.826+0000 7fc0b4a00640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x5621fc014400 0x5621fbff5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.826+0000 7fc0b4a00640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x5621fc014400 0x5621fbff5600 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.826+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.5 v2:172.21.15.134:6800/3340754489 1 ==== osd_op_reply(12 [pgnls-filter start_epoch 48 out=49b] v39'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014400 2024-09-13T17:53:37.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.826+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:13 6.14 6:28000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fbf0bc00 con 0x5621fc015400 2024-09-13T17:53:37.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.826+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 <== osd.2 v2:172.21.15.114:6800/1009667871 2 ==== osd_op_reply(13 [pgnls-filter start_epoch 48 out=49b] v39'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26fc0 con 0x5621fc015400 2024-09-13T17:53:37.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.826+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:14 6.34 6:2c000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fcb44800 con 0x5621fbf0b800 2024-09-13T17:53:37.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.826+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 <== osd.0 v2:172.21.15.114:6808/4163905135 4 ==== osd_op_reply(14 [pgnls-filter start_epoch 48 out=49b] v39'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26fc0 con 0x5621fbf0b800 2024-09-13T17:53:37.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.826+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:15 6.c 6:30000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc034000 con 0x5621fcb45800 2024-09-13T17:53:37.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.826+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.3 v2:172.21.15.114:6824/1824187331 3 ==== osd_op_reply(15 [pgnls-filter start_epoch 48 out=49b] v39'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fcb45800 2024-09-13T17:53:37.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.826+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:16 6.2c 6:34000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fcb44400 con 0x5621fbf0b000 2024-09-13T17:53:37.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.830+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.6 v2:172.21.15.134:6824/1813072387 2 ==== osd_op_reply(16 [pgnls-filter start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fbf0b000 2024-09-13T17:53:37.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.830+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:17 6.1c 6:38000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc034400 con 0x5621fc014800 2024-09-13T17:53:37.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.830+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.7 v2:172.21.15.134:6816/874939117 3 ==== osd_op_reply(17 [pgnls-filter start_epoch 48 out=49b] v39'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc014800 2024-09-13T17:53:37.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.830+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:18 6.3c 6:3c000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fcb45c00 con 0x5621fc015400 2024-09-13T17:53:37.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.830+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 <== osd.2 v2:172.21.15.114:6800/1009667871 3 ==== osd_op_reply(18 [pgnls-filter start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26fc0 con 0x5621fc015400 2024-09-13T17:53:37.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.830+0000 7fc0afa00640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x5621fc034800 0x5621fbff6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.830+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:19 6.2 6:40000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc034c00 con 0x5621fc034800 2024-09-13T17:53:37.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.830+0000 7fc0b5e00640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x5621fc034800 0x5621fbff6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.830+0000 7fc0b5e00640 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x5621fc034800 0x5621fbff6680 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.830+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.4 v2:172.21.15.134:6808/3210409298 1 ==== osd_op_reply(19 [pgnls-filter start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc034800 2024-09-13T17:53:37.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.830+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:20 6.22 6:44000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc035000 con 0x5621fbf0b000 2024-09-13T17:53:37.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.830+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.6 v2:172.21.15.134:6824/1813072387 3 ==== osd_op_reply(20 [pgnls-filter start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fbf0b000 2024-09-13T17:53:37.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.830+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:21 6.12 6:48000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc035400 con 0x5621fc014800 2024-09-13T17:53:37.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.830+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.7 v2:172.21.15.134:6816/874939117 4 ==== osd_op_reply(21 [pgnls-filter start_epoch 48 out=49b] v39'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc014800 2024-09-13T17:53:37.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.830+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:22 6.32 6:4c000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fcb44400 con 0x5621fc034800 2024-09-13T17:53:37.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.834+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.4 v2:172.21.15.134:6808/3210409298 2 ==== osd_op_reply(22 [pgnls-filter start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc034800 2024-09-13T17:53:37.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.834+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:23 6.a 6:50000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc035800 con 0x5621fc014400 2024-09-13T17:53:37.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.834+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.5 v2:172.21.15.134:6800/3340754489 2 ==== osd_op_reply(23 [pgnls-filter start_epoch 48 out=49b] v39'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014400 2024-09-13T17:53:37.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.834+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:24 6.2a 6:54000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc015000 con 0x5621fc034800 2024-09-13T17:53:37.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.834+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.4 v2:172.21.15.134:6808/3210409298 3 ==== osd_op_reply(24 [pgnls-filter start_epoch 48 out=49b] v39'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc034800 2024-09-13T17:53:37.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.834+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:25 6.1a 6:58000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc035c00 con 0x5621fc034800 2024-09-13T17:53:37.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.834+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.4 v2:172.21.15.134:6808/3210409298 4 ==== osd_op_reply(25 [pgnls-filter start_epoch 48 out=49b] v39'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc034800 2024-09-13T17:53:37.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.834+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:26 6.3a 6:5c000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc015c00 con 0x5621fc014000 2024-09-13T17:53:37.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.834+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.1 v2:172.21.15.114:6816/2809354915 3 ==== osd_op_reply(26 [pgnls-filter start_epoch 48 out=49b] v39'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014000 2024-09-13T17:53:37.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.834+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:27 6.6 6:60000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc015000 con 0x5621fcb45800 2024-09-13T17:53:37.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.834+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.3 v2:172.21.15.114:6824/1824187331 4 ==== osd_op_reply(27 [pgnls-filter start_epoch 48 out=49b] v39'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fcb45800 2024-09-13T17:53:37.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.834+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:28 6.26 6:64000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fbf0b400 con 0x5621fc014000 2024-09-13T17:53:37.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.834+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.1 v2:172.21.15.114:6816/2809354915 4 ==== osd_op_reply(28 [pgnls-filter start_epoch 48 out=49b] v39'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014000 2024-09-13T17:53:37.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.834+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:29 6.16 6:68000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fcb44400 con 0x5621fbf0b800 2024-09-13T17:53:37.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.834+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 <== osd.0 v2:172.21.15.114:6808/4163905135 5 ==== osd_op_reply(29 [pgnls-filter start_epoch 48 out=49b] v39'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26fc0 con 0x5621fbf0b800 2024-09-13T17:53:37.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.834+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:30 6.36 6:6c000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc9eb400 con 0x5621fc014400 2024-09-13T17:53:37.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.834+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.5 v2:172.21.15.134:6800/3340754489 3 ==== osd_op_reply(30 [pgnls-filter start_epoch 48 out=49b] v39'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014400 2024-09-13T17:53:37.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.834+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:31 6.e 6:70000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc034400 con 0x5621fc034800 2024-09-13T17:53:37.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.834+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.4 v2:172.21.15.134:6808/3210409298 5 ==== osd_op_reply(31 [pgnls-filter start_epoch 48 out=49b] v39'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc034800 2024-09-13T17:53:37.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.834+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:32 6.2e 6:74000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc034000 con 0x5621fbf0b000 2024-09-13T17:53:37.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.834+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.6 v2:172.21.15.134:6824/1813072387 4 ==== osd_op_reply(32 [pgnls-filter start_epoch 48 out=49b] v39'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fbf0b000 2024-09-13T17:53:37.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.834+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:33 6.1e 6:78000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc034c00 con 0x5621fc034800 2024-09-13T17:53:37.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.834+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.4 v2:172.21.15.134:6808/3210409298 6 ==== osd_op_reply(33 [pgnls-filter start_epoch 48 out=49b] v39'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc034800 2024-09-13T17:53:37.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.834+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:34 6.3e 6:7c000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc035800 con 0x5621fcb45800 2024-09-13T17:53:37.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.838+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.3 v2:172.21.15.114:6824/1824187331 5 ==== osd_op_reply(34 [pgnls-filter start_epoch 48 out=49b] v39'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fcb45800 2024-09-13T17:53:37.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.838+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:35 6.1 6:80000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc035000 con 0x5621fc014000 2024-09-13T17:53:37.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.838+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.1 v2:172.21.15.114:6816/2809354915 5 ==== osd_op_reply(35 [pgnls-filter start_epoch 48 out=49b] v39'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014000 2024-09-13T17:53:37.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.838+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:36 6.21 6:84000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fbf0bc00 con 0x5621fc014800 2024-09-13T17:53:37.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.838+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.7 v2:172.21.15.134:6816/874939117 5 ==== osd_op_reply(36 [pgnls-filter start_epoch 48 out=49b] v39'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc014800 2024-09-13T17:53:37.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.838+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:37 6.11 6:88000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc035400 con 0x5621fcb45800 2024-09-13T17:53:37.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.838+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.3 v2:172.21.15.114:6824/1824187331 6 ==== osd_op_reply(37 [pgnls-filter start_epoch 48 out=49b] v39'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fcb45800 2024-09-13T17:53:37.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.838+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:38 6.31 6:8c000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fbf0a800 con 0x5621fc014400 2024-09-13T17:53:37.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.838+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.5 v2:172.21.15.134:6800/3340754489 4 ==== osd_op_reply(38 [pgnls-filter start_epoch 48 out=49b] v39'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014400 2024-09-13T17:53:37.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.838+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:39 6.9 6:90000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc014c00 con 0x5621fbf0b800 2024-09-13T17:53:37.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.838+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 <== osd.0 v2:172.21.15.114:6808/4163905135 6 ==== osd_op_reply(39 [pgnls-filter start_epoch 48 out=49b] v39'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26fc0 con 0x5621fbf0b800 2024-09-13T17:53:37.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.838+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:40 6.29 6:94000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fcb44800 con 0x5621fc014800 2024-09-13T17:53:37.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.838+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.7 v2:172.21.15.134:6816/874939117 6 ==== osd_op_reply(40 [pgnls-filter start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc014800 2024-09-13T17:53:37.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.838+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:41 6.19 6:98000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc015800 con 0x5621fc014400 2024-09-13T17:53:37.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.838+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.5 v2:172.21.15.134:6800/3340754489 5 ==== osd_op_reply(41 [pgnls-filter start_epoch 48 out=49b] v39'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014400 2024-09-13T17:53:37.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.838+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:42 6.39 6:9c000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fcb45c00 con 0x5621fc014400 2024-09-13T17:53:37.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.838+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.5 v2:172.21.15.134:6800/3340754489 6 ==== osd_op_reply(42 [pgnls-filter start_epoch 48 out=49b] v39'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014400 2024-09-13T17:53:37.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.838+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:43 6.5 6:a0000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc015c00 con 0x5621fc014800 2024-09-13T17:53:37.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.838+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.7 v2:172.21.15.134:6816/874939117 7 ==== osd_op_reply(43 [pgnls-filter start_epoch 48 out=49b] v39'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc014800 2024-09-13T17:53:37.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.838+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:44 6.25 6:a4000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fcb44400 con 0x5621fbf0b000 2024-09-13T17:53:37.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.838+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.6 v2:172.21.15.134:6824/1813072387 5 ==== osd_op_reply(44 [pgnls-filter start_epoch 48 out=49b] v39'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fbf0b000 2024-09-13T17:53:37.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.838+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:45 6.15 6:a8000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc015000 con 0x5621fc014800 2024-09-13T17:53:37.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.842+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.7 v2:172.21.15.134:6816/874939117 8 ==== osd_op_reply(45 [pgnls-filter start_epoch 48 out=49b] v39'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc014800 2024-09-13T17:53:37.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.842+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:46 6.35 6:ac000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc035c00 con 0x5621fbf0b800 2024-09-13T17:53:37.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.842+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 <== osd.0 v2:172.21.15.114:6808/4163905135 7 ==== osd_op_reply(46 [pgnls-filter start_epoch 48 out=49b] v39'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26fc0 con 0x5621fbf0b800 2024-09-13T17:53:37.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.842+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:47 6.d 6:b0000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc015c00 con 0x5621fc014400 2024-09-13T17:53:37.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.842+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.5 v2:172.21.15.134:6800/3340754489 7 ==== osd_op_reply(47 [pgnls-filter start_epoch 48 out=49b] v39'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014400 2024-09-13T17:53:37.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.842+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:48 6.2d 6:b4000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc034400 con 0x5621fc015400 2024-09-13T17:53:37.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.842+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 <== osd.2 v2:172.21.15.114:6800/1009667871 4 ==== osd_op_reply(48 [pgnls-filter start_epoch 48 out=49b] v39'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26fc0 con 0x5621fc015400 2024-09-13T17:53:37.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.842+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:49 6.1d 6:b8000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc015800 con 0x5621fc014000 2024-09-13T17:53:37.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.842+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.1 v2:172.21.15.114:6816/2809354915 6 ==== osd_op_reply(49 [pgnls-filter start_epoch 48 out=49b] v39'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014000 2024-09-13T17:53:37.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.842+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:50 6.3d 6:bc000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc034000 con 0x5621fbf0b800 2024-09-13T17:53:37.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.842+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 <== osd.0 v2:172.21.15.114:6808/4163905135 8 ==== osd_op_reply(50 [pgnls-filter start_epoch 48 out=49b] v39'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26fc0 con 0x5621fbf0b800 2024-09-13T17:53:37.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.842+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:51 6.3 6:c0000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fbf0bc00 con 0x5621fc014800 2024-09-13T17:53:37.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.842+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.7 v2:172.21.15.134:6816/874939117 9 ==== osd_op_reply(51 [pgnls-filter start_epoch 48 out=49b] v39'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc014800 2024-09-13T17:53:37.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.842+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:52 6.23 6:c4000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc034c00 con 0x5621fbf0b000 2024-09-13T17:53:37.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.842+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.6 v2:172.21.15.134:6824/1813072387 6 ==== osd_op_reply(52 [pgnls-filter start_epoch 48 out=49b] v39'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fbf0b000 2024-09-13T17:53:37.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.842+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:53 6.13 6:c8000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fbf0b400 con 0x5621fcb45800 2024-09-13T17:53:37.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.842+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.3 v2:172.21.15.114:6824/1824187331 7 ==== osd_op_reply(53 [pgnls-filter start_epoch 48 out=49b] v39'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fcb45800 2024-09-13T17:53:37.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.842+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:54 6.33 6:cc000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc035800 con 0x5621fc014400 2024-09-13T17:53:37.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.846+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.5 v2:172.21.15.134:6800/3340754489 8 ==== osd_op_reply(54 [pgnls-filter start_epoch 48 out=49b] v39'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014400 2024-09-13T17:53:37.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.846+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:55 6.b 6:d0000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fbf0a800 con 0x5621fcb45800 2024-09-13T17:53:37.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.846+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.3 v2:172.21.15.114:6824/1824187331 8 ==== osd_op_reply(55 [pgnls-filter start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fcb45800 2024-09-13T17:53:37.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.846+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:56 6.2b 6:d4000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc035000 con 0x5621fc014400 2024-09-13T17:53:37.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.846+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.5 v2:172.21.15.134:6800/3340754489 9 ==== osd_op_reply(56 [pgnls-filter start_epoch 48 out=49b] v39'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014400 2024-09-13T17:53:37.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.846+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:57 6.1b 6:d8000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc035400 con 0x5621fcb45800 2024-09-13T17:53:37.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.846+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.3 v2:172.21.15.114:6824/1824187331 9 ==== osd_op_reply(57 [pgnls-filter start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fcb45800 2024-09-13T17:53:37.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.846+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:58 6.3b 6:dc000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc9eb400 con 0x5621fc015400 2024-09-13T17:53:37.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.846+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 <== osd.2 v2:172.21.15.114:6800/1009667871 5 ==== osd_op_reply(58 [pgnls-filter start_epoch 48 out=49b] v39'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26fc0 con 0x5621fc015400 2024-09-13T17:53:37.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.846+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:59 6.7 6:e0000000::::head [pgnls-filter start_epoch 48 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc035800 con 0x5621fc014400 2024-09-13T17:53:37.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.846+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.5 v2:172.21.15.134:6800/3340754489 10 ==== osd_op_reply(59 [pgnls-filter start_epoch 48 out=81b] v48'10 uv10 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014400 2024-09-13T17:53:37.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.846+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:60 6.0 6:00000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc03e000 con 0x5621fbf0b800 2024-09-13T17:53:37.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.846+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 <== osd.0 v2:172.21.15.114:6808/4163905135 9 ==== osd_op_reply(60 [pgnls-filter start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26fc0 con 0x5621fbf0b800 2024-09-13T17:53:37.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.846+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:61 6.20 6:04000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc035000 con 0x5621fc014000 2024-09-13T17:53:37.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.846+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.1 v2:172.21.15.114:6816/2809354915 7 ==== osd_op_reply(61 [pgnls-filter start_epoch 48 out=49b] v39'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014000 2024-09-13T17:53:37.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.846+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:62 6.10 6:08000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fcb44800 con 0x5621fbf0b800 2024-09-13T17:53:37.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.846+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 <== osd.0 v2:172.21.15.114:6808/4163905135 10 ==== osd_op_reply(62 [pgnls-filter start_epoch 48 out=49b] v39'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26fc0 con 0x5621fbf0b800 2024-09-13T17:53:37.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.846+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:63 6.30 6:0c000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc035400 con 0x5621fc014800 2024-09-13T17:53:37.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.846+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.7 v2:172.21.15.134:6816/874939117 10 ==== osd_op_reply(63 [pgnls-filter start_epoch 48 out=49b] v39'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc014800 2024-09-13T17:53:37.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.846+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc03e000 con 0x5621fc014800 2024-09-13T17:53:37.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.846+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.7 v2:172.21.15.134:6816/874939117 11 ==== osd_op_reply(64 [pgnls-filter start_epoch 48 out=49b] v39'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc014800 2024-09-13T17:53:37.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.846+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:65 6.28 6:14000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fbf0b400 con 0x5621fc015400 2024-09-13T17:53:37.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.846+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 <== osd.2 v2:172.21.15.114:6800/1009667871 6 ==== osd_op_reply(65 [pgnls-filter start_epoch 48 out=49b] v39'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26fc0 con 0x5621fc015400 2024-09-13T17:53:37.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.846+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:66 6.18 6:18000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc9eb400 con 0x5621fbf0b800 2024-09-13T17:53:37.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.846+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 <== osd.0 v2:172.21.15.114:6808/4163905135 11 ==== osd_op_reply(66 [pgnls-filter start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26fc0 con 0x5621fbf0b800 2024-09-13T17:53:37.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.850+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:67 6.38 6:1c000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fbf0a800 con 0x5621fcb45800 2024-09-13T17:53:37.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.850+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.3 v2:172.21.15.114:6824/1824187331 10 ==== osd_op_reply(67 [pgnls-filter start_epoch 48 out=49b] v39'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fcb45800 2024-09-13T17:53:37.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.850+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:68 6.4 6:20000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc035c00 con 0x5621fc014000 2024-09-13T17:53:37.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.850+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.1 v2:172.21.15.114:6816/2809354915 8 ==== osd_op_reply(68 [pgnls-filter start_epoch 48 out=49b] v39'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014000 2024-09-13T17:53:37.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.850+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:69 6.24 6:24000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc015c00 con 0x5621fc014400 2024-09-13T17:53:37.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.850+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.5 v2:172.21.15.134:6800/3340754489 11 ==== osd_op_reply(69 [pgnls-filter start_epoch 48 out=49b] v39'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014400 2024-09-13T17:53:37.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.850+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:70 6.14 6:28000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc034400 con 0x5621fc015400 2024-09-13T17:53:37.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.850+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 <== osd.2 v2:172.21.15.114:6800/1009667871 7 ==== osd_op_reply(70 [pgnls-filter start_epoch 48 out=49b] v39'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26fc0 con 0x5621fc015400 2024-09-13T17:53:37.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.850+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:71 6.34 6:2c000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc015800 con 0x5621fbf0b800 2024-09-13T17:53:37.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.850+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 <== osd.0 v2:172.21.15.114:6808/4163905135 12 ==== osd_op_reply(71 [pgnls-filter start_epoch 48 out=49b] v39'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26fc0 con 0x5621fbf0b800 2024-09-13T17:53:37.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.850+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:72 6.c 6:30000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc034000 con 0x5621fcb45800 2024-09-13T17:53:37.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.850+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.3 v2:172.21.15.114:6824/1824187331 11 ==== osd_op_reply(72 [pgnls-filter start_epoch 48 out=49b] v39'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fcb45800 2024-09-13T17:53:37.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.850+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:73 6.2c 6:34000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fcb45c00 con 0x5621fbf0b000 2024-09-13T17:53:37.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.850+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.6 v2:172.21.15.134:6824/1813072387 7 ==== osd_op_reply(73 [pgnls-filter start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fbf0b000 2024-09-13T17:53:37.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.850+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:74 6.1c 6:38000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc014c00 con 0x5621fc014800 2024-09-13T17:53:37.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.850+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.7 v2:172.21.15.134:6816/874939117 12 ==== osd_op_reply(74 [pgnls-filter start_epoch 48 out=49b] v39'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc014800 2024-09-13T17:53:37.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.850+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:75 6.3c 6:3c000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc015000 con 0x5621fc015400 2024-09-13T17:53:37.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.850+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 <== osd.2 v2:172.21.15.114:6800/1009667871 8 ==== osd_op_reply(75 [pgnls-filter start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26fc0 con 0x5621fc015400 2024-09-13T17:53:37.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.850+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:76 6.2 6:40000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc048000 con 0x5621fc034800 2024-09-13T17:53:37.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.850+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.4 v2:172.21.15.134:6808/3210409298 7 ==== osd_op_reply(76 [pgnls-filter start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc034800 2024-09-13T17:53:37.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.850+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:77 6.22 6:44000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc014c00 con 0x5621fbf0b000 2024-09-13T17:53:37.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.850+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.6 v2:172.21.15.134:6824/1813072387 8 ==== osd_op_reply(77 [pgnls-filter start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fbf0b000 2024-09-13T17:53:37.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.850+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:78 6.12 6:48000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc048400 con 0x5621fc014800 2024-09-13T17:53:37.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.854+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.7 v2:172.21.15.134:6816/874939117 13 ==== osd_op_reply(78 [pgnls-filter start_epoch 48 out=49b] v39'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc014800 2024-09-13T17:53:37.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.854+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:79 6.32 6:4c000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fcb44400 con 0x5621fc034800 2024-09-13T17:53:37.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.854+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.4 v2:172.21.15.134:6808/3210409298 8 ==== osd_op_reply(79 [pgnls-filter start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc034800 2024-09-13T17:53:37.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.854+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:80 6.a 6:50000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc048800 con 0x5621fc014400 2024-09-13T17:53:37.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.854+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.5 v2:172.21.15.134:6800/3340754489 12 ==== osd_op_reply(80 [pgnls-filter start_epoch 48 out=49b] v39'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014400 2024-09-13T17:53:37.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.854+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:81 6.2a 6:54000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fcb45c00 con 0x5621fc034800 2024-09-13T17:53:37.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.854+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.4 v2:172.21.15.134:6808/3210409298 9 ==== osd_op_reply(81 [pgnls-filter start_epoch 48 out=49b] v39'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc034800 2024-09-13T17:53:37.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.854+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:82 6.1a 6:58000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc048c00 con 0x5621fc034800 2024-09-13T17:53:37.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.854+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.4 v2:172.21.15.134:6808/3210409298 10 ==== osd_op_reply(82 [pgnls-filter start_epoch 48 out=49b] v39'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc034800 2024-09-13T17:53:37.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.854+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:83 6.3a 6:5c000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc03e000 con 0x5621fc014000 2024-09-13T17:53:37.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.854+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.1 v2:172.21.15.114:6816/2809354915 9 ==== osd_op_reply(83 [pgnls-filter start_epoch 48 out=49b] v39'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014000 2024-09-13T17:53:37.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.854+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:84 6.6 6:60000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc049000 con 0x5621fcb45800 2024-09-13T17:53:37.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.854+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.3 v2:172.21.15.114:6824/1824187331 12 ==== osd_op_reply(84 [pgnls-filter start_epoch 48 out=49b] v39'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fcb45800 2024-09-13T17:53:37.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.854+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:85 6.26 6:64000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc034c00 con 0x5621fc014000 2024-09-13T17:53:37.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.854+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.1 v2:172.21.15.114:6816/2809354915 10 ==== osd_op_reply(85 [pgnls-filter start_epoch 48 out=49b] v39'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014000 2024-09-13T17:53:37.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.854+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:86 6.16 6:68000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc049400 con 0x5621fbf0b800 2024-09-13T17:53:37.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.854+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 <== osd.0 v2:172.21.15.114:6808/4163905135 13 ==== osd_op_reply(86 [pgnls-filter start_epoch 48 out=49b] v39'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26fc0 con 0x5621fbf0b800 2024-09-13T17:53:37.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.854+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:87 6.36 6:6c000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc035400 con 0x5621fc014400 2024-09-13T17:53:37.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.854+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.5 v2:172.21.15.134:6800/3340754489 13 ==== osd_op_reply(87 [pgnls-filter start_epoch 48 out=49b] v39'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014400 2024-09-13T17:53:37.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.854+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:88 6.e 6:70000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc049800 con 0x5621fc034800 2024-09-13T17:53:37.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.854+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.4 v2:172.21.15.134:6808/3210409298 11 ==== osd_op_reply(88 [pgnls-filter start_epoch 48 out=49b] v39'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc034800 2024-09-13T17:53:37.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.854+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:89 6.2e 6:74000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fbf0bc00 con 0x5621fbf0b000 2024-09-13T17:53:37.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.858+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.6 v2:172.21.15.134:6824/1813072387 9 ==== osd_op_reply(89 [pgnls-filter start_epoch 48 out=49b] v39'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fbf0b000 2024-09-13T17:53:37.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.858+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:90 6.1e 6:78000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc049c00 con 0x5621fc034800 2024-09-13T17:53:37.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.858+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.4 v2:172.21.15.134:6808/3210409298 12 ==== osd_op_reply(90 [pgnls-filter start_epoch 48 out=49b] v39'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc034800 2024-09-13T17:53:37.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.858+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:91 6.3e 6:7c000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc014c00 con 0x5621fcb45800 2024-09-13T17:53:37.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.858+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.3 v2:172.21.15.114:6824/1824187331 13 ==== osd_op_reply(91 [pgnls-filter start_epoch 48 out=49b] v39'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fcb45800 2024-09-13T17:53:37.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.858+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:92 6.1 6:80000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc03e000 con 0x5621fc014000 2024-09-13T17:53:37.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.858+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.1 v2:172.21.15.114:6816/2809354915 11 ==== osd_op_reply(92 [pgnls-filter start_epoch 48 out=49b] v39'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014000 2024-09-13T17:53:37.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.858+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:93 6.21 6:84000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc015800 con 0x5621fc014800 2024-09-13T17:53:37.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.858+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.7 v2:172.21.15.134:6816/874939117 14 ==== osd_op_reply(93 [pgnls-filter start_epoch 48 out=49b] v39'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc014800 2024-09-13T17:53:37.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.858+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:94 6.11 6:88000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc034400 con 0x5621fcb45800 2024-09-13T17:53:37.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.858+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.3 v2:172.21.15.114:6824/1824187331 14 ==== osd_op_reply(94 [pgnls-filter start_epoch 48 out=49b] v39'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fcb45800 2024-09-13T17:53:37.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.858+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:95 6.31 6:8c000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc015000 con 0x5621fc014400 2024-09-13T17:53:37.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.858+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.5 v2:172.21.15.134:6800/3340754489 14 ==== osd_op_reply(95 [pgnls-filter start_epoch 48 out=49b] v39'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014400 2024-09-13T17:53:37.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.858+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:96 6.9 6:90000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc035800 con 0x5621fbf0b800 2024-09-13T17:53:37.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.858+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 <== osd.0 v2:172.21.15.114:6808/4163905135 14 ==== osd_op_reply(96 [pgnls-filter start_epoch 48 out=49b] v39'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26fc0 con 0x5621fbf0b800 2024-09-13T17:53:37.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.858+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:97 6.29 6:94000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc015c00 con 0x5621fc014800 2024-09-13T17:53:37.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.858+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.7 v2:172.21.15.134:6816/874939117 15 ==== osd_op_reply(97 [pgnls-filter start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc014800 2024-09-13T17:53:37.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.858+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:98 6.19 6:98000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc035000 con 0x5621fc014400 2024-09-13T17:53:37.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.858+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.5 v2:172.21.15.134:6800/3340754489 15 ==== osd_op_reply(98 [pgnls-filter start_epoch 48 out=49b] v39'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014400 2024-09-13T17:53:37.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.858+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:99 6.39 6:9c000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fbf0bc00 con 0x5621fc014400 2024-09-13T17:53:37.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.858+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.5 v2:172.21.15.134:6800/3340754489 16 ==== osd_op_reply(99 [pgnls-filter start_epoch 48 out=49b] v39'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014400 2024-09-13T17:53:37.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.858+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:100 6.5 6:a0000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc035c00 con 0x5621fc014800 2024-09-13T17:53:37.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.862+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.7 v2:172.21.15.134:6816/874939117 16 ==== osd_op_reply(100 [pgnls-filter start_epoch 48 out=49b] v39'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc014800 2024-09-13T17:53:37.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.862+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:101 6.25 6:a4000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fbf0b400 con 0x5621fbf0b000 2024-09-13T17:53:37.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.862+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.6 v2:172.21.15.134:6824/1813072387 10 ==== osd_op_reply(101 [pgnls-filter start_epoch 48 out=49b] v39'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fbf0b000 2024-09-13T17:53:37.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.862+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:102 6.15 6:a8000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc034000 con 0x5621fc014800 2024-09-13T17:53:37.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.862+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.7 v2:172.21.15.134:6816/874939117 17 ==== osd_op_reply(102 [pgnls-filter start_epoch 48 out=49b] v39'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc014800 2024-09-13T17:53:37.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.862+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:103 6.35 6:ac000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fbf0a800 con 0x5621fbf0b800 2024-09-13T17:53:37.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.862+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 <== osd.0 v2:172.21.15.114:6808/4163905135 15 ==== osd_op_reply(103 [pgnls-filter start_epoch 48 out=49b] v39'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26fc0 con 0x5621fbf0b800 2024-09-13T17:53:37.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.862+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:104 6.d 6:b0000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc048000 con 0x5621fc014400 2024-09-13T17:53:37.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.862+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.5 v2:172.21.15.134:6800/3340754489 17 ==== osd_op_reply(104 [pgnls-filter start_epoch 48 out=49b] v39'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014400 2024-09-13T17:53:37.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.862+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:105 6.2d 6:b4000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc9eb400 con 0x5621fc015400 2024-09-13T17:53:37.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.862+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 <== osd.2 v2:172.21.15.114:6800/1009667871 9 ==== osd_op_reply(105 [pgnls-filter start_epoch 48 out=49b] v39'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26fc0 con 0x5621fc015400 2024-09-13T17:53:37.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.862+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:106 6.1d 6:b8000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc048400 con 0x5621fc014000 2024-09-13T17:53:37.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.862+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.1 v2:172.21.15.114:6816/2809354915 12 ==== osd_op_reply(106 [pgnls-filter start_epoch 48 out=49b] v39'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014000 2024-09-13T17:53:37.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.862+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:107 6.3d 6:bc000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fcb44400 con 0x5621fbf0b800 2024-09-13T17:53:37.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.862+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 <== osd.0 v2:172.21.15.114:6808/4163905135 16 ==== osd_op_reply(107 [pgnls-filter start_epoch 48 out=49b] v39'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26fc0 con 0x5621fbf0b800 2024-09-13T17:53:37.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.862+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:108 6.3 6:c0000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc048800 con 0x5621fc014800 2024-09-13T17:53:37.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.862+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.7 v2:172.21.15.134:6816/874939117 18 ==== osd_op_reply(108 [pgnls-filter start_epoch 48 out=49b] v39'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc014800 2024-09-13T17:53:37.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.862+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:109 6.23 6:c4000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fcb45c00 con 0x5621fbf0b000 2024-09-13T17:53:37.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.862+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.6 v2:172.21.15.134:6824/1813072387 11 ==== osd_op_reply(109 [pgnls-filter start_epoch 48 out=49b] v39'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fbf0b000 2024-09-13T17:53:37.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.862+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:110 6.13 6:c8000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc048c00 con 0x5621fcb45800 2024-09-13T17:53:37.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.862+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.3 v2:172.21.15.114:6824/1824187331 15 ==== osd_op_reply(110 [pgnls-filter start_epoch 48 out=49b] v39'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fcb45800 2024-09-13T17:53:37.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.862+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:111 6.33 6:cc000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fcb44800 con 0x5621fc014400 2024-09-13T17:53:37.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.862+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.5 v2:172.21.15.134:6800/3340754489 18 ==== osd_op_reply(111 [pgnls-filter start_epoch 48 out=49b] v39'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014400 2024-09-13T17:53:37.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.862+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:112 6.b 6:d0000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc049000 con 0x5621fcb45800 2024-09-13T17:53:37.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.866+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.3 v2:172.21.15.114:6824/1824187331 16 ==== osd_op_reply(112 [pgnls-filter start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fcb45800 2024-09-13T17:53:37.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.866+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:113 6.2b 6:d4000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc048000 con 0x5621fc014400 2024-09-13T17:53:37.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.866+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.5 v2:172.21.15.134:6800/3340754489 19 ==== osd_op_reply(113 [pgnls-filter start_epoch 48 out=49b] v39'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014400 2024-09-13T17:53:37.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.866+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:114 6.1b 6:d8000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc049400 con 0x5621fcb45800 2024-09-13T17:53:37.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.866+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.3 v2:172.21.15.114:6824/1824187331 17 ==== osd_op_reply(114 [pgnls-filter start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fcb45800 2024-09-13T17:53:37.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.866+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:115 6.3b 6:dc000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc048400 con 0x5621fc015400 2024-09-13T17:53:37.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.866+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 <== osd.2 v2:172.21.15.114:6800/1009667871 10 ==== osd_op_reply(115 [pgnls-filter start_epoch 48 out=49b] v39'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26fc0 con 0x5621fc015400 2024-09-13T17:53:37.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.866+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:116 6.7 6:e0000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc049800 con 0x5621fc014400 2024-09-13T17:53:37.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.866+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.5 v2:172.21.15.134:6800/3340754489 20 ==== osd_op_reply(116 [pgnls-filter start_epoch 48 out=81b] v48'10 uv10 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014400 2024-09-13T17:53:37.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.866+0000 7fc0b72a78c0 20 datascan.forall_objects: OSD matched oid 10000000001.00000000 2024-09-13T17:53:37.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.866+0000 7fc0b72a78c0 10 datascan.operator(): handling object 10000000001.0 2024-09-13T17:53:37.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.866+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:117 6.7 6:e2e07930:::10000000001.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc03e400 con 0x5621fc014400 2024-09-13T17:53:37.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.866+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.5 v2:172.21.15.134:6800/3340754489 21 ==== osd_op_reply(117 10000000001.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (95) out=95b,getxattr (30) out=30b,getxattr] v0'0 uv10 ondisk = 0) v8 ==== 416+0+163 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fc014400 2024-09-13T17:53:37.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.866+0000 7fc0b72a78c0 20 datascan.operator(): loaded layout from xattr: pi: 6 os: 4194304 sc: 1 su: 4194304 2024-09-13T17:53:37.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.866+0000 7fc0b72a78c0 10 datascan.inject_with_backtrace: inode: 0x0x10000000001 2024-09-13T17:53:37.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.866+0000 7fc0b72a78c0 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/sixmegs 2024-09-13T17:53:37.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.866+0000 7fc0b72a78c0 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=sixmegs 2024-09-13T17:53:37.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.866+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:118 7.10 7:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc03e800 con 0x5621fcb45800 2024-09-13T17:53:37.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.866+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.3 v2:172.21.15.114:6824/1824187331 18 ==== osd_op_reply(118 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fcb45800 2024-09-13T17:53:37.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.866+0000 7fc0b72a78c0 4 datascan.get_frag_of: Unexpected error on '10000000000.00000000': (2) No such file or directory 2024-09-13T17:53:37.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.866+0000 7fc0b72a78c0 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/sixmegs, will insert to root 2024-09-13T17:53:37.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.866+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:119 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc03ec00 con 0x5621fcb45800 2024-09-13T17:53:37.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.866+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.3 v2:172.21.15.114:6824/1824187331 19 ==== osd_op_reply(119 10000000000.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fcb45800 2024-09-13T17:53:37.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.866+0000 7fc0b72a78c0 10 datascan.find_or_create_dirfrag: read_version = 0 2024-09-13T17:53:37.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.866+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:120 7.10 7:0cf6ad0f:::10000000000.00000000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc03f000 con 0x5621fcb45800 2024-09-13T17:53:37.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.866+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.3 v2:172.21.15.114:6824/1824187331 20 ==== osd_op_reply(120 10000000000.00000000 [create,omap-set-header] v48'1 uv1 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fcb45800 2024-09-13T17:53:37.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.866+0000 7fc0b72a78c0 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x10000000000 2024-09-13T17:53:37.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.866+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:121 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc03f400 con 0x5621fcb45800 2024-09-13T17:53:37.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.870+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.3 v2:172.21.15.114:6824/1824187331 21 ==== osd_op_reply(121 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fcb45800 2024-09-13T17:53:37.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.870+0000 7fc0b72a78c0 20 datascan.read_dentry: oid=10000000000.00000000 dname=sixmegs frag=*, r=0 2024-09-13T17:53:37.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.870+0000 7fc0b72a78c0 20 datascan.read_dentry: sixmegs_head not found in result 2024-09-13T17:53:37.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.870+0000 7fc0b72a78c0 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000001 at 0x0x10000000000/sixmegs with size=6291456 bytes 2024-09-13T17:53:37.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.870+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:122 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=508b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc03f800 con 0x5621fcb45800 2024-09-13T17:53:37.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.870+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.3 v2:172.21.15.114:6824/1824187331 22 ==== osd_op_reply(122 10000000000.00000000 [omap-set-vals] v48'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fcb45800 2024-09-13T17:53:37.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.870+0000 7fc0b72a78c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/sixmegs pointing to 0x0x10000000001 2024-09-13T17:53:37.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.870+0000 7fc0b72a78c0 10 datascan.inject_with_backtrace: backptr: 0x0x1/subdir 2024-09-13T17:53:37.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.870+0000 7fc0b72a78c0 20 datascan.get_frag_of: dirino=0x1 target_dname=subdir 2024-09-13T17:53:37.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.870+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:123 7.1f 7:ff5b34d6:::1.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc03fc00 con 0x5621fbf0b000 2024-09-13T17:53:37.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.870+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.6 v2:172.21.15.134:6824/1813072387 12 ==== osd_op_reply(123 1.00000000 [getxattr] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fbf0b000 2024-09-13T17:53:37.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.870+0000 7fc0b72a78c0 4 datascan.get_frag_of: Unexpected error on '1.00000000': (2) No such file or directory 2024-09-13T17:53:37.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.870+0000 7fc0b72a78c0 20 datascan.inject_with_backtrace: don't know fragment for 0x0x1/subdir, will insert to root 2024-09-13T17:53:37.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.870+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:124 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc03e400 con 0x5621fbf0b000 2024-09-13T17:53:37.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.870+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.6 v2:172.21.15.134:6824/1813072387 13 ==== osd_op_reply(124 1.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fbf0b000 2024-09-13T17:53:37.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.870+0000 7fc0b72a78c0 10 datascan.find_or_create_dirfrag: read_version = 0 2024-09-13T17:53:37.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.870+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:125 7.1f 7:ff5b34d6:::1.00000000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc03e800 con 0x5621fbf0b000 2024-09-13T17:53:37.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.870+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.6 v2:172.21.15.134:6824/1813072387 14 ==== osd_op_reply(125 1.00000000 [create,omap-set-header] v48'2 uv2 ondisk = 0) v8 ==== 196+0+0 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fbf0b000 2024-09-13T17:53:37.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.870+0000 7fc0b72a78c0 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x1 2024-09-13T17:53:37.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.870+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:126 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc03ec00 con 0x5621fbf0b000 2024-09-13T17:53:37.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.870+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.6 v2:172.21.15.134:6824/1813072387 15 ==== osd_op_reply(126 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv2 ondisk = 0) v8 ==== 154+0+4 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fbf0b000 2024-09-13T17:53:37.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.870+0000 7fc0b72a78c0 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2024-09-13T17:53:37.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.870+0000 7fc0b72a78c0 20 datascan.read_dentry: subdir_head not found in result 2024-09-13T17:53:37.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.870+0000 7fc0b72a78c0 10 datascan.inject_with_backtrace: Linking ancestor directory of inode 0x0x10000000000 at 0x0x1:subdir 2024-09-13T17:53:37.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.870+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:127 7.1f 7:ff5b34d6:::1.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc048c00 con 0x5621fbf0b000 2024-09-13T17:53:37.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.6 v2:172.21.15.134:6824/1813072387 16 ==== osd_op_reply(127 1.00000000 [omap-set-vals] v48'3 uv3 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fbf0b000 2024-09-13T17:53:37.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b72a78c0 20 datascan.inject_linkage: Injected dentry 0x0x1/subdir pointing to 0x0x10000000000 2024-09-13T17:53:37.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:128 6.27 6:e4000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc049000 con 0x5621fbf0b000 2024-09-13T17:53:37.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.6 v2:172.21.15.134:6824/1813072387 17 ==== osd_op_reply(128 [pgnls-filter start_epoch 48 out=49b] v39'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fbf0b000 2024-09-13T17:53:37.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:129 6.17 6:e8000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc049c00 con 0x5621fc034800 2024-09-13T17:53:37.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.4 v2:172.21.15.134:6808/3210409298 13 ==== osd_op_reply(129 [pgnls-filter start_epoch 48 out=49b] v39'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc034800 2024-09-13T17:53:37.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:130 6.37 6:ec000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fbf0bc00 con 0x5621fbf0b800 2024-09-13T17:53:37.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 <== osd.0 v2:172.21.15.114:6808/4163905135 17 ==== osd_op_reply(130 [pgnls-filter start_epoch 48 out=49b] v39'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26fc0 con 0x5621fbf0b800 2024-09-13T17:53:37.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:131 6.f 6:f0000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc03fc00 con 0x5621fc015400 2024-09-13T17:53:37.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 <== osd.2 v2:172.21.15.114:6800/1009667871 11 ==== osd_op_reply(131 [pgnls-filter start_epoch 48 out=49b] v39'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26fc0 con 0x5621fc015400 2024-09-13T17:53:37.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:132 6.2f 6:f4000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc034c00 con 0x5621fc014800 2024-09-13T17:53:37.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b5e00640 1 -- 172.21.15.114:0/4176220631 <== osd.7 v2:172.21.15.134:6816/874939117 19 ==== osd_op_reply(132 [pgnls-filter start_epoch 48 out=49b] v39'9 uv1 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26d80 con 0x5621fc014800 2024-09-13T17:53:37.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0af000640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:133 6.1f 6:f8000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc03e400 con 0x5621fcb45800 2024-09-13T17:53:37.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.3 v2:172.21.15.114:6824/1824187331 23 ==== osd_op_reply(133 [pgnls-filter start_epoch 48 out=49b] v39'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fcb45800 2024-09-13T17:53:37.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0afa00640 1 -- 172.21.15.114:0/4176220631 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:134 6.3f 6:fc000000::::head [pgnls-filter start_epoch 48 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5621fc035400 con 0x5621fcb45800 2024-09-13T17:53:37.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b4a00640 1 -- 172.21.15.114:0/4176220631 <== osd.3 v2:172.21.15.114:6824/1824187331 24 ==== osd_op_reply(134 [pgnls-filter start_epoch 48 out=49b] v39'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5621fcb26b40 con 0x5621fcb45800 2024-09-13T17:53:37.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x5621fbf0b800 msgr2=0x5621fbcb3180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b72a78c0 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x5621fbf0b800 0x5621fbcb3180 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x5621fc014000 msgr2=0x5621fbff4580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b72a78c0 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x5621fc014000 0x5621fbff4580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x5621fc015400 msgr2=0x5621fbff5080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b72a78c0 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x5621fc015400 0x5621fbff5080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x5621fcb45800 msgr2=0x5621fbcb2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b72a78c0 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x5621fcb45800 0x5621fbcb2680 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x5621fc034800 msgr2=0x5621fbff6680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b72a78c0 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x5621fc034800 0x5621fbff6680 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x5621fc014400 msgr2=0x5621fbff5600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b72a78c0 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x5621fc014400 0x5621fbff5600 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x5621fbf0b000 msgr2=0x5621fbcb2c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b72a78c0 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x5621fbf0b000 0x5621fbcb2c00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x5621fc014800 msgr2=0x5621fbff4b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b72a78c0 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x5621fc014800 0x5621fbff4b00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 reap_dead start 2024-09-13T17:53:37.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b5400640 1 -- 172.21.15.114:0/4176220631 reap_dead start 2024-09-13T17:53:37.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x5621fbf0ac00 msgr2=0x5621fbff4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b72a78c0 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x5621fbf0ac00 0x5621fbff4000 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x5621fca79950 tx=0x5621fc9e81e0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5621fcb44c00 msgr2=0x5621fbcb0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.874+0000 7fc0b72a78c0 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5621fcb44c00 0x5621fbcb0b00 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x5621fca79020 tx=0x5621fc9e8000 comp rx=0 tx=0).stop 2024-09-13T17:53:37.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.878+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 shutdown_connections 2024-09-13T17:53:37.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.878+0000 7fc0b72a78c0 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x5621fbf0ac00 0x5621fbff4000 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.878+0000 7fc0b72a78c0 1 --2- 172.21.15.114:0/4176220631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5621fcb44c00 0x5621fbcb0b00 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.878+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 >> 172.21.15.114:0/4176220631 conn(0x5621fbc24c00 msgr2=0x5621fbc51800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:37.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.878+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 shutdown_connections 2024-09-13T17:53:37.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.878+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/4176220631 wait complete. 2024-09-13T17:53:37.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.878+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/355787064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5621fbc25400 msgr2=0x5621fbcb1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.878+0000 7fc0b72a78c0 1 --2- 172.21.15.114:0/355787064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5621fbc25400 0x5621fbcb1600 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x5621fca798c0 tx=0x5621fbca0f00 comp rx=0 tx=0).stop 2024-09-13T17:53:37.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.878+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/355787064 shutdown_connections 2024-09-13T17:53:37.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.878+0000 7fc0b72a78c0 1 --2- 172.21.15.114:0/355787064 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5621fbc25000 0x5621fbcb1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.878+0000 7fc0b72a78c0 1 --2- 172.21.15.114:0/355787064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5621fbc25400 0x5621fbcb1600 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.878+0000 7fc0b72a78c0 1 --2- 172.21.15.114:0/355787064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5621fbc25800 0x5621fbcb1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.878+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/355787064 >> 172.21.15.114:0/355787064 conn(0x5621fbc25c00 msgr2=0x5621fbc51000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:37.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.878+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/355787064 shutdown_connections 2024-09-13T17:53:37.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.878+0000 7fc0b72a78c0 1 -- 172.21.15.114:0/355787064 wait complete. 2024-09-13T17:53:37.887 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', '--alternate-pool', 'recovery_fs_metadata', '--filesystem', 'cephfs', '--force-corrupt', '--force-init', 'cephfs_data'] in time 0:00:00.122607, result: 2024-09-13T17:53:37.887 DEBUG:teuthology.orchestra.run.smithi114:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links --filesystem recovery_fs 2024-09-13T17:53:37.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.922+0000 7fe5a2f058c0 1 -- start start 2024-09-13T17:53:37.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.922+0000 7fe5a2f058c0 1 Processor -- start 2024-09-13T17:53:37.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a2f058c0 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595b393b800 0x5595b39c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a2f058c0 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5595b393b400 0x5595b39c7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a2f058c0 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595b393b000 0x5595b39c7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a2f058c0 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595b3a08a00 con 0x5595b393b000 2024-09-13T17:53:37.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a2f058c0 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595b3a08640 con 0x5595b393b800 2024-09-13T17:53:37.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a2f058c0 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595b3a08500 con 0x5595b393b400 2024-09-13T17:53:37.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a1a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595b393b000 0x5595b39c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a1a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595b393b000 0x5595b39c7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44040/0 (socket says 172.21.15.114:44040) 2024-09-13T17:53:37.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a1a00640 1 -- 172.21.15.114:0/2837257800 learned_addr learned my addr 172.21.15.114:0/2837257800 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:37.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a0600640 1 --2- 172.21.15.114:0/2837257800 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5595b393b400 0x5595b39c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a1000640 1 --2- 172.21.15.114:0/2837257800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595b393b800 0x5595b39c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a1a00640 1 -- 172.21.15.114:0/2837257800 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5595b393b400 msgr2=0x5595b39c7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:37.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a1a00640 1 --2- 172.21.15.114:0/2837257800 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5595b393b400 0x5595b39c7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a1a00640 1 -- 172.21.15.114:0/2837257800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595b393b800 msgr2=0x5595b39c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:37.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a1a00640 1 --2- 172.21.15.114:0/2837257800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595b393b800 0x5595b39c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a1a00640 1 -- 172.21.15.114:0/2837257800 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595b39709c0 con 0x5595b393b000 2024-09-13T17:53:37.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a1000640 1 --2- 172.21.15.114:0/2837257800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595b393b800 0x5595b39c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:37.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a0600640 1 --2- 172.21.15.114:0/2837257800 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5595b393b400 0x5595b39c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:37.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a1a00640 1 --2- 172.21.15.114:0/2837257800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595b393b000 0x5595b39c7080 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x5595b4795020 tx=0x5595b4708000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6341b0074e122514 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe59de00640 1 -- 172.21.15.114:0/2837257800 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5595b398f080 con 0x5595b393b000 2024-09-13T17:53:37.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe59de00640 1 -- 172.21.15.114:0/2837257800 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5595b3998900 con 0x5595b393b000 2024-09-13T17:53:37.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe59de00640 1 -- 172.21.15.114:0/2837257800 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5595b398f600 con 0x5595b393b000 2024-09-13T17:53:37.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/2837257800 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595b39701a0 con 0x5595b393b000 2024-09-13T17:53:37.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/2837257800 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5595b39709c0 con 0x5595b393b000 2024-09-13T17:53:37.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a2f058c0 4 waiting for MDS map... 2024-09-13T17:53:37.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe59de00640 1 -- 172.21.15.114:0/2837257800 <== mon.0 v2:172.21.15.114:3300/0 4 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x5595b397cc40 con 0x5595b393b000 2024-09-13T17:53:37.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe59de00640 1 -- 172.21.15.114:0/2837257800 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 23) v1 ==== 3691+0+0 (secure 0 0 0) 0x5595b3989200 con 0x5595b393b000 2024-09-13T17:53:37.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a2f058c0 4 Got MDS map 23 2024-09-13T17:53:37.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a2f058c0 4 datascan.main: Using metadata pool output 2024-09-13T17:53:37.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a2f058c0 4 datascan.main: connecting to RADOS... 2024-09-13T17:53:37.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a2f058c0 1 Processor -- start 2024-09-13T17:53:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a2f058c0 1 -- start start 2024-09-13T17:53:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a2f058c0 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595b471b800 0x5595b39c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a2f058c0 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5595b471bc00 0x5595b39c6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a2f058c0 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595b48ae000 0x5595b39c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a2f058c0 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595b3981e00 con 0x5595b48ae000 2024-09-13T17:53:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a2f058c0 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595b3a08500 con 0x5595b471b800 2024-09-13T17:53:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.926+0000 7fe5a2f058c0 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595b3a08640 con 0x5595b471bc00 2024-09-13T17:53:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a0600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595b48ae000 0x5595b39c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a0600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595b471b800 0x5595b39c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a0600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595b471b800 0x5595b39c6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:43990/0 (socket says 172.21.15.114:43990) 2024-09-13T17:53:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a0600640 1 -- 172.21.15.114:0/3453498380 learned_addr learned my addr 172.21.15.114:0/3453498380 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a1000640 1 --2- 172.21.15.114:0/3453498380 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5595b471bc00 0x5595b39c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a0600640 1 -- 172.21.15.114:0/3453498380 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5595b471bc00 msgr2=0x5595b39c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:37.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a0600640 1 --2- 172.21.15.114:0/3453498380 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5595b471bc00 0x5595b39c6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a0600640 1 -- 172.21.15.114:0/3453498380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595b48ae000 msgr2=0x5595b39c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:37.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a0600640 1 --2- 172.21.15.114:0/3453498380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595b48ae000 0x5595b39c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a0600640 1 -- 172.21.15.114:0/3453498380 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595b3970b60 con 0x5595b471b800 2024-09-13T17:53:37.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a0600640 1 --2- 172.21.15.114:0/3453498380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595b471b800 0x5595b39c6b00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x5595b4795b60 tx=0x5595b4858cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6851ea6f92a685fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe59b600640 1 -- 172.21.15.114:0/3453498380 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5595b398f080 con 0x5595b471b800 2024-09-13T17:53:37.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe59b600640 1 -- 172.21.15.114:0/3453498380 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5595b4712300 con 0x5595b471b800 2024-09-13T17:53:37.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe59b600640 1 -- 172.21.15.114:0/3453498380 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5595b398f600 con 0x5595b471b800 2024-09-13T17:53:37.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3453498380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595b471b800 msgr2=0x5595b39c6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a2f058c0 1 --2- 172.21.15.114:0/3453498380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595b471b800 0x5595b39c6b00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x5595b4795b60 tx=0x5595b4858cc0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3453498380 shutdown_connections 2024-09-13T17:53:37.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a2f058c0 1 --2- 172.21.15.114:0/3453498380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595b48ae000 0x5595b39c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a2f058c0 1 --2- 172.21.15.114:0/3453498380 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5595b471bc00 0x5595b39c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a2f058c0 1 --2- 172.21.15.114:0/3453498380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595b471b800 0x5595b39c6b00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3453498380 >> 172.21.15.114:0/3453498380 conn(0x5595b393ac00 msgr2=0x5595b3967800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:37.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3453498380 shutdown_connections 2024-09-13T17:53:37.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3453498380 wait complete. 2024-09-13T17:53:37.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a2f058c0 1 Processor -- start 2024-09-13T17:53:37.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a2f058c0 1 -- start start 2024-09-13T17:53:37.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a2f058c0 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5595b471bc00 0x5595b39c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a2f058c0 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595b471b800 0x5595b39c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a2f058c0 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595b48af800 0x5595b39c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a2f058c0 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595b3a083c0 con 0x5595b471b800 2024-09-13T17:53:37.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a2f058c0 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595b3a08280 con 0x5595b48af800 2024-09-13T17:53:37.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a2f058c0 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595b3a08140 con 0x5595b471bc00 2024-09-13T17:53:37.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a1000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595b471b800 0x5595b39c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a1000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595b471b800 0x5595b39c6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44046/0 (socket says 172.21.15.114:44046) 2024-09-13T17:53:37.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a1000640 1 -- 172.21.15.114:0/3979521984 learned_addr learned my addr 172.21.15.114:0/3979521984 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:37.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a1000640 1 -- 172.21.15.114:0/3979521984 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5595b471bc00 msgr2=0x5595b39c6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a0600640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5595b471bc00 0x5595b39c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a0600640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595b48af800 0x5595b39c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a1000640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5595b471bc00 0x5595b39c6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a1000640 1 -- 172.21.15.114:0/3979521984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595b48af800 msgr2=0x5595b39c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a1000640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595b48af800 0x5595b39c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a1000640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595b3970340 con 0x5595b471b800 2024-09-13T17:53:37.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a0600640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595b48af800 0x5595b39c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:37.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a1000640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595b471b800 0x5595b39c6580 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x5595b47179b0 tx=0x5595b4858d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe599800640 1 -- 172.21.15.114:0/3979521984 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5595b398f080 con 0x5595b471b800 2024-09-13T17:53:37.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe599800640 1 -- 172.21.15.114:0/3979521984 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5595b4713980 con 0x5595b471b800 2024-09-13T17:53:37.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5595b3970000 con 0x5595b471b800 2024-09-13T17:53:37.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.930+0000 7fe599800640 1 -- 172.21.15.114:0/3979521984 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5595b398f600 con 0x5595b471b800 2024-09-13T17:53:37.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.934+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595b3970ea0 con 0x5595b471b800 2024-09-13T17:53:37.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.934+0000 7fe5a2f058c0 4 datascan.init: resolving metadata pool 7 2024-09-13T17:53:37.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.934+0000 7fe599800640 1 -- 172.21.15.114:0/3979521984 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x5595b3974840 con 0x5595b471b800 2024-09-13T17:53:37.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.934+0000 7fe599800640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x5595b48c5400 0x5595b3d10000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.934+0000 7fe599800640 1 -- 172.21.15.114:0/3979521984 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x5595b397ca80 con 0x5595b471b800 2024-09-13T17:53:37.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.934+0000 7fe5a2f058c0 4 datascan.init: found metadata pool 'recovery_fs_metadata' 2024-09-13T17:53:37.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.934+0000 7fe5a2f058c0 4 datascan.main: resolving metadata pool 7 2024-09-13T17:53:37.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.934+0000 7fe5a2f058c0 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x5595b48af400 0x5595b39c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.934+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:1 7.0 7:00000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48af000 con 0x5595b48af400 2024-09-13T17:53:37.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.934+0000 7fe5a0600640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x5595b48c5400 0x5595b3d10000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.934+0000 7fe5a0600640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x5595b48af400 0x5595b39c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.934+0000 7fe5a0600640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x5595b48c5400 0x5595b3d10000 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x5595b4795a70 tx=0x5595b47082a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.934+0000 7fe5a0600640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x5595b48af400 0x5595b39c8680 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.934+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 <== osd.5 v2:172.21.15.134:6800/3340754489 1 ==== osd_op_reply(1 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704b40 con 0x5595b48af400 2024-09-13T17:53:37.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.934+0000 7fe5a0600640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x5595b48af000 0x5595b3d10580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.934+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:2 7.10 7:08000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48c4400 con 0x5595b48af000 2024-09-13T17:53:37.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.934+0000 7fe5a1a00640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x5595b48af000 0x5595b3d10580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.938+0000 7fe5a1a00640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x5595b48af000 0x5595b3d10580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.938+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.3 v2:172.21.15.114:6824/1824187331 1 ==== osd_op_reply(2 [pgnls start_epoch 48 out=81b] v48'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48af000 2024-09-13T17:53:37.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.938+0000 7fe5a1a00640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x5595b48c4400 0x5595b3d10b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.938+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:3 7.8 7:10000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b471b400 con 0x5595b48c4400 2024-09-13T17:53:37.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.938+0000 7fe5a1000640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x5595b48c4400 0x5595b3d10b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.938+0000 7fe5a1000640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x5595b48c4400 0x5595b3d10b00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.938+0000 7fe5a1000640 1 -- 172.21.15.114:0/3979521984 <== osd.2 v2:172.21.15.114:6800/1009667871 1 ==== osd_op_reply(3 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704fc0 con 0x5595b48c4400 2024-09-13T17:53:37.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.938+0000 7fe5a1000640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x5595b471b400 0x5595b3d11080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.938+0000 7fe5a1000640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:4 7.18 7:18000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48c5800 con 0x5595b471b400 2024-09-13T17:53:37.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.938+0000 7fe5a0600640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x5595b471b400 0x5595b3d11080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.938+0000 7fe5a0600640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x5595b471b400 0x5595b3d11080 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.938+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 <== osd.0 v2:172.21.15.114:6808/4163905135 1 ==== osd_op_reply(4 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704b40 con 0x5595b471b400 2024-09-13T17:53:37.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.938+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:5 7.4 7:20000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48c5800 con 0x5595b471b400 2024-09-13T17:53:37.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.938+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 <== osd.0 v2:172.21.15.114:6808/4163905135 2 ==== osd_op_reply(5 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704b40 con 0x5595b471b400 2024-09-13T17:53:37.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.938+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:6 7.14 7:28000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48c5800 con 0x5595b48af000 2024-09-13T17:53:37.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.938+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.3 v2:172.21.15.114:6824/1824187331 2 ==== osd_op_reply(6 [pgnls start_epoch 48 out=77b] v48'1 uv1 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48af000 2024-09-13T17:53:37.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.938+0000 7fe5a1a00640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x5595b48c5800 0x5595b3d11600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.938+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:7 7.c 7:30000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d2a000 con 0x5595b48c5800 2024-09-13T17:53:37.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.938+0000 7fe5a1a00640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x5595b48c5800 0x5595b3d11600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.942+0000 7fe5a1a00640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x5595b48c5800 0x5595b3d11600 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.942+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.6 v2:172.21.15.134:6824/1813072387 1 ==== osd_op_reply(7 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48c5800 2024-09-13T17:53:37.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.942+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:8 7.1c 7:38000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d2a000 con 0x5595b48af400 2024-09-13T17:53:37.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.942+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 <== osd.5 v2:172.21.15.134:6800/3340754489 2 ==== osd_op_reply(8 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704b40 con 0x5595b48af400 2024-09-13T17:53:37.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.942+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:9 7.2 7:40000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d2a000 con 0x5595b48af000 2024-09-13T17:53:37.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.942+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.3 v2:172.21.15.114:6824/1824187331 3 ==== osd_op_reply(9 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48af000 2024-09-13T17:53:37.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.942+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:10 7.12 7:48000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d2a000 con 0x5595b48c5800 2024-09-13T17:53:37.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.942+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.6 v2:172.21.15.134:6824/1813072387 2 ==== osd_op_reply(10 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48c5800 2024-09-13T17:53:37.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.942+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:11 7.a 7:50000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d2a000 con 0x5595b48af000 2024-09-13T17:53:37.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.942+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.3 v2:172.21.15.114:6824/1824187331 4 ==== osd_op_reply(11 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48af000 2024-09-13T17:53:37.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.942+0000 7fe5a1a00640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x5595b3d2a000 0x5595b3d11b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.942+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:12 7.1a 7:58000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d2a400 con 0x5595b3d2a000 2024-09-13T17:53:37.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.942+0000 7fe5a1000640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x5595b3d2a000 0x5595b3d11b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.942+0000 7fe5a1000640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x5595b3d2a000 0x5595b3d11b80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.942+0000 7fe5a1000640 1 -- 172.21.15.114:0/3979521984 <== osd.4 v2:172.21.15.134:6808/3210409298 1 ==== osd_op_reply(12 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704fc0 con 0x5595b3d2a000 2024-09-13T17:53:37.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.942+0000 7fe5a1000640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:13 7.6 7:60000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d2a400 con 0x5595b471b400 2024-09-13T17:53:37.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.942+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 <== osd.0 v2:172.21.15.114:6808/4163905135 3 ==== osd_op_reply(13 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704b40 con 0x5595b471b400 2024-09-13T17:53:37.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.942+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:14 7.16 7:68000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d2a400 con 0x5595b3d2a000 2024-09-13T17:53:37.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.942+0000 7fe5a1000640 1 -- 172.21.15.114:0/3979521984 <== osd.4 v2:172.21.15.134:6808/3210409298 2 ==== osd_op_reply(14 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704fc0 con 0x5595b3d2a000 2024-09-13T17:53:37.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.942+0000 7fe5a1000640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:15 7.e 7:70000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d2a400 con 0x5595b48c4400 2024-09-13T17:53:37.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.942+0000 7fe5a1000640 1 -- 172.21.15.114:0/3979521984 <== osd.2 v2:172.21.15.114:6800/1009667871 2 ==== osd_op_reply(15 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704fc0 con 0x5595b48c4400 2024-09-13T17:53:37.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.942+0000 7fe5a1000640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x5595b3d2a400 0x5595b3d12100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.942+0000 7fe5a1000640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:16 7.1e 7:78000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48c5c00 con 0x5595b3d2a400 2024-09-13T17:53:37.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.942+0000 7fe5a0600640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x5595b3d2a400 0x5595b3d12100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.946+0000 7fe5a0600640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x5595b3d2a400 0x5595b3d12100 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.946+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 <== osd.1 v2:172.21.15.114:6816/2809354915 1 ==== osd_op_reply(16 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704b40 con 0x5595b3d2a400 2024-09-13T17:53:37.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.946+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:17 7.1 7:80000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48c5c00 con 0x5595b3d2a000 2024-09-13T17:53:37.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.946+0000 7fe5a1000640 1 -- 172.21.15.114:0/3979521984 <== osd.4 v2:172.21.15.134:6808/3210409298 3 ==== osd_op_reply(17 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704fc0 con 0x5595b3d2a000 2024-09-13T17:53:37.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.946+0000 7fe5a1000640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x5595b48c5c00 0x5595b3d12680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:37.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.946+0000 7fe5a1000640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:18 7.11 7:88000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d2b000 con 0x5595b48c5c00 2024-09-13T17:53:37.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.946+0000 7fe5a1a00640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x5595b48c5c00 0x5595b3d12680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:37.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.946+0000 7fe5a1a00640 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x5595b48c5c00 0x5595b3d12680 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:37.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.946+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.7 v2:172.21.15.134:6816/874939117 1 ==== osd_op_reply(18 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48c5c00 2024-09-13T17:53:37.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.946+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:19 7.9 7:90000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d2b000 con 0x5595b471b400 2024-09-13T17:53:37.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.946+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 <== osd.0 v2:172.21.15.114:6808/4163905135 4 ==== osd_op_reply(19 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704b40 con 0x5595b471b400 2024-09-13T17:53:37.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.946+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:20 7.19 7:98000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d2b000 con 0x5595b48c5800 2024-09-13T17:53:37.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.946+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.6 v2:172.21.15.134:6824/1813072387 3 ==== osd_op_reply(20 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48c5800 2024-09-13T17:53:37.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.946+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:21 7.5 7:a0000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d2b000 con 0x5595b48c5c00 2024-09-13T17:53:37.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.946+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.7 v2:172.21.15.134:6816/874939117 2 ==== osd_op_reply(21 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48c5c00 2024-09-13T17:53:37.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.946+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:22 7.15 7:a8000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d2b000 con 0x5595b48c5c00 2024-09-13T17:53:37.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.946+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.7 v2:172.21.15.134:6816/874939117 3 ==== osd_op_reply(22 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48c5c00 2024-09-13T17:53:37.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.946+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:23 7.d 7:b0000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d2b000 con 0x5595b48c5800 2024-09-13T17:53:37.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.946+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.6 v2:172.21.15.134:6824/1813072387 4 ==== osd_op_reply(23 [pgnls start_epoch 48 out=74b] v48'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48c5800 2024-09-13T17:53:37.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.946+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:24 7.1d 7:b8000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d2b000 con 0x5595b3d2a400 2024-09-13T17:53:37.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 <== osd.1 v2:172.21.15.114:6816/2809354915 2 ==== osd_op_reply(24 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704b40 con 0x5595b3d2a400 2024-09-13T17:53:37.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:25 7.3 7:c0000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d2b000 con 0x5595b48af000 2024-09-13T17:53:37.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.3 v2:172.21.15.114:6824/1824187331 5 ==== osd_op_reply(25 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48af000 2024-09-13T17:53:37.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:26 7.13 7:c8000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d2b000 con 0x5595b471b400 2024-09-13T17:53:37.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 <== osd.0 v2:172.21.15.114:6808/4163905135 5 ==== osd_op_reply(26 [pgnls start_epoch 48 out=98b] v48'2 uv2 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x5595b4704b40 con 0x5595b471b400 2024-09-13T17:53:37.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:27 7.b 7:d0000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d2b000 con 0x5595b3d2a400 2024-09-13T17:53:37.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 <== osd.1 v2:172.21.15.114:6816/2809354915 3 ==== osd_op_reply(27 [pgnls start_epoch 48 out=76b] v48'1 uv1 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x5595b4704b40 con 0x5595b3d2a400 2024-09-13T17:53:37.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:28 7.1b 7:d8000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d2b000 con 0x5595b471b400 2024-09-13T17:53:37.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 <== osd.0 v2:172.21.15.114:6808/4163905135 6 ==== osd_op_reply(28 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704b40 con 0x5595b471b400 2024-09-13T17:53:37.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:29 7.7 7:e0000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d2b000 con 0x5595b48c5800 2024-09-13T17:53:37.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.6 v2:172.21.15.134:6824/1813072387 5 ==== osd_op_reply(29 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48c5800 2024-09-13T17:53:37.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:30 7.17 7:e8000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d2b000 con 0x5595b48c5c00 2024-09-13T17:53:37.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.7 v2:172.21.15.134:6816/874939117 4 ==== osd_op_reply(30 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48c5c00 2024-09-13T17:53:37.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:31 7.f 7:f0000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d2b000 con 0x5595b471b400 2024-09-13T17:53:37.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 <== osd.0 v2:172.21.15.114:6808/4163905135 7 ==== osd_op_reply(31 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704b40 con 0x5595b471b400 2024-09-13T17:53:37.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:32 7.1f 7:f8000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d2b000 con 0x5595b48c5800 2024-09-13T17:53:37.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.6 v2:172.21.15.134:6824/1813072387 6 ==== osd_op_reply(32 [pgnls start_epoch 48 out=101b] v48'3 uv3 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48c5800 2024-09-13T17:53:37.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a2f058c0 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-09-13T17:53:37.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:33 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b48af000 2024-09-13T17:53:37.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.3 v2:172.21.15.114:6824/1824187331 6 ==== osd_op_reply(33 10000000000.00000000 [omap-get-vals out=509b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+509 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48af000 2024-09-13T17:53:37.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a2f058c0 20 datascan.scan_links: injected ino detected 2024-09-13T17:53:37.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a2f058c0 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-09-13T17:53:37.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a2f058c0 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-09-13T17:53:37.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a2f058c0 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-09-13T17:53:37.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a2f058c0 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-09-13T17:53:37.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a2f058c0 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-09-13T17:53:37.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a2f058c0 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-09-13T17:53:37.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a2f058c0 10 datascan.scan_links: step 1: handling object 100.00000000 2024-09-13T17:53:37.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:34 7.13 7:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48ae800 con 0x5595b471b400 2024-09-13T17:53:37.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 <== osd.0 v2:172.21.15.114:6808/4163905135 8 ==== osd_op_reply(34 100.00000000 [omap-get-vals out=5b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5595b4704b40 con 0x5595b471b400 2024-09-13T17:53:37.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a2f058c0 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-09-13T17:53:37.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a2f058c0 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-09-13T17:53:37.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a2f058c0 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-09-13T17:53:37.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a2f058c0 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-09-13T17:53:37.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a2f058c0 10 datascan.scan_links: step 1: handling object 1.00000000 2024-09-13T17:53:37.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.950+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:35 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48ae400 con 0x5595b48c5800 2024-09-13T17:53:37.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.954+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.6 v2:172.21.15.134:6824/1813072387 7 ==== osd_op_reply(35 1.00000000 [omap-get-vals out=508b] v0'0 uv3 ondisk = 0) v8 ==== 154+0+508 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48c5800 2024-09-13T17:53:37.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.954+0000 7fe5a2f058c0 20 datascan.scan_links: injected ino detected 2024-09-13T17:53:37.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.954+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:36 7.0 7:00000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48ae000 con 0x5595b48af400 2024-09-13T17:53:37.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.954+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 <== osd.5 v2:172.21.15.134:6800/3340754489 3 ==== osd_op_reply(36 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704b40 con 0x5595b48af400 2024-09-13T17:53:37.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.954+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:37 7.10 7:08000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48ae000 con 0x5595b48af000 2024-09-13T17:53:37.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.954+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.3 v2:172.21.15.114:6824/1824187331 7 ==== osd_op_reply(37 [pgnls start_epoch 48 out=81b] v48'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48af000 2024-09-13T17:53:37.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.954+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:38 7.8 7:10000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b48c4400 2024-09-13T17:53:37.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.954+0000 7fe5a1000640 1 -- 172.21.15.114:0/3979521984 <== osd.2 v2:172.21.15.114:6800/1009667871 3 ==== osd_op_reply(38 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704fc0 con 0x5595b48c4400 2024-09-13T17:53:37.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.954+0000 7fe5a1000640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:39 7.18 7:18000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b471b400 2024-09-13T17:53:37.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.954+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 <== osd.0 v2:172.21.15.114:6808/4163905135 9 ==== osd_op_reply(39 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704b40 con 0x5595b471b400 2024-09-13T17:53:37.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.954+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:40 7.4 7:20000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b471b400 2024-09-13T17:53:37.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.954+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 <== osd.0 v2:172.21.15.114:6808/4163905135 10 ==== osd_op_reply(40 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704b40 con 0x5595b471b400 2024-09-13T17:53:37.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.954+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:41 7.14 7:28000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b48af000 2024-09-13T17:53:37.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.954+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.3 v2:172.21.15.114:6824/1824187331 8 ==== osd_op_reply(41 [pgnls start_epoch 48 out=77b] v48'1 uv1 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48af000 2024-09-13T17:53:37.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.954+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:42 7.c 7:30000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b48c5800 2024-09-13T17:53:37.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.954+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.6 v2:172.21.15.134:6824/1813072387 8 ==== osd_op_reply(42 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48c5800 2024-09-13T17:53:37.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.954+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- osd_op(unknown.0.0:43 7.1c 7:38000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b48af400 2024-09-13T17:53:37.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.954+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 <== osd.5 v2:172.21.15.134:6800/3340754489 4 ==== osd_op_reply(43 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704b40 con 0x5595b48af400 2024-09-13T17:53:37.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.954+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:44 7.2 7:40000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b48af000 2024-09-13T17:53:37.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.954+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.3 v2:172.21.15.114:6824/1824187331 9 ==== osd_op_reply(44 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48af000 2024-09-13T17:53:37.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.954+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:45 7.12 7:48000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b48c5800 2024-09-13T17:53:37.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.954+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.6 v2:172.21.15.134:6824/1813072387 9 ==== osd_op_reply(45 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48c5800 2024-09-13T17:53:37.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.954+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:46 7.a 7:50000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b48af000 2024-09-13T17:53:37.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.954+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.3 v2:172.21.15.114:6824/1824187331 10 ==== osd_op_reply(46 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48af000 2024-09-13T17:53:37.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.954+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:47 7.1a 7:58000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b3d2a000 2024-09-13T17:53:37.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.958+0000 7fe5a1000640 1 -- 172.21.15.114:0/3979521984 <== osd.4 v2:172.21.15.134:6808/3210409298 4 ==== osd_op_reply(47 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704fc0 con 0x5595b3d2a000 2024-09-13T17:53:37.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.958+0000 7fe5a1000640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:48 7.6 7:60000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b471b400 2024-09-13T17:53:37.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.958+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 <== osd.0 v2:172.21.15.114:6808/4163905135 11 ==== osd_op_reply(48 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704b40 con 0x5595b471b400 2024-09-13T17:53:37.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.958+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:49 7.16 7:68000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b3d2a000 2024-09-13T17:53:37.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.958+0000 7fe5a1000640 1 -- 172.21.15.114:0/3979521984 <== osd.4 v2:172.21.15.134:6808/3210409298 5 ==== osd_op_reply(49 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704fc0 con 0x5595b3d2a000 2024-09-13T17:53:37.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.958+0000 7fe5a1000640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- osd_op(unknown.0.0:50 7.e 7:70000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b48c4400 2024-09-13T17:53:37.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.958+0000 7fe5a1000640 1 -- 172.21.15.114:0/3979521984 <== osd.2 v2:172.21.15.114:6800/1009667871 4 ==== osd_op_reply(50 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704fc0 con 0x5595b48c4400 2024-09-13T17:53:37.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.958+0000 7fe5a1000640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:51 7.1e 7:78000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b3d2a400 2024-09-13T17:53:37.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.958+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 <== osd.1 v2:172.21.15.114:6816/2809354915 4 ==== osd_op_reply(51 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704b40 con 0x5595b3d2a400 2024-09-13T17:53:37.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.958+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:52 7.1 7:80000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b3d2a000 2024-09-13T17:53:37.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.958+0000 7fe5a1000640 1 -- 172.21.15.114:0/3979521984 <== osd.4 v2:172.21.15.134:6808/3210409298 6 ==== osd_op_reply(52 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704fc0 con 0x5595b3d2a000 2024-09-13T17:53:37.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.958+0000 7fe5a1000640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:53 7.11 7:88000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b48c5c00 2024-09-13T17:53:37.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.958+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.7 v2:172.21.15.134:6816/874939117 5 ==== osd_op_reply(53 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48c5c00 2024-09-13T17:53:37.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.958+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:54 7.9 7:90000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b471b400 2024-09-13T17:53:37.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.958+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 <== osd.0 v2:172.21.15.114:6808/4163905135 12 ==== osd_op_reply(54 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704b40 con 0x5595b471b400 2024-09-13T17:53:37.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.958+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:55 7.19 7:98000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b48c5800 2024-09-13T17:53:37.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.958+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.6 v2:172.21.15.134:6824/1813072387 10 ==== osd_op_reply(55 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48c5800 2024-09-13T17:53:37.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.958+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:56 7.5 7:a0000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b48c5c00 2024-09-13T17:53:37.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.958+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.7 v2:172.21.15.134:6816/874939117 6 ==== osd_op_reply(56 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48c5c00 2024-09-13T17:53:37.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.958+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:57 7.15 7:a8000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b48c5c00 2024-09-13T17:53:37.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.958+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.7 v2:172.21.15.134:6816/874939117 7 ==== osd_op_reply(57 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48c5c00 2024-09-13T17:53:37.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.958+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:58 7.d 7:b0000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b48c5800 2024-09-13T17:53:37.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.6 v2:172.21.15.134:6824/1813072387 11 ==== osd_op_reply(58 [pgnls start_epoch 48 out=74b] v48'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48c5800 2024-09-13T17:53:37.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:59 7.1d 7:b8000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b3d2a400 2024-09-13T17:53:37.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 <== osd.1 v2:172.21.15.114:6816/2809354915 5 ==== osd_op_reply(59 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704b40 con 0x5595b3d2a400 2024-09-13T17:53:37.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:60 7.3 7:c0000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b48af000 2024-09-13T17:53:37.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.3 v2:172.21.15.114:6824/1824187331 11 ==== osd_op_reply(60 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48af000 2024-09-13T17:53:37.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:61 7.13 7:c8000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b471b400 2024-09-13T17:53:37.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 <== osd.0 v2:172.21.15.114:6808/4163905135 13 ==== osd_op_reply(61 [pgnls start_epoch 48 out=98b] v48'2 uv2 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x5595b4704b40 con 0x5595b471b400 2024-09-13T17:53:37.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:62 7.b 7:d0000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b3d2a400 2024-09-13T17:53:37.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 <== osd.1 v2:172.21.15.114:6816/2809354915 6 ==== osd_op_reply(62 [pgnls start_epoch 48 out=76b] v48'1 uv1 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x5595b4704b40 con 0x5595b3d2a400 2024-09-13T17:53:37.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:63 7.1b 7:d8000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b471b400 2024-09-13T17:53:37.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 <== osd.0 v2:172.21.15.114:6808/4163905135 14 ==== osd_op_reply(63 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704b40 con 0x5595b471b400 2024-09-13T17:53:37.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:64 7.7 7:e0000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b48c5800 2024-09-13T17:53:37.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.6 v2:172.21.15.134:6824/1813072387 12 ==== osd_op_reply(64 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48c5800 2024-09-13T17:53:37.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- osd_op(unknown.0.0:65 7.17 7:e8000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b48c5c00 2024-09-13T17:53:37.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.7 v2:172.21.15.134:6816/874939117 8 ==== osd_op_reply(65 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48c5c00 2024-09-13T17:53:37.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:66 7.f 7:f0000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b471b400 2024-09-13T17:53:37.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 <== osd.0 v2:172.21.15.114:6808/4163905135 15 ==== osd_op_reply(66 [pgnls start_epoch 48 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5595b4704b40 con 0x5595b471b400 2024-09-13T17:53:37.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:67 7.1f 7:f8000000::::head [pgnls start_epoch 48 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b48aec00 con 0x5595b48c5800 2024-09-13T17:53:37.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.6 v2:172.21.15.134:6824/1813072387 13 ==== osd_op_reply(67 [pgnls start_epoch 48 out=101b] v48'3 uv3 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48c5800 2024-09-13T17:53:37.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a2f058c0 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-09-13T17:53:37.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:68 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d42000 con 0x5595b48af000 2024-09-13T17:53:37.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.3 v2:172.21.15.114:6824/1824187331 12 ==== osd_op_reply(68 10000000000.00000000 [omap-get-vals out=509b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+509 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48af000 2024-09-13T17:53:37.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a2f058c0 20 datascan.scan_links: injected ino detected 2024-09-13T17:53:37.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a2f058c0 20 datascan.scan_links: adding 0x10000000001 for future processing to fix dnfirst 2024-09-13T17:53:37.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a2f058c0 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-09-13T17:53:37.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a2f058c0 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-09-13T17:53:37.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a2f058c0 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-09-13T17:53:37.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a2f058c0 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-09-13T17:53:37.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a2f058c0 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-09-13T17:53:37.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a2f058c0 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-09-13T17:53:37.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a2f058c0 10 datascan.scan_links: step 2: handling object 100.00000000 2024-09-13T17:53:37.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.962+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:69 7.13 7:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d42400 con 0x5595b471b400 2024-09-13T17:53:37.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 <== osd.0 v2:172.21.15.114:6808/4163905135 16 ==== osd_op_reply(69 100.00000000 [omap-get-vals out=5b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5595b4704b40 con 0x5595b471b400 2024-09-13T17:53:37.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a2f058c0 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-09-13T17:53:37.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a2f058c0 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-09-13T17:53:37.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a2f058c0 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-09-13T17:53:37.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a2f058c0 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-09-13T17:53:37.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a2f058c0 10 datascan.scan_links: step 2: handling object 1.00000000 2024-09-13T17:53:37.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:70 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d42800 con 0x5595b48c5800 2024-09-13T17:53:37.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.6 v2:172.21.15.134:6824/1813072387 14 ==== osd_op_reply(70 1.00000000 [omap-get-vals out=508b] v0'0 uv3 ondisk = 0) v8 ==== 154+0+508 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48c5800 2024-09-13T17:53:37.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a2f058c0 20 datascan.scan_links: injected ino detected 2024-09-13T17:53:37.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a2f058c0 20 datascan.scan_links: adding 0x10000000000 for future processing to fix dnfirst 2024-09-13T17:53:37.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a2f058c0 10 datascan.scan_links: processing 0 dup_primaries, 0 remote_links 2024-09-13T17:53:37.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a2f058c0 10 datascan.scan_links: removing dup dentries from 0 objects 2024-09-13T17:53:37.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a2f058c0 10 datascan.scan_links: processing 0 bad_nlink_inos 2024-09-13T17:53:37.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a2f058c0 10 datascan.scan_links: processing 2 injected_inos 2024-09-13T17:53:37.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a2f058c0 10 datascan.scan_links: handling injected_ino 0x10000000000 2024-09-13T17:53:37.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a2f058c0 20 datascan.scan_links: fixing linkage (dnfirst) of 0x1:subdir 2024-09-13T17:53:37.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:71 7.1f 7:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d42c00 con 0x5595b48c5800 2024-09-13T17:53:37.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.6 v2:172.21.15.134:6824/1813072387 15 ==== osd_op_reply(71 1.00000000 [omap-get-vals-by-keys out=507b] v0'0 uv3 ondisk = 0) v8 ==== 154+0+507 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48c5800 2024-09-13T17:53:37.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a2f058c0 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2024-09-13T17:53:37.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a2f058c0 20 datascan.scan_links: first is now 2 2024-09-13T17:53:37.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:72 7.1f 7:ff5b34d6:::1.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d43000 con 0x5595b48c5800 2024-09-13T17:53:37.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.6 v2:172.21.15.134:6824/1813072387 16 ==== osd_op_reply(72 1.00000000 [omap-set-vals] v48'4 uv4 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48c5800 2024-09-13T17:53:37.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a2f058c0 20 datascan.inject_linkage: Injected dentry 0x0x1/subdir pointing to 0x0x10000000000 2024-09-13T17:53:37.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a2f058c0 10 datascan.scan_links: handling injected_ino 0x10000000001 2024-09-13T17:53:37.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a2f058c0 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:sixmegs 2024-09-13T17:53:37.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:73 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d43400 con 0x5595b48af000 2024-09-13T17:53:37.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.3 v2:172.21.15.114:6824/1824187331 13 ==== osd_op_reply(73 10000000000.00000000 [omap-get-vals-by-keys out=508b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+508 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48af000 2024-09-13T17:53:37.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a2f058c0 20 datascan.read_dentry: oid=10000000000.00000000 dname=sixmegs frag=*, r=0 2024-09-13T17:53:37.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a2f058c0 20 datascan.scan_links: first is now 2 2024-09-13T17:53:37.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.966+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:74 7.10 7:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=508b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d43800 con 0x5595b48af000 2024-09-13T17:53:37.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.3 v2:172.21.15.114:6824/1824187331 14 ==== osd_op_reply(74 10000000000.00000000 [omap-set-vals] v48'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48af000 2024-09-13T17:53:37.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/sixmegs pointing to 0x0x10000000001 2024-09-13T17:53:37.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 10 datascan.scan_links: updating inotable 2024-09-13T17:53:37.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:75 7.13 7:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d43c00 con 0x5595b471b400 2024-09-13T17:53:37.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 <== osd.0 v2:172.21.15.114:6808/4163905135 17 ==== osd_op_reply(75 mds0_inotable [read 0~34 out=34b] v0'0 uv2 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x5595b4704b40 con 0x5595b471b400 2024-09-13T17:53:37.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 10 mds.0.inotable: skip_inos was [0x10000000000~0x10000000000] 2024-09-13T17:53:37.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 10 mds.0.inotable: skip_inos now [0x10000000002~0xfffffffffe] 2024-09-13T17:53:37.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:76 7.13 7:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d42000 con 0x5595b471b400 2024-09-13T17:53:37.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a0600640 1 -- 172.21.15.114:0/3979521984 <== osd.0 v2:172.21.15.114:6808/4163905135 18 ==== osd_op_reply(76 mds0_inotable [writefull 0~34] v48'3 uv3 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x5595b4704b40 con 0x5595b471b400 2024-09-13T17:53:37.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 10 datascan.scan_links: updating snaptable 2024-09-13T17:53:37.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:77 7.d 7:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x5595b3d42800 con 0x5595b48c5800 2024-09-13T17:53:37.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a1a00640 1 -- 172.21.15.114:0/3979521984 <== osd.6 v2:172.21.15.134:6824/1813072387 17 ==== osd_op_reply(77 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x5595b4704d80 con 0x5595b48c5800 2024-09-13T17:53:37.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x5595b471b400 msgr2=0x5595b3d11080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x5595b471b400 0x5595b3d11080 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x5595b3d2a400 msgr2=0x5595b3d12100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x5595b3d2a400 0x5595b3d12100 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x5595b48c4400 msgr2=0x5595b3d10b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x5595b48c4400 0x5595b3d10b00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x5595b48af000 msgr2=0x5595b3d10580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x5595b48af000 0x5595b3d10580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x5595b3d2a000 msgr2=0x5595b3d11b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x5595b3d2a000 0x5595b3d11b80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x5595b48af400 msgr2=0x5595b39c8680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x5595b48af400 0x5595b39c8680 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x5595b48c5800 msgr2=0x5595b3d11600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a1000640 1 -- 172.21.15.114:0/3979521984 reap_dead start 2024-09-13T17:53:37.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x5595b48c5800 0x5595b3d11600 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x5595b48c5c00 msgr2=0x5595b3d12680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x5595b48c5c00 0x5595b3d12680 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a1000640 1 -- 172.21.15.114:0/3979521984 reap_dead start 2024-09-13T17:53:37.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a1000640 1 -- 172.21.15.114:0/3979521984 reap_dead start 2024-09-13T17:53:37.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a1000640 1 -- 172.21.15.114:0/3979521984 reap_dead start 2024-09-13T17:53:37.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x5595b48c5400 msgr2=0x5595b3d10000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x5595b48c5400 0x5595b3d10000 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x5595b4795a70 tx=0x5595b47082a0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595b471b800 msgr2=0x5595b39c6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595b471b800 0x5595b39c6580 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x5595b47179b0 tx=0x5595b4858d20 comp rx=0 tx=0).stop 2024-09-13T17:53:37.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 shutdown_connections 2024-09-13T17:53:37.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x5595b48c5400 0x5595b3d10000 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 --2- 172.21.15.114:0/3979521984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595b471b800 0x5595b39c6580 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 >> 172.21.15.114:0/3979521984 conn(0x5595b393ac00 msgr2=0x5595b3967800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:37.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 shutdown_connections 2024-09-13T17:53:37.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.970+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/3979521984 wait complete. 2024-09-13T17:53:37.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.974+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/2837257800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595b393b000 msgr2=0x5595b39c7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:37.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.974+0000 7fe5a2f058c0 1 --2- 172.21.15.114:0/2837257800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595b393b000 0x5595b39c7080 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x5595b4795020 tx=0x5595b4708000 comp rx=0 tx=0).stop 2024-09-13T17:53:37.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.974+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/2837257800 shutdown_connections 2024-09-13T17:53:37.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.974+0000 7fe5a2f058c0 1 --2- 172.21.15.114:0/2837257800 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x5595b393b000 0x5595b39c7080 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.974+0000 7fe5a2f058c0 1 --2- 172.21.15.114:0/2837257800 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x5595b393b400 0x5595b39c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.974+0000 7fe5a2f058c0 1 --2- 172.21.15.114:0/2837257800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5595b393b800 0x5595b39c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:37.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.974+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/2837257800 >> 172.21.15.114:0/2837257800 conn(0x5595b393bc00 msgr2=0x5595b3967000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:37.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.974+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/2837257800 shutdown_connections 2024-09-13T17:53:37.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:37.974+0000 7fe5a2f058c0 1 -- 172.21.15.114:0/2837257800 wait complete. 2024-09-13T17:53:37.983 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links', '--filesystem', 'recovery_fs'] in time 0:00:00.095363, result: 2024-09-13T17:53:37.983 DEBUG:teuthology.orchestra.run.smithi114:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank recovery_fs:0 event recover_dentries list --alternate-pool recovery_fs_metadata 2024-09-13T17:53:38.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.066+0000 7f892a64a400 1 -- start start 2024-09-13T17:53:38.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.066+0000 7f892a64a400 1 Processor -- start 2024-09-13T17:53:38.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f892a64a400 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2df845800 0x55b2df8d0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f892a64a400 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55b2df845400 0x55b2df8d0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f892a64a400 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2df845000 0x55b2df8d1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f892a64a400 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2df912a00 con 0x55b2df845000 2024-09-13T17:53:38.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f892a64a400 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2df912780 con 0x55b2df845800 2024-09-13T17:53:38.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f892a64a400 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2df912640 con 0x55b2df845400 2024-09-13T17:53:38.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f8929200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2df845000 0x55b2df8d1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f8928800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2df845800 0x55b2df8d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f8928800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2df845800 0x55b2df8d0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:44030/0 (socket says 172.21.15.114:44030) 2024-09-13T17:53:38.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f8928800640 1 -- 172.21.15.114:0/3491680086 learned_addr learned my addr 172.21.15.114:0/3491680086 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:38.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f8929200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2df845000 0x55b2df8d1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44070/0 (socket says 172.21.15.114:44070) 2024-09-13T17:53:38.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f8927e00640 1 --2- 172.21.15.114:0/3491680086 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55b2df845400 0x55b2df8d0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f8929200640 1 -- 172.21.15.114:0/3491680086 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55b2df845400 msgr2=0x55b2df8d0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:38.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f8929200640 1 --2- 172.21.15.114:0/3491680086 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55b2df845400 0x55b2df8d0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f8929200640 1 -- 172.21.15.114:0/3491680086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2df845800 msgr2=0x55b2df8d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:38.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f8929200640 1 --2- 172.21.15.114:0/3491680086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2df845800 0x55b2df8d0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f8929200640 1 -- 172.21.15.114:0/3491680086 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2df87c9c0 con 0x55b2df845000 2024-09-13T17:53:38.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f8927e00640 1 --2- 172.21.15.114:0/3491680086 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55b2df845400 0x55b2df8d0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:38.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f8929200640 1 --2- 172.21.15.114:0/3491680086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2df845000 0x55b2df8d1080 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x55b2e06b8900 tx=0x55b2e0616000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99593f57ff38c047 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:38.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f8925600640 1 -- 172.21.15.114:0/3491680086 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b2df899080 con 0x55b2df845000 2024-09-13T17:53:38.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f8925600640 1 -- 172.21.15.114:0/3491680086 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b2e062c300 con 0x55b2df845000 2024-09-13T17:53:38.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f8925600640 1 -- 172.21.15.114:0/3491680086 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b2df899600 con 0x55b2df845000 2024-09-13T17:53:38.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f892a64a400 1 -- 172.21.15.114:0/3491680086 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b2df87c1a0 con 0x55b2df845000 2024-09-13T17:53:38.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f892a64a400 1 -- 172.21.15.114:0/3491680086 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55b2df87c9c0 con 0x55b2df845000 2024-09-13T17:53:38.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f892a64a400 4 waiting for MDS map... 2024-09-13T17:53:38.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f8925600640 1 -- 172.21.15.114:0/3491680086 <== mon.0 v2:172.21.15.114:3300/0 4 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x55b2df886c40 con 0x55b2df845000 2024-09-13T17:53:38.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f8925600640 1 -- 172.21.15.114:0/3491680086 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 23) v1 ==== 3691+0+0 (secure 0 0 0) 0x55b2df892f00 con 0x55b2df845000 2024-09-13T17:53:38.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f892a64a400 4 Got MDS map 23 2024-09-13T17:53:38.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f892a64a400 10 main: JournalTool::main 2024-09-13T17:53:38.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f892a64a400 4 main: JournalTool: connecting to RADOS... 2024-09-13T17:53:38.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f892a64a400 1 Processor -- start 2024-09-13T17:53:38.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f892a64a400 1 -- start start 2024-09-13T17:53:38.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f892a64a400 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2e062f800 0x55b2df8d1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f892a64a400 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e062fc00 0x55b2df8d1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f892a64a400 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55b2e07a8000 0x55b2df8d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f892a64a400 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2df88be00 con 0x55b2e062fc00 2024-09-13T17:53:38.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f892a64a400 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2df912780 con 0x55b2e062f800 2024-09-13T17:53:38.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f892a64a400 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2df912a00 con 0x55b2e07a8000 2024-09-13T17:53:38.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f8928800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e062fc00 0x55b2df8d1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f8928800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e062fc00 0x55b2df8d1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44086/0 (socket says 172.21.15.114:44086) 2024-09-13T17:53:38.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f8928800640 1 -- 172.21.15.114:0/155376420 learned_addr learned my addr 172.21.15.114:0/155376420 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:38.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.070+0000 7f8927e00640 1 --2- 172.21.15.114:0/155376420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2e062f800 0x55b2df8d1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f8927e00640 1 --2- 172.21.15.114:0/155376420 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55b2e07a8000 0x55b2df8d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f8928800640 1 -- 172.21.15.114:0/155376420 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55b2e07a8000 msgr2=0x55b2df8d2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:38.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f8928800640 1 --2- 172.21.15.114:0/155376420 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55b2e07a8000 0x55b2df8d2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f8928800640 1 -- 172.21.15.114:0/155376420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2e062f800 msgr2=0x55b2df8d1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:38.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f8928800640 1 --2- 172.21.15.114:0/155376420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2e062f800 0x55b2df8d1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f8928800640 1 -- 172.21.15.114:0/155376420 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2df87cb60 con 0x55b2e062fc00 2024-09-13T17:53:38.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f8927e00640 1 --2- 172.21.15.114:0/155376420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2e062f800 0x55b2df8d1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:38.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f8928800640 1 --2- 172.21.15.114:0/155376420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e062fc00 0x55b2df8d1b80 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x55b2e07ae180 tx=0x55b2e0750d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f5557861a9123d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:38.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f8922e00640 1 -- 172.21.15.114:0/155376420 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b2df899080 con 0x55b2e062fc00 2024-09-13T17:53:38.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f8922e00640 1 -- 172.21.15.114:0/155376420 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b2e062ca80 con 0x55b2e062fc00 2024-09-13T17:53:38.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f8922e00640 1 -- 172.21.15.114:0/155376420 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b2df899600 con 0x55b2e062fc00 2024-09-13T17:53:38.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f892a64a400 1 -- 172.21.15.114:0/155376420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e062fc00 msgr2=0x55b2df8d1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:38.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f892a64a400 1 --2- 172.21.15.114:0/155376420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e062fc00 0x55b2df8d1b80 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x55b2e07ae180 tx=0x55b2e0750d20 comp rx=0 tx=0).stop 2024-09-13T17:53:38.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f892a64a400 1 -- 172.21.15.114:0/155376420 shutdown_connections 2024-09-13T17:53:38.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f892a64a400 1 --2- 172.21.15.114:0/155376420 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55b2e07a8000 0x55b2df8d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f892a64a400 1 --2- 172.21.15.114:0/155376420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e062fc00 0x55b2df8d1b80 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f892a64a400 1 --2- 172.21.15.114:0/155376420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2e062f800 0x55b2df8d1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f892a64a400 1 -- 172.21.15.114:0/155376420 >> 172.21.15.114:0/155376420 conn(0x55b2df844c00 msgr2=0x55b2df873800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:38.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f892a64a400 1 -- 172.21.15.114:0/155376420 shutdown_connections 2024-09-13T17:53:38.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f892a64a400 1 -- 172.21.15.114:0/155376420 wait complete. 2024-09-13T17:53:38.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f892a64a400 1 Processor -- start 2024-09-13T17:53:38.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f892a64a400 1 -- start start 2024-09-13T17:53:38.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f892a64a400 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2e062fc00 0x55b2df8d3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f892a64a400 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55b2e062f800 0x55b2df8d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f892a64a400 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e07a9800 0x55b2df8d2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f892a64a400 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2df912500 con 0x55b2e07a9800 2024-09-13T17:53:38.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f892a64a400 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2df9123c0 con 0x55b2e062fc00 2024-09-13T17:53:38.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f892a64a400 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2df912280 con 0x55b2e062f800 2024-09-13T17:53:38.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f8927e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e07a9800 0x55b2df8d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f8927e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e07a9800 0x55b2df8d2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44088/0 (socket says 172.21.15.114:44088) 2024-09-13T17:53:38.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f8927e00640 1 -- 172.21.15.114:0/2448143141 learned_addr learned my addr 172.21.15.114:0/2448143141 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:38.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f8928800640 1 --2- 172.21.15.114:0/2448143141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55b2e062f800 0x55b2df8d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f8927e00640 1 --2- 172.21.15.114:0/2448143141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2e062fc00 0x55b2df8d3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f8927e00640 1 -- 172.21.15.114:0/2448143141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55b2e062f800 msgr2=0x55b2df8d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:38.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f8927e00640 1 --2- 172.21.15.114:0/2448143141 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55b2e062f800 0x55b2df8d2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f8927e00640 1 -- 172.21.15.114:0/2448143141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2e062fc00 msgr2=0x55b2df8d3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:38.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f8927e00640 1 --2- 172.21.15.114:0/2448143141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2e062fc00 0x55b2df8d3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f8927e00640 1 -- 172.21.15.114:0/2448143141 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2df87c340 con 0x55b2e07a9800 2024-09-13T17:53:38.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f8927e00640 1 --2- 172.21.15.114:0/2448143141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e07a9800 0x55b2df8d2680 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x55b2e07af4d0 tx=0x55b2e0750c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:38.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f8921000640 1 -- 172.21.15.114:0/2448143141 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b2df899080 con 0x55b2e07a9800 2024-09-13T17:53:38.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f8921000640 1 -- 172.21.15.114:0/2448143141 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b2df8a2180 con 0x55b2e07a9800 2024-09-13T17:53:38.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f8921000640 1 -- 172.21.15.114:0/2448143141 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b2df899600 con 0x55b2e07a9800 2024-09-13T17:53:38.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f892a64a400 1 -- 172.21.15.114:0/2448143141 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b2df87c000 con 0x55b2e07a9800 2024-09-13T17:53:38.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.074+0000 7f892a64a400 1 -- 172.21.15.114:0/2448143141 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b2df87cea0 con 0x55b2e07a9800 2024-09-13T17:53:38.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.078+0000 7f892a64a400 4 main: JournalTool: resolving pool 7 2024-09-13T17:53:38.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.078+0000 7f8921000640 1 -- 172.21.15.114:0/2448143141 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x55b2df910840 con 0x55b2e07a9800 2024-09-13T17:53:38.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.078+0000 7f8921000640 1 --2- 172.21.15.114:0/2448143141 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x55b2e07c7400 0x55b2df8d3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.078+0000 7f8921000640 1 -- 172.21.15.114:0/2448143141 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x55b2df886a80 con 0x55b2e07a9800 2024-09-13T17:53:38.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.078+0000 7f892a64a400 4 main: JournalTool: creating IoCtx.. 2024-09-13T17:53:38.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.078+0000 7f892a64a400 4 main: Executing for rank 0 2024-09-13T17:53:38.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.078+0000 7f892a64a400 1 main_event: Using alternate pool recovery_fs_metadata 2024-09-13T17:53:38.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.078+0000 7f892a64a400 1 --2- 172.21.15.114:0/2448143141 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x55b2e07a9400 0x55b2df8d2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.078+0000 7f892a64a400 1 -- 172.21.15.114:0/2448143141 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) v8 -- 0x55b2e07a9000 con 0x55b2e07a9400 2024-09-13T17:53:38.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.078+0000 7f8928800640 1 --2- 172.21.15.114:0/2448143141 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x55b2e07c7400 0x55b2df8d3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.078+0000 7f8927e00640 1 --2- 172.21.15.114:0/2448143141 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x55b2e07a9400 0x55b2df8d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.078+0000 7f8928800640 1 --2- 172.21.15.114:0/2448143141 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x55b2e07c7400 0x55b2df8d3700 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x55b2e07ae180 tx=0x55b2e0616060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:38.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.078+0000 7f8927e00640 1 --2- 172.21.15.114:0/2448143141 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x55b2e07a9400 0x55b2df8d2100 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:38.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.078+0000 7f8927e00640 1 -- 172.21.15.114:0/2448143141 <== osd.0 v2:172.21.15.114:6808/4163905135 1 ==== osd_op_reply(1 400.00000000 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55b2e059cb40 con 0x55b2e07a9400 2024-09-13T17:53:38.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.078+0000 7f892a64a400 -1 Pointer 400.00000000 is absent 2024-09-13T17:53:38.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.078+0000 7f892a64a400 4 main_event: consumed 0 inodes 2024-09-13T17:53:38.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.078+0000 7f892a64a400 1 --2- 172.21.15.114:0/2448143141 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x55b2e07a8c00 0x55b2df8d1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.078+0000 7f892a64a400 1 -- 172.21.15.114:0/2448143141 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:2 7.3 7:c0ce80d4:::4.00000000:head [omap-rm-keys in=4b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) v8 -- 0x55b2e07a8800 con 0x55b2e07a8c00 2024-09-13T17:53:38.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.078+0000 7f8929200640 1 --2- 172.21.15.114:0/2448143141 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x55b2e07a8c00 0x55b2df8d1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.078+0000 7f8929200640 1 --2- 172.21.15.114:0/2448143141 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x55b2e07a8c00 0x55b2df8d1b80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:38.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.082+0000 7f8929200640 1 -- 172.21.15.114:0/2448143141 <== osd.3 v2:172.21.15.114:6824/1824187331 1 ==== osd_op_reply(2 4.00000000 [omap-rm-keys] v48'1 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x55b2e059d200 con 0x55b2e07a8c00 2024-09-13T17:53:38.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.082+0000 7f892a64a400 4 0 events 2024-09-13T17:53:38.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.082+0000 7f892a64a400 1 -- 172.21.15.114:0/2448143141 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x55b2e07a9400 msgr2=0x55b2df8d2100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:38.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.082+0000 7f892a64a400 1 --2- 172.21.15.114:0/2448143141 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x55b2e07a9400 0x55b2df8d2100 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.082+0000 7f892a64a400 1 -- 172.21.15.114:0/2448143141 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x55b2e07a8c00 msgr2=0x55b2df8d1b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:38.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.082+0000 7f892a64a400 1 --2- 172.21.15.114:0/2448143141 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x55b2e07a8c00 0x55b2df8d1b80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.082+0000 7f892a64a400 1 -- 172.21.15.114:0/2448143141 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x55b2e07c7400 msgr2=0x55b2df8d3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:38.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.082+0000 7f892a64a400 1 --2- 172.21.15.114:0/2448143141 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x55b2e07c7400 0x55b2df8d3700 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x55b2e07ae180 tx=0x55b2e0616060 comp rx=0 tx=0).stop 2024-09-13T17:53:38.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.082+0000 7f892a64a400 1 -- 172.21.15.114:0/2448143141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e07a9800 msgr2=0x55b2df8d2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:38.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.082+0000 7f892a64a400 1 --2- 172.21.15.114:0/2448143141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e07a9800 0x55b2df8d2680 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x55b2e07af4d0 tx=0x55b2e0750c00 comp rx=0 tx=0).stop 2024-09-13T17:53:38.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.082+0000 7f8928800640 1 -- 172.21.15.114:0/2448143141 reap_dead start 2024-09-13T17:53:38.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.082+0000 7f892a64a400 1 -- 172.21.15.114:0/2448143141 shutdown_connections 2024-09-13T17:53:38.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.082+0000 7f892a64a400 1 --2- 172.21.15.114:0/2448143141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2e07a9800 0x55b2df8d2680 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.082+0000 7f892a64a400 1 -- 172.21.15.114:0/2448143141 >> 172.21.15.114:0/2448143141 conn(0x55b2df844c00 msgr2=0x55b2df873800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:38.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.082+0000 7f892a64a400 1 -- 172.21.15.114:0/2448143141 shutdown_connections 2024-09-13T17:53:38.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.082+0000 7f892a64a400 1 -- 172.21.15.114:0/2448143141 wait complete. 2024-09-13T17:53:38.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.082+0000 7f892a64a400 1 -- 172.21.15.114:0/3491680086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2df845000 msgr2=0x55b2df8d1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:38.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.082+0000 7f892a64a400 1 --2- 172.21.15.114:0/3491680086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2df845000 0x55b2df8d1080 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x55b2e06b8900 tx=0x55b2e0616000 comp rx=0 tx=0).stop 2024-09-13T17:53:38.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.082+0000 7f892a64a400 1 -- 172.21.15.114:0/3491680086 shutdown_connections 2024-09-13T17:53:38.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.082+0000 7f892a64a400 1 --2- 172.21.15.114:0/3491680086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55b2df845000 0x55b2df8d1080 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.082+0000 7f892a64a400 1 --2- 172.21.15.114:0/3491680086 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55b2df845400 0x55b2df8d0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.082+0000 7f892a64a400 1 --2- 172.21.15.114:0/3491680086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b2df845800 0x55b2df8d0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.082+0000 7f892a64a400 1 -- 172.21.15.114:0/3491680086 >> 172.21.15.114:0/3491680086 conn(0x55b2df845c00 msgr2=0x55b2df873000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:38.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.082+0000 7f892a64a400 1 -- 172.21.15.114:0/3491680086 shutdown_connections 2024-09-13T17:53:38.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.082+0000 7f892a64a400 1 -- 172.21.15.114:0/3491680086 wait complete. 2024-09-13T17:53:38.093 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'recovery_fs:0', 'event', 'recover_dentries', 'list', '--alternate-pool', 'recovery_fs_metadata'] in time 0:00:00.110475, result: 2024-09-13T17:53:38.094 DEBUG:teuthology.orchestra.run.smithi114:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank recovery_fs:0 journal reset --force --yes-i-really-really-mean-it 2024-09-13T17:53:38.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.178+0000 7f1eb5623400 1 -- start start 2024-09-13T17:53:38.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.178+0000 7f1eb5623400 1 Processor -- start 2024-09-13T17:53:38.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.178+0000 7f1eb5623400 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a59669800 0x562a596f4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.178+0000 7f1eb5623400 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a59669400 0x562a596f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.178+0000 7f1eb5623400 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562a59669000 0x562a596f5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.178+0000 7f1eb5623400 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a596afe00 con 0x562a59669400 2024-09-13T17:53:38.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.178+0000 7f1eb5623400 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a59736a00 con 0x562a59669800 2024-09-13T17:53:38.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.178+0000 7f1eb5623400 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a59736640 con 0x562a59669000 2024-09-13T17:53:38.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb2c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a59669400 0x562a596f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb2c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a59669400 0x562a596f4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44102/0 (socket says 172.21.15.114:44102) 2024-09-13T17:53:38.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb2c00640 1 -- 172.21.15.114:0/329955780 learned_addr learned my addr 172.21.15.114:0/329955780 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:38.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb4000640 1 --2- 172.21.15.114:0/329955780 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562a59669000 0x562a596f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb3600640 1 --2- 172.21.15.114:0/329955780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a59669800 0x562a596f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb2c00640 1 -- 172.21.15.114:0/329955780 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562a59669000 msgr2=0x562a596f5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:38.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb2c00640 1 --2- 172.21.15.114:0/329955780 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562a59669000 0x562a596f5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb2c00640 1 -- 172.21.15.114:0/329955780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a59669800 msgr2=0x562a596f4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:38.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb2c00640 1 --2- 172.21.15.114:0/329955780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a59669800 0x562a596f4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb2c00640 1 -- 172.21.15.114:0/329955780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a596a09c0 con 0x562a59669400 2024-09-13T17:53:38.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb2c00640 1 --2- 172.21.15.114:0/329955780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a59669400 0x562a596f4b00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x562a5a4cd2f0 tx=0x562a5a432480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c26bad134ef9b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:38.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb0400640 1 -- 172.21.15.114:0/329955780 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562a596bd600 con 0x562a59669400 2024-09-13T17:53:38.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb0400640 1 -- 172.21.15.114:0/329955780 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562a5a43ca80 con 0x562a59669400 2024-09-13T17:53:38.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb0400640 1 -- 172.21.15.114:0/329955780 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562a596bd1e0 con 0x562a59669400 2024-09-13T17:53:38.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb5623400 1 -- 172.21.15.114:0/329955780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a596a0b60 con 0x562a59669400 2024-09-13T17:53:38.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb5623400 1 -- 172.21.15.114:0/329955780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x562a596a0340 con 0x562a59669400 2024-09-13T17:53:38.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb5623400 4 waiting for MDS map... 2024-09-13T17:53:38.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb0400640 1 -- 172.21.15.114:0/329955780 <== mon.0 v2:172.21.15.114:3300/0 4 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x562a596aac40 con 0x562a59669400 2024-09-13T17:53:38.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb0400640 1 -- 172.21.15.114:0/329955780 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 23) v1 ==== 3691+0+0 (secure 0 0 0) 0x562a596b6f00 con 0x562a59669400 2024-09-13T17:53:38.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb5623400 4 Got MDS map 23 2024-09-13T17:53:38.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb5623400 10 main: JournalTool::main 2024-09-13T17:53:38.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb5623400 4 main: JournalTool: connecting to RADOS... 2024-09-13T17:53:38.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb5623400 1 Processor -- start 2024-09-13T17:53:38.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb5623400 1 -- start start 2024-09-13T17:53:38.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb5623400 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a5a572c00 0x562a596f5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb5623400 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562a5a573000 0x562a596f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb5623400 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a5a573400 0x562a596f6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb5623400 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a59736500 con 0x562a5a572c00 2024-09-13T17:53:38.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb5623400 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a597363c0 con 0x562a5a573400 2024-09-13T17:53:38.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb5623400 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a59736a00 con 0x562a5a573000 2024-09-13T17:53:38.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb4000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a5a572c00 0x562a596f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb4000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a5a572c00 0x562a596f5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44106/0 (socket says 172.21.15.114:44106) 2024-09-13T17:53:38.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb2c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a5a573400 0x562a596f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb4000640 1 -- 172.21.15.114:0/3653746251 learned_addr learned my addr 172.21.15.114:0/3653746251 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:38.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb3600640 1 --2- 172.21.15.114:0/3653746251 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562a5a573000 0x562a596f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb2c00640 1 -- 172.21.15.114:0/3653746251 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562a5a573000 msgr2=0x562a596f5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:38.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb2c00640 1 --2- 172.21.15.114:0/3653746251 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562a5a573000 0x562a596f5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb2c00640 1 -- 172.21.15.114:0/3653746251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a5a572c00 msgr2=0x562a596f5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:38.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb2c00640 1 --2- 172.21.15.114:0/3653746251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a5a572c00 0x562a596f5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb2c00640 1 -- 172.21.15.114:0/3653746251 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a596a0000 con 0x562a5a573400 2024-09-13T17:53:38.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.182+0000 7f1eb4000640 1 --2- 172.21.15.114:0/3653746251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a5a572c00 0x562a596f5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:53:38.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb2c00640 1 --2- 172.21.15.114:0/3653746251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a5a573400 0x562a596f6100 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x562a5a4cd8f0 tx=0x562a59742360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a04f2176d504d39 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:38.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eadc00640 1 -- 172.21.15.114:0/3653746251 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562a596bcf20 con 0x562a5a573400 2024-09-13T17:53:38.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eadc00640 1 -- 172.21.15.114:0/3653746251 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562a5a43cd80 con 0x562a5a573400 2024-09-13T17:53:38.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eadc00640 1 -- 172.21.15.114:0/3653746251 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562a596bd600 con 0x562a5a573400 2024-09-13T17:53:38.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb5623400 1 -- 172.21.15.114:0/3653746251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a5a573400 msgr2=0x562a596f6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:38.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb5623400 1 --2- 172.21.15.114:0/3653746251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a5a573400 0x562a596f6100 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x562a5a4cd8f0 tx=0x562a59742360 comp rx=0 tx=0).stop 2024-09-13T17:53:38.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb5623400 1 -- 172.21.15.114:0/3653746251 shutdown_connections 2024-09-13T17:53:38.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb5623400 1 --2- 172.21.15.114:0/3653746251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a5a573400 0x562a596f6100 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb5623400 1 --2- 172.21.15.114:0/3653746251 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562a5a573000 0x562a596f5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb5623400 1 --2- 172.21.15.114:0/3653746251 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a5a572c00 0x562a596f5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb5623400 1 -- 172.21.15.114:0/3653746251 >> 172.21.15.114:0/3653746251 conn(0x562a59668c00 msgr2=0x562a59695000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:38.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb5623400 1 -- 172.21.15.114:0/3653746251 shutdown_connections 2024-09-13T17:53:38.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb5623400 1 -- 172.21.15.114:0/3653746251 wait complete. 2024-09-13T17:53:38.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb5623400 1 Processor -- start 2024-09-13T17:53:38.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb5623400 1 -- start start 2024-09-13T17:53:38.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb5623400 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a5a572c00 0x562a596f7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb5623400 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a5a573000 0x562a596f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb5623400 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562a5a573400 0x562a596f6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb5623400 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a59736280 con 0x562a5a573000 2024-09-13T17:53:38.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb5623400 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a59736140 con 0x562a5a572c00 2024-09-13T17:53:38.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb5623400 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a59736000 con 0x562a5a573400 2024-09-13T17:53:38.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb3600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a5a573000 0x562a596f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb3600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a5a573000 0x562a596f6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44116/0 (socket says 172.21.15.114:44116) 2024-09-13T17:53:38.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb3600640 1 -- 172.21.15.114:0/1920046246 learned_addr learned my addr 172.21.15.114:0/1920046246 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:38.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb4000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a5a572c00 0x562a596f7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb2c00640 1 --2- 172.21.15.114:0/1920046246 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562a5a573400 0x562a596f6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb3600640 1 -- 172.21.15.114:0/1920046246 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562a5a573400 msgr2=0x562a596f6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:38.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb3600640 1 --2- 172.21.15.114:0/1920046246 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562a5a573400 0x562a596f6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb3600640 1 -- 172.21.15.114:0/1920046246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a5a572c00 msgr2=0x562a596f7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:38.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb3600640 1 --2- 172.21.15.114:0/1920046246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a5a572c00 0x562a596f7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb3600640 1 -- 172.21.15.114:0/1920046246 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a596a09c0 con 0x562a5a573000 2024-09-13T17:53:38.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb3600640 1 --2- 172.21.15.114:0/1920046246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a5a573000 0x562a596f6c00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x562a5a4cc9f0 tx=0x562a5a432000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:38.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eabe00640 1 -- 172.21.15.114:0/1920046246 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562a596bd080 con 0x562a5a573000 2024-09-13T17:53:38.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eabe00640 1 -- 172.21.15.114:0/1920046246 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562a596c6480 con 0x562a5a573000 2024-09-13T17:53:38.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb5623400 1 -- 172.21.15.114:0/1920046246 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562a596a0b60 con 0x562a5a573000 2024-09-13T17:53:38.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eabe00640 1 -- 172.21.15.114:0/1920046246 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562a596bcf20 con 0x562a5a573000 2024-09-13T17:53:38.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb5623400 1 -- 172.21.15.114:0/1920046246 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a596a0340 con 0x562a5a573000 2024-09-13T17:53:38.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.186+0000 7f1eb5623400 4 main: JournalTool: resolving pool 7 2024-09-13T17:53:38.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.190+0000 7f1eabe00640 1 -- 172.21.15.114:0/1920046246 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x562a59735080 con 0x562a5a573000 2024-09-13T17:53:38.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.190+0000 7f1eabe00640 1 --2- 172.21.15.114:0/1920046246 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x562a59a3c000 0x562a596f7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.190+0000 7f1eabe00640 1 -- 172.21.15.114:0/1920046246 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x562a596aaa80 con 0x562a5a573000 2024-09-13T17:53:38.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.190+0000 7f1eb5623400 4 main: JournalTool: creating IoCtx.. 2024-09-13T17:53:38.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.190+0000 7f1eb5623400 4 main: Executing for rank 0 2024-09-13T17:53:38.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.190+0000 7f1eb4000640 1 --2- 172.21.15.114:0/1920046246 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x562a59a3c000 0x562a596f7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.190+0000 7f1eb4000640 1 --2- 172.21.15.114:0/1920046246 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x562a59a3c000 0x562a596f7700 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x562a5a58c630 tx=0x562a59a49800 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:38.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.190+0000 7f1eb5623400 1 -- start start 2024-09-13T17:53:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.190+0000 7f1eb5623400 1 Processor -- start 2024-09-13T17:53:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.190+0000 7f1eb5623400 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562a5a573c00 0x562a596f6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.190+0000 7f1eb5623400 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a59a3d000 0x562a596f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.190+0000 7f1eb5623400 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a59a3d400 0x562a596f5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.190+0000 7f1eb5623400 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a59737040 con 0x562a59a3d400 2024-09-13T17:53:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.190+0000 7f1eb5623400 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a59736780 con 0x562a59a3d000 2024-09-13T17:53:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.190+0000 7f1eb5623400 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a59736000 con 0x562a5a573c00 2024-09-13T17:53:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.190+0000 7f1eb2c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a59a3d400 0x562a596f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.190+0000 7f1eb2c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a59a3d400 0x562a596f5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44128/0 (socket says 172.21.15.114:44128) 2024-09-13T17:53:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.190+0000 7f1eb2c00640 1 -- 172.21.15.114:0/1631485250 learned_addr learned my addr 172.21.15.114:0/1631485250 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.190+0000 7f1eb4000640 1 --2- 172.21.15.114:0/1631485250 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562a5a573c00 0x562a596f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.190+0000 7f1eb3600640 1 --2- 172.21.15.114:0/1631485250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a59a3d000 0x562a596f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.194+0000 7f1eb2c00640 1 -- 172.21.15.114:0/1631485250 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562a5a573c00 msgr2=0x562a596f6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:38.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.194+0000 7f1eb2c00640 1 --2- 172.21.15.114:0/1631485250 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562a5a573c00 0x562a596f6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.194+0000 7f1eb2c00640 1 -- 172.21.15.114:0/1631485250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a59a3d000 msgr2=0x562a596f5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:38.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.194+0000 7f1eb2c00640 1 --2- 172.21.15.114:0/1631485250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a59a3d000 0x562a596f5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.194+0000 7f1eb2c00640 1 -- 172.21.15.114:0/1631485250 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a5998d6c0 con 0x562a59a3d400 2024-09-13T17:53:38.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.194+0000 7f1eb2c00640 1 --2- 172.21.15.114:0/1631485250 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a59a3d400 0x562a596f5600 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x562a5a58c8d0 tx=0x562a5a59ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b54200592b4c1d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:38.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.194+0000 7f1ea8200640 1 -- 172.21.15.114:0/1631485250 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562a596bd1e0 con 0x562a59a3d400 2024-09-13T17:53:38.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.194+0000 7f1ea8200640 1 -- 172.21.15.114:0/1631485250 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562a5a43cf00 con 0x562a59a3d400 2024-09-13T17:53:38.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.194+0000 7f1ea8200640 1 -- 172.21.15.114:0/1631485250 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562a596bcdc0 con 0x562a59a3d400 2024-09-13T17:53:38.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.194+0000 7f1eb5623400 1 -- 172.21.15.114:0/1631485250 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a5998d520 con 0x562a59a3d400 2024-09-13T17:53:38.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.194+0000 7f1eb5623400 1 -- 172.21.15.114:0/1631485250 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x562a5998d380 con 0x562a59a3d400 2024-09-13T17:53:38.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.194+0000 7f1eb5623400 4 waiting for MDS map... 2024-09-13T17:53:38.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.194+0000 7f1ea8200640 1 -- 172.21.15.114:0/1631485250 <== mon.0 v2:172.21.15.114:3300/0 4 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x562a596aa8c0 con 0x562a59a3d400 2024-09-13T17:53:38.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.194+0000 7f1ea8200640 1 -- 172.21.15.114:0/1631485250 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 23) v1 ==== 3691+0+0 (secure 0 0 0) 0x562a59aa4000 con 0x562a59a3d400 2024-09-13T17:53:38.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.194+0000 7f1eb5623400 4 Got MDS map 23 2024-09-13T17:53:38.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.194+0000 7f1eb5623400 1 --2- 172.21.15.114:0/1631485250 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x562a59a3d800 0x562a59ab8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.194+0000 7f1eb5623400 1 -- 172.21.15.114:0/1631485250 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:1 7.f 7:f1f69726:::400.00000000:head [writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) v8 -- 0x562a59a3dc00 con 0x562a59a3d800 2024-09-13T17:53:38.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.194+0000 7f1eb4000640 1 --2- 172.21.15.114:0/1631485250 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x562a59a3d800 0x562a59ab8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.194+0000 7f1eb4000640 1 --2- 172.21.15.114:0/1631485250 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x562a59a3d800 0x562a59ab8000 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=f65df6604c40683e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:38.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.194+0000 7f1eb4000640 1 -- 172.21.15.114:0/1631485250 <== osd.0 v2:172.21.15.114:6808/4163905135 1 ==== osd_op_reply(1 400.00000000 [writefull 0~22] v48'1 uv1 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x562a5a42eb40 con 0x562a59a3d800 2024-09-13T17:53:38.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.194+0000 7f1eb5623400 1 --2- 172.21.15.114:0/1631485250 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x562a59aa1400 0x562a59ab8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.194+0000 7f1eb5623400 1 -- 172.21.15.114:0/1631485250 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:2 7.14 7:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) v8 -- 0x562a59aa1800 con 0x562a59aa1400 2024-09-13T17:53:38.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.194+0000 7f1eb3600640 1 --2- 172.21.15.114:0/1631485250 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x562a59aa1400 0x562a59ab8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.198+0000 7f1eb3600640 1 --2- 172.21.15.114:0/1631485250 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x562a59aa1400 0x562a59ab8580 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=74a088375c1d866b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:38.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.198+0000 7f1eb3600640 1 -- 172.21.15.114:0/1631485250 <== osd.3 v2:172.21.15.114:6824/1824187331 1 ==== osd_op_reply(2 200.00000000 [writefull 0~90] v48'2 uv2 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x562a5a42ed80 con 0x562a59aa1400 2024-09-13T17:53:38.204 INFO:teuthology.orchestra.run.smithi114.stdout:writing EResetJournal entry 2024-09-13T17:53:38.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.198+0000 7f1eb5623400 1 -- 172.21.15.114:0/1631485250 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:3 7.14 7:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) v8 -- 0x562a59aa1c00 con 0x562a59aa1400 2024-09-13T17:53:38.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.198+0000 7f1eb5623400 1 -- 172.21.15.114:0/1631485250 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- osd_op(unknown.0.0:4 7.1b 7:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) v8 -- 0x562a59ac8000 con 0x562a59a3d800 2024-09-13T17:53:38.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.198+0000 7f1eb5623400 1 --2- 172.21.15.114:0/1631485250 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x562a59ac8400 0x562a59ab8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.198+0000 7f1eb5623400 1 -- 172.21.15.114:0/1631485250 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:5 7.b 7:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) v8 -- 0x562a59ac8800 con 0x562a59ac8400 2024-09-13T17:53:38.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.198+0000 7f1eb5623400 1 --2- 172.21.15.114:0/1631485250 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x562a59ac8c00 0x562a59ab9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.198+0000 7f1eb5623400 1 -- 172.21.15.114:0/1631485250 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- osd_op(unknown.0.0:6 7.1f 7:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) v8 -- 0x562a59ac9000 con 0x562a59ac8c00 2024-09-13T17:53:38.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.198+0000 7f1eb5623400 1 --2- 172.21.15.114:0/1631485250 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x562a59ac9400 0x562a59ab9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.198+0000 7f1eb5623400 1 -- 172.21.15.114:0/1631485250 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- osd_op(unknown.0.0:7 7.1a 7:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) v8 -- 0x562a59ac9800 con 0x562a59ac9400 2024-09-13T17:53:38.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.198+0000 7f1eb5623400 1 -- 172.21.15.114:0/1631485250 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- osd_op(unknown.0.0:8 7.1e 7:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) v8 -- 0x562a59ac9c00 con 0x562a59ac8400 2024-09-13T17:53:38.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.198+0000 7f1eb4000640 1 --2- 172.21.15.114:0/1631485250 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x562a59ac8400 0x562a59ab8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.198+0000 7f1eb3600640 1 --2- 172.21.15.114:0/1631485250 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x562a59ac8c00 0x562a59ab9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.198+0000 7f1eb2c00640 1 --2- 172.21.15.114:0/1631485250 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x562a59ac9400 0x562a59ab9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.198+0000 7f1eb3600640 1 --2- 172.21.15.114:0/1631485250 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x562a59ac8c00 0x562a59ab9080 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=7423387818157a0f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:38.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.198+0000 7f1eb4000640 1 --2- 172.21.15.114:0/1631485250 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x562a59ac8400 0x562a59ab8b00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=d44464435b16f03c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:38.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.198+0000 7f1eb2c00640 1 --2- 172.21.15.114:0/1631485250 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x562a59ac9400 0x562a59ab9600 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=3536484ea8b1cc12 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:38.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.198+0000 7f1eb3600640 1 -- 172.21.15.114:0/1631485250 <== osd.3 v2:172.21.15.114:6824/1824187331 2 ==== osd_op_reply(3 200.00000001 [delete] v48'3 uv2 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x562a5a42ed80 con 0x562a59aa1400 2024-09-13T17:53:38.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.198+0000 7f1eb4000640 1 -- 172.21.15.114:0/1631485250 <== osd.0 v2:172.21.15.114:6808/4163905135 2 ==== osd_op_reply(4 200.00000002 [delete] v48'1 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x562a5a42eb40 con 0x562a59a3d800 2024-09-13T17:53:38.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.198+0000 7f1ea6400640 1 -- 172.21.15.114:0/1631485250 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- osd_op(unknown.0.0:9 7.14 7:2e2fa760:::200.00000001:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48) v8 -- 0x562a59a3cc00 con 0x562a59aa1400 2024-09-13T17:53:38.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb3600640 1 -- 172.21.15.114:0/1631485250 <== osd.6 v2:172.21.15.134:6824/1813072387 1 ==== osd_op_reply(6 200.00000004 [delete] v48'5 uv4 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x562a5a42ed80 con 0x562a59ac8c00 2024-09-13T17:53:38.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb4000640 1 -- 172.21.15.114:0/1631485250 <== osd.1 v2:172.21.15.114:6816/2809354915 1 ==== osd_op_reply(8 200.00000006 [delete] v48'1 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x562a5a42eb40 con 0x562a59ac8400 2024-09-13T17:53:38.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb3600640 1 -- 172.21.15.114:0/1631485250 <== osd.3 v2:172.21.15.114:6824/1824187331 3 ==== osd_op_reply(9 200.00000001 [write 0~48] v48'4 uv4 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x562a5a42ed80 con 0x562a59aa1400 2024-09-13T17:53:38.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb4000640 1 -- 172.21.15.114:0/1631485250 <== osd.1 v2:172.21.15.114:6816/2809354915 2 ==== osd_op_reply(5 200.00000003 [delete] v48'2 uv1 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x562a5a42eb40 con 0x562a59ac8400 2024-09-13T17:53:38.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb2c00640 1 -- 172.21.15.114:0/1631485250 <== osd.4 v2:172.21.15.134:6808/3210409298 1 ==== osd_op_reply(7 200.00000005 [delete] v48'1 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x562a5a42f8c0 con 0x562a59ac9400 2024-09-13T17:53:38.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 4 Successfully wrote new journal pointer and header for rank 3:0 2024-09-13T17:53:38.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 -- 172.21.15.114:0/1631485250 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x562a59a3d800 msgr2=0x562a59ab8000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:38.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 --2- 172.21.15.114:0/1631485250 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x562a59a3d800 0x562a59ab8000 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 -- 172.21.15.114:0/1631485250 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x562a59ac8400 msgr2=0x562a59ab8b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:38.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 --2- 172.21.15.114:0/1631485250 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x562a59ac8400 0x562a59ab8b00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 -- 172.21.15.114:0/1631485250 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x562a59aa1400 msgr2=0x562a59ab8580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:38.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 --2- 172.21.15.114:0/1631485250 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x562a59aa1400 0x562a59ab8580 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 -- 172.21.15.114:0/1631485250 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x562a59ac9400 msgr2=0x562a59ab9600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:38.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 --2- 172.21.15.114:0/1631485250 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x562a59ac9400 0x562a59ab9600 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 -- 172.21.15.114:0/1631485250 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x562a59ac8c00 msgr2=0x562a59ab9080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:38.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 --2- 172.21.15.114:0/1631485250 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x562a59ac8c00 0x562a59ab9080 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb2c00640 1 -- 172.21.15.114:0/1631485250 reap_dead start 2024-09-13T17:53:38.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb2c00640 1 -- 172.21.15.114:0/1631485250 reap_dead start 2024-09-13T17:53:38.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 -- 172.21.15.114:0/1631485250 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a59a3d400 msgr2=0x562a596f5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:38.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 --2- 172.21.15.114:0/1631485250 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a59a3d400 0x562a596f5600 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x562a5a58c8d0 tx=0x562a5a59ac00 comp rx=0 tx=0).stop 2024-09-13T17:53:38.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 -- 172.21.15.114:0/1631485250 shutdown_connections 2024-09-13T17:53:38.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 --2- 172.21.15.114:0/1631485250 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a59a3d400 0x562a596f5600 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 -- 172.21.15.114:0/1631485250 >> 172.21.15.114:0/1631485250 conn(0x562a5a573800 msgr2=0x562a59694800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:38.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 -- 172.21.15.114:0/1631485250 shutdown_connections 2024-09-13T17:53:38.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 -- 172.21.15.114:0/1631485250 wait complete. 2024-09-13T17:53:38.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 -- 172.21.15.114:0/1920046246 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x562a59a3c000 msgr2=0x562a596f7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:38.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 --2- 172.21.15.114:0/1920046246 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x562a59a3c000 0x562a596f7700 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x562a5a58c630 tx=0x562a59a49800 comp rx=0 tx=0).stop 2024-09-13T17:53:38.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 -- 172.21.15.114:0/1920046246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a5a573000 msgr2=0x562a596f6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:38.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 --2- 172.21.15.114:0/1920046246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a5a573000 0x562a596f6c00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x562a5a4cc9f0 tx=0x562a5a432000 comp rx=0 tx=0).stop 2024-09-13T17:53:38.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 -- 172.21.15.114:0/1920046246 shutdown_connections 2024-09-13T17:53:38.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 --2- 172.21.15.114:0/1920046246 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x562a59a3c000 0x562a596f7700 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 --2- 172.21.15.114:0/1920046246 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562a5a573400 0x562a596f6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 --2- 172.21.15.114:0/1920046246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a5a573000 0x562a596f6c00 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 --2- 172.21.15.114:0/1920046246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a5a572c00 0x562a596f7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 -- 172.21.15.114:0/1920046246 >> 172.21.15.114:0/1920046246 conn(0x562a59668c00 msgr2=0x562a59695000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:38.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 -- 172.21.15.114:0/1920046246 shutdown_connections 2024-09-13T17:53:38.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.202+0000 7f1eb5623400 1 -- 172.21.15.114:0/1920046246 wait complete. 2024-09-13T17:53:38.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.206+0000 7f1eb5623400 1 -- 172.21.15.114:0/329955780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a59669400 msgr2=0x562a596f4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:38.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.206+0000 7f1eb5623400 1 --2- 172.21.15.114:0/329955780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a59669400 0x562a596f4b00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x562a5a4cd2f0 tx=0x562a5a432480 comp rx=0 tx=0).stop 2024-09-13T17:53:38.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.206+0000 7f1eb5623400 1 -- 172.21.15.114:0/329955780 shutdown_connections 2024-09-13T17:53:38.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.206+0000 7f1eb5623400 1 --2- 172.21.15.114:0/329955780 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x562a59669000 0x562a596f5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.206+0000 7f1eb5623400 1 --2- 172.21.15.114:0/329955780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x562a59669400 0x562a596f4b00 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.206+0000 7f1eb5623400 1 --2- 172.21.15.114:0/329955780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a59669800 0x562a596f4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.206+0000 7f1eb5623400 1 -- 172.21.15.114:0/329955780 >> 172.21.15.114:0/329955780 conn(0x562a59669c00 msgr2=0x562a59695800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:38.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.206+0000 7f1eb5623400 1 -- 172.21.15.114:0/329955780 shutdown_connections 2024-09-13T17:53:38.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.206+0000 7f1eb5623400 1 -- 172.21.15.114:0/329955780 wait complete. 2024-09-13T17:53:38.215 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'recovery_fs:0', 'journal', 'reset', '--force', '--yes-i-really-really-mean-it'] in time 0:00:00.121325, result: writing EResetJournal entry 2024-09-13T17:53:38.215 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set recovery_fs joinable true 2024-09-13T17:53:38.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.394+0000 7fe454e00640 1 Processor -- start 2024-09-13T17:53:38.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.394+0000 7fe454e00640 1 -- start start 2024-09-13T17:53:38.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.394+0000 7fe454e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe45013c240 0x7fe45013f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.394+0000 7fe454e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4500cd220 con 0x7fe45006dc60 2024-09-13T17:53:38.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.394+0000 7fe454e00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe45013f960 con 0x7fe45013c980 2024-09-13T17:53:38.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.394+0000 7fe454e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe45015a740 con 0x7fe45013c240 2024-09-13T17:53:38.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.394+0000 7fe44de00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe45013c240 0x7fe45013f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.394+0000 7fe44e800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe45006dc60 0x7fe4500cd650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51150/0 (socket says 172.21.15.114:51150) 2024-09-13T17:53:38.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.394+0000 7fe44e800640 1 -- 172.21.15.114:0/3489952527 learned_addr learned my addr 172.21.15.114:0/3489952527 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:38.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.394+0000 7fe44ca00640 1 -- 172.21.15.114:0/3489952527 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 315120114 0 0) 0x7fe4500cd220 con 0x7fe45006dc60 2024-09-13T17:53:38.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.394+0000 7fe44ca00640 1 -- 172.21.15.114:0/3489952527 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe434005740 con 0x7fe45006dc60 2024-09-13T17:53:38.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.394+0000 7fe44de00640 1 -- 172.21.15.114:0/3489952527 >> v1:172.21.15.134:6789/0 conn(0x7fe45013c980 legacy=0x7fe45006d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:38.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.394+0000 7fe44ca00640 1 -- 172.21.15.114:0/3489952527 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2528006054 0 0) 0x7fe43c001120 con 0x7fe45013c980 2024-09-13T17:53:38.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.394+0000 7fe44de00640 1 -- 172.21.15.114:0/3489952527 >> v1:172.21.15.114:6789/0 conn(0x7fe45006dc60 legacy=0x7fe4500cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:38.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.394+0000 7fe44de00640 1 -- 172.21.15.114:0/3489952527 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe450159bc0 con 0x7fe45013c240 2024-09-13T17:53:38.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.398+0000 7fe44de00640 1 --2- 172.21.15.114:0/3489952527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45013c240 0x7fe45013f420 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe4400097c0 tx=0x7fe44001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c14ad2e7a990c42d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:38.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.398+0000 7fe44ca00640 1 -- 172.21.15.114:0/3489952527 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4400ab600 con 0x7fe45013c240 2024-09-13T17:53:38.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.398+0000 7fe44ca00640 1 -- 172.21.15.114:0/3489952527 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4400a7050 con 0x7fe45013c240 2024-09-13T17:53:38.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.398+0000 7fe44ca00640 1 -- 172.21.15.114:0/3489952527 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4400ab980 con 0x7fe45013c240 2024-09-13T17:53:38.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.398+0000 7fe454e00640 1 -- 172.21.15.114:0/3489952527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45013c240 msgr2=0x7fe45013f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:38.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.398+0000 7fe454e00640 1 --2- 172.21.15.114:0/3489952527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45013c240 0x7fe45013f420 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe4400097c0 tx=0x7fe44001c3e0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.398+0000 7fe454e00640 1 -- 172.21.15.114:0/3489952527 shutdown_connections 2024-09-13T17:53:38.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.398+0000 7fe454e00640 1 --2- 172.21.15.114:0/3489952527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45013c240 0x7fe45013f420 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.398+0000 7fe454e00640 1 -- 172.21.15.114:0/3489952527 >> 172.21.15.114:0/3489952527 conn(0x7fe4500660b0 msgr2=0x7fe450069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:38.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.402+0000 7fe454e00640 1 -- 172.21.15.114:0/3489952527 shutdown_connections 2024-09-13T17:53:38.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.402+0000 7fe454e00640 1 -- 172.21.15.114:0/3489952527 wait complete. 2024-09-13T17:53:38.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.402+0000 7fe454e00640 1 Processor -- start 2024-09-13T17:53:38.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.402+0000 7fe454e00640 1 -- start start 2024-09-13T17:53:38.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.402+0000 7fe454e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe45006dc60 0x7fe4500b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.402+0000 7fe454e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45013c240 0x7fe4500b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.402+0000 7fe454e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe45013c980 0x7fe4501f0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.402+0000 7fe454e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe450154c90 con 0x7fe45013c240 2024-09-13T17:53:38.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.402+0000 7fe454e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe450155120 con 0x7fe45013c980 2024-09-13T17:53:38.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.402+0000 7fe454e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe450154080 con 0x7fe45006dc60 2024-09-13T17:53:38.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.402+0000 7fe44d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45013c240 0x7fe4500b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.402+0000 7fe44de00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe45006dc60 0x7fe4500b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.402+0000 7fe44d400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45013c240 0x7fe4500b0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44146/0 (socket says 172.21.15.114:44146) 2024-09-13T17:53:38.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.402+0000 7fe44d400640 1 -- 172.21.15.114:0/3407592940 learned_addr learned my addr 172.21.15.114:0/3407592940 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:38.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.402+0000 7fe44e800640 1 --2- 172.21.15.114:0/3407592940 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe45013c980 0x7fe4501f0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.402+0000 7fe44d400640 1 -- 172.21.15.114:0/3407592940 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe45006dc60 msgr2=0x7fe4500b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:38.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.402+0000 7fe44d400640 1 --2- 172.21.15.114:0/3407592940 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe45006dc60 0x7fe4500b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.402+0000 7fe44d400640 1 -- 172.21.15.114:0/3407592940 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe45013c980 msgr2=0x7fe4501f0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:38.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.402+0000 7fe44d400640 1 --2- 172.21.15.114:0/3407592940 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe45013c980 0x7fe4501f0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:38.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.402+0000 7fe44d400640 1 -- 172.21.15.114:0/3407592940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe440009420 con 0x7fe45013c240 2024-09-13T17:53:38.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.402+0000 7fe44d400640 1 --2- 172.21.15.114:0/3407592940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45013c240 0x7fe4500b0840 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe43c001ec0 tx=0x7fe43c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:38.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.402+0000 7fe446000640 1 -- 172.21.15.114:0/3407592940 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c0054e0 con 0x7fe45013c240 2024-09-13T17:53:38.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.402+0000 7fe446000640 1 -- 172.21.15.114:0/3407592940 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43c003600 con 0x7fe45013c240 2024-09-13T17:53:38.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.402+0000 7fe446000640 1 -- 172.21.15.114:0/3407592940 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c0039b0 con 0x7fe45013c240 2024-09-13T17:53:38.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.402+0000 7fe454e00640 1 -- 172.21.15.114:0/3407592940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe450154360 con 0x7fe45013c240 2024-09-13T17:53:38.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.406+0000 7fe454e00640 1 -- 172.21.15.114:0/3407592940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe450154920 con 0x7fe45013c240 2024-09-13T17:53:38.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.406+0000 7fe454e00640 1 -- 172.21.15.114:0/3407592940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe450154e00 con 0x7fe45013c240 2024-09-13T17:53:38.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.406+0000 7fe446000640 1 -- 172.21.15.114:0/3407592940 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe43c003b10 con 0x7fe45013c240 2024-09-13T17:53:38.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.406+0000 7fe446000640 1 --2- 172.21.15.114:0/3407592940 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe430066690 0x7fe430068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:38.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.406+0000 7fe446000640 1 -- 172.21.15.114:0/3407592940 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7fe43c0838f0 con 0x7fe45013c240 2024-09-13T17:53:38.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.406+0000 7fe44de00640 1 --2- 172.21.15.114:0/3407592940 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe430066690 0x7fe430068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:38.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.406+0000 7fe44de00640 1 --2- 172.21.15.114:0/3407592940 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe430066690 0x7fe430068b50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe4400ad000 tx=0x7fe4400a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:38.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.410+0000 7fe446000640 1 -- 172.21.15.114:0/3407592940 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe43c050980 con 0x7fe45013c240 2024-09-13T17:53:38.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:38.598+0000 7fe454e00640 1 -- 172.21.15.114:0/3407592940 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "recovery_fs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fe45013f960 con 0x7fe45013c240 2024-09-13T17:53:39.413 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-09-13T17:53:39.406+0000 7f67aa600640 -1 log_channel(cluster) log [ERR] : Health check update: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:53:39.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.406+0000 7fe446000640 1 -- 172.21.15.114:0/3407592940 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "recovery_fs", "var": "joinable", "val": "true"}]=0 recovery_fs marked joinable; MDS may join as newly active. v24) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe45013f960 con 0x7fe45013c240 2024-09-13T17:53:39.414 INFO:teuthology.orchestra.run.smithi114.stderr:recovery_fs marked joinable; MDS may join as newly active. 2024-09-13T17:53:39.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.410+0000 7fe454e00640 1 -- 172.21.15.114:0/3407592940 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe430066690 msgr2=0x7fe430068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:39.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.410+0000 7fe454e00640 1 --2- 172.21.15.114:0/3407592940 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe430066690 0x7fe430068b50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe4400ad000 tx=0x7fe4400a6000 comp rx=0 tx=0).stop 2024-09-13T17:53:39.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.410+0000 7fe454e00640 1 -- 172.21.15.114:0/3407592940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45013c240 msgr2=0x7fe4500b0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:39.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.410+0000 7fe454e00640 1 --2- 172.21.15.114:0/3407592940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45013c240 0x7fe4500b0840 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe43c001ec0 tx=0x7fe43c00c8e0 comp rx=0 tx=0).stop 2024-09-13T17:53:39.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.410+0000 7fe454e00640 1 -- 172.21.15.114:0/3407592940 shutdown_connections 2024-09-13T17:53:39.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.410+0000 7fe454e00640 1 --2- 172.21.15.114:0/3407592940 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe430066690 0x7fe430068b50 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:39.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.410+0000 7fe454e00640 1 --2- 172.21.15.114:0/3407592940 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe45013c980 0x7fe4501f0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:39.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.410+0000 7fe454e00640 1 --2- 172.21.15.114:0/3407592940 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe45013c240 0x7fe4500b0840 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:39.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.410+0000 7fe454e00640 1 --2- 172.21.15.114:0/3407592940 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe45006dc60 0x7fe4500b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:39.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.410+0000 7fe454e00640 1 -- 172.21.15.114:0/3407592940 >> 172.21.15.114:0/3407592940 conn(0x7fe4500660b0 msgr2=0x7fe450156690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:39.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.410+0000 7fe454e00640 1 -- 172.21.15.114:0/3407592940 shutdown_connections 2024-09-13T17:53:39.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.410+0000 7fe454e00640 1 -- 172.21.15.114:0/3407592940 wait complete. 2024-09-13T17:53:39.419 INFO:tasks.ceph.mds.a.smithi114.stderr:2024-09-13T17:53:39.414+0000 7f672e400640 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2024-09-13T17:53:39.441 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:53:39.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.570+0000 7fbd23600640 1 Processor -- start 2024-09-13T17:53:39.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.570+0000 7fbd23600640 1 -- start start 2024-09-13T17:53:39.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.574+0000 7fbd23600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fbd1c070890 0x7fbd1c06cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:39.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.574+0000 7fbd23600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd1c151800 con 0x7fbd1c070420 2024-09-13T17:53:39.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.574+0000 7fbd23600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd1c0cafb0 con 0x7fbd1c151420 2024-09-13T17:53:39.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.574+0000 7fbd23600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd1c0cbc30 con 0x7fbd1c070890 2024-09-13T17:53:39.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.574+0000 7fbd1be00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbd1c070420 0x7fbd1c06c540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51152/0 (socket says 172.21.15.114:51152) 2024-09-13T17:53:39.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.574+0000 7fbd1be00640 1 -- 172.21.15.114:0/3792830566 learned_addr learned my addr 172.21.15.114:0/3792830566 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:39.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.574+0000 7fbd21600640 1 --2- 172.21.15.114:0/3792830566 >> v2:172.21.15.134:3300/0 conn(0x7fbd1c070890 0x7fbd1c06cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:39.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.574+0000 7fbd1b400640 1 -- 172.21.15.114:0/3792830566 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 475804048 0 0) 0x7fbd1c151800 con 0x7fbd1c070420 2024-09-13T17:53:39.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.574+0000 7fbd1b400640 1 -- 172.21.15.114:0/3792830566 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd00003530 con 0x7fbd1c070420 2024-09-13T17:53:39.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.574+0000 7fbd21600640 1 -- 172.21.15.114:0/3792830566 >> v1:172.21.15.134:6789/0 conn(0x7fbd1c151420 legacy=0x7fbd1c0cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:39.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.574+0000 7fbd21600640 1 -- 172.21.15.114:0/3792830566 >> v1:172.21.15.114:6789/0 conn(0x7fbd1c070420 legacy=0x7fbd1c06c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:39.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.574+0000 7fbd21600640 1 -- 172.21.15.114:0/3792830566 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1c0cb290 con 0x7fbd1c070890 2024-09-13T17:53:39.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.578+0000 7fbd21600640 1 --2- 172.21.15.114:0/3792830566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd1c070890 0x7fbd1c06cc50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009d90 tx=0x7fbd1401c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77e85ea01198fd7d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:39.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.578+0000 7fbd1b400640 1 -- 172.21.15.114:0/3792830566 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd140a58e0 con 0x7fbd1c070890 2024-09-13T17:53:39.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.578+0000 7fbd1b400640 1 -- 172.21.15.114:0/3792830566 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd140a5a40 con 0x7fbd1c070890 2024-09-13T17:53:39.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.578+0000 7fbd1b400640 1 -- 172.21.15.114:0/3792830566 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd140a5dd0 con 0x7fbd1c070890 2024-09-13T17:53:39.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.578+0000 7fbd23600640 1 -- 172.21.15.114:0/3792830566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd1c070890 msgr2=0x7fbd1c06cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:39.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.578+0000 7fbd23600640 1 --2- 172.21.15.114:0/3792830566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd1c070890 0x7fbd1c06cc50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009d90 tx=0x7fbd1401c820 comp rx=0 tx=0).stop 2024-09-13T17:53:39.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.578+0000 7fbd23600640 1 -- 172.21.15.114:0/3792830566 shutdown_connections 2024-09-13T17:53:39.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.578+0000 7fbd23600640 1 --2- 172.21.15.114:0/3792830566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd1c070890 0x7fbd1c06cc50 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:39.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.578+0000 7fbd23600640 1 -- 172.21.15.114:0/3792830566 >> 172.21.15.114:0/3792830566 conn(0x7fbd1c0660b0 msgr2=0x7fbd1c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:39.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.578+0000 7fbd23600640 1 -- 172.21.15.114:0/3792830566 shutdown_connections 2024-09-13T17:53:39.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.578+0000 7fbd23600640 1 -- 172.21.15.114:0/3792830566 wait complete. 2024-09-13T17:53:39.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.578+0000 7fbd23600640 1 Processor -- start 2024-09-13T17:53:39.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.582+0000 7fbd23600640 1 -- start start 2024-09-13T17:53:39.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.582+0000 7fbd23600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd1c070420 0x7fbd1c149100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:39.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.582+0000 7fbd23600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd1c070890 0x7fbd1c0b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:39.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.582+0000 7fbd23600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbd1c151420 0x7fbd1c155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:39.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.582+0000 7fbd23600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c0b1a20 con 0x7fbd1c070890 2024-09-13T17:53:39.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.582+0000 7fbd23600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c0b1d00 con 0x7fbd1c070420 2024-09-13T17:53:39.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.582+0000 7fbd23600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c0b1fe0 con 0x7fbd1c151420 2024-09-13T17:53:39.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.582+0000 7fbd1be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd1c070890 0x7fbd1c0b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:39.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.582+0000 7fbd1be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd1c070890 0x7fbd1c0b2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44156/0 (socket says 172.21.15.114:44156) 2024-09-13T17:53:39.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.582+0000 7fbd1be00640 1 -- 172.21.15.114:0/1211960281 learned_addr learned my addr 172.21.15.114:0/1211960281 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:39.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.582+0000 7fbd20c00640 1 --2- 172.21.15.114:0/1211960281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd1c070420 0x7fbd1c149100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:39.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.582+0000 7fbd1be00640 1 -- 172.21.15.114:0/1211960281 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbd1c151420 msgr2=0x7fbd1c155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:39.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.582+0000 7fbd1be00640 1 --2- 172.21.15.114:0/1211960281 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbd1c151420 0x7fbd1c155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:39.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.582+0000 7fbd1be00640 1 -- 172.21.15.114:0/1211960281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd1c070420 msgr2=0x7fbd1c149100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:39.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.582+0000 7fbd1be00640 1 --2- 172.21.15.114:0/1211960281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd1c070420 0x7fbd1c149100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:39.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.582+0000 7fbd1be00640 1 -- 172.21.15.114:0/1211960281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd14009a70 con 0x7fbd1c070890 2024-09-13T17:53:39.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.582+0000 7fbd20c00640 1 --2- 172.21.15.114:0/1211960281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd1c070420 0x7fbd1c149100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:39.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.582+0000 7fbd1be00640 1 --2- 172.21.15.114:0/1211960281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd1c070890 0x7fbd1c0b2ac0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fbd080010f0 tx=0x7fbd0800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:39.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.582+0000 7fbd18c00640 1 -- 172.21.15.114:0/1211960281 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd08005cf0 con 0x7fbd1c070890 2024-09-13T17:53:39.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.582+0000 7fbd18c00640 1 -- 172.21.15.114:0/1211960281 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd08005e70 con 0x7fbd1c070890 2024-09-13T17:53:39.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.582+0000 7fbd18c00640 1 -- 172.21.15.114:0/1211960281 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd080072d0 con 0x7fbd1c070890 2024-09-13T17:53:39.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.582+0000 7fbd23600640 1 -- 172.21.15.114:0/1211960281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1c0b22c0 con 0x7fbd1c070890 2024-09-13T17:53:39.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.582+0000 7fbd23600640 1 -- 172.21.15.114:0/1211960281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1c149640 con 0x7fbd1c070890 2024-09-13T17:53:39.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.582+0000 7fbd23600640 1 -- 172.21.15.114:0/1211960281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd1c0cc660 con 0x7fbd1c070890 2024-09-13T17:53:39.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.586+0000 7fbd18c00640 1 -- 172.21.15.114:0/1211960281 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbd08007430 con 0x7fbd1c070890 2024-09-13T17:53:39.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.586+0000 7fbd18c00640 1 --2- 172.21.15.114:0/1211960281 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbcfc0666c0 0x7fbcfc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:39.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.586+0000 7fbd18c00640 1 -- 172.21.15.114:0/1211960281 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7fbd08083a50 con 0x7fbd1c070890 2024-09-13T17:53:39.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.586+0000 7fbd20c00640 1 --2- 172.21.15.114:0/1211960281 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbcfc0666c0 0x7fbcfc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:39.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.586+0000 7fbd20c00640 1 --2- 172.21.15.114:0/1211960281 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbcfc0666c0 0x7fbcfc068b80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c154e30 tx=0x7fbd0c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:39.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.590+0000 7fbd18c00640 1 -- 172.21.15.114:0/1211960281 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbd08050a30 con 0x7fbd1c070890 2024-09-13T17:53:39.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.774+0000 7fbd23600640 1 -- 172.21.15.114:0/1211960281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd1c0b2770 con 0x7fbd1c070890 2024-09-13T17:53:39.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.774+0000 7fbd18c00640 1 -- 172.21.15.114:0/1211960281 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+5951 (secure 0 0 0) 0x7fbd08054050 con 0x7fbd1c070890 2024-09-13T17:53:39.780 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:39.780 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":25,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/1758700058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1758700058},{"type":"v1","addr":"172.21.15.134:6833","nonce":1758700058}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/4015015784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4015015784},{"type":"v1","addr":"172.21.15.134:6835","nonce":4015015784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2696640153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2696640153},{"type":"v1","addr":"172.21.15.114:6836","nonce":2696640153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:53:08.298484+0000","modified":"2024-09-13T17:53:22.929771+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:53:32.086012+0000","modified":"2024-09-13T17:53:39.413508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5598":{"gid":5598,"name":"a","rank":0,"incarnation":25,"state":"up:replay","state_seq":1,"addr":"172.21.15.114:6837/2697286380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2697286380},{"type":"v1","addr":"172.21.15.114:6837","nonce":2697286380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T17:53:39.780 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 25 2024-09-13T17:53:39.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.778+0000 7fbd23600640 1 -- 172.21.15.114:0/1211960281 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbcfc0666c0 msgr2=0x7fbcfc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:39.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.778+0000 7fbd23600640 1 --2- 172.21.15.114:0/1211960281 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbcfc0666c0 0x7fbcfc068b80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c154e30 tx=0x7fbd0c009040 comp rx=0 tx=0).stop 2024-09-13T17:53:39.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.778+0000 7fbd23600640 1 -- 172.21.15.114:0/1211960281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd1c070890 msgr2=0x7fbd1c0b2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:39.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.778+0000 7fbd23600640 1 --2- 172.21.15.114:0/1211960281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd1c070890 0x7fbd1c0b2ac0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fbd080010f0 tx=0x7fbd0800c810 comp rx=0 tx=0).stop 2024-09-13T17:53:39.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.778+0000 7fbd23600640 1 -- 172.21.15.114:0/1211960281 shutdown_connections 2024-09-13T17:53:39.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.778+0000 7fbd23600640 1 --2- 172.21.15.114:0/1211960281 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbcfc0666c0 0x7fbcfc068b80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:39.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.778+0000 7fbd23600640 1 --2- 172.21.15.114:0/1211960281 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbd1c151420 0x7fbd1c155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:39.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.778+0000 7fbd23600640 1 --2- 172.21.15.114:0/1211960281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd1c070890 0x7fbd1c0b2ac0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:39.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.778+0000 7fbd23600640 1 --2- 172.21.15.114:0/1211960281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd1c070420 0x7fbd1c149100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:39.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.778+0000 7fbd23600640 1 -- 172.21.15.114:0/1211960281 >> 172.21.15.114:0/1211960281 conn(0x7fbd1c0660b0 msgr2=0x7fbd1c165970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:39.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.778+0000 7fbd23600640 1 -- 172.21.15.114:0/1211960281 shutdown_connections 2024-09-13T17:53:39.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:39.778+0000 7fbd23600640 1 -- 172.21.15.114:0/1211960281 wait complete. 2024-09-13T17:53:40.203 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:53:32.086012+0000', 'modified': '2024-09-13T17:53:39.413508+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5598}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5598': {'gid': 5598, 'name': 'a', 'rank': 0, 'incarnation': 25, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.114:6837/2697286380', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6835', 'nonce': 2697286380}, {'type': 'v1', 'addr': '172.21.15.114:6837', 'nonce': 2697286380}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'recovery_fs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:53:40.203 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5598:up:replay 2024-09-13T17:53:41.204 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:53:41.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.338+0000 7f6763800640 1 Processor -- start 2024-09-13T17:53:41.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.338+0000 7f6763800640 1 -- start start 2024-09-13T17:53:41.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.338+0000 7f6763800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f675c13f420 0x7f675c06d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:41.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.338+0000 7f6763800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f675c0cd220 con 0x7f675c06da90 2024-09-13T17:53:41.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.338+0000 7f6763800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f675c15a740 con 0x7f675c13c240 2024-09-13T17:53:41.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.338+0000 7f6763800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f675c06df40 con 0x7f675c13f420 2024-09-13T17:53:41.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.342+0000 7f675be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f675c13f420 0x7f675c06d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:41.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.342+0000 7f6761800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f675c06da90 0x7f675c0cd650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33774/0 (socket says 172.21.15.114:33774) 2024-09-13T17:53:41.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.342+0000 7f6761800640 1 -- 172.21.15.114:0/901966232 learned_addr learned my addr 172.21.15.114:0/901966232 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:41.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.342+0000 7f675be00640 1 -- 172.21.15.114:0/901966232 >> v1:172.21.15.134:6789/0 conn(0x7f675c13c240 legacy=0x7f675c13c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:41.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.342+0000 7f675be00640 1 -- 172.21.15.114:0/901966232 >> v1:172.21.15.114:6789/0 conn(0x7f675c06da90 legacy=0x7f675c0cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:41.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.342+0000 7f675b400640 1 -- 172.21.15.114:0/901966232 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506234742 0 0) 0x7f675c0cd220 con 0x7f675c06da90 2024-09-13T17:53:41.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.342+0000 7f675be00640 1 -- 172.21.15.114:0/901966232 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675c159bc0 con 0x7f675c13f420 2024-09-13T17:53:41.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.342+0000 7f675be00640 1 --2- 172.21.15.114:0/901966232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f675c13f420 0x7f675c06d550 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f67480097c0 tx=0x7f674801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815172960f30318d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:41.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.342+0000 7f675b400640 1 -- 172.21.15.114:0/901966232 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67480ab670 con 0x7f675c13f420 2024-09-13T17:53:41.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.342+0000 7f675b400640 1 -- 172.21.15.114:0/901966232 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67480ab7d0 con 0x7f675c13f420 2024-09-13T17:53:41.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.342+0000 7f675b400640 1 -- 172.21.15.114:0/901966232 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67480abb60 con 0x7f675c13f420 2024-09-13T17:53:41.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.346+0000 7f6763800640 1 -- 172.21.15.114:0/901966232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f675c13f420 msgr2=0x7f675c06d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:41.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.346+0000 7f6763800640 1 --2- 172.21.15.114:0/901966232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f675c13f420 0x7f675c06d550 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f67480097c0 tx=0x7f674801c470 comp rx=0 tx=0).stop 2024-09-13T17:53:41.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.346+0000 7f6763800640 1 -- 172.21.15.114:0/901966232 shutdown_connections 2024-09-13T17:53:41.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.346+0000 7f6763800640 1 --2- 172.21.15.114:0/901966232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f675c13f420 0x7f675c06d550 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:41.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.346+0000 7f6763800640 1 -- 172.21.15.114:0/901966232 >> 172.21.15.114:0/901966232 conn(0x7f675c0660b0 msgr2=0x7f675c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:41.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.346+0000 7f6763800640 1 -- 172.21.15.114:0/901966232 shutdown_connections 2024-09-13T17:53:41.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.346+0000 7f6763800640 1 -- 172.21.15.114:0/901966232 wait complete. 2024-09-13T17:53:41.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.346+0000 7f6763800640 1 Processor -- start 2024-09-13T17:53:41.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.346+0000 7f6763800640 1 -- start start 2024-09-13T17:53:41.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.346+0000 7f6763800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f675c06da90 0x7f675c15c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:41.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.346+0000 7f6763800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f675c13c240 0x7f675c151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:41.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.346+0000 7f6763800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f675c13f420 0x7f675c06c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:41.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.346+0000 7f6763800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675c15c060 con 0x7f675c06da90 2024-09-13T17:53:41.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.346+0000 7f6763800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675c15b3e0 con 0x7f675c13c240 2024-09-13T17:53:41.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.346+0000 7f6763800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675c15b6c0 con 0x7f675c13f420 2024-09-13T17:53:41.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.346+0000 7f6760e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f675c06da90 0x7f675c15c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:41.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.346+0000 7f6760e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f675c06da90 0x7f675c15c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43690/0 (socket says 172.21.15.114:43690) 2024-09-13T17:53:41.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.346+0000 7f6760e00640 1 -- 172.21.15.114:0/1579967327 learned_addr learned my addr 172.21.15.114:0/1579967327 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:41.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.346+0000 7f675be00640 1 --2- 172.21.15.114:0/1579967327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f675c13c240 0x7f675c151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:41.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.346+0000 7f6761800640 1 --2- 172.21.15.114:0/1579967327 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f675c13f420 0x7f675c06c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:41.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.346+0000 7f6760e00640 1 -- 172.21.15.114:0/1579967327 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f675c13f420 msgr2=0x7f675c06c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:41.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.346+0000 7f6760e00640 1 --2- 172.21.15.114:0/1579967327 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f675c13f420 0x7f675c06c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:41.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.346+0000 7f6760e00640 1 -- 172.21.15.114:0/1579967327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f675c13c240 msgr2=0x7f675c151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:41.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.346+0000 7f6760e00640 1 --2- 172.21.15.114:0/1579967327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f675c13c240 0x7f675c151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:41.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.346+0000 7f6760e00640 1 -- 172.21.15.114:0/1579967327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6748009420 con 0x7f675c06da90 2024-09-13T17:53:41.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.346+0000 7f6760e00640 1 --2- 172.21.15.114:0/1579967327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f675c06da90 0x7f675c15c480 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f674c00c500 tx=0x7f674c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:41.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.350+0000 7f6758c00640 1 -- 172.21.15.114:0/1579967327 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c005220 con 0x7f675c06da90 2024-09-13T17:53:41.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.350+0000 7f6758c00640 1 -- 172.21.15.114:0/1579967327 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674c005380 con 0x7f675c06da90 2024-09-13T17:53:41.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.350+0000 7f6763800640 1 -- 172.21.15.114:0/1579967327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f675c15b9a0 con 0x7f675c06da90 2024-09-13T17:53:41.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.350+0000 7f6758c00640 1 -- 172.21.15.114:0/1579967327 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c007270 con 0x7f675c06da90 2024-09-13T17:53:41.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.350+0000 7f6763800640 1 -- 172.21.15.114:0/1579967327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f675c151f60 con 0x7f675c06da90 2024-09-13T17:53:41.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.350+0000 7f6763800640 1 -- 172.21.15.114:0/1579967327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f675c0667b0 con 0x7f675c06da90 2024-09-13T17:53:41.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.350+0000 7f6758c00640 1 -- 172.21.15.114:0/1579967327 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f674c0073d0 con 0x7f675c06da90 2024-09-13T17:53:41.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.350+0000 7f6758c00640 1 --2- 172.21.15.114:0/1579967327 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f673c066690 0x7f673c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:41.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.350+0000 7f6758c00640 1 -- 172.21.15.114:0/1579967327 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f674c083830 con 0x7f675c06da90 2024-09-13T17:53:41.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.350+0000 7f675be00640 1 --2- 172.21.15.114:0/1579967327 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f673c066690 0x7f673c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:41.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.350+0000 7f675be00640 1 --2- 172.21.15.114:0/1579967327 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f673c066690 0x7f673c068b50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f67480af000 tx=0x7f67480a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:41.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.354+0000 7f6758c00640 1 -- 172.21.15.114:0/1579967327 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f674c050840 con 0x7f675c06da90 2024-09-13T17:53:41.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.542+0000 7f6763800640 1 -- 172.21.15.114:0/1579967327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f675c15a4c0 con 0x7f675c06da90 2024-09-13T17:53:41.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.542+0000 7f6758c00640 1 -- 172.21.15.114:0/1579967327 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+5951 (secure 0 0 0) 0x7f674c053e60 con 0x7f675c06da90 2024-09-13T17:53:41.548 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:41.548 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":27,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/1758700058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1758700058},{"type":"v1","addr":"172.21.15.134:6833","nonce":1758700058}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/4015015784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4015015784},{"type":"v1","addr":"172.21.15.134:6835","nonce":4015015784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2696640153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2696640153},{"type":"v1","addr":"172.21.15.114:6836","nonce":2696640153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:53:08.298484+0000","modified":"2024-09-13T17:53:22.929771+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:53:32.086012+0000","modified":"2024-09-13T17:53:41.422933+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5598":{"gid":5598,"name":"a","rank":0,"incarnation":25,"state":"up:rejoin","state_seq":7,"addr":"172.21.15.114:6837/2697286380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2697286380},{"type":"v1","addr":"172.21.15.114:6837","nonce":2697286380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T17:53:41.548 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 27 2024-09-13T17:53:41.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.542+0000 7f6763800640 1 -- 172.21.15.114:0/1579967327 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f673c066690 msgr2=0x7f673c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.542+0000 7f6763800640 1 --2- 172.21.15.114:0/1579967327 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f673c066690 0x7f673c068b50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f67480af000 tx=0x7f67480a7000 comp rx=0 tx=0).stop 2024-09-13T17:53:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.542+0000 7f6763800640 1 -- 172.21.15.114:0/1579967327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f675c06da90 msgr2=0x7f675c15c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.542+0000 7f6763800640 1 --2- 172.21.15.114:0/1579967327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f675c06da90 0x7f675c15c480 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f674c00c500 tx=0x7f674c00c9c0 comp rx=0 tx=0).stop 2024-09-13T17:53:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.542+0000 7f6763800640 1 -- 172.21.15.114:0/1579967327 shutdown_connections 2024-09-13T17:53:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.542+0000 7f6763800640 1 --2- 172.21.15.114:0/1579967327 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f673c066690 0x7f673c068b50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.542+0000 7f6763800640 1 --2- 172.21.15.114:0/1579967327 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f675c13f420 0x7f675c06c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.542+0000 7f6763800640 1 --2- 172.21.15.114:0/1579967327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f675c13c240 0x7f675c151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.542+0000 7f6763800640 1 --2- 172.21.15.114:0/1579967327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f675c06da90 0x7f675c15c480 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.542+0000 7f6763800640 1 -- 172.21.15.114:0/1579967327 >> 172.21.15.114:0/1579967327 conn(0x7f675c0660b0 msgr2=0x7f675c156350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.542+0000 7f6763800640 1 -- 172.21.15.114:0/1579967327 shutdown_connections 2024-09-13T17:53:41.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:41.542+0000 7f6763800640 1 -- 172.21.15.114:0/1579967327 wait complete. 2024-09-13T17:53:41.972 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:53:32.086012+0000', 'modified': '2024-09-13T17:53:41.422933+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5598}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5598': {'gid': 5598, 'name': 'a', 'rank': 0, 'incarnation': 25, 'state': 'up:rejoin', 'state_seq': 7, 'addr': '172.21.15.114:6837/2697286380', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6835', 'nonce': 2697286380}, {'type': 'v1', 'addr': '172.21.15.114:6837', 'nonce': 2697286380}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'recovery_fs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:53:41.972 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5598:up:rejoin 2024-09-13T17:53:42.973 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:53:43.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.114+0000 7f3dd1600640 1 Processor -- start 2024-09-13T17:53:43.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.114+0000 7f3dd1600640 1 -- start start 2024-09-13T17:53:43.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.114+0000 7f3dd1600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3dcc151420 0x7f3dcc0cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:43.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.114+0000 7f3dd1600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dcc070b30 0x7f3dcc06c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:43.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.114+0000 7f3dd1600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dcc151800 con 0x7f3dcc0ccba0 2024-09-13T17:53:43.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.114+0000 7f3dd1600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dcc0cbc30 con 0x7f3dcc151420 2024-09-13T17:53:43.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.114+0000 7f3dd1600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc0cafb0 con 0x7f3dcc070b30 2024-09-13T17:53:43.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.114+0000 7f3dc2000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3dcc0ccba0 0x7f3dcc070420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33776/0 (socket says 172.21.15.114:33776) 2024-09-13T17:53:43.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.114+0000 7f3dcaa00640 1 --2- 172.21.15.114:0/2255725142 >> v2:172.21.15.114:3300/0 conn(0x7f3dcc151420 0x7f3dcc0cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:43.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.114+0000 7f3dc2000640 1 -- 172.21.15.114:0/2255725142 learned_addr learned my addr 172.21.15.114:0/2255725142 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:43.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.118+0000 7f3dcb400640 1 --2- 172.21.15.114:0/2255725142 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dcc070b30 0x7f3dcc06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:43.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.118+0000 7f3dca000640 1 -- 172.21.15.114:0/2255725142 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 286150248 0 0) 0x7f3dcc151800 con 0x7f3dcc0ccba0 2024-09-13T17:53:43.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.118+0000 7f3dca000640 1 -- 172.21.15.114:0/2255725142 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3db0003530 con 0x7f3dcc0ccba0 2024-09-13T17:53:43.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.118+0000 7f3dcaa00640 1 -- 172.21.15.114:0/2255725142 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dcc070b30 msgr2=0x7f3dcc06c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:43.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.118+0000 7f3dcaa00640 1 --2- 172.21.15.114:0/2255725142 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dcc070b30 0x7f3dcc06c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.118+0000 7f3dcaa00640 1 -- 172.21.15.114:0/2255725142 >> v1:172.21.15.114:6789/0 conn(0x7f3dcc0ccba0 legacy=0x7f3dcc070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:43.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.118+0000 7f3dcaa00640 1 -- 172.21.15.114:0/2255725142 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dcc0cb290 con 0x7f3dcc151420 2024-09-13T17:53:43.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.118+0000 7f3dcaa00640 1 --2- 172.21.15.114:0/2255725142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dcc151420 0x7f3dcc0cc660 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0097c0 tx=0x7f3dbc01c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a35c6cb984844b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:43.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.118+0000 7f3dca000640 1 -- 172.21.15.114:0/2255725142 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc004230 con 0x7f3dcc151420 2024-09-13T17:53:43.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.118+0000 7f3dca000640 1 -- 172.21.15.114:0/2255725142 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dbc0a7050 con 0x7f3dcc151420 2024-09-13T17:53:43.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.118+0000 7f3dca000640 1 -- 172.21.15.114:0/2255725142 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc003620 con 0x7f3dcc151420 2024-09-13T17:53:43.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.122+0000 7f3dd1600640 1 -- 172.21.15.114:0/2255725142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dcc151420 msgr2=0x7f3dcc0cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:43.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.122+0000 7f3dd1600640 1 --2- 172.21.15.114:0/2255725142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dcc151420 0x7f3dcc0cc660 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0097c0 tx=0x7f3dbc01c350 comp rx=0 tx=0).stop 2024-09-13T17:53:43.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.122+0000 7f3dd1600640 1 -- 172.21.15.114:0/2255725142 shutdown_connections 2024-09-13T17:53:43.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.122+0000 7f3dd1600640 1 --2- 172.21.15.114:0/2255725142 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dcc070b30 0x7f3dcc06c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.122+0000 7f3dd1600640 1 --2- 172.21.15.114:0/2255725142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dcc151420 0x7f3dcc0cc660 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.122+0000 7f3dd1600640 1 -- 172.21.15.114:0/2255725142 >> 172.21.15.114:0/2255725142 conn(0x7f3dcc0660b0 msgr2=0x7f3dcc069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:43.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.122+0000 7f3dd1600640 1 -- 172.21.15.114:0/2255725142 shutdown_connections 2024-09-13T17:53:43.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.122+0000 7f3dd1600640 1 -- 172.21.15.114:0/2255725142 wait complete. 2024-09-13T17:53:43.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.122+0000 7f3dd1600640 1 Processor -- start 2024-09-13T17:53:43.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.122+0000 7f3dd1600640 1 -- start start 2024-09-13T17:53:43.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.122+0000 7f3dd1600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dcc070b30 0x7f3dcc14ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:43.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.122+0000 7f3dd1600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dcc0ccba0 0x7f3dcc0afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:43.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.122+0000 7f3dd1600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dcc151420 0x7f3dcc0b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:43.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.122+0000 7f3dd1600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc0af8f0 con 0x7f3dcc070b30 2024-09-13T17:53:43.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.122+0000 7f3dd1600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc0af4d0 con 0x7f3dcc151420 2024-09-13T17:53:43.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.122+0000 7f3dd1600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc14f460 con 0x7f3dcc0ccba0 2024-09-13T17:53:43.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.122+0000 7f3dcaa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dcc070b30 0x7f3dcc14ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:43.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.122+0000 7f3dcaa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dcc070b30 0x7f3dcc14ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43708/0 (socket says 172.21.15.114:43708) 2024-09-13T17:53:43.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.122+0000 7f3dcaa00640 1 -- 172.21.15.114:0/891441559 learned_addr learned my addr 172.21.15.114:0/891441559 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:43.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.122+0000 7f3dc2000640 1 --2- 172.21.15.114:0/891441559 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dcc0ccba0 0x7f3dcc0afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:43.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.122+0000 7f3dcb400640 1 --2- 172.21.15.114:0/891441559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dcc151420 0x7f3dcc0b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:43.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.122+0000 7f3dcaa00640 1 -- 172.21.15.114:0/891441559 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dcc0ccba0 msgr2=0x7f3dcc0afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:43.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.122+0000 7f3dcaa00640 1 --2- 172.21.15.114:0/891441559 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dcc0ccba0 0x7f3dcc0afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.122+0000 7f3dcaa00640 1 -- 172.21.15.114:0/891441559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dcc151420 msgr2=0x7f3dcc0b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:43.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.122+0000 7f3dcaa00640 1 --2- 172.21.15.114:0/891441559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dcc151420 0x7f3dcc0b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.122+0000 7f3dcaa00640 1 -- 172.21.15.114:0/891441559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dbc009420 con 0x7f3dcc070b30 2024-09-13T17:53:43.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.122+0000 7f3dc2000640 1 --2- 172.21.15.114:0/891441559 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dcc0ccba0 0x7f3dcc0afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:43.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.122+0000 7f3dcaa00640 1 --2- 172.21.15.114:0/891441559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dcc070b30 0x7f3dcc14ef20 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0097c0 tx=0x7f3dbc0190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:43.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.126+0000 7f3dc3400640 1 -- 172.21.15.114:0/891441559 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc003af0 con 0x7f3dcc070b30 2024-09-13T17:53:43.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.126+0000 7f3dc3400640 1 -- 172.21.15.114:0/891441559 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dbc003c50 con 0x7f3dcc070b30 2024-09-13T17:53:43.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.126+0000 7f3dc3400640 1 -- 172.21.15.114:0/891441559 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc0ab440 con 0x7f3dcc070b30 2024-09-13T17:53:43.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.126+0000 7f3dd1600640 1 -- 172.21.15.114:0/891441559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dcc0ae5b0 con 0x7f3dcc070b30 2024-09-13T17:53:43.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.126+0000 7f3dd1600640 1 -- 172.21.15.114:0/891441559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dcc0aeb30 con 0x7f3dcc070b30 2024-09-13T17:53:43.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.126+0000 7f3dd1600640 1 -- 172.21.15.114:0/891441559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dcc06c540 con 0x7f3dcc070b30 2024-09-13T17:53:43.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.126+0000 7f3dc3400640 1 -- 172.21.15.114:0/891441559 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3dbc0b2040 con 0x7f3dcc070b30 2024-09-13T17:53:43.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.126+0000 7f3dc3400640 1 --2- 172.21.15.114:0/891441559 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3da80666c0 0x7f3da8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:43.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.126+0000 7f3dc3400640 1 -- 172.21.15.114:0/891441559 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f3dbc11e2d0 con 0x7f3dcc070b30 2024-09-13T17:53:43.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.126+0000 7f3dc2000640 1 --2- 172.21.15.114:0/891441559 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3da80666c0 0x7f3da8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:43.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.126+0000 7f3dc2000640 1 --2- 172.21.15.114:0/891441559 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3da80666c0 0x7f3da8068b80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc157b60 tx=0x7f3db4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:43.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.130+0000 7f3dc3400640 1 -- 172.21.15.114:0/891441559 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3dbc0eb2b0 con 0x7f3dcc070b30 2024-09-13T17:53:43.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.318+0000 7f3dd1600640 1 -- 172.21.15.114:0/891441559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3dcc15d3a0 con 0x7f3dcc070b30 2024-09-13T17:53:43.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.318+0000 7f3dc3400640 1 -- 172.21.15.114:0/891441559 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+5951 (secure 0 0 0) 0x7f3dbc0ee8d0 con 0x7f3dcc070b30 2024-09-13T17:53:43.325 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:43.325 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/1758700058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1758700058},{"type":"v1","addr":"172.21.15.134:6833","nonce":1758700058}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/4015015784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4015015784},{"type":"v1","addr":"172.21.15.134:6835","nonce":4015015784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2696640153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2696640153},{"type":"v1","addr":"172.21.15.114:6836","nonce":2696640153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:53:08.298484+0000","modified":"2024-09-13T17:53:22.929771+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:53:32.086012+0000","modified":"2024-09-13T17:53:42.428826+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5598":{"gid":5598,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6837/2697286380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2697286380},{"type":"v1","addr":"172.21.15.114:6837","nonce":2697286380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T17:53:43.325 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 28 2024-09-13T17:53:43.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.322+0000 7f3dd1600640 1 -- 172.21.15.114:0/891441559 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3da80666c0 msgr2=0x7f3da8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:43.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.322+0000 7f3dd1600640 1 --2- 172.21.15.114:0/891441559 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3da80666c0 0x7f3da8068b80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc157b60 tx=0x7f3db4009040 comp rx=0 tx=0).stop 2024-09-13T17:53:43.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.322+0000 7f3dd1600640 1 -- 172.21.15.114:0/891441559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dcc070b30 msgr2=0x7f3dcc14ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:43.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.322+0000 7f3dd1600640 1 --2- 172.21.15.114:0/891441559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dcc070b30 0x7f3dcc14ef20 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0097c0 tx=0x7f3dbc0190f0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.322+0000 7f3dd1600640 1 -- 172.21.15.114:0/891441559 shutdown_connections 2024-09-13T17:53:43.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.322+0000 7f3dd1600640 1 --2- 172.21.15.114:0/891441559 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3da80666c0 0x7f3da8068b80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.322+0000 7f3dd1600640 1 --2- 172.21.15.114:0/891441559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3dcc151420 0x7f3dcc0b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.322+0000 7f3dd1600640 1 --2- 172.21.15.114:0/891441559 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3dcc0ccba0 0x7f3dcc0afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.322+0000 7f3dd1600640 1 --2- 172.21.15.114:0/891441559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3dcc070b30 0x7f3dcc14ef20 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.322+0000 7f3dd1600640 1 -- 172.21.15.114:0/891441559 >> 172.21.15.114:0/891441559 conn(0x7f3dcc0660b0 msgr2=0x7f3dcc157cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:43.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.322+0000 7f3dd1600640 1 -- 172.21.15.114:0/891441559 shutdown_connections 2024-09-13T17:53:43.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.322+0000 7f3dd1600640 1 -- 172.21.15.114:0/891441559 wait complete. 2024-09-13T17:53:43.697 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:53:43.701 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:53:43.750 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T17:53:32.086012+0000', 'modified': '2024-09-13T17:53:42.428826+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5598}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5598': {'gid': 5598, 'name': 'a', 'rank': 0, 'incarnation': 25, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.114:6837/2697286380', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6835', 'nonce': 2697286380}, {'type': 'v1', 'addr': '172.21.15.114:6837', 'nonce': 2697286380}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'recovery_fs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T17:53:43.750 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T17:53:43.750 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T17:53:43.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.882+0000 7f4260400640 1 Processor -- start 2024-09-13T17:53:43.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.882+0000 7f4260400640 1 -- start start 2024-09-13T17:53:43.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.882+0000 7f4260400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4258151420 0x7f42580cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:43.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.882+0000 7f4260400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4258070b30 0x7f425806c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:43.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.882+0000 7f4260400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4258151800 con 0x7f42580ccba0 2024-09-13T17:53:43.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.882+0000 7f4260400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42580cbc30 con 0x7f4258151420 2024-09-13T17:53:43.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.882+0000 7f4260400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42580cafb0 con 0x7f4258070b30 2024-09-13T17:53:43.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.882+0000 7f425da00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4258151420 0x7f42580cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:43.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.882+0000 7f425da00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4258151420 0x7f42580cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43720/0 (socket says 172.21.15.114:43720) 2024-09-13T17:53:43.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.882+0000 7f425da00640 1 -- 172.21.15.114:0/363384582 learned_addr learned my addr 172.21.15.114:0/363384582 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:43.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.882+0000 7f425e400640 1 --2- 172.21.15.114:0/363384582 >> v2:172.21.15.134:3300/0 conn(0x7f4258070b30 0x7f425806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:43.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.882+0000 7f425da00640 1 -- 172.21.15.114:0/363384582 >> v2:172.21.15.134:3300/0 conn(0x7f4258070b30 msgr2=0x7f425806c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:43.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.882+0000 7f425da00640 1 --2- 172.21.15.114:0/363384582 >> v2:172.21.15.134:3300/0 conn(0x7f4258070b30 0x7f425806c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.882+0000 7f425da00640 1 -- 172.21.15.114:0/363384582 >> v1:172.21.15.134:6789/0 conn(0x7f42580ccba0 legacy=0x7f4258070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:43.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.882+0000 7f425da00640 1 -- 172.21.15.114:0/363384582 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42580cb290 con 0x7f4258151420 2024-09-13T17:53:43.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.882+0000 7f425e400640 1 --2- 172.21.15.114:0/363384582 >> v2:172.21.15.134:3300/0 conn(0x7f4258070b30 0x7f425806c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:43.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.886+0000 7f425da00640 1 --2- 172.21.15.114:0/363384582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4258151420 0x7f42580cc660 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f42580b3980 tx=0x7f424c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ded3805aa5f4c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:43.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.886+0000 7f4257e00640 1 -- 172.21.15.114:0/363384582 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c0ab600 con 0x7f4258151420 2024-09-13T17:53:43.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.886+0000 7f4257e00640 1 -- 172.21.15.114:0/363384582 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424c0a7050 con 0x7f4258151420 2024-09-13T17:53:43.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.886+0000 7f4257e00640 1 -- 172.21.15.114:0/363384582 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c0ab980 con 0x7f4258151420 2024-09-13T17:53:43.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.886+0000 7f4260400640 1 -- 172.21.15.114:0/363384582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4258151420 msgr2=0x7f42580cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:43.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.886+0000 7f4260400640 1 --2- 172.21.15.114:0/363384582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4258151420 0x7f42580cc660 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f42580b3980 tx=0x7f424c01c370 comp rx=0 tx=0).stop 2024-09-13T17:53:43.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.886+0000 7f4260400640 1 -- 172.21.15.114:0/363384582 shutdown_connections 2024-09-13T17:53:43.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.886+0000 7f4260400640 1 --2- 172.21.15.114:0/363384582 >> v2:172.21.15.134:3300/0 conn(0x7f4258070b30 0x7f425806c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.886+0000 7f4260400640 1 --2- 172.21.15.114:0/363384582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4258151420 0x7f42580cc660 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.886+0000 7f4260400640 1 -- 172.21.15.114:0/363384582 >> 172.21.15.114:0/363384582 conn(0x7f42580660b0 msgr2=0x7f4258069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:43.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.886+0000 7f4260400640 1 -- 172.21.15.114:0/363384582 shutdown_connections 2024-09-13T17:53:43.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.886+0000 7f4260400640 1 -- 172.21.15.114:0/363384582 wait complete. 2024-09-13T17:53:43.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.890+0000 7f4260400640 1 Processor -- start 2024-09-13T17:53:43.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.890+0000 7f4260400640 1 -- start start 2024-09-13T17:53:43.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.890+0000 7f4260400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4258070b30 0x7f4258154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:43.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.890+0000 7f4260400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42580ccba0 0x7f4258152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:43.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.890+0000 7f4260400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4258151420 0x7f425814b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:43.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.890+0000 7f4260400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425814bfa0 con 0x7f42580ccba0 2024-09-13T17:53:43.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.890+0000 7f4260400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4258152cc0 con 0x7f4258070b30 2024-09-13T17:53:43.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.890+0000 7f4260400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4258152f10 con 0x7f4258151420 2024-09-13T17:53:43.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.890+0000 7f425d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42580ccba0 0x7f4258152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:43.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.890+0000 7f425d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42580ccba0 0x7f4258152780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43722/0 (socket says 172.21.15.114:43722) 2024-09-13T17:53:43.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.890+0000 7f425d000640 1 -- 172.21.15.114:0/1303016318 learned_addr learned my addr 172.21.15.114:0/1303016318 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:43.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.890+0000 7f425da00640 1 --2- 172.21.15.114:0/1303016318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4258070b30 0x7f4258154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:43.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.890+0000 7f425e400640 1 --2- 172.21.15.114:0/1303016318 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4258151420 0x7f425814b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:43.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.890+0000 7f425d000640 1 -- 172.21.15.114:0/1303016318 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4258151420 msgr2=0x7f425814b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:43.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.890+0000 7f425d000640 1 --2- 172.21.15.114:0/1303016318 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4258151420 0x7f425814b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.890+0000 7f425d000640 1 -- 172.21.15.114:0/1303016318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4258070b30 msgr2=0x7f4258154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:43.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.890+0000 7f425d000640 1 --2- 172.21.15.114:0/1303016318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4258070b30 0x7f4258154740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.890+0000 7f425d000640 1 -- 172.21.15.114:0/1303016318 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424c0094d0 con 0x7f42580ccba0 2024-09-13T17:53:43.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.890+0000 7f425da00640 1 --2- 172.21.15.114:0/1303016318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4258070b30 0x7f4258154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:43.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.890+0000 7f425d000640 1 --2- 172.21.15.114:0/1303016318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42580ccba0 0x7f4258152780 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f424400c450 tx=0x7f424400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:43.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.890+0000 7f4255600640 1 -- 172.21.15.114:0/1303016318 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4244012830 con 0x7f42580ccba0 2024-09-13T17:53:43.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.890+0000 7f4255600640 1 -- 172.21.15.114:0/1303016318 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42440129b0 con 0x7f42580ccba0 2024-09-13T17:53:43.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.890+0000 7f4255600640 1 -- 172.21.15.114:0/1303016318 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4244012d60 con 0x7f42580ccba0 2024-09-13T17:53:43.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.890+0000 7f4260400640 1 -- 172.21.15.114:0/1303016318 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42581531f0 con 0x7f42580ccba0 2024-09-13T17:53:43.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.890+0000 7f4260400640 1 -- 172.21.15.114:0/1303016318 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42581537b0 con 0x7f42580ccba0 2024-09-13T17:53:43.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.894+0000 7f4255600640 1 -- 172.21.15.114:0/1303016318 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f424401c460 con 0x7f42580ccba0 2024-09-13T17:53:43.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.894+0000 7f4255600640 1 --2- 172.21.15.114:0/1303016318 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4238066690 0x7f4238068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:43.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.894+0000 7f4255600640 1 -- 172.21.15.114:0/1303016318 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f4244084440 con 0x7f42580ccba0 2024-09-13T17:53:43.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.894+0000 7f425da00640 1 --2- 172.21.15.114:0/1303016318 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4238066690 0x7f4238068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:43.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.894+0000 7f426385f000 1 Processor -- start 2024-09-13T17:53:43.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.894+0000 7f426385f000 1 -- start start 2024-09-13T17:53:43.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.894+0000 7f425da00640 1 --2- 172.21.15.114:0/1303016318 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4238066690 0x7f4238068b50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f424c0ad000 tx=0x7f424c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:43.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.894+0000 7f426385f000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560a9564e1f0 0x560a9564e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:43.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.894+0000 7f426385f000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a9564eb10 0x560a95604200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:43.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.894+0000 7f426385f000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a95604740 0x560a95604b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:43.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.894+0000 7f426385f000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a954cce80 con 0x560a9564eb10 2024-09-13T17:53:43.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.894+0000 7f426385f000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a9545aaf0 con 0x560a95604740 2024-09-13T17:53:43.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.894+0000 7f426385f000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x560a954580c0 con 0x560a9564e1f0 2024-09-13T17:53:43.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f425d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a9564eb10 0x560a95604200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:43.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f425d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a9564eb10 0x560a95604200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43732/0 (socket says 172.21.15.114:43732) 2024-09-13T17:53:43.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f425d000640 1 -- 172.21.15.114:0/2543424353 learned_addr learned my addr 172.21.15.114:0/2543424353 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:43.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f425da00640 1 --2- 172.21.15.114:0/2543424353 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560a9564e1f0 0x560a9564e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:43.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f425e400640 1 --2- 172.21.15.114:0/2543424353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a95604740 0x560a95604b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:43.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f425d000640 1 -- 172.21.15.114:0/2543424353 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560a9564e1f0 msgr2=0x560a9564e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:43.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f425d000640 1 --2- 172.21.15.114:0/2543424353 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560a9564e1f0 0x560a9564e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f425d000640 1 -- 172.21.15.114:0/2543424353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a95604740 msgr2=0x560a95604b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:43.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f425d000640 1 --2- 172.21.15.114:0/2543424353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a95604740 0x560a95604b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f425d000640 1 -- 172.21.15.114:0/2543424353 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a9514f890 con 0x560a9564eb10 2024-09-13T17:53:43.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f425e400640 1 --2- 172.21.15.114:0/2543424353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a95604740 0x560a95604b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:43.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f425d000640 1 --2- 172.21.15.114:0/2543424353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a9564eb10 0x560a95604200 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f424400ce10 tx=0x7f4244054ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da5f3e97dc95e0f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:43.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f424a000640 1 -- 172.21.15.114:0/2543424353 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424405b0b0 con 0x560a9564eb10 2024-09-13T17:53:43.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f424a000640 1 -- 172.21.15.114:0/2543424353 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4244068e90 con 0x560a9564eb10 2024-09-13T17:53:43.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f424a000640 1 -- 172.21.15.114:0/2543424353 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4244051760 con 0x560a9564eb10 2024-09-13T17:53:43.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f426385f000 1 -- 172.21.15.114:0/2543424353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a9564eb10 msgr2=0x560a95604200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:43.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f426385f000 1 --2- 172.21.15.114:0/2543424353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a9564eb10 0x560a95604200 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f424400ce10 tx=0x7f4244054ae0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f426385f000 1 -- 172.21.15.114:0/2543424353 shutdown_connections 2024-09-13T17:53:43.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f426385f000 1 --2- 172.21.15.114:0/2543424353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a95604740 0x560a95604b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f426385f000 1 --2- 172.21.15.114:0/2543424353 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a9564eb10 0x560a95604200 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f426385f000 1 --2- 172.21.15.114:0/2543424353 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560a9564e1f0 0x560a9564e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f426385f000 1 -- 172.21.15.114:0/2543424353 >> 172.21.15.114:0/2543424353 conn(0x560a9560afb0 msgr2=0x560a9560b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:43.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f426385f000 1 -- 172.21.15.114:0/2543424353 shutdown_connections 2024-09-13T17:53:43.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f426385f000 1 -- 172.21.15.114:0/2543424353 wait complete. 2024-09-13T17:53:43.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f426385f000 1 -- start start 2024-09-13T17:53:43.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f426385f000 1 Processor -- start 2024-09-13T17:53:43.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f426385f000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a95604740 0x560a9560ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:43.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f426385f000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560a9564e1f0 0x560a956104f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:43.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f426385f000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a9564eb10 0x560a95610a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:43.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f426385f000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a954539b0 con 0x560a9564eb10 2024-09-13T17:53:43.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f426385f000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a953f2c00 con 0x560a95604740 2024-09-13T17:53:43.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f426385f000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x560a95411070 con 0x560a9564e1f0 2024-09-13T17:53:43.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f426385f000 10 client.0 _ll_register_callbacks cb 0x560a955f0ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:53:43.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f425e400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a9564eb10 0x560a95610a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:43.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f425e400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a9564eb10 0x560a95610a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43746/0 (socket says 172.21.15.114:43746) 2024-09-13T17:53:43.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f425e400640 1 -- 172.21.15.114:0/415810813 learned_addr learned my addr 172.21.15.114:0/415810813 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:43.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f425da00640 1 --2- 172.21.15.114:0/415810813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a95604740 0x560a9560ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:43.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.898+0000 7f425d000640 1 --2- 172.21.15.114:0/415810813 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560a9564e1f0 0x560a956104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:43.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f425e400640 1 -- 172.21.15.114:0/415810813 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560a9564e1f0 msgr2=0x560a956104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:43.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f425e400640 1 --2- 172.21.15.114:0/415810813 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560a9564e1f0 0x560a956104f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f425e400640 1 -- 172.21.15.114:0/415810813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a95604740 msgr2=0x560a9560ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:43.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f425e400640 1 --2- 172.21.15.114:0/415810813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a95604740 0x560a9560ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f425e400640 1 -- 172.21.15.114:0/415810813 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42581537b0 con 0x560a9564eb10 2024-09-13T17:53:43.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f425e400640 1 --2- 172.21.15.114:0/415810813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a9564eb10 0x560a95610a30 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f425000ebc0 tx=0x7f425000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fefa086726973c19 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:43.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f423ea00640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-13T17:53:43.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f423ea00640 1 -- 172.21.15.114:0/415810813 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4250013070 con 0x560a9564eb10 2024-09-13T17:53:43.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f423ea00640 1 -- 172.21.15.114:0/415810813 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f425000a620 con 0x560a9564eb10 2024-09-13T17:53:43.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f426385f000 1 -- 172.21.15.114:0/415810813 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560a954105f0 con 0x560a9564eb10 2024-09-13T17:53:43.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f423ea00640 1 -- 172.21.15.114:0/415810813 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4250007b20 con 0x560a9564eb10 2024-09-13T17:53:43.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f426385f000 10 client.5877 fetch_fsmap learned FSMap version 28 2024-09-13T17:53:43.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f426385f000 1 -- 172.21.15.114:0/415810813 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x560a95418ab0 con 0x560a9564eb10 2024-09-13T17:53:43.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f423ea00640 1 -- 172.21.15.114:0/415810813 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560a954105f0 con 0x560a9564eb10 2024-09-13T17:53:43.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f423ea00640 1 -- 172.21.15.114:0/415810813 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 28) v1 ==== 3687+0+0 (secure 0 0 0) 0x7f4250008040 con 0x560a9564eb10 2024-09-13T17:53:43.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f426385f000 10 client.5877 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T17:53:43.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f426385f000 10 client.5877 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T17:53:43.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f426385f000 20 client.5877 populate_metadata read hostname 'smithi114' 2024-09-13T17:53:43.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f426385f000 1 --2- 172.21.15.114:0/415810813 >> [v2:172.21.15.114:6835/2697286380,v1:172.21.15.114:6837/2697286380] conn(0x560a95611440 0x560a956602a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:43.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f426385f000 4 client.5877 mds_command: new command op to 5598 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:53:43.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f426385f000 1 -- 172.21.15.114:0/415810813 --> [v2:172.21.15.114:6835/2697286380,v1:172.21.15.114:6837/2697286380] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560a95450790 con 0x560a95611440 2024-09-13T17:53:43.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f425da00640 1 --2- 172.21.15.114:0/415810813 >> [v2:172.21.15.114:6835/2697286380,v1:172.21.15.114:6837/2697286380] conn(0x560a95611440 0x560a956602a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:43.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f425da00640 1 --2- 172.21.15.114:0/415810813 >> [v2:172.21.15.114:6835/2697286380,v1:172.21.15.114:6837/2697286380] conn(0x560a95611440 0x560a956602a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4df5958134ba8c0 server_cookie=75531aa870abaecc in_seq=0 out_seq=0 2024-09-13T17:53:43.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f423ea00640 10 client.5877 ms_handle_connect on v2:172.21.15.114:6835/2697286380 2024-09-13T17:53:43.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f423ea00640 1 -- 172.21.15.114:0/415810813 <== mds.0 v2:172.21.15.114:6835/2697286380 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x560a95450790 con 0x560a95611440 2024-09-13T17:53:43.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f423ea00640 10 client.5877 handle_command_reply: tid=0 2024-09-13T17:53:43.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f426385f000 1 client.5877 shutdown 2024-09-13T17:53:43.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f426385f000 1 -- 172.21.15.114:0/415810813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a9564eb10 msgr2=0x560a95610a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:43.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f426385f000 1 --2- 172.21.15.114:0/415810813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a9564eb10 0x560a95610a30 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f425000ebc0 tx=0x7f425000c7f0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f426385f000 1 -- 172.21.15.114:0/415810813 shutdown_connections 2024-09-13T17:53:43.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f426385f000 1 --2- 172.21.15.114:0/415810813 >> [v2:172.21.15.114:6835/2697286380,v1:172.21.15.114:6837/2697286380] conn(0x560a95611440 0x560a956602a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f426385f000 1 --2- 172.21.15.114:0/415810813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a9564eb10 0x560a95610a30 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f426385f000 1 --2- 172.21.15.114:0/415810813 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560a9564e1f0 0x560a956104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f426385f000 1 --2- 172.21.15.114:0/415810813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a95604740 0x560a9560ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f423ea00640 0 client.5877 ms_handle_reset on v2:172.21.15.114:6835/2697286380 2024-09-13T17:53:43.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f426385f000 1 -- 172.21.15.114:0/415810813 >> 172.21.15.114:0/415810813 conn(0x560a9560afb0 msgr2=0x560a956031f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:43.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f426385f000 1 -- 172.21.15.114:0/415810813 shutdown_connections 2024-09-13T17:53:43.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f426385f000 1 -- 172.21.15.114:0/415810813 wait complete. 2024-09-13T17:53:43.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.902+0000 7f426385f000 20 client.5877 trim_cache size 0 max 16384 2024-09-13T17:53:43.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.918+0000 7f426385f000 1 Processor -- start 2024-09-13T17:53:43.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.918+0000 7f426385f000 1 -- start start 2024-09-13T17:53:43.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.918+0000 7f426385f000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a95604740 0x560a956b2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:43.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.918+0000 7f426385f000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a9564e1f0 0x560a956b3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:43.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.918+0000 7f426385f000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560a9564eb10 0x560a956b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:43.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.918+0000 7f426385f000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a95110940 con 0x560a9564e1f0 2024-09-13T17:53:43.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.918+0000 7f426385f000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a954484d0 con 0x560a95604740 2024-09-13T17:53:43.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.918+0000 7f426385f000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x560a954965f0 con 0x560a9564eb10 2024-09-13T17:53:43.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.918+0000 7f425d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a9564e1f0 0x560a956b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:43.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.918+0000 7f425d000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a9564e1f0 0x560a956b3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43754/0 (socket says 172.21.15.114:43754) 2024-09-13T17:53:43.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.918+0000 7f425d000640 1 -- 172.21.15.114:0/1087001510 learned_addr learned my addr 172.21.15.114:0/1087001510 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:43.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f425e400640 1 --2- 172.21.15.114:0/1087001510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560a9564eb10 0x560a956b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:43.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f425da00640 1 --2- 172.21.15.114:0/1087001510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a95604740 0x560a956b2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:43.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f425d000640 1 -- 172.21.15.114:0/1087001510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560a9564eb10 msgr2=0x560a956b35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:43.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f425d000640 1 --2- 172.21.15.114:0/1087001510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560a9564eb10 0x560a956b35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f425d000640 1 -- 172.21.15.114:0/1087001510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a95604740 msgr2=0x560a956b2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:43.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f425d000640 1 --2- 172.21.15.114:0/1087001510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a95604740 0x560a956b2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f425d000640 1 -- 172.21.15.114:0/1087001510 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a953fec00 con 0x560a9564e1f0 2024-09-13T17:53:43.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f425e400640 1 --2- 172.21.15.114:0/1087001510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560a9564eb10 0x560a956b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:43.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f425da00640 1 --2- 172.21.15.114:0/1087001510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a95604740 0x560a956b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:43.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f425d000640 1 --2- 172.21.15.114:0/1087001510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a9564e1f0 0x560a956b3080 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f424405d600 tx=0x7f4244014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b178a01986ce171a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:43.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f424aa00640 1 -- 172.21.15.114:0/1087001510 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4244051390 con 0x560a9564e1f0 2024-09-13T17:53:43.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f424aa00640 1 -- 172.21.15.114:0/1087001510 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4244068e90 con 0x560a9564e1f0 2024-09-13T17:53:43.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f424aa00640 1 -- 172.21.15.114:0/1087001510 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42440822a0 con 0x560a9564e1f0 2024-09-13T17:53:43.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f426385f000 1 -- 172.21.15.114:0/1087001510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a9564e1f0 msgr2=0x560a956b3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:43.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f426385f000 1 --2- 172.21.15.114:0/1087001510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a9564e1f0 0x560a956b3080 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f424405d600 tx=0x7f4244014000 comp rx=0 tx=0).stop 2024-09-13T17:53:43.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f426385f000 1 -- 172.21.15.114:0/1087001510 shutdown_connections 2024-09-13T17:53:43.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f426385f000 1 --2- 172.21.15.114:0/1087001510 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560a9564eb10 0x560a956b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f426385f000 1 --2- 172.21.15.114:0/1087001510 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a9564e1f0 0x560a956b3080 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f426385f000 1 --2- 172.21.15.114:0/1087001510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a95604740 0x560a956b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f426385f000 1 -- 172.21.15.114:0/1087001510 >> 172.21.15.114:0/1087001510 conn(0x560a9560afb0 msgr2=0x560a956029d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:43.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f426385f000 1 -- 172.21.15.114:0/1087001510 shutdown_connections 2024-09-13T17:53:43.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f426385f000 1 -- 172.21.15.114:0/1087001510 wait complete. 2024-09-13T17:53:43.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f426385f000 1 -- start start 2024-09-13T17:53:43.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f426385f000 1 Processor -- start 2024-09-13T17:53:43.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f426385f000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a95604740 0x560a956b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:43.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f426385f000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560a9564e1f0 0x560a956bab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:43.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f426385f000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a9564eb10 0x560a956bd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:43.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f426385f000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a95604300 con 0x560a9564eb10 2024-09-13T17:53:43.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f426385f000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a9540cf80 con 0x560a95604740 2024-09-13T17:53:43.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f426385f000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x560a955fc6d0 con 0x560a9564e1f0 2024-09-13T17:53:43.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f426385f000 10 client.0 _ll_register_callbacks cb 0x7f4244054e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:53:43.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f425e400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a9564eb10 0x560a956bd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:43.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f425e400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a9564eb10 0x560a956bd0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43770/0 (socket says 172.21.15.114:43770) 2024-09-13T17:53:43.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f425e400640 1 -- 172.21.15.114:0/3080419932 learned_addr learned my addr 172.21.15.114:0/3080419932 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:43.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f425da00640 1 --2- 172.21.15.114:0/3080419932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a95604740 0x560a956b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:43.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f425d000640 1 --2- 172.21.15.114:0/3080419932 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560a9564e1f0 0x560a956bab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:43.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f425e400640 1 -- 172.21.15.114:0/3080419932 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560a9564e1f0 msgr2=0x560a956bab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:43.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f425e400640 1 --2- 172.21.15.114:0/3080419932 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560a9564e1f0 0x560a956bab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f425e400640 1 -- 172.21.15.114:0/3080419932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a95604740 msgr2=0x560a956b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:43.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f425e400640 1 --2- 172.21.15.114:0/3080419932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a95604740 0x560a956b5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.922+0000 7f425e400640 1 -- 172.21.15.114:0/3080419932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560a9514f890 con 0x560a9564eb10 2024-09-13T17:53:43.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f425e400640 1 --2- 172.21.15.114:0/3080419932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a9564eb10 0x560a956bd0e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f425000e550 tx=0x7f4250013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e5c0855befb73e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:43.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f423ea00640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-13T17:53:43.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f423ea00640 1 -- 172.21.15.114:0/3080419932 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425002a030 con 0x560a9564eb10 2024-09-13T17:53:43.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f423ea00640 1 -- 172.21.15.114:0/3080419932 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f425002b070 con 0x560a9564eb10 2024-09-13T17:53:43.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f426385f000 1 -- 172.21.15.114:0/3080419932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560a95423460 con 0x560a9564eb10 2024-09-13T17:53:43.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f423ea00640 1 -- 172.21.15.114:0/3080419932 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f425000e800 con 0x560a9564eb10 2024-09-13T17:53:43.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f426385f000 10 client.5883 fetch_fsmap learned FSMap version 28 2024-09-13T17:53:43.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f426385f000 1 -- 172.21.15.114:0/3080419932 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x560a9514fcc0 con 0x560a9564eb10 2024-09-13T17:53:43.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f423ea00640 1 -- 172.21.15.114:0/3080419932 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560a95423460 con 0x560a9564eb10 2024-09-13T17:53:43.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f423ea00640 1 -- 172.21.15.114:0/3080419932 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 28) v1 ==== 3687+0+0 (secure 0 0 0) 0x7f425002e360 con 0x560a9564eb10 2024-09-13T17:53:43.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f426385f000 10 client.5883 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T17:53:43.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f426385f000 10 client.5883 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T17:53:43.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f426385f000 20 client.5883 populate_metadata read hostname 'smithi114' 2024-09-13T17:53:43.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f426385f000 1 --2- 172.21.15.114:0/3080419932 >> [v2:172.21.15.114:6835/2697286380,v1:172.21.15.114:6837/2697286380] conn(0x560a956bd620 0x560a956bfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:43.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f426385f000 4 client.5883 mds_command: new command op to 5598 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T17:53:43.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f426385f000 1 -- 172.21.15.114:0/3080419932 --> [v2:172.21.15.114:6835/2697286380,v1:172.21.15.114:6837/2697286380] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560a9541c9c0 con 0x560a956bd620 2024-09-13T17:53:43.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f425da00640 1 --2- 172.21.15.114:0/3080419932 >> [v2:172.21.15.114:6835/2697286380,v1:172.21.15.114:6837/2697286380] conn(0x560a956bd620 0x560a956bfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:43.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f425da00640 1 --2- 172.21.15.114:0/3080419932 >> [v2:172.21.15.114:6835/2697286380,v1:172.21.15.114:6837/2697286380] conn(0x560a956bd620 0x560a956bfa10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca956be4056a3c32 server_cookie=52402e301e3144d7 in_seq=0 out_seq=0 2024-09-13T17:53:43.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f423ea00640 10 client.5883 ms_handle_connect on v2:172.21.15.114:6835/2697286380 2024-09-13T17:53:43.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f423ea00640 1 -- 172.21.15.114:0/3080419932 <== mds.0 v2:172.21.15.114:6835/2697286380 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x560a9541c9c0 con 0x560a956bd620 2024-09-13T17:53:43.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f423ea00640 10 client.5883 handle_command_reply: tid=0 2024-09-13T17:53:43.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f426385f000 1 client.5883 shutdown 2024-09-13T17:53:43.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f426385f000 1 -- 172.21.15.114:0/3080419932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a9564eb10 msgr2=0x560a956bd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:43.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f426385f000 1 --2- 172.21.15.114:0/3080419932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a9564eb10 0x560a956bd0e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f425000e550 tx=0x7f4250013000 comp rx=0 tx=0).stop 2024-09-13T17:53:43.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f426385f000 1 -- 172.21.15.114:0/3080419932 shutdown_connections 2024-09-13T17:53:43.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f426385f000 1 --2- 172.21.15.114:0/3080419932 >> [v2:172.21.15.114:6835/2697286380,v1:172.21.15.114:6837/2697286380] conn(0x560a956bd620 0x560a956bfa10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f426385f000 1 --2- 172.21.15.114:0/3080419932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x560a9564eb10 0x560a956bd0e0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f426385f000 1 --2- 172.21.15.114:0/3080419932 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x560a9564e1f0 0x560a956bab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f426385f000 1 --2- 172.21.15.114:0/3080419932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560a95604740 0x560a956b5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f426385f000 1 -- 172.21.15.114:0/3080419932 >> 172.21.15.114:0/3080419932 conn(0x560a9560afb0 msgr2=0x560a956031f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:43.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f423ea00640 0 client.5883 ms_handle_reset on v2:172.21.15.114:6835/2697286380 2024-09-13T17:53:43.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f426385f000 1 -- 172.21.15.114:0/3080419932 shutdown_connections 2024-09-13T17:53:43.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f426385f000 1 -- 172.21.15.114:0/3080419932 wait complete. 2024-09-13T17:53:43.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f426385f000 20 client.5883 trim_cache size 0 max 16384 2024-09-13T17:53:43.937 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-13T17:53:43.937 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "d730423f-882d-4061-b746-f6a7dc2544e0", 2024-09-13T17:53:43.937 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2024-09-13T17:53:43.937 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 5598, 2024-09-13T17:53:43.937 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2024-09-13T17:53:43.937 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2024-09-13T17:53:43.937 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "recovery_fs", 2024-09-13T17:53:43.938 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 4.51626832, 2024-09-13T17:53:43.938 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 28, 2024-09-13T17:53:43.938 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 48, 2024-09-13T17:53:43.938 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 48, 2024-09-13T17:53:43.938 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 20.593962091000002 2024-09-13T17:53:43.938 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-13T17:53:43.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f4260400640 1 -- 172.21.15.114:0/1303016318 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4238066690 msgr2=0x7f4238068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:43.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f4260400640 1 --2- 172.21.15.114:0/1303016318 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4238066690 0x7f4238068b50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f424c0ad000 tx=0x7f424c008040 comp rx=0 tx=0).stop 2024-09-13T17:53:43.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f4260400640 1 -- 172.21.15.114:0/1303016318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42580ccba0 msgr2=0x7f4258152780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:43.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f4260400640 1 --2- 172.21.15.114:0/1303016318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42580ccba0 0x7f4258152780 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f424400c450 tx=0x7f424400c910 comp rx=0 tx=0).stop 2024-09-13T17:53:43.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f4260400640 1 -- 172.21.15.114:0/1303016318 shutdown_connections 2024-09-13T17:53:43.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f4260400640 1 --2- 172.21.15.114:0/1303016318 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4238066690 0x7f4238068b50 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f4260400640 1 --2- 172.21.15.114:0/1303016318 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4258151420 0x7f425814b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f4260400640 1 --2- 172.21.15.114:0/1303016318 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42580ccba0 0x7f4258152780 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f4260400640 1 --2- 172.21.15.114:0/1303016318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4258070b30 0x7f4258154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f4260400640 1 -- 172.21.15.114:0/1303016318 >> 172.21.15.114:0/1303016318 conn(0x7f42580660b0 msgr2=0x7f425815c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:43.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f4260400640 1 -- 172.21.15.114:0/1303016318 shutdown_connections 2024-09-13T17:53:43.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:43.926+0000 7f4260400640 1 -- 172.21.15.114:0/1303016318 wait complete. 2024-09-13T17:53:43.945 INFO:tasks.ceph.mds.a.smithi114.stderr:2024-09-13T17:53:43.938+0000 7f6732a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:53:43.952 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds debug_mds 20 2024-09-13T17:53:44.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.086+0000 7f509e600640 1 Processor -- start 2024-09-13T17:53:44.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.086+0000 7f509e600640 1 -- start start 2024-09-13T17:53:44.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.086+0000 7f509e600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5098070420 0x7f5098070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.086+0000 7f509e600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5098151800 con 0x7f509806c540 2024-09-13T17:53:44.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.086+0000 7f509e600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50980cafb0 con 0x7f5098151420 2024-09-13T17:53:44.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.086+0000 7f509e600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50980cbc30 con 0x7f5098070420 2024-09-13T17:53:44.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.086+0000 7f5097e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f509806c540 0x7f509806c970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33780/0 (socket says 172.21.15.114:33780) 2024-09-13T17:53:44.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.086+0000 7f5097e00640 1 -- 172.21.15.114:0/217633757 learned_addr learned my addr 172.21.15.114:0/217633757 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:44.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.086+0000 7f5096a00640 1 --2- 172.21.15.114:0/217633757 >> v2:172.21.15.134:3300/0 conn(0x7f5098070420 0x7f5098070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.090+0000 7f5096000640 1 -- 172.21.15.114:0/217633757 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955397559 0 0) 0x7f5098151800 con 0x7f509806c540 2024-09-13T17:53:44.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.090+0000 7f5096000640 1 -- 172.21.15.114:0/217633757 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f507c003530 con 0x7f509806c540 2024-09-13T17:53:44.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.090+0000 7f5096000640 1 -- 172.21.15.114:0/217633757 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1873749886 0 0) 0x7f50980cafb0 con 0x7f5098151420 2024-09-13T17:53:44.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.090+0000 7f5096000640 1 -- 172.21.15.114:0/217633757 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5098151800 con 0x7f5098151420 2024-09-13T17:53:44.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.090+0000 7f5096000640 1 -- 172.21.15.114:0/217633757 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1959678005 0 0) 0x7f507c003530 con 0x7f509806c540 2024-09-13T17:53:44.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.090+0000 7f5096000640 1 -- 172.21.15.114:0/217633757 >> v2:172.21.15.134:3300/0 conn(0x7f5098070420 msgr2=0x7f5098070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:44.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.090+0000 7f5096000640 1 --2- 172.21.15.114:0/217633757 >> v2:172.21.15.134:3300/0 conn(0x7f5098070420 0x7f5098070890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.090+0000 7f5096000640 1 -- 172.21.15.114:0/217633757 >> v1:172.21.15.134:6789/0 conn(0x7f5098151420 legacy=0x7f50980cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:44.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.090+0000 7f5096000640 1 -- 172.21.15.114:0/217633757 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50980cb290 con 0x7f509806c540 2024-09-13T17:53:44.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.090+0000 7f5096000640 1 -- 172.21.15.114:0/217633757 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7f50900016a0 con 0x7f509806c540 2024-09-13T17:53:44.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.090+0000 7f5096000640 1 -- 172.21.15.114:0/217633757 >> v1:172.21.15.114:6789/0 conn(0x7f509806c540 legacy=0x7f509806c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:44.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.090+0000 7f5096000640 1 --2- 172.21.15.114:0/217633757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f507c003b10 0x7f507c003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.090+0000 7f5096000640 1 --2- 172.21.15.114:0/217633757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f507c0047d0 0x7f507c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.090+0000 7f5096000640 1 --2- 172.21.15.114:0/217633757 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f507c005200 0x7f507c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.090+0000 7f5096000640 1 -- 172.21.15.114:0/217633757 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50980cbc30 con 0x7f507c0047d0 2024-09-13T17:53:44.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.090+0000 7f5096000640 1 -- 172.21.15.114:0/217633757 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507c00c160 con 0x7f507c003b10 2024-09-13T17:53:44.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.090+0000 7f5096000640 1 -- 172.21.15.114:0/217633757 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507c00c320 con 0x7f507c005200 2024-09-13T17:53:44.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.090+0000 7f5096a00640 1 --2- 172.21.15.114:0/217633757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f507c0047d0 0x7f507c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.090+0000 7f5097400640 1 --2- 172.21.15.114:0/217633757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f507c003b10 0x7f507c003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.090+0000 7f5097e00640 1 --2- 172.21.15.114:0/217633757 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f507c005200 0x7f507c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.090+0000 7f5096a00640 1 -- 172.21.15.114:0/217633757 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f507c005200 msgr2=0x7f507c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:44.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.090+0000 7f5096a00640 1 --2- 172.21.15.114:0/217633757 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f507c005200 0x7f507c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.090+0000 7f5096a00640 1 -- 172.21.15.114:0/217633757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f507c003b10 msgr2=0x7f507c003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:44.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.090+0000 7f5096a00640 1 --2- 172.21.15.114:0/217633757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f507c003b10 0x7f507c003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.090+0000 7f5096a00640 1 -- 172.21.15.114:0/217633757 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507c003530 con 0x7f507c0047d0 2024-09-13T17:53:44.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.090+0000 7f5097e00640 1 --2- 172.21.15.114:0/217633757 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f507c005200 0x7f507c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:44.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.090+0000 7f5097e00640 1 -- 172.21.15.114:0/217633757 reap_dead start 2024-09-13T17:53:44.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.094+0000 7f5096a00640 1 --2- 172.21.15.114:0/217633757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f507c0047d0 0x7f507c004c50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5084009ae0 tx=0x7f508401ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec658be7cbf5ac09 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:44.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.094+0000 7f5096000640 1 -- 172.21.15.114:0/217633757 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50840a5590 con 0x7f507c0047d0 2024-09-13T17:53:44.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.094+0000 7f5096000640 1 -- 172.21.15.114:0/217633757 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50840a56f0 con 0x7f507c0047d0 2024-09-13T17:53:44.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.094+0000 7f5096000640 1 -- 172.21.15.114:0/217633757 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50840a5aa0 con 0x7f507c0047d0 2024-09-13T17:53:44.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.094+0000 7f509e600640 1 -- 172.21.15.114:0/217633757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f507c0047d0 msgr2=0x7f507c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:44.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.094+0000 7f509e600640 1 --2- 172.21.15.114:0/217633757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f507c0047d0 0x7f507c004c50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5084009ae0 tx=0x7f508401ca40 comp rx=0 tx=0).stop 2024-09-13T17:53:44.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.094+0000 7f509e600640 1 -- 172.21.15.114:0/217633757 shutdown_connections 2024-09-13T17:53:44.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.094+0000 7f509e600640 1 --2- 172.21.15.114:0/217633757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f507c0047d0 0x7f507c004c50 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.094+0000 7f509e600640 1 -- 172.21.15.114:0/217633757 >> 172.21.15.114:0/217633757 conn(0x7f50980660b0 msgr2=0x7f5098069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:44.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.094+0000 7f509e600640 1 -- 172.21.15.114:0/217633757 shutdown_connections 2024-09-13T17:53:44.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.094+0000 7f509e600640 1 -- 172.21.15.114:0/217633757 wait complete. 2024-09-13T17:53:44.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.094+0000 7f509e600640 1 Processor -- start 2024-09-13T17:53:44.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.094+0000 7f509e600640 1 -- start start 2024-09-13T17:53:44.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.094+0000 7f509e600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f507c0047d0 0x7f509814f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.094+0000 7f509e600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f509814c0c0 0x7f5098157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.094+0000 7f509e600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5098157c80 0x7f50980adba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.094+0000 7f509e600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50981566a0 con 0x7f5098157c80 2024-09-13T17:53:44.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.094+0000 7f509e600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5098156980 con 0x7f507c0047d0 2024-09-13T17:53:44.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.094+0000 7f509e600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5098156c60 con 0x7f509814c0c0 2024-09-13T17:53:44.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.098+0000 7f5097e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5098157c80 0x7f50980adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.098+0000 7f5097e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5098157c80 0x7f50980adba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43800/0 (socket says 172.21.15.114:43800) 2024-09-13T17:53:44.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.098+0000 7f5097e00640 1 -- 172.21.15.114:0/548964221 learned_addr learned my addr 172.21.15.114:0/548964221 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:44.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.098+0000 7f5097400640 1 --2- 172.21.15.114:0/548964221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f507c0047d0 0x7f509814f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.098+0000 7f5096a00640 1 --2- 172.21.15.114:0/548964221 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f509814c0c0 0x7f5098157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.098+0000 7f5097e00640 1 -- 172.21.15.114:0/548964221 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f509814c0c0 msgr2=0x7f5098157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:44.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.098+0000 7f5097e00640 1 --2- 172.21.15.114:0/548964221 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f509814c0c0 0x7f5098157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.098+0000 7f5097e00640 1 -- 172.21.15.114:0/548964221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f507c0047d0 msgr2=0x7f509814f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:44.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.098+0000 7f5097e00640 1 --2- 172.21.15.114:0/548964221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f507c0047d0 0x7f509814f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.098+0000 7f5097e00640 1 -- 172.21.15.114:0/548964221 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5098156f40 con 0x7f5098157c80 2024-09-13T17:53:44.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.098+0000 7f5097e00640 1 --2- 172.21.15.114:0/548964221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5098157c80 0x7f50980adba0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f509806e890 tx=0x7f509000e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:44.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.098+0000 7f508f400640 1 -- 172.21.15.114:0/548964221 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090010510 con 0x7f5098157c80 2024-09-13T17:53:44.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.098+0000 7f508f400640 1 -- 172.21.15.114:0/548964221 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5090010690 con 0x7f5098157c80 2024-09-13T17:53:44.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.098+0000 7f508f400640 1 -- 172.21.15.114:0/548964221 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090010a40 con 0x7f5098157c80 2024-09-13T17:53:44.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.098+0000 7f509e600640 1 -- 172.21.15.114:0/548964221 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5098157220 con 0x7f5098157c80 2024-09-13T17:53:44.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.098+0000 7f509e600640 1 -- 172.21.15.114:0/548964221 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f509814ff90 con 0x7f5098157c80 2024-09-13T17:53:44.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.098+0000 7f509e600640 1 -- 172.21.15.114:0/548964221 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50980cafb0 con 0x7f5098157c80 2024-09-13T17:53:44.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.098+0000 7f508f400640 1 -- 172.21.15.114:0/548964221 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5090010ba0 con 0x7f5098157c80 2024-09-13T17:53:44.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.098+0000 7f508f400640 1 --2- 172.21.15.114:0/548964221 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f50780666c0 0x7f5078068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.098+0000 7f508f400640 1 -- 172.21.15.114:0/548964221 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f5090083740 con 0x7f5098157c80 2024-09-13T17:53:44.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.098+0000 7f5097400640 1 --2- 172.21.15.114:0/548964221 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f50780666c0 0x7f5078068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.102+0000 7f5097400640 1 --2- 172.21.15.114:0/548964221 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f50780666c0 0x7f5078068b80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5088000f90 tx=0x7f5088009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:44.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.102+0000 7f508f400640 1 -- 172.21.15.114:0/548964221 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5090050740 con 0x7f5098157c80 2024-09-13T17:53:44.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.258+0000 7f509e600640 1 -- 172.21.15.114:0/548964221 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) v1 -- 0x7f5098158150 con 0x7f5098157c80 2024-09-13T17:53:44.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.262+0000 7f508f400640 1 -- 172.21.15.114:0/548964221 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v11)=0 v11) v1 ==== 108+0+0 (secure 0 0 0) 0x7f50900190b0 con 0x7f5098157c80 2024-09-13T17:53:44.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.262+0000 7f509e600640 1 -- 172.21.15.114:0/548964221 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f50780666c0 msgr2=0x7f5078068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:44.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.262+0000 7f509e600640 1 --2- 172.21.15.114:0/548964221 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f50780666c0 0x7f5078068b80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5088000f90 tx=0x7f5088009040 comp rx=0 tx=0).stop 2024-09-13T17:53:44.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.262+0000 7f509e600640 1 -- 172.21.15.114:0/548964221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5098157c80 msgr2=0x7f50980adba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:44.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.262+0000 7f509e600640 1 --2- 172.21.15.114:0/548964221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5098157c80 0x7f50980adba0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f509806e890 tx=0x7f509000e890 comp rx=0 tx=0).stop 2024-09-13T17:53:44.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.266+0000 7f509e600640 1 -- 172.21.15.114:0/548964221 shutdown_connections 2024-09-13T17:53:44.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.266+0000 7f509e600640 1 --2- 172.21.15.114:0/548964221 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f50780666c0 0x7f5078068b80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.266+0000 7f509e600640 1 --2- 172.21.15.114:0/548964221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5098157c80 0x7f50980adba0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.266+0000 7f509e600640 1 --2- 172.21.15.114:0/548964221 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f509814c0c0 0x7f5098157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.266+0000 7f509e600640 1 --2- 172.21.15.114:0/548964221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f507c0047d0 0x7f509814f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.266+0000 7f509e600640 1 -- 172.21.15.114:0/548964221 >> 172.21.15.114:0/548964221 conn(0x7f50980660b0 msgr2=0x7f509806c920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:44.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.266+0000 7f509e600640 1 -- 172.21.15.114:0/548964221 shutdown_connections 2024-09-13T17:53:44.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.266+0000 7f509e600640 1 -- 172.21.15.114:0/548964221 wait complete. 2024-09-13T17:53:44.289 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / force,recursive,repair 2024-09-13T17:53:44.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.422+0000 7fc0ef000640 1 Processor -- start 2024-09-13T17:53:44.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.422+0000 7fc0ef000640 1 -- start start 2024-09-13T17:53:44.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.422+0000 7fc0ef000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc0e813c240 0x7fc0e813f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.422+0000 7fc0ef000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0e813c980 0x7fc0e806d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.422+0000 7fc0ef000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc0e806da90 0x7fc0e80cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.422+0000 7fc0ef000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e80cd220 con 0x7fc0e813c240 2024-09-13T17:53:44.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.422+0000 7fc0ef000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e813f960 con 0x7fc0e806da90 2024-09-13T17:53:44.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.422+0000 7fc0ef000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e806ded0 con 0x7fc0e813c980 2024-09-13T17:53:44.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.422+0000 7fc0e7e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc0e813c240 0x7fc0e813f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.426+0000 7fc0e7e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc0e813c240 0x7fc0e813f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43812/0 (socket says 172.21.15.114:43812) 2024-09-13T17:53:44.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.426+0000 7fc0e7e00640 1 -- 172.21.15.114:0/3834846130 learned_addr learned my addr 172.21.15.114:0/3834846130 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:44.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.426+0000 7fc0ed000640 1 --2- 172.21.15.114:0/3834846130 >> v2:172.21.15.134:3300/0 conn(0x7fc0e806da90 0x7fc0e80cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.426+0000 7fc0df400640 1 --2- 172.21.15.114:0/3834846130 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0e813c980 0x7fc0e806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.426+0000 7fc0e7e00640 1 -- 172.21.15.114:0/3834846130 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0e813c980 msgr2=0x7fc0e806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:44.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.426+0000 7fc0e7e00640 1 --2- 172.21.15.114:0/3834846130 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0e813c980 0x7fc0e806d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.426+0000 7fc0e7e00640 1 -- 172.21.15.114:0/3834846130 >> v2:172.21.15.134:3300/0 conn(0x7fc0e806da90 msgr2=0x7fc0e80cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:44.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.426+0000 7fc0e7e00640 1 --2- 172.21.15.114:0/3834846130 >> v2:172.21.15.134:3300/0 conn(0x7fc0e806da90 0x7fc0e80cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.426+0000 7fc0e7e00640 1 -- 172.21.15.114:0/3834846130 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e815a740 con 0x7fc0e813c240 2024-09-13T17:53:44.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.426+0000 7fc0e7e00640 1 --2- 172.21.15.114:0/3834846130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0e813c240 0x7fc0e813f420 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8157350 tx=0x7fc0d801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1509a736085116 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:44.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.430+0000 7fc0e7400640 1 -- 172.21.15.114:0/3834846130 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d80aa610 con 0x7fc0e813c240 2024-09-13T17:53:44.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.430+0000 7fc0e7400640 1 -- 172.21.15.114:0/3834846130 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d80a6040 con 0x7fc0e813c240 2024-09-13T17:53:44.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.430+0000 7fc0e7400640 1 -- 172.21.15.114:0/3834846130 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d80aa990 con 0x7fc0e813c240 2024-09-13T17:53:44.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.430+0000 7fc0ef000640 1 -- 172.21.15.114:0/3834846130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0e813c240 msgr2=0x7fc0e813f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:44.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.430+0000 7fc0ef000640 1 --2- 172.21.15.114:0/3834846130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0e813c240 0x7fc0e813f420 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8157350 tx=0x7fc0d801c4f0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.430+0000 7fc0ef000640 1 -- 172.21.15.114:0/3834846130 shutdown_connections 2024-09-13T17:53:44.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.430+0000 7fc0ef000640 1 --2- 172.21.15.114:0/3834846130 >> v2:172.21.15.134:3300/0 conn(0x7fc0e806da90 0x7fc0e80cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.430+0000 7fc0ef000640 1 --2- 172.21.15.114:0/3834846130 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0e813c980 0x7fc0e806d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.430+0000 7fc0ef000640 1 --2- 172.21.15.114:0/3834846130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0e813c240 0x7fc0e813f420 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.430+0000 7fc0ef000640 1 -- 172.21.15.114:0/3834846130 >> 172.21.15.114:0/3834846130 conn(0x7fc0e80660b0 msgr2=0x7fc0e8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:44.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.430+0000 7fc0ef000640 1 -- 172.21.15.114:0/3834846130 shutdown_connections 2024-09-13T17:53:44.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.430+0000 7fc0ef000640 1 -- 172.21.15.114:0/3834846130 wait complete. 2024-09-13T17:53:44.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.434+0000 7fc0ef000640 1 Processor -- start 2024-09-13T17:53:44.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.434+0000 7fc0ef000640 1 -- start start 2024-09-13T17:53:44.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.434+0000 7fc0ef000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0e806da90 0x7fc0e81585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.434+0000 7fc0ef000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0e813c240 0x7fc0e80afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.434+0000 7fc0ef000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0e813c980 0x7fc0e815f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.434+0000 7fc0ef000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e815d3c0 con 0x7fc0e813c980 2024-09-13T17:53:44.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.434+0000 7fc0ef000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e813b4c0 con 0x7fc0e806da90 2024-09-13T17:53:44.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.434+0000 7fc0ef000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e80b0680 con 0x7fc0e813c240 2024-09-13T17:53:44.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.434+0000 7fc0ed000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0e813c980 0x7fc0e815f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.434+0000 7fc0ed000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0e813c980 0x7fc0e815f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43816/0 (socket says 172.21.15.114:43816) 2024-09-13T17:53:44.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.434+0000 7fc0ed000640 1 -- 172.21.15.114:0/3301414924 learned_addr learned my addr 172.21.15.114:0/3301414924 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:44.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.434+0000 7fc0e7e00640 1 --2- 172.21.15.114:0/3301414924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0e806da90 0x7fc0e81585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.434+0000 7fc0df400640 1 --2- 172.21.15.114:0/3301414924 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0e813c240 0x7fc0e80afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.434+0000 7fc0ed000640 1 -- 172.21.15.114:0/3301414924 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0e813c240 msgr2=0x7fc0e80afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:44.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.434+0000 7fc0ed000640 1 --2- 172.21.15.114:0/3301414924 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0e813c240 0x7fc0e80afbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.434+0000 7fc0ed000640 1 -- 172.21.15.114:0/3301414924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0e806da90 msgr2=0x7fc0e81585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:44.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.434+0000 7fc0ed000640 1 --2- 172.21.15.114:0/3301414924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0e806da90 0x7fc0e81585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.434+0000 7fc0ed000640 1 -- 172.21.15.114:0/3301414924 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d80094d0 con 0x7fc0e813c980 2024-09-13T17:53:44.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.434+0000 7fc0ed000640 1 --2- 172.21.15.114:0/3301414924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0e813c980 0x7fc0e815f780 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0007e90 tx=0x7fc0e000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:44.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.434+0000 7fc0e4c00640 1 -- 172.21.15.114:0/3301414924 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0014420 con 0x7fc0e813c980 2024-09-13T17:53:44.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.434+0000 7fc0e4c00640 1 -- 172.21.15.114:0/3301414924 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e00145a0 con 0x7fc0e813c980 2024-09-13T17:53:44.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.434+0000 7fc0e4c00640 1 -- 172.21.15.114:0/3301414924 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0014950 con 0x7fc0e813c980 2024-09-13T17:53:44.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.434+0000 7fc0ef000640 1 -- 172.21.15.114:0/3301414924 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e815a230 con 0x7fc0e813c980 2024-09-13T17:53:44.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.434+0000 7fc0ef000640 1 -- 172.21.15.114:0/3301414924 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e815cfe0 con 0x7fc0e813c980 2024-09-13T17:53:44.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.438+0000 7fc0e4c00640 1 -- 172.21.15.114:0/3301414924 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc0e0014ab0 con 0x7fc0e813c980 2024-09-13T17:53:44.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.438+0000 7fc0e4c00640 1 --2- 172.21.15.114:0/3301414924 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc0c4066690 0x7fc0c4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.438+0000 7fc0e4c00640 1 -- 172.21.15.114:0/3301414924 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7fc0e0084d80 con 0x7fc0e813c980 2024-09-13T17:53:44.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.438+0000 7fc0e7e00640 1 --2- 172.21.15.114:0/3301414924 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc0c4066690 0x7fc0c4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.438+0000 7fc0f23de000 1 Processor -- start 2024-09-13T17:53:44.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.438+0000 7fc0f23de000 1 -- start start 2024-09-13T17:53:44.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.438+0000 7fc0e7e00640 1 --2- 172.21.15.114:0/3301414924 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc0c4066690 0x7fc0c4068b50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc0d80ae000 tx=0x7fc0d80b5040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:44.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.438+0000 7fc0f23de000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc76101bf0 0x55dc76101fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.438+0000 7fc0f23de000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc76102510 0x55dc760baf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.438+0000 7fc0f23de000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dc760bb4c0 0x55dc760bb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.438+0000 7fc0f23de000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc75f80890 con 0x55dc76102510 2024-09-13T17:53:44.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.438+0000 7fc0f23de000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc75f0ca00 con 0x55dc76101bf0 2024-09-13T17:53:44.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.438+0000 7fc0f23de000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc75f09fd0 con 0x55dc760bb4c0 2024-09-13T17:53:44.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.438+0000 7fc0df400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc76102510 0x55dc760baf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.438+0000 7fc0df400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc76102510 0x55dc760baf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43834/0 (socket says 172.21.15.114:43834) 2024-09-13T17:53:44.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.438+0000 7fc0df400640 1 -- 172.21.15.114:0/2019905110 learned_addr learned my addr 172.21.15.114:0/2019905110 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:44.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.438+0000 7fc0e7e00640 1 --2- 172.21.15.114:0/2019905110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc76101bf0 0x55dc76101fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.438+0000 7fc0ed000640 1 --2- 172.21.15.114:0/2019905110 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dc760bb4c0 0x55dc760bb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.438+0000 7fc0df400640 1 -- 172.21.15.114:0/2019905110 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dc760bb4c0 msgr2=0x55dc760bb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:44.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.438+0000 7fc0df400640 1 --2- 172.21.15.114:0/2019905110 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dc760bb4c0 0x55dc760bb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.438+0000 7fc0df400640 1 -- 172.21.15.114:0/2019905110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc76101bf0 msgr2=0x55dc76101fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:44.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.438+0000 7fc0df400640 1 --2- 172.21.15.114:0/2019905110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc76101bf0 0x55dc76101fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.438+0000 7fc0df400640 1 -- 172.21.15.114:0/2019905110 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc75c01d50 con 0x55dc76102510 2024-09-13T17:53:44.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.438+0000 7fc0ed000640 1 --2- 172.21.15.114:0/2019905110 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dc760bb4c0 0x55dc760bb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:44.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.438+0000 7fc0e7e00640 1 --2- 172.21.15.114:0/2019905110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc76101bf0 0x55dc76101fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:44.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0df400640 1 --2- 172.21.15.114:0/2019905110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc76102510 0x55dc760baf80 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc0d00078a0 tx=0x7fc0d0007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4faa030206b03ce4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:44.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0dcc00640 1 -- 172.21.15.114:0/2019905110 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0010b00 con 0x55dc76102510 2024-09-13T17:53:44.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0dcc00640 1 -- 172.21.15.114:0/2019905110 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d0010c60 con 0x55dc76102510 2024-09-13T17:53:44.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0dcc00640 1 -- 172.21.15.114:0/2019905110 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0014430 con 0x55dc76102510 2024-09-13T17:53:44.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0f23de000 1 -- 172.21.15.114:0/2019905110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc76102510 msgr2=0x55dc760baf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:44.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0f23de000 1 --2- 172.21.15.114:0/2019905110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc76102510 0x55dc760baf80 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc0d00078a0 tx=0x7fc0d0007d60 comp rx=0 tx=0).stop 2024-09-13T17:53:44.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0f23de000 1 -- 172.21.15.114:0/2019905110 shutdown_connections 2024-09-13T17:53:44.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0f23de000 1 --2- 172.21.15.114:0/2019905110 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dc760bb4c0 0x55dc760bb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0f23de000 1 --2- 172.21.15.114:0/2019905110 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc76102510 0x55dc760baf80 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0f23de000 1 --2- 172.21.15.114:0/2019905110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc76101bf0 0x55dc76101fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0f23de000 1 -- 172.21.15.114:0/2019905110 >> 172.21.15.114:0/2019905110 conn(0x55dc760b7470 msgr2=0x55dc760b9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:44.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0f23de000 1 -- 172.21.15.114:0/2019905110 shutdown_connections 2024-09-13T17:53:44.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0f23de000 1 -- 172.21.15.114:0/2019905110 wait complete. 2024-09-13T17:53:44.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0f23de000 1 -- start start 2024-09-13T17:53:44.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0f23de000 1 Processor -- start 2024-09-13T17:53:44.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0f23de000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dc760bb4c0 0x55dc760c0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0f23de000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc76101bf0 0x55dc760c0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0f23de000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc76102510 0x55dc760c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0f23de000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc75f058c0 con 0x55dc76102510 2024-09-13T17:53:44.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0f23de000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc75ea5160 con 0x55dc76101bf0 2024-09-13T17:53:44.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0f23de000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc75ea4e00 con 0x55dc760bb4c0 2024-09-13T17:53:44.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0f23de000 10 client.0 _ll_register_callbacks cb 0x55dc760a4920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:53:44.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0ed000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc76102510 0x55dc760c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0ed000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc76102510 0x55dc760c39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43846/0 (socket says 172.21.15.114:43846) 2024-09-13T17:53:44.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0ed000640 1 -- 172.21.15.114:0/199330215 learned_addr learned my addr 172.21.15.114:0/199330215 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:44.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0df400640 1 --2- 172.21.15.114:0/199330215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc76101bf0 0x55dc760c0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0e7e00640 1 --2- 172.21.15.114:0/199330215 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dc760bb4c0 0x55dc760c0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0ed000640 1 -- 172.21.15.114:0/199330215 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dc760bb4c0 msgr2=0x55dc760c0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:44.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0ed000640 1 --2- 172.21.15.114:0/199330215 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dc760bb4c0 0x55dc760c0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0ed000640 1 -- 172.21.15.114:0/199330215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc76101bf0 msgr2=0x55dc760c0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:44.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0ed000640 1 --2- 172.21.15.114:0/199330215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc76101bf0 0x55dc760c0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0ed000640 1 -- 172.21.15.114:0/199330215 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d000e040 con 0x55dc76102510 2024-09-13T17:53:44.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0ed000640 1 --2- 172.21.15.114:0/199330215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc76102510 0x55dc760c39b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0055740 tx=0x7fc0e005dd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=535c3c30cb77d545 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:44.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.442+0000 7fc0d5600640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-13T17:53:44.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0d5600640 1 -- 172.21.15.114:0/199330215 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e006d370 con 0x55dc76102510 2024-09-13T17:53:44.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0d5600640 1 -- 172.21.15.114:0/199330215 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7fc0e0054f30 con 0x55dc76102510 2024-09-13T17:53:44.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0f23de000 1 -- 172.21.15.114:0/199330215 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dc75f04210 con 0x55dc76102510 2024-09-13T17:53:44.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0d5600640 1 -- 172.21.15.114:0/199330215 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0e00550f0 con 0x55dc76102510 2024-09-13T17:53:44.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0f23de000 10 client.5901 fetch_fsmap learned FSMap version 28 2024-09-13T17:53:44.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0f23de000 1 -- 172.21.15.114:0/199330215 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x55dc75ecaba0 con 0x55dc76102510 2024-09-13T17:53:44.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0d5600640 1 -- 172.21.15.114:0/199330215 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dc75f04210 con 0x55dc76102510 2024-09-13T17:53:44.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0d5600640 1 -- 172.21.15.114:0/199330215 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 28) v1 ==== 3687+0+0 (secure 0 0 0) 0x7fc0e0005d20 con 0x55dc76102510 2024-09-13T17:53:44.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0f23de000 10 client.5901 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T17:53:44.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0f23de000 10 client.5901 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-13T17:53:44.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0f23de000 20 client.5901 populate_metadata read hostname 'smithi114' 2024-09-13T17:53:44.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0f23de000 1 --2- 172.21.15.114:0/199330215 >> [v2:172.21.15.114:6835/2697286380,v1:172.21.15.114:6837/2697286380] conn(0x55dc760c43c0 0x55dc76112c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0f23de000 4 client.5901 mds_command: new command op to 5598 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T17:53:44.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0f23de000 1 -- 172.21.15.114:0/199330215 --> [v2:172.21.15.114:6835/2697286380,v1:172.21.15.114:6837/2697286380] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dc75ec3aa0 con 0x55dc760c43c0 2024-09-13T17:53:44.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0e7e00640 1 --2- 172.21.15.114:0/199330215 >> [v2:172.21.15.114:6835/2697286380,v1:172.21.15.114:6837/2697286380] conn(0x55dc760c43c0 0x55dc76112c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0d5600640 10 client.5901 ms_handle_connect on v2:172.21.15.114:6835/2697286380 2024-09-13T17:53:44.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0e7e00640 1 --2- 172.21.15.114:0/199330215 >> [v2:172.21.15.114:6835/2697286380,v1:172.21.15.114:6837/2697286380] conn(0x55dc760c43c0 0x55dc76112c90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a831c8fd184049d9 server_cookie=1b54e9dada3707fe in_seq=0 out_seq=0 2024-09-13T17:53:44.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0d5600640 1 -- 172.21.15.114:0/199330215 <== mds.0 v2:172.21.15.114:6835/2697286380 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55dc75ec3aa0 con 0x55dc760c43c0 2024-09-13T17:53:44.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0d5600640 10 client.5901 handle_command_reply: tid=0 2024-09-13T17:53:44.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0f23de000 1 client.5901 shutdown 2024-09-13T17:53:44.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0f23de000 1 -- 172.21.15.114:0/199330215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc76102510 msgr2=0x55dc760c39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:44.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0f23de000 1 --2- 172.21.15.114:0/199330215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc76102510 0x55dc760c39b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0055740 tx=0x7fc0e005dd80 comp rx=0 tx=0).stop 2024-09-13T17:53:44.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0f23de000 1 -- 172.21.15.114:0/199330215 shutdown_connections 2024-09-13T17:53:44.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0f23de000 1 --2- 172.21.15.114:0/199330215 >> [v2:172.21.15.114:6835/2697286380,v1:172.21.15.114:6837/2697286380] conn(0x55dc760c43c0 0x55dc76112c90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0f23de000 1 --2- 172.21.15.114:0/199330215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc76102510 0x55dc760c39b0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0f23de000 1 --2- 172.21.15.114:0/199330215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc76101bf0 0x55dc760c0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0f23de000 1 --2- 172.21.15.114:0/199330215 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dc760bb4c0 0x55dc760c0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0f23de000 1 -- 172.21.15.114:0/199330215 >> 172.21.15.114:0/199330215 conn(0x55dc760b7470 msgr2=0x55dc760ba080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:44.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0d5600640 0 client.5901 ms_handle_reset on v2:172.21.15.114:6835/2697286380 2024-09-13T17:53:44.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0f23de000 1 -- 172.21.15.114:0/199330215 shutdown_connections 2024-09-13T17:53:44.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0f23de000 1 -- 172.21.15.114:0/199330215 wait complete. 2024-09-13T17:53:44.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.446+0000 7fc0f23de000 20 client.5901 trim_cache size 0 max 16384 2024-09-13T17:53:44.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0f23de000 1 Processor -- start 2024-09-13T17:53:44.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0f23de000 1 -- start start 2024-09-13T17:53:44.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0f23de000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc760b7470 0x55dc760ba870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0f23de000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dc760bb4c0 0x55dc760badb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0f23de000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc76101bf0 0x55dc76112c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0f23de000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc76101550 con 0x55dc760b7470 2024-09-13T17:53:44.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0f23de000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc75bc29d0 con 0x55dc76101bf0 2024-09-13T17:53:44.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0f23de000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc75eae1a0 con 0x55dc760bb4c0 2024-09-13T17:53:44.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0e7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc760b7470 0x55dc760ba870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0e7e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc760b7470 0x55dc760ba870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43860/0 (socket says 172.21.15.114:43860) 2024-09-13T17:53:44.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0e7e00640 1 -- 172.21.15.114:0/2541372093 learned_addr learned my addr 172.21.15.114:0/2541372093 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:44.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0df400640 1 --2- 172.21.15.114:0/2541372093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dc760bb4c0 0x55dc760badb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0ed000640 1 --2- 172.21.15.114:0/2541372093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc76101bf0 0x55dc76112c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0e7e00640 1 -- 172.21.15.114:0/2541372093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dc760bb4c0 msgr2=0x55dc760badb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:44.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0e7e00640 1 --2- 172.21.15.114:0/2541372093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dc760bb4c0 0x55dc760badb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0e7e00640 1 -- 172.21.15.114:0/2541372093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc76101bf0 msgr2=0x55dc76112c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:44.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0e7e00640 1 --2- 172.21.15.114:0/2541372093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc76101bf0 0x55dc76112c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0e7e00640 1 -- 172.21.15.114:0/2541372093 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc75eb0cf0 con 0x55dc760b7470 2024-09-13T17:53:44.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0e7e00640 1 --2- 172.21.15.114:0/2541372093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc760b7470 0x55dc760ba870 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8009320 tx=0x7fc0d8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e9c88ef9367192 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:44.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0dd600640 1 -- 172.21.15.114:0/2541372093 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d80be8d0 con 0x55dc760b7470 2024-09-13T17:53:44.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0dd600640 1 -- 172.21.15.114:0/2541372093 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d80c5040 con 0x55dc760b7470 2024-09-13T17:53:44.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0dd600640 1 -- 172.21.15.114:0/2541372093 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d80bec30 con 0x55dc760b7470 2024-09-13T17:53:44.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0f23de000 1 -- 172.21.15.114:0/2541372093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc760b7470 msgr2=0x55dc760ba870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:44.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0f23de000 1 --2- 172.21.15.114:0/2541372093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc760b7470 0x55dc760ba870 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8009320 tx=0x7fc0d8004740 comp rx=0 tx=0).stop 2024-09-13T17:53:44.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0f23de000 1 -- 172.21.15.114:0/2541372093 shutdown_connections 2024-09-13T17:53:44.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0f23de000 1 --2- 172.21.15.114:0/2541372093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc76101bf0 0x55dc76112c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0f23de000 1 --2- 172.21.15.114:0/2541372093 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dc760bb4c0 0x55dc760badb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0f23de000 1 --2- 172.21.15.114:0/2541372093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc760b7470 0x55dc760ba870 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.462+0000 7fc0f23de000 1 -- 172.21.15.114:0/2541372093 >> 172.21.15.114:0/2541372093 conn(0x55dc76101170 msgr2=0x55dc76114ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:44.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0f23de000 1 -- 172.21.15.114:0/2541372093 shutdown_connections 2024-09-13T17:53:44.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0f23de000 1 -- 172.21.15.114:0/2541372093 wait complete. 2024-09-13T17:53:44.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0f23de000 1 -- start start 2024-09-13T17:53:44.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0f23de000 1 Processor -- start 2024-09-13T17:53:44.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0f23de000 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dc760b7470 0x55dc7616a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0f23de000 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc760bb4c0 0x55dc76125f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0f23de000 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc76101bf0 0x55dc761264b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0f23de000 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc76101030 con 0x55dc76101bf0 2024-09-13T17:53:44.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0f23de000 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc75f08420 con 0x55dc760bb4c0 2024-09-13T17:53:44.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0f23de000 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc75f030d0 con 0x55dc760b7470 2024-09-13T17:53:44.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0f23de000 10 client.0 _ll_register_callbacks cb 0x55dc75f57950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T17:53:44.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0ed000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc76101bf0 0x55dc761264b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0ed000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc76101bf0 0x55dc761264b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43870/0 (socket says 172.21.15.114:43870) 2024-09-13T17:53:44.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0ed000640 1 -- 172.21.15.114:0/1845748654 learned_addr learned my addr 172.21.15.114:0/1845748654 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:44.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0e7e00640 1 --2- 172.21.15.114:0/1845748654 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dc760b7470 0x55dc7616a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0df400640 1 --2- 172.21.15.114:0/1845748654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc760bb4c0 0x55dc76125f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0ed000640 1 -- 172.21.15.114:0/1845748654 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dc760b7470 msgr2=0x55dc7616a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:44.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0ed000640 1 --2- 172.21.15.114:0/1845748654 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dc760b7470 0x55dc7616a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0ed000640 1 -- 172.21.15.114:0/1845748654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc760bb4c0 msgr2=0x55dc76125f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:44.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0ed000640 1 --2- 172.21.15.114:0/1845748654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc760bb4c0 0x55dc76125f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0ed000640 1 -- 172.21.15.114:0/1845748654 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e815a740 con 0x55dc76101bf0 2024-09-13T17:53:44.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0df400640 1 --2- 172.21.15.114:0/1845748654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc760bb4c0 0x55dc76125f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:44.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0ed000640 1 --2- 172.21.15.114:0/1845748654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc76101bf0 0x55dc761264b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0055980 tx=0x7fc0e0082d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac519cfd92fa5b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:44.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0d5600640 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2024-09-13T17:53:44.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0d5600640 1 -- 172.21.15.114:0/1845748654 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0055ad0 con 0x55dc76101bf0 2024-09-13T17:53:44.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0d5600640 1 -- 172.21.15.114:0/1845748654 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7fc0e005db50 con 0x55dc76101bf0 2024-09-13T17:53:44.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0f23de000 1 -- 172.21.15.114:0/1845748654 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dc75f026a0 con 0x55dc76101bf0 2024-09-13T17:53:44.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0d5600640 1 -- 172.21.15.114:0/1845748654 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0e0051dc0 con 0x55dc76101bf0 2024-09-13T17:53:44.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0f23de000 10 client.5907 fetch_fsmap learned FSMap version 28 2024-09-13T17:53:44.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0f23de000 1 -- 172.21.15.114:0/1845748654 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x55dc75ea4810 con 0x55dc76101bf0 2024-09-13T17:53:44.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0d5600640 1 -- 172.21.15.114:0/1845748654 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dc75f026a0 con 0x55dc76101bf0 2024-09-13T17:53:44.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0d5600640 1 -- 172.21.15.114:0/1845748654 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 28) v1 ==== 3687+0+0 (secure 0 0 0) 0x7fc0e0005d20 con 0x55dc76101bf0 2024-09-13T17:53:44.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0f23de000 10 client.5907 fetch_fsmap finished waiting for FSMap version 28 2024-09-13T17:53:44.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0f23de000 10 client.5907 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-13T17:53:44.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0f23de000 20 client.5907 populate_metadata read hostname 'smithi114' 2024-09-13T17:53:44.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0f23de000 1 --2- 172.21.15.114:0/1845748654 >> [v2:172.21.15.114:6835/2697286380,v1:172.21.15.114:6837/2697286380] conn(0x55dc76102510 0x55dc761269f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0f23de000 4 client.5907 mds_command: new command op to 5598 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive", "repair"]}] 2024-09-13T17:53:44.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0f23de000 1 -- 172.21.15.114:0/1845748654 --> [v2:172.21.15.114:6835/2697286380,v1:172.21.15.114:6837/2697286380] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive", "repair"]}) v1 -- 0x55dc75ecd440 con 0x55dc76102510 2024-09-13T17:53:44.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.466+0000 7fc0e7e00640 1 --2- 172.21.15.114:0/1845748654 >> [v2:172.21.15.114:6835/2697286380,v1:172.21.15.114:6837/2697286380] conn(0x55dc76102510 0x55dc761269f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0e7e00640 1 --2- 172.21.15.114:0/1845748654 >> [v2:172.21.15.114:6835/2697286380,v1:172.21.15.114:6837/2697286380] conn(0x55dc76102510 0x55dc761269f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad9f118f15f9ff9e server_cookie=c8a91cbc8a9a224e in_seq=0 out_seq=0 2024-09-13T17:53:44.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0d5600640 10 client.5907 ms_handle_connect on v2:172.21.15.114:6835/2697286380 2024-09-13T17:53:44.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0d5600640 1 -- 172.21.15.114:0/1845748654 <== mds.0 v2:172.21.15.114:6835/2697286380 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55dc75ecd440 con 0x55dc76102510 2024-09-13T17:53:44.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0d5600640 10 client.5907 handle_command_reply: tid=0 2024-09-13T17:53:44.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0f23de000 1 client.5907 shutdown 2024-09-13T17:53:44.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0f23de000 1 -- 172.21.15.114:0/1845748654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc76101bf0 msgr2=0x55dc761264b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:44.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0f23de000 1 --2- 172.21.15.114:0/1845748654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc76101bf0 0x55dc761264b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0055980 tx=0x7fc0e0082d60 comp rx=0 tx=0).stop 2024-09-13T17:53:44.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0f23de000 1 -- 172.21.15.114:0/1845748654 shutdown_connections 2024-09-13T17:53:44.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0f23de000 1 --2- 172.21.15.114:0/1845748654 >> [v2:172.21.15.114:6835/2697286380,v1:172.21.15.114:6837/2697286380] conn(0x55dc76102510 0x55dc761269f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0f23de000 1 --2- 172.21.15.114:0/1845748654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55dc76101bf0 0x55dc761264b0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0d5600640 0 client.5907 ms_handle_reset on v2:172.21.15.114:6835/2697286380 2024-09-13T17:53:44.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0f23de000 1 --2- 172.21.15.114:0/1845748654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc760bb4c0 0x55dc76125f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0f23de000 1 --2- 172.21.15.114:0/1845748654 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x55dc760b7470 0x55dc7616a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0f23de000 1 -- 172.21.15.114:0/1845748654 >> 172.21.15.114:0/1845748654 conn(0x55dc76101170 msgr2=0x55dc760c08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:44.478 INFO:tasks.ceph.mds.a.smithi114.stderr:2024-09-13T17:53:44.470+0000 7f672e400640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000000 2024-09-13T17:53:44.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0f23de000 1 -- 172.21.15.114:0/1845748654 shutdown_connections 2024-09-13T17:53:44.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0f23de000 1 -- 172.21.15.114:0/1845748654 wait complete. 2024-09-13T17:53:44.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0f23de000 20 client.5907 trim_cache size 0 max 16384 2024-09-13T17:53:44.479 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-13T17:53:44.479 INFO:teuthology.orchestra.run.smithi114.stdout: "return_code": 0, 2024-09-13T17:53:44.480 INFO:teuthology.orchestra.run.smithi114.stdout: "scrub_tag": "b71b18f9-42fa-4b30-9f94-cb11bd0075f4", 2024-09-13T17:53:44.480 INFO:teuthology.orchestra.run.smithi114.stdout: "mode": "asynchronous" 2024-09-13T17:53:44.480 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-13T17:53:44.480 INFO:tasks.ceph.mds.a.smithi114.stderr:2024-09-13T17:53:44.470+0000 7f672e400640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /subdir/ auth v1 pv4 ap=3 DIRTYPARENT f(v0 1=1+0) n() (inest lock dirty) (ifile lock->sync w=1 flushing) (iversion lock) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x564e5dec1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000000:[<0x1/subdir v1>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=1+0)","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 1=1+0)","memory_value.rstat":"n()","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2024-09-13T17:53:44.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0ef000640 1 -- 172.21.15.114:0/3301414924 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc0c4066690 msgr2=0x7fc0c4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:44.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0ef000640 1 --2- 172.21.15.114:0/3301414924 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc0c4066690 0x7fc0c4068b50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc0d80ae000 tx=0x7fc0d80b5040 comp rx=0 tx=0).stop 2024-09-13T17:53:44.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0ef000640 1 -- 172.21.15.114:0/3301414924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0e813c980 msgr2=0x7fc0e815f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:44.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0ef000640 1 --2- 172.21.15.114:0/3301414924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0e813c980 0x7fc0e815f780 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0007e90 tx=0x7fc0e000e4b0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0ef000640 1 -- 172.21.15.114:0/3301414924 shutdown_connections 2024-09-13T17:53:44.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0ef000640 1 --2- 172.21.15.114:0/3301414924 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc0c4066690 0x7fc0c4068b50 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0ef000640 1 --2- 172.21.15.114:0/3301414924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0e813c980 0x7fc0e815f780 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0ef000640 1 --2- 172.21.15.114:0/3301414924 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc0e813c240 0x7fc0e80afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0ef000640 1 --2- 172.21.15.114:0/3301414924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0e806da90 0x7fc0e81585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0ef000640 1 -- 172.21.15.114:0/3301414924 >> 172.21.15.114:0/3301414924 conn(0x7fc0e80660b0 msgr2=0x7fc0e80ad8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:44.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0ef000640 1 -- 172.21.15.114:0/3301414924 shutdown_connections 2024-09-13T17:53:44.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.470+0000 7fc0ef000640 1 -- 172.21.15.114:0/3301414924 wait complete. 2024-09-13T17:53:44.482 INFO:tasks.ceph.mds.a.smithi114.stderr:2024-09-13T17:53:44.474+0000 7f672e400640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x564e5defa100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(6)0x10000000001:[<0x10000000000/sixmegs v10>,<0x1/subdir v12>]//[]","memoryvalue":"(6)0x10000000001:[<0x10000000000/sixmegs v1>,<0x1/subdir v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-13T17:53:44.482 INFO:tasks.ceph.mds.a.smithi114.stderr:2024-09-13T17:53:44.474+0000 7f672e400640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1 [...2,head] / auth v4 ap=5 snaprealm=0x564e5deb8900 DIRTYPARENT f(v1 1=0+1) n(v0 1=0+1)/n() (idft sync r=1) (inest sync r=1) (ifile sync->mix r=1) (iversion lock) | dirtyscattered=0 lock=3 dirfrag=1 openingsnapparents=0 dirtyparent=1 dirty=1 waiter=1 authpin=1 scrubqueue=0 0x564e5dec1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x1:[]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=0+1)","ondisk_value.rstat":"n(v0 2=0+2)","memory_value.dirstat":"f(v1 1=0+1)","memory_value.rstat":"n(v0 1=0+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2024-09-13T17:53:44.497 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:53:44.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.626+0000 7f6bef200640 1 Processor -- start 2024-09-13T17:53:44.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.626+0000 7f6bef200640 1 -- start start 2024-09-13T17:53:44.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.630+0000 7f6bef200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6be813f420 0x7f6be806d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.630+0000 7f6bef200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be80cd220 con 0x7f6be813c240 2024-09-13T17:53:44.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.630+0000 7f6bef200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be806ded0 con 0x7f6be806da90 2024-09-13T17:53:44.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.630+0000 7f6bef200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be815a740 con 0x7f6be813f420 2024-09-13T17:53:44.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.630+0000 7f6be7e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6be813c240 0x7f6be813c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33796/0 (socket says 172.21.15.114:33796) 2024-09-13T17:53:44.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.630+0000 7f6be7e00640 1 -- 172.21.15.114:0/2634073967 learned_addr learned my addr 172.21.15.114:0/2634073967 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:44.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.630+0000 7f6bdf400640 1 --2- 172.21.15.114:0/2634073967 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6be813f420 0x7f6be806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.630+0000 7f6be7400640 1 -- 172.21.15.114:0/2634073967 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3188029520 0 0) 0x7f6be80cd220 con 0x7f6be813c240 2024-09-13T17:53:44.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.630+0000 7f6be7400640 1 -- 172.21.15.114:0/2634073967 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bcc003530 con 0x7f6be813c240 2024-09-13T17:53:44.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.630+0000 7f6be7400640 1 -- 172.21.15.114:0/2634073967 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2858174310 0 0) 0x7f6be806ded0 con 0x7f6be806da90 2024-09-13T17:53:44.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.630+0000 7f6be7400640 1 -- 172.21.15.114:0/2634073967 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6be80cd220 con 0x7f6be806da90 2024-09-13T17:53:44.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.630+0000 7f6bdf400640 1 -- 172.21.15.114:0/2634073967 >> v1:172.21.15.134:6789/0 conn(0x7f6be806da90 legacy=0x7f6be80cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:44.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.630+0000 7f6bdf400640 1 -- 172.21.15.114:0/2634073967 >> v1:172.21.15.114:6789/0 conn(0x7f6be813c240 legacy=0x7f6be813c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:44.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.630+0000 7f6bdf400640 1 -- 172.21.15.114:0/2634073967 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be8159bc0 con 0x7f6be813f420 2024-09-13T17:53:44.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.634+0000 7f6bdf400640 1 --2- 172.21.15.114:0/2634073967 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6be813f420 0x7f6be806d550 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00097f0 tx=0x7f6bd001c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=affb351beacd6fcc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:44.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.634+0000 7f6be7400640 1 -- 172.21.15.114:0/2634073967 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd00aa610 con 0x7f6be813f420 2024-09-13T17:53:44.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.634+0000 7f6be7400640 1 -- 172.21.15.114:0/2634073967 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd00a6040 con 0x7f6be813f420 2024-09-13T17:53:44.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.634+0000 7f6be7400640 1 -- 172.21.15.114:0/2634073967 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd00aa990 con 0x7f6be813f420 2024-09-13T17:53:44.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.634+0000 7f6bef200640 1 -- 172.21.15.114:0/2634073967 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6be813f420 msgr2=0x7f6be806d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:44.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.634+0000 7f6bef200640 1 --2- 172.21.15.114:0/2634073967 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6be813f420 0x7f6be806d550 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00097f0 tx=0x7f6bd001c4b0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.634+0000 7f6bef200640 1 -- 172.21.15.114:0/2634073967 shutdown_connections 2024-09-13T17:53:44.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.634+0000 7f6bef200640 1 --2- 172.21.15.114:0/2634073967 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6be813f420 0x7f6be806d550 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.634+0000 7f6bef200640 1 -- 172.21.15.114:0/2634073967 >> 172.21.15.114:0/2634073967 conn(0x7f6be80660b0 msgr2=0x7f6be8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:44.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.634+0000 7f6bef200640 1 -- 172.21.15.114:0/2634073967 shutdown_connections 2024-09-13T17:53:44.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.634+0000 7f6bef200640 1 -- 172.21.15.114:0/2634073967 wait complete. 2024-09-13T17:53:44.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.634+0000 7f6bef200640 1 Processor -- start 2024-09-13T17:53:44.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.634+0000 7f6bef200640 1 -- start start 2024-09-13T17:53:44.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.638+0000 7f6bef200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6be806da90 0x7f6be8138de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.638+0000 7f6bef200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6be813c240 0x7f6be81f8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.638+0000 7f6bef200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6be813f420 0x7f6be81f8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.638+0000 7f6bef200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be80afb60 con 0x7f6be813f420 2024-09-13T17:53:44.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.638+0000 7f6bef200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be80af880 con 0x7f6be806da90 2024-09-13T17:53:44.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.638+0000 7f6bef200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be81f6260 con 0x7f6be813c240 2024-09-13T17:53:44.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.638+0000 7f6bed200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6be813f420 0x7f6be81f8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.638+0000 7f6bed200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6be813f420 0x7f6be81f8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43884/0 (socket says 172.21.15.114:43884) 2024-09-13T17:53:44.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.638+0000 7f6bed200640 1 -- 172.21.15.114:0/496814054 learned_addr learned my addr 172.21.15.114:0/496814054 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:44.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.638+0000 7f6be7e00640 1 --2- 172.21.15.114:0/496814054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6be806da90 0x7f6be8138de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.638+0000 7f6bdf400640 1 --2- 172.21.15.114:0/496814054 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6be813c240 0x7f6be81f8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.638+0000 7f6bed200640 1 -- 172.21.15.114:0/496814054 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6be813c240 msgr2=0x7f6be81f8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:44.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.638+0000 7f6bed200640 1 --2- 172.21.15.114:0/496814054 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6be813c240 0x7f6be81f8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.638+0000 7f6bed200640 1 -- 172.21.15.114:0/496814054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6be806da90 msgr2=0x7f6be8138de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:44.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.638+0000 7f6bed200640 1 --2- 172.21.15.114:0/496814054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6be806da90 0x7f6be8138de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.638+0000 7f6bed200640 1 -- 172.21.15.114:0/496814054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd0009420 con 0x7f6be813f420 2024-09-13T17:53:44.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.638+0000 7f6bed200640 1 --2- 172.21.15.114:0/496814054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6be813f420 0x7f6be81f8ac0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f6be000c3c0 tx=0x7f6be000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:44.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.638+0000 7f6be4c00640 1 -- 172.21.15.114:0/496814054 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be00052d0 con 0x7f6be813f420 2024-09-13T17:53:44.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.638+0000 7f6be4c00640 1 -- 172.21.15.114:0/496814054 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be0005430 con 0x7f6be813f420 2024-09-13T17:53:44.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.638+0000 7f6be4c00640 1 -- 172.21.15.114:0/496814054 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0003820 con 0x7f6be813f420 2024-09-13T17:53:44.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.638+0000 7f6bef200640 1 -- 172.21.15.114:0/496814054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be81f6540 con 0x7f6be813f420 2024-09-13T17:53:44.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.638+0000 7f6bef200640 1 -- 172.21.15.114:0/496814054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be8139320 con 0x7f6be813f420 2024-09-13T17:53:44.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.638+0000 7f6bef200640 1 -- 172.21.15.114:0/496814054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be81f60a0 con 0x7f6be813f420 2024-09-13T17:53:44.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.638+0000 7f6be4c00640 1 -- 172.21.15.114:0/496814054 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6be0003980 con 0x7f6be813f420 2024-09-13T17:53:44.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.642+0000 7f6be4c00640 1 --2- 172.21.15.114:0/496814054 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6bc4066690 0x7f6bc4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.642+0000 7f6be4c00640 1 -- 172.21.15.114:0/496814054 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f6be00839a0 con 0x7f6be813f420 2024-09-13T17:53:44.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.642+0000 7f6be7e00640 1 --2- 172.21.15.114:0/496814054 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6bc4066690 0x7f6bc4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.642+0000 7f6be7e00640 1 --2- 172.21.15.114:0/496814054 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6bc4066690 0x7f6bc4068b50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6bd80012f0 tx=0x7f6bd8001aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:44.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.646+0000 7f6be4c00640 1 -- 172.21.15.114:0/496814054 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6be0050a30 con 0x7f6be813f420 2024-09-13T17:53:44.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.830+0000 7f6bef200640 1 -- 172.21.15.114:0/496814054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6be80667b0 con 0x7f6be813f420 2024-09-13T17:53:44.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.830+0000 7f6be4c00640 1 -- 172.21.15.114:0/496814054 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+5951 (secure 0 0 0) 0x7f6be0054050 con 0x7f6be813f420 2024-09-13T17:53:44.837 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:44.837 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/1758700058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1758700058},{"type":"v1","addr":"172.21.15.134:6833","nonce":1758700058}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/4015015784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4015015784},{"type":"v1","addr":"172.21.15.134:6835","nonce":4015015784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2696640153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2696640153},{"type":"v1","addr":"172.21.15.114:6836","nonce":2696640153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:53:08.298484+0000","modified":"2024-09-13T17:53:22.929771+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:53:32.086012+0000","modified":"2024-09-13T17:53:42.428826+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5598":{"gid":5598,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6837/2697286380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2697286380},{"type":"v1","addr":"172.21.15.114:6837","nonce":2697286380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T17:53:44.837 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 28 2024-09-13T17:53:44.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.834+0000 7f6bef200640 1 -- 172.21.15.114:0/496814054 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6bc4066690 msgr2=0x7f6bc4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:44.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.834+0000 7f6bef200640 1 --2- 172.21.15.114:0/496814054 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6bc4066690 0x7f6bc4068b50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6bd80012f0 tx=0x7f6bd8001aa0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.834+0000 7f6bef200640 1 -- 172.21.15.114:0/496814054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6be813f420 msgr2=0x7f6be81f8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:44.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.834+0000 7f6bef200640 1 --2- 172.21.15.114:0/496814054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6be813f420 0x7f6be81f8ac0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f6be000c3c0 tx=0x7f6be000c880 comp rx=0 tx=0).stop 2024-09-13T17:53:44.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.834+0000 7f6bef200640 1 -- 172.21.15.114:0/496814054 shutdown_connections 2024-09-13T17:53:44.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.834+0000 7f6bef200640 1 --2- 172.21.15.114:0/496814054 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f6bc4066690 0x7f6bc4068b50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.834+0000 7f6bef200640 1 --2- 172.21.15.114:0/496814054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6be813f420 0x7f6be81f8ac0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.834+0000 7f6bef200640 1 --2- 172.21.15.114:0/496814054 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f6be813c240 0x7f6be81f8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.834+0000 7f6bef200640 1 --2- 172.21.15.114:0/496814054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6be806da90 0x7f6be8138de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.834+0000 7f6bef200640 1 -- 172.21.15.114:0/496814054 >> 172.21.15.114:0/496814054 conn(0x7f6be80660b0 msgr2=0x7f6be81396b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:44.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.834+0000 7f6bef200640 1 -- 172.21.15.114:0/496814054 shutdown_connections 2024-09-13T17:53:44.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.834+0000 7f6bef200640 1 -- 172.21.15.114:0/496814054 wait complete. 2024-09-13T17:53:44.858 INFO:tasks.cephfs.test_recovery_pool:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 2, "epoch": 28, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-13T17:53:08.298484+0000", "damaged": [], "data_pools": [ 6 ], "enabled": true, "epoch": 18, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [ 0 ], "flags": 19, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": false, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": {}, "last_failure": 0, "last_failure_osd_epoch": 40, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 5, "modified": "2024-09-13T17:53:22.929771+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": {} } }, { "id": 3, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-13T17:53:32.086012+0000", "damaged": [], "data_pools": [ 6 ], "enabled": true, "epoch": 28, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "recovery_fs", "in": [ 0 ], "info": { "gid_5598": { "addr": "172.21.15.114:6837/2697286380", "addrs": { "addrvec": [ { "addr": "172.21.15.114:6835", "nonce": 2697286380, "type": "v2" }, { "addr": "172.21.15.114:6837", "nonce": 2697286380, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5598, "incarnation": 25, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:active", "state_seq": 8 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 7, "modified": "2024-09-13T17:53:42.428826+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5598 } } } ], "standbys": [ { "addr": "172.21.15.134:6833/1758700058", "addrs": { "addrvec": [ { "addr": "172.21.15.134:6832", "nonce": 1758700058, "type": "v2" }, { "addr": "172.21.15.134:6833", "nonce": 1758700058, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 19, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5129, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.134:6835/4015015784", "addrs": { "addrvec": [ { "addr": "172.21.15.134:6834", "nonce": 4015015784, "type": "v2" }, { "addr": "172.21.15.134:6835", "nonce": 4015015784, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 20, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5485, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.114:6836/2696640153", "addrs": { "addrvec": [ { "addr": "172.21.15.114:6834", "nonce": 2696640153, "type": "v2" }, { "addr": "172.21.15.114:6836", "nonce": 2696640153, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 19, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5595, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-09-13T17:53:44.858 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T17:53:44.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.986+0000 7fb05c600640 1 Processor -- start 2024-09-13T17:53:44.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.986+0000 7fb05c600640 1 -- start start 2024-09-13T17:53:44.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.990+0000 7fb05c600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb05413f420 0x7fb05406d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.990+0000 7fb05c600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0540cd220 con 0x7fb05413c240 2024-09-13T17:53:44.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.990+0000 7fb05c600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb05406ded0 con 0x7fb05406da90 2024-09-13T17:53:44.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.990+0000 7fb05c600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb05415a740 con 0x7fb05413f420 2024-09-13T17:53:44.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.990+0000 7fb059c00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb05413c240 0x7fb05413c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33798/0 (socket says 172.21.15.114:33798) 2024-09-13T17:53:44.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.990+0000 7fb059c00640 1 -- 172.21.15.114:0/31801517 learned_addr learned my addr 172.21.15.114:0/31801517 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:44.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.990+0000 7fb059200640 1 --2- 172.21.15.114:0/31801517 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb05413f420 0x7fb05406d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.990+0000 7fb053e00640 1 -- 172.21.15.114:0/31801517 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928307648 0 0) 0x7fb0540cd220 con 0x7fb05413c240 2024-09-13T17:53:44.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.990+0000 7fb053e00640 1 -- 172.21.15.114:0/31801517 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb03c003530 con 0x7fb05413c240 2024-09-13T17:53:44.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.990+0000 7fb053e00640 1 -- 172.21.15.114:0/31801517 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325789732 0 0) 0x7fb05406ded0 con 0x7fb05406da90 2024-09-13T17:53:44.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.990+0000 7fb053e00640 1 -- 172.21.15.114:0/31801517 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0540cd220 con 0x7fb05406da90 2024-09-13T17:53:44.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.990+0000 7fb059200640 1 -- 172.21.15.114:0/31801517 >> v1:172.21.15.134:6789/0 conn(0x7fb05406da90 legacy=0x7fb0540cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:44.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.990+0000 7fb059200640 1 -- 172.21.15.114:0/31801517 >> v1:172.21.15.114:6789/0 conn(0x7fb05413c240 legacy=0x7fb05413c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:44.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.990+0000 7fb059200640 1 -- 172.21.15.114:0/31801517 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb054159bc0 con 0x7fb05413f420 2024-09-13T17:53:44.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.994+0000 7fb059200640 1 --2- 172.21.15.114:0/31801517 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb05413f420 0x7fb05406d550 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb0400097f0 tx=0x7fb04001c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25014e8a5d91fb25 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:44.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.994+0000 7fb053e00640 1 -- 172.21.15.114:0/31801517 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0400aa610 con 0x7fb05413f420 2024-09-13T17:53:44.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.994+0000 7fb053e00640 1 -- 172.21.15.114:0/31801517 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0400a6040 con 0x7fb05413f420 2024-09-13T17:53:44.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.994+0000 7fb053e00640 1 -- 172.21.15.114:0/31801517 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0400aa990 con 0x7fb05413f420 2024-09-13T17:53:45.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.994+0000 7fb05c600640 1 -- 172.21.15.114:0/31801517 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb05413f420 msgr2=0x7fb05406d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:45.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.994+0000 7fb05c600640 1 --2- 172.21.15.114:0/31801517 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb05413f420 0x7fb05406d550 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb0400097f0 tx=0x7fb04001c4b0 comp rx=0 tx=0).stop 2024-09-13T17:53:45.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.994+0000 7fb05c600640 1 -- 172.21.15.114:0/31801517 shutdown_connections 2024-09-13T17:53:45.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.994+0000 7fb05c600640 1 --2- 172.21.15.114:0/31801517 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb05413f420 0x7fb05406d550 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:45.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.994+0000 7fb05c600640 1 -- 172.21.15.114:0/31801517 >> 172.21.15.114:0/31801517 conn(0x7fb0540660b0 msgr2=0x7fb054069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:45.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.994+0000 7fb05c600640 1 -- 172.21.15.114:0/31801517 shutdown_connections 2024-09-13T17:53:45.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.994+0000 7fb05c600640 1 -- 172.21.15.114:0/31801517 wait complete. 2024-09-13T17:53:45.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.994+0000 7fb05c600640 1 Processor -- start 2024-09-13T17:53:45.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.994+0000 7fb05c600640 1 -- start start 2024-09-13T17:53:45.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.998+0000 7fb05c600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb05406da90 0x7fb054138d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:45.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.998+0000 7fb05c600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb05413c240 0x7fb05415bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:45.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.998+0000 7fb05c600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb05413f420 0x7fb054153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:45.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.998+0000 7fb05c600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0541392b0 con 0x7fb05406da90 2024-09-13T17:53:45.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.998+0000 7fb05c600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05415ad10 con 0x7fb05413c240 2024-09-13T17:53:45.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.998+0000 7fb05c600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb05415aff0 con 0x7fb05413f420 2024-09-13T17:53:45.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.998+0000 7fb059c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb05406da90 0x7fb054138d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:45.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.998+0000 7fb059c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb05406da90 0x7fb054138d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43888/0 (socket says 172.21.15.114:43888) 2024-09-13T17:53:45.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.998+0000 7fb059c00640 1 -- 172.21.15.114:0/2025125623 learned_addr learned my addr 172.21.15.114:0/2025125623 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:45.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.998+0000 7fb059200640 1 --2- 172.21.15.114:0/2025125623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb05413c240 0x7fb05415bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:45.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.998+0000 7fb05a600640 1 --2- 172.21.15.114:0/2025125623 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb05413f420 0x7fb054153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:45.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.998+0000 7fb059c00640 1 -- 172.21.15.114:0/2025125623 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb05413f420 msgr2=0x7fb054153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:45.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.998+0000 7fb059c00640 1 --2- 172.21.15.114:0/2025125623 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb05413f420 0x7fb054153c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:45.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.998+0000 7fb059c00640 1 -- 172.21.15.114:0/2025125623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb05413c240 msgr2=0x7fb05415bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:45.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.998+0000 7fb059c00640 1 --2- 172.21.15.114:0/2025125623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb05413c240 0x7fb05415bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:45.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.998+0000 7fb059c00640 1 -- 172.21.15.114:0/2025125623 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb040009420 con 0x7fb05406da90 2024-09-13T17:53:45.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.998+0000 7fb059c00640 1 --2- 172.21.15.114:0/2025125623 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb05406da90 0x7fb054138d70 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb04800c4d0 tx=0x7fb04800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:45.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.998+0000 7fb051600640 1 -- 172.21.15.114:0/2025125623 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb048005cf0 con 0x7fb05406da90 2024-09-13T17:53:45.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.998+0000 7fb051600640 1 -- 172.21.15.114:0/2025125623 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb048005e50 con 0x7fb05406da90 2024-09-13T17:53:45.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.998+0000 7fb05c600640 1 -- 172.21.15.114:0/2025125623 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb05415b2d0 con 0x7fb05406da90 2024-09-13T17:53:45.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.998+0000 7fb051600640 1 -- 172.21.15.114:0/2025125623 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb048007270 con 0x7fb05406da90 2024-09-13T17:53:45.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.998+0000 7fb05c600640 1 -- 172.21.15.114:0/2025125623 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb05415b890 con 0x7fb05406da90 2024-09-13T17:53:45.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.998+0000 7fb05c600640 1 -- 172.21.15.114:0/2025125623 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0540667b0 con 0x7fb05406da90 2024-09-13T17:53:45.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:44.998+0000 7fb051600640 1 -- 172.21.15.114:0/2025125623 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb0480073d0 con 0x7fb05406da90 2024-09-13T17:53:45.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:45.002+0000 7fb051600640 1 --2- 172.21.15.114:0/2025125623 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb0340666c0 0x7fb034068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:45.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:45.002+0000 7fb051600640 1 -- 172.21.15.114:0/2025125623 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7fb048083a80 con 0x7fb05406da90 2024-09-13T17:53:45.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:45.002+0000 7fb059200640 1 --2- 172.21.15.114:0/2025125623 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb0340666c0 0x7fb034068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:45.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:45.002+0000 7fb059200640 1 --2- 172.21.15.114:0/2025125623 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb0340666c0 0x7fb034068b80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb0400ae000 tx=0x7fb0400a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:45.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:45.006+0000 7fb051600640 1 -- 172.21.15.114:0/2025125623 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb048050a80 con 0x7fb05406da90 2024-09-13T17:53:45.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:45.190+0000 7fb05c600640 1 -- 172.21.15.114:0/2025125623 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb0540706b0 con 0x7fb05406da90 2024-09-13T17:53:45.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:45.194+0000 7fb051600640 1 -- 172.21.15.114:0/2025125623 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) v1 ==== 53+0+156 (secure 0 0 0) 0x7fb048017070 con 0x7fb05406da90 2024-09-13T17:53:45.198 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T17:53:45.198 INFO:teuthology.orchestra.run.smithi114.stdout:name: recovery_fs, metadata pool: recovery_fs_metadata, data pools: [cephfs_data ] 2024-09-13T17:53:45.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:45.194+0000 7fb05c600640 1 -- 172.21.15.114:0/2025125623 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb0340666c0 msgr2=0x7fb034068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:45.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:45.194+0000 7fb05c600640 1 --2- 172.21.15.114:0/2025125623 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb0340666c0 0x7fb034068b80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb0400ae000 tx=0x7fb0400a7000 comp rx=0 tx=0).stop 2024-09-13T17:53:45.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:45.194+0000 7fb05c600640 1 -- 172.21.15.114:0/2025125623 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb05406da90 msgr2=0x7fb054138d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:45.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:45.194+0000 7fb05c600640 1 --2- 172.21.15.114:0/2025125623 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb05406da90 0x7fb054138d70 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb04800c4d0 tx=0x7fb04800c990 comp rx=0 tx=0).stop 2024-09-13T17:53:45.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:45.194+0000 7fb05c600640 1 -- 172.21.15.114:0/2025125623 shutdown_connections 2024-09-13T17:53:45.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:45.194+0000 7fb05c600640 1 --2- 172.21.15.114:0/2025125623 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fb0340666c0 0x7fb034068b80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:45.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:45.194+0000 7fb05c600640 1 --2- 172.21.15.114:0/2025125623 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fb05413f420 0x7fb054153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:45.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:45.194+0000 7fb05c600640 1 --2- 172.21.15.114:0/2025125623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb05413c240 0x7fb05415bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:45.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:45.194+0000 7fb05c600640 1 --2- 172.21.15.114:0/2025125623 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb05406da90 0x7fb054138d70 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:45.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:45.194+0000 7fb05c600640 1 -- 172.21.15.114:0/2025125623 >> 172.21.15.114:0/2025125623 conn(0x7fb0540660b0 msgr2=0x7fb05413eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:45.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:45.194+0000 7fb05c600640 1 -- 172.21.15.114:0/2025125623 shutdown_connections 2024-09-13T17:53:45.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:45.194+0000 7fb05c600640 1 -- 172.21.15.114:0/2025125623 wait complete. 2024-09-13T17:53:45.219 INFO:tasks.cephfs.mount:Mounting Ceph FS recovery_fs; just confirmed its presence on cluster 2024-09-13T17:53:45.219 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T17:53:45.219 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-09-13T17:53:45.219 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T17:53:45.219 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T17:53:45.220 INFO:tasks.cephfs.mount:self.cephfs_name = recovery_fs 2024-09-13T17:53:45.220 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T17:53:45.220 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T17:53:45.220 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:53:45.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:53:45.220 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-09-13T17:53:45.229 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T17:53:45.230 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T17:53:45.230 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T17:53:45.230 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:53:45.230 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-09-13T17:53:45.230 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:53:45.230 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:53:45.230 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:53:45.230 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-09-13T17:53:45.230 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:53:45.231 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:53:45.231 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-09-13T17:53:45.231 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T17:53:45.231 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:53:45.231 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T17:53:45.231 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-09-13T17:53:45.231 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T17:53:45.232 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42345sec preferred_lft 42345sec 2024-09-13T17:53:45.232 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-09-13T17:53:45.232 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:53:45.232 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T17:53:45.232 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:0f:6c:f2:fc brd ff:ff:ff:ff:ff:ff 2024-09-13T17:53:45.232 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T17:53:45.232 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:53:45.232 INFO:teuthology.orchestra.run.smithi114.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T17:53:45.232 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T17:53:45.232 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T17:53:45.232 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:53:45.232 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-13T17:53:45.232 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:53:45.232 INFO:teuthology.orchestra.run.smithi114.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:53:45.233 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:53:45.233 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T17:53:45.233 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:53:45.233 INFO:teuthology.orchestra.run.smithi114.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T17:53:45.233 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T17:53:45.233 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-13T17:53:45.233 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-13T17:53:45.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:53:45.233 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T17:53:45.295 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-09-13T17:53:45.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:53:45.297 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-09-13T17:53:45.349 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-09-13T17:53:45.349 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T17:53:45.349 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T17:53:45.349 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T17:53:45.349 INFO:teuthology.orchestra.run.smithi114.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-13T17:53:45.349 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T17:53:45.349 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T17:53:45.350 INFO:teuthology.orchestra.run.smithi114.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:53:45.350 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:53:45.350 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T17:53:45.350 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T17:53:45.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:53:45.350 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2024-09-13T17:53:45.350 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-13T17:53:45.350 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T17:53:45.350 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T17:53:45.350 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T17:53:45.351 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-13T17:53:45.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:53:45.442 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-13T17:53:45.450 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:53:45.451 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T17:53:45.451 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:53:45.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:53:45.452 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-09-13T17:53:45.517 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:53:45.517 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T17:53:45.565 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T17:53:45.565 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T17:53:45.566 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:53:45.617 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.recovery_fs=/ 2024-09-13T17:53:45.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:53:45.617 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.recovery_fs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T17:53:45.705 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T17:53:45.705 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T17:53:45.718 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T17:53:45.718 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T17:53:45.718 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.134:3300,172.21.15.134:3301" 2024-09-13T17:53:45.718 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with new device syntax: 0@d730423f-882d-4061-b746-f6a7dc2544e0.recovery_fs=/ 2024-09-13T17:53:45.718 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.114:3300/172.21.15.134:3300/172.21.15.134:3301" will pass to kernel 2024-09-13T17:53:45.721 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T17:53:45.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:53:45.722 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T17:53:45.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:53:45.741 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T17:53:45.801 INFO:teuthology.orchestra.run.smithi114.stdout:client5342 2024-09-13T17:53:45.801 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:53:45.801 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:53:45.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:53:45.854 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls subdir) 2024-09-13T17:53:45.909 INFO:teuthology.orchestra.run.smithi114.stdout:sixmegs 2024-09-13T17:53:45.911 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T17:53:45.911 DEBUG:teuthology.orchestra.run.smithi114:> import os 2024-09-13T17:53:45.911 DEBUG:teuthology.orchestra.run.smithi114:> import stat 2024-09-13T17:53:45.911 DEBUG:teuthology.orchestra.run.smithi114:> import json 2024-09-13T17:53:45.911 DEBUG:teuthology.orchestra.run.smithi114:> import sys 2024-09-13T17:53:45.911 DEBUG:teuthology.orchestra.run.smithi114:> 2024-09-13T17:53:45.911 DEBUG:teuthology.orchestra.run.smithi114:> try: 2024-09-13T17:53:45.911 DEBUG:teuthology.orchestra.run.smithi114:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-09-13T17:53:45.911 DEBUG:teuthology.orchestra.run.smithi114:> except OSError as e: 2024-09-13T17:53:45.911 DEBUG:teuthology.orchestra.run.smithi114:> sys.exit(e.errno) 2024-09-13T17:53:45.911 DEBUG:teuthology.orchestra.run.smithi114:> 2024-09-13T17:53:45.912 DEBUG:teuthology.orchestra.run.smithi114:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-13T17:53:45.912 DEBUG:teuthology.orchestra.run.smithi114:> print(json.dumps( 2024-09-13T17:53:45.912 DEBUG:teuthology.orchestra.run.smithi114:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-13T17:53:45.912 DEBUG:teuthology.orchestra.run.smithi114:> indent=2)) 2024-09-13T17:53:45.912 DEBUG:teuthology.orchestra.run.smithi114:> ' 2024-09-13T17:53:46.024 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-13T17:53:46.024 INFO:teuthology.orchestra.run.smithi114.stdout: "st_mode": 33088, 2024-09-13T17:53:46.024 INFO:teuthology.orchestra.run.smithi114.stdout: "st_ino": 1099511627777, 2024-09-13T17:53:46.024 INFO:teuthology.orchestra.run.smithi114.stdout: "st_dev": 44, 2024-09-13T17:53:46.025 INFO:teuthology.orchestra.run.smithi114.stdout: "st_nlink": 1, 2024-09-13T17:53:46.025 INFO:teuthology.orchestra.run.smithi114.stdout: "st_uid": 0, 2024-09-13T17:53:46.025 INFO:teuthology.orchestra.run.smithi114.stdout: "st_gid": 0, 2024-09-13T17:53:46.025 INFO:teuthology.orchestra.run.smithi114.stdout: "st_size": 6291456, 2024-09-13T17:53:46.025 INFO:teuthology.orchestra.run.smithi114.stdout: "st_atime": 1726250002.0, 2024-09-13T17:53:46.025 INFO:teuthology.orchestra.run.smithi114.stdout: "st_mtime": 1726250002.0, 2024-09-13T17:53:46.025 INFO:teuthology.orchestra.run.smithi114.stdout: "st_ctime": 1726250002.0 2024-09-13T17:53:46.025 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-13T17:53:46.209 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T17:53:46.209 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:53:46.352 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T17:53:46.464 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T17:53:46.465 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:53:46.465 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:53:46.474 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:53:46.474 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:53:46.525 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:53:46.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.698+0000 7f8caa800640 1 Processor -- start 2024-09-13T17:53:46.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.698+0000 7f8caa800640 1 -- start start 2024-09-13T17:53:46.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.698+0000 7f8caa800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8ca41538d0 0x7f8ca40b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:46.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.698+0000 7f8caa800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ca4071990 0x7f8ca40acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:46.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.698+0000 7f8caa800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca415a6c0 con 0x7f8ca406dd70 2024-09-13T17:53:46.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.698+0000 7f8caa800640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca4153cb0 con 0x7f8ca41538d0 2024-09-13T17:53:46.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.698+0000 7f8caa800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca40abe30 con 0x7f8ca4071990 2024-09-13T17:53:46.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.702+0000 7f8ca9400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8ca41538d0 0x7f8ca40b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:46.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.702+0000 7f8ca9e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ca4071990 0x7f8ca40acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:46.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.702+0000 7f8ca8a00640 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f8ca406dd70 0x7f8ca4071280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:37092/0 (socket says 172.21.15.114:37092) 2024-09-13T17:53:46.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.702+0000 7f8ca8a00640 1 -- 172.21.15.114:0/1840624590 learned_addr learned my addr 172.21.15.114:0/1840624590 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:46.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.702+0000 7f8ca9e00640 1 -- 172.21.15.114:0/1840624590 >> v2:172.21.15.134:3300/0 conn(0x7f8ca41538d0 msgr2=0x7f8ca40b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:46.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.702+0000 7f8ca9e00640 1 --2- 172.21.15.114:0/1840624590 >> v2:172.21.15.134:3300/0 conn(0x7f8ca41538d0 0x7f8ca40b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:46.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.702+0000 7f8ca9e00640 1 -- 172.21.15.114:0/1840624590 >> v1:172.21.15.134:6789/0 conn(0x7f8ca406dd70 legacy=0x7f8ca4071280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:46.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.702+0000 7f8ca9e00640 1 -- 172.21.15.114:0/1840624590 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca40ac110 con 0x7f8ca4071990 2024-09-13T17:53:46.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.702+0000 7f8ca9400640 1 --2- 172.21.15.114:0/1840624590 >> v2:172.21.15.134:3300/0 conn(0x7f8ca41538d0 0x7f8ca40b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:53:46.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.702+0000 7f8ca9e00640 1 --2- 172.21.15.114:0/1840624590 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ca4071990 0x7f8ca40acbf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c009d90 tx=0x7f8c9c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9c2677d8d29de19 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:46.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.702+0000 7f8ca3e00640 1 -- 172.21.15.114:0/1840624590 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c0a5a00 con 0x7f8ca4071990 2024-09-13T17:53:46.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.702+0000 7f8ca3e00640 1 -- 172.21.15.114:0/1840624590 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9c0a5b60 con 0x7f8ca4071990 2024-09-13T17:53:46.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.702+0000 7f8ca3e00640 1 -- 172.21.15.114:0/1840624590 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c0ad440 con 0x7f8ca4071990 2024-09-13T17:53:46.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.706+0000 7f8caa800640 1 -- 172.21.15.114:0/1840624590 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ca4071990 msgr2=0x7f8ca40acbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:46.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.706+0000 7f8caa800640 1 --2- 172.21.15.114:0/1840624590 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ca4071990 0x7f8ca40acbf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c009d90 tx=0x7f8c9c01c940 comp rx=0 tx=0).stop 2024-09-13T17:53:46.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.706+0000 7f8caa800640 1 -- 172.21.15.114:0/1840624590 shutdown_connections 2024-09-13T17:53:46.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.706+0000 7f8caa800640 1 --2- 172.21.15.114:0/1840624590 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ca4071990 0x7f8ca40acbf0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:46.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.706+0000 7f8caa800640 1 --2- 172.21.15.114:0/1840624590 >> v2:172.21.15.134:3300/0 conn(0x7f8ca41538d0 0x7f8ca40b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:46.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.706+0000 7f8caa800640 1 -- 172.21.15.114:0/1840624590 >> 172.21.15.114:0/1840624590 conn(0x7f8ca40ce0d0 msgr2=0x7f8ca40ce4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:46.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.706+0000 7f8caa800640 1 -- 172.21.15.114:0/1840624590 shutdown_connections 2024-09-13T17:53:46.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.706+0000 7f8caa800640 1 -- 172.21.15.114:0/1840624590 wait complete. 2024-09-13T17:53:46.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.706+0000 7f8caa800640 1 Processor -- start 2024-09-13T17:53:46.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.706+0000 7f8caa800640 1 -- start start 2024-09-13T17:53:46.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.706+0000 7f8caa800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ca406dd70 0x7f8ca414db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.706+0000 7f8caa800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ca4071990 0x7f8ca4097b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.706+0000 7f8caa800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca41538d0 0x7f8ca409be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.706+0000 7f8caa800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca414d9c0 con 0x7f8ca41538d0 2024-09-13T17:53:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.706+0000 7f8caa800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca414f500 con 0x7f8ca4071990 2024-09-13T17:53:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.706+0000 7f8caa800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca409c3d0 con 0x7f8ca406dd70 2024-09-13T17:53:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.706+0000 7f8ca9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca41538d0 0x7f8ca409be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.706+0000 7f8ca9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca41538d0 0x7f8ca409be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43890/0 (socket says 172.21.15.114:43890) 2024-09-13T17:53:46.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.706+0000 7f8ca9e00640 1 -- 172.21.15.114:0/1168621404 learned_addr learned my addr 172.21.15.114:0/1168621404 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.706+0000 7f8ca8a00640 1 --2- 172.21.15.114:0/1168621404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ca4071990 0x7f8ca4097b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.706+0000 7f8ca9400640 1 --2- 172.21.15.114:0/1168621404 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ca406dd70 0x7f8ca414db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.706+0000 7f8ca9e00640 1 -- 172.21.15.114:0/1168621404 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ca406dd70 msgr2=0x7f8ca414db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.706+0000 7f8ca9e00640 1 --2- 172.21.15.114:0/1168621404 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ca406dd70 0x7f8ca414db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.706+0000 7f8ca9e00640 1 -- 172.21.15.114:0/1168621404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ca4071990 msgr2=0x7f8ca4097b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.706+0000 7f8ca9e00640 1 --2- 172.21.15.114:0/1168621404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ca4071990 0x7f8ca4097b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.706+0000 7f8ca9e00640 1 -- 172.21.15.114:0/1168621404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c98009420 con 0x7f8ca41538d0 2024-09-13T17:53:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.706+0000 7f8ca8a00640 1 --2- 172.21.15.114:0/1168621404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ca4071990 0x7f8ca4097b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.706+0000 7f8ca9400640 1 --2- 172.21.15.114:0/1168621404 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ca406dd70 0x7f8ca414db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:46.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.710+0000 7f8ca9e00640 1 --2- 172.21.15.114:0/1168621404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca41538d0 0x7f8ca409be90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c0b0040 tx=0x7f8c9c0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:46.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.710+0000 7f8ca1600640 1 -- 172.21.15.114:0/1168621404 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c0adce0 con 0x7f8ca41538d0 2024-09-13T17:53:46.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.710+0000 7f8ca1600640 1 -- 172.21.15.114:0/1168621404 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9c0ade40 con 0x7f8ca41538d0 2024-09-13T17:53:46.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.710+0000 7f8caa800640 1 -- 172.21.15.114:0/1168621404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c9c009a70 con 0x7f8ca41538d0 2024-09-13T17:53:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.710+0000 7f8ca1600640 1 -- 172.21.15.114:0/1168621404 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c0b9690 con 0x7f8ca41538d0 2024-09-13T17:53:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.710+0000 7f8caa800640 1 -- 172.21.15.114:0/1168621404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca414fa80 con 0x7f8ca41538d0 2024-09-13T17:53:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.710+0000 7f8caa800640 1 -- 172.21.15.114:0/1168621404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca40acbf0 con 0x7f8ca41538d0 2024-09-13T17:53:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.710+0000 7f8ca1600640 1 -- 172.21.15.114:0/1168621404 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8c9c0b97f0 con 0x7f8ca41538d0 2024-09-13T17:53:46.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.710+0000 7f8ca1600640 1 --2- 172.21.15.114:0/1168621404 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8c84066690 0x7f8c84068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:46.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.710+0000 7f8ca1600640 1 -- 172.21.15.114:0/1168621404 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f8c9c11fc00 con 0x7f8ca41538d0 2024-09-13T17:53:46.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.710+0000 7f8ca9400640 1 --2- 172.21.15.114:0/1168621404 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8c84066690 0x7f8c84068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:46.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.714+0000 7f8ca9400640 1 --2- 172.21.15.114:0/1168621404 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8c84066690 0x7f8c84068b50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8c98009ca0 tx=0x7f8c98008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:46.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.714+0000 7f8ca1600640 1 -- 172.21.15.114:0/1168621404 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8c9c126080 con 0x7f8ca41538d0 2024-09-13T17:53:46.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.870+0000 7f8caa800640 1 -- 172.21.15.114:0/1168621404 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ca4070cf0 con 0x7f8ca41538d0 2024-09-13T17:53:46.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.870+0000 7f8ca1600640 1 -- 172.21.15.114:0/1168621404 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+18795 (secure 0 0 0) 0x7f8c9c0ecc80 con 0x7f8ca41538d0 2024-09-13T17:53:46.876 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:46.876 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":48,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:53:33.088316+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:53:06.185439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:53:07.297633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2024-09-13T17:53:31.026998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.35","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6835/1239035445":"2024-09-14T17:53:22.929223+0000","172.21.15.134:6833/1239035445":"2024-09-14T17:53:22.929223+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:53:46.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.874+0000 7f8caa800640 1 -- 172.21.15.114:0/1168621404 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8c84066690 msgr2=0x7f8c84068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:46.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.874+0000 7f8caa800640 1 --2- 172.21.15.114:0/1168621404 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8c84066690 0x7f8c84068b50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8c98009ca0 tx=0x7f8c98008040 comp rx=0 tx=0).stop 2024-09-13T17:53:46.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.874+0000 7f8caa800640 1 -- 172.21.15.114:0/1168621404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca41538d0 msgr2=0x7f8ca409be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:46.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.874+0000 7f8caa800640 1 --2- 172.21.15.114:0/1168621404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca41538d0 0x7f8ca409be90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c0b0040 tx=0x7f8c9c0196e0 comp rx=0 tx=0).stop 2024-09-13T17:53:46.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.874+0000 7f8caa800640 1 -- 172.21.15.114:0/1168621404 shutdown_connections 2024-09-13T17:53:46.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.874+0000 7f8caa800640 1 --2- 172.21.15.114:0/1168621404 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8c84066690 0x7f8c84068b50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:46.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.874+0000 7f8caa800640 1 --2- 172.21.15.114:0/1168621404 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ca41538d0 0x7f8ca409be90 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:46.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.874+0000 7f8caa800640 1 --2- 172.21.15.114:0/1168621404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ca4071990 0x7f8ca4097b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:46.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.874+0000 7f8caa800640 1 --2- 172.21.15.114:0/1168621404 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ca406dd70 0x7f8ca414db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:46.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.874+0000 7f8caa800640 1 -- 172.21.15.114:0/1168621404 >> 172.21.15.114:0/1168621404 conn(0x7f8ca40ce0d0 msgr2=0x7f8ca4071280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:46.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.874+0000 7f8caa800640 1 -- 172.21.15.114:0/1168621404 shutdown_connections 2024-09-13T17:53:46.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:46.874+0000 7f8caa800640 1 -- 172.21.15.114:0/1168621404 wait complete. 2024-09-13T17:53:46.899 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:51:37.996254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:53:06.185439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:53:07.297633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'recovery_fs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'recovery_fs_metadata', 'create_time': '2024-09-13T17:53:31.026998+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'recovery_fs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:53:46.899 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:53:47.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.030+0000 7f3d39800640 1 Processor -- start 2024-09-13T17:53:47.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.030+0000 7f3d39800640 1 -- start start 2024-09-13T17:53:47.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.034+0000 7f3d39800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3d34151420 0x7f3d340cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:47.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.034+0000 7f3d39800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d34151800 con 0x7f3d340ccba0 2024-09-13T17:53:47.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.034+0000 7f3d39800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d340cafb0 con 0x7f3d34070b30 2024-09-13T17:53:47.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.034+0000 7f3d39800640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d340cbc30 con 0x7f3d34151420 2024-09-13T17:53:47.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.034+0000 7f3d32a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3d34151420 0x7f3d340cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:47.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.034+0000 7f3d32000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3d340ccba0 0x7f3d34070420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33804/0 (socket says 172.21.15.114:33804) 2024-09-13T17:53:47.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.034+0000 7f3d32000640 1 -- 172.21.15.114:0/2296746865 learned_addr learned my addr 172.21.15.114:0/2296746865 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:47.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.034+0000 7f3d32a00640 1 -- 172.21.15.114:0/2296746865 >> v1:172.21.15.134:6789/0 conn(0x7f3d34070b30 legacy=0x7f3d3406c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:47.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.034+0000 7f3d32a00640 1 -- 172.21.15.114:0/2296746865 >> v1:172.21.15.114:6789/0 conn(0x7f3d340ccba0 legacy=0x7f3d34070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:47.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.034+0000 7f3d32a00640 1 -- 172.21.15.114:0/2296746865 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d340cb290 con 0x7f3d34151420 2024-09-13T17:53:47.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.034+0000 7f3d31600640 1 -- 172.21.15.114:0/2296746865 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818442841 0 0) 0x7f3d34151800 con 0x7f3d340ccba0 2024-09-13T17:53:47.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.038+0000 7f3d32a00640 1 --2- 172.21.15.114:0/2296746865 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d34151420 0x7f3d340cc660 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3d24009d90 tx=0x7f3d2401c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a2c0e3f5c3d77b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:47.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.038+0000 7f3d31600640 1 -- 172.21.15.114:0/2296746865 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d240a58e0 con 0x7f3d34151420 2024-09-13T17:53:47.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.038+0000 7f3d31600640 1 -- 172.21.15.114:0/2296746865 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d240a5a40 con 0x7f3d34151420 2024-09-13T17:53:47.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.038+0000 7f3d31600640 1 -- 172.21.15.114:0/2296746865 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d240a5dd0 con 0x7f3d34151420 2024-09-13T17:53:47.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.038+0000 7f3d39800640 1 -- 172.21.15.114:0/2296746865 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d34151420 msgr2=0x7f3d340cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:47.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.038+0000 7f3d39800640 1 --2- 172.21.15.114:0/2296746865 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d34151420 0x7f3d340cc660 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3d24009d90 tx=0x7f3d2401c820 comp rx=0 tx=0).stop 2024-09-13T17:53:47.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.038+0000 7f3d39800640 1 -- 172.21.15.114:0/2296746865 shutdown_connections 2024-09-13T17:53:47.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.038+0000 7f3d39800640 1 --2- 172.21.15.114:0/2296746865 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d34151420 0x7f3d340cc660 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:47.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.038+0000 7f3d39800640 1 -- 172.21.15.114:0/2296746865 >> 172.21.15.114:0/2296746865 conn(0x7f3d340660b0 msgr2=0x7f3d34069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:47.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.038+0000 7f3d39800640 1 -- 172.21.15.114:0/2296746865 shutdown_connections 2024-09-13T17:53:47.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.038+0000 7f3d39800640 1 -- 172.21.15.114:0/2296746865 wait complete. 2024-09-13T17:53:47.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.038+0000 7f3d39800640 1 Processor -- start 2024-09-13T17:53:47.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.038+0000 7f3d39800640 1 -- start start 2024-09-13T17:53:47.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.038+0000 7f3d39800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d34070b30 0x7f3d341611d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:47.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.038+0000 7f3d39800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3d340ccba0 0x7f3d34158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:47.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.042+0000 7f3d39800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d34151420 0x7f3d3415f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:47.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.042+0000 7f3d39800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d340ad710 con 0x7f3d34070b30 2024-09-13T17:53:47.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.042+0000 7f3d39800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d341618d0 con 0x7f3d34151420 2024-09-13T17:53:47.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.042+0000 7f3d39800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d34161bb0 con 0x7f3d340ccba0 2024-09-13T17:53:47.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.042+0000 7f3d32a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d34070b30 0x7f3d341611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:47.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.042+0000 7f3d32a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d34070b30 0x7f3d341611d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43904/0 (socket says 172.21.15.114:43904) 2024-09-13T17:53:47.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.042+0000 7f3d32a00640 1 -- 172.21.15.114:0/1421508584 learned_addr learned my addr 172.21.15.114:0/1421508584 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:47.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.042+0000 7f3d32000640 1 --2- 172.21.15.114:0/1421508584 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3d340ccba0 0x7f3d34158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:47.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.042+0000 7f3d33400640 1 --2- 172.21.15.114:0/1421508584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d34151420 0x7f3d3415f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:47.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.042+0000 7f3d32a00640 1 -- 172.21.15.114:0/1421508584 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3d340ccba0 msgr2=0x7f3d34158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:47.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.042+0000 7f3d32a00640 1 --2- 172.21.15.114:0/1421508584 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3d340ccba0 0x7f3d34158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:47.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.042+0000 7f3d32a00640 1 -- 172.21.15.114:0/1421508584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d34151420 msgr2=0x7f3d3415f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:47.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.042+0000 7f3d32a00640 1 --2- 172.21.15.114:0/1421508584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d34151420 0x7f3d3415f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:47.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.042+0000 7f3d32a00640 1 -- 172.21.15.114:0/1421508584 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d24009a70 con 0x7f3d34070b30 2024-09-13T17:53:47.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.042+0000 7f3d32a00640 1 --2- 172.21.15.114:0/1421508584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d34070b30 0x7f3d341611d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f3d240b0040 tx=0x7f3d240195c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:47.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.042+0000 7f3d2aa00640 1 -- 172.21.15.114:0/1421508584 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d240ad8d0 con 0x7f3d34070b30 2024-09-13T17:53:47.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.042+0000 7f3d2aa00640 1 -- 172.21.15.114:0/1421508584 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d240ada30 con 0x7f3d34070b30 2024-09-13T17:53:47.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.042+0000 7f3d39800640 1 -- 172.21.15.114:0/1421508584 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d34161e90 con 0x7f3d34070b30 2024-09-13T17:53:47.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.042+0000 7f3d2aa00640 1 -- 172.21.15.114:0/1421508584 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d240addc0 con 0x7f3d34070b30 2024-09-13T17:53:47.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.042+0000 7f3d39800640 1 -- 172.21.15.114:0/1421508584 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d34162450 con 0x7f3d34070b30 2024-09-13T17:53:47.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.042+0000 7f3d39800640 1 -- 172.21.15.114:0/1421508584 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d340cc660 con 0x7f3d34070b30 2024-09-13T17:53:47.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.042+0000 7f3d2aa00640 1 -- 172.21.15.114:0/1421508584 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3d240c4460 con 0x7f3d34070b30 2024-09-13T17:53:47.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.046+0000 7f3d2aa00640 1 --2- 172.21.15.114:0/1421508584 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3d14066690 0x7f3d14068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:47.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.046+0000 7f3d2aa00640 1 -- 172.21.15.114:0/1421508584 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f3d2411fca0 con 0x7f3d34070b30 2024-09-13T17:53:47.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.046+0000 7f3d32000640 1 --2- 172.21.15.114:0/1421508584 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3d14066690 0x7f3d14068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:47.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.046+0000 7f3d32000640 1 --2- 172.21.15.114:0/1421508584 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3d14066690 0x7f3d14068b50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3d340711d0 tx=0x7f3d20009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:47.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.050+0000 7f3d2aa00640 1 -- 172.21.15.114:0/1421508584 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3d240ecc80 con 0x7f3d34070b30 2024-09-13T17:53:47.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.202+0000 7f3d39800640 1 -- 172.21.15.114:0/1421508584 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d34162640 con 0x7f3d34070b30 2024-09-13T17:53:47.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.202+0000 7f3d2aa00640 1 -- 172.21.15.114:0/1421508584 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d240b2070 con 0x7f3d34070b30 2024-09-13T17:53:47.207 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-13T17:53:47.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.202+0000 7f3d39800640 1 -- 172.21.15.114:0/1421508584 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3d14066690 msgr2=0x7f3d14068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:47.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.202+0000 7f3d39800640 1 --2- 172.21.15.114:0/1421508584 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3d14066690 0x7f3d14068b50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3d340711d0 tx=0x7f3d20009040 comp rx=0 tx=0).stop 2024-09-13T17:53:47.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.202+0000 7f3d39800640 1 -- 172.21.15.114:0/1421508584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d34070b30 msgr2=0x7f3d341611d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:47.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.202+0000 7f3d39800640 1 --2- 172.21.15.114:0/1421508584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d34070b30 0x7f3d341611d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f3d240b0040 tx=0x7f3d240195c0 comp rx=0 tx=0).stop 2024-09-13T17:53:47.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.202+0000 7f3d39800640 1 -- 172.21.15.114:0/1421508584 shutdown_connections 2024-09-13T17:53:47.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.202+0000 7f3d39800640 1 --2- 172.21.15.114:0/1421508584 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3d14066690 0x7f3d14068b50 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:47.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.202+0000 7f3d39800640 1 --2- 172.21.15.114:0/1421508584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d34151420 0x7f3d3415f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:47.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.202+0000 7f3d39800640 1 --2- 172.21.15.114:0/1421508584 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3d340ccba0 0x7f3d34158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:47.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.202+0000 7f3d39800640 1 --2- 172.21.15.114:0/1421508584 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3d34070b30 0x7f3d341611d0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:47.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.202+0000 7f3d39800640 1 -- 172.21.15.114:0/1421508584 >> 172.21.15.114:0/1421508584 conn(0x7f3d340660b0 msgr2=0x7f3d34070420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:47.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.202+0000 7f3d39800640 1 -- 172.21.15.114:0/1421508584 shutdown_connections 2024-09-13T17:53:47.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.206+0000 7f3d39800640 1 -- 172.21.15.114:0/1421508584 wait complete. 2024-09-13T17:53:47.228 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:53:47.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.362+0000 7f0efd000640 1 Processor -- start 2024-09-13T17:53:47.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.362+0000 7f0efd000640 1 -- start start 2024-09-13T17:53:47.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.362+0000 7f0efd000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0ef813f420 0x7f0ef806d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:47.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.362+0000 7f0efd000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef80cd220 con 0x7f0ef813c240 2024-09-13T17:53:47.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.362+0000 7f0efd000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef815a740 con 0x7f0ef806da90 2024-09-13T17:53:47.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.362+0000 7f0efd000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef806df40 con 0x7f0ef813f420 2024-09-13T17:53:47.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.362+0000 7f0ef5e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0ef813c240 0x7f0ef813c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33808/0 (socket says 172.21.15.114:33808) 2024-09-13T17:53:47.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.362+0000 7f0ef5e00640 1 -- 172.21.15.114:0/2058813960 learned_addr learned my addr 172.21.15.114:0/2058813960 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:47.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.362+0000 7f0ef5400640 1 --2- 172.21.15.114:0/2058813960 >> v2:172.21.15.134:3300/0 conn(0x7f0ef813f420 0x7f0ef806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:47.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.362+0000 7f0ef4a00640 1 -- 172.21.15.114:0/2058813960 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3590918328 0 0) 0x7f0ef80cd220 con 0x7f0ef813c240 2024-09-13T17:53:47.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.362+0000 7f0ef4a00640 1 -- 172.21.15.114:0/2058813960 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0edc003530 con 0x7f0ef813c240 2024-09-13T17:53:47.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.362+0000 7f0ef4a00640 1 -- 172.21.15.114:0/2058813960 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 24347557 0 0) 0x7f0edc003530 con 0x7f0ef813c240 2024-09-13T17:53:47.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.362+0000 7f0ef5400640 1 -- 172.21.15.114:0/2058813960 >> v1:172.21.15.134:6789/0 conn(0x7f0ef806da90 legacy=0x7f0ef80cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:47.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.362+0000 7f0ef5400640 1 -- 172.21.15.114:0/2058813960 >> v1:172.21.15.114:6789/0 conn(0x7f0ef813c240 legacy=0x7f0ef813c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:47.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.362+0000 7f0ef5400640 1 -- 172.21.15.114:0/2058813960 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef8159bc0 con 0x7f0ef813f420 2024-09-13T17:53:47.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.366+0000 7f0ef5400640 1 --2- 172.21.15.114:0/2058813960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ef813f420 0x7f0ef806d550 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0ee40097c0 tx=0x7f0ee401c240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8aa64380a89c9e68 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:47.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.366+0000 7f0ef4a00640 1 -- 172.21.15.114:0/2058813960 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8001680 con 0x7f0ef813f420 2024-09-13T17:53:47.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.366+0000 7f0ef4a00640 1 -- 172.21.15.114:0/2058813960 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee40a7050 con 0x7f0ef813f420 2024-09-13T17:53:47.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.366+0000 7f0ef4a00640 1 -- 172.21.15.114:0/2058813960 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee40ab620 con 0x7f0ef813f420 2024-09-13T17:53:47.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.366+0000 7f0efd000640 1 -- 172.21.15.114:0/2058813960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ef813f420 msgr2=0x7f0ef806d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:47.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.366+0000 7f0efd000640 1 --2- 172.21.15.114:0/2058813960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ef813f420 0x7f0ef806d550 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0ee40097c0 tx=0x7f0ee401c240 comp rx=0 tx=0).stop 2024-09-13T17:53:47.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.366+0000 7f0efd000640 1 -- 172.21.15.114:0/2058813960 shutdown_connections 2024-09-13T17:53:47.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.366+0000 7f0efd000640 1 --2- 172.21.15.114:0/2058813960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ef813f420 0x7f0ef806d550 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:47.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.366+0000 7f0efd000640 1 -- 172.21.15.114:0/2058813960 >> 172.21.15.114:0/2058813960 conn(0x7f0ef80660b0 msgr2=0x7f0ef8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:47.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.366+0000 7f0efd000640 1 -- 172.21.15.114:0/2058813960 shutdown_connections 2024-09-13T17:53:47.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.366+0000 7f0efd000640 1 -- 172.21.15.114:0/2058813960 wait complete. 2024-09-13T17:53:47.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.370+0000 7f0efd000640 1 Processor -- start 2024-09-13T17:53:47.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.370+0000 7f0efd000640 1 -- start start 2024-09-13T17:53:47.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.370+0000 7f0efd000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ef806da90 0x7f0ef81f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:47.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.370+0000 7f0efd000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ef813c240 0x7f0ef80b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:47.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.370+0000 7f0efd000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0ef813f420 0x7f0ef813a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:47.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.370+0000 7f0efd000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef80ac940 con 0x7f0ef813c240 2024-09-13T17:53:47.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.370+0000 7f0efd000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef80c4bd0 con 0x7f0ef806da90 2024-09-13T17:53:47.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.370+0000 7f0efd000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef80abcc0 con 0x7f0ef813f420 2024-09-13T17:53:47.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.370+0000 7f0ef5400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ef813c240 0x7f0ef80b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:47.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.370+0000 7f0ef5400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ef813c240 0x7f0ef80b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43908/0 (socket says 172.21.15.114:43908) 2024-09-13T17:53:47.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.370+0000 7f0ef5400640 1 -- 172.21.15.114:0/324210075 learned_addr learned my addr 172.21.15.114:0/324210075 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:47.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.370+0000 7f0ef5400640 1 -- 172.21.15.114:0/324210075 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0ef813f420 msgr2=0x7f0ef813a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:47.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.370+0000 7f0ef5400640 1 --2- 172.21.15.114:0/324210075 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0ef813f420 0x7f0ef813a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:47.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.370+0000 7f0ef5400640 1 -- 172.21.15.114:0/324210075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ef806da90 msgr2=0x7f0ef81f5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:47.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.370+0000 7f0ef5400640 1 --2- 172.21.15.114:0/324210075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ef806da90 0x7f0ef81f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:47.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.370+0000 7f0ef5400640 1 -- 172.21.15.114:0/324210075 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee4009420 con 0x7f0ef813c240 2024-09-13T17:53:47.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.370+0000 7f0ef5400640 1 --2- 172.21.15.114:0/324210075 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ef813c240 0x7f0ef80b0900 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0ee40097c0 tx=0x7f0ee401aa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:47.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.370+0000 7f0eee000640 1 -- 172.21.15.114:0/324210075 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4004020 con 0x7f0ef813c240 2024-09-13T17:53:47.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.370+0000 7f0eee000640 1 -- 172.21.15.114:0/324210075 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee40a4e90 con 0x7f0ef813c240 2024-09-13T17:53:47.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.370+0000 7f0efd000640 1 -- 172.21.15.114:0/324210075 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef80abfa0 con 0x7f0ef813c240 2024-09-13T17:53:47.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.370+0000 7f0eee000640 1 -- 172.21.15.114:0/324210075 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee40043c0 con 0x7f0ef813c240 2024-09-13T17:53:47.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.370+0000 7f0efd000640 1 -- 172.21.15.114:0/324210075 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef80ac560 con 0x7f0ef813c240 2024-09-13T17:53:47.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.370+0000 7f0efd000640 1 -- 172.21.15.114:0/324210075 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef8159790 con 0x7f0ef813c240 2024-09-13T17:53:47.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.374+0000 7f0eee000640 1 -- 172.21.15.114:0/324210075 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0ee4003620 con 0x7f0ef813c240 2024-09-13T17:53:47.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.374+0000 7f0eee000640 1 --2- 172.21.15.114:0/324210075 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0ed8066690 0x7f0ed8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:47.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.374+0000 7f0eee000640 1 -- 172.21.15.114:0/324210075 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f0ee411ddd0 con 0x7f0ef813c240 2024-09-13T17:53:47.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.374+0000 7f0ef5e00640 1 --2- 172.21.15.114:0/324210075 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0ed8066690 0x7f0ed8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:47.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.374+0000 7f0ef5e00640 1 --2- 172.21.15.114:0/324210075 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0ed8066690 0x7f0ed8068b50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8001ec0 tx=0x7f0ee8001ab0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:47.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.378+0000 7f0eee000640 1 -- 172.21.15.114:0/324210075 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0ee40ead20 con 0x7f0ef813c240 2024-09-13T17:53:47.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.530+0000 7f0efd000640 1 -- 172.21.15.114:0/324210075 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0ef80aca80 con 0x7f0ef813c240 2024-09-13T17:53:47.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.530+0000 7f0eee000640 1 -- 172.21.15.114:0/324210075 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v48) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0ef80aca80 con 0x7f0ef813c240 2024-09-13T17:53:47.538 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:53:47.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.534+0000 7f0efd000640 1 -- 172.21.15.114:0/324210075 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0ed8066690 msgr2=0x7f0ed8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:47.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.534+0000 7f0efd000640 1 --2- 172.21.15.114:0/324210075 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0ed8066690 0x7f0ed8068b50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8001ec0 tx=0x7f0ee8001ab0 comp rx=0 tx=0).stop 2024-09-13T17:53:47.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.534+0000 7f0efd000640 1 -- 172.21.15.114:0/324210075 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ef813c240 msgr2=0x7f0ef80b0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:47.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.534+0000 7f0efd000640 1 --2- 172.21.15.114:0/324210075 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ef813c240 0x7f0ef80b0900 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0ee40097c0 tx=0x7f0ee401aa80 comp rx=0 tx=0).stop 2024-09-13T17:53:47.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.534+0000 7f0efd000640 1 -- 172.21.15.114:0/324210075 shutdown_connections 2024-09-13T17:53:47.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.534+0000 7f0efd000640 1 --2- 172.21.15.114:0/324210075 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0ed8066690 0x7f0ed8068b50 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:47.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.534+0000 7f0efd000640 1 --2- 172.21.15.114:0/324210075 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f0ef813f420 0x7f0ef813a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:47.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.534+0000 7f0efd000640 1 --2- 172.21.15.114:0/324210075 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0ef813c240 0x7f0ef80b0900 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:47.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.534+0000 7f0efd000640 1 --2- 172.21.15.114:0/324210075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ef806da90 0x7f0ef81f5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:47.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.534+0000 7f0efd000640 1 -- 172.21.15.114:0/324210075 >> 172.21.15.114:0/324210075 conn(0x7f0ef80660b0 msgr2=0x7f0ef8158c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:47.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.534+0000 7f0efd000640 1 -- 172.21.15.114:0/324210075 shutdown_connections 2024-09-13T17:53:47.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.534+0000 7f0efd000640 1 -- 172.21.15.114:0/324210075 wait complete. 2024-09-13T17:53:47.558 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:53:47.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.690+0000 7fd127200640 1 Processor -- start 2024-09-13T17:53:47.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.690+0000 7fd127200640 1 -- start start 2024-09-13T17:53:47.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.694+0000 7fd127200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd12815c880 0x7fd1280d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:47.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.694+0000 7fd127200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd12806bfc0 0x7fd128098a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:47.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.694+0000 7fd127200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd128099400 con 0x7fd128098fb0 2024-09-13T17:53:47.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.694+0000 7fd127200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd12815cc60 con 0x7fd12815c880 2024-09-13T17:53:47.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.694+0000 7fd127200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1280ca980 con 0x7fd12806bfc0 2024-09-13T17:53:47.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.694+0000 7fd125e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd12815c880 0x7fd1280d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:47.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.694+0000 7fd125e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd12815c880 0x7fd1280d0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43916/0 (socket says 172.21.15.114:43916) 2024-09-13T17:53:47.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.694+0000 7fd125e00640 1 -- 172.21.15.114:0/3834154502 learned_addr learned my addr 172.21.15.114:0/3834154502 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:47.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.694+0000 7fd125e00640 1 -- 172.21.15.114:0/3834154502 >> v2:172.21.15.134:3300/0 conn(0x7fd12806bfc0 msgr2=0x7fd128098a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:47.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.694+0000 7fd125400640 1 --2- 172.21.15.114:0/3834154502 >> v2:172.21.15.134:3300/0 conn(0x7fd12806bfc0 0x7fd128098a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:47.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.694+0000 7fd125e00640 1 --2- 172.21.15.114:0/3834154502 >> v2:172.21.15.134:3300/0 conn(0x7fd12806bfc0 0x7fd128098a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:47.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.694+0000 7fd125e00640 1 -- 172.21.15.114:0/3834154502 >> v1:172.21.15.134:6789/0 conn(0x7fd128098fb0 legacy=0x7fd1280ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:47.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.694+0000 7fd125e00640 1 -- 172.21.15.114:0/3834154502 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12806c450 con 0x7fd12815c880 2024-09-13T17:53:47.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.694+0000 7fd125400640 1 --2- 172.21.15.114:0/3834154502 >> v2:172.21.15.134:3300/0 conn(0x7fd12806bfc0 0x7fd128098a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:47.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.698+0000 7fd125e00640 1 --2- 172.21.15.114:0/3834154502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd12815c880 0x7fd1280d0e50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd1280cfe90 tx=0x7fd11801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192060a154ceee9c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:47.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.698+0000 7fd124a00640 1 -- 172.21.15.114:0/3834154502 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1180ab620 con 0x7fd12815c880 2024-09-13T17:53:47.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.698+0000 7fd124a00640 1 -- 172.21.15.114:0/3834154502 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1180ab780 con 0x7fd12815c880 2024-09-13T17:53:47.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.698+0000 7fd124a00640 1 -- 172.21.15.114:0/3834154502 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1180abb10 con 0x7fd12815c880 2024-09-13T17:53:47.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.698+0000 7fd127200640 1 -- 172.21.15.114:0/3834154502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd12815c880 msgr2=0x7fd1280d0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:47.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.698+0000 7fd127200640 1 --2- 172.21.15.114:0/3834154502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd12815c880 0x7fd1280d0e50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd1280cfe90 tx=0x7fd11801c420 comp rx=0 tx=0).stop 2024-09-13T17:53:47.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.698+0000 7fd127200640 1 -- 172.21.15.114:0/3834154502 shutdown_connections 2024-09-13T17:53:47.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.698+0000 7fd127200640 1 --2- 172.21.15.114:0/3834154502 >> v2:172.21.15.134:3300/0 conn(0x7fd12806bfc0 0x7fd128098a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:47.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.698+0000 7fd127200640 1 --2- 172.21.15.114:0/3834154502 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd12815c880 0x7fd1280d0e50 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:47.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.698+0000 7fd127200640 1 -- 172.21.15.114:0/3834154502 >> 172.21.15.114:0/3834154502 conn(0x7fd1280d0330 msgr2=0x7fd1280d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:47.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.698+0000 7fd127200640 1 -- 172.21.15.114:0/3834154502 shutdown_connections 2024-09-13T17:53:47.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.698+0000 7fd127200640 1 -- 172.21.15.114:0/3834154502 wait complete. 2024-09-13T17:53:47.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.698+0000 7fd127200640 1 Processor -- start 2024-09-13T17:53:47.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.698+0000 7fd127200640 1 -- start start 2024-09-13T17:53:47.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.698+0000 7fd127200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd128098fb0 0x7fd12814f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:47.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.698+0000 7fd127200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd12815c880 0x7fd128152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:47.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.698+0000 7fd127200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd128156420 0x7fd12806f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:47.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.698+0000 7fd127200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1280ce7c0 con 0x7fd12815c880 2024-09-13T17:53:47.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.698+0000 7fd127200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12814fdd0 con 0x7fd128098fb0 2024-09-13T17:53:47.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.698+0000 7fd127200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1280c7400 con 0x7fd128156420 2024-09-13T17:53:47.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.698+0000 7fd125400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd12815c880 0x7fd128152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:47.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.698+0000 7fd125400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd12815c880 0x7fd128152120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43920/0 (socket says 172.21.15.114:43920) 2024-09-13T17:53:47.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.698+0000 7fd125400640 1 -- 172.21.15.114:0/3307146115 learned_addr learned my addr 172.21.15.114:0/3307146115 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:47.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.702+0000 7fd125e00640 1 --2- 172.21.15.114:0/3307146115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd128098fb0 0x7fd12814f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:47.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.702+0000 7fd126800640 1 --2- 172.21.15.114:0/3307146115 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd128156420 0x7fd12806f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:47.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.702+0000 7fd125400640 1 -- 172.21.15.114:0/3307146115 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd128156420 msgr2=0x7fd12806f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:47.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.702+0000 7fd125400640 1 --2- 172.21.15.114:0/3307146115 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd128156420 0x7fd12806f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:47.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.702+0000 7fd125400640 1 -- 172.21.15.114:0/3307146115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd128098fb0 msgr2=0x7fd12814f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:47.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.702+0000 7fd125400640 1 --2- 172.21.15.114:0/3307146115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd128098fb0 0x7fd12814f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:47.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.702+0000 7fd125400640 1 -- 172.21.15.114:0/3307146115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1180094d0 con 0x7fd12815c880 2024-09-13T17:53:47.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.702+0000 7fd126800640 1 --2- 172.21.15.114:0/3307146115 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd128156420 0x7fd12806f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:47.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.702+0000 7fd125400640 1 --2- 172.21.15.114:0/3307146115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd12815c880 0x7fd128152120 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd11400c820 tx=0x7fd11400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:47.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.702+0000 7fd11e000640 1 -- 172.21.15.114:0/3307146115 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd114007a30 con 0x7fd12815c880 2024-09-13T17:53:47.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.702+0000 7fd11e000640 1 -- 172.21.15.114:0/3307146115 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd114007b90 con 0x7fd12815c880 2024-09-13T17:53:47.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.702+0000 7fd11e000640 1 -- 172.21.15.114:0/3307146115 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11400ce10 con 0x7fd12815c880 2024-09-13T17:53:47.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.702+0000 7fd127200640 1 -- 172.21.15.114:0/3307146115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd128153780 con 0x7fd12815c880 2024-09-13T17:53:47.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.702+0000 7fd127200640 1 -- 172.21.15.114:0/3307146115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd128152c70 con 0x7fd12815c880 2024-09-13T17:53:47.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.702+0000 7fd127200640 1 -- 172.21.15.114:0/3307146115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd128153910 con 0x7fd12815c880 2024-09-13T17:53:47.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.702+0000 7fd11e000640 1 -- 172.21.15.114:0/3307146115 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd1140113f0 con 0x7fd12815c880 2024-09-13T17:53:47.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.702+0000 7fd11e000640 1 --2- 172.21.15.114:0/3307146115 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd1080666c0 0x7fd108068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:47.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.702+0000 7fd11e000640 1 -- 172.21.15.114:0/3307146115 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7fd114084550 con 0x7fd12815c880 2024-09-13T17:53:47.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.706+0000 7fd125e00640 1 --2- 172.21.15.114:0/3307146115 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd1080666c0 0x7fd108068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:47.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.706+0000 7fd125e00640 1 --2- 172.21.15.114:0/3307146115 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd1080666c0 0x7fd108068b80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd1180af000 tx=0x7fd1180b6040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:47.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.706+0000 7fd11e000640 1 -- 172.21.15.114:0/3307146115 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd1140515f0 con 0x7fd12815c880 2024-09-13T17:53:47.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.862+0000 7fd127200640 1 -- 172.21.15.114:0/3307146115 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd128098a70 con 0x7fd12815c880 2024-09-13T17:53:47.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.862+0000 7fd11e000640 1 -- 172.21.15.114:0/3307146115 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v48) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd114054c10 con 0x7fd12815c880 2024-09-13T17:53:47.868 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-09-13T17:53:47.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.866+0000 7fd127200640 1 -- 172.21.15.114:0/3307146115 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd1080666c0 msgr2=0x7fd108068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:47.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.866+0000 7fd127200640 1 --2- 172.21.15.114:0/3307146115 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd1080666c0 0x7fd108068b80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd1180af000 tx=0x7fd1180b6040 comp rx=0 tx=0).stop 2024-09-13T17:53:47.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.866+0000 7fd127200640 1 -- 172.21.15.114:0/3307146115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd12815c880 msgr2=0x7fd128152120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:47.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.866+0000 7fd127200640 1 --2- 172.21.15.114:0/3307146115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd12815c880 0x7fd128152120 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd11400c820 tx=0x7fd11400cce0 comp rx=0 tx=0).stop 2024-09-13T17:53:47.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.866+0000 7fd127200640 1 -- 172.21.15.114:0/3307146115 shutdown_connections 2024-09-13T17:53:47.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.866+0000 7fd127200640 1 --2- 172.21.15.114:0/3307146115 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd1080666c0 0x7fd108068b80 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:47.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.866+0000 7fd127200640 1 --2- 172.21.15.114:0/3307146115 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd128156420 0x7fd12806f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:47.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.866+0000 7fd127200640 1 --2- 172.21.15.114:0/3307146115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd12815c880 0x7fd128152120 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:47.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.866+0000 7fd127200640 1 --2- 172.21.15.114:0/3307146115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd128098fb0 0x7fd12814f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:47.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.866+0000 7fd127200640 1 -- 172.21.15.114:0/3307146115 >> 172.21.15.114:0/3307146115 conn(0x7fd1280d0330 msgr2=0x7fd128159830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:47.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.866+0000 7fd127200640 1 -- 172.21.15.114:0/3307146115 shutdown_connections 2024-09-13T17:53:47.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:47.866+0000 7fd127200640 1 -- 172.21.15.114:0/3307146115 wait complete. 2024-09-13T17:53:47.890 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get recovery_fs_metadata pg_num 2024-09-13T17:53:48.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.026+0000 7f0123400640 1 Processor -- start 2024-09-13T17:53:48.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.026+0000 7f0123400640 1 -- start start 2024-09-13T17:53:48.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.026+0000 7f0123400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f011c0b1c20 0x7f011c158a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:48.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.026+0000 7f0123400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f011c0b2490 con 0x7f011c070420 2024-09-13T17:53:48.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.026+0000 7f0123400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f011c0b21b0 con 0x7f011c159be0 2024-09-13T17:53:48.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.026+0000 7f0123400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f011c159100 con 0x7f011c0b1c20 2024-09-13T17:53:48.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.026+0000 7f0121400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f011c070420 0x7f011c0708b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33822/0 (socket says 172.21.15.114:33822) 2024-09-13T17:53:48.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.026+0000 7f0121400640 1 -- 172.21.15.114:0/3299989128 learned_addr learned my addr 172.21.15.114:0/3299989128 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:48.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.030+0000 7f0113e00640 1 --2- 172.21.15.114:0/3299989128 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f011c0b1c20 0x7f011c158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:48.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.030+0000 7f011be00640 1 -- 172.21.15.114:0/3299989128 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673126890 0 0) 0x7f011c0b2490 con 0x7f011c070420 2024-09-13T17:53:48.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.030+0000 7f011be00640 1 -- 172.21.15.114:0/3299989128 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0100005740 con 0x7f011c070420 2024-09-13T17:53:48.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.030+0000 7f011be00640 1 -- 172.21.15.114:0/3299989128 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2718513191 0 0) 0x7f011c0b21b0 con 0x7f011c159be0 2024-09-13T17:53:48.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.030+0000 7f011be00640 1 -- 172.21.15.114:0/3299989128 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f011c0b2490 con 0x7f011c159be0 2024-09-13T17:53:48.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.030+0000 7f011be00640 1 -- 172.21.15.114:0/3299989128 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1613056595 0 0) 0x7f0100005740 con 0x7f011c070420 2024-09-13T17:53:48.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.030+0000 7f011be00640 1 -- 172.21.15.114:0/3299989128 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f011c0b1c20 msgr2=0x7f011c158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:48.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.030+0000 7f011be00640 1 --2- 172.21.15.114:0/3299989128 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f011c0b1c20 0x7f011c158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:48.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.030+0000 7f011be00640 1 -- 172.21.15.114:0/3299989128 >> v1:172.21.15.134:6789/0 conn(0x7f011c159be0 legacy=0x7f011c0b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:48.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.030+0000 7f011be00640 1 -- 172.21.15.114:0/3299989128 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011c1593e0 con 0x7f011c070420 2024-09-13T17:53:48.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.030+0000 7f011be00640 1 -- 172.21.15.114:0/3299989128 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7f0114001680 con 0x7f011c070420 2024-09-13T17:53:48.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.030+0000 7f011be00640 1 -- 172.21.15.114:0/3299989128 >> v1:172.21.15.114:6789/0 conn(0x7f011c070420 legacy=0x7f011c0708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:48.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.030+0000 7f011be00640 1 --2- 172.21.15.114:0/3299989128 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f011c0b1c20 0x7f0100005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:48.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.030+0000 7f011be00640 1 --2- 172.21.15.114:0/3299989128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01000062b0 0x7f01000069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:48.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.030+0000 7f011be00640 1 --2- 172.21.15.114:0/3299989128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0100006f20 0x7f01000073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:48.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.030+0000 7f011be00640 1 -- 172.21.15.114:0/3299989128 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011c159100 con 0x7f0100006f20 2024-09-13T17:53:48.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.030+0000 7f011be00640 1 -- 172.21.15.114:0/3299989128 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010000dc80 con 0x7f01000062b0 2024-09-13T17:53:48.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.030+0000 7f011be00640 1 -- 172.21.15.114:0/3299989128 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010000de40 con 0x7f011c0b1c20 2024-09-13T17:53:48.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.030+0000 7f0121400640 1 --2- 172.21.15.114:0/3299989128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0100006f20 0x7f01000073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:48.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.030+0000 7f0120a00640 1 --2- 172.21.15.114:0/3299989128 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f011c0b1c20 0x7f0100005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:48.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.030+0000 7f0113e00640 1 --2- 172.21.15.114:0/3299989128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01000062b0 0x7f01000069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:48.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.030+0000 7f0120a00640 1 -- 172.21.15.114:0/3299989128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01000062b0 msgr2=0x7f01000069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:48.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.030+0000 7f0120a00640 1 --2- 172.21.15.114:0/3299989128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01000062b0 0x7f01000069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:48.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.030+0000 7f0120a00640 1 -- 172.21.15.114:0/3299989128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0100006f20 msgr2=0x7f01000073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:48.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.030+0000 7f0120a00640 1 --2- 172.21.15.114:0/3299989128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0100006f20 0x7f01000073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:48.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.030+0000 7f0120a00640 1 -- 172.21.15.114:0/3299989128 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0100005740 con 0x7f011c0b1c20 2024-09-13T17:53:48.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.030+0000 7f0121400640 1 --2- 172.21.15.114:0/3299989128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0100006f20 0x7f01000073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:53:48.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.034+0000 7f0120a00640 1 --2- 172.21.15.114:0/3299989128 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f011c0b1c20 0x7f0100005d50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f010c001fd0 tx=0x7f010c01c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d60f39a4aae984c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:48.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.034+0000 7f011be00640 1 -- 172.21.15.114:0/3299989128 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c003b80 con 0x7f011c0b1c20 2024-09-13T17:53:48.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.034+0000 7f011be00640 1 -- 172.21.15.114:0/3299989128 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010c003d00 con 0x7f011c0b1c20 2024-09-13T17:53:48.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.034+0000 7f011be00640 1 -- 172.21.15.114:0/3299989128 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c005310 con 0x7f011c0b1c20 2024-09-13T17:53:48.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.034+0000 7f0123400640 1 -- 172.21.15.114:0/3299989128 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f011c0b1c20 msgr2=0x7f0100005d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:48.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.034+0000 7f0123400640 1 --2- 172.21.15.114:0/3299989128 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f011c0b1c20 0x7f0100005d50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f010c001fd0 tx=0x7f010c01c900 comp rx=0 tx=0).stop 2024-09-13T17:53:48.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.034+0000 7f0121400640 1 -- 172.21.15.114:0/3299989128 reap_dead start 2024-09-13T17:53:48.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.034+0000 7f0123400640 1 -- 172.21.15.114:0/3299989128 shutdown_connections 2024-09-13T17:53:48.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.034+0000 7f0123400640 1 -- 172.21.15.114:0/3299989128 >> 172.21.15.114:0/3299989128 conn(0x7f011c0660b0 msgr2=0x7f011c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:48.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.034+0000 7f0123400640 1 -- 172.21.15.114:0/3299989128 shutdown_connections 2024-09-13T17:53:48.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.034+0000 7f0123400640 1 -- 172.21.15.114:0/3299989128 wait complete. 2024-09-13T17:53:48.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.034+0000 7f0123400640 1 Processor -- start 2024-09-13T17:53:48.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.034+0000 7f0123400640 1 -- start start 2024-09-13T17:53:48.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.038+0000 7f0123400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f011c0b1c20 0x7f011c151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:48.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.038+0000 7f0123400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f011c1f2270 0x7f011c13ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:48.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.038+0000 7f0123400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f011c154450 0x7f011c0cd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:48.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.038+0000 7f0123400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011c1f2740 con 0x7f011c154450 2024-09-13T17:53:48.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.038+0000 7f0123400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011c1f2a20 con 0x7f011c0b1c20 2024-09-13T17:53:48.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.038+0000 7f0123400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f011c1f2d00 con 0x7f011c1f2270 2024-09-13T17:53:48.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.038+0000 7f0121400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f011c154450 0x7f011c0cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:48.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.038+0000 7f0121400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f011c154450 0x7f011c0cd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43948/0 (socket says 172.21.15.114:43948) 2024-09-13T17:53:48.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.038+0000 7f0121400640 1 -- 172.21.15.114:0/2700899135 learned_addr learned my addr 172.21.15.114:0/2700899135 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:48.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.038+0000 7f0120a00640 1 --2- 172.21.15.114:0/2700899135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f011c0b1c20 0x7f011c151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:48.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.038+0000 7f0113e00640 1 --2- 172.21.15.114:0/2700899135 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f011c1f2270 0x7f011c13ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:48.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.038+0000 7f0121400640 1 -- 172.21.15.114:0/2700899135 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f011c1f2270 msgr2=0x7f011c13ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:48.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.038+0000 7f0121400640 1 --2- 172.21.15.114:0/2700899135 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f011c1f2270 0x7f011c13ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:48.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.038+0000 7f0121400640 1 -- 172.21.15.114:0/2700899135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f011c0b1c20 msgr2=0x7f011c151890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:48.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.038+0000 7f0121400640 1 --2- 172.21.15.114:0/2700899135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f011c0b1c20 0x7f011c151890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:48.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.038+0000 7f0121400640 1 -- 172.21.15.114:0/2700899135 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011c1f2fe0 con 0x7f011c154450 2024-09-13T17:53:48.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.038+0000 7f0120a00640 1 --2- 172.21.15.114:0/2700899135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f011c0b1c20 0x7f011c151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:48.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.038+0000 7f0113e00640 1 --2- 172.21.15.114:0/2700899135 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f011c1f2270 0x7f011c13ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:48.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.038+0000 7f0121400640 1 --2- 172.21.15.114:0/2700899135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f011c154450 0x7f011c0cd810 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f011c06dff0 tx=0x7f0114012920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:48.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.038+0000 7f0119600640 1 -- 172.21.15.114:0/2700899135 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0114005780 con 0x7f011c154450 2024-09-13T17:53:48.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.038+0000 7f0119600640 1 -- 172.21.15.114:0/2700899135 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0114014750 con 0x7f011c154450 2024-09-13T17:53:48.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.038+0000 7f0123400640 1 -- 172.21.15.114:0/2700899135 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f011c13d3f0 con 0x7f011c154450 2024-09-13T17:53:48.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.038+0000 7f0119600640 1 -- 172.21.15.114:0/2700899135 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0114014b00 con 0x7f011c154450 2024-09-13T17:53:48.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.038+0000 7f0123400640 1 -- 172.21.15.114:0/2700899135 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f011c154ab0 con 0x7f011c154450 2024-09-13T17:53:48.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.038+0000 7f0123400640 1 -- 172.21.15.114:0/2700899135 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f011c0b1510 con 0x7f011c154450 2024-09-13T17:53:48.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.038+0000 7f0119600640 1 -- 172.21.15.114:0/2700899135 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0114014c60 con 0x7f011c154450 2024-09-13T17:53:48.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.042+0000 7f0119600640 1 --2- 172.21.15.114:0/2700899135 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f00f8066690 0x7f00f8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:48.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.042+0000 7f0119600640 1 -- 172.21.15.114:0/2700899135 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f0114086ca0 con 0x7f011c154450 2024-09-13T17:53:48.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.042+0000 7f0120a00640 1 --2- 172.21.15.114:0/2700899135 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f00f8066690 0x7f00f8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:48.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.042+0000 7f0120a00640 1 --2- 172.21.15.114:0/2700899135 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f00f8066690 0x7f00f8068b50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f010c0ad000 tx=0x7f010c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:48.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.046+0000 7f0119600640 1 -- 172.21.15.114:0/2700899135 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0114053cb0 con 0x7f011c154450 2024-09-13T17:53:48.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.202+0000 7f0123400640 1 -- 172.21.15.114:0/2700899135 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "recovery_fs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f011c1f3170 con 0x7f011c154450 2024-09-13T17:53:48.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.202+0000 7f0119600640 1 -- 172.21.15.114:0/2700899135 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "recovery_fs_metadata", "var": "pg_num"}]=0 v48) v1 ==== 109+0+11 (secure 0 0 0) 0x7f011401c020 con 0x7f011c154450 2024-09-13T17:53:48.207 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:53:48.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.202+0000 7f0123400640 1 -- 172.21.15.114:0/2700899135 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f00f8066690 msgr2=0x7f00f8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:48.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.202+0000 7f0123400640 1 --2- 172.21.15.114:0/2700899135 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f00f8066690 0x7f00f8068b50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f010c0ad000 tx=0x7f010c0a7000 comp rx=0 tx=0).stop 2024-09-13T17:53:48.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.202+0000 7f0123400640 1 -- 172.21.15.114:0/2700899135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f011c154450 msgr2=0x7f011c0cd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:48.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.202+0000 7f0123400640 1 --2- 172.21.15.114:0/2700899135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f011c154450 0x7f011c0cd810 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f011c06dff0 tx=0x7f0114012920 comp rx=0 tx=0).stop 2024-09-13T17:53:48.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.202+0000 7f0123400640 1 -- 172.21.15.114:0/2700899135 shutdown_connections 2024-09-13T17:53:48.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.202+0000 7f0123400640 1 --2- 172.21.15.114:0/2700899135 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f00f8066690 0x7f00f8068b50 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:48.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.202+0000 7f0123400640 1 --2- 172.21.15.114:0/2700899135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f011c154450 0x7f011c0cd810 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:48.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.202+0000 7f0123400640 1 --2- 172.21.15.114:0/2700899135 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f011c1f2270 0x7f011c13ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:48.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.202+0000 7f0123400640 1 --2- 172.21.15.114:0/2700899135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f011c0b1c20 0x7f011c151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:48.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.202+0000 7f0123400640 1 -- 172.21.15.114:0/2700899135 >> 172.21.15.114:0/2700899135 conn(0x7f011c0660b0 msgr2=0x7f011c157a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:48.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.202+0000 7f0123400640 1 -- 172.21.15.114:0/2700899135 shutdown_connections 2024-09-13T17:53:48.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.202+0000 7f0123400640 1 -- 172.21.15.114:0/2700899135 wait complete. 2024-09-13T17:53:48.228 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T17:53:48.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.362+0000 7f36cdc00640 1 Processor -- start 2024-09-13T17:53:48.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.362+0000 7f36cdc00640 1 -- start start 2024-09-13T17:53:48.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.366+0000 7f36cdc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f36c81591c0 0x7f36c80abdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:48.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.366+0000 7f36cdc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36c815d2e0 0x7f36c8070120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:48.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.366+0000 7f36cdc00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36c80ac7c0 con 0x7f36c80ac300 2024-09-13T17:53:48.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.366+0000 7f36cdc00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c80acaa0 con 0x7f36c81591c0 2024-09-13T17:53:48.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.366+0000 7f36cdc00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c80acd80 con 0x7f36c815d2e0 2024-09-13T17:53:48.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.366+0000 7f36c7e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f36c81591c0 0x7f36c80abdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:48.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.366+0000 7f36bfe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f36c80ac300 0x7f36c815cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33826/0 (socket says 172.21.15.114:33826) 2024-09-13T17:53:48.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.366+0000 7f36bfe00640 1 -- 172.21.15.114:0/2281844821 learned_addr learned my addr 172.21.15.114:0/2281844821 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:48.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.366+0000 7f36c7e00640 1 -- 172.21.15.114:0/2281844821 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36c815d2e0 msgr2=0x7f36c8070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:48.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.366+0000 7f36cd200640 1 --2- 172.21.15.114:0/2281844821 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36c815d2e0 0x7f36c8070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:48.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.366+0000 7f36c7400640 1 -- 172.21.15.114:0/2281844821 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4101161499 0 0) 0x7f36c80ac7c0 con 0x7f36c80ac300 2024-09-13T17:53:48.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.366+0000 7f36c7e00640 1 --2- 172.21.15.114:0/2281844821 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36c815d2e0 0x7f36c8070120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:48.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.366+0000 7f36c7e00640 1 -- 172.21.15.114:0/2281844821 >> v1:172.21.15.114:6789/0 conn(0x7f36c80ac300 legacy=0x7f36c815cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:48.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.366+0000 7f36c7e00640 1 -- 172.21.15.114:0/2281844821 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c80ad060 con 0x7f36c81591c0 2024-09-13T17:53:48.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.366+0000 7f36cd200640 1 --2- 172.21.15.114:0/2281844821 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36c815d2e0 0x7f36c8070120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:48.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.370+0000 7f36c7e00640 1 --2- 172.21.15.114:0/2281844821 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36c81591c0 0x7f36c80abdc0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f36b80097c0 tx=0x7f36b801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=648a0a13331051dd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:48.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.370+0000 7f36c7400640 1 -- 172.21.15.114:0/2281844821 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b80ab600 con 0x7f36c81591c0 2024-09-13T17:53:48.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.370+0000 7f36c7400640 1 -- 172.21.15.114:0/2281844821 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b80a7050 con 0x7f36c81591c0 2024-09-13T17:53:48.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.370+0000 7f36c7400640 1 -- 172.21.15.114:0/2281844821 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b80ab980 con 0x7f36c81591c0 2024-09-13T17:53:48.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.370+0000 7f36cdc00640 1 -- 172.21.15.114:0/2281844821 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36c81591c0 msgr2=0x7f36c80abdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:48.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.370+0000 7f36cdc00640 1 --2- 172.21.15.114:0/2281844821 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36c81591c0 0x7f36c80abdc0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f36b80097c0 tx=0x7f36b801c410 comp rx=0 tx=0).stop 2024-09-13T17:53:48.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.370+0000 7f36cdc00640 1 -- 172.21.15.114:0/2281844821 shutdown_connections 2024-09-13T17:53:48.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.370+0000 7f36cdc00640 1 --2- 172.21.15.114:0/2281844821 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36c815d2e0 0x7f36c8070120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:48.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.370+0000 7f36cdc00640 1 --2- 172.21.15.114:0/2281844821 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36c81591c0 0x7f36c80abdc0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:48.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.370+0000 7f36cdc00640 1 -- 172.21.15.114:0/2281844821 >> 172.21.15.114:0/2281844821 conn(0x7f36c80cdfd0 msgr2=0x7f36c80ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:48.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.370+0000 7f36cdc00640 1 -- 172.21.15.114:0/2281844821 shutdown_connections 2024-09-13T17:53:48.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.370+0000 7f36cdc00640 1 -- 172.21.15.114:0/2281844821 wait complete. 2024-09-13T17:53:48.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.370+0000 7f36cdc00640 1 Processor -- start 2024-09-13T17:53:48.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.370+0000 7f36cdc00640 1 -- start start 2024-09-13T17:53:48.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.374+0000 7f36cdc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36c80ac300 0x7f36c809be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:48.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.374+0000 7f36cdc00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36c81591c0 0x7f36c80981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:48.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.374+0000 7f36cdc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36c815d2e0 0x7f36c81452a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:48.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.374+0000 7f36cdc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c80996b0 con 0x7f36c815d2e0 2024-09-13T17:53:48.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.374+0000 7f36cdc00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c8098a30 con 0x7f36c81591c0 2024-09-13T17:53:48.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.374+0000 7f36cdc00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c8098d10 con 0x7f36c80ac300 2024-09-13T17:53:48.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.374+0000 7f36cd200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36c815d2e0 0x7f36c81452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:48.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.374+0000 7f36cd200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36c815d2e0 0x7f36c81452a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43960/0 (socket says 172.21.15.114:43960) 2024-09-13T17:53:48.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.374+0000 7f36cd200640 1 -- 172.21.15.114:0/4040567089 learned_addr learned my addr 172.21.15.114:0/4040567089 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:48.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.374+0000 7f36c7e00640 1 --2- 172.21.15.114:0/4040567089 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36c80ac300 0x7f36c809be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:48.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.374+0000 7f36bfe00640 1 --2- 172.21.15.114:0/4040567089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36c81591c0 0x7f36c80981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:48.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.374+0000 7f36cd200640 1 -- 172.21.15.114:0/4040567089 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36c80ac300 msgr2=0x7f36c809be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:48.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.374+0000 7f36cd200640 1 --2- 172.21.15.114:0/4040567089 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36c80ac300 0x7f36c809be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:48.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.374+0000 7f36cd200640 1 -- 172.21.15.114:0/4040567089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36c81591c0 msgr2=0x7f36c80981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:48.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.374+0000 7f36cd200640 1 --2- 172.21.15.114:0/4040567089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36c81591c0 0x7f36c80981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:48.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.374+0000 7f36cd200640 1 -- 172.21.15.114:0/4040567089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b8009420 con 0x7f36c815d2e0 2024-09-13T17:53:48.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.374+0000 7f36cd200640 1 --2- 172.21.15.114:0/4040567089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36c815d2e0 0x7f36c81452a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f36c000cce0 tx=0x7f36c000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:48.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.374+0000 7f36c4c00640 1 -- 172.21.15.114:0/4040567089 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c0003ba0 con 0x7f36c815d2e0 2024-09-13T17:53:48.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.374+0000 7f36c4c00640 1 -- 172.21.15.114:0/4040567089 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c0003d20 con 0x7f36c815d2e0 2024-09-13T17:53:48.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.374+0000 7f36c4c00640 1 -- 172.21.15.114:0/4040567089 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c0004260 con 0x7f36c815d2e0 2024-09-13T17:53:48.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.374+0000 7f36cdc00640 1 -- 172.21.15.114:0/4040567089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c8098ff0 con 0x7f36c815d2e0 2024-09-13T17:53:48.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.374+0000 7f36cdc00640 1 -- 172.21.15.114:0/4040567089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c8098720 con 0x7f36c815d2e0 2024-09-13T17:53:48.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.374+0000 7f36cdc00640 1 -- 172.21.15.114:0/4040567089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c80997f0 con 0x7f36c815d2e0 2024-09-13T17:53:48.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.374+0000 7f36c4c00640 1 -- 172.21.15.114:0/4040567089 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f36c000b040 con 0x7f36c815d2e0 2024-09-13T17:53:48.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.378+0000 7f36c4c00640 1 --2- 172.21.15.114:0/4040567089 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f36a4066690 0x7f36a4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:48.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.378+0000 7f36c4c00640 1 -- 172.21.15.114:0/4040567089 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f36c0084b50 con 0x7f36c815d2e0 2024-09-13T17:53:48.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.378+0000 7f36c7e00640 1 --2- 172.21.15.114:0/4040567089 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f36a4066690 0x7f36a4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:48.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.378+0000 7f36c7e00640 1 --2- 172.21.15.114:0/4040567089 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f36a4066690 0x7f36a4068b50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f36b80ad000 tx=0x7f36b8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:48.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.382+0000 7f36c4c00640 1 -- 172.21.15.114:0/4040567089 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f36c80997f0 con 0x7f36c815d2e0 2024-09-13T17:53:48.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.550+0000 7f36cdc00640 1 -- 172.21.15.114:0/4040567089 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f36c80997f0 con 0x7f36c815d2e0 2024-09-13T17:53:48.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.550+0000 7f36c4c00640 1 -- 172.21.15.114:0/4040567089 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v48) v1 ==== 80+0+124 (secure 0 0 0) 0x7f36c80997f0 con 0x7f36c815d2e0 2024-09-13T17:53:48.555 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.134:6835/1239035445 2024-09-14T17:53:22.929223+0000 2024-09-13T17:53:48.555 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.134:6833/1239035445 2024-09-14T17:53:22.929223+0000 2024-09-13T17:53:48.555 INFO:teuthology.orchestra.run.smithi114.stderr:listed 2 entries 2024-09-13T17:53:48.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.550+0000 7f36cdc00640 1 -- 172.21.15.114:0/4040567089 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f36a4066690 msgr2=0x7f36a4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:48.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.550+0000 7f36cdc00640 1 --2- 172.21.15.114:0/4040567089 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f36a4066690 0x7f36a4068b50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f36b80ad000 tx=0x7f36b8008040 comp rx=0 tx=0).stop 2024-09-13T17:53:48.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.550+0000 7f36cdc00640 1 -- 172.21.15.114:0/4040567089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36c815d2e0 msgr2=0x7f36c81452a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:48.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.550+0000 7f36cdc00640 1 --2- 172.21.15.114:0/4040567089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36c815d2e0 0x7f36c81452a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f36c000cce0 tx=0x7f36c000a650 comp rx=0 tx=0).stop 2024-09-13T17:53:48.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.550+0000 7f36cdc00640 1 -- 172.21.15.114:0/4040567089 shutdown_connections 2024-09-13T17:53:48.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.550+0000 7f36cdc00640 1 --2- 172.21.15.114:0/4040567089 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f36a4066690 0x7f36a4068b50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:48.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.550+0000 7f36cdc00640 1 --2- 172.21.15.114:0/4040567089 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f36c815d2e0 0x7f36c81452a0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:48.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.550+0000 7f36cdc00640 1 --2- 172.21.15.114:0/4040567089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f36c81591c0 0x7f36c80981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:48.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.550+0000 7f36cdc00640 1 --2- 172.21.15.114:0/4040567089 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f36c80ac300 0x7f36c809be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:48.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.550+0000 7f36cdc00640 1 -- 172.21.15.114:0/4040567089 >> 172.21.15.114:0/4040567089 conn(0x7f36c80cdfd0 msgr2=0x7f36c8162e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:48.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.550+0000 7f36cdc00640 1 -- 172.21.15.114:0/4040567089 shutdown_connections 2024-09-13T17:53:48.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.550+0000 7f36cdc00640 1 -- 172.21.15.114:0/4040567089 wait complete. 2024-09-13T17:53:48.575 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T17:53:48.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:53:48.575 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T17:53:48.601 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-09-13T17:53:48.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:53:48.601 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T17:53:48.654 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:53:48.654 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:53:48.664 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350256k,nr_inodes=4087564,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4616 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:53:48.664 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:53:48.664 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:53:48.705 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350196k,nr_inodes=4087549,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7573 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:53:48.705 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:53:48.705 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:53:48.714 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350256k,nr_inodes=4087564,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4616 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:53:48.714 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:53:48.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.878+0000 7f55df200640 1 Processor -- start 2024-09-13T17:53:48.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.878+0000 7f55df200640 1 -- start start 2024-09-13T17:53:48.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.878+0000 7f55df200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f55d815c150 0x7f55d80cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:48.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.878+0000 7f55df200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f55d8160160 0x7f55d81605f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:48.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.878+0000 7f55df200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d80ce5b0 con 0x7f55d80ce0b0 2024-09-13T17:53:48.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.878+0000 7f55df200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d8160b30 con 0x7f55d815c150 2024-09-13T17:53:48.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.878+0000 7f55df200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d80ce890 con 0x7f55d8160160 2024-09-13T17:53:48.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.878+0000 7f55d7e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f55d815c150 0x7f55d80cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:48.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.878+0000 7f55d7e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f55d815c150 0x7f55d80cbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43962/0 (socket says 172.21.15.114:43962) 2024-09-13T17:53:48.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.878+0000 7f55d7e00640 1 -- 172.21.15.114:0/3009376229 learned_addr learned my addr 172.21.15.114:0/3009376229 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:48.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.878+0000 7f55dd200640 1 --2- 172.21.15.114:0/3009376229 >> v2:172.21.15.134:3300/0 conn(0x7f55d8160160 0x7f55d81605f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:48.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.878+0000 7f55d7e00640 1 -- 172.21.15.114:0/3009376229 >> v2:172.21.15.134:3300/0 conn(0x7f55d8160160 msgr2=0x7f55d81605f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:48.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.878+0000 7f55d7e00640 1 --2- 172.21.15.114:0/3009376229 >> v2:172.21.15.134:3300/0 conn(0x7f55d8160160 0x7f55d81605f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:48.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.878+0000 7f55d7e00640 1 -- 172.21.15.114:0/3009376229 >> v1:172.21.15.134:6789/0 conn(0x7f55d80ce0b0 legacy=0x7f55d815c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:48.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.878+0000 7f55d7e00640 1 -- 172.21.15.114:0/3009376229 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d80ceb70 con 0x7f55d815c150 2024-09-13T17:53:48.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.882+0000 7f55d7e00640 1 --2- 172.21.15.114:0/3009376229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d815c150 0x7f55d80cbfd0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f55d80b2060 tx=0x7f55c801c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6ebd81b6fd10eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:48.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.882+0000 7f55d6a00640 1 -- 172.21.15.114:0/3009376229 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c80a57b0 con 0x7f55d815c150 2024-09-13T17:53:48.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.882+0000 7f55d6a00640 1 -- 172.21.15.114:0/3009376229 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c80a5910 con 0x7f55d815c150 2024-09-13T17:53:48.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.882+0000 7f55d6a00640 1 -- 172.21.15.114:0/3009376229 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c80a5ca0 con 0x7f55d815c150 2024-09-13T17:53:48.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.882+0000 7f55df200640 1 -- 172.21.15.114:0/3009376229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d815c150 msgr2=0x7f55d80cbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:48.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.882+0000 7f55df200640 1 --2- 172.21.15.114:0/3009376229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d815c150 0x7f55d80cbfd0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f55d80b2060 tx=0x7f55c801c8f0 comp rx=0 tx=0).stop 2024-09-13T17:53:48.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.882+0000 7f55df200640 1 -- 172.21.15.114:0/3009376229 shutdown_connections 2024-09-13T17:53:48.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.882+0000 7f55df200640 1 --2- 172.21.15.114:0/3009376229 >> v2:172.21.15.134:3300/0 conn(0x7f55d8160160 0x7f55d81605f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:48.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.882+0000 7f55df200640 1 --2- 172.21.15.114:0/3009376229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d815c150 0x7f55d80cbfd0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:48.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.882+0000 7f55df200640 1 -- 172.21.15.114:0/3009376229 >> 172.21.15.114:0/3009376229 conn(0x7f55d80d04e0 msgr2=0x7f55d80d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:48.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.882+0000 7f55df200640 1 -- 172.21.15.114:0/3009376229 shutdown_connections 2024-09-13T17:53:48.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.882+0000 7f55df200640 1 -- 172.21.15.114:0/3009376229 wait complete. 2024-09-13T17:53:48.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.886+0000 7f55df200640 1 Processor -- start 2024-09-13T17:53:48.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.886+0000 7f55df200640 1 -- start start 2024-09-13T17:53:48.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.886+0000 7f55df200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f55d80ce0b0 0x7f55d80b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:48.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.886+0000 7f55df200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d815c150 0x7f55d8167250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:48.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.886+0000 7f55df200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55d8160160 0x7f55d81484d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:48.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.886+0000 7f55df200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d81579d0 con 0x7f55d815c150 2024-09-13T17:53:48.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.886+0000 7f55df200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d8156dc0 con 0x7f55d8160160 2024-09-13T17:53:48.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.886+0000 7f55df200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d81570a0 con 0x7f55d80ce0b0 2024-09-13T17:53:48.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.886+0000 7f55d7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d815c150 0x7f55d8167250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:48.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.886+0000 7f55d7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d815c150 0x7f55d8167250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43966/0 (socket says 172.21.15.114:43966) 2024-09-13T17:53:48.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.886+0000 7f55d7400640 1 -- 172.21.15.114:0/1306547203 learned_addr learned my addr 172.21.15.114:0/1306547203 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:48.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.886+0000 7f55d7e00640 1 --2- 172.21.15.114:0/1306547203 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f55d80ce0b0 0x7f55d80b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:48.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.886+0000 7f55dd200640 1 --2- 172.21.15.114:0/1306547203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55d8160160 0x7f55d81484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:48.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.886+0000 7f55d7400640 1 -- 172.21.15.114:0/1306547203 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f55d80ce0b0 msgr2=0x7f55d80b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:48.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.886+0000 7f55d7400640 1 --2- 172.21.15.114:0/1306547203 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f55d80ce0b0 0x7f55d80b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:48.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.886+0000 7f55d7400640 1 -- 172.21.15.114:0/1306547203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55d8160160 msgr2=0x7f55d81484d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:48.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.886+0000 7f55d7400640 1 --2- 172.21.15.114:0/1306547203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55d8160160 0x7f55d81484d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:48.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.886+0000 7f55d7400640 1 -- 172.21.15.114:0/1306547203 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c8009b30 con 0x7f55d815c150 2024-09-13T17:53:48.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.886+0000 7f55d7400640 1 --2- 172.21.15.114:0/1306547203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d815c150 0x7f55d8167250 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f55c400c450 tx=0x7f55c400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:48.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.886+0000 7f55cfe00640 1 -- 172.21.15.114:0/1306547203 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c4012830 con 0x7f55d815c150 2024-09-13T17:53:48.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.886+0000 7f55cfe00640 1 -- 172.21.15.114:0/1306547203 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c40129b0 con 0x7f55d815c150 2024-09-13T17:53:48.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.886+0000 7f55df200640 1 -- 172.21.15.114:0/1306547203 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d8157380 con 0x7f55d815c150 2024-09-13T17:53:48.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.886+0000 7f55cfe00640 1 -- 172.21.15.114:0/1306547203 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c4012d60 con 0x7f55d815c150 2024-09-13T17:53:48.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.886+0000 7f55df200640 1 -- 172.21.15.114:0/1306547203 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d8158e30 con 0x7f55d815c150 2024-09-13T17:53:48.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.886+0000 7f55df200640 1 -- 172.21.15.114:0/1306547203 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55d8067320 con 0x7f55d815c150 2024-09-13T17:53:48.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.890+0000 7f55cfe00640 1 -- 172.21.15.114:0/1306547203 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f55c401c460 con 0x7f55d815c150 2024-09-13T17:53:48.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.890+0000 7f55cfe00640 1 --2- 172.21.15.114:0/1306547203 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f55b8066690 0x7f55b8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:48.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.890+0000 7f55cfe00640 1 -- 172.21.15.114:0/1306547203 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f55c4084430 con 0x7f55d815c150 2024-09-13T17:53:48.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.890+0000 7f55d7e00640 1 --2- 172.21.15.114:0/1306547203 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f55b8066690 0x7f55b8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:48.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.890+0000 7f55d7e00640 1 --2- 172.21.15.114:0/1306547203 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f55b8066690 0x7f55b8068b50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f55c80ae000 tx=0x7f55c80a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:48.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:48.894+0000 7f55cfe00640 1 -- 172.21.15.114:0/1306547203 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f55c4051390 con 0x7f55d815c150 2024-09-13T17:53:49.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.078+0000 7f55df200640 1 -- 172.21.15.114:0/1306547203 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55d806cff0 con 0x7f55d815c150 2024-09-13T17:53:49.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.078+0000 7f55cfe00640 1 -- 172.21.15.114:0/1306547203 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+5951 (secure 0 0 0) 0x7f55c40549b0 con 0x7f55d815c150 2024-09-13T17:53:49.087 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:49.088 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/1758700058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1758700058},{"type":"v1","addr":"172.21.15.134:6833","nonce":1758700058}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/4015015784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4015015784},{"type":"v1","addr":"172.21.15.134:6835","nonce":4015015784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2696640153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2696640153},{"type":"v1","addr":"172.21.15.114:6836","nonce":2696640153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:53:08.298484+0000","modified":"2024-09-13T17:53:22.929771+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:53:32.086012+0000","modified":"2024-09-13T17:53:42.428826+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5598":{"gid":5598,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6837/2697286380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2697286380},{"type":"v1","addr":"172.21.15.114:6837","nonce":2697286380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T17:53:49.089 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 28 2024-09-13T17:53:49.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.082+0000 7f55df200640 1 -- 172.21.15.114:0/1306547203 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f55b8066690 msgr2=0x7f55b8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:49.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.082+0000 7f55df200640 1 --2- 172.21.15.114:0/1306547203 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f55b8066690 0x7f55b8068b50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f55c80ae000 tx=0x7f55c80a7070 comp rx=0 tx=0).stop 2024-09-13T17:53:49.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.082+0000 7f55df200640 1 -- 172.21.15.114:0/1306547203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d815c150 msgr2=0x7f55d8167250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:49.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.082+0000 7f55df200640 1 --2- 172.21.15.114:0/1306547203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d815c150 0x7f55d8167250 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f55c400c450 tx=0x7f55c400c910 comp rx=0 tx=0).stop 2024-09-13T17:53:49.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.082+0000 7f55df200640 1 -- 172.21.15.114:0/1306547203 shutdown_connections 2024-09-13T17:53:49.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.082+0000 7f55df200640 1 --2- 172.21.15.114:0/1306547203 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f55b8066690 0x7f55b8068b50 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.082+0000 7f55df200640 1 --2- 172.21.15.114:0/1306547203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55d8160160 0x7f55d81484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.082+0000 7f55df200640 1 --2- 172.21.15.114:0/1306547203 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f55d815c150 0x7f55d8167250 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.082+0000 7f55df200640 1 --2- 172.21.15.114:0/1306547203 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f55d80ce0b0 0x7f55d80b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.082+0000 7f55df200640 1 -- 172.21.15.114:0/1306547203 >> 172.21.15.114:0/1306547203 conn(0x7f55d80d04e0 msgr2=0x7f55d80b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:49.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.082+0000 7f55df200640 1 -- 172.21.15.114:0/1306547203 shutdown_connections 2024-09-13T17:53:49.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.082+0000 7f55df200640 1 -- 172.21.15.114:0/1306547203 wait complete. 2024-09-13T17:53:49.106 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:53:49.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.238+0000 7f2a6ae00640 1 Processor -- start 2024-09-13T17:53:49.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.238+0000 7f2a6ae00640 1 -- start start 2024-09-13T17:53:49.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.238+0000 7f2a6ae00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2a6413f420 0x7f2a6406d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:49.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.238+0000 7f2a6ae00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2a6406da90 0x7f2a640cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:49.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.238+0000 7f2a6ae00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a640cd220 con 0x7f2a6413c240 2024-09-13T17:53:49.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.238+0000 7f2a6ae00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a6406df40 con 0x7f2a6413f420 2024-09-13T17:53:49.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.238+0000 7f2a6ae00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a6415a740 con 0x7f2a6406da90 2024-09-13T17:53:49.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.238+0000 7f2a63400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2a6413f420 0x7f2a6406d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:49.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.238+0000 7f2a63e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2a6413c240 0x7f2a6413c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33836/0 (socket says 172.21.15.114:33836) 2024-09-13T17:53:49.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.238+0000 7f2a63e00640 1 -- 172.21.15.114:0/1870011490 learned_addr learned my addr 172.21.15.114:0/1870011490 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:49.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.238+0000 7f2a68e00640 1 --2- 172.21.15.114:0/1870011490 >> v2:172.21.15.134:3300/0 conn(0x7f2a6406da90 0x7f2a640cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:49.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.238+0000 7f2a63400640 1 -- 172.21.15.114:0/1870011490 >> v2:172.21.15.134:3300/0 conn(0x7f2a6406da90 msgr2=0x7f2a640cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:49.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.238+0000 7f2a63400640 1 --2- 172.21.15.114:0/1870011490 >> v2:172.21.15.134:3300/0 conn(0x7f2a6406da90 0x7f2a640cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.238+0000 7f2a63400640 1 -- 172.21.15.114:0/1870011490 >> v1:172.21.15.114:6789/0 conn(0x7f2a6413c240 legacy=0x7f2a6413c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:49.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.238+0000 7f2a63400640 1 -- 172.21.15.114:0/1870011490 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a64159bc0 con 0x7f2a6413f420 2024-09-13T17:53:49.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.238+0000 7f2a62a00640 1 -- 172.21.15.114:0/1870011490 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1045320931 0 0) 0x7f2a640cd220 con 0x7f2a6413c240 2024-09-13T17:53:49.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.242+0000 7f2a63400640 1 --2- 172.21.15.114:0/1870011490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a6413f420 0x7f2a6406d550 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2a640cc4f0 tx=0x7f2a5001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909183ce40852507 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:49.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.242+0000 7f2a62a00640 1 -- 172.21.15.114:0/1870011490 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a500ab650 con 0x7f2a6413f420 2024-09-13T17:53:49.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.242+0000 7f2a62a00640 1 -- 172.21.15.114:0/1870011490 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a500ab7b0 con 0x7f2a6413f420 2024-09-13T17:53:49.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.242+0000 7f2a62a00640 1 -- 172.21.15.114:0/1870011490 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a500abb40 con 0x7f2a6413f420 2024-09-13T17:53:49.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.242+0000 7f2a6ae00640 1 -- 172.21.15.114:0/1870011490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a6413f420 msgr2=0x7f2a6406d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:49.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.242+0000 7f2a6ae00640 1 --2- 172.21.15.114:0/1870011490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a6413f420 0x7f2a6406d550 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2a640cc4f0 tx=0x7f2a5001c450 comp rx=0 tx=0).stop 2024-09-13T17:53:49.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.242+0000 7f2a6ae00640 1 -- 172.21.15.114:0/1870011490 shutdown_connections 2024-09-13T17:53:49.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.242+0000 7f2a6ae00640 1 --2- 172.21.15.114:0/1870011490 >> v2:172.21.15.134:3300/0 conn(0x7f2a6406da90 0x7f2a640cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.242+0000 7f2a6ae00640 1 --2- 172.21.15.114:0/1870011490 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a6413f420 0x7f2a6406d550 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.242+0000 7f2a6ae00640 1 -- 172.21.15.114:0/1870011490 >> 172.21.15.114:0/1870011490 conn(0x7f2a640660b0 msgr2=0x7f2a64069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:49.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.242+0000 7f2a6ae00640 1 -- 172.21.15.114:0/1870011490 shutdown_connections 2024-09-13T17:53:49.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.242+0000 7f2a6ae00640 1 -- 172.21.15.114:0/1870011490 wait complete. 2024-09-13T17:53:49.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.242+0000 7f2a6ae00640 1 Processor -- start 2024-09-13T17:53:49.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.242+0000 7f2a6ae00640 1 -- start start 2024-09-13T17:53:49.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.246+0000 7f2a6ae00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a6406da90 0x7f2a640ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:49.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.246+0000 7f2a6ae00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a6413c240 0x7f2a640ad010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:49.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.246+0000 7f2a6ae00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a6413f420 0x7f2a6413a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:49.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.246+0000 7f2a6ae00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a640aead0 con 0x7f2a6413f420 2024-09-13T17:53:49.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.246+0000 7f2a6ae00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a640ad550 con 0x7f2a6406da90 2024-09-13T17:53:49.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.246+0000 7f2a6ae00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a640acc20 con 0x7f2a6413c240 2024-09-13T17:53:49.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.246+0000 7f2a68e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a6413f420 0x7f2a6413a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:49.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.246+0000 7f2a68e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a6413f420 0x7f2a6413a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43990/0 (socket says 172.21.15.114:43990) 2024-09-13T17:53:49.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.246+0000 7f2a68e00640 1 -- 172.21.15.114:0/307193657 learned_addr learned my addr 172.21.15.114:0/307193657 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:49.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.246+0000 7f2a63e00640 1 --2- 172.21.15.114:0/307193657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a6406da90 0x7f2a640ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:49.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.246+0000 7f2a63400640 1 --2- 172.21.15.114:0/307193657 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a6413c240 0x7f2a640ad010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:49.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.246+0000 7f2a68e00640 1 -- 172.21.15.114:0/307193657 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a6413c240 msgr2=0x7f2a640ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:49.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.246+0000 7f2a68e00640 1 --2- 172.21.15.114:0/307193657 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a6413c240 0x7f2a640ad010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.246+0000 7f2a68e00640 1 -- 172.21.15.114:0/307193657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a6406da90 msgr2=0x7f2a640ac2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:49.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.246+0000 7f2a68e00640 1 --2- 172.21.15.114:0/307193657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a6406da90 0x7f2a640ac2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.246+0000 7f2a68e00640 1 -- 172.21.15.114:0/307193657 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a50009420 con 0x7f2a6413f420 2024-09-13T17:53:49.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.246+0000 7f2a63400640 1 --2- 172.21.15.114:0/307193657 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a6413c240 0x7f2a640ad010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:49.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.246+0000 7f2a63e00640 1 --2- 172.21.15.114:0/307193657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a6406da90 0x7f2a640ac2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:49.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.246+0000 7f2a68e00640 1 --2- 172.21.15.114:0/307193657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a6413f420 0x7f2a6413a080 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c007e70 tx=0x7f2a5c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:49.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.246+0000 7f2a5be00640 1 -- 172.21.15.114:0/307193657 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c014620 con 0x7f2a6413f420 2024-09-13T17:53:49.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.246+0000 7f2a5be00640 1 -- 172.21.15.114:0/307193657 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5c0147a0 con 0x7f2a6413f420 2024-09-13T17:53:49.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.246+0000 7f2a5be00640 1 -- 172.21.15.114:0/307193657 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c014b50 con 0x7f2a6413f420 2024-09-13T17:53:49.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.246+0000 7f2a6ae00640 1 -- 172.21.15.114:0/307193657 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a640ac940 con 0x7f2a6413f420 2024-09-13T17:53:49.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.246+0000 7f2a6ae00640 1 -- 172.21.15.114:0/307193657 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a641651e0 con 0x7f2a6413f420 2024-09-13T17:53:49.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.246+0000 7f2a6ae00640 1 -- 172.21.15.114:0/307193657 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a64159790 con 0x7f2a6413f420 2024-09-13T17:53:49.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.246+0000 7f2a5be00640 1 -- 172.21.15.114:0/307193657 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2a5c014cb0 con 0x7f2a6413f420 2024-09-13T17:53:49.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.250+0000 7f2a5be00640 1 --2- 172.21.15.114:0/307193657 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2a44066690 0x7f2a44068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:49.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.250+0000 7f2a5be00640 1 -- 172.21.15.114:0/307193657 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f2a5c084ef0 con 0x7f2a6413f420 2024-09-13T17:53:49.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.250+0000 7f2a63e00640 1 --2- 172.21.15.114:0/307193657 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2a44066690 0x7f2a44068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:49.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.250+0000 7f2a63e00640 1 --2- 172.21.15.114:0/307193657 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2a44066690 0x7f2a44068b50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2a54007fd0 tx=0x7f2a54007c20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:49.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.254+0000 7f2a5be00640 1 -- 172.21.15.114:0/307193657 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2a5c051ed0 con 0x7f2a6413f420 2024-09-13T17:53:49.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.410+0000 7f2a6ae00640 1 -- 172.21.15.114:0/307193657 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a6413c9d0 con 0x7f2a6413f420 2024-09-13T17:53:49.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.410+0000 7f2a5be00640 1 -- 172.21.15.114:0/307193657 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+18795 (secure 0 0 0) 0x7f2a5c0554f0 con 0x7f2a6413f420 2024-09-13T17:53:49.415 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:49.415 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":48,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:53:33.088316+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:53:06.185439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:53:07.297633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2024-09-13T17:53:31.026998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.35","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6835/1239035445":"2024-09-14T17:53:22.929223+0000","172.21.15.134:6833/1239035445":"2024-09-14T17:53:22.929223+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:53:49.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.410+0000 7f2a6ae00640 1 -- 172.21.15.114:0/307193657 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2a44066690 msgr2=0x7f2a44068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:49.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.410+0000 7f2a6ae00640 1 --2- 172.21.15.114:0/307193657 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2a44066690 0x7f2a44068b50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2a54007fd0 tx=0x7f2a54007c20 comp rx=0 tx=0).stop 2024-09-13T17:53:49.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.410+0000 7f2a6ae00640 1 -- 172.21.15.114:0/307193657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a6413f420 msgr2=0x7f2a6413a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:49.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.410+0000 7f2a6ae00640 1 --2- 172.21.15.114:0/307193657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a6413f420 0x7f2a6413a080 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c007e70 tx=0x7f2a5c00e4b0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.410+0000 7f2a6ae00640 1 -- 172.21.15.114:0/307193657 shutdown_connections 2024-09-13T17:53:49.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.410+0000 7f2a6ae00640 1 --2- 172.21.15.114:0/307193657 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2a44066690 0x7f2a44068b50 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.410+0000 7f2a6ae00640 1 --2- 172.21.15.114:0/307193657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a6413f420 0x7f2a6413a080 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.410+0000 7f2a6ae00640 1 --2- 172.21.15.114:0/307193657 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2a6413c240 0x7f2a640ad010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.410+0000 7f2a6ae00640 1 --2- 172.21.15.114:0/307193657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a6406da90 0x7f2a640ac2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.410+0000 7f2a6ae00640 1 -- 172.21.15.114:0/307193657 >> 172.21.15.114:0/307193657 conn(0x7f2a640660b0 msgr2=0x7f2a641573b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:49.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.410+0000 7f2a6ae00640 1 -- 172.21.15.114:0/307193657 shutdown_connections 2024-09-13T17:53:49.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.410+0000 7f2a6ae00640 1 -- 172.21.15.114:0/307193657 wait complete. 2024-09-13T17:53:49.438 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:51:37.996254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T17:53:06.185439+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:53:07.297633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'recovery_fs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'recovery_fs_metadata', 'create_time': '2024-09-13T17:53:31.026998+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'recovery_fs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:53:49.438 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:53:49.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.570+0000 7f82bb600640 1 Processor -- start 2024-09-13T17:53:49.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.570+0000 7f82bb600640 1 -- start start 2024-09-13T17:53:49.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.574+0000 7f82bb600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f82b413c240 0x7f82b413f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:49.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.574+0000 7f82bb600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f82b406dc60 0x7f82b40cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:49.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.574+0000 7f82bb600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b40cd220 con 0x7f82b413c980 2024-09-13T17:53:49.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.574+0000 7f82bb600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b413f960 con 0x7f82b406dc60 2024-09-13T17:53:49.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.574+0000 7f82bb600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b415a740 con 0x7f82b413c240 2024-09-13T17:53:49.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.574+0000 7f82b9600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f82b406dc60 0x7f82b40cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:49.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.574+0000 7f82b3e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f82b413c980 0x7f82b406d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33838/0 (socket says 172.21.15.114:33838) 2024-09-13T17:53:49.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.574+0000 7f82b3e00640 1 -- 172.21.15.114:0/874461672 learned_addr learned my addr 172.21.15.114:0/874461672 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:49.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.574+0000 7f82b8c00640 1 --2- 172.21.15.114:0/874461672 >> v2:172.21.15.134:3300/0 conn(0x7f82b413c240 0x7f82b413f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:49.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.574+0000 7f82b9600640 1 -- 172.21.15.114:0/874461672 >> v2:172.21.15.134:3300/0 conn(0x7f82b413c240 msgr2=0x7f82b413f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:49.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.574+0000 7f82b9600640 1 --2- 172.21.15.114:0/874461672 >> v2:172.21.15.134:3300/0 conn(0x7f82b413c240 0x7f82b413f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.574+0000 7f82b9600640 1 -- 172.21.15.114:0/874461672 >> v1:172.21.15.114:6789/0 conn(0x7f82b413c980 legacy=0x7f82b406d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:49.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.574+0000 7f82b9600640 1 -- 172.21.15.114:0/874461672 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b4159bc0 con 0x7f82b406dc60 2024-09-13T17:53:49.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.574+0000 7f82b8c00640 1 --2- 172.21.15.114:0/874461672 >> v2:172.21.15.134:3300/0 conn(0x7f82b413c240 0x7f82b413f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:49.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.578+0000 7f82b9600640 1 --2- 172.21.15.114:0/874461672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82b406dc60 0x7f82b40cd650 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f82b406e720 tx=0x7f82ac01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d8e648ca89f00cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:49.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.578+0000 7f82b3400640 1 -- 172.21.15.114:0/874461672 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac0ac620 con 0x7f82b406dc60 2024-09-13T17:53:49.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.578+0000 7f82b3400640 1 -- 172.21.15.114:0/874461672 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ac0ac780 con 0x7f82b406dc60 2024-09-13T17:53:49.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.578+0000 7f82b3400640 1 -- 172.21.15.114:0/874461672 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac0acb10 con 0x7f82b406dc60 2024-09-13T17:53:49.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.578+0000 7f82bb600640 1 -- 172.21.15.114:0/874461672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82b406dc60 msgr2=0x7f82b40cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:49.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.578+0000 7f82bb600640 1 --2- 172.21.15.114:0/874461672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82b406dc60 0x7f82b40cd650 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f82b406e720 tx=0x7f82ac01c3c0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.578+0000 7f82bb600640 1 -- 172.21.15.114:0/874461672 shutdown_connections 2024-09-13T17:53:49.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.578+0000 7f82bb600640 1 --2- 172.21.15.114:0/874461672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82b406dc60 0x7f82b40cd650 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.578+0000 7f82bb600640 1 --2- 172.21.15.114:0/874461672 >> v2:172.21.15.134:3300/0 conn(0x7f82b413c240 0x7f82b413f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.578+0000 7f82bb600640 1 -- 172.21.15.114:0/874461672 >> 172.21.15.114:0/874461672 conn(0x7f82b40660b0 msgr2=0x7f82b4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:49.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.578+0000 7f82bb600640 1 -- 172.21.15.114:0/874461672 shutdown_connections 2024-09-13T17:53:49.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.578+0000 7f82bb600640 1 -- 172.21.15.114:0/874461672 wait complete. 2024-09-13T17:53:49.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.578+0000 7f82bb600640 1 Processor -- start 2024-09-13T17:53:49.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.578+0000 7f82bb600640 1 -- start start 2024-09-13T17:53:49.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.582+0000 7f82bb600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82b406dc60 0x7f82b4138640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:49.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.582+0000 7f82bb600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82b413c240 0x7f82b40ad300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:49.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.582+0000 7f82bb600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82b413c980 0x7f82b40ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:49.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.582+0000 7f82bb600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b415b740 con 0x7f82b413c240 2024-09-13T17:53:49.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.582+0000 7f82bb600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b41390c0 con 0x7f82b413c980 2024-09-13T17:53:49.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.582+0000 7f82bb600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b415a980 con 0x7f82b406dc60 2024-09-13T17:53:49.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.582+0000 7f82b3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82b413c240 0x7f82b40ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:49.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.582+0000 7f82b3e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82b413c240 0x7f82b40ad300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44000/0 (socket says 172.21.15.114:44000) 2024-09-13T17:53:49.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.582+0000 7f82b3e00640 1 -- 172.21.15.114:0/3951999038 learned_addr learned my addr 172.21.15.114:0/3951999038 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:49.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.582+0000 7f82b9600640 1 --2- 172.21.15.114:0/3951999038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82b413c980 0x7f82b40ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:49.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.582+0000 7f82b8c00640 1 --2- 172.21.15.114:0/3951999038 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82b406dc60 0x7f82b4138640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:49.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.582+0000 7f82b3e00640 1 -- 172.21.15.114:0/3951999038 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82b406dc60 msgr2=0x7f82b4138640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:49.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.582+0000 7f82b3e00640 1 --2- 172.21.15.114:0/3951999038 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82b406dc60 0x7f82b4138640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.582+0000 7f82b3e00640 1 -- 172.21.15.114:0/3951999038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82b413c980 msgr2=0x7f82b40ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:49.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.582+0000 7f82b3e00640 1 --2- 172.21.15.114:0/3951999038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82b413c980 0x7f82b40ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.582+0000 7f82b3e00640 1 -- 172.21.15.114:0/3951999038 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ac009420 con 0x7f82b413c240 2024-09-13T17:53:49.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.582+0000 7f82b9600640 1 --2- 172.21.15.114:0/3951999038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82b413c980 0x7f82b40ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:49.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.582+0000 7f82b3e00640 1 --2- 172.21.15.114:0/3951999038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82b413c240 0x7f82b40ad300 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f82a000c500 tx=0x7f82a000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:49.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.582+0000 7f82b0c00640 1 -- 172.21.15.114:0/3951999038 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a0005cf0 con 0x7f82b413c240 2024-09-13T17:53:49.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.582+0000 7f82b0c00640 1 -- 172.21.15.114:0/3951999038 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a0005e50 con 0x7f82b413c240 2024-09-13T17:53:49.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.582+0000 7f82b0c00640 1 -- 172.21.15.114:0/3951999038 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a00072f0 con 0x7f82b413c240 2024-09-13T17:53:49.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.582+0000 7f82bb600640 1 -- 172.21.15.114:0/3951999038 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b415ac60 con 0x7f82b413c240 2024-09-13T17:53:49.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.582+0000 7f82bb600640 1 -- 172.21.15.114:0/3951999038 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b415b220 con 0x7f82b413c240 2024-09-13T17:53:49.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.582+0000 7f82bb600640 1 -- 172.21.15.114:0/3951999038 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b415b410 con 0x7f82b413c240 2024-09-13T17:53:49.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.582+0000 7f82b0c00640 1 -- 172.21.15.114:0/3951999038 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f82a0007450 con 0x7f82b413c240 2024-09-13T17:53:49.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.586+0000 7f82b0c00640 1 --2- 172.21.15.114:0/3951999038 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8294066690 0x7f8294068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:49.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.586+0000 7f82b0c00640 1 -- 172.21.15.114:0/3951999038 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f82a0083a70 con 0x7f82b413c240 2024-09-13T17:53:49.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.586+0000 7f82b8c00640 1 --2- 172.21.15.114:0/3951999038 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8294066690 0x7f8294068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:49.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.586+0000 7f82b8c00640 1 --2- 172.21.15.114:0/3951999038 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8294066690 0x7f8294068b50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f82b40b2990 tx=0x7f82a4009890 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:49.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.590+0000 7f82b0c00640 1 -- 172.21.15.114:0/3951999038 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f82a0050b00 con 0x7f82b413c240 2024-09-13T17:53:49.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.742+0000 7f82bb600640 1 -- 172.21.15.114:0/3951999038 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82b415a4f0 con 0x7f82b413c240 2024-09-13T17:53:49.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.742+0000 7f82b0c00640 1 -- 172.21.15.114:0/3951999038 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7f82a0054120 con 0x7f82b413c240 2024-09-13T17:53:49.749 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-13T17:53:49.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.746+0000 7f82bb600640 1 -- 172.21.15.114:0/3951999038 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8294066690 msgr2=0x7f8294068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:49.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.746+0000 7f82bb600640 1 --2- 172.21.15.114:0/3951999038 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8294066690 0x7f8294068b50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f82b40b2990 tx=0x7f82a4009890 comp rx=0 tx=0).stop 2024-09-13T17:53:49.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.746+0000 7f82bb600640 1 -- 172.21.15.114:0/3951999038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82b413c240 msgr2=0x7f82b40ad300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:49.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.746+0000 7f82bb600640 1 --2- 172.21.15.114:0/3951999038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82b413c240 0x7f82b40ad300 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f82a000c500 tx=0x7f82a000c9c0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.746+0000 7f82bb600640 1 -- 172.21.15.114:0/3951999038 shutdown_connections 2024-09-13T17:53:49.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.746+0000 7f82bb600640 1 --2- 172.21.15.114:0/3951999038 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8294066690 0x7f8294068b50 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.746+0000 7f82bb600640 1 --2- 172.21.15.114:0/3951999038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82b413c980 0x7f82b40ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.746+0000 7f82bb600640 1 --2- 172.21.15.114:0/3951999038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82b413c240 0x7f82b40ad300 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.746+0000 7f82bb600640 1 --2- 172.21.15.114:0/3951999038 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f82b406dc60 0x7f82b4138640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.746+0000 7f82bb600640 1 -- 172.21.15.114:0/3951999038 >> 172.21.15.114:0/3951999038 conn(0x7f82b40660b0 msgr2=0x7f82b41396b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:49.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.746+0000 7f82bb600640 1 -- 172.21.15.114:0/3951999038 shutdown_connections 2024-09-13T17:53:49.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.746+0000 7f82bb600640 1 -- 172.21.15.114:0/3951999038 wait complete. 2024-09-13T17:53:49.771 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T17:53:49.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.902+0000 7f4f7dc00640 1 Processor -- start 2024-09-13T17:53:49.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.902+0000 7f4f7dc00640 1 -- start start 2024-09-13T17:53:49.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.902+0000 7f4f7dc00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4f78143f40 0x7f4f780cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:49.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.902+0000 7f4f7dc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f780cca40 0x7f4f7806c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:49.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.902+0000 7f4f7dc00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4f7806c8f0 0x7f4f780703b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:49.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.902+0000 7f4f7dc00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f7815aac0 con 0x7f4f7806c8f0 2024-09-13T17:53:49.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.902+0000 7f4f7dc00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f7806cd50 con 0x7f4f78143f40 2024-09-13T17:53:49.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.902+0000 7f4f7dc00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f78144320 con 0x7f4f780cca40 2024-09-13T17:53:49.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.902+0000 7f4f77400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4f7806c8f0 0x7f4f780703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:49.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.902+0000 7f4f77400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4f7806c8f0 0x7f4f780703b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44002/0 (socket says 172.21.15.114:44002) 2024-09-13T17:53:49.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.902+0000 7f4f77400640 1 -- 172.21.15.114:0/3957164167 learned_addr learned my addr 172.21.15.114:0/3957164167 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:49.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.902+0000 7f4f76a00640 1 --2- 172.21.15.114:0/3957164167 >> v2:172.21.15.134:3300/0 conn(0x7f4f78143f40 0x7f4f780cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:49.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.902+0000 7f4f6e000640 1 --2- 172.21.15.114:0/3957164167 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f780cca40 0x7f4f7806c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:49.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.902+0000 7f4f77400640 1 -- 172.21.15.114:0/3957164167 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f780cca40 msgr2=0x7f4f7806c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:49.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.902+0000 7f4f77400640 1 --2- 172.21.15.114:0/3957164167 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f780cca40 0x7f4f7806c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.902+0000 7f4f77400640 1 -- 172.21.15.114:0/3957164167 >> v2:172.21.15.134:3300/0 conn(0x7f4f78143f40 msgr2=0x7f4f780cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:49.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.902+0000 7f4f77400640 1 --2- 172.21.15.114:0/3957164167 >> v2:172.21.15.134:3300/0 conn(0x7f4f78143f40 0x7f4f780cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.902+0000 7f4f77400640 1 -- 172.21.15.114:0/3957164167 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f780cda60 con 0x7f4f7806c8f0 2024-09-13T17:53:49.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.906+0000 7f4f77400640 1 --2- 172.21.15.114:0/3957164167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f7806c8f0 0x7f4f780703b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f4f78071470 tx=0x7f4f7001c670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68cd9b0c81c7eadc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:49.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.906+0000 7f4f76000640 1 -- 172.21.15.114:0/3957164167 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f700a6500 con 0x7f4f7806c8f0 2024-09-13T17:53:49.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.906+0000 7f4f76000640 1 -- 172.21.15.114:0/3957164167 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f700a6660 con 0x7f4f7806c8f0 2024-09-13T17:53:49.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.906+0000 7f4f76000640 1 -- 172.21.15.114:0/3957164167 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f700a69f0 con 0x7f4f7806c8f0 2024-09-13T17:53:49.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.906+0000 7f4f7dc00640 1 -- 172.21.15.114:0/3957164167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f7806c8f0 msgr2=0x7f4f780703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:49.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.906+0000 7f4f7dc00640 1 --2- 172.21.15.114:0/3957164167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f7806c8f0 0x7f4f780703b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f4f78071470 tx=0x7f4f7001c670 comp rx=0 tx=0).stop 2024-09-13T17:53:49.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.906+0000 7f4f7dc00640 1 -- 172.21.15.114:0/3957164167 shutdown_connections 2024-09-13T17:53:49.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.906+0000 7f4f7dc00640 1 --2- 172.21.15.114:0/3957164167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f7806c8f0 0x7f4f780703b0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.906+0000 7f4f7dc00640 1 --2- 172.21.15.114:0/3957164167 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f780cca40 0x7f4f7806c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.906+0000 7f4f7dc00640 1 --2- 172.21.15.114:0/3957164167 >> v2:172.21.15.134:3300/0 conn(0x7f4f78143f40 0x7f4f780cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.906+0000 7f4f7dc00640 1 -- 172.21.15.114:0/3957164167 >> 172.21.15.114:0/3957164167 conn(0x7f4f780b01a0 msgr2=0x7f4f780b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:49.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.906+0000 7f4f7dc00640 1 -- 172.21.15.114:0/3957164167 shutdown_connections 2024-09-13T17:53:49.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.906+0000 7f4f7dc00640 1 -- 172.21.15.114:0/3957164167 wait complete. 2024-09-13T17:53:49.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.910+0000 7f4f7dc00640 1 Processor -- start 2024-09-13T17:53:49.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.910+0000 7f4f7dc00640 1 -- start start 2024-09-13T17:53:49.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.910+0000 7f4f7dc00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f7806c8f0 0x7f4f781f4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:49.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.910+0000 7f4f7dc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f780cca40 0x7f4f78148a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:49.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.910+0000 7f4f7dc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f78143f40 0x7f4f78148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:49.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.910+0000 7f4f7dc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7813e340 con 0x7f4f780cca40 2024-09-13T17:53:49.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.910+0000 7f4f7dc00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f780b2f10 con 0x7f4f7806c8f0 2024-09-13T17:53:49.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.910+0000 7f4f7dc00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f780b31f0 con 0x7f4f78143f40 2024-09-13T17:53:49.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.910+0000 7f4f6e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f780cca40 0x7f4f78148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:49.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.910+0000 7f4f6e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f780cca40 0x7f4f78148a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44006/0 (socket says 172.21.15.114:44006) 2024-09-13T17:53:49.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.910+0000 7f4f6e000640 1 -- 172.21.15.114:0/777934511 learned_addr learned my addr 172.21.15.114:0/777934511 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:49.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.910+0000 7f4f77400640 1 --2- 172.21.15.114:0/777934511 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f78143f40 0x7f4f78148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:49.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.910+0000 7f4f76a00640 1 --2- 172.21.15.114:0/777934511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f7806c8f0 0x7f4f781f4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:49.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.910+0000 7f4f6e000640 1 -- 172.21.15.114:0/777934511 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f78143f40 msgr2=0x7f4f78148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:49.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.910+0000 7f4f6e000640 1 --2- 172.21.15.114:0/777934511 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f78143f40 0x7f4f78148fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.910+0000 7f4f6e000640 1 -- 172.21.15.114:0/777934511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f7806c8f0 msgr2=0x7f4f781f4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.910+0000 7f4f6e000640 1 --2- 172.21.15.114:0/777934511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f7806c8f0 0x7f4f781f4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.910+0000 7f4f6e000640 1 -- 172.21.15.114:0/777934511 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f70009b30 con 0x7f4f780cca40 2024-09-13T17:53:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.910+0000 7f4f6e000640 1 --2- 172.21.15.114:0/777934511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f780cca40 0x7f4f78148a70 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f4f6000d800 tx=0x7f4f6000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.910+0000 7f4f6f400640 1 -- 172.21.15.114:0/777934511 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6000b6c0 con 0x7f4f780cca40 2024-09-13T17:53:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.910+0000 7f4f6f400640 1 -- 172.21.15.114:0/777934511 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6000b820 con 0x7f4f780cca40 2024-09-13T17:53:49.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.910+0000 7f4f6f400640 1 -- 172.21.15.114:0/777934511 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6000bb90 con 0x7f4f780cca40 2024-09-13T17:53:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.910+0000 7f4f7dc00640 1 -- 172.21.15.114:0/777934511 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f780b34d0 con 0x7f4f780cca40 2024-09-13T17:53:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.910+0000 7f4f7dc00640 1 -- 172.21.15.114:0/777934511 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f780abd90 con 0x7f4f780cca40 2024-09-13T17:53:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.914+0000 7f4f7dc00640 1 -- 172.21.15.114:0/777934511 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f7806c3b0 con 0x7f4f780cca40 2024-09-13T17:53:49.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.914+0000 7f4f6f400640 1 -- 172.21.15.114:0/777934511 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4f6000bcf0 con 0x7f4f780cca40 2024-09-13T17:53:49.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.914+0000 7f4f6f400640 1 --2- 172.21.15.114:0/777934511 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4f54066690 0x7f4f54068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:49.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.914+0000 7f4f6f400640 1 -- 172.21.15.114:0/777934511 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f4f60084ab0 con 0x7f4f780cca40 2024-09-13T17:53:49.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.914+0000 7f4f76a00640 1 --2- 172.21.15.114:0/777934511 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4f54066690 0x7f4f54068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:49.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.914+0000 7f4f76a00640 1 --2- 172.21.15.114:0/777934511 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4f54066690 0x7f4f54068b50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4f6800d8d0 tx=0x7f4f68008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:49.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:49.918+0000 7f4f6f400640 1 -- 172.21.15.114:0/777934511 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4f60051a90 con 0x7f4f780cca40 2024-09-13T17:53:50.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.074+0000 7f4f7dc00640 1 -- 172.21.15.114:0/777934511 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4f780ad430 con 0x7f4f780cca40 2024-09-13T17:53:50.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.074+0000 7f4f6f400640 1 -- 172.21.15.114:0/777934511 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v48) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4f60011340 con 0x7f4f780cca40 2024-09-13T17:53:50.082 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:53:50.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.078+0000 7f4f7dc00640 1 -- 172.21.15.114:0/777934511 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4f54066690 msgr2=0x7f4f54068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:50.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.078+0000 7f4f7dc00640 1 --2- 172.21.15.114:0/777934511 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4f54066690 0x7f4f54068b50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4f6800d8d0 tx=0x7f4f68008040 comp rx=0 tx=0).stop 2024-09-13T17:53:50.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.078+0000 7f4f7dc00640 1 -- 172.21.15.114:0/777934511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f780cca40 msgr2=0x7f4f78148a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:50.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.078+0000 7f4f7dc00640 1 --2- 172.21.15.114:0/777934511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f780cca40 0x7f4f78148a70 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f4f6000d800 tx=0x7f4f6000dcc0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.078+0000 7f4f7dc00640 1 -- 172.21.15.114:0/777934511 shutdown_connections 2024-09-13T17:53:50.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.078+0000 7f4f7dc00640 1 --2- 172.21.15.114:0/777934511 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f4f54066690 0x7f4f54068b50 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.078+0000 7f4f7dc00640 1 --2- 172.21.15.114:0/777934511 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4f78143f40 0x7f4f78148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.078+0000 7f4f7dc00640 1 --2- 172.21.15.114:0/777934511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4f780cca40 0x7f4f78148a70 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.078+0000 7f4f7dc00640 1 --2- 172.21.15.114:0/777934511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f7806c8f0 0x7f4f781f4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.078+0000 7f4f7dc00640 1 -- 172.21.15.114:0/777934511 >> 172.21.15.114:0/777934511 conn(0x7f4f780b01a0 msgr2=0x7f4f7815b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:50.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.078+0000 7f4f7dc00640 1 -- 172.21.15.114:0/777934511 shutdown_connections 2024-09-13T17:53:50.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.078+0000 7f4f7dc00640 1 -- 172.21.15.114:0/777934511 wait complete. 2024-09-13T17:53:50.103 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:53:50.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.234+0000 7fbfefa00640 1 Processor -- start 2024-09-13T17:53:50.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.234+0000 7fbfefa00640 1 -- start start 2024-09-13T17:53:50.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.234+0000 7fbfefa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbfe815a650 0x7fbfe8099480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:50.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.234+0000 7fbfefa00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbfe815e7c0 0x7fbfe80cb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:50.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.234+0000 7fbfefa00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe80ce540 con 0x7fbfe80ce0b0 2024-09-13T17:53:50.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.234+0000 7fbfefa00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe815ba40 con 0x7fbfe815a650 2024-09-13T17:53:50.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.238+0000 7fbfefa00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe80ce820 con 0x7fbfe815e7c0 2024-09-13T17:53:50.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.238+0000 7fbfe7e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbfe80ce0b0 0x7fbfe815e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33854/0 (socket says 172.21.15.114:33854) 2024-09-13T17:53:50.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.238+0000 7fbfed000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbfe815a650 0x7fbfe8099480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:50.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.238+0000 7fbfe7e00640 1 -- 172.21.15.114:0/2219160246 learned_addr learned my addr 172.21.15.114:0/2219160246 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:50.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.238+0000 7fbfeda00640 1 --2- 172.21.15.114:0/2219160246 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbfe815e7c0 0x7fbfe80cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:50.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.238+0000 7fbfed000640 1 -- 172.21.15.114:0/2219160246 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbfe815e7c0 msgr2=0x7fbfe80cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:50.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.238+0000 7fbfed000640 1 --2- 172.21.15.114:0/2219160246 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbfe815e7c0 0x7fbfe80cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.238+0000 7fbfed000640 1 -- 172.21.15.114:0/2219160246 >> v1:172.21.15.114:6789/0 conn(0x7fbfe80ce0b0 legacy=0x7fbfe815e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:50.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.238+0000 7fbfed000640 1 -- 172.21.15.114:0/2219160246 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe80ceb00 con 0x7fbfe815a650 2024-09-13T17:53:50.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.238+0000 7fbfed000640 1 --2- 172.21.15.114:0/2219160246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe815a650 0x7fbfe8099480 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0097c0 tx=0x7fbfdc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1d3a54c14d1a7b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:50.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.238+0000 7fbfe7400640 1 -- 172.21.15.114:0/2219160246 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc0ab670 con 0x7fbfe815a650 2024-09-13T17:53:50.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.238+0000 7fbfe7400640 1 -- 172.21.15.114:0/2219160246 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfdc0ab7d0 con 0x7fbfe815a650 2024-09-13T17:53:50.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.238+0000 7fbfe7400640 1 -- 172.21.15.114:0/2219160246 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc0abb60 con 0x7fbfe815a650 2024-09-13T17:53:50.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.242+0000 7fbfefa00640 1 -- 172.21.15.114:0/2219160246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe815a650 msgr2=0x7fbfe8099480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:50.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.242+0000 7fbfefa00640 1 --2- 172.21.15.114:0/2219160246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe815a650 0x7fbfe8099480 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0097c0 tx=0x7fbfdc01c470 comp rx=0 tx=0).stop 2024-09-13T17:53:50.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.242+0000 7fbfefa00640 1 -- 172.21.15.114:0/2219160246 shutdown_connections 2024-09-13T17:53:50.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.242+0000 7fbfefa00640 1 --2- 172.21.15.114:0/2219160246 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbfe815e7c0 0x7fbfe80cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.242+0000 7fbfefa00640 1 --2- 172.21.15.114:0/2219160246 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe815a650 0x7fbfe8099480 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.242+0000 7fbfefa00640 1 -- 172.21.15.114:0/2219160246 >> 172.21.15.114:0/2219160246 conn(0x7fbfe80d04e0 msgr2=0x7fbfe80d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:50.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.242+0000 7fbfefa00640 1 -- 172.21.15.114:0/2219160246 shutdown_connections 2024-09-13T17:53:50.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.242+0000 7fbfefa00640 1 -- 172.21.15.114:0/2219160246 wait complete. 2024-09-13T17:53:50.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.242+0000 7fbfefa00640 1 Processor -- start 2024-09-13T17:53:50.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.242+0000 7fbfefa00640 1 -- start start 2024-09-13T17:53:50.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.242+0000 7fbfefa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe815a650 0x7fbfe815bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:50.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.242+0000 7fbfefa00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfe815e7c0 0x7fbfe806c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:50.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.242+0000 7fbfefa00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbfe815d590 0x7fbfe815da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:50.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.242+0000 7fbfefa00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe8158d50 con 0x7fbfe815a650 2024-09-13T17:53:50.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.242+0000 7fbfefa00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe815c4f0 con 0x7fbfe815e7c0 2024-09-13T17:53:50.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.242+0000 7fbfefa00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe815c7d0 con 0x7fbfe815d590 2024-09-13T17:53:50.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.242+0000 7fbfed000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe815a650 0x7fbfe815bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:50.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.242+0000 7fbfed000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe815a650 0x7fbfe815bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44022/0 (socket says 172.21.15.114:44022) 2024-09-13T17:53:50.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.242+0000 7fbfed000640 1 -- 172.21.15.114:0/2989301420 learned_addr learned my addr 172.21.15.114:0/2989301420 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:50.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.242+0000 7fbfeda00640 1 --2- 172.21.15.114:0/2989301420 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbfe815d590 0x7fbfe815da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:50.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.242+0000 7fbfe7e00640 1 --2- 172.21.15.114:0/2989301420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfe815e7c0 0x7fbfe806c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:50.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.242+0000 7fbfed000640 1 -- 172.21.15.114:0/2989301420 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbfe815d590 msgr2=0x7fbfe815da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:50.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.242+0000 7fbfed000640 1 --2- 172.21.15.114:0/2989301420 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbfe815d590 0x7fbfe815da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.242+0000 7fbfed000640 1 -- 172.21.15.114:0/2989301420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfe815e7c0 msgr2=0x7fbfe806c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:50.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.242+0000 7fbfed000640 1 --2- 172.21.15.114:0/2989301420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfe815e7c0 0x7fbfe806c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.242+0000 7fbfed000640 1 -- 172.21.15.114:0/2989301420 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc009420 con 0x7fbfe815a650 2024-09-13T17:53:50.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.246+0000 7fbfed000640 1 --2- 172.21.15.114:0/2989301420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe815a650 0x7fbfe815bca0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0ad040 tx=0x7fbfdc01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:50.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.246+0000 7fbfe4c00640 1 -- 172.21.15.114:0/2989301420 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc0b5810 con 0x7fbfe815a650 2024-09-13T17:53:50.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.246+0000 7fbfe4c00640 1 -- 172.21.15.114:0/2989301420 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfdc0b5990 con 0x7fbfe815a650 2024-09-13T17:53:50.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.246+0000 7fbfefa00640 1 -- 172.21.15.114:0/2989301420 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe815cab0 con 0x7fbfe815a650 2024-09-13T17:53:50.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.246+0000 7fbfe4c00640 1 -- 172.21.15.114:0/2989301420 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc0b5d40 con 0x7fbfe815a650 2024-09-13T17:53:50.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.246+0000 7fbfefa00640 1 -- 172.21.15.114:0/2989301420 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe815d070 con 0x7fbfe815a650 2024-09-13T17:53:50.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.246+0000 7fbfefa00640 1 -- 172.21.15.114:0/2989301420 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe804e2c0 con 0x7fbfe815a650 2024-09-13T17:53:50.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.246+0000 7fbfe4c00640 1 -- 172.21.15.114:0/2989301420 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbfdc0b4390 con 0x7fbfe815a650 2024-09-13T17:53:50.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.246+0000 7fbfe4c00640 1 --2- 172.21.15.114:0/2989301420 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbfc8066690 0x7fbfc8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:50.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.246+0000 7fbfe4c00640 1 -- 172.21.15.114:0/2989301420 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7fbfdc11ef20 con 0x7fbfe815a650 2024-09-13T17:53:50.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.246+0000 7fbfe7e00640 1 --2- 172.21.15.114:0/2989301420 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbfc8066690 0x7fbfc8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:50.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.246+0000 7fbfe7e00640 1 --2- 172.21.15.114:0/2989301420 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbfc8066690 0x7fbfc8068b50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbfe815a170 tx=0x7fbfd4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:50.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.254+0000 7fbfe4c00640 1 -- 172.21.15.114:0/2989301420 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbfdc0ebe90 con 0x7fbfe815a650 2024-09-13T17:53:50.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.410+0000 7fbfefa00640 1 -- 172.21.15.114:0/2989301420 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbfe8099480 con 0x7fbfe815a650 2024-09-13T17:53:50.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.410+0000 7fbfe4c00640 1 -- 172.21.15.114:0/2989301420 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v48) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbfdc0ab630 con 0x7fbfe815a650 2024-09-13T17:53:50.415 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-09-13T17:53:50.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.410+0000 7fbfefa00640 1 -- 172.21.15.114:0/2989301420 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbfc8066690 msgr2=0x7fbfc8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:50.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.410+0000 7fbfefa00640 1 --2- 172.21.15.114:0/2989301420 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbfc8066690 0x7fbfc8068b50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbfe815a170 tx=0x7fbfd4009040 comp rx=0 tx=0).stop 2024-09-13T17:53:50.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.410+0000 7fbfefa00640 1 -- 172.21.15.114:0/2989301420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe815a650 msgr2=0x7fbfe815bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:50.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.410+0000 7fbfefa00640 1 --2- 172.21.15.114:0/2989301420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe815a650 0x7fbfe815bca0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0ad040 tx=0x7fbfdc01acb0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.410+0000 7fbfefa00640 1 -- 172.21.15.114:0/2989301420 shutdown_connections 2024-09-13T17:53:50.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.410+0000 7fbfefa00640 1 --2- 172.21.15.114:0/2989301420 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbfc8066690 0x7fbfc8068b50 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.410+0000 7fbfefa00640 1 --2- 172.21.15.114:0/2989301420 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbfe815d590 0x7fbfe815da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.410+0000 7fbfefa00640 1 --2- 172.21.15.114:0/2989301420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbfe815e7c0 0x7fbfe806c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.410+0000 7fbfefa00640 1 --2- 172.21.15.114:0/2989301420 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfe815a650 0x7fbfe815bca0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.410+0000 7fbfefa00640 1 -- 172.21.15.114:0/2989301420 >> 172.21.15.114:0/2989301420 conn(0x7fbfe80d04e0 msgr2=0x7fbfe806e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:50.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.410+0000 7fbfefa00640 1 -- 172.21.15.114:0/2989301420 shutdown_connections 2024-09-13T17:53:50.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.410+0000 7fbfefa00640 1 -- 172.21.15.114:0/2989301420 wait complete. 2024-09-13T17:53:50.437 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get recovery_fs_metadata pg_num 2024-09-13T17:53:50.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.570+0000 7ff9ff600640 1 Processor -- start 2024-09-13T17:53:50.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.570+0000 7ff9ff600640 1 -- start start 2024-09-13T17:53:50.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.574+0000 7ff9ff600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff9f80cdad0 0x7ff9f80ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:50.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.574+0000 7ff9ff600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff9f806d740 0x7ff9f8070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:50.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.574+0000 7ff9ff600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f8070dc0 con 0x7ff9f8070420 2024-09-13T17:53:50.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.574+0000 7ff9ff600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f806cc10 con 0x7ff9f806d740 2024-09-13T17:53:50.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.574+0000 7ff9ff600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f80adfb0 con 0x7ff9f80cdad0 2024-09-13T17:53:50.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.574+0000 7ff9fd600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff9f806d740 0x7ff9f8070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:50.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.574+0000 7ff9efe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff9f8070420 0x7ff9f806d030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33868/0 (socket says 172.21.15.114:33868) 2024-09-13T17:53:50.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.574+0000 7ff9efe00640 1 -- 172.21.15.114:0/4161104977 learned_addr learned my addr 172.21.15.114:0/4161104977 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:50.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.574+0000 7ff9fcc00640 1 --2- 172.21.15.114:0/4161104977 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff9f80cdad0 0x7ff9f80ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:50.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.574+0000 7ff9fd600640 1 -- 172.21.15.114:0/4161104977 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff9f80cdad0 msgr2=0x7ff9f80ad4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:50.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.574+0000 7ff9fd600640 1 --2- 172.21.15.114:0/4161104977 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff9f80cdad0 0x7ff9f80ad4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.574+0000 7ff9fd600640 1 -- 172.21.15.114:0/4161104977 >> v1:172.21.15.114:6789/0 conn(0x7ff9f8070420 legacy=0x7ff9f806d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:50.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.574+0000 7ff9f7e00640 1 -- 172.21.15.114:0/4161104977 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882388412 0 0) 0x7ff9f8070dc0 con 0x7ff9f8070420 2024-09-13T17:53:50.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.574+0000 7ff9fd600640 1 -- 172.21.15.114:0/4161104977 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f80adcd0 con 0x7ff9f806d740 2024-09-13T17:53:50.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.578+0000 7ff9fd600640 1 --2- 172.21.15.114:0/4161104977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9f806d740 0x7ff9f8070880 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0009d90 tx=0x7ff9f001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279c92201209492e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:50.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.578+0000 7ff9f7e00640 1 -- 172.21.15.114:0/4161104977 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f00a5970 con 0x7ff9f806d740 2024-09-13T17:53:50.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.578+0000 7ff9f7e00640 1 -- 172.21.15.114:0/4161104977 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f00a5ad0 con 0x7ff9f806d740 2024-09-13T17:53:50.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.578+0000 7ff9f7e00640 1 -- 172.21.15.114:0/4161104977 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f00a5e60 con 0x7ff9f806d740 2024-09-13T17:53:50.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.578+0000 7ff9ff600640 1 -- 172.21.15.114:0/4161104977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9f806d740 msgr2=0x7ff9f8070880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:50.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.578+0000 7ff9ff600640 1 --2- 172.21.15.114:0/4161104977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9f806d740 0x7ff9f8070880 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0009d90 tx=0x7ff9f001c8b0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.578+0000 7ff9ff600640 1 -- 172.21.15.114:0/4161104977 shutdown_connections 2024-09-13T17:53:50.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.578+0000 7ff9ff600640 1 --2- 172.21.15.114:0/4161104977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9f806d740 0x7ff9f8070880 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.578+0000 7ff9ff600640 1 --2- 172.21.15.114:0/4161104977 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff9f80cdad0 0x7ff9f80ad4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.578+0000 7ff9ff600640 1 -- 172.21.15.114:0/4161104977 >> 172.21.15.114:0/4161104977 conn(0x7ff9f80660b0 msgr2=0x7ff9f8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:50.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.578+0000 7ff9ff600640 1 -- 172.21.15.114:0/4161104977 shutdown_connections 2024-09-13T17:53:50.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.578+0000 7ff9ff600640 1 -- 172.21.15.114:0/4161104977 wait complete. 2024-09-13T17:53:50.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.578+0000 7ff9ff600640 1 Processor -- start 2024-09-13T17:53:50.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.578+0000 7ff9ff600640 1 -- start start 2024-09-13T17:53:50.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.582+0000 7ff9ff600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9f806d740 0x7ff9f814c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:50.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.582+0000 7ff9ff600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff9f8070420 0x7ff9f8146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:50.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.582+0000 7ff9ff600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9f80cdad0 0x7ff9f814d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:50.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.582+0000 7ff9ff600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f814ad30 con 0x7ff9f80cdad0 2024-09-13T17:53:50.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.582+0000 7ff9ff600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f814b010 con 0x7ff9f806d740 2024-09-13T17:53:50.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.582+0000 7ff9ff600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f814b2f0 con 0x7ff9f8070420 2024-09-13T17:53:50.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.582+0000 7ff9fd600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9f80cdad0 0x7ff9f814d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:50.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.582+0000 7ff9efe00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff9f8070420 0x7ff9f8146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:50.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.582+0000 7ff9fd600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9f80cdad0 0x7ff9f814d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44048/0 (socket says 172.21.15.114:44048) 2024-09-13T17:53:50.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.582+0000 7ff9fd600640 1 -- 172.21.15.114:0/1693502931 learned_addr learned my addr 172.21.15.114:0/1693502931 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:50.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.582+0000 7ff9fcc00640 1 --2- 172.21.15.114:0/1693502931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9f806d740 0x7ff9f814c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:50.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.582+0000 7ff9fd600640 1 -- 172.21.15.114:0/1693502931 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff9f8070420 msgr2=0x7ff9f8146cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:50.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.582+0000 7ff9fd600640 1 --2- 172.21.15.114:0/1693502931 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff9f8070420 0x7ff9f8146cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.582+0000 7ff9fd600640 1 -- 172.21.15.114:0/1693502931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9f806d740 msgr2=0x7ff9f814c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:50.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.582+0000 7ff9fd600640 1 --2- 172.21.15.114:0/1693502931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9f806d740 0x7ff9f814c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.582+0000 7ff9fd600640 1 -- 172.21.15.114:0/1693502931 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f0009a70 con 0x7ff9f80cdad0 2024-09-13T17:53:50.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.582+0000 7ff9efe00640 1 --2- 172.21.15.114:0/1693502931 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff9f8070420 0x7ff9f8146cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:53:50.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.582+0000 7ff9fd600640 1 --2- 172.21.15.114:0/1693502931 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9f80cdad0 0x7ff9f814d0e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff9f001a4e0 tx=0x7ff9f0019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:50.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.582+0000 7ff9f5600640 1 -- 172.21.15.114:0/1693502931 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f00aed80 con 0x7ff9f80cdad0 2024-09-13T17:53:50.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.582+0000 7ff9f5600640 1 -- 172.21.15.114:0/1693502931 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f0009450 con 0x7ff9f80cdad0 2024-09-13T17:53:50.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.582+0000 7ff9f5600640 1 -- 172.21.15.114:0/1693502931 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f00b7610 con 0x7ff9f80cdad0 2024-09-13T17:53:50.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.582+0000 7ff9ff600640 1 -- 172.21.15.114:0/1693502931 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f814b5d0 con 0x7ff9f80cdad0 2024-09-13T17:53:50.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.582+0000 7ff9ff600640 1 -- 172.21.15.114:0/1693502931 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f81478a0 con 0x7ff9f80cdad0 2024-09-13T17:53:50.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.582+0000 7ff9ff600640 1 -- 172.21.15.114:0/1693502931 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f814b7f0 con 0x7ff9f80cdad0 2024-09-13T17:53:50.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.582+0000 7ff9f5600640 1 -- 172.21.15.114:0/1693502931 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff9f00b4050 con 0x7ff9f80cdad0 2024-09-13T17:53:50.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.586+0000 7ff9f5600640 1 --2- 172.21.15.114:0/1693502931 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff9d4066690 0x7ff9d4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:50.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.586+0000 7ff9f5600640 1 -- 172.21.15.114:0/1693502931 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7ff9f011f8b0 con 0x7ff9f80cdad0 2024-09-13T17:53:50.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.586+0000 7ff9fcc00640 1 --2- 172.21.15.114:0/1693502931 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff9d4066690 0x7ff9d4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:50.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.586+0000 7ff9fcc00640 1 --2- 172.21.15.114:0/1693502931 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff9d4066690 0x7ff9d4068b50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff9f81f8650 tx=0x7ff9e8009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:50.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.590+0000 7ff9f5600640 1 -- 172.21.15.114:0/1693502931 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff9f00eca70 con 0x7ff9f80cdad0 2024-09-13T17:53:50.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.742+0000 7ff9ff600640 1 -- 172.21.15.114:0/1693502931 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "recovery_fs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff9f814ae70 con 0x7ff9f80cdad0 2024-09-13T17:53:50.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.742+0000 7ff9f5600640 1 -- 172.21.15.114:0/1693502931 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "recovery_fs_metadata", "var": "pg_num"}]=0 v48) v1 ==== 109+0+11 (secure 0 0 0) 0x7ff9f814ae70 con 0x7ff9f80cdad0 2024-09-13T17:53:50.747 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:53:50.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.742+0000 7ff9ff600640 1 -- 172.21.15.114:0/1693502931 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff9d4066690 msgr2=0x7ff9d4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:50.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.742+0000 7ff9ff600640 1 --2- 172.21.15.114:0/1693502931 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff9d4066690 0x7ff9d4068b50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff9f81f8650 tx=0x7ff9e8009190 comp rx=0 tx=0).stop 2024-09-13T17:53:50.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.742+0000 7ff9ff600640 1 -- 172.21.15.114:0/1693502931 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9f80cdad0 msgr2=0x7ff9f814d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:50.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.742+0000 7ff9ff600640 1 --2- 172.21.15.114:0/1693502931 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9f80cdad0 0x7ff9f814d0e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff9f001a4e0 tx=0x7ff9f0019650 comp rx=0 tx=0).stop 2024-09-13T17:53:50.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.742+0000 7ff9ff600640 1 -- 172.21.15.114:0/1693502931 shutdown_connections 2024-09-13T17:53:50.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.742+0000 7ff9ff600640 1 --2- 172.21.15.114:0/1693502931 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff9d4066690 0x7ff9d4068b50 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.742+0000 7ff9ff600640 1 --2- 172.21.15.114:0/1693502931 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9f80cdad0 0x7ff9f814d0e0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.742+0000 7ff9ff600640 1 --2- 172.21.15.114:0/1693502931 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff9f8070420 0x7ff9f8146cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.742+0000 7ff9ff600640 1 --2- 172.21.15.114:0/1693502931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9f806d740 0x7ff9f814c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.742+0000 7ff9ff600640 1 -- 172.21.15.114:0/1693502931 >> 172.21.15.114:0/1693502931 conn(0x7ff9f80660b0 msgr2=0x7ff9f80b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:50.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.742+0000 7ff9ff600640 1 -- 172.21.15.114:0/1693502931 shutdown_connections 2024-09-13T17:53:50.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.742+0000 7ff9ff600640 1 -- 172.21.15.114:0/1693502931 wait complete. 2024-09-13T17:53:50.768 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:53:50.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.898+0000 7ff1c8000640 1 Processor -- start 2024-09-13T17:53:50.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.898+0000 7ff1c8000640 1 -- start start 2024-09-13T17:53:50.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.898+0000 7ff1c8000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1c00713c0 0x7ff1c00b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:50.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.898+0000 7ff1c8000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c00b2490 con 0x7ff1c0158a70 2024-09-13T17:53:50.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.898+0000 7ff1c8000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c0158e50 con 0x7ff1c0159be0 2024-09-13T17:53:50.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.898+0000 7ff1c8000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c00b21b0 con 0x7ff1c00713c0 2024-09-13T17:53:50.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.898+0000 7ff1c5600640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff1c0158a70 0x7ff1c0070cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56816/0 (socket says 172.21.15.114:56816) 2024-09-13T17:53:50.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.898+0000 7ff1c5600640 1 -- 172.21.15.114:0/1149563468 learned_addr learned my addr 172.21.15.114:0/1149563468 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:50.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.898+0000 7ff1c4c00640 1 --2- 172.21.15.114:0/1149563468 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1c00713c0 0x7ff1c00b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:50.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.898+0000 7ff1bfe00640 1 -- 172.21.15.114:0/1149563468 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 812817101 0 0) 0x7ff1c00b2490 con 0x7ff1c0158a70 2024-09-13T17:53:50.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.898+0000 7ff1bfe00640 1 -- 172.21.15.114:0/1149563468 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1a8003450 con 0x7ff1c0158a70 2024-09-13T17:53:50.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.898+0000 7ff1c4c00640 1 -- 172.21.15.114:0/1149563468 >> v1:172.21.15.134:6789/0 conn(0x7ff1c0159be0 legacy=0x7ff1c00cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:50.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.898+0000 7ff1c4c00640 1 -- 172.21.15.114:0/1149563468 >> v1:172.21.15.114:6789/0 conn(0x7ff1c0158a70 legacy=0x7ff1c0070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:50.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.898+0000 7ff1c4c00640 1 -- 172.21.15.114:0/1149563468 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c0159100 con 0x7ff1c00713c0 2024-09-13T17:53:50.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.902+0000 7ff1c4c00640 1 --2- 172.21.15.114:0/1149563468 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1c00713c0 0x7ff1c00b1510 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0097f0 tx=0x7ff1ac01c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bab4fdc0964c2d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:50.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.902+0000 7ff1bfe00640 1 -- 172.21.15.114:0/1149563468 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac0ac600 con 0x7ff1c00713c0 2024-09-13T17:53:50.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.902+0000 7ff1bfe00640 1 -- 172.21.15.114:0/1149563468 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ac0a8050 con 0x7ff1c00713c0 2024-09-13T17:53:50.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.902+0000 7ff1bfe00640 1 -- 172.21.15.114:0/1149563468 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac0ac980 con 0x7ff1c00713c0 2024-09-13T17:53:50.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.902+0000 7ff1c8000640 1 -- 172.21.15.114:0/1149563468 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1c00713c0 msgr2=0x7ff1c00b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:50.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.902+0000 7ff1c8000640 1 --2- 172.21.15.114:0/1149563468 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1c00713c0 0x7ff1c00b1510 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0097f0 tx=0x7ff1ac01c420 comp rx=0 tx=0).stop 2024-09-13T17:53:50.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.902+0000 7ff1c8000640 1 -- 172.21.15.114:0/1149563468 shutdown_connections 2024-09-13T17:53:50.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.902+0000 7ff1c8000640 1 --2- 172.21.15.114:0/1149563468 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1c00713c0 0x7ff1c00b1510 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.902+0000 7ff1c8000640 1 -- 172.21.15.114:0/1149563468 >> 172.21.15.114:0/1149563468 conn(0x7ff1c00660b0 msgr2=0x7ff1c0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:50.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.902+0000 7ff1c8000640 1 -- 172.21.15.114:0/1149563468 shutdown_connections 2024-09-13T17:53:50.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.902+0000 7ff1c8000640 1 -- 172.21.15.114:0/1149563468 wait complete. 2024-09-13T17:53:50.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.906+0000 7ff1c8000640 1 Processor -- start 2024-09-13T17:53:50.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.906+0000 7ff1c8000640 1 -- start start 2024-09-13T17:53:50.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.906+0000 7ff1c8000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1c00713c0 0x7ff1c014e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:50.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.906+0000 7ff1c8000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1c0158a70 0x7ff1c014ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:50.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.906+0000 7ff1c8000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1c0159be0 0x7ff1c014f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:50.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.906+0000 7ff1c8000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c014f800 con 0x7ff1c00713c0 2024-09-13T17:53:50.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.906+0000 7ff1c8000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c014a8e0 con 0x7ff1c0159be0 2024-09-13T17:53:50.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.906+0000 7ff1c8000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c0154110 con 0x7ff1c0158a70 2024-09-13T17:53:50.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.906+0000 7ff1c5600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1c00713c0 0x7ff1c014e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:50.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.906+0000 7ff1c5600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1c00713c0 0x7ff1c014e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48468/0 (socket says 172.21.15.114:48468) 2024-09-13T17:53:50.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.906+0000 7ff1c5600640 1 -- 172.21.15.114:0/189296037 learned_addr learned my addr 172.21.15.114:0/189296037 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:50.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.906+0000 7ff1c4c00640 1 --2- 172.21.15.114:0/189296037 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1c0158a70 0x7ff1c014ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:50.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.906+0000 7ff1c6000640 1 --2- 172.21.15.114:0/189296037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1c0159be0 0x7ff1c014f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:50.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.906+0000 7ff1c5600640 1 -- 172.21.15.114:0/189296037 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1c0158a70 msgr2=0x7ff1c014ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:50.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.906+0000 7ff1c5600640 1 --2- 172.21.15.114:0/189296037 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1c0158a70 0x7ff1c014ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.906+0000 7ff1c5600640 1 -- 172.21.15.114:0/189296037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1c0159be0 msgr2=0x7ff1c014f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:50.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.906+0000 7ff1c5600640 1 --2- 172.21.15.114:0/189296037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1c0159be0 0x7ff1c014f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.906+0000 7ff1c5600640 1 -- 172.21.15.114:0/189296037 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ac009420 con 0x7ff1c00713c0 2024-09-13T17:53:50.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.906+0000 7ff1c4c00640 1 --2- 172.21.15.114:0/189296037 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1c0158a70 0x7ff1c014ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:53:50.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.906+0000 7ff1c5600640 1 --2- 172.21.15.114:0/189296037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1c00713c0 0x7ff1c014e840 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400cbf0 tx=0x7ff1b400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:50.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.906+0000 7ff1bd600640 1 -- 172.21.15.114:0/189296037 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b400ad50 con 0x7ff1c00713c0 2024-09-13T17:53:50.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.906+0000 7ff1bd600640 1 -- 172.21.15.114:0/189296037 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b4012400 con 0x7ff1c00713c0 2024-09-13T17:53:50.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.906+0000 7ff1bd600640 1 -- 172.21.15.114:0/189296037 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4012790 con 0x7ff1c00713c0 2024-09-13T17:53:50.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.906+0000 7ff1c8000640 1 -- 172.21.15.114:0/189296037 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c014d9a0 con 0x7ff1c00713c0 2024-09-13T17:53:50.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.906+0000 7ff1c8000640 1 -- 172.21.15.114:0/189296037 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c014ae10 con 0x7ff1c00713c0 2024-09-13T17:53:50.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.910+0000 7ff1c8000640 1 -- 172.21.15.114:0/189296037 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c014b000 con 0x7ff1c00713c0 2024-09-13T17:53:50.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.910+0000 7ff1bd600640 1 -- 172.21.15.114:0/189296037 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff1b4007070 con 0x7ff1c00713c0 2024-09-13T17:53:50.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.910+0000 7ff1bd600640 1 --2- 172.21.15.114:0/189296037 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff1a0066690 0x7ff1a0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:50.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.910+0000 7ff1bd600640 1 -- 172.21.15.114:0/189296037 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7ff1b4084540 con 0x7ff1c00713c0 2024-09-13T17:53:50.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.910+0000 7ff1c4c00640 1 --2- 172.21.15.114:0/189296037 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff1a0066690 0x7ff1a0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:50.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.910+0000 7ff1c4c00640 1 --2- 172.21.15.114:0/189296037 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff1a0066690 0x7ff1a0068b50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0ae000 tx=0x7ff1ac0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:50.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:50.914+0000 7ff1bd600640 1 -- 172.21.15.114:0/189296037 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff1b40515d0 con 0x7ff1c00713c0 2024-09-13T17:53:51.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.102+0000 7ff1c8000640 1 -- 172.21.15.114:0/189296037 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1c00cd780 con 0x7ff1c00713c0 2024-09-13T17:53:51.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.102+0000 7ff1bd600640 1 -- 172.21.15.114:0/189296037 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+5951 (secure 0 0 0) 0x7ff1b4054bf0 con 0x7ff1c00713c0 2024-09-13T17:53:51.109 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:51.109 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/1758700058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1758700058},{"type":"v1","addr":"172.21.15.134:6833","nonce":1758700058}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/4015015784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4015015784},{"type":"v1","addr":"172.21.15.134:6835","nonce":4015015784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2696640153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2696640153},{"type":"v1","addr":"172.21.15.114:6836","nonce":2696640153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:53:08.298484+0000","modified":"2024-09-13T17:53:22.929771+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:53:32.086012+0000","modified":"2024-09-13T17:53:42.428826+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5598":{"gid":5598,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6837/2697286380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2697286380},{"type":"v1","addr":"172.21.15.114:6837","nonce":2697286380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T17:53:51.109 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 28 2024-09-13T17:53:51.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.106+0000 7ff1c8000640 1 -- 172.21.15.114:0/189296037 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff1a0066690 msgr2=0x7ff1a0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:51.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.106+0000 7ff1c8000640 1 --2- 172.21.15.114:0/189296037 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff1a0066690 0x7ff1a0068b50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0ae000 tx=0x7ff1ac0a7000 comp rx=0 tx=0).stop 2024-09-13T17:53:51.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.106+0000 7ff1c8000640 1 -- 172.21.15.114:0/189296037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1c00713c0 msgr2=0x7ff1c014e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:51.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.106+0000 7ff1c8000640 1 --2- 172.21.15.114:0/189296037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1c00713c0 0x7ff1c014e840 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400cbf0 tx=0x7ff1b400a430 comp rx=0 tx=0).stop 2024-09-13T17:53:51.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.106+0000 7ff1c8000640 1 -- 172.21.15.114:0/189296037 shutdown_connections 2024-09-13T17:53:51.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.106+0000 7ff1c8000640 1 --2- 172.21.15.114:0/189296037 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff1a0066690 0x7ff1a0068b50 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:51.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.106+0000 7ff1c8000640 1 --2- 172.21.15.114:0/189296037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1c0159be0 0x7ff1c014f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:51.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.106+0000 7ff1c8000640 1 --2- 172.21.15.114:0/189296037 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff1c0158a70 0x7ff1c014ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:51.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.106+0000 7ff1c8000640 1 --2- 172.21.15.114:0/189296037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1c00713c0 0x7ff1c014e840 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:51.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.106+0000 7ff1c8000640 1 -- 172.21.15.114:0/189296037 >> 172.21.15.114:0/189296037 conn(0x7ff1c00660b0 msgr2=0x7ff1c00b28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:51.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.106+0000 7ff1c8000640 1 -- 172.21.15.114:0/189296037 shutdown_connections 2024-09-13T17:53:51.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.106+0000 7ff1c8000640 1 -- 172.21.15.114:0/189296037 wait complete. 2024-09-13T17:53:51.130 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:53:51.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.258+0000 7f3950800640 1 Processor -- start 2024-09-13T17:53:51.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.258+0000 7f3950800640 1 -- start start 2024-09-13T17:53:51.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.258+0000 7f3950800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3948151420 0x7f39480cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:51.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.258+0000 7f3950800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39480ccba0 0x7f3948070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:51.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.258+0000 7f3950800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3948151800 con 0x7f3948070960 2024-09-13T17:53:51.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.258+0000 7f3950800640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39480cbc30 con 0x7f3948151420 2024-09-13T17:53:51.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.258+0000 7f3950800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3948070d90 con 0x7f39480ccba0 2024-09-13T17:53:51.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.262+0000 7f394d400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39480ccba0 0x7f3948070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:51.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.262+0000 7f394de00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3948151420 0x7f39480cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:51.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.262+0000 7f394d400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39480ccba0 0x7f3948070420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:43204/0 (socket says 172.21.15.114:43204) 2024-09-13T17:53:51.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.262+0000 7f394d400640 1 -- 172.21.15.114:0/1679969370 learned_addr learned my addr 172.21.15.114:0/1679969370 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:51.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.262+0000 7f394de00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3948151420 0x7f39480cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:59156/0 (socket says 172.21.15.114:59156) 2024-09-13T17:53:51.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.262+0000 7f394d400640 1 -- 172.21.15.114:0/1679969370 >> v2:172.21.15.134:3300/0 conn(0x7f3948151420 msgr2=0x7f39480cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:51.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.262+0000 7f394d400640 1 --2- 172.21.15.114:0/1679969370 >> v2:172.21.15.134:3300/0 conn(0x7f3948151420 0x7f39480cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:51.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.262+0000 7f394d400640 1 -- 172.21.15.114:0/1679969370 >> v1:172.21.15.134:6789/0 conn(0x7f3948070960 legacy=0x7f394815df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:51.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.262+0000 7f394d400640 1 -- 172.21.15.114:0/1679969370 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39480cafb0 con 0x7f39480ccba0 2024-09-13T17:53:51.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.262+0000 7f394d400640 1 --2- 172.21.15.114:0/1679969370 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39480ccba0 0x7f3948070420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3938009870 tx=0x7f393801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b45e4d5064d550f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:51.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.262+0000 7f394ca00640 1 -- 172.21.15.114:0/1679969370 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39380ab610 con 0x7f39480ccba0 2024-09-13T17:53:51.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.266+0000 7f394ca00640 1 -- 172.21.15.114:0/1679969370 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39380ab770 con 0x7f39480ccba0 2024-09-13T17:53:51.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.266+0000 7f394ca00640 1 -- 172.21.15.114:0/1679969370 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39380abb00 con 0x7f39480ccba0 2024-09-13T17:53:51.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.266+0000 7f3950800640 1 -- 172.21.15.114:0/1679969370 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39480ccba0 msgr2=0x7f3948070420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:51.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.266+0000 7f3950800640 1 --2- 172.21.15.114:0/1679969370 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39480ccba0 0x7f3948070420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3938009870 tx=0x7f393801c410 comp rx=0 tx=0).stop 2024-09-13T17:53:51.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.266+0000 7f3950800640 1 -- 172.21.15.114:0/1679969370 shutdown_connections 2024-09-13T17:53:51.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.266+0000 7f3950800640 1 --2- 172.21.15.114:0/1679969370 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39480ccba0 0x7f3948070420 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:51.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.266+0000 7f3950800640 1 --2- 172.21.15.114:0/1679969370 >> v2:172.21.15.134:3300/0 conn(0x7f3948151420 0x7f39480cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:51.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.266+0000 7f3950800640 1 -- 172.21.15.114:0/1679969370 >> 172.21.15.114:0/1679969370 conn(0x7f39480660b0 msgr2=0x7f3948069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:51.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.266+0000 7f3950800640 1 -- 172.21.15.114:0/1679969370 shutdown_connections 2024-09-13T17:53:51.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.266+0000 7f3950800640 1 -- 172.21.15.114:0/1679969370 wait complete. 2024-09-13T17:53:51.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.266+0000 7f3950800640 1 Processor -- start 2024-09-13T17:53:51.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.266+0000 7f3950800640 1 -- start start 2024-09-13T17:53:51.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.266+0000 7f3950800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3948070960 0x7f39481f5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:51.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.266+0000 7f3950800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39480ccba0 0x7f394814cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:51.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.266+0000 7f3950800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3948151420 0x7f394814d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:51.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.266+0000 7f3950800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39481f32b0 con 0x7f3948070960 2024-09-13T17:53:51.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.266+0000 7f3950800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39481f3590 con 0x7f3948151420 2024-09-13T17:53:51.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.266+0000 7f3950800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39481f3870 con 0x7f39480ccba0 2024-09-13T17:53:51.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.266+0000 7f394de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3948070960 0x7f39481f5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:51.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.266+0000 7f394de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3948070960 0x7f39481f5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48470/0 (socket says 172.21.15.114:48470) 2024-09-13T17:53:51.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.266+0000 7f394de00640 1 -- 172.21.15.114:0/1733877736 learned_addr learned my addr 172.21.15.114:0/1733877736 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:51.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.266+0000 7f394e800640 1 --2- 172.21.15.114:0/1733877736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3948151420 0x7f394814d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:51.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.266+0000 7f394d400640 1 --2- 172.21.15.114:0/1733877736 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39480ccba0 0x7f394814cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:51.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.270+0000 7f394de00640 1 -- 172.21.15.114:0/1733877736 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39480ccba0 msgr2=0x7f394814cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:51.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.270+0000 7f394de00640 1 --2- 172.21.15.114:0/1733877736 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39480ccba0 0x7f394814cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:51.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.270+0000 7f394de00640 1 -- 172.21.15.114:0/1733877736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3948151420 msgr2=0x7f394814d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:51.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.270+0000 7f394de00640 1 --2- 172.21.15.114:0/1733877736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3948151420 0x7f394814d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:51.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.270+0000 7f394de00640 1 -- 172.21.15.114:0/1733877736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39380094d0 con 0x7f3948070960 2024-09-13T17:53:51.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.270+0000 7f394de00640 1 --2- 172.21.15.114:0/1733877736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3948070960 0x7f39481f5d70 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f393c00e870 tx=0x7f393c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:51.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.270+0000 7f3942000640 1 -- 172.21.15.114:0/1733877736 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c009510 con 0x7f3948070960 2024-09-13T17:53:51.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.270+0000 7f3942000640 1 -- 172.21.15.114:0/1733877736 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393c00eec0 con 0x7f3948070960 2024-09-13T17:53:51.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.270+0000 7f3942000640 1 -- 172.21.15.114:0/1733877736 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c00cb40 con 0x7f3948070960 2024-09-13T17:53:51.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.270+0000 7f3950800640 1 -- 172.21.15.114:0/1733877736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39481f3b50 con 0x7f3948070960 2024-09-13T17:53:51.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.270+0000 7f3950800640 1 -- 172.21.15.114:0/1733877736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39481f62b0 con 0x7f3948070960 2024-09-13T17:53:51.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.270+0000 7f3950800640 1 -- 172.21.15.114:0/1733877736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3948070400 con 0x7f3948070960 2024-09-13T17:53:51.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.270+0000 7f3942000640 1 -- 172.21.15.114:0/1733877736 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f393c00cca0 con 0x7f3948070960 2024-09-13T17:53:51.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.270+0000 7f3942000640 1 --2- 172.21.15.114:0/1733877736 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f392c0666c0 0x7f392c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:51.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.270+0000 7f3942000640 1 -- 172.21.15.114:0/1733877736 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f393c084540 con 0x7f3948070960 2024-09-13T17:53:51.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.270+0000 7f394d400640 1 --2- 172.21.15.114:0/1733877736 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f392c0666c0 0x7f392c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:51.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.274+0000 7f394d400640 1 --2- 172.21.15.114:0/1733877736 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f392c0666c0 0x7f392c068b80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f39380af000 tx=0x7f39380b6040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:51.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.274+0000 7f3942000640 1 -- 172.21.15.114:0/1733877736 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f393c0515e0 con 0x7f3948070960 2024-09-13T17:53:51.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.430+0000 7f3950800640 1 -- 172.21.15.114:0/1733877736 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f394815b730 con 0x7f3948070960 2024-09-13T17:53:51.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.430+0000 7f3942000640 1 -- 172.21.15.114:0/1733877736 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+18795 (secure 0 0 0) 0x7f393c054c00 con 0x7f3948070960 2024-09-13T17:53:51.437 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:51.437 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":48,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:53:33.088316+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:53:06.185439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:53:07.297633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2024-09-13T17:53:31.026998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.35","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6835/1239035445":"2024-09-14T17:53:22.929223+0000","172.21.15.134:6833/1239035445":"2024-09-14T17:53:22.929223+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:53:51.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.434+0000 7f3950800640 1 -- 172.21.15.114:0/1733877736 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f392c0666c0 msgr2=0x7f392c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:51.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.434+0000 7f3950800640 1 --2- 172.21.15.114:0/1733877736 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f392c0666c0 0x7f392c068b80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f39380af000 tx=0x7f39380b6040 comp rx=0 tx=0).stop 2024-09-13T17:53:51.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.434+0000 7f3950800640 1 -- 172.21.15.114:0/1733877736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3948070960 msgr2=0x7f39481f5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:51.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.434+0000 7f3950800640 1 --2- 172.21.15.114:0/1733877736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3948070960 0x7f39481f5d70 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f393c00e870 tx=0x7f393c00ec70 comp rx=0 tx=0).stop 2024-09-13T17:53:51.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.434+0000 7f3950800640 1 -- 172.21.15.114:0/1733877736 shutdown_connections 2024-09-13T17:53:51.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.434+0000 7f3950800640 1 --2- 172.21.15.114:0/1733877736 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f392c0666c0 0x7f392c068b80 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:51.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.434+0000 7f3950800640 1 --2- 172.21.15.114:0/1733877736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3948151420 0x7f394814d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:51.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.434+0000 7f3950800640 1 --2- 172.21.15.114:0/1733877736 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f39480ccba0 0x7f394814cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:51.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.434+0000 7f3950800640 1 --2- 172.21.15.114:0/1733877736 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3948070960 0x7f39481f5d70 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:51.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.434+0000 7f3950800640 1 -- 172.21.15.114:0/1733877736 >> 172.21.15.114:0/1733877736 conn(0x7f39480660b0 msgr2=0x7f39480b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:51.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.434+0000 7f3950800640 1 -- 172.21.15.114:0/1733877736 shutdown_connections 2024-09-13T17:53:51.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.434+0000 7f3950800640 1 -- 172.21.15.114:0/1733877736 wait complete. 2024-09-13T17:53:51.458 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T17:53:51.459 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:53:51.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.586+0000 7ff49f600640 1 Processor -- start 2024-09-13T17:53:51.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.586+0000 7ff49f600640 1 -- start start 2024-09-13T17:53:51.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.590+0000 7ff49f600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff49806dc60 0x7ff4980cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:51.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.590+0000 7ff49f600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4980cd220 con 0x7ff49813f420 2024-09-13T17:53:51.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.590+0000 7ff49f600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49815a740 con 0x7ff49813c240 2024-09-13T17:53:51.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.590+0000 7ff49f600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff498159bc0 con 0x7ff49806dc60 2024-09-13T17:53:51.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.590+0000 7ff48fe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff49813f420 0x7ff49806d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56824/0 (socket says 172.21.15.114:56824) 2024-09-13T17:53:51.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.590+0000 7ff48fe00640 1 -- 172.21.15.114:0/2945738182 learned_addr learned my addr 172.21.15.114:0/2945738182 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:51.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.590+0000 7ff49d600640 1 --2- 172.21.15.114:0/2945738182 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff49806dc60 0x7ff4980cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:51.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.590+0000 7ff497e00640 1 -- 172.21.15.114:0/2945738182 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063331161 0 0) 0x7ff4980cd220 con 0x7ff49813f420 2024-09-13T17:53:51.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.590+0000 7ff497e00640 1 -- 172.21.15.114:0/2945738182 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff47c003530 con 0x7ff49813f420 2024-09-13T17:53:51.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.590+0000 7ff497e00640 1 -- 172.21.15.114:0/2945738182 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776235192 0 0) 0x7ff49815a740 con 0x7ff49813c240 2024-09-13T17:53:51.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.590+0000 7ff49d600640 1 -- 172.21.15.114:0/2945738182 >> v1:172.21.15.134:6789/0 conn(0x7ff49813c240 legacy=0x7ff49813c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:51.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.590+0000 7ff49d600640 1 -- 172.21.15.114:0/2945738182 >> v1:172.21.15.114:6789/0 conn(0x7ff49813f420 legacy=0x7ff49806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:51.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.590+0000 7ff49d600640 1 -- 172.21.15.114:0/2945738182 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff498159ea0 con 0x7ff49806dc60 2024-09-13T17:53:51.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.594+0000 7ff49d600640 1 --2- 172.21.15.114:0/2945738182 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff49806dc60 0x7ff4980cd650 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff490009dc0 tx=0x7ff49001c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c719156563428b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:51.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.594+0000 7ff497e00640 1 -- 172.21.15.114:0/2945738182 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4900a5a20 con 0x7ff49806dc60 2024-09-13T17:53:51.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.594+0000 7ff497e00640 1 -- 172.21.15.114:0/2945738182 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4900a5b80 con 0x7ff49806dc60 2024-09-13T17:53:51.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.594+0000 7ff497e00640 1 -- 172.21.15.114:0/2945738182 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4900ad440 con 0x7ff49806dc60 2024-09-13T17:53:51.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.594+0000 7ff49f600640 1 -- 172.21.15.114:0/2945738182 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff49806dc60 msgr2=0x7ff4980cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:51.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.594+0000 7ff49f600640 1 --2- 172.21.15.114:0/2945738182 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff49806dc60 0x7ff4980cd650 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff490009dc0 tx=0x7ff49001c960 comp rx=0 tx=0).stop 2024-09-13T17:53:51.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.594+0000 7ff49f600640 1 -- 172.21.15.114:0/2945738182 shutdown_connections 2024-09-13T17:53:51.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.594+0000 7ff49f600640 1 --2- 172.21.15.114:0/2945738182 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff49806dc60 0x7ff4980cd650 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:51.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.594+0000 7ff49f600640 1 -- 172.21.15.114:0/2945738182 >> 172.21.15.114:0/2945738182 conn(0x7ff4980660b0 msgr2=0x7ff498069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:51.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.594+0000 7ff49f600640 1 -- 172.21.15.114:0/2945738182 shutdown_connections 2024-09-13T17:53:51.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.594+0000 7ff49f600640 1 -- 172.21.15.114:0/2945738182 wait complete. 2024-09-13T17:53:51.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.594+0000 7ff49f600640 1 Processor -- start 2024-09-13T17:53:51.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.594+0000 7ff49f600640 1 -- start start 2024-09-13T17:53:51.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.598+0000 7ff49f600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff49806dc60 0x7ff4980afb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:51.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.598+0000 7ff49f600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff49813c240 0x7ff498138d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:51.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.598+0000 7ff49f600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff49813f420 0x7ff498153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:51.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.598+0000 7ff49f600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4980b0360 con 0x7ff49806dc60 2024-09-13T17:53:51.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.598+0000 7ff49f600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4980b0640 con 0x7ff49813f420 2024-09-13T17:53:51.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.598+0000 7ff49f600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4980b0920 con 0x7ff49813c240 2024-09-13T17:53:51.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.598+0000 7ff49cc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff49806dc60 0x7ff4980afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:51.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.598+0000 7ff49cc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff49806dc60 0x7ff4980afb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48486/0 (socket says 172.21.15.114:48486) 2024-09-13T17:53:51.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.598+0000 7ff49cc00640 1 -- 172.21.15.114:0/4090836995 learned_addr learned my addr 172.21.15.114:0/4090836995 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:51.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.598+0000 7ff48fe00640 1 --2- 172.21.15.114:0/4090836995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff49813c240 0x7ff498138d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:51.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.598+0000 7ff49d600640 1 --2- 172.21.15.114:0/4090836995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff49813f420 0x7ff498153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:51.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.598+0000 7ff49cc00640 1 -- 172.21.15.114:0/4090836995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff49813c240 msgr2=0x7ff498138d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:51.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.598+0000 7ff49cc00640 1 --2- 172.21.15.114:0/4090836995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff49813c240 0x7ff498138d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:51.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.598+0000 7ff49cc00640 1 -- 172.21.15.114:0/4090836995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff49813f420 msgr2=0x7ff498153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:51.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.598+0000 7ff49cc00640 1 --2- 172.21.15.114:0/4090836995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff49813f420 0x7ff498153a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:51.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.598+0000 7ff49cc00640 1 -- 172.21.15.114:0/4090836995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff490009a70 con 0x7ff49806dc60 2024-09-13T17:53:51.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.598+0000 7ff49d600640 1 --2- 172.21.15.114:0/4090836995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff49813f420 0x7ff498153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:51.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.598+0000 7ff49cc00640 1 --2- 172.21.15.114:0/4090836995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff49806dc60 0x7ff4980afb10 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff488001ec0 tx=0x7ff48800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:51.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.598+0000 7ff495600640 1 -- 172.21.15.114:0/4090836995 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4880054e0 con 0x7ff49806dc60 2024-09-13T17:53:51.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.598+0000 7ff495600640 1 -- 172.21.15.114:0/4090836995 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff488003600 con 0x7ff49806dc60 2024-09-13T17:53:51.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.598+0000 7ff495600640 1 -- 172.21.15.114:0/4090836995 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4880039b0 con 0x7ff49806dc60 2024-09-13T17:53:51.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.598+0000 7ff49f600640 1 -- 172.21.15.114:0/4090836995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4980abfd0 con 0x7ff49806dc60 2024-09-13T17:53:51.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.598+0000 7ff49f600640 1 -- 172.21.15.114:0/4090836995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4981392b0 con 0x7ff49806dc60 2024-09-13T17:53:51.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.598+0000 7ff49f600640 1 -- 172.21.15.114:0/4090836995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4980abe30 con 0x7ff49806dc60 2024-09-13T17:53:51.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.598+0000 7ff495600640 1 -- 172.21.15.114:0/4090836995 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff488003b10 con 0x7ff49806dc60 2024-09-13T17:53:51.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.602+0000 7ff495600640 1 --2- 172.21.15.114:0/4090836995 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff4740666c0 0x7ff474068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:51.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.602+0000 7ff495600640 1 -- 172.21.15.114:0/4090836995 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7ff488083ac0 con 0x7ff49806dc60 2024-09-13T17:53:51.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.602+0000 7ff48fe00640 1 --2- 172.21.15.114:0/4090836995 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff4740666c0 0x7ff474068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:51.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.602+0000 7ff48fe00640 1 --2- 172.21.15.114:0/4090836995 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff4740666c0 0x7ff474068b80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff4980ae0a0 tx=0x7ff480009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:51.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.606+0000 7ff495600640 1 -- 172.21.15.114:0/4090836995 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff4980abe30 con 0x7ff49806dc60 2024-09-13T17:53:51.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.790+0000 7ff49f600640 1 -- 172.21.15.114:0/4090836995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4980abe30 con 0x7ff49806dc60 2024-09-13T17:53:51.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.790+0000 7ff495600640 1 -- 172.21.15.114:0/4090836995 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+5951 (secure 0 0 0) 0x7ff4980abe30 con 0x7ff49806dc60 2024-09-13T17:53:51.796 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:51.796 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/1758700058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1758700058},{"type":"v1","addr":"172.21.15.134:6833","nonce":1758700058}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/4015015784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4015015784},{"type":"v1","addr":"172.21.15.134:6835","nonce":4015015784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2696640153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2696640153},{"type":"v1","addr":"172.21.15.114:6836","nonce":2696640153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:53:08.298484+0000","modified":"2024-09-13T17:53:22.929771+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:53:32.086012+0000","modified":"2024-09-13T17:53:42.428826+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5598":{"gid":5598,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6837/2697286380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2697286380},{"type":"v1","addr":"172.21.15.114:6837","nonce":2697286380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T17:53:51.797 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 28 2024-09-13T17:53:51.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.790+0000 7ff49f600640 1 -- 172.21.15.114:0/4090836995 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff4740666c0 msgr2=0x7ff474068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:51.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.790+0000 7ff49f600640 1 --2- 172.21.15.114:0/4090836995 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff4740666c0 0x7ff474068b80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff4980ae0a0 tx=0x7ff480009040 comp rx=0 tx=0).stop 2024-09-13T17:53:51.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.790+0000 7ff49f600640 1 -- 172.21.15.114:0/4090836995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff49806dc60 msgr2=0x7ff4980afb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:51.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.790+0000 7ff49f600640 1 --2- 172.21.15.114:0/4090836995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff49806dc60 0x7ff4980afb10 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff488001ec0 tx=0x7ff48800c8e0 comp rx=0 tx=0).stop 2024-09-13T17:53:51.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.794+0000 7ff49f600640 1 -- 172.21.15.114:0/4090836995 shutdown_connections 2024-09-13T17:53:51.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.794+0000 7ff49f600640 1 --2- 172.21.15.114:0/4090836995 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff4740666c0 0x7ff474068b80 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:51.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.794+0000 7ff49f600640 1 --2- 172.21.15.114:0/4090836995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff49813f420 0x7ff498153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:51.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.794+0000 7ff49f600640 1 --2- 172.21.15.114:0/4090836995 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff49813c240 0x7ff498138d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:51.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.794+0000 7ff49f600640 1 --2- 172.21.15.114:0/4090836995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff49806dc60 0x7ff4980afb10 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:51.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.794+0000 7ff49f600640 1 -- 172.21.15.114:0/4090836995 >> 172.21.15.114:0/4090836995 conn(0x7ff4980660b0 msgr2=0x7ff49806c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:51.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.794+0000 7ff49f600640 1 -- 172.21.15.114:0/4090836995 shutdown_connections 2024-09-13T17:53:51.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.794+0000 7ff49f600640 1 -- 172.21.15.114:0/4090836995 wait complete. 2024-09-13T17:53:51.817 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:53:51.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.946+0000 7f12f6a00640 1 Processor -- start 2024-09-13T17:53:51.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.946+0000 7f12f6a00640 1 -- start start 2024-09-13T17:53:51.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.946+0000 7f12f6a00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f12f013c240 0x7f12f013f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:51.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.946+0000 7f12f6a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f12f013c980 0x7f12f006d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:51.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.946+0000 7f12f6a00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f00cd220 con 0x7f12f006da90 2024-09-13T17:53:51.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.946+0000 7f12f6a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f006df40 con 0x7f12f013c980 2024-09-13T17:53:51.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.946+0000 7f12f6a00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f013f960 con 0x7f12f013c240 2024-09-13T17:53:51.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.950+0000 7f12ef400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f12f013c980 0x7f12f006d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:51.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.950+0000 7f12ef400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f12f013c980 0x7f12f006d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48488/0 (socket says 172.21.15.114:48488) 2024-09-13T17:53:51.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.950+0000 7f12ef400640 1 -- 172.21.15.114:0/1030235508 learned_addr learned my addr 172.21.15.114:0/1030235508 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:51.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.950+0000 7f12efe00640 1 --2- 172.21.15.114:0/1030235508 >> v2:172.21.15.134:3300/0 conn(0x7f12f013c240 0x7f12f013f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:51.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.950+0000 7f12ef400640 1 -- 172.21.15.114:0/1030235508 >> v2:172.21.15.134:3300/0 conn(0x7f12f013c240 msgr2=0x7f12f013f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:51.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.950+0000 7f12ef400640 1 --2- 172.21.15.114:0/1030235508 >> v2:172.21.15.134:3300/0 conn(0x7f12f013c240 0x7f12f013f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:51.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.950+0000 7f12ef400640 1 -- 172.21.15.114:0/1030235508 >> v1:172.21.15.134:6789/0 conn(0x7f12f006da90 legacy=0x7f12f00cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:51.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.950+0000 7f12ef400640 1 -- 172.21.15.114:0/1030235508 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f015a740 con 0x7f12f013c980 2024-09-13T17:53:51.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.950+0000 7f12ef400640 1 --2- 172.21.15.114:0/1030235508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12f013c980 0x7f12f006d550 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f12f006e720 tx=0x7f12dc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c2c6ca4e0a7db0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:51.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.950+0000 7f12eea00640 1 -- 172.21.15.114:0/1030235508 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc0aa650 con 0x7f12f013c980 2024-09-13T17:53:51.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.950+0000 7f12eea00640 1 -- 172.21.15.114:0/1030235508 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12dc0aa7b0 con 0x7f12f013c980 2024-09-13T17:53:51.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.950+0000 7f12eea00640 1 -- 172.21.15.114:0/1030235508 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc0aab40 con 0x7f12f013c980 2024-09-13T17:53:51.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.954+0000 7f12f6a00640 1 -- 172.21.15.114:0/1030235508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12f013c980 msgr2=0x7f12f006d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:51.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.954+0000 7f12f6a00640 1 --2- 172.21.15.114:0/1030235508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12f013c980 0x7f12f006d550 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f12f006e720 tx=0x7f12dc01c4f0 comp rx=0 tx=0).stop 2024-09-13T17:53:51.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.954+0000 7f12f6a00640 1 -- 172.21.15.114:0/1030235508 shutdown_connections 2024-09-13T17:53:51.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.954+0000 7f12f6a00640 1 --2- 172.21.15.114:0/1030235508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12f013c980 0x7f12f006d550 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:51.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.954+0000 7f12f6a00640 1 --2- 172.21.15.114:0/1030235508 >> v2:172.21.15.134:3300/0 conn(0x7f12f013c240 0x7f12f013f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:51.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.954+0000 7f12f6a00640 1 -- 172.21.15.114:0/1030235508 >> 172.21.15.114:0/1030235508 conn(0x7f12f00660b0 msgr2=0x7f12f0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:51.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.954+0000 7f12f6a00640 1 -- 172.21.15.114:0/1030235508 shutdown_connections 2024-09-13T17:53:51.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.954+0000 7f12f6a00640 1 -- 172.21.15.114:0/1030235508 wait complete. 2024-09-13T17:53:51.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.954+0000 7f12f6a00640 1 Processor -- start 2024-09-13T17:53:51.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.954+0000 7f12f6a00640 1 -- start start 2024-09-13T17:53:51.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.954+0000 7f12f6a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12f006da90 0x7f12f0139d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:51.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.954+0000 7f12f6a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12f013c240 0x7f12f0151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:51.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.954+0000 7f12f6a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12f013c980 0x7f12f013e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:51.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.954+0000 7f12f6a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f014ff30 con 0x7f12f013c240 2024-09-13T17:53:51.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.954+0000 7f12f6a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f014f970 con 0x7f12f013c980 2024-09-13T17:53:51.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.954+0000 7f12f6a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f014fc50 con 0x7f12f006da90 2024-09-13T17:53:51.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.954+0000 7f12ef400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12f013c240 0x7f12f0151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:51.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.954+0000 7f12ef400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12f013c240 0x7f12f0151b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48494/0 (socket says 172.21.15.114:48494) 2024-09-13T17:53:51.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.954+0000 7f12ef400640 1 -- 172.21.15.114:0/865544394 learned_addr learned my addr 172.21.15.114:0/865544394 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:51.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.954+0000 7f12f4a00640 1 --2- 172.21.15.114:0/865544394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12f013c980 0x7f12f013e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:51.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.954+0000 7f12efe00640 1 --2- 172.21.15.114:0/865544394 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12f006da90 0x7f12f0139d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:51.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.954+0000 7f12ef400640 1 -- 172.21.15.114:0/865544394 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12f006da90 msgr2=0x7f12f0139d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:51.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.954+0000 7f12ef400640 1 --2- 172.21.15.114:0/865544394 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12f006da90 0x7f12f0139d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:51.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.954+0000 7f12ef400640 1 -- 172.21.15.114:0/865544394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12f013c980 msgr2=0x7f12f013e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:51.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.954+0000 7f12ef400640 1 --2- 172.21.15.114:0/865544394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12f013c980 0x7f12f013e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:51.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.954+0000 7f12ef400640 1 -- 172.21.15.114:0/865544394 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc0094d0 con 0x7f12f013c240 2024-09-13T17:53:51.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.954+0000 7f12ef400640 1 --2- 172.21.15.114:0/865544394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12f013c240 0x7f12f0151b20 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f12dc019100 tx=0x7f12dc01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:51.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.958+0000 7f12e7e00640 1 -- 172.21.15.114:0/865544394 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc0b3800 con 0x7f12f013c240 2024-09-13T17:53:51.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.958+0000 7f12e7e00640 1 -- 172.21.15.114:0/865544394 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12dc0b3980 con 0x7f12f013c240 2024-09-13T17:53:51.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.958+0000 7f12f6a00640 1 -- 172.21.15.114:0/865544394 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f0151320 con 0x7f12f013c240 2024-09-13T17:53:51.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.958+0000 7f12e7e00640 1 -- 172.21.15.114:0/865544394 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc0b3d30 con 0x7f12f013c240 2024-09-13T17:53:51.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.958+0000 7f12f6a00640 1 -- 172.21.15.114:0/865544394 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f013a280 con 0x7f12f013c240 2024-09-13T17:53:51.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.958+0000 7f12f6a00640 1 -- 172.21.15.114:0/865544394 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f0151840 con 0x7f12f013c240 2024-09-13T17:53:51.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.958+0000 7f12e7e00640 1 -- 172.21.15.114:0/865544394 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f12dc0b2380 con 0x7f12f013c240 2024-09-13T17:53:51.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.958+0000 7f12e7e00640 1 --2- 172.21.15.114:0/865544394 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f12d00666c0 0x7f12d0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:51.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.958+0000 7f12e7e00640 1 -- 172.21.15.114:0/865544394 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f12dc11e390 con 0x7f12f013c240 2024-09-13T17:53:51.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.958+0000 7f12efe00640 1 --2- 172.21.15.114:0/865544394 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f12d00666c0 0x7f12d0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:51.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.958+0000 7f12efe00640 1 --2- 172.21.15.114:0/865544394 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f12d00666c0 0x7f12d0068b80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f12e000b9d0 tx=0x7f12e0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:51.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:51.962+0000 7f12e7e00640 1 -- 172.21.15.114:0/865544394 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f12f0151840 con 0x7f12f013c240 2024-09-13T17:53:52.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.150+0000 7f12f6a00640 1 -- 172.21.15.114:0/865544394 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12f0151840 con 0x7f12f013c240 2024-09-13T17:53:52.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.150+0000 7f12e7e00640 1 -- 172.21.15.114:0/865544394 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+5951 (secure 0 0 0) 0x7f12f0151840 con 0x7f12f013c240 2024-09-13T17:53:52.155 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:52.155 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/1758700058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1758700058},{"type":"v1","addr":"172.21.15.134:6833","nonce":1758700058}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/4015015784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4015015784},{"type":"v1","addr":"172.21.15.134:6835","nonce":4015015784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2696640153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2696640153},{"type":"v1","addr":"172.21.15.114:6836","nonce":2696640153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:53:08.298484+0000","modified":"2024-09-13T17:53:22.929771+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:53:32.086012+0000","modified":"2024-09-13T17:53:42.428826+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5598":{"gid":5598,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6837/2697286380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2697286380},{"type":"v1","addr":"172.21.15.114:6837","nonce":2697286380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T17:53:52.155 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 28 2024-09-13T17:53:52.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.150+0000 7f12f6a00640 1 -- 172.21.15.114:0/865544394 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f12d00666c0 msgr2=0x7f12d0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:52.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.150+0000 7f12f6a00640 1 --2- 172.21.15.114:0/865544394 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f12d00666c0 0x7f12d0068b80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f12e000b9d0 tx=0x7f12e0008040 comp rx=0 tx=0).stop 2024-09-13T17:53:52.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.150+0000 7f12f6a00640 1 -- 172.21.15.114:0/865544394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12f013c240 msgr2=0x7f12f0151b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:52.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.150+0000 7f12f6a00640 1 --2- 172.21.15.114:0/865544394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12f013c240 0x7f12f0151b20 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f12dc019100 tx=0x7f12dc01ad30 comp rx=0 tx=0).stop 2024-09-13T17:53:52.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.150+0000 7f12f6a00640 1 -- 172.21.15.114:0/865544394 shutdown_connections 2024-09-13T17:53:52.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.150+0000 7f12f6a00640 1 --2- 172.21.15.114:0/865544394 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f12d00666c0 0x7f12d0068b80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:52.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.150+0000 7f12f6a00640 1 --2- 172.21.15.114:0/865544394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12f013c980 0x7f12f013e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:52.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.150+0000 7f12f6a00640 1 --2- 172.21.15.114:0/865544394 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12f013c240 0x7f12f0151b20 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:52.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.150+0000 7f12f6a00640 1 --2- 172.21.15.114:0/865544394 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f12f006da90 0x7f12f0139d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:52.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.150+0000 7f12f6a00640 1 -- 172.21.15.114:0/865544394 >> 172.21.15.114:0/865544394 conn(0x7f12f00660b0 msgr2=0x7f12f01575b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:52.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.150+0000 7f12f6a00640 1 -- 172.21.15.114:0/865544394 shutdown_connections 2024-09-13T17:53:52.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.150+0000 7f12f6a00640 1 -- 172.21.15.114:0/865544394 wait complete. 2024-09-13T17:53:52.176 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:53:52.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.306+0000 7f3a7bc00640 1 Processor -- start 2024-09-13T17:53:52.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.306+0000 7f3a7bc00640 1 -- start start 2024-09-13T17:53:52.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.306+0000 7f3a7bc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a7413f420 0x7f3a7406d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:52.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.306+0000 7f3a7bc00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3a7406da90 0x7f3a740cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:52.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.306+0000 7f3a7bc00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a740cd220 con 0x7f3a7413c240 2024-09-13T17:53:52.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.306+0000 7f3a7bc00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7406ded0 con 0x7f3a7406da90 2024-09-13T17:53:52.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.306+0000 7f3a7bc00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7415a740 con 0x7f3a7413f420 2024-09-13T17:53:52.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.306+0000 7f3a6be00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a7413f420 0x7f3a7406d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:52.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.306+0000 7f3a79c00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3a7406da90 0x7f3a740cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:52.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.306+0000 7f3a79c00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3a7406da90 0x7f3a740cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:59196/0 (socket says 172.21.15.114:59196) 2024-09-13T17:53:52.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.306+0000 7f3a79c00640 1 -- 172.21.15.114:0/3829105985 learned_addr learned my addr 172.21.15.114:0/3829105985 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:52.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.306+0000 7f3a6be00640 1 -- 172.21.15.114:0/3829105985 >> v2:172.21.15.134:3300/0 conn(0x7f3a7406da90 msgr2=0x7f3a740cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:52.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.306+0000 7f3a6be00640 1 --2- 172.21.15.114:0/3829105985 >> v2:172.21.15.134:3300/0 conn(0x7f3a7406da90 0x7f3a740cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:52.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.306+0000 7f3a6be00640 1 -- 172.21.15.114:0/3829105985 >> v1:172.21.15.134:6789/0 conn(0x7f3a7413c240 legacy=0x7f3a7413c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:52.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.306+0000 7f3a6be00640 1 -- 172.21.15.114:0/3829105985 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a74159bc0 con 0x7f3a7413f420 2024-09-13T17:53:52.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.306+0000 7f3a73e00640 1 -- 172.21.15.114:0/3829105985 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843591763 0 0) 0x7f3a740cd220 con 0x7f3a7413c240 2024-09-13T17:53:52.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.306+0000 7f3a79c00640 1 --2- 172.21.15.114:0/3829105985 >> v2:172.21.15.134:3300/0 conn(0x7f3a7406da90 0x7f3a740cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:53:52.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.310+0000 7f3a6be00640 1 --2- 172.21.15.114:0/3829105985 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a7413f420 0x7f3a7406d550 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0097c0 tx=0x7f3a5c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dedbe7c2f34e0f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:52.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.310+0000 7f3a73e00640 1 -- 172.21.15.114:0/3829105985 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0ab670 con 0x7f3a7413f420 2024-09-13T17:53:52.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.310+0000 7f3a73e00640 1 -- 172.21.15.114:0/3829105985 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c0ab7d0 con 0x7f3a7413f420 2024-09-13T17:53:52.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.310+0000 7f3a73e00640 1 -- 172.21.15.114:0/3829105985 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0abb60 con 0x7f3a7413f420 2024-09-13T17:53:52.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.310+0000 7f3a7bc00640 1 -- 172.21.15.114:0/3829105985 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a7413f420 msgr2=0x7f3a7406d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:52.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.310+0000 7f3a7bc00640 1 --2- 172.21.15.114:0/3829105985 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a7413f420 0x7f3a7406d550 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0097c0 tx=0x7f3a5c01c470 comp rx=0 tx=0).stop 2024-09-13T17:53:52.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.310+0000 7f3a7bc00640 1 -- 172.21.15.114:0/3829105985 shutdown_connections 2024-09-13T17:53:52.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.310+0000 7f3a7bc00640 1 --2- 172.21.15.114:0/3829105985 >> v2:172.21.15.134:3300/0 conn(0x7f3a7406da90 0x7f3a740cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:52.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.310+0000 7f3a7bc00640 1 --2- 172.21.15.114:0/3829105985 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a7413f420 0x7f3a7406d550 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:52.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.310+0000 7f3a7bc00640 1 -- 172.21.15.114:0/3829105985 >> 172.21.15.114:0/3829105985 conn(0x7f3a740660b0 msgr2=0x7f3a74069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:52.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.310+0000 7f3a7bc00640 1 -- 172.21.15.114:0/3829105985 shutdown_connections 2024-09-13T17:53:52.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.310+0000 7f3a7bc00640 1 -- 172.21.15.114:0/3829105985 wait complete. 2024-09-13T17:53:52.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.314+0000 7f3a7bc00640 1 Processor -- start 2024-09-13T17:53:52.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.314+0000 7f3a7bc00640 1 -- start start 2024-09-13T17:53:52.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.314+0000 7f3a7bc00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a7406da90 0x7f3a7412aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:52.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.314+0000 7f3a7bc00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a7413c240 0x7f3a74138c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:52.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.314+0000 7f3a7bc00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a7413f420 0x7f3a7413e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:52.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.314+0000 7f3a7bc00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a741540c0 con 0x7f3a7413c240 2024-09-13T17:53:52.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.314+0000 7f3a7bc00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a74153d70 con 0x7f3a7406da90 2024-09-13T17:53:52.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.314+0000 7f3a7bc00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7412afa0 con 0x7f3a7413f420 2024-09-13T17:53:52.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.314+0000 7f3a6be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a7413c240 0x7f3a74138c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:52.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.314+0000 7f3a6be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a7413c240 0x7f3a74138c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48508/0 (socket says 172.21.15.114:48508) 2024-09-13T17:53:52.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.314+0000 7f3a6be00640 1 -- 172.21.15.114:0/2631994223 learned_addr learned my addr 172.21.15.114:0/2631994223 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:52.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.314+0000 7f3a79200640 1 --2- 172.21.15.114:0/2631994223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a7406da90 0x7f3a7412aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:52.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.314+0000 7f3a79c00640 1 --2- 172.21.15.114:0/2631994223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a7413f420 0x7f3a7413e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:52.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.314+0000 7f3a6be00640 1 -- 172.21.15.114:0/2631994223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a7413f420 msgr2=0x7f3a7413e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:52.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.314+0000 7f3a6be00640 1 --2- 172.21.15.114:0/2631994223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a7413f420 0x7f3a7413e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:52.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.314+0000 7f3a6be00640 1 -- 172.21.15.114:0/2631994223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a7406da90 msgr2=0x7f3a7412aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:52.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.314+0000 7f3a6be00640 1 --2- 172.21.15.114:0/2631994223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a7406da90 0x7f3a7412aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:52.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.314+0000 7f3a6be00640 1 -- 172.21.15.114:0/2631994223 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a6c009b30 con 0x7f3a7413c240 2024-09-13T17:53:52.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.314+0000 7f3a79c00640 1 --2- 172.21.15.114:0/2631994223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a7413f420 0x7f3a7413e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:52.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.314+0000 7f3a6be00640 1 --2- 172.21.15.114:0/2631994223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a7413c240 0x7f3a74138c90 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c01a0a0 tx=0x7f3a5c019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:52.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.314+0000 7f3a71600640 1 -- 172.21.15.114:0/2631994223 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0b5810 con 0x7f3a7413c240 2024-09-13T17:53:52.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.314+0000 7f3a71600640 1 -- 172.21.15.114:0/2631994223 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c0b5990 con 0x7f3a7413c240 2024-09-13T17:53:52.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.314+0000 7f3a71600640 1 -- 172.21.15.114:0/2631994223 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0b5d40 con 0x7f3a7413c240 2024-09-13T17:53:52.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.314+0000 7f3a7bc00640 1 -- 172.21.15.114:0/2631994223 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5c009420 con 0x7f3a7413c240 2024-09-13T17:53:52.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.314+0000 7f3a7bc00640 1 -- 172.21.15.114:0/2631994223 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a740c93e0 con 0x7f3a7413c240 2024-09-13T17:53:52.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.318+0000 7f3a7bc00640 1 -- 172.21.15.114:0/2631994223 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a74159790 con 0x7f3a7413c240 2024-09-13T17:53:52.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.318+0000 7f3a71600640 1 -- 172.21.15.114:0/2631994223 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3a5c0b4390 con 0x7f3a7413c240 2024-09-13T17:53:52.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.318+0000 7f3a71600640 1 --2- 172.21.15.114:0/2631994223 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3a50066690 0x7f3a50068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:52.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.318+0000 7f3a71600640 1 -- 172.21.15.114:0/2631994223 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f3a5c11ec40 con 0x7f3a7413c240 2024-09-13T17:53:52.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.318+0000 7f3a79200640 1 --2- 172.21.15.114:0/2631994223 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3a50066690 0x7f3a50068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:52.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.318+0000 7f3a79200640 1 --2- 172.21.15.114:0/2631994223 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3a50066690 0x7f3a50068b50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3a64000f70 tx=0x7f3a64009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:52.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.322+0000 7f3a71600640 1 -- 172.21.15.114:0/2631994223 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3a5c0ebc20 con 0x7f3a7413c240 2024-09-13T17:53:52.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.482+0000 7f3a7bc00640 1 -- 172.21.15.114:0/2631994223 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a7406cb50 con 0x7f3a7413c240 2024-09-13T17:53:52.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.482+0000 7f3a71600640 1 -- 172.21.15.114:0/2631994223 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+18795 (secure 0 0 0) 0x7f3a5c11e070 con 0x7f3a7413c240 2024-09-13T17:53:52.490 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:52.490 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":48,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:53:33.088316+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T17:53:06.185439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:53:07.297633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2024-09-13T17:53:31.026998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.35","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6835/1239035445":"2024-09-14T17:53:22.929223+0000","172.21.15.134:6833/1239035445":"2024-09-14T17:53:22.929223+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:53:52.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.486+0000 7f3a7bc00640 1 -- 172.21.15.114:0/2631994223 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3a50066690 msgr2=0x7f3a50068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:52.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.486+0000 7f3a7bc00640 1 --2- 172.21.15.114:0/2631994223 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3a50066690 0x7f3a50068b50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3a64000f70 tx=0x7f3a64009040 comp rx=0 tx=0).stop 2024-09-13T17:53:52.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.486+0000 7f3a7bc00640 1 -- 172.21.15.114:0/2631994223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a7413c240 msgr2=0x7f3a74138c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:52.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.486+0000 7f3a7bc00640 1 --2- 172.21.15.114:0/2631994223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a7413c240 0x7f3a74138c90 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c01a0a0 tx=0x7f3a5c019210 comp rx=0 tx=0).stop 2024-09-13T17:53:52.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.486+0000 7f3a7bc00640 1 -- 172.21.15.114:0/2631994223 shutdown_connections 2024-09-13T17:53:52.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.486+0000 7f3a7bc00640 1 --2- 172.21.15.114:0/2631994223 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3a50066690 0x7f3a50068b50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:52.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.486+0000 7f3a7bc00640 1 --2- 172.21.15.114:0/2631994223 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3a7413f420 0x7f3a7413e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:52.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.486+0000 7f3a7bc00640 1 --2- 172.21.15.114:0/2631994223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a7413c240 0x7f3a74138c90 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:52.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.486+0000 7f3a7bc00640 1 --2- 172.21.15.114:0/2631994223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a7406da90 0x7f3a7412aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:52.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.486+0000 7f3a7bc00640 1 -- 172.21.15.114:0/2631994223 >> 172.21.15.114:0/2631994223 conn(0x7f3a740660b0 msgr2=0x7f3a7406c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:52.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.486+0000 7f3a7bc00640 1 -- 172.21.15.114:0/2631994223 shutdown_connections 2024-09-13T17:53:52.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.486+0000 7f3a7bc00640 1 -- 172.21.15.114:0/2631994223 wait complete. 2024-09-13T17:53:52.510 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T17:53:52.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.642+0000 7fe69b400640 1 Processor -- start 2024-09-13T17:53:52.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.642+0000 7fe69b400640 1 -- start start 2024-09-13T17:53:52.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.642+0000 7fe69b400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe69413f420 0x7fe69406d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:52.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.642+0000 7fe69b400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6940cd220 con 0x7fe69406da90 2024-09-13T17:53:52.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.642+0000 7fe69b400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69415a740 con 0x7fe69413c240 2024-09-13T17:53:52.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.642+0000 7fe69b400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe69406df40 con 0x7fe69413f420 2024-09-13T17:53:52.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.642+0000 7fe699400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe69406da90 0x7fe6940cd650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56830/0 (socket says 172.21.15.114:56830) 2024-09-13T17:53:52.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.642+0000 7fe699400640 1 -- 172.21.15.114:0/3144677482 learned_addr learned my addr 172.21.15.114:0/3144677482 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:52.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.642+0000 7fe68be00640 1 --2- 172.21.15.114:0/3144677482 >> v2:172.21.15.134:3300/0 conn(0x7fe69413f420 0x7fe69406d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:52.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.642+0000 7fe693e00640 1 -- 172.21.15.114:0/3144677482 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 6291959 0 0) 0x7fe6940cd220 con 0x7fe69406da90 2024-09-13T17:53:52.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.642+0000 7fe693e00640 1 -- 172.21.15.114:0/3144677482 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe678003530 con 0x7fe69406da90 2024-09-13T17:53:52.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.642+0000 7fe68be00640 1 -- 172.21.15.114:0/3144677482 >> v1:172.21.15.134:6789/0 conn(0x7fe69413c240 legacy=0x7fe69413c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:52.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.642+0000 7fe68be00640 1 -- 172.21.15.114:0/3144677482 >> v1:172.21.15.114:6789/0 conn(0x7fe69406da90 legacy=0x7fe6940cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:52.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.642+0000 7fe68be00640 1 -- 172.21.15.114:0/3144677482 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe694159bc0 con 0x7fe69413f420 2024-09-13T17:53:52.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.646+0000 7fe68be00640 1 --2- 172.21.15.114:0/3144677482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe69413f420 0x7fe69406d550 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe67c0097c0 tx=0x7fe67c01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7da123284593ac51 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:52.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.646+0000 7fe693e00640 1 -- 172.21.15.114:0/3144677482 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67c0ab670 con 0x7fe69413f420 2024-09-13T17:53:52.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.646+0000 7fe693e00640 1 -- 172.21.15.114:0/3144677482 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67c0ab7d0 con 0x7fe69413f420 2024-09-13T17:53:52.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.646+0000 7fe693e00640 1 -- 172.21.15.114:0/3144677482 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67c0abb60 con 0x7fe69413f420 2024-09-13T17:53:52.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.646+0000 7fe69b400640 1 -- 172.21.15.114:0/3144677482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe69413f420 msgr2=0x7fe69406d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:52.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.646+0000 7fe69b400640 1 --2- 172.21.15.114:0/3144677482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe69413f420 0x7fe69406d550 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe67c0097c0 tx=0x7fe67c01c470 comp rx=0 tx=0).stop 2024-09-13T17:53:52.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.646+0000 7fe69b400640 1 -- 172.21.15.114:0/3144677482 shutdown_connections 2024-09-13T17:53:52.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.646+0000 7fe69b400640 1 --2- 172.21.15.114:0/3144677482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe69413f420 0x7fe69406d550 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:52.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.646+0000 7fe69b400640 1 -- 172.21.15.114:0/3144677482 >> 172.21.15.114:0/3144677482 conn(0x7fe6940660b0 msgr2=0x7fe694069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:52.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.646+0000 7fe69b400640 1 -- 172.21.15.114:0/3144677482 shutdown_connections 2024-09-13T17:53:52.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.646+0000 7fe69b400640 1 -- 172.21.15.114:0/3144677482 wait complete. 2024-09-13T17:53:52.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.650+0000 7fe69b400640 1 Processor -- start 2024-09-13T17:53:52.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.650+0000 7fe69b400640 1 -- start start 2024-09-13T17:53:52.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.650+0000 7fe69b400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe69406da90 0x7fe6940b3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:52.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.650+0000 7fe69b400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe69413c240 0x7fe6941396f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:52.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.650+0000 7fe69b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe69413f420 0x7fe694150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:52.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.650+0000 7fe69b400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6940b2480 con 0x7fe69413f420 2024-09-13T17:53:52.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.650+0000 7fe69b400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6940b1870 con 0x7fe69413c240 2024-09-13T17:53:52.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.650+0000 7fe69b400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6940b1b50 con 0x7fe69406da90 2024-09-13T17:53:52.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.650+0000 7fe699400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe69413f420 0x7fe694150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:52.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.650+0000 7fe699400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe69413f420 0x7fe694150950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48512/0 (socket says 172.21.15.114:48512) 2024-09-13T17:53:52.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.650+0000 7fe699400640 1 -- 172.21.15.114:0/3375548006 learned_addr learned my addr 172.21.15.114:0/3375548006 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:52.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.650+0000 7fe68be00640 1 --2- 172.21.15.114:0/3375548006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe69413c240 0x7fe6941396f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:52.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.650+0000 7fe698a00640 1 --2- 172.21.15.114:0/3375548006 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe69406da90 0x7fe6940b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:52.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.650+0000 7fe699400640 1 -- 172.21.15.114:0/3375548006 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe69406da90 msgr2=0x7fe6940b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:52.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.650+0000 7fe699400640 1 --2- 172.21.15.114:0/3375548006 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe69406da90 0x7fe6940b3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:52.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.650+0000 7fe699400640 1 -- 172.21.15.114:0/3375548006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe69413c240 msgr2=0x7fe6941396f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:52.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.650+0000 7fe699400640 1 --2- 172.21.15.114:0/3375548006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe69413c240 0x7fe6941396f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:52.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.650+0000 7fe699400640 1 -- 172.21.15.114:0/3375548006 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67c009420 con 0x7fe69413f420 2024-09-13T17:53:52.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.650+0000 7fe699400640 1 --2- 172.21.15.114:0/3375548006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe69413f420 0x7fe694150950 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe68c00caa0 tx=0x7fe68c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:52.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.650+0000 7fe691600640 1 -- 172.21.15.114:0/3375548006 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c00ac00 con 0x7fe69413f420 2024-09-13T17:53:52.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.650+0000 7fe691600640 1 -- 172.21.15.114:0/3375548006 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68c00ad60 con 0x7fe69413f420 2024-09-13T17:53:52.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.650+0000 7fe691600640 1 -- 172.21.15.114:0/3375548006 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c012620 con 0x7fe69413f420 2024-09-13T17:53:52.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.650+0000 7fe69b400640 1 -- 172.21.15.114:0/3375548006 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6940b1e30 con 0x7fe69413f420 2024-09-13T17:53:52.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.650+0000 7fe69b400640 1 -- 172.21.15.114:0/3375548006 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6940b3660 con 0x7fe69413f420 2024-09-13T17:53:52.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.654+0000 7fe69b400640 1 -- 172.21.15.114:0/3375548006 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6940b25f0 con 0x7fe69413f420 2024-09-13T17:53:52.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.654+0000 7fe691600640 1 -- 172.21.15.114:0/3375548006 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe68c007070 con 0x7fe69413f420 2024-09-13T17:53:52.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.654+0000 7fe691600640 1 --2- 172.21.15.114:0/3375548006 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe670066690 0x7fe670068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:52.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.654+0000 7fe691600640 1 -- 172.21.15.114:0/3375548006 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7fe68c084440 con 0x7fe69413f420 2024-09-13T17:53:52.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.654+0000 7fe698a00640 1 --2- 172.21.15.114:0/3375548006 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe670066690 0x7fe670068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:52.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.654+0000 7fe698a00640 1 --2- 172.21.15.114:0/3375548006 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe670066690 0x7fe670068b50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe684007fd0 tx=0x7fe684009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:52.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.658+0000 7fe691600640 1 -- 172.21.15.114:0/3375548006 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe68c0514e0 con 0x7fe69413f420 2024-09-13T17:53:52.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:52.846+0000 7fe69b400640 1 -- 172.21.15.114:0/3375548006 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe6940667b0 con 0x7fe69413f420 2024-09-13T17:53:53.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.466+0000 7fe691600640 1 -- 172.21.15.114:0/3375548006 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe68c054b00 con 0x7fe69413f420 2024-09-13T17:53:53.473 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T17:53:53.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.470+0000 7fe69b400640 1 -- 172.21.15.114:0/3375548006 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe670066690 msgr2=0x7fe670068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:53.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.470+0000 7fe69b400640 1 --2- 172.21.15.114:0/3375548006 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe670066690 0x7fe670068b50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe684007fd0 tx=0x7fe684009040 comp rx=0 tx=0).stop 2024-09-13T17:53:53.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.470+0000 7fe69b400640 1 -- 172.21.15.114:0/3375548006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe69413f420 msgr2=0x7fe694150950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:53.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.470+0000 7fe69b400640 1 --2- 172.21.15.114:0/3375548006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe69413f420 0x7fe694150950 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe68c00caa0 tx=0x7fe68c00cf60 comp rx=0 tx=0).stop 2024-09-13T17:53:53.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.470+0000 7fe69b400640 1 -- 172.21.15.114:0/3375548006 shutdown_connections 2024-09-13T17:53:53.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.470+0000 7fe69b400640 1 --2- 172.21.15.114:0/3375548006 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fe670066690 0x7fe670068b50 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:53.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.470+0000 7fe69b400640 1 --2- 172.21.15.114:0/3375548006 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe69413f420 0x7fe694150950 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:53.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.470+0000 7fe69b400640 1 --2- 172.21.15.114:0/3375548006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe69413c240 0x7fe6941396f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:53.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.470+0000 7fe69b400640 1 --2- 172.21.15.114:0/3375548006 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fe69406da90 0x7fe6940b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:53.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.470+0000 7fe69b400640 1 -- 172.21.15.114:0/3375548006 >> 172.21.15.114:0/3375548006 conn(0x7fe6940660b0 msgr2=0x7fe6941545b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:53.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.470+0000 7fe69b400640 1 -- 172.21.15.114:0/3375548006 shutdown_connections 2024-09-13T17:53:53.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.470+0000 7fe69b400640 1 -- 172.21.15.114:0/3375548006 wait complete. 2024-09-13T17:53:53.496 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T17:53:53.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.630+0000 7faf98000640 1 Processor -- start 2024-09-13T17:53:53.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.630+0000 7faf98000640 1 -- start start 2024-09-13T17:53:53.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.630+0000 7faf98000640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faf9013c240 0x7faf9013f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:53.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.630+0000 7faf98000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7faf9006dc60 0x7faf900cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:53.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.630+0000 7faf98000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf900cd220 con 0x7faf9013c980 2024-09-13T17:53:53.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.630+0000 7faf98000640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf9013f960 con 0x7faf9013c240 2024-09-13T17:53:53.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.630+0000 7faf98000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf9015a740 con 0x7faf9006dc60 2024-09-13T17:53:53.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.630+0000 7faf95600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faf9013c240 0x7faf9013f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:53.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.630+0000 7faf94c00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7faf9013c980 0x7faf9006d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56840/0 (socket says 172.21.15.114:56840) 2024-09-13T17:53:53.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.630+0000 7faf94c00640 1 -- 172.21.15.114:0/249841719 learned_addr learned my addr 172.21.15.114:0/249841719 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:53.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.630+0000 7faf96000640 1 --2- 172.21.15.114:0/249841719 >> v2:172.21.15.134:3300/0 conn(0x7faf9006dc60 0x7faf900cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.630+0000 7faf95600640 1 -- 172.21.15.114:0/249841719 >> v2:172.21.15.134:3300/0 conn(0x7faf9006dc60 msgr2=0x7faf900cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.630+0000 7faf95600640 1 --2- 172.21.15.114:0/249841719 >> v2:172.21.15.134:3300/0 conn(0x7faf9006dc60 0x7faf900cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.630+0000 7faf95600640 1 -- 172.21.15.114:0/249841719 >> v1:172.21.15.114:6789/0 conn(0x7faf9013c980 legacy=0x7faf9006d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.630+0000 7faf95600640 1 -- 172.21.15.114:0/249841719 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf90159bc0 con 0x7faf9013c240 2024-09-13T17:53:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.630+0000 7faf8fe00640 1 -- 172.21.15.114:0/249841719 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1722539218 0 0) 0x7faf900cd220 con 0x7faf9013c980 2024-09-13T17:53:53.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.630+0000 7faf96000640 1 --2- 172.21.15.114:0/249841719 >> v2:172.21.15.134:3300/0 conn(0x7faf9006dc60 0x7faf900cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:53.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.634+0000 7faf95600640 1 --2- 172.21.15.114:0/249841719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf9013c240 0x7faf9013f420 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7faf900cc210 tx=0x7faf8401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b790e408b4954f16 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:53.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.634+0000 7faf8fe00640 1 -- 172.21.15.114:0/249841719 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf840ac620 con 0x7faf9013c240 2024-09-13T17:53:53.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.634+0000 7faf8fe00640 1 -- 172.21.15.114:0/249841719 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf840ac780 con 0x7faf9013c240 2024-09-13T17:53:53.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.634+0000 7faf8fe00640 1 -- 172.21.15.114:0/249841719 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf840acb10 con 0x7faf9013c240 2024-09-13T17:53:53.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.634+0000 7faf98000640 1 -- 172.21.15.114:0/249841719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf9013c240 msgr2=0x7faf9013f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:53.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.634+0000 7faf98000640 1 --2- 172.21.15.114:0/249841719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf9013c240 0x7faf9013f420 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7faf900cc210 tx=0x7faf8401c3c0 comp rx=0 tx=0).stop 2024-09-13T17:53:53.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.634+0000 7faf98000640 1 -- 172.21.15.114:0/249841719 shutdown_connections 2024-09-13T17:53:53.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.634+0000 7faf98000640 1 --2- 172.21.15.114:0/249841719 >> v2:172.21.15.134:3300/0 conn(0x7faf9006dc60 0x7faf900cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:53.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.634+0000 7faf98000640 1 --2- 172.21.15.114:0/249841719 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf9013c240 0x7faf9013f420 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:53.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.634+0000 7faf98000640 1 -- 172.21.15.114:0/249841719 >> 172.21.15.114:0/249841719 conn(0x7faf900660b0 msgr2=0x7faf90069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:53.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.634+0000 7faf98000640 1 -- 172.21.15.114:0/249841719 shutdown_connections 2024-09-13T17:53:53.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.634+0000 7faf98000640 1 -- 172.21.15.114:0/249841719 wait complete. 2024-09-13T17:53:53.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.634+0000 7faf98000640 1 Processor -- start 2024-09-13T17:53:53.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.634+0000 7faf98000640 1 -- start start 2024-09-13T17:53:53.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.638+0000 7faf98000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf9006dc60 0x7faf900a9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:53.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.638+0000 7faf98000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf9013c240 0x7faf90153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:53.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.638+0000 7faf98000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf9013c980 0x7faf900a7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:53.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.638+0000 7faf98000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf900af380 con 0x7faf9013c240 2024-09-13T17:53:53.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.638+0000 7faf98000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf900af660 con 0x7faf9006dc60 2024-09-13T17:53:53.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.638+0000 7faf98000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf900af940 con 0x7faf9013c980 2024-09-13T17:53:53.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.638+0000 7faf94c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf9013c240 0x7faf90153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:53.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.638+0000 7faf94c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf9013c240 0x7faf90153250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48530/0 (socket says 172.21.15.114:48530) 2024-09-13T17:53:53.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.638+0000 7faf94c00640 1 -- 172.21.15.114:0/2301126033 learned_addr learned my addr 172.21.15.114:0/2301126033 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:53.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.638+0000 7faf96000640 1 --2- 172.21.15.114:0/2301126033 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf9013c980 0x7faf900a7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:53.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.638+0000 7faf95600640 1 --2- 172.21.15.114:0/2301126033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf9006dc60 0x7faf900a9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:53.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.638+0000 7faf94c00640 1 -- 172.21.15.114:0/2301126033 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf9013c980 msgr2=0x7faf900a7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:53.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.638+0000 7faf94c00640 1 --2- 172.21.15.114:0/2301126033 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf9013c980 0x7faf900a7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:53.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.638+0000 7faf94c00640 1 -- 172.21.15.114:0/2301126033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf9006dc60 msgr2=0x7faf900a9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:53.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.638+0000 7faf94c00640 1 --2- 172.21.15.114:0/2301126033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf9006dc60 0x7faf900a9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:53.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.638+0000 7faf94c00640 1 -- 172.21.15.114:0/2301126033 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf84009420 con 0x7faf9013c240 2024-09-13T17:53:53.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.638+0000 7faf96000640 1 --2- 172.21.15.114:0/2301126033 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf9013c980 0x7faf900a7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:53.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.638+0000 7faf95600640 1 --2- 172.21.15.114:0/2301126033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf9006dc60 0x7faf900a9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:53.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.638+0000 7faf94c00640 1 --2- 172.21.15.114:0/2301126033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf9013c240 0x7faf90153250 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00c480 tx=0x7faf7c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:53.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.638+0000 7faf8d600640 1 -- 172.21.15.114:0/2301126033 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c0074e0 con 0x7faf9013c240 2024-09-13T17:53:53.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.638+0000 7faf8d600640 1 -- 172.21.15.114:0/2301126033 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7c007660 con 0x7faf9013c240 2024-09-13T17:53:53.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.638+0000 7faf98000640 1 -- 172.21.15.114:0/2301126033 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf900afc20 con 0x7faf9013c240 2024-09-13T17:53:53.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.638+0000 7faf8d600640 1 -- 172.21.15.114:0/2301126033 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c004a30 con 0x7faf9013c240 2024-09-13T17:53:53.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.638+0000 7faf98000640 1 -- 172.21.15.114:0/2301126033 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf900af010 con 0x7faf9013c240 2024-09-13T17:53:53.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.638+0000 7faf98000640 1 -- 172.21.15.114:0/2301126033 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf90159790 con 0x7faf9013c240 2024-09-13T17:53:53.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.642+0000 7faf8d600640 1 -- 172.21.15.114:0/2301126033 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faf7c004b90 con 0x7faf9013c240 2024-09-13T17:53:53.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.642+0000 7faf8d600640 1 --2- 172.21.15.114:0/2301126033 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7faf70066690 0x7faf70068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:53.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.642+0000 7faf8d600640 1 -- 172.21.15.114:0/2301126033 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7faf7c083a40 con 0x7faf9013c240 2024-09-13T17:53:53.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.642+0000 7faf95600640 1 --2- 172.21.15.114:0/2301126033 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7faf70066690 0x7faf70068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:53.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.642+0000 7faf95600640 1 --2- 172.21.15.114:0/2301126033 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7faf70066690 0x7faf70068b50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7faf840ae000 tx=0x7faf84008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:53.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.646+0000 7faf8d600640 1 -- 172.21.15.114:0/2301126033 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faf7c0544b0 con 0x7faf9013c240 2024-09-13T17:53:53.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:53.834+0000 7faf98000640 1 -- 172.21.15.114:0/2301126033 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7faf90071360 con 0x7faf9013c240 2024-09-13T17:53:54.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.474+0000 7faf8d600640 1 -- 172.21.15.114:0/2301126033 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v30) v1 ==== 104+0+0 (secure 0 0 0) 0x7faf7c054040 con 0x7faf9013c240 2024-09-13T17:53:54.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.474+0000 7faf98000640 1 -- 172.21.15.114:0/2301126033 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7faf70066690 msgr2=0x7faf70068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:54.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.474+0000 7faf98000640 1 --2- 172.21.15.114:0/2301126033 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7faf70066690 0x7faf70068b50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7faf840ae000 tx=0x7faf84008040 comp rx=0 tx=0).stop 2024-09-13T17:53:54.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.474+0000 7faf98000640 1 -- 172.21.15.114:0/2301126033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf9013c240 msgr2=0x7faf90153250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:54.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.474+0000 7faf98000640 1 --2- 172.21.15.114:0/2301126033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf9013c240 0x7faf90153250 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00c480 tx=0x7faf7c00c940 comp rx=0 tx=0).stop 2024-09-13T17:53:54.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.474+0000 7faf98000640 1 -- 172.21.15.114:0/2301126033 shutdown_connections 2024-09-13T17:53:54.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.474+0000 7faf98000640 1 --2- 172.21.15.114:0/2301126033 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7faf70066690 0x7faf70068b50 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:54.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.474+0000 7faf98000640 1 --2- 172.21.15.114:0/2301126033 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7faf9013c980 0x7faf900a7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:54.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.474+0000 7faf98000640 1 --2- 172.21.15.114:0/2301126033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf9013c240 0x7faf90153250 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:54.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.474+0000 7faf98000640 1 --2- 172.21.15.114:0/2301126033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faf9006dc60 0x7faf900a9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:54.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.474+0000 7faf98000640 1 -- 172.21.15.114:0/2301126033 >> 172.21.15.114:0/2301126033 conn(0x7faf900660b0 msgr2=0x7faf901560b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:54.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.474+0000 7faf98000640 1 -- 172.21.15.114:0/2301126033 shutdown_connections 2024-09-13T17:53:54.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.474+0000 7faf98000640 1 -- 172.21.15.114:0/2301126033 wait complete. 2024-09-13T17:53:54.503 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T17:53:54.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.638+0000 7fd1ab200640 1 Processor -- start 2024-09-13T17:53:54.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.638+0000 7fd1ab200640 1 -- start start 2024-09-13T17:53:54.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.638+0000 7fd1ab200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd1ac15c880 0x7fd1ac0d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:54.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.638+0000 7fd1ab200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1ac099180 0x7fd1ac0cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:54.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.638+0000 7fd1ab200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ac0ca980 con 0x7fd1ac06bfc0 2024-09-13T17:53:54.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.638+0000 7fd1ab200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ac15cc60 con 0x7fd1ac15c880 2024-09-13T17:53:54.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.638+0000 7fd1ab200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac06c450 con 0x7fd1ac099180 2024-09-13T17:53:54.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.638+0000 7fd1a9400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd1ac06bfc0 0x7fd1ac098a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56848/0 (socket says 172.21.15.114:56848) 2024-09-13T17:53:54.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.638+0000 7fd1a9400640 1 -- 172.21.15.114:0/1279125722 learned_addr learned my addr 172.21.15.114:0/1279125722 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:54.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.638+0000 7fd1a8a00640 1 -- 172.21.15.114:0/1279125722 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2626957467 0 0) 0x7fd1ac0ca980 con 0x7fd1ac06bfc0 2024-09-13T17:53:54.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.638+0000 7fd1aa800640 1 --2- 172.21.15.114:0/1279125722 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1ac099180 0x7fd1ac0cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:54.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.638+0000 7fd1a8a00640 1 -- 172.21.15.114:0/1279125722 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd190003530 con 0x7fd1ac06bfc0 2024-09-13T17:53:54.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.638+0000 7fd1a9e00640 1 --2- 172.21.15.114:0/1279125722 >> v2:172.21.15.134:3300/0 conn(0x7fd1ac15c880 0x7fd1ac0d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:54.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.638+0000 7fd1a8a00640 1 -- 172.21.15.114:0/1279125722 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1942850118 0 0) 0x7fd190003530 con 0x7fd1ac06bfc0 2024-09-13T17:53:54.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.638+0000 7fd1a8a00640 1 -- 172.21.15.114:0/1279125722 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1ac099180 msgr2=0x7fd1ac0cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:54.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.638+0000 7fd1a8a00640 1 --2- 172.21.15.114:0/1279125722 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1ac099180 0x7fd1ac0cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:54.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.638+0000 7fd1a8a00640 1 -- 172.21.15.114:0/1279125722 >> v2:172.21.15.134:3300/0 conn(0x7fd1ac15c880 msgr2=0x7fd1ac0d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:54.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.638+0000 7fd1a8a00640 1 --2- 172.21.15.114:0/1279125722 >> v2:172.21.15.134:3300/0 conn(0x7fd1ac15c880 0x7fd1ac0d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:54.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.638+0000 7fd1a8a00640 1 -- 172.21.15.114:0/1279125722 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac06c730 con 0x7fd1ac06bfc0 2024-09-13T17:53:54.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.638+0000 7fd1a8a00640 1 -- 172.21.15.114:0/1279125722 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7fd198001680 con 0x7fd1ac06bfc0 2024-09-13T17:53:54.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.638+0000 7fd1a8a00640 1 -- 172.21.15.114:0/1279125722 >> v1:172.21.15.114:6789/0 conn(0x7fd1ac06bfc0 legacy=0x7fd1ac098a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:54.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.638+0000 7fd1a8a00640 1 --2- 172.21.15.114:0/1279125722 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1ac099180 0x7fd190003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:54.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.638+0000 7fd1a8a00640 1 --2- 172.21.15.114:0/1279125722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd190003f00 0x7fd1900047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:54.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.638+0000 7fd1a8a00640 1 --2- 172.21.15.114:0/1279125722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd190004d10 0x7fd190005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:54.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.638+0000 7fd1a8a00640 1 -- 172.21.15.114:0/1279125722 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac15cc60 con 0x7fd190003f00 2024-09-13T17:53:54.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.638+0000 7fd1a8a00640 1 -- 172.21.15.114:0/1279125722 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac06c450 con 0x7fd190004d10 2024-09-13T17:53:54.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.642+0000 7fd1a8a00640 1 -- 172.21.15.114:0/1279125722 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd19000b9e0 con 0x7fd1ac099180 2024-09-13T17:53:54.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.642+0000 7fd1a9e00640 1 --2- 172.21.15.114:0/1279125722 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1ac099180 0x7fd190003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:54.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.642+0000 7fd1a9400640 1 --2- 172.21.15.114:0/1279125722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd190003f00 0x7fd1900047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:54.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.642+0000 7fd1aa800640 1 --2- 172.21.15.114:0/1279125722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd190004d10 0x7fd190005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:54.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.642+0000 7fd1a9e00640 1 -- 172.21.15.114:0/1279125722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd190004d10 msgr2=0x7fd190005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:54.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.642+0000 7fd1a9e00640 1 --2- 172.21.15.114:0/1279125722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd190004d10 0x7fd190005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:54.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.642+0000 7fd1a9e00640 1 -- 172.21.15.114:0/1279125722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd190003f00 msgr2=0x7fd1900047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:54.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.642+0000 7fd1a9e00640 1 --2- 172.21.15.114:0/1279125722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd190003f00 0x7fd1900047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:54.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.642+0000 7fd1a9e00640 1 -- 172.21.15.114:0/1279125722 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd190003530 con 0x7fd1ac099180 2024-09-13T17:53:54.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.642+0000 7fd1a9400640 1 --2- 172.21.15.114:0/1279125722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd190003f00 0x7fd1900047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:53:54.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.642+0000 7fd1a9e00640 1 --2- 172.21.15.114:0/1279125722 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1ac099180 0x7fd190003980 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd19c00e170 tx=0x7fd19c01cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6941db7ea05ce247 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:54.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.642+0000 7fd1a8a00640 1 -- 172.21.15.114:0/1279125722 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c0a5c60 con 0x7fd1ac099180 2024-09-13T17:53:54.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.642+0000 7fd1a8a00640 1 -- 172.21.15.114:0/1279125722 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19c00f040 con 0x7fd1ac099180 2024-09-13T17:53:54.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.642+0000 7fd1a8a00640 1 -- 172.21.15.114:0/1279125722 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c0ad440 con 0x7fd1ac099180 2024-09-13T17:53:54.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.646+0000 7fd1ab200640 1 -- 172.21.15.114:0/1279125722 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1ac099180 msgr2=0x7fd190003980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:54.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.646+0000 7fd1ab200640 1 --2- 172.21.15.114:0/1279125722 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1ac099180 0x7fd190003980 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd19c00e170 tx=0x7fd19c01cc70 comp rx=0 tx=0).stop 2024-09-13T17:53:54.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.646+0000 7fd1aa800640 1 -- 172.21.15.114:0/1279125722 reap_dead start 2024-09-13T17:53:54.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.646+0000 7fd1ab200640 1 -- 172.21.15.114:0/1279125722 shutdown_connections 2024-09-13T17:53:54.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.646+0000 7fd1ab200640 1 -- 172.21.15.114:0/1279125722 >> 172.21.15.114:0/1279125722 conn(0x7fd1ac0d0330 msgr2=0x7fd1ac0d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:54.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.646+0000 7fd1ab200640 1 -- 172.21.15.114:0/1279125722 shutdown_connections 2024-09-13T17:53:54.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.646+0000 7fd1ab200640 1 -- 172.21.15.114:0/1279125722 wait complete. 2024-09-13T17:53:54.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.646+0000 7fd1ab200640 1 Processor -- start 2024-09-13T17:53:54.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.646+0000 7fd1ab200640 1 -- start start 2024-09-13T17:53:54.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.646+0000 7fd1ab200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1ac099180 0x7fd1ac158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:54.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.646+0000 7fd1ab200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1ac15adc0 0x7fd1ac15b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:54.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.646+0000 7fd1ab200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1ac153ed0 0x7fd1ac154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:54.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.646+0000 7fd1ab200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac0ca770 con 0x7fd1ac153ed0 2024-09-13T17:53:54.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.646+0000 7fd1ab200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac158a80 con 0x7fd1ac15adc0 2024-09-13T17:53:54.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.646+0000 7fd1ab200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac1561b0 con 0x7fd1ac099180 2024-09-13T17:53:54.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.646+0000 7fd1aa800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1ac153ed0 0x7fd1ac154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:54.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.646+0000 7fd1aa800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1ac153ed0 0x7fd1ac154360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48554/0 (socket says 172.21.15.114:48554) 2024-09-13T17:53:54.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.646+0000 7fd1a9e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1ac099180 0x7fd1ac158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:54.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.646+0000 7fd1aa800640 1 -- 172.21.15.114:0/1597107825 learned_addr learned my addr 172.21.15.114:0/1597107825 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:54.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.646+0000 7fd1a9400640 1 --2- 172.21.15.114:0/1597107825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1ac15adc0 0x7fd1ac15b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:54.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.646+0000 7fd1aa800640 1 -- 172.21.15.114:0/1597107825 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1ac099180 msgr2=0x7fd1ac158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:54.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.646+0000 7fd1aa800640 1 --2- 172.21.15.114:0/1597107825 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1ac099180 0x7fd1ac158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:54.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.646+0000 7fd1aa800640 1 -- 172.21.15.114:0/1597107825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1ac15adc0 msgr2=0x7fd1ac15b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:54.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.646+0000 7fd1aa800640 1 --2- 172.21.15.114:0/1597107825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1ac15adc0 0x7fd1ac15b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:54.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.646+0000 7fd1aa800640 1 -- 172.21.15.114:0/1597107825 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac156490 con 0x7fd1ac153ed0 2024-09-13T17:53:54.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.650+0000 7fd1aa800640 1 --2- 172.21.15.114:0/1597107825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1ac153ed0 0x7fd1ac154360 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac099b10 tx=0x7fd1a4011c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:54.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.650+0000 7fd1a2000640 1 -- 172.21.15.114:0/1597107825 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4011ee0 con 0x7fd1ac153ed0 2024-09-13T17:53:54.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.650+0000 7fd1a2000640 1 -- 172.21.15.114:0/1597107825 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a4004240 con 0x7fd1ac153ed0 2024-09-13T17:53:54.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.650+0000 7fd1a2000640 1 -- 172.21.15.114:0/1597107825 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a400f770 con 0x7fd1ac153ed0 2024-09-13T17:53:54.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.650+0000 7fd1ab200640 1 -- 172.21.15.114:0/1597107825 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ac156770 con 0x7fd1ac153ed0 2024-09-13T17:53:54.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.650+0000 7fd1ab200640 1 -- 172.21.15.114:0/1597107825 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ac15b780 con 0x7fd1ac153ed0 2024-09-13T17:53:54.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.650+0000 7fd1ab200640 1 -- 172.21.15.114:0/1597107825 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1ac0d0e50 con 0x7fd1ac153ed0 2024-09-13T17:53:54.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.650+0000 7fd1a2000640 1 -- 172.21.15.114:0/1597107825 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd1a400f8d0 con 0x7fd1ac153ed0 2024-09-13T17:53:54.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.650+0000 7fd1a2000640 1 --2- 172.21.15.114:0/1597107825 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd18c066690 0x7fd18c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:54.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.650+0000 7fd1a2000640 1 -- 172.21.15.114:0/1597107825 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6597+0+0 (secure 0 0 0) 0x7fd1a4084500 con 0x7fd1ac153ed0 2024-09-13T17:53:54.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.650+0000 7fd1a9e00640 1 --2- 172.21.15.114:0/1597107825 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd18c066690 0x7fd18c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:54.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.650+0000 7fd1a9e00640 1 --2- 172.21.15.114:0/1597107825 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd18c066690 0x7fd18c068b50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0af000 tx=0x7fd19c0a7040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:54.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.654+0000 7fd1a2000640 1 -- 172.21.15.114:0/1597107825 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd1a4051450 con 0x7fd1ac153ed0 2024-09-13T17:53:54.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:54.814+0000 7fd1ab200640 1 -- 172.21.15.114:0/1597107825 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd1ac0addc0 con 0x7fd1ac153ed0 2024-09-13T17:53:55.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.478+0000 7fd1a2000640 1 -- 172.21.15.114:0/1597107825 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v49) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd1a4059e60 con 0x7fd1ac153ed0 2024-09-13T17:53:55.483 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2024-09-13T17:53:55.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.478+0000 7fd1ab200640 1 -- 172.21.15.114:0/1597107825 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd18c066690 msgr2=0x7fd18c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:55.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.478+0000 7fd1ab200640 1 --2- 172.21.15.114:0/1597107825 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd18c066690 0x7fd18c068b50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd19c0af000 tx=0x7fd19c0a7040 comp rx=0 tx=0).stop 2024-09-13T17:53:55.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.478+0000 7fd1ab200640 1 -- 172.21.15.114:0/1597107825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1ac153ed0 msgr2=0x7fd1ac154360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:55.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.478+0000 7fd1ab200640 1 --2- 172.21.15.114:0/1597107825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1ac153ed0 0x7fd1ac154360 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac099b10 tx=0x7fd1a4011c30 comp rx=0 tx=0).stop 2024-09-13T17:53:55.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.482+0000 7fd1ab200640 1 -- 172.21.15.114:0/1597107825 shutdown_connections 2024-09-13T17:53:55.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.482+0000 7fd1ab200640 1 --2- 172.21.15.114:0/1597107825 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fd18c066690 0x7fd18c068b50 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:55.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.482+0000 7fd1ab200640 1 --2- 172.21.15.114:0/1597107825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1ac153ed0 0x7fd1ac154360 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:55.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.482+0000 7fd1ab200640 1 --2- 172.21.15.114:0/1597107825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1ac15adc0 0x7fd1ac15b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:55.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.482+0000 7fd1ab200640 1 --2- 172.21.15.114:0/1597107825 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fd1ac099180 0x7fd1ac158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:55.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.482+0000 7fd1ab200640 1 -- 172.21.15.114:0/1597107825 >> 172.21.15.114:0/1597107825 conn(0x7fd1ac0d0330 msgr2=0x7fd1ac098a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:55.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.482+0000 7fd1ab200640 1 -- 172.21.15.114:0/1597107825 shutdown_connections 2024-09-13T17:53:55.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.482+0000 7fd1ab200640 1 -- 172.21.15.114:0/1597107825 wait complete. 2024-09-13T17:53:55.511 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T17:53:55.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.646+0000 7ffb48e00640 1 Processor -- start 2024-09-13T17:53:55.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.646+0000 7ffb48e00640 1 -- start start 2024-09-13T17:53:55.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.646+0000 7ffb48e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffb440cdad0 0x7ffb440ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:55.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.646+0000 7ffb48e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb440adfb0 con 0x7ffb44070420 2024-09-13T17:53:55.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.646+0000 7ffb48e00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb440adcd0 con 0x7ffb4406d740 2024-09-13T17:53:55.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.646+0000 7ffb48e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4406cc10 con 0x7ffb440cdad0 2024-09-13T17:53:55.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.646+0000 7ffb39400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ffb44070420 0x7ffb4406d030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56864/0 (socket says 172.21.15.114:56864) 2024-09-13T17:53:55.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.646+0000 7ffb39400640 1 -- 172.21.15.114:0/931757060 learned_addr learned my addr 172.21.15.114:0/931757060 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:55.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.646+0000 7ffb41e00640 1 --2- 172.21.15.114:0/931757060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffb440cdad0 0x7ffb440ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:55.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.646+0000 7ffb41400640 1 -- 172.21.15.114:0/931757060 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2535603430 0 0) 0x7ffb440adfb0 con 0x7ffb44070420 2024-09-13T17:53:55.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.646+0000 7ffb41400640 1 -- 172.21.15.114:0/931757060 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb28003530 con 0x7ffb44070420 2024-09-13T17:53:55.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.646+0000 7ffb41400640 1 -- 172.21.15.114:0/931757060 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1872981820 0 0) 0x7ffb28003530 con 0x7ffb44070420 2024-09-13T17:53:55.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.646+0000 7ffb41400640 1 -- 172.21.15.114:0/931757060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffb440cdad0 msgr2=0x7ffb440ad4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:55.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.646+0000 7ffb41400640 1 --2- 172.21.15.114:0/931757060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffb440cdad0 0x7ffb440ad4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:55.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.646+0000 7ffb41400640 1 -- 172.21.15.114:0/931757060 >> v1:172.21.15.134:6789/0 conn(0x7ffb4406d740 legacy=0x7ffb4415d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:55.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.646+0000 7ffb41400640 1 -- 172.21.15.114:0/931757060 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4406c550 con 0x7ffb44070420 2024-09-13T17:53:55.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.646+0000 7ffb41400640 1 -- 172.21.15.114:0/931757060 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7ffb2c001680 con 0x7ffb44070420 2024-09-13T17:53:55.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.646+0000 7ffb41400640 1 -- 172.21.15.114:0/931757060 >> v1:172.21.15.114:6789/0 conn(0x7ffb44070420 legacy=0x7ffb4406d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:55.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.646+0000 7ffb41400640 1 --2- 172.21.15.114:0/931757060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffb440cdad0 0x7ffb280039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:55.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.646+0000 7ffb41400640 1 --2- 172.21.15.114:0/931757060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb28003ef0 0x7ffb280047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:55.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.646+0000 7ffb41400640 1 --2- 172.21.15.114:0/931757060 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb28004d10 0x7ffb28005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:55.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.646+0000 7ffb41400640 1 -- 172.21.15.114:0/931757060 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4406cc10 con 0x7ffb28004d10 2024-09-13T17:53:55.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.646+0000 7ffb41400640 1 -- 172.21.15.114:0/931757060 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2800baa0 con 0x7ffb28003ef0 2024-09-13T17:53:55.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.646+0000 7ffb41400640 1 -- 172.21.15.114:0/931757060 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2800bc60 con 0x7ffb440cdad0 2024-09-13T17:53:55.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.646+0000 7ffb42800640 1 --2- 172.21.15.114:0/931757060 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb28004d10 0x7ffb28005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:55.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.646+0000 7ffb41e00640 1 --2- 172.21.15.114:0/931757060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffb440cdad0 0x7ffb280039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:55.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.646+0000 7ffb39400640 1 --2- 172.21.15.114:0/931757060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb28003ef0 0x7ffb280047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:55.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.650+0000 7ffb42800640 1 -- 172.21.15.114:0/931757060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffb440cdad0 msgr2=0x7ffb280039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:55.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.650+0000 7ffb42800640 1 --2- 172.21.15.114:0/931757060 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffb440cdad0 0x7ffb280039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:55.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.650+0000 7ffb42800640 1 -- 172.21.15.114:0/931757060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb28003ef0 msgr2=0x7ffb280047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:55.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.650+0000 7ffb42800640 1 --2- 172.21.15.114:0/931757060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb28003ef0 0x7ffb280047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:55.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.650+0000 7ffb42800640 1 -- 172.21.15.114:0/931757060 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb28003530 con 0x7ffb28004d10 2024-09-13T17:53:55.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.650+0000 7ffb42800640 1 --2- 172.21.15.114:0/931757060 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb28004d10 0x7ffb28005190 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c002010 tx=0x7ffb3c01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81fe970adae5601 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:55.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.650+0000 7ffb41400640 1 -- 172.21.15.114:0/931757060 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c0a66a0 con 0x7ffb28004d10 2024-09-13T17:53:55.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.650+0000 7ffb41400640 1 -- 172.21.15.114:0/931757060 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3c0a6820 con 0x7ffb28004d10 2024-09-13T17:53:55.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.650+0000 7ffb41400640 1 -- 172.21.15.114:0/931757060 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c0a6bd0 con 0x7ffb28004d10 2024-09-13T17:53:55.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.650+0000 7ffb48e00640 1 -- 172.21.15.114:0/931757060 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb28004d10 msgr2=0x7ffb28005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:55.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.650+0000 7ffb48e00640 1 --2- 172.21.15.114:0/931757060 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb28004d10 0x7ffb28005190 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c002010 tx=0x7ffb3c01c8b0 comp rx=0 tx=0).stop 2024-09-13T17:53:55.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.650+0000 7ffb42800640 1 -- 172.21.15.114:0/931757060 reap_dead start 2024-09-13T17:53:55.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.650+0000 7ffb48e00640 1 -- 172.21.15.114:0/931757060 shutdown_connections 2024-09-13T17:53:55.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.650+0000 7ffb48e00640 1 -- 172.21.15.114:0/931757060 >> 172.21.15.114:0/931757060 conn(0x7ffb440660b0 msgr2=0x7ffb44069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:55.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.650+0000 7ffb48e00640 1 -- 172.21.15.114:0/931757060 shutdown_connections 2024-09-13T17:53:55.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.650+0000 7ffb48e00640 1 -- 172.21.15.114:0/931757060 wait complete. 2024-09-13T17:53:55.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.654+0000 7ffb48e00640 1 Processor -- start 2024-09-13T17:53:55.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.654+0000 7ffb48e00640 1 -- start start 2024-09-13T17:53:55.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.654+0000 7ffb48e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb4415e690 0x7ffb4415f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:55.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.654+0000 7ffb48e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffb4415ea70 0x7ffb4414d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:55.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.654+0000 7ffb48e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb4414bc10 0x7ffb44164000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:55.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.654+0000 7ffb48e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4414c0c0 con 0x7ffb4415e690 2024-09-13T17:53:55.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.654+0000 7ffb48e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4414c800 con 0x7ffb4414bc10 2024-09-13T17:53:55.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.654+0000 7ffb48e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4414cae0 con 0x7ffb4415ea70 2024-09-13T17:53:55.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.654+0000 7ffb41e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb4415e690 0x7ffb4415f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:55.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.654+0000 7ffb41e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb4415e690 0x7ffb4415f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48574/0 (socket says 172.21.15.114:48574) 2024-09-13T17:53:55.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.654+0000 7ffb41e00640 1 -- 172.21.15.114:0/418151744 learned_addr learned my addr 172.21.15.114:0/418151744 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:55.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.654+0000 7ffb42800640 1 --2- 172.21.15.114:0/418151744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb4414bc10 0x7ffb44164000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:55.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.654+0000 7ffb39400640 1 --2- 172.21.15.114:0/418151744 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffb4415ea70 0x7ffb4414d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:55.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.654+0000 7ffb41e00640 1 -- 172.21.15.114:0/418151744 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffb4415ea70 msgr2=0x7ffb4414d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:55.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.654+0000 7ffb41e00640 1 --2- 172.21.15.114:0/418151744 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ffb4415ea70 0x7ffb4414d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:55.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.654+0000 7ffb41e00640 1 -- 172.21.15.114:0/418151744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb4414bc10 msgr2=0x7ffb44164000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:55.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.654+0000 7ffb41e00640 1 --2- 172.21.15.114:0/418151744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb4414bc10 0x7ffb44164000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:55.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.654+0000 7ffb41e00640 1 -- 172.21.15.114:0/418151744 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4414cdc0 con 0x7ffb4415e690 2024-09-13T17:53:55.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.654+0000 7ffb41e00640 1 --2- 172.21.15.114:0/418151744 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb4415e690 0x7ffb4415f530 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ffb340119d0 tx=0x7ffb34011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:55.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.654+0000 7ffb3aa00640 1 -- 172.21.15.114:0/418151744 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3400fb50 con 0x7ffb4415e690 2024-09-13T17:53:55.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.654+0000 7ffb3aa00640 1 -- 172.21.15.114:0/418151744 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3400fcb0 con 0x7ffb4415e690 2024-09-13T17:53:55.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.654+0000 7ffb48e00640 1 -- 172.21.15.114:0/418151744 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb4414d0a0 con 0x7ffb4415e690 2024-09-13T17:53:55.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.654+0000 7ffb3aa00640 1 -- 172.21.15.114:0/418151744 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb34014440 con 0x7ffb4415e690 2024-09-13T17:53:55.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.654+0000 7ffb48e00640 1 -- 172.21.15.114:0/418151744 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb44164540 con 0x7ffb4415e690 2024-09-13T17:53:55.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.658+0000 7ffb48e00640 1 -- 172.21.15.114:0/418151744 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb440ad830 con 0x7ffb4415e690 2024-09-13T17:53:55.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.658+0000 7ffb3aa00640 1 -- 172.21.15.114:0/418151744 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffb340145a0 con 0x7ffb4415e690 2024-09-13T17:53:55.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.658+0000 7ffb3aa00640 1 --2- 172.21.15.114:0/418151744 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ffb200666c0 0x7ffb20068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:55.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.658+0000 7ffb3aa00640 1 -- 172.21.15.114:0/418151744 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6159+0+0 (secure 0 0 0) 0x7ffb34084b00 con 0x7ffb4415e690 2024-09-13T17:53:55.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.658+0000 7ffb39400640 1 --2- 172.21.15.114:0/418151744 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ffb200666c0 0x7ffb20068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:55.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.658+0000 7ffb39400640 1 --2- 172.21.15.114:0/418151744 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ffb200666c0 0x7ffb20068b80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ffb4415fad0 tx=0x7ffb2c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:55.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.662+0000 7ffb3aa00640 1 -- 172.21.15.114:0/418151744 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffb34051e00 con 0x7ffb4415e690 2024-09-13T17:53:55.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.818+0000 7ffb48e00640 1 -- 172.21.15.114:0/418151744 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ffb440ce1d0 con 0x7ffb4415e690 2024-09-13T17:53:55.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.818+0000 7ffb3aa00640 1 -- 172.21.15.114:0/418151744 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=-16 pool 'cephfs_data' is in use by CephFS v49) v1 ==== 181+0+0 (secure 0 0 0) 0x7ffb34022020 con 0x7ffb4415e690 2024-09-13T17:53:55.825 INFO:teuthology.orchestra.run.smithi114.stderr:Error EBUSY: pool 'cephfs_data' is in use by CephFS 2024-09-13T17:53:55.834 DEBUG:teuthology.orchestra.run:got remote process result: 16 2024-09-13T17:53:55.835 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:53:55.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.966+0000 7f7c5de00640 1 Processor -- start 2024-09-13T17:53:55.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.966+0000 7f7c5de00640 1 -- start start 2024-09-13T17:53:55.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.970+0000 7f7c5de00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7c5813f420 0x7f7c5806d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:55.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.970+0000 7f7c5de00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c580cd220 con 0x7f7c5806da90 2024-09-13T17:53:55.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.970+0000 7f7c5de00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5815a740 con 0x7f7c5813c240 2024-09-13T17:53:55.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.970+0000 7f7c5de00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5806df40 con 0x7f7c5813f420 2024-09-13T17:53:55.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.970+0000 7f7c57400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7c5806da90 0x7f7c580cd650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56868/0 (socket says 172.21.15.114:56868) 2024-09-13T17:53:55.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.970+0000 7f7c57400640 1 -- 172.21.15.114:0/381430445 learned_addr learned my addr 172.21.15.114:0/381430445 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:55.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.970+0000 7f7c4e000640 1 --2- 172.21.15.114:0/381430445 >> v2:172.21.15.134:3300/0 conn(0x7f7c5813f420 0x7f7c5806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:55.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.970+0000 7f7c56000640 1 -- 172.21.15.114:0/381430445 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260480875 0 0) 0x7f7c580cd220 con 0x7f7c5806da90 2024-09-13T17:53:55.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.970+0000 7f7c56000640 1 -- 172.21.15.114:0/381430445 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c3c005740 con 0x7f7c5806da90 2024-09-13T17:53:55.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.970+0000 7f7c4e000640 1 -- 172.21.15.114:0/381430445 >> v1:172.21.15.134:6789/0 conn(0x7f7c5813c240 legacy=0x7f7c5813c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:55.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.970+0000 7f7c4e000640 1 -- 172.21.15.114:0/381430445 >> v1:172.21.15.114:6789/0 conn(0x7f7c5806da90 legacy=0x7f7c580cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:55.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.970+0000 7f7c4e000640 1 -- 172.21.15.114:0/381430445 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c58159bc0 con 0x7f7c5813f420 2024-09-13T17:53:55.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.974+0000 7f7c4e000640 1 --2- 172.21.15.114:0/381430445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c5813f420 0x7f7c5806d550 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7c400097c0 tx=0x7f7c4001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b677b4b0001b480 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:55.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.974+0000 7f7c56000640 1 -- 172.21.15.114:0/381430445 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c400ab600 con 0x7f7c5813f420 2024-09-13T17:53:55.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.974+0000 7f7c56000640 1 -- 172.21.15.114:0/381430445 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c400a7050 con 0x7f7c5813f420 2024-09-13T17:53:55.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.974+0000 7f7c56000640 1 -- 172.21.15.114:0/381430445 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c400ab980 con 0x7f7c5813f420 2024-09-13T17:53:55.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.974+0000 7f7c5de00640 1 -- 172.21.15.114:0/381430445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c5813f420 msgr2=0x7f7c5806d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:55.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.974+0000 7f7c5de00640 1 --2- 172.21.15.114:0/381430445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c5813f420 0x7f7c5806d550 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7c400097c0 tx=0x7f7c4001c470 comp rx=0 tx=0).stop 2024-09-13T17:53:55.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.974+0000 7f7c5de00640 1 -- 172.21.15.114:0/381430445 shutdown_connections 2024-09-13T17:53:55.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.974+0000 7f7c5de00640 1 --2- 172.21.15.114:0/381430445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c5813f420 0x7f7c5806d550 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:55.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.974+0000 7f7c5de00640 1 -- 172.21.15.114:0/381430445 >> 172.21.15.114:0/381430445 conn(0x7f7c580660b0 msgr2=0x7f7c58069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:55.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.974+0000 7f7c5de00640 1 -- 172.21.15.114:0/381430445 shutdown_connections 2024-09-13T17:53:55.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.974+0000 7f7c5de00640 1 -- 172.21.15.114:0/381430445 wait complete. 2024-09-13T17:53:55.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.974+0000 7f7c5de00640 1 Processor -- start 2024-09-13T17:53:55.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.974+0000 7f7c5de00640 1 -- start start 2024-09-13T17:53:55.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.974+0000 7f7c5de00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c5806da90 0x7f7c580ad0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:55.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.974+0000 7f7c5de00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c5813c240 0x7f7c580c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:55.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.974+0000 7f7c5de00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c5813f420 0x7f7c58156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:55.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.974+0000 7f7c5de00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580c6500 con 0x7f7c5813c240 2024-09-13T17:53:55.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.974+0000 7f7c5de00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580c43d0 con 0x7f7c5813f420 2024-09-13T17:53:55.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.974+0000 7f7c5de00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c58157130 con 0x7f7c5806da90 2024-09-13T17:53:55.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.978+0000 7f7c4e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c5813c240 0x7f7c580c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:55.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.978+0000 7f7c4e000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c5813c240 0x7f7c580c3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48590/0 (socket says 172.21.15.114:48590) 2024-09-13T17:53:55.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.978+0000 7f7c4e000640 1 -- 172.21.15.114:0/1145928582 learned_addr learned my addr 172.21.15.114:0/1145928582 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:55.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.978+0000 7f7c57400640 1 --2- 172.21.15.114:0/1145928582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c5813f420 0x7f7c58156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:55.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.978+0000 7f7c56a00640 1 --2- 172.21.15.114:0/1145928582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c5806da90 0x7f7c580ad0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:55.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.978+0000 7f7c4e000640 1 -- 172.21.15.114:0/1145928582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c5806da90 msgr2=0x7f7c580ad0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:55.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.978+0000 7f7c4e000640 1 --2- 172.21.15.114:0/1145928582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c5806da90 0x7f7c580ad0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:55.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.978+0000 7f7c4e000640 1 -- 172.21.15.114:0/1145928582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c5813f420 msgr2=0x7f7c58156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:55.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.978+0000 7f7c4e000640 1 --2- 172.21.15.114:0/1145928582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c5813f420 0x7f7c58156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:55.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.978+0000 7f7c4e000640 1 -- 172.21.15.114:0/1145928582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c40009420 con 0x7f7c5813c240 2024-09-13T17:53:55.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.978+0000 7f7c57400640 1 --2- 172.21.15.114:0/1145928582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c5813f420 0x7f7c58156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:55.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.978+0000 7f7c56a00640 1 --2- 172.21.15.114:0/1145928582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c5806da90 0x7f7c580ad0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:55.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.978+0000 7f7c4e000640 1 --2- 172.21.15.114:0/1145928582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c5813c240 0x7f7c580c3e90 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f7c40019080 tx=0x7f7c40019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:55.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.978+0000 7f7c4fe00640 1 -- 172.21.15.114:0/1145928582 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c400b4410 con 0x7f7c5813c240 2024-09-13T17:53:55.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.978+0000 7f7c4fe00640 1 -- 172.21.15.114:0/1145928582 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c400b4570 con 0x7f7c5813c240 2024-09-13T17:53:55.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.978+0000 7f7c5de00640 1 -- 172.21.15.114:0/1145928582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c580c4630 con 0x7f7c5813c240 2024-09-13T17:53:55.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.978+0000 7f7c4fe00640 1 -- 172.21.15.114:0/1145928582 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c400b4920 con 0x7f7c5813c240 2024-09-13T17:53:55.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.978+0000 7f7c5de00640 1 -- 172.21.15.114:0/1145928582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c580c4bf0 con 0x7f7c5813c240 2024-09-13T17:53:55.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.978+0000 7f7c5de00640 1 -- 172.21.15.114:0/1145928582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c580c53f0 con 0x7f7c5813c240 2024-09-13T17:53:55.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.978+0000 7f7c4fe00640 1 -- 172.21.15.114:0/1145928582 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7c400b2040 con 0x7f7c5813c240 2024-09-13T17:53:55.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.978+0000 7f7c4fe00640 1 --2- 172.21.15.114:0/1145928582 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7c34066690 0x7f7c34068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:55.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.978+0000 7f7c4fe00640 1 -- 172.21.15.114:0/1145928582 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f7c4011e3c0 con 0x7f7c5813c240 2024-09-13T17:53:55.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.982+0000 7f7c56a00640 1 --2- 172.21.15.114:0/1145928582 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7c34066690 0x7f7c34068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:55.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.982+0000 7f7c56a00640 1 --2- 172.21.15.114:0/1145928582 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7c34066690 0x7f7c34068b50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7c480012f0 tx=0x7f7c48009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:55.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:55.986+0000 7f7c4fe00640 1 -- 172.21.15.114:0/1145928582 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7c580c53f0 con 0x7f7c5813c240 2024-09-13T17:53:56.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.142+0000 7f7c5de00640 1 -- 172.21.15.114:0/1145928582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c580c53f0 con 0x7f7c5813c240 2024-09-13T17:53:56.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.142+0000 7f7c4fe00640 1 -- 172.21.15.114:0/1145928582 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16961 (secure 0 0 0) 0x7f7c580c53f0 con 0x7f7c5813c240 2024-09-13T17:53:56.148 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:56.148 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":49,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:53:55.477488+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:53:07.297633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2024-09-13T17:53:31.026998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.35","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6835/1239035445":"2024-09-14T17:53:22.929223+0000","172.21.15.134:6833/1239035445":"2024-09-14T17:53:22.929223+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:53:56.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.142+0000 7f7c5de00640 1 -- 172.21.15.114:0/1145928582 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7c34066690 msgr2=0x7f7c34068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:56.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.142+0000 7f7c5de00640 1 --2- 172.21.15.114:0/1145928582 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7c34066690 0x7f7c34068b50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7c480012f0 tx=0x7f7c48009040 comp rx=0 tx=0).stop 2024-09-13T17:53:56.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.142+0000 7f7c5de00640 1 -- 172.21.15.114:0/1145928582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c5813c240 msgr2=0x7f7c580c3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:56.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.142+0000 7f7c5de00640 1 --2- 172.21.15.114:0/1145928582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c5813c240 0x7f7c580c3e90 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f7c40019080 tx=0x7f7c40019210 comp rx=0 tx=0).stop 2024-09-13T17:53:56.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.142+0000 7f7c5de00640 1 -- 172.21.15.114:0/1145928582 shutdown_connections 2024-09-13T17:53:56.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.142+0000 7f7c5de00640 1 --2- 172.21.15.114:0/1145928582 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7c34066690 0x7f7c34068b50 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:56.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.142+0000 7f7c5de00640 1 --2- 172.21.15.114:0/1145928582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c5813f420 0x7f7c58156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:56.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.142+0000 7f7c5de00640 1 --2- 172.21.15.114:0/1145928582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c5813c240 0x7f7c580c3e90 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:56.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.142+0000 7f7c5de00640 1 --2- 172.21.15.114:0/1145928582 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7c5806da90 0x7f7c580ad0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:56.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.142+0000 7f7c5de00640 1 -- 172.21.15.114:0/1145928582 >> 172.21.15.114:0/1145928582 conn(0x7f7c580660b0 msgr2=0x7f7c58158ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:56.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.142+0000 7f7c5de00640 1 -- 172.21.15.114:0/1145928582 shutdown_connections 2024-09-13T17:53:56.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.146+0000 7f7c5de00640 1 -- 172.21.15.114:0/1145928582 wait complete. 2024-09-13T17:53:56.169 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:51:37.996254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T17:53:07.297633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'recovery_fs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'recovery_fs_metadata', 'create_time': '2024-09-13T17:53:31.026998+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'recovery_fs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T17:53:56.169 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T17:53:56.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.302+0000 7f473ac00640 1 Processor -- start 2024-09-13T17:53:56.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.302+0000 7f473ac00640 1 -- start start 2024-09-13T17:53:56.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.302+0000 7f473ac00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4734070420 0x7f47340708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:56.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.302+0000 7f473ac00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47340adfb0 con 0x7f473406d030 2024-09-13T17:53:56.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.302+0000 7f473ac00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47340adcd0 con 0x7f47340cdad0 2024-09-13T17:53:56.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.302+0000 7f473ac00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473406cc10 con 0x7f4734070420 2024-09-13T17:53:56.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.302+0000 7f4738c00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f473406d030 0x7f473406d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56870/0 (socket says 172.21.15.114:56870) 2024-09-13T17:53:56.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.302+0000 7f4738c00640 1 -- 172.21.15.114:0/1959493261 learned_addr learned my addr 172.21.15.114:0/1959493261 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:56.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.302+0000 7f472b400640 1 --2- 172.21.15.114:0/1959493261 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4734070420 0x7f47340708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:56.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.302+0000 7f4733400640 1 -- 172.21.15.114:0/1959493261 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2840397835 0 0) 0x7f47340adfb0 con 0x7f473406d030 2024-09-13T17:53:56.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.302+0000 7f4733400640 1 -- 172.21.15.114:0/1959493261 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4718003530 con 0x7f473406d030 2024-09-13T17:53:56.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.302+0000 7f4733400640 1 -- 172.21.15.114:0/1959493261 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828484658 0 0) 0x7f47340adcd0 con 0x7f47340cdad0 2024-09-13T17:53:56.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.302+0000 7f4733400640 1 -- 172.21.15.114:0/1959493261 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47340adfb0 con 0x7f47340cdad0 2024-09-13T17:53:56.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.302+0000 7f472b400640 1 -- 172.21.15.114:0/1959493261 >> v1:172.21.15.134:6789/0 conn(0x7f47340cdad0 legacy=0x7f47340ad4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:56.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.302+0000 7f472b400640 1 -- 172.21.15.114:0/1959493261 >> v1:172.21.15.114:6789/0 conn(0x7f473406d030 legacy=0x7f473406d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:56.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.302+0000 7f472b400640 1 -- 172.21.15.114:0/1959493261 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473406c550 con 0x7f4734070420 2024-09-13T17:53:56.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.306+0000 7f472b400640 1 --2- 172.21.15.114:0/1959493261 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4734070420 0x7f47340708b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f471c0097f0 tx=0x7f471c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c64273c650772516 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:56.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.306+0000 7f4733400640 1 -- 172.21.15.114:0/1959493261 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c0ab600 con 0x7f4734070420 2024-09-13T17:53:56.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.306+0000 7f4733400640 1 -- 172.21.15.114:0/1959493261 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471c0a7050 con 0x7f4734070420 2024-09-13T17:53:56.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.306+0000 7f4733400640 1 -- 172.21.15.114:0/1959493261 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c0ab980 con 0x7f4734070420 2024-09-13T17:53:56.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.306+0000 7f473ac00640 1 -- 172.21.15.114:0/1959493261 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4734070420 msgr2=0x7f47340708b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:56.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.306+0000 7f473ac00640 1 --2- 172.21.15.114:0/1959493261 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4734070420 0x7f47340708b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f471c0097f0 tx=0x7f471c01c450 comp rx=0 tx=0).stop 2024-09-13T17:53:56.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.306+0000 7f473ac00640 1 -- 172.21.15.114:0/1959493261 shutdown_connections 2024-09-13T17:53:56.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.306+0000 7f473ac00640 1 --2- 172.21.15.114:0/1959493261 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4734070420 0x7f47340708b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:56.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.306+0000 7f473ac00640 1 -- 172.21.15.114:0/1959493261 >> 172.21.15.114:0/1959493261 conn(0x7f47340660b0 msgr2=0x7f4734069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:56.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.306+0000 7f473ac00640 1 -- 172.21.15.114:0/1959493261 shutdown_connections 2024-09-13T17:53:56.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.306+0000 7f473ac00640 1 -- 172.21.15.114:0/1959493261 wait complete. 2024-09-13T17:53:56.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.310+0000 7f473ac00640 1 Processor -- start 2024-09-13T17:53:56.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.310+0000 7f473ac00640 1 -- start start 2024-09-13T17:53:56.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.310+0000 7f473ac00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f473406d030 0x7f4734145f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:56.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.310+0000 7f473ac00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4734070420 0x7f473414eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:56.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.310+0000 7f473ac00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47340cdad0 0x7f4734153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:56.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.310+0000 7f473ac00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4734146480 con 0x7f47340cdad0 2024-09-13T17:53:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.310+0000 7f473ac00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4734151fc0 con 0x7f473406d030 2024-09-13T17:53:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.310+0000 7f473ac00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47341522a0 con 0x7f4734070420 2024-09-13T17:53:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.310+0000 7f4738c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47340cdad0 0x7f4734153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.310+0000 7f4738c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47340cdad0 0x7f4734153060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48594/0 (socket says 172.21.15.114:48594) 2024-09-13T17:53:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.310+0000 7f4738c00640 1 -- 172.21.15.114:0/3328782986 learned_addr learned my addr 172.21.15.114:0/3328782986 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.310+0000 7f4733e00640 1 --2- 172.21.15.114:0/3328782986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f473406d030 0x7f4734145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.310+0000 7f472b400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4734070420 0x7f473414eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.310+0000 7f4738c00640 1 -- 172.21.15.114:0/3328782986 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4734070420 msgr2=0x7f473414eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.310+0000 7f4738c00640 1 --2- 172.21.15.114:0/3328782986 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4734070420 0x7f473414eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.310+0000 7f4738c00640 1 -- 172.21.15.114:0/3328782986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f473406d030 msgr2=0x7f4734145f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.310+0000 7f4738c00640 1 --2- 172.21.15.114:0/3328782986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f473406d030 0x7f4734145f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.310+0000 7f4738c00640 1 -- 172.21.15.114:0/3328782986 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471c009420 con 0x7f47340cdad0 2024-09-13T17:53:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.310+0000 7f4733e00640 1 --2- 172.21.15.114:0/3328782986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f473406d030 0x7f4734145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:53:56.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.310+0000 7f4738c00640 1 --2- 172.21.15.114:0/3328782986 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47340cdad0 0x7f4734153060 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f472c00caa0 tx=0x7f472c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:56.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.310+0000 7f4730c00640 1 -- 172.21.15.114:0/3328782986 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c00ac00 con 0x7f47340cdad0 2024-09-13T17:53:56.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.310+0000 7f4730c00640 1 -- 172.21.15.114:0/3328782986 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472c00ad80 con 0x7f47340cdad0 2024-09-13T17:53:56.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.310+0000 7f473ac00640 1 -- 172.21.15.114:0/3328782986 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4734152580 con 0x7f47340cdad0 2024-09-13T17:53:56.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.310+0000 7f4730c00640 1 -- 172.21.15.114:0/3328782986 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c012640 con 0x7f47340cdad0 2024-09-13T17:53:56.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.310+0000 7f473ac00640 1 -- 172.21.15.114:0/3328782986 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4734152b40 con 0x7f47340cdad0 2024-09-13T17:53:56.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.314+0000 7f473ac00640 1 -- 172.21.15.114:0/3328782986 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4734067960 con 0x7f47340cdad0 2024-09-13T17:53:56.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.314+0000 7f4730c00640 1 -- 172.21.15.114:0/3328782986 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f472c007070 con 0x7f47340cdad0 2024-09-13T17:53:56.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.314+0000 7f4730c00640 1 --2- 172.21.15.114:0/3328782986 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f47100666c0 0x7f4710068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:56.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.314+0000 7f4730c00640 1 -- 172.21.15.114:0/3328782986 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f472c0841d0 con 0x7f47340cdad0 2024-09-13T17:53:56.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.314+0000 7f4733e00640 1 --2- 172.21.15.114:0/3328782986 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f47100666c0 0x7f4710068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:56.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.314+0000 7f4733e00640 1 --2- 172.21.15.114:0/3328782986 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f47100666c0 0x7f4710068b80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f47240011f0 tx=0x7f4724009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:56.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.318+0000 7f4730c00640 1 -- 172.21.15.114:0/3328782986 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f472c051420 con 0x7f47340cdad0 2024-09-13T17:53:56.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.486+0000 7f473ac00640 1 -- 172.21.15.114:0/3328782986 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4734152d30 con 0x7f47340cdad0 2024-09-13T17:53:56.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.486+0000 7f4730c00640 1 -- 172.21.15.114:0/3328782986 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7f472c054a40 con 0x7f47340cdad0 2024-09-13T17:53:56.491 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2024-09-13T17:53:56.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.486+0000 7f473ac00640 1 -- 172.21.15.114:0/3328782986 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f47100666c0 msgr2=0x7f4710068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:56.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.486+0000 7f473ac00640 1 --2- 172.21.15.114:0/3328782986 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f47100666c0 0x7f4710068b80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f47240011f0 tx=0x7f4724009040 comp rx=0 tx=0).stop 2024-09-13T17:53:56.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.486+0000 7f473ac00640 1 -- 172.21.15.114:0/3328782986 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47340cdad0 msgr2=0x7f4734153060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:56.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.486+0000 7f473ac00640 1 --2- 172.21.15.114:0/3328782986 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47340cdad0 0x7f4734153060 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f472c00caa0 tx=0x7f472c00cf60 comp rx=0 tx=0).stop 2024-09-13T17:53:56.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.486+0000 7f473ac00640 1 -- 172.21.15.114:0/3328782986 shutdown_connections 2024-09-13T17:53:56.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.486+0000 7f473ac00640 1 --2- 172.21.15.114:0/3328782986 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f47100666c0 0x7f4710068b80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:56.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.486+0000 7f473ac00640 1 --2- 172.21.15.114:0/3328782986 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47340cdad0 0x7f4734153060 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:56.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.486+0000 7f473ac00640 1 --2- 172.21.15.114:0/3328782986 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f4734070420 0x7f473414eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:56.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.486+0000 7f473ac00640 1 --2- 172.21.15.114:0/3328782986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f473406d030 0x7f4734145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:56.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.486+0000 7f473ac00640 1 -- 172.21.15.114:0/3328782986 >> 172.21.15.114:0/3328782986 conn(0x7f47340660b0 msgr2=0x7f47340b0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:56.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.486+0000 7f473ac00640 1 -- 172.21.15.114:0/3328782986 shutdown_connections 2024-09-13T17:53:56.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.486+0000 7f473ac00640 1 -- 172.21.15.114:0/3328782986 wait complete. 2024-09-13T17:53:56.512 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T17:53:56.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.646+0000 7f72c9e00640 1 Processor -- start 2024-09-13T17:53:56.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.646+0000 7f72c9e00640 1 -- start start 2024-09-13T17:53:56.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.646+0000 7f72c9e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f72c413c240 0x7f72c413f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:56.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.646+0000 7f72c9e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f72c406dc60 0x7f72c40cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:56.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.646+0000 7f72c9e00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c40cd220 con 0x7f72c413c980 2024-09-13T17:53:56.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.646+0000 7f72c9e00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c413f960 con 0x7f72c406dc60 2024-09-13T17:53:56.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.646+0000 7f72c9e00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c415a740 con 0x7f72c413c240 2024-09-13T17:53:56.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.646+0000 7f72ba000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f72c413c980 0x7f72c406d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56872/0 (socket says 172.21.15.114:56872) 2024-09-13T17:53:56.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.646+0000 7f72ba000640 1 -- 172.21.15.114:0/1457945849 learned_addr learned my addr 172.21.15.114:0/1457945849 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:56.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.646+0000 7f72c3400640 1 --2- 172.21.15.114:0/1457945849 >> v2:172.21.15.114:3300/0 conn(0x7f72c406dc60 0x7f72c40cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:56.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.646+0000 7f72c2a00640 1 --2- 172.21.15.114:0/1457945849 >> v2:172.21.15.134:3300/0 conn(0x7f72c413c240 0x7f72c413f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:56.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.646+0000 7f72c2000640 1 -- 172.21.15.114:0/1457945849 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632034498 0 0) 0x7f72c40cd220 con 0x7f72c413c980 2024-09-13T17:53:56.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.646+0000 7f72c2000640 1 -- 172.21.15.114:0/1457945849 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72a8003530 con 0x7f72c413c980 2024-09-13T17:53:56.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.646+0000 7f72c3400640 1 -- 172.21.15.114:0/1457945849 >> v2:172.21.15.134:3300/0 conn(0x7f72c413c240 msgr2=0x7f72c413f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:56.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.646+0000 7f72c3400640 1 --2- 172.21.15.114:0/1457945849 >> v2:172.21.15.134:3300/0 conn(0x7f72c413c240 0x7f72c413f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:56.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.646+0000 7f72c3400640 1 -- 172.21.15.114:0/1457945849 >> v1:172.21.15.114:6789/0 conn(0x7f72c413c980 legacy=0x7f72c406d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:56.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.646+0000 7f72c3400640 1 -- 172.21.15.114:0/1457945849 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c4159bc0 con 0x7f72c406dc60 2024-09-13T17:53:56.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.650+0000 7f72c3400640 1 --2- 172.21.15.114:0/1457945849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72c406dc60 0x7f72c40cd650 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f72c406e720 tx=0x7f72bc01c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191b971a604c9891 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:56.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.650+0000 7f72c2000640 1 -- 172.21.15.114:0/1457945849 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc0a5930 con 0x7f72c406dc60 2024-09-13T17:53:56.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.650+0000 7f72c2000640 1 -- 172.21.15.114:0/1457945849 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72bc0a5a90 con 0x7f72c406dc60 2024-09-13T17:53:56.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.650+0000 7f72c2000640 1 -- 172.21.15.114:0/1457945849 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc0a5e20 con 0x7f72c406dc60 2024-09-13T17:53:56.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.650+0000 7f72c9e00640 1 -- 172.21.15.114:0/1457945849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72c406dc60 msgr2=0x7f72c40cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:56.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.650+0000 7f72c9e00640 1 --2- 172.21.15.114:0/1457945849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72c406dc60 0x7f72c40cd650 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f72c406e720 tx=0x7f72bc01c870 comp rx=0 tx=0).stop 2024-09-13T17:53:56.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.650+0000 7f72c9e00640 1 -- 172.21.15.114:0/1457945849 shutdown_connections 2024-09-13T17:53:56.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.650+0000 7f72c9e00640 1 --2- 172.21.15.114:0/1457945849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72c406dc60 0x7f72c40cd650 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:56.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.650+0000 7f72c9e00640 1 --2- 172.21.15.114:0/1457945849 >> v2:172.21.15.134:3300/0 conn(0x7f72c413c240 0x7f72c413f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:56.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.650+0000 7f72c9e00640 1 -- 172.21.15.114:0/1457945849 >> 172.21.15.114:0/1457945849 conn(0x7f72c40660b0 msgr2=0x7f72c4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:56.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.650+0000 7f72c9e00640 1 -- 172.21.15.114:0/1457945849 shutdown_connections 2024-09-13T17:53:56.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.650+0000 7f72c9e00640 1 -- 172.21.15.114:0/1457945849 wait complete. 2024-09-13T17:53:56.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.654+0000 7f72c9e00640 1 Processor -- start 2024-09-13T17:53:56.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.654+0000 7f72c9e00640 1 -- start start 2024-09-13T17:53:56.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.654+0000 7f72c9e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72c406dc60 0x7f72c41558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:56.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.654+0000 7f72c9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72c413c240 0x7f72c40b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:56.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.654+0000 7f72c9e00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72c413c980 0x7f72c4153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:56.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.654+0000 7f72c9e00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c40b0180 con 0x7f72c413c240 2024-09-13T17:53:56.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.654+0000 7f72c9e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c40abe50 con 0x7f72c406dc60 2024-09-13T17:53:56.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.654+0000 7f72c9e00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c4155ed0 con 0x7f72c413c980 2024-09-13T17:53:56.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.654+0000 7f72ba000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72c413c240 0x7f72c40b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:56.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.654+0000 7f72c2a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72c406dc60 0x7f72c41558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:56.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.654+0000 7f72ba000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72c413c240 0x7f72c40b0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48612/0 (socket says 172.21.15.114:48612) 2024-09-13T17:53:56.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.654+0000 7f72ba000640 1 -- 172.21.15.114:0/1524155681 learned_addr learned my addr 172.21.15.114:0/1524155681 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:56.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.654+0000 7f72c3400640 1 --2- 172.21.15.114:0/1524155681 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72c413c980 0x7f72c4153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:56.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.654+0000 7f72ba000640 1 -- 172.21.15.114:0/1524155681 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72c413c980 msgr2=0x7f72c4153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:56.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.654+0000 7f72ba000640 1 --2- 172.21.15.114:0/1524155681 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72c413c980 0x7f72c4153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:56.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.654+0000 7f72ba000640 1 -- 172.21.15.114:0/1524155681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72c406dc60 msgr2=0x7f72c41558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:56.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.654+0000 7f72ba000640 1 --2- 172.21.15.114:0/1524155681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72c406dc60 0x7f72c41558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:56.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.654+0000 7f72ba000640 1 -- 172.21.15.114:0/1524155681 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72bc009a70 con 0x7f72c413c240 2024-09-13T17:53:56.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.654+0000 7f72c2a00640 1 --2- 172.21.15.114:0/1524155681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72c406dc60 0x7f72c41558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:53:56.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.654+0000 7f72ba000640 1 --2- 172.21.15.114:0/1524155681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72c413c240 0x7f72c40b0b20 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00c500 tx=0x7f72ac00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:56.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.654+0000 7f72bbe00640 1 -- 172.21.15.114:0/1524155681 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac005cf0 con 0x7f72c413c240 2024-09-13T17:53:56.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.654+0000 7f72bbe00640 1 -- 172.21.15.114:0/1524155681 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ac005e50 con 0x7f72c413c240 2024-09-13T17:53:56.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.654+0000 7f72c9e00640 1 -- 172.21.15.114:0/1524155681 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c41561b0 con 0x7f72c413c240 2024-09-13T17:53:56.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.654+0000 7f72bbe00640 1 -- 172.21.15.114:0/1524155681 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac0072f0 con 0x7f72c413c240 2024-09-13T17:53:56.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.654+0000 7f72c9e00640 1 -- 172.21.15.114:0/1524155681 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c40b1060 con 0x7f72c413c240 2024-09-13T17:53:56.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.654+0000 7f72c9e00640 1 -- 172.21.15.114:0/1524155681 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c40ac020 con 0x7f72c413c240 2024-09-13T17:53:56.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.658+0000 7f72bbe00640 1 -- 172.21.15.114:0/1524155681 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f72ac007450 con 0x7f72c413c240 2024-09-13T17:53:56.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.658+0000 7f72bbe00640 1 --2- 172.21.15.114:0/1524155681 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f72a0066690 0x7f72a0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:56.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.658+0000 7f72bbe00640 1 -- 172.21.15.114:0/1524155681 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f72ac0838c0 con 0x7f72c413c240 2024-09-13T17:53:56.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.658+0000 7f72c2a00640 1 --2- 172.21.15.114:0/1524155681 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f72a0066690 0x7f72a0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:56.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.658+0000 7f72c2a00640 1 --2- 172.21.15.114:0/1524155681 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f72a0066690 0x7f72a0068b50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f72b4007e50 tx=0x7f72b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:56.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.662+0000 7f72bbe00640 1 -- 172.21.15.114:0/1524155681 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f72c40ac020 con 0x7f72c413c240 2024-09-13T17:53:56.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.814+0000 7f72c9e00640 1 -- 172.21.15.114:0/1524155681 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f72c40ac020 con 0x7f72c413c240 2024-09-13T17:53:56.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.814+0000 7f72bbe00640 1 -- 172.21.15.114:0/1524155681 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7f72c40ac020 con 0x7f72c413c240 2024-09-13T17:53:56.821 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2024-09-13T17:53:56.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.818+0000 7f72c9e00640 1 -- 172.21.15.114:0/1524155681 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f72a0066690 msgr2=0x7f72a0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:56.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.818+0000 7f72c9e00640 1 --2- 172.21.15.114:0/1524155681 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f72a0066690 0x7f72a0068b50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f72b4007e50 tx=0x7f72b4008040 comp rx=0 tx=0).stop 2024-09-13T17:53:56.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.818+0000 7f72c9e00640 1 -- 172.21.15.114:0/1524155681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72c413c240 msgr2=0x7f72c40b0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:56.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.818+0000 7f72c9e00640 1 --2- 172.21.15.114:0/1524155681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72c413c240 0x7f72c40b0b20 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00c500 tx=0x7f72ac00c9c0 comp rx=0 tx=0).stop 2024-09-13T17:53:56.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.818+0000 7f72c9e00640 1 -- 172.21.15.114:0/1524155681 shutdown_connections 2024-09-13T17:53:56.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.818+0000 7f72c9e00640 1 --2- 172.21.15.114:0/1524155681 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f72a0066690 0x7f72a0068b50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:56.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.818+0000 7f72c9e00640 1 --2- 172.21.15.114:0/1524155681 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72c413c980 0x7f72c4153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:56.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.818+0000 7f72c9e00640 1 --2- 172.21.15.114:0/1524155681 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72c413c240 0x7f72c40b0b20 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:56.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.818+0000 7f72c9e00640 1 --2- 172.21.15.114:0/1524155681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72c406dc60 0x7f72c41558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:56.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.818+0000 7f72c9e00640 1 -- 172.21.15.114:0/1524155681 >> 172.21.15.114:0/1524155681 conn(0x7f72c40660b0 msgr2=0x7f72c4157be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:56.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.818+0000 7f72c9e00640 1 -- 172.21.15.114:0/1524155681 shutdown_connections 2024-09-13T17:53:56.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.818+0000 7f72c9e00640 1 -- 172.21.15.114:0/1524155681 wait complete. 2024-09-13T17:53:56.841 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get recovery_fs_metadata pg_num 2024-09-13T17:53:56.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f925e800640 1 Processor -- start 2024-09-13T17:53:56.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f925e800640 1 -- start start 2024-09-13T17:53:56.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f925e800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9258070420 0x7f9258070860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:56.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f925e800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9258070da0 con 0x7f9258151420 2024-09-13T17:53:56.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f925e800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9258151800 con 0x7f925806c540 2024-09-13T17:53:56.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f925e800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92580cbc30 con 0x7f9258070420 2024-09-13T17:53:56.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f9257400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9258151420 0x7f92580cc660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56882/0 (socket says 172.21.15.114:56882) 2024-09-13T17:53:56.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f9257400640 1 -- 172.21.15.114:0/1298909176 learned_addr learned my addr 172.21.15.114:0/1298909176 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:56.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f9256a00640 1 --2- 172.21.15.114:0/1298909176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9258070420 0x7f9258070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:56.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f9256000640 1 -- 172.21.15.114:0/1298909176 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1111953173 0 0) 0x7f9258070da0 con 0x7f9258151420 2024-09-13T17:53:56.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f9256000640 1 -- 172.21.15.114:0/1298909176 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f923c003530 con 0x7f9258151420 2024-09-13T17:53:56.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f9256000640 1 -- 172.21.15.114:0/1298909176 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3575386786 0 0) 0x7f923c003530 con 0x7f9258151420 2024-09-13T17:53:56.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f9256000640 1 -- 172.21.15.114:0/1298909176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9258070420 msgr2=0x7f9258070860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:56.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f9256000640 1 --2- 172.21.15.114:0/1298909176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9258070420 0x7f9258070860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:56.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f9256000640 1 -- 172.21.15.114:0/1298909176 >> v1:172.21.15.134:6789/0 conn(0x7f925806c540 legacy=0x7f925806c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:56.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f9256000640 1 -- 172.21.15.114:0/1298909176 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92580cafb0 con 0x7f9258151420 2024-09-13T17:53:56.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f9256000640 1 -- 172.21.15.114:0/1298909176 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7f9248001680 con 0x7f9258151420 2024-09-13T17:53:56.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f9256000640 1 -- 172.21.15.114:0/1298909176 >> v1:172.21.15.114:6789/0 conn(0x7f9258151420 legacy=0x7f92580cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:56.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f9256000640 1 --2- 172.21.15.114:0/1298909176 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f923c0039b0 0x7f923c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:56.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f9256000640 1 --2- 172.21.15.114:0/1298909176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9258070420 0x7f923c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:56.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f9256000640 1 --2- 172.21.15.114:0/1298909176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f923c004d10 0x7f923c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:56.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f9256000640 1 -- 172.21.15.114:0/1298909176 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92580cbc30 con 0x7f923c0039b0 2024-09-13T17:53:56.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f9256000640 1 -- 172.21.15.114:0/1298909176 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c00bb80 con 0x7f923c004d10 2024-09-13T17:53:56.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f9256000640 1 -- 172.21.15.114:0/1298909176 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923c00bd40 con 0x7f9258070420 2024-09-13T17:53:56.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f9257400640 1 --2- 172.21.15.114:0/1298909176 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f923c0039b0 0x7f923c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:56.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f9256a00640 1 --2- 172.21.15.114:0/1298909176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9258070420 0x7f923c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:56.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f9257e00640 1 --2- 172.21.15.114:0/1298909176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f923c004d10 0x7f923c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:56.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f9257400640 1 -- 172.21.15.114:0/1298909176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9258070420 msgr2=0x7f923c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:56.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f9257400640 1 --2- 172.21.15.114:0/1298909176 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9258070420 0x7f923c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:56.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f9257400640 1 -- 172.21.15.114:0/1298909176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f923c004d10 msgr2=0x7f923c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:56.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f9257400640 1 --2- 172.21.15.114:0/1298909176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f923c004d10 0x7f923c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:56.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f9257400640 1 -- 172.21.15.114:0/1298909176 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923c003530 con 0x7f923c0039b0 2024-09-13T17:53:56.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.974+0000 7f9257e00640 1 --2- 172.21.15.114:0/1298909176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f923c004d10 0x7f923c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:56.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.978+0000 7f9257400640 1 --2- 172.21.15.114:0/1298909176 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f923c0039b0 0x7f923c003dd0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f924800c240 tx=0x7f924801cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13cc8a5f63ef342 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:56.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.978+0000 7f9256000640 1 -- 172.21.15.114:0/1298909176 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925806d8b0 con 0x7f923c0039b0 2024-09-13T17:53:56.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.978+0000 7f9256000640 1 -- 172.21.15.114:0/1298909176 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9248005ae0 con 0x7f923c0039b0 2024-09-13T17:53:56.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.978+0000 7f9256000640 1 -- 172.21.15.114:0/1298909176 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92480a5890 con 0x7f923c0039b0 2024-09-13T17:53:56.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.978+0000 7f925e800640 1 -- 172.21.15.114:0/1298909176 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f923c0039b0 msgr2=0x7f923c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:56.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.978+0000 7f925e800640 1 --2- 172.21.15.114:0/1298909176 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f923c0039b0 0x7f923c003dd0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f924800c240 tx=0x7f924801cc30 comp rx=0 tx=0).stop 2024-09-13T17:53:56.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.978+0000 7f9257e00640 1 -- 172.21.15.114:0/1298909176 reap_dead start 2024-09-13T17:53:56.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.978+0000 7f925e800640 1 -- 172.21.15.114:0/1298909176 shutdown_connections 2024-09-13T17:53:56.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.978+0000 7f925e800640 1 -- 172.21.15.114:0/1298909176 >> 172.21.15.114:0/1298909176 conn(0x7f92580660b0 msgr2=0x7f9258069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:56.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.978+0000 7f925e800640 1 -- 172.21.15.114:0/1298909176 shutdown_connections 2024-09-13T17:53:56.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.978+0000 7f925e800640 1 -- 172.21.15.114:0/1298909176 wait complete. 2024-09-13T17:53:56.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.982+0000 7f925e800640 1 Processor -- start 2024-09-13T17:53:56.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.982+0000 7f925e800640 1 -- start start 2024-09-13T17:53:56.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.982+0000 7f925e800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f923c0039b0 0x7f925814b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:56.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.982+0000 7f925e800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92581601b0 0x7f9258160630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:56.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.982+0000 7f925e800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92580af8b0 0x7f92580afd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:56.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.982+0000 7f925e800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9258160b70 con 0x7f92581601b0 2024-09-13T17:53:56.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.982+0000 7f925e800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925814be50 con 0x7f923c0039b0 2024-09-13T17:53:56.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.982+0000 7f925e800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925815b990 con 0x7f92580af8b0 2024-09-13T17:53:56.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.982+0000 7f9256a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92581601b0 0x7f9258160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:56.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.982+0000 7f9256a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92581601b0 0x7f9258160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48632/0 (socket says 172.21.15.114:48632) 2024-09-13T17:53:56.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.982+0000 7f9256a00640 1 -- 172.21.15.114:0/358091083 learned_addr learned my addr 172.21.15.114:0/358091083 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:56.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.982+0000 7f9257400640 1 --2- 172.21.15.114:0/358091083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f923c0039b0 0x7f925814b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:56.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.982+0000 7f9257e00640 1 --2- 172.21.15.114:0/358091083 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92580af8b0 0x7f92580afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:56.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.982+0000 7f9256a00640 1 -- 172.21.15.114:0/358091083 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92580af8b0 msgr2=0x7f92580afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:56.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.982+0000 7f9256a00640 1 --2- 172.21.15.114:0/358091083 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92580af8b0 0x7f92580afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:56.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.982+0000 7f9256a00640 1 -- 172.21.15.114:0/358091083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f923c0039b0 msgr2=0x7f925814b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:56.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.982+0000 7f9256a00640 1 --2- 172.21.15.114:0/358091083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f923c0039b0 0x7f925814b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:56.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.982+0000 7f9256a00640 1 -- 172.21.15.114:0/358091083 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9258070c10 con 0x7f92581601b0 2024-09-13T17:53:56.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.982+0000 7f9257e00640 1 --2- 172.21.15.114:0/358091083 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92580af8b0 0x7f92580afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:53:56.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.982+0000 7f9256a00640 1 --2- 172.21.15.114:0/358091083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92581601b0 0x7f9258160630 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f92440119d0 tx=0x7f9244011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:56.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.982+0000 7f924f400640 1 -- 172.21.15.114:0/358091083 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924400fb50 con 0x7f92581601b0 2024-09-13T17:53:56.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.982+0000 7f924f400640 1 -- 172.21.15.114:0/358091083 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924400fcb0 con 0x7f92581601b0 2024-09-13T17:53:56.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.982+0000 7f924f400640 1 -- 172.21.15.114:0/358091083 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9244014440 con 0x7f92581601b0 2024-09-13T17:53:56.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.982+0000 7f925e800640 1 -- 172.21.15.114:0/358091083 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f925815bc70 con 0x7f92581601b0 2024-09-13T17:53:56.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.982+0000 7f925e800640 1 -- 172.21.15.114:0/358091083 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f925815c230 con 0x7f92581601b0 2024-09-13T17:53:56.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.986+0000 7f925e800640 1 -- 172.21.15.114:0/358091083 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f925806c990 con 0x7f92581601b0 2024-09-13T17:53:56.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.986+0000 7f924f400640 1 -- 172.21.15.114:0/358091083 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f92440145a0 con 0x7f92581601b0 2024-09-13T17:53:56.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.986+0000 7f924f400640 1 --2- 172.21.15.114:0/358091083 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f92380666c0 0x7f9238068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:56.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.986+0000 7f924f400640 1 -- 172.21.15.114:0/358091083 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f9244084b80 con 0x7f92581601b0 2024-09-13T17:53:56.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.986+0000 7f9257400640 1 --2- 172.21.15.114:0/358091083 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f92380666c0 0x7f9238068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:56.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.986+0000 7f9257400640 1 --2- 172.21.15.114:0/358091083 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f92380666c0 0x7f9238068b80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f92480ab000 tx=0x7f92480a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:56.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:56.990+0000 7f924f400640 1 -- 172.21.15.114:0/358091083 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9244051d50 con 0x7f92581601b0 2024-09-13T17:53:57.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.142+0000 7f925e800640 1 -- 172.21.15.114:0/358091083 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "recovery_fs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f92580b1b30 con 0x7f92581601b0 2024-09-13T17:53:57.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.146+0000 7f924f400640 1 -- 172.21.15.114:0/358091083 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "recovery_fs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 109+0+11 (secure 0 0 0) 0x7f9244022020 con 0x7f92581601b0 2024-09-13T17:53:57.150 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2024-09-13T17:53:57.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.146+0000 7f925e800640 1 -- 172.21.15.114:0/358091083 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f92380666c0 msgr2=0x7f9238068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:57.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.146+0000 7f925e800640 1 --2- 172.21.15.114:0/358091083 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f92380666c0 0x7f9238068b80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f92480ab000 tx=0x7f92480a7070 comp rx=0 tx=0).stop 2024-09-13T17:53:57.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.146+0000 7f925e800640 1 -- 172.21.15.114:0/358091083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92581601b0 msgr2=0x7f9258160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:57.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.146+0000 7f925e800640 1 --2- 172.21.15.114:0/358091083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92581601b0 0x7f9258160630 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f92440119d0 tx=0x7f9244011e90 comp rx=0 tx=0).stop 2024-09-13T17:53:57.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.146+0000 7f925e800640 1 -- 172.21.15.114:0/358091083 shutdown_connections 2024-09-13T17:53:57.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.146+0000 7f925e800640 1 --2- 172.21.15.114:0/358091083 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f92380666c0 0x7f9238068b80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.146+0000 7f925e800640 1 --2- 172.21.15.114:0/358091083 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f92580af8b0 0x7f92580afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.146+0000 7f925e800640 1 --2- 172.21.15.114:0/358091083 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f92581601b0 0x7f9258160630 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.146+0000 7f925e800640 1 --2- 172.21.15.114:0/358091083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f923c0039b0 0x7f925814b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.146+0000 7f925e800640 1 -- 172.21.15.114:0/358091083 >> 172.21.15.114:0/358091083 conn(0x7f92580660b0 msgr2=0x7f92580b2330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:57.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.146+0000 7f925e800640 1 -- 172.21.15.114:0/358091083 shutdown_connections 2024-09-13T17:53:57.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.146+0000 7f925e800640 1 -- 172.21.15.114:0/358091083 wait complete. 2024-09-13T17:53:57.171 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:53:57.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.298+0000 7f549d200640 1 Processor -- start 2024-09-13T17:53:57.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.298+0000 7f549d200640 1 -- start start 2024-09-13T17:53:57.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f549d200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f549813c240 0x7f549813f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:57.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f549d200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54980cd220 con 0x7f549813c980 2024-09-13T17:53:57.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f549d200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f549813f960 con 0x7f549806dc60 2024-09-13T17:53:57.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f549d200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549815a740 con 0x7f549813c240 2024-09-13T17:53:57.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f548fe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f549813c980 0x7f549806d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56898/0 (socket says 172.21.15.114:56898) 2024-09-13T17:53:57.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f548fe00640 1 -- 172.21.15.114:0/3679010496 learned_addr learned my addr 172.21.15.114:0/3679010496 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:57.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f5495e00640 1 --2- 172.21.15.114:0/3679010496 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f549813c240 0x7f549813f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:57.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f5495400640 1 -- 172.21.15.114:0/3679010496 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1107372783 0 0) 0x7f54980cd220 con 0x7f549813c980 2024-09-13T17:53:57.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f5495400640 1 -- 172.21.15.114:0/3679010496 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f547c003530 con 0x7f549813c980 2024-09-13T17:53:57.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f5495400640 1 -- 172.21.15.114:0/3679010496 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1646425467 0 0) 0x7f54900014a0 con 0x7f549806dc60 2024-09-13T17:53:57.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f5495400640 1 -- 172.21.15.114:0/3679010496 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54980cd220 con 0x7f549806dc60 2024-09-13T17:53:57.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f5495400640 1 -- 172.21.15.114:0/3679010496 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1534101366 0 0) 0x7f547c003530 con 0x7f549813c980 2024-09-13T17:53:57.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f5495400640 1 -- 172.21.15.114:0/3679010496 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f549813c240 msgr2=0x7f549813f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:57.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f5495400640 1 --2- 172.21.15.114:0/3679010496 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f549813c240 0x7f549813f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f5495400640 1 -- 172.21.15.114:0/3679010496 >> v1:172.21.15.134:6789/0 conn(0x7f549806dc60 legacy=0x7f54980cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:57.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f5495400640 1 -- 172.21.15.114:0/3679010496 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5498159bc0 con 0x7f549813c980 2024-09-13T17:53:57.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f5495400640 1 -- 172.21.15.114:0/3679010496 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7f5480001680 con 0x7f549813c980 2024-09-13T17:53:57.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f5495400640 1 -- 172.21.15.114:0/3679010496 >> v1:172.21.15.114:6789/0 conn(0x7f549813c980 legacy=0x7f549806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:57.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f5495400640 1 --2- 172.21.15.114:0/3679010496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f547c003b40 0x7f547c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:57.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f5495400640 1 --2- 172.21.15.114:0/3679010496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f547c0047d0 0x7f547c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:57.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f5495400640 1 --2- 172.21.15.114:0/3679010496 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f547c005190 0x7f547c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:57.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f5495400640 1 -- 172.21.15.114:0/3679010496 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549815a740 con 0x7f547c003b40 2024-09-13T17:53:57.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f5495400640 1 -- 172.21.15.114:0/3679010496 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c00bf80 con 0x7f547c0047d0 2024-09-13T17:53:57.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f5495400640 1 -- 172.21.15.114:0/3679010496 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547c00c140 con 0x7f547c005190 2024-09-13T17:53:57.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f5495e00640 1 --2- 172.21.15.114:0/3679010496 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f549813c240 0x7f549813f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:53:57.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f5495e00640 1 --2- 172.21.15.114:0/3679010496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f547c003b40 0x7f547c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:57.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f548fe00640 1 --2- 172.21.15.114:0/3679010496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f547c0047d0 0x7f547c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:57.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f5496800640 1 --2- 172.21.15.114:0/3679010496 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f547c005190 0x7f547c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:57.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f5495e00640 1 -- 172.21.15.114:0/3679010496 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f547c005190 msgr2=0x7f547c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:57.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f5495e00640 1 --2- 172.21.15.114:0/3679010496 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f547c005190 0x7f547c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f5495e00640 1 -- 172.21.15.114:0/3679010496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f547c0047d0 msgr2=0x7f547c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:57.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f5495e00640 1 --2- 172.21.15.114:0/3679010496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f547c0047d0 0x7f547c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.302+0000 7f5495e00640 1 -- 172.21.15.114:0/3679010496 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547c003530 con 0x7f547c003b40 2024-09-13T17:53:57.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.306+0000 7f5495e00640 1 --2- 172.21.15.114:0/3679010496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f547c003b40 0x7f547c003f40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f549806e510 tx=0x7f548801ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7999e304e5a9352 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:57.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.306+0000 7f5495400640 1 -- 172.21.15.114:0/3679010496 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5488004030 con 0x7f547c003b40 2024-09-13T17:53:57.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.306+0000 7f5495400640 1 -- 172.21.15.114:0/3679010496 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5488004190 con 0x7f547c003b40 2024-09-13T17:53:57.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.306+0000 7f5495400640 1 -- 172.21.15.114:0/3679010496 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5488004520 con 0x7f547c003b40 2024-09-13T17:53:57.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.306+0000 7f549d200640 1 -- 172.21.15.114:0/3679010496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f547c003b40 msgr2=0x7f547c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:57.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.306+0000 7f549d200640 1 --2- 172.21.15.114:0/3679010496 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f547c003b40 0x7f547c003f40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f549806e510 tx=0x7f548801ca80 comp rx=0 tx=0).stop 2024-09-13T17:53:57.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.306+0000 7f5496800640 1 -- 172.21.15.114:0/3679010496 reap_dead start 2024-09-13T17:53:57.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.306+0000 7f549d200640 1 -- 172.21.15.114:0/3679010496 shutdown_connections 2024-09-13T17:53:57.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.306+0000 7f549d200640 1 -- 172.21.15.114:0/3679010496 >> 172.21.15.114:0/3679010496 conn(0x7f54980660b0 msgr2=0x7f5498069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:57.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.306+0000 7f549d200640 1 -- 172.21.15.114:0/3679010496 shutdown_connections 2024-09-13T17:53:57.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.306+0000 7f549d200640 1 -- 172.21.15.114:0/3679010496 wait complete. 2024-09-13T17:53:57.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.306+0000 7f549d200640 1 Processor -- start 2024-09-13T17:53:57.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.310+0000 7f549d200640 1 -- start start 2024-09-13T17:53:57.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.310+0000 7f549d200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f547c003b40 0x7f5498139e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:57.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.310+0000 7f549d200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54980b0860 0x7f5498155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:57.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.310+0000 7f549d200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5498153dd0 0x7f5498154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:57.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.310+0000 7f549d200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54980b0620 con 0x7f54980b0860 2024-09-13T17:53:57.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.310+0000 7f549d200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549813a3c0 con 0x7f5498153dd0 2024-09-13T17:53:57.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.310+0000 7f549d200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54981547a0 con 0x7f547c003b40 2024-09-13T17:53:57.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.310+0000 7f548fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54980b0860 0x7f5498155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:57.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.310+0000 7f548fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54980b0860 0x7f5498155cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48652/0 (socket says 172.21.15.114:48652) 2024-09-13T17:53:57.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.310+0000 7f548fe00640 1 -- 172.21.15.114:0/3554852243 learned_addr learned my addr 172.21.15.114:0/3554852243 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:57.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.310+0000 7f5496800640 1 --2- 172.21.15.114:0/3554852243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5498153dd0 0x7f5498154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:57.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.310+0000 7f5495e00640 1 --2- 172.21.15.114:0/3554852243 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f547c003b40 0x7f5498139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:57.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.310+0000 7f548fe00640 1 -- 172.21.15.114:0/3554852243 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f547c003b40 msgr2=0x7f5498139e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:57.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.310+0000 7f548fe00640 1 --2- 172.21.15.114:0/3554852243 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f547c003b40 0x7f5498139e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.310+0000 7f548fe00640 1 -- 172.21.15.114:0/3554852243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5498153dd0 msgr2=0x7f5498154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:57.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.310+0000 7f548fe00640 1 --2- 172.21.15.114:0/3554852243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5498153dd0 0x7f5498154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.310+0000 7f548fe00640 1 -- 172.21.15.114:0/3554852243 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54980b0ff0 con 0x7f54980b0860 2024-09-13T17:53:57.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.310+0000 7f5495e00640 1 --2- 172.21.15.114:0/3554852243 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f547c003b40 0x7f5498139e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:57.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.310+0000 7f548fe00640 1 --2- 172.21.15.114:0/3554852243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54980b0860 0x7f5498155cc0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f5480004f80 tx=0x7f54800074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:57.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.310+0000 7f548e000640 1 -- 172.21.15.114:0/3554852243 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548000f750 con 0x7f54980b0860 2024-09-13T17:53:57.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.310+0000 7f548e000640 1 -- 172.21.15.114:0/3554852243 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548000f8d0 con 0x7f54980b0860 2024-09-13T17:53:57.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.310+0000 7f548e000640 1 -- 172.21.15.114:0/3554852243 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548000fc80 con 0x7f54980b0860 2024-09-13T17:53:57.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.310+0000 7f549d200640 1 -- 172.21.15.114:0/3554852243 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54980b0d10 con 0x7f54980b0860 2024-09-13T17:53:57.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.310+0000 7f549d200640 1 -- 172.21.15.114:0/3554852243 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54980ae520 con 0x7f54980b0860 2024-09-13T17:53:57.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.310+0000 7f549d200640 1 -- 172.21.15.114:0/3554852243 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f549813cd60 con 0x7f54980b0860 2024-09-13T17:53:57.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.314+0000 7f548e000640 1 -- 172.21.15.114:0/3554852243 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f548001d460 con 0x7f54980b0860 2024-09-13T17:53:57.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.314+0000 7f548e000640 1 --2- 172.21.15.114:0/3554852243 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5474066690 0x7f5474068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:57.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.314+0000 7f548e000640 1 -- 172.21.15.114:0/3554852243 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f54800844b0 con 0x7f54980b0860 2024-09-13T17:53:57.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.314+0000 7f5495e00640 1 --2- 172.21.15.114:0/3554852243 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5474066690 0x7f5474068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:57.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.314+0000 7f5495e00640 1 --2- 172.21.15.114:0/3554852243 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5474066690 0x7f5474068b50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f54880ad000 tx=0x7f54880af040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:57.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.318+0000 7f548e000640 1 -- 172.21.15.114:0/3554852243 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5480051660 con 0x7f54980b0860 2024-09-13T17:53:57.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.506+0000 7f549d200640 1 -- 172.21.15.114:0/3554852243 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f549815d200 con 0x7f54980b0860 2024-09-13T17:53:57.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.506+0000 7f548e000640 1 -- 172.21.15.114:0/3554852243 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4752 (secure 0 0 0) 0x7f5480054c80 con 0x7f54980b0860 2024-09-13T17:53:57.511 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:57.511 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":30,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/1758700058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1758700058},{"type":"v1","addr":"172.21.15.134:6833","nonce":1758700058}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/4015015784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4015015784},{"type":"v1","addr":"172.21.15.134:6835","nonce":4015015784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2696640153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2696640153},{"type":"v1","addr":"172.21.15.114:6836","nonce":2696640153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:53:32.086012+0000","modified":"2024-09-13T17:53:42.428826+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5598":{"gid":5598,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6837/2697286380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2697286380},{"type":"v1","addr":"172.21.15.114:6837","nonce":2697286380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T17:53:57.511 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 30 2024-09-13T17:53:57.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.506+0000 7f549d200640 1 -- 172.21.15.114:0/3554852243 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5474066690 msgr2=0x7f5474068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:57.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.506+0000 7f549d200640 1 --2- 172.21.15.114:0/3554852243 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5474066690 0x7f5474068b50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f54880ad000 tx=0x7f54880af040 comp rx=0 tx=0).stop 2024-09-13T17:53:57.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.506+0000 7f549d200640 1 -- 172.21.15.114:0/3554852243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54980b0860 msgr2=0x7f5498155cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:57.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.506+0000 7f549d200640 1 --2- 172.21.15.114:0/3554852243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54980b0860 0x7f5498155cc0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f5480004f80 tx=0x7f54800074f0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.506+0000 7f549d200640 1 -- 172.21.15.114:0/3554852243 shutdown_connections 2024-09-13T17:53:57.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.506+0000 7f549d200640 1 --2- 172.21.15.114:0/3554852243 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f5474066690 0x7f5474068b50 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.506+0000 7f549d200640 1 --2- 172.21.15.114:0/3554852243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5498153dd0 0x7f5498154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.506+0000 7f549d200640 1 --2- 172.21.15.114:0/3554852243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f54980b0860 0x7f5498155cc0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.506+0000 7f549d200640 1 --2- 172.21.15.114:0/3554852243 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f547c003b40 0x7f5498139e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.506+0000 7f549d200640 1 -- 172.21.15.114:0/3554852243 >> 172.21.15.114:0/3554852243 conn(0x7f54980660b0 msgr2=0x7f5498153260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:57.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.506+0000 7f549d200640 1 -- 172.21.15.114:0/3554852243 shutdown_connections 2024-09-13T17:53:57.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.506+0000 7f549d200640 1 -- 172.21.15.114:0/3554852243 wait complete. 2024-09-13T17:53:57.533 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:53:57.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.662+0000 7f18e8600640 1 Processor -- start 2024-09-13T17:53:57.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.662+0000 7f18e8600640 1 -- start start 2024-09-13T17:53:57.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.662+0000 7f18e8600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18e0070420 0x7f18e0070800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:57.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.662+0000 7f18e8600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f18e00cdfb0 0x7f18e00b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:57.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.662+0000 7f18e8600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e0070d40 con 0x7f18e0160c30 2024-09-13T17:53:57.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.662+0000 7f18e8600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e006cb50 con 0x7f18e00cdfb0 2024-09-13T17:53:57.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.662+0000 7f18e8600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e006cd40 con 0x7f18e0070420 2024-09-13T17:53:57.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.662+0000 7f18e6600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f18e00cdfb0 0x7f18e00b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:57.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.662+0000 7f18e5c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18e0070420 0x7f18e0070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:57.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.662+0000 7f18e6600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f18e00cdfb0 0x7f18e00b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:59356/0 (socket says 172.21.15.114:59356) 2024-09-13T17:53:57.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.662+0000 7f18e6600640 1 -- 172.21.15.114:0/4078388047 learned_addr learned my addr 172.21.15.114:0/4078388047 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:57.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.662+0000 7f18e5c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18e0070420 0x7f18e0070800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3301/0 says I am v2:172.21.15.114:43400/0 (socket says 172.21.15.114:43400) 2024-09-13T17:53:57.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.662+0000 7f18e5200640 1 --1- 172.21.15.114:0/4078388047 >> v1:172.21.15.134:6789/0 conn(0x7f18e0160c30 0x7f18e006c440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:51764/0 (socket says 172.21.15.114:51764) 2024-09-13T17:53:57.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.662+0000 7f18e5c00640 1 -- 172.21.15.114:0/4078388047 >> v2:172.21.15.134:3300/0 conn(0x7f18e00cdfb0 msgr2=0x7f18e00b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:57.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.662+0000 7f18e5c00640 1 --2- 172.21.15.114:0/4078388047 >> v2:172.21.15.134:3300/0 conn(0x7f18e00cdfb0 0x7f18e00b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.662+0000 7f18e5c00640 1 -- 172.21.15.114:0/4078388047 >> v1:172.21.15.134:6789/0 conn(0x7f18e0160c30 legacy=0x7f18e006c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:57.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.662+0000 7f18e5c00640 1 -- 172.21.15.114:0/4078388047 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e006d020 con 0x7f18e0070420 2024-09-13T17:53:57.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.662+0000 7f18e6600640 1 --2- 172.21.15.114:0/4078388047 >> v2:172.21.15.134:3300/0 conn(0x7f18e00cdfb0 0x7f18e00b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:53:57.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.666+0000 7f18e5c00640 1 --2- 172.21.15.114:0/4078388047 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18e0070420 0x7f18e0070800 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f18d40097c0 tx=0x7f18d401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=325a4a1d42073bfa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:57.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.666+0000 7f18dfe00640 1 -- 172.21.15.114:0/4078388047 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d40ab670 con 0x7f18e0070420 2024-09-13T17:53:57.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.666+0000 7f18dfe00640 1 -- 172.21.15.114:0/4078388047 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d40ab7d0 con 0x7f18e0070420 2024-09-13T17:53:57.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.666+0000 7f18dfe00640 1 -- 172.21.15.114:0/4078388047 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d40abb60 con 0x7f18e0070420 2024-09-13T17:53:57.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.666+0000 7f18e8600640 1 -- 172.21.15.114:0/4078388047 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18e0070420 msgr2=0x7f18e0070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:57.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.666+0000 7f18e8600640 1 --2- 172.21.15.114:0/4078388047 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18e0070420 0x7f18e0070800 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f18d40097c0 tx=0x7f18d401c470 comp rx=0 tx=0).stop 2024-09-13T17:53:57.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.666+0000 7f18e8600640 1 -- 172.21.15.114:0/4078388047 shutdown_connections 2024-09-13T17:53:57.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.666+0000 7f18e8600640 1 --2- 172.21.15.114:0/4078388047 >> v2:172.21.15.134:3300/0 conn(0x7f18e00cdfb0 0x7f18e00b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.666+0000 7f18e8600640 1 --2- 172.21.15.114:0/4078388047 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18e0070420 0x7f18e0070800 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.666+0000 7f18e8600640 1 -- 172.21.15.114:0/4078388047 >> 172.21.15.114:0/4078388047 conn(0x7f18e00660b0 msgr2=0x7f18e0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:57.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.666+0000 7f18e8600640 1 -- 172.21.15.114:0/4078388047 shutdown_connections 2024-09-13T17:53:57.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.666+0000 7f18e8600640 1 -- 172.21.15.114:0/4078388047 wait complete. 2024-09-13T17:53:57.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.670+0000 7f18e8600640 1 Processor -- start 2024-09-13T17:53:57.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.670+0000 7f18e8600640 1 -- start start 2024-09-13T17:53:57.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.670+0000 7f18e8600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e0070420 0x7f18e01536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.670+0000 7f18e8600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18e00cdfb0 0x7f18e0161a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.670+0000 7f18e8600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18e0160c30 0x7f18e0161fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.670+0000 7f18e8600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e0157f90 con 0x7f18e0160c30 2024-09-13T17:53:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.670+0000 7f18e8600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e0161110 con 0x7f18e0070420 2024-09-13T17:53:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.670+0000 7f18e8600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e01613f0 con 0x7f18e00cdfb0 2024-09-13T17:53:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.670+0000 7f18e6600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18e0160c30 0x7f18e0161fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.670+0000 7f18e5c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e0070420 0x7f18e01536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.670+0000 7f18e5c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e0070420 0x7f18e01536d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:59372/0 (socket says 172.21.15.114:59372) 2024-09-13T17:53:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.670+0000 7f18e5c00640 1 -- 172.21.15.114:0/2100558500 learned_addr learned my addr 172.21.15.114:0/2100558500 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.670+0000 7f18e5200640 1 --2- 172.21.15.114:0/2100558500 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18e00cdfb0 0x7f18e0161a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:57.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.670+0000 7f18e6600640 1 -- 172.21.15.114:0/2100558500 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18e00cdfb0 msgr2=0x7f18e0161a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:57.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.670+0000 7f18e6600640 1 --2- 172.21.15.114:0/2100558500 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18e00cdfb0 0x7f18e0161a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.670+0000 7f18e6600640 1 -- 172.21.15.114:0/2100558500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e0070420 msgr2=0x7f18e01536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:57.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.670+0000 7f18e6600640 1 --2- 172.21.15.114:0/2100558500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e0070420 0x7f18e01536d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.670+0000 7f18e6600640 1 -- 172.21.15.114:0/2100558500 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d8009b30 con 0x7f18e0160c30 2024-09-13T17:53:57.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.670+0000 7f18e5200640 1 --2- 172.21.15.114:0/2100558500 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18e00cdfb0 0x7f18e0161a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:57.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.670+0000 7f18e6600640 1 --2- 172.21.15.114:0/2100558500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18e0160c30 0x7f18e0161fc0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f18d800efc0 tx=0x7f18d800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:57.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.670+0000 7f18dd600640 1 -- 172.21.15.114:0/2100558500 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d8018070 con 0x7f18e0160c30 2024-09-13T17:53:57.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.670+0000 7f18dd600640 1 -- 172.21.15.114:0/2100558500 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d800f040 con 0x7f18e0160c30 2024-09-13T17:53:57.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.670+0000 7f18dd600640 1 -- 172.21.15.114:0/2100558500 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d800cd40 con 0x7f18e0160c30 2024-09-13T17:53:57.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.670+0000 7f18e8600640 1 -- 172.21.15.114:0/2100558500 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d4009420 con 0x7f18e0160c30 2024-09-13T17:53:57.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.670+0000 7f18e8600640 1 -- 172.21.15.114:0/2100558500 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e0157940 con 0x7f18e0160c30 2024-09-13T17:53:57.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.674+0000 7f18e8600640 1 -- 172.21.15.114:0/2100558500 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e0070800 con 0x7f18e0160c30 2024-09-13T17:53:57.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.674+0000 7f18dd600640 1 -- 172.21.15.114:0/2100558500 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f18d8014480 con 0x7f18e0160c30 2024-09-13T17:53:57.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.674+0000 7f18dd600640 1 --2- 172.21.15.114:0/2100558500 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f18c0066690 0x7f18c0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:57.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.674+0000 7f18dd600640 1 -- 172.21.15.114:0/2100558500 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f18d80843a0 con 0x7f18e0160c30 2024-09-13T17:53:57.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.674+0000 7f18e5c00640 1 --2- 172.21.15.114:0/2100558500 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f18c0066690 0x7f18c0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:57.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.674+0000 7f18e5c00640 1 --2- 172.21.15.114:0/2100558500 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f18c0066690 0x7f18c0068b50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f18d40097c0 tx=0x7f18d40a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:57.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.678+0000 7f18dd600640 1 -- 172.21.15.114:0/2100558500 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f18d80515e0 con 0x7f18e0160c30 2024-09-13T17:53:57.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.834+0000 7f18e8600640 1 -- 172.21.15.114:0/2100558500 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18e00b3290 con 0x7f18e0160c30 2024-09-13T17:53:57.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.838+0000 7f18dd600640 1 -- 172.21.15.114:0/2100558500 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16961 (secure 0 0 0) 0x7f18d8054c00 con 0x7f18e0160c30 2024-09-13T17:53:57.843 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:57.843 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":49,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:53:55.477488+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:53:07.297633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2024-09-13T17:53:31.026998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.35","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6835/1239035445":"2024-09-14T17:53:22.929223+0000","172.21.15.134:6833/1239035445":"2024-09-14T17:53:22.929223+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:53:57.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.838+0000 7f18e8600640 1 -- 172.21.15.114:0/2100558500 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f18c0066690 msgr2=0x7f18c0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:57.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.838+0000 7f18e8600640 1 --2- 172.21.15.114:0/2100558500 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f18c0066690 0x7f18c0068b50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f18d40097c0 tx=0x7f18d40a7000 comp rx=0 tx=0).stop 2024-09-13T17:53:57.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.838+0000 7f18e8600640 1 -- 172.21.15.114:0/2100558500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18e0160c30 msgr2=0x7f18e0161fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:57.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.838+0000 7f18e8600640 1 --2- 172.21.15.114:0/2100558500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18e0160c30 0x7f18e0161fc0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f18d800efc0 tx=0x7f18d800c490 comp rx=0 tx=0).stop 2024-09-13T17:53:57.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.838+0000 7f18e8600640 1 -- 172.21.15.114:0/2100558500 shutdown_connections 2024-09-13T17:53:57.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.838+0000 7f18e8600640 1 --2- 172.21.15.114:0/2100558500 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f18c0066690 0x7f18c0068b50 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.838+0000 7f18e8600640 1 --2- 172.21.15.114:0/2100558500 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18e0160c30 0x7f18e0161fc0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.838+0000 7f18e8600640 1 --2- 172.21.15.114:0/2100558500 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18e00cdfb0 0x7f18e0161a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.838+0000 7f18e8600640 1 --2- 172.21.15.114:0/2100558500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e0070420 0x7f18e01536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.838+0000 7f18e8600640 1 -- 172.21.15.114:0/2100558500 >> 172.21.15.114:0/2100558500 conn(0x7f18e00660b0 msgr2=0x7f18e015e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:57.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.838+0000 7f18e8600640 1 -- 172.21.15.114:0/2100558500 shutdown_connections 2024-09-13T17:53:57.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.838+0000 7f18e8600640 1 -- 172.21.15.114:0/2100558500 wait complete. 2024-09-13T17:53:57.865 INFO:tasks.cephfs.filesystem:Destroying file system recovery_fs and related pools 2024-09-13T17:53:57.865 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:53:58.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.994+0000 7fa560c00640 1 Processor -- start 2024-09-13T17:53:58.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.994+0000 7fa560c00640 1 -- start start 2024-09-13T17:53:58.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.998+0000 7fa560c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa55c070420 0x7fa55c070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:58.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.998+0000 7fa560c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa55c151800 con 0x7fa55c06c540 2024-09-13T17:53:58.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.998+0000 7fa560c00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa55c0cafb0 con 0x7fa55c151420 2024-09-13T17:53:58.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.998+0000 7fa560c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55c0cbc30 con 0x7fa55c070420 2024-09-13T17:53:58.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.998+0000 7fa55a800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa55c06c540 0x7fa55c06c970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56902/0 (socket says 172.21.15.114:56902) 2024-09-13T17:53:58.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.998+0000 7fa559400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa55c070420 0x7fa55c070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:58.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.998+0000 7fa55a800640 1 -- 172.21.15.114:0/1079842260 learned_addr learned my addr 172.21.15.114:0/1079842260 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:58.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.998+0000 7fa559400640 1 -- 172.21.15.114:0/1079842260 >> v1:172.21.15.134:6789/0 conn(0x7fa55c151420 legacy=0x7fa55c0cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:58.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.998+0000 7fa559400640 1 -- 172.21.15.114:0/1079842260 >> v1:172.21.15.114:6789/0 conn(0x7fa55c06c540 legacy=0x7fa55c06c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:58.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.998+0000 7fa559400640 1 -- 172.21.15.114:0/1079842260 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c0cb290 con 0x7fa55c070420 2024-09-13T17:53:58.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:57.998+0000 7fa558a00640 1 -- 172.21.15.114:0/1079842260 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 189247437 0 0) 0x7fa55c151800 con 0x7fa55c06c540 2024-09-13T17:53:58.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.002+0000 7fa559400640 1 --2- 172.21.15.114:0/1079842260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa55c070420 0x7fa55c070890 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa5480097c0 tx=0x7fa54801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207319fbc791d9c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:58.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.002+0000 7fa558a00640 1 -- 172.21.15.114:0/1079842260 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5480ab600 con 0x7fa55c070420 2024-09-13T17:53:58.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.002+0000 7fa558a00640 1 -- 172.21.15.114:0/1079842260 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5480a7050 con 0x7fa55c070420 2024-09-13T17:53:58.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.002+0000 7fa558a00640 1 -- 172.21.15.114:0/1079842260 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5480ab980 con 0x7fa55c070420 2024-09-13T17:53:58.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.002+0000 7fa560c00640 1 -- 172.21.15.114:0/1079842260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa55c070420 msgr2=0x7fa55c070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:58.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.002+0000 7fa560c00640 1 --2- 172.21.15.114:0/1079842260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa55c070420 0x7fa55c070890 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa5480097c0 tx=0x7fa54801c380 comp rx=0 tx=0).stop 2024-09-13T17:53:58.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.002+0000 7fa560c00640 1 -- 172.21.15.114:0/1079842260 shutdown_connections 2024-09-13T17:53:58.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.002+0000 7fa560c00640 1 --2- 172.21.15.114:0/1079842260 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa55c070420 0x7fa55c070890 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:58.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.002+0000 7fa560c00640 1 -- 172.21.15.114:0/1079842260 >> 172.21.15.114:0/1079842260 conn(0x7fa55c0660b0 msgr2=0x7fa55c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:58.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.002+0000 7fa560c00640 1 -- 172.21.15.114:0/1079842260 shutdown_connections 2024-09-13T17:53:58.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.002+0000 7fa560c00640 1 -- 172.21.15.114:0/1079842260 wait complete. 2024-09-13T17:53:58.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.002+0000 7fa560c00640 1 Processor -- start 2024-09-13T17:53:58.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.002+0000 7fa560c00640 1 -- start start 2024-09-13T17:53:58.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.006+0000 7fa560c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa55c06c540 0x7fa55c1f8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:58.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.006+0000 7fa560c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa55c070420 0x7fa55c1f80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:58.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.006+0000 7fa560c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa55c151420 0x7fa55c0ac930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:58.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.006+0000 7fa560c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c0b1610 con 0x7fa55c070420 2024-09-13T17:53:58.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.006+0000 7fa560c00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c0b2470 con 0x7fa55c151420 2024-09-13T17:53:58.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.006+0000 7fa560c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c0b1860 con 0x7fa55c06c540 2024-09-13T17:53:58.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.006+0000 7fa559400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa55c070420 0x7fa55c1f80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:58.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.006+0000 7fa559400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa55c070420 0x7fa55c1f80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48676/0 (socket says 172.21.15.114:48676) 2024-09-13T17:53:58.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.006+0000 7fa559400640 1 -- 172.21.15.114:0/801958431 learned_addr learned my addr 172.21.15.114:0/801958431 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:58.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.006+0000 7fa559e00640 1 --2- 172.21.15.114:0/801958431 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa55c06c540 0x7fa55c1f8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:58.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.006+0000 7fa55a800640 1 --2- 172.21.15.114:0/801958431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa55c151420 0x7fa55c0ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:58.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.006+0000 7fa559400640 1 -- 172.21.15.114:0/801958431 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa55c06c540 msgr2=0x7fa55c1f8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:58.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.006+0000 7fa559400640 1 --2- 172.21.15.114:0/801958431 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa55c06c540 0x7fa55c1f8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:58.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.006+0000 7fa559400640 1 -- 172.21.15.114:0/801958431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa55c151420 msgr2=0x7fa55c0ac930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:58.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.006+0000 7fa559400640 1 --2- 172.21.15.114:0/801958431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa55c151420 0x7fa55c0ac930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:58.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.006+0000 7fa559400640 1 -- 172.21.15.114:0/801958431 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa548009420 con 0x7fa55c070420 2024-09-13T17:53:58.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.006+0000 7fa559400640 1 --2- 172.21.15.114:0/801958431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa55c070420 0x7fa55c1f80e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fa548018f90 tx=0x7fa548019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:58.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.006+0000 7fa552000640 1 -- 172.21.15.114:0/801958431 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5480b4840 con 0x7fa55c070420 2024-09-13T17:53:58.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.006+0000 7fa552000640 1 -- 172.21.15.114:0/801958431 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5480b49a0 con 0x7fa55c070420 2024-09-13T17:53:58.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.006+0000 7fa552000640 1 -- 172.21.15.114:0/801958431 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5480b4d50 con 0x7fa55c070420 2024-09-13T17:53:58.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.006+0000 7fa560c00640 1 -- 172.21.15.114:0/801958431 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa55c0b1b40 con 0x7fa55c070420 2024-09-13T17:53:58.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.006+0000 7fa560c00640 1 -- 172.21.15.114:0/801958431 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa55c0b2100 con 0x7fa55c070420 2024-09-13T17:53:58.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.006+0000 7fa560c00640 1 -- 172.21.15.114:0/801958431 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa55c070890 con 0x7fa55c070420 2024-09-13T17:53:58.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.006+0000 7fa552000640 1 -- 172.21.15.114:0/801958431 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa5480b2040 con 0x7fa55c070420 2024-09-13T17:53:58.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.010+0000 7fa552000640 1 --2- 172.21.15.114:0/801958431 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa53c066690 0x7fa53c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:58.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.010+0000 7fa552000640 1 -- 172.21.15.114:0/801958431 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fa54811e5d0 con 0x7fa55c070420 2024-09-13T17:53:58.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.010+0000 7fa559e00640 1 --2- 172.21.15.114:0/801958431 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa53c066690 0x7fa53c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:58.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.010+0000 7fa559e00640 1 --2- 172.21.15.114:0/801958431 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa53c066690 0x7fa53c068b50 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa54c007fd0 tx=0x7fa54c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:58.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.014+0000 7fa552000640 1 -- 172.21.15.114:0/801958431 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa5480eb830 con 0x7fa55c070420 2024-09-13T17:53:58.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.198+0000 7fa560c00640 1 -- 172.21.15.114:0/801958431 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa55c0ad7f0 con 0x7fa55c070420 2024-09-13T17:53:58.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.198+0000 7fa552000640 1 -- 172.21.15.114:0/801958431 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4752 (secure 0 0 0) 0x7fa5480eee50 con 0x7fa55c070420 2024-09-13T17:53:58.204 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:58.204 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":30,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/1758700058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1758700058},{"type":"v1","addr":"172.21.15.134:6833","nonce":1758700058}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/4015015784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4015015784},{"type":"v1","addr":"172.21.15.134:6835","nonce":4015015784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2696640153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2696640153},{"type":"v1","addr":"172.21.15.114:6836","nonce":2696640153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:53:32.086012+0000","modified":"2024-09-13T17:53:42.428826+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5598":{"gid":5598,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6837/2697286380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2697286380},{"type":"v1","addr":"172.21.15.114:6837","nonce":2697286380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T17:53:58.204 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 30 2024-09-13T17:53:58.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.198+0000 7fa560c00640 1 -- 172.21.15.114:0/801958431 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa53c066690 msgr2=0x7fa53c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:58.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.198+0000 7fa560c00640 1 --2- 172.21.15.114:0/801958431 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa53c066690 0x7fa53c068b50 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa54c007fd0 tx=0x7fa54c009040 comp rx=0 tx=0).stop 2024-09-13T17:53:58.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.198+0000 7fa560c00640 1 -- 172.21.15.114:0/801958431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa55c070420 msgr2=0x7fa55c1f80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:58.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.198+0000 7fa560c00640 1 --2- 172.21.15.114:0/801958431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa55c070420 0x7fa55c1f80e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fa548018f90 tx=0x7fa548019120 comp rx=0 tx=0).stop 2024-09-13T17:53:58.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.202+0000 7fa560c00640 1 -- 172.21.15.114:0/801958431 shutdown_connections 2024-09-13T17:53:58.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.202+0000 7fa560c00640 1 --2- 172.21.15.114:0/801958431 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa53c066690 0x7fa53c068b50 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:58.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.202+0000 7fa560c00640 1 --2- 172.21.15.114:0/801958431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa55c151420 0x7fa55c0ac930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:58.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.202+0000 7fa560c00640 1 --2- 172.21.15.114:0/801958431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa55c070420 0x7fa55c1f80e0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:58.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.202+0000 7fa560c00640 1 --2- 172.21.15.114:0/801958431 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa55c06c540 0x7fa55c1f8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:58.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.202+0000 7fa560c00640 1 -- 172.21.15.114:0/801958431 >> 172.21.15.114:0/801958431 conn(0x7fa55c0660b0 msgr2=0x7fa55c0cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:58.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.202+0000 7fa560c00640 1 -- 172.21.15.114:0/801958431 shutdown_connections 2024-09-13T17:53:58.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.202+0000 7fa560c00640 1 -- 172.21.15.114:0/801958431 wait complete. 2024-09-13T17:53:58.226 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:53:58.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.354+0000 7fea7ee00640 1 Processor -- start 2024-09-13T17:53:58.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.354+0000 7fea7ee00640 1 -- start start 2024-09-13T17:53:58.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.358+0000 7fea7ee00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fea7813c240 0x7fea7813f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:58.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.358+0000 7fea7ee00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fea7806dc60 0x7fea780cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:58.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.358+0000 7fea7ee00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea780cd220 con 0x7fea7813c980 2024-09-13T17:53:58.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.358+0000 7fea7ee00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea7813f960 con 0x7fea7813c240 2024-09-13T17:53:58.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.358+0000 7fea7ee00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea7815a740 con 0x7fea7806dc60 2024-09-13T17:53:58.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.358+0000 7fea77400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fea7813c980 0x7fea7806d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56908/0 (socket says 172.21.15.114:56908) 2024-09-13T17:53:58.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.358+0000 7fea77400640 1 -- 172.21.15.114:0/1811798319 learned_addr learned my addr 172.21.15.114:0/1811798319 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:58.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.358+0000 7fea77e00640 1 --2- 172.21.15.114:0/1811798319 >> v2:172.21.15.114:3300/0 conn(0x7fea7813c240 0x7fea7813f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:58.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.358+0000 7fea7ce00640 1 --2- 172.21.15.114:0/1811798319 >> v2:172.21.15.134:3300/0 conn(0x7fea7806dc60 0x7fea780cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:58.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.358+0000 7fea76a00640 1 -- 172.21.15.114:0/1811798319 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907949395 0 0) 0x7fea780cd220 con 0x7fea7813c980 2024-09-13T17:53:58.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.358+0000 7fea76a00640 1 -- 172.21.15.114:0/1811798319 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea5c003530 con 0x7fea7813c980 2024-09-13T17:53:58.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.358+0000 7fea77e00640 1 -- 172.21.15.114:0/1811798319 >> v2:172.21.15.134:3300/0 conn(0x7fea7806dc60 msgr2=0x7fea780cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:58.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.358+0000 7fea77e00640 1 --2- 172.21.15.114:0/1811798319 >> v2:172.21.15.134:3300/0 conn(0x7fea7806dc60 0x7fea780cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:58.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.358+0000 7fea77e00640 1 -- 172.21.15.114:0/1811798319 >> v1:172.21.15.114:6789/0 conn(0x7fea7813c980 legacy=0x7fea7806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:58.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.358+0000 7fea77e00640 1 -- 172.21.15.114:0/1811798319 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea78159bc0 con 0x7fea7813c240 2024-09-13T17:53:58.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.362+0000 7fea77e00640 1 --2- 172.21.15.114:0/1811798319 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea7813c240 0x7fea7813f420 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fea780cc210 tx=0x7fea6801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54bb378ecb8d99d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:58.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.362+0000 7fea76a00640 1 -- 172.21.15.114:0/1811798319 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea680ac620 con 0x7fea7813c240 2024-09-13T17:53:58.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.362+0000 7fea76a00640 1 -- 172.21.15.114:0/1811798319 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea680ac780 con 0x7fea7813c240 2024-09-13T17:53:58.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.362+0000 7fea76a00640 1 -- 172.21.15.114:0/1811798319 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea680acb10 con 0x7fea7813c240 2024-09-13T17:53:58.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.362+0000 7fea7ee00640 1 -- 172.21.15.114:0/1811798319 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea7813c240 msgr2=0x7fea7813f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:58.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.362+0000 7fea7ee00640 1 --2- 172.21.15.114:0/1811798319 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea7813c240 0x7fea7813f420 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fea780cc210 tx=0x7fea6801c3c0 comp rx=0 tx=0).stop 2024-09-13T17:53:58.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.362+0000 7fea7ee00640 1 -- 172.21.15.114:0/1811798319 shutdown_connections 2024-09-13T17:53:58.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.362+0000 7fea7ee00640 1 --2- 172.21.15.114:0/1811798319 >> v2:172.21.15.134:3300/0 conn(0x7fea7806dc60 0x7fea780cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:58.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.362+0000 7fea7ee00640 1 --2- 172.21.15.114:0/1811798319 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea7813c240 0x7fea7813f420 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:58.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.362+0000 7fea7ee00640 1 -- 172.21.15.114:0/1811798319 >> 172.21.15.114:0/1811798319 conn(0x7fea780660b0 msgr2=0x7fea78069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:58.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.362+0000 7fea7ee00640 1 -- 172.21.15.114:0/1811798319 shutdown_connections 2024-09-13T17:53:58.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.362+0000 7fea7ee00640 1 -- 172.21.15.114:0/1811798319 wait complete. 2024-09-13T17:53:58.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.362+0000 7fea7ee00640 1 Processor -- start 2024-09-13T17:53:58.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.362+0000 7fea7ee00640 1 -- start start 2024-09-13T17:53:58.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.362+0000 7fea7ee00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea7806dc60 0x7fea7813a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:58.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.362+0000 7fea7ee00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea7813c240 0x7fea78128870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:58.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.362+0000 7fea7ee00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea7813c980 0x7fea781557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:58.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.362+0000 7fea7ee00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea78155320 con 0x7fea7813c240 2024-09-13T17:53:58.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.362+0000 7fea7ee00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7815b580 con 0x7fea7806dc60 2024-09-13T17:53:58.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.362+0000 7fea7ee00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea78154cd0 con 0x7fea7813c980 2024-09-13T17:53:58.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.366+0000 7fea77400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea7813c240 0x7fea78128870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:58.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.366+0000 7fea77400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea7813c240 0x7fea78128870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48696/0 (socket says 172.21.15.114:48696) 2024-09-13T17:53:58.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.366+0000 7fea77400640 1 -- 172.21.15.114:0/4166296 learned_addr learned my addr 172.21.15.114:0/4166296 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:58.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.366+0000 7fea77e00640 1 --2- 172.21.15.114:0/4166296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea7806dc60 0x7fea7813a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:58.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.366+0000 7fea7ce00640 1 --2- 172.21.15.114:0/4166296 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea7813c980 0x7fea781557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:58.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.366+0000 7fea77400640 1 -- 172.21.15.114:0/4166296 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea7813c980 msgr2=0x7fea781557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:58.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.366+0000 7fea77400640 1 --2- 172.21.15.114:0/4166296 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea7813c980 0x7fea781557b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:58.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.366+0000 7fea77400640 1 -- 172.21.15.114:0/4166296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea7806dc60 msgr2=0x7fea7813a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:58.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.366+0000 7fea77400640 1 --2- 172.21.15.114:0/4166296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea7806dc60 0x7fea7813a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:58.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.366+0000 7fea77400640 1 -- 172.21.15.114:0/4166296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea68009420 con 0x7fea7813c240 2024-09-13T17:53:58.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.366+0000 7fea77400640 1 --2- 172.21.15.114:0/4166296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea7813c240 0x7fea78128870 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fea6000c420 tx=0x7fea6000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:58.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.366+0000 7fea6fe00640 1 -- 172.21.15.114:0/4166296 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea60005cf0 con 0x7fea7813c240 2024-09-13T17:53:58.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.366+0000 7fea6fe00640 1 -- 172.21.15.114:0/4166296 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea60005e50 con 0x7fea7813c240 2024-09-13T17:53:58.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.366+0000 7fea6fe00640 1 -- 172.21.15.114:0/4166296 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea600072d0 con 0x7fea7813c240 2024-09-13T17:53:58.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.366+0000 7fea7ee00640 1 -- 172.21.15.114:0/4166296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea78154fb0 con 0x7fea7813c240 2024-09-13T17:53:58.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.366+0000 7fea7ee00640 1 -- 172.21.15.114:0/4166296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea78128db0 con 0x7fea7813c240 2024-09-13T17:53:58.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.366+0000 7fea7ee00640 1 -- 172.21.15.114:0/4166296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea78154b30 con 0x7fea7813c240 2024-09-13T17:53:58.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.366+0000 7fea6fe00640 1 -- 172.21.15.114:0/4166296 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fea60007430 con 0x7fea7813c240 2024-09-13T17:53:58.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.366+0000 7fea6fe00640 1 --2- 172.21.15.114:0/4166296 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fea540666c0 0x7fea54068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:58.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.366+0000 7fea6fe00640 1 -- 172.21.15.114:0/4166296 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fea600838f0 con 0x7fea7813c240 2024-09-13T17:53:58.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.366+0000 7fea77e00640 1 --2- 172.21.15.114:0/4166296 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fea540666c0 0x7fea54068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:58.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.370+0000 7fea77e00640 1 --2- 172.21.15.114:0/4166296 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fea540666c0 0x7fea54068b80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fea680ae000 tx=0x7fea68004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:58.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.370+0000 7fea6fe00640 1 -- 172.21.15.114:0/4166296 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fea78154b30 con 0x7fea7813c240 2024-09-13T17:53:58.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.558+0000 7fea7ee00640 1 -- 172.21.15.114:0/4166296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea78154b30 con 0x7fea7813c240 2024-09-13T17:53:58.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.562+0000 7fea6fe00640 1 -- 172.21.15.114:0/4166296 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4752 (secure 0 0 0) 0x7fea78154b30 con 0x7fea7813c240 2024-09-13T17:53:58.566 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:58.566 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":30,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/1758700058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1758700058},{"type":"v1","addr":"172.21.15.134:6833","nonce":1758700058}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/4015015784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4015015784},{"type":"v1","addr":"172.21.15.134:6835","nonce":4015015784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2696640153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2696640153},{"type":"v1","addr":"172.21.15.114:6836","nonce":2696640153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T17:53:32.086012+0000","modified":"2024-09-13T17:53:42.428826+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5598},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5598":{"gid":5598,"name":"a","rank":0,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.114:6837/2697286380","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":2697286380},{"type":"v1","addr":"172.21.15.114:6837","nonce":2697286380}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":7,"enabled":true,"fs_name":"recovery_fs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T17:53:58.567 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 30 2024-09-13T17:53:58.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.562+0000 7fea7ee00640 1 -- 172.21.15.114:0/4166296 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fea540666c0 msgr2=0x7fea54068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:58.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.562+0000 7fea7ee00640 1 --2- 172.21.15.114:0/4166296 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fea540666c0 0x7fea54068b80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fea680ae000 tx=0x7fea68004740 comp rx=0 tx=0).stop 2024-09-13T17:53:58.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.562+0000 7fea7ee00640 1 -- 172.21.15.114:0/4166296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea7813c240 msgr2=0x7fea78128870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:58.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.562+0000 7fea7ee00640 1 --2- 172.21.15.114:0/4166296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea7813c240 0x7fea78128870 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fea6000c420 tx=0x7fea6000c8e0 comp rx=0 tx=0).stop 2024-09-13T17:53:58.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.562+0000 7fea7ee00640 1 -- 172.21.15.114:0/4166296 shutdown_connections 2024-09-13T17:53:58.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.562+0000 7fea7ee00640 1 --2- 172.21.15.114:0/4166296 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fea540666c0 0x7fea54068b80 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:58.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.562+0000 7fea7ee00640 1 --2- 172.21.15.114:0/4166296 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fea7813c980 0x7fea781557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:58.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.562+0000 7fea7ee00640 1 --2- 172.21.15.114:0/4166296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fea7813c240 0x7fea78128870 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:58.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.562+0000 7fea7ee00640 1 --2- 172.21.15.114:0/4166296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea7806dc60 0x7fea7813a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:58.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.562+0000 7fea7ee00640 1 -- 172.21.15.114:0/4166296 >> 172.21.15.114:0/4166296 conn(0x7fea780660b0 msgr2=0x7fea780b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:58.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.562+0000 7fea7ee00640 1 -- 172.21.15.114:0/4166296 shutdown_connections 2024-09-13T17:53:58.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.562+0000 7fea7ee00640 1 -- 172.21.15.114:0/4166296 wait complete. 2024-09-13T17:53:58.587 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:53:58.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.718+0000 7f25af200640 1 Processor -- start 2024-09-13T17:53:58.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.718+0000 7f25af200640 1 -- start start 2024-09-13T17:53:58.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.718+0000 7f25af200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f25b015a4a0 0x7f25b00ce230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:58.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.718+0000 7f25af200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f25b00ce770 0x7f25b00cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:58.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.718+0000 7f25af200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b0099d70 con 0x7f25b00b3aa0 2024-09-13T17:53:58.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.718+0000 7f25af200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b00997b0 con 0x7f25b00ce770 2024-09-13T17:53:58.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.718+0000 7f25af200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b0099a90 con 0x7f25b015a4a0 2024-09-13T17:53:58.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.718+0000 7f25ae800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f25b00b3aa0 0x7f25b00b3f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56920/0 (socket says 172.21.15.114:56920) 2024-09-13T17:53:58.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.718+0000 7f25ae800640 1 -- 172.21.15.114:0/2944428745 learned_addr learned my addr 172.21.15.114:0/2944428745 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:58.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.718+0000 7f25ad400640 1 --2- 172.21.15.114:0/2944428745 >> v2:172.21.15.114:3300/0 conn(0x7f25b00ce770 0x7f25b00cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:58.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.718+0000 7f25ade00640 1 --2- 172.21.15.114:0/2944428745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f25b015a4a0 0x7f25b00ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:58.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.718+0000 7f25ad400640 1 -- 172.21.15.114:0/2944428745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f25b015a4a0 msgr2=0x7f25b00ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:58.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.718+0000 7f25ad400640 1 --2- 172.21.15.114:0/2944428745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f25b015a4a0 0x7f25b00ce230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:58.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.718+0000 7f25ad400640 1 -- 172.21.15.114:0/2944428745 >> v1:172.21.15.114:6789/0 conn(0x7f25b00b3aa0 legacy=0x7f25b00b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:58.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.718+0000 7f25ad400640 1 -- 172.21.15.114:0/2944428745 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b00b32a0 con 0x7f25b00ce770 2024-09-13T17:53:58.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.718+0000 7f25aca00640 1 -- 172.21.15.114:0/2944428745 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2284177085 0 0) 0x7f25b0099d70 con 0x7f25b00b3aa0 2024-09-13T17:53:58.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.722+0000 7f25ad400640 1 --2- 172.21.15.114:0/2944428745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25b00ce770 0x7f25b00cebd0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f259c0097c0 tx=0x7f259c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=140daa2bca080af1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:58.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.722+0000 7f25aca00640 1 -- 172.21.15.114:0/2944428745 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c0ab600 con 0x7f25b00ce770 2024-09-13T17:53:58.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.722+0000 7f25aca00640 1 -- 172.21.15.114:0/2944428745 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259c0a7050 con 0x7f25b00ce770 2024-09-13T17:53:58.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.722+0000 7f25aca00640 1 -- 172.21.15.114:0/2944428745 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c0ab980 con 0x7f25b00ce770 2024-09-13T17:53:58.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.722+0000 7f25af200640 1 -- 172.21.15.114:0/2944428745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25b00ce770 msgr2=0x7f25b00cebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:58.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.722+0000 7f25af200640 1 --2- 172.21.15.114:0/2944428745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25b00ce770 0x7f25b00cebd0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f259c0097c0 tx=0x7f259c01c4a0 comp rx=0 tx=0).stop 2024-09-13T17:53:58.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.722+0000 7f25af200640 1 -- 172.21.15.114:0/2944428745 shutdown_connections 2024-09-13T17:53:58.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.722+0000 7f25af200640 1 --2- 172.21.15.114:0/2944428745 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25b00ce770 0x7f25b00cebd0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:58.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.722+0000 7f25af200640 1 --2- 172.21.15.114:0/2944428745 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f25b015a4a0 0x7f25b00ce230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:58.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.722+0000 7f25af200640 1 -- 172.21.15.114:0/2944428745 >> 172.21.15.114:0/2944428745 conn(0x7f25b00d0330 msgr2=0x7f25b00d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:58.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.722+0000 7f25af200640 1 -- 172.21.15.114:0/2944428745 shutdown_connections 2024-09-13T17:53:58.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.722+0000 7f25af200640 1 -- 172.21.15.114:0/2944428745 wait complete. 2024-09-13T17:53:58.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.722+0000 7f25af200640 1 Processor -- start 2024-09-13T17:53:58.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.722+0000 7f25af200640 1 -- start start 2024-09-13T17:53:58.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.726+0000 7f25af200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f25b00b3aa0 0x7f25b00c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:58.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.726+0000 7f25af200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25b00ce770 0x7f25b01f59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:58.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.726+0000 7f25af200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25b015a4a0 0x7f25b015ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:58.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.726+0000 7f25af200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b01f5f20 con 0x7f25b015a4a0 2024-09-13T17:53:58.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.726+0000 7f25af200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b015b9e0 con 0x7f25b00ce770 2024-09-13T17:53:58.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.726+0000 7f25af200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b015c260 con 0x7f25b00b3aa0 2024-09-13T17:53:58.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.726+0000 7f25ae800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25b015a4a0 0x7f25b015ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:58.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.726+0000 7f25ae800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25b015a4a0 0x7f25b015ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48708/0 (socket says 172.21.15.114:48708) 2024-09-13T17:53:58.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.726+0000 7f25ade00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f25b00b3aa0 0x7f25b00c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:58.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.726+0000 7f25ae800640 1 -- 172.21.15.114:0/599634056 learned_addr learned my addr 172.21.15.114:0/599634056 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:58.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.726+0000 7f25ad400640 1 --2- 172.21.15.114:0/599634056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25b00ce770 0x7f25b01f59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:58.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.726+0000 7f25ae800640 1 -- 172.21.15.114:0/599634056 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f25b00b3aa0 msgr2=0x7f25b00c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:58.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.726+0000 7f25ae800640 1 --2- 172.21.15.114:0/599634056 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f25b00b3aa0 0x7f25b00c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:58.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.726+0000 7f25ae800640 1 -- 172.21.15.114:0/599634056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25b00ce770 msgr2=0x7f25b01f59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:58.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.726+0000 7f25ae800640 1 --2- 172.21.15.114:0/599634056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25b00ce770 0x7f25b01f59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:58.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.726+0000 7f25ae800640 1 -- 172.21.15.114:0/599634056 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259c009420 con 0x7f25b015a4a0 2024-09-13T17:53:58.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.726+0000 7f25ae800640 1 --2- 172.21.15.114:0/599634056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25b015a4a0 0x7f25b015ab60 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f25a800c3c0 tx=0x7f25a800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:58.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.726+0000 7f25a6000640 1 -- 172.21.15.114:0/599634056 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a80074e0 con 0x7f25b015a4a0 2024-09-13T17:53:58.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.726+0000 7f25a6000640 1 -- 172.21.15.114:0/599634056 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a8007640 con 0x7f25b015a4a0 2024-09-13T17:53:58.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.726+0000 7f25a6000640 1 -- 172.21.15.114:0/599634056 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a8004a30 con 0x7f25b015a4a0 2024-09-13T17:53:58.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.726+0000 7f25af200640 1 -- 172.21.15.114:0/599634056 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b015c520 con 0x7f25b015a4a0 2024-09-13T17:53:58.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.726+0000 7f25af200640 1 -- 172.21.15.114:0/599634056 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b015cae0 con 0x7f25b015a4a0 2024-09-13T17:53:58.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.726+0000 7f25af200640 1 -- 172.21.15.114:0/599634056 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b00cebd0 con 0x7f25b015a4a0 2024-09-13T17:53:58.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.726+0000 7f25a6000640 1 -- 172.21.15.114:0/599634056 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f25a8004b90 con 0x7f25b015a4a0 2024-09-13T17:53:58.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.730+0000 7f25a6000640 1 --2- 172.21.15.114:0/599634056 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2590066690 0x7f2590068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:58.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.730+0000 7f25a6000640 1 -- 172.21.15.114:0/599634056 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f25a8083fe0 con 0x7f25b015a4a0 2024-09-13T17:53:58.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.730+0000 7f25ade00640 1 --2- 172.21.15.114:0/599634056 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2590066690 0x7f2590068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:58.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.730+0000 7f25ade00640 1 --2- 172.21.15.114:0/599634056 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2590066690 0x7f2590068b50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f25a0003ab0 tx=0x7f25a0009830 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:58.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.734+0000 7f25a6000640 1 -- 172.21.15.114:0/599634056 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f25a8051270 con 0x7f25b015a4a0 2024-09-13T17:53:58.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.886+0000 7f25af200640 1 -- 172.21.15.114:0/599634056 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25b0164c50 con 0x7f25b015a4a0 2024-09-13T17:53:58.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.886+0000 7f25a6000640 1 -- 172.21.15.114:0/599634056 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16961 (secure 0 0 0) 0x7f25a8054890 con 0x7f25b015a4a0 2024-09-13T17:53:58.894 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:53:58.894 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":49,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:53:55.477488+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T17:53:07.297633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"recovery_fs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"recovery_fs_metadata","create_time":"2024-09-13T17:53:31.026998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"recovery_fs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.35","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.134:6835/1239035445":"2024-09-14T17:53:22.929223+0000","172.21.15.134:6833/1239035445":"2024-09-14T17:53:22.929223+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:53:58.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.890+0000 7f25af200640 1 -- 172.21.15.114:0/599634056 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2590066690 msgr2=0x7f2590068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:58.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.890+0000 7f25af200640 1 --2- 172.21.15.114:0/599634056 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2590066690 0x7f2590068b50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f25a0003ab0 tx=0x7f25a0009830 comp rx=0 tx=0).stop 2024-09-13T17:53:58.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.890+0000 7f25af200640 1 -- 172.21.15.114:0/599634056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25b015a4a0 msgr2=0x7f25b015ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:58.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.890+0000 7f25af200640 1 --2- 172.21.15.114:0/599634056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25b015a4a0 0x7f25b015ab60 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f25a800c3c0 tx=0x7f25a800c880 comp rx=0 tx=0).stop 2024-09-13T17:53:58.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.890+0000 7f25af200640 1 -- 172.21.15.114:0/599634056 shutdown_connections 2024-09-13T17:53:58.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.890+0000 7f25af200640 1 --2- 172.21.15.114:0/599634056 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2590066690 0x7f2590068b50 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:58.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.890+0000 7f25af200640 1 --2- 172.21.15.114:0/599634056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f25b015a4a0 0x7f25b015ab60 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:58.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.890+0000 7f25af200640 1 --2- 172.21.15.114:0/599634056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25b00ce770 0x7f25b01f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:58.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.890+0000 7f25af200640 1 --2- 172.21.15.114:0/599634056 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f25b00b3aa0 0x7f25b00c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:58.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.890+0000 7f25af200640 1 -- 172.21.15.114:0/599634056 >> 172.21.15.114:0/599634056 conn(0x7f25b00d0330 msgr2=0x7f25b006ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:58.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.890+0000 7f25af200640 1 -- 172.21.15.114:0/599634056 shutdown_connections 2024-09-13T17:53:58.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:58.890+0000 7f25af200640 1 -- 172.21.15.114:0/599634056 wait complete. 2024-09-13T17:53:58.915 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail recovery_fs 2024-09-13T17:53:59.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.046+0000 7fa5eba00640 1 Processor -- start 2024-09-13T17:53:59.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.046+0000 7fa5eba00640 1 -- start start 2024-09-13T17:53:59.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.046+0000 7fa5eba00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa5e4070420 0x7fa5e4070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:59.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.046+0000 7fa5eba00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e4151800 con 0x7fa5e406c540 2024-09-13T17:53:59.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.046+0000 7fa5eba00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e40cafb0 con 0x7fa5e4151420 2024-09-13T17:53:59.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.046+0000 7fa5eba00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e40cbc30 con 0x7fa5e4070420 2024-09-13T17:53:59.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.046+0000 7fa5e9a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa5e406c540 0x7fa5e406c970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56932/0 (socket says 172.21.15.114:56932) 2024-09-13T17:53:59.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.046+0000 7fa5e9a00640 1 -- 172.21.15.114:0/3946308359 learned_addr learned my addr 172.21.15.114:0/3946308359 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:59.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.046+0000 7fa5dbe00640 1 --2- 172.21.15.114:0/3946308359 >> v2:172.21.15.134:3300/0 conn(0x7fa5e4070420 0x7fa5e4070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:59.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.046+0000 7fa5e3e00640 1 -- 172.21.15.114:0/3946308359 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005216198 0 0) 0x7fa5e4151800 con 0x7fa5e406c540 2024-09-13T17:53:59.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.046+0000 7fa5e3e00640 1 -- 172.21.15.114:0/3946308359 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5c8003530 con 0x7fa5e406c540 2024-09-13T17:53:59.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.046+0000 7fa5e3e00640 1 -- 172.21.15.114:0/3946308359 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2291364193 0 0) 0x7fa5c8003530 con 0x7fa5e406c540 2024-09-13T17:53:59.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.046+0000 7fa5dbe00640 1 -- 172.21.15.114:0/3946308359 >> v1:172.21.15.134:6789/0 conn(0x7fa5e4151420 legacy=0x7fa5e40cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:59.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.046+0000 7fa5dbe00640 1 -- 172.21.15.114:0/3946308359 >> v1:172.21.15.114:6789/0 conn(0x7fa5e406c540 legacy=0x7fa5e406c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:59.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.046+0000 7fa5dbe00640 1 -- 172.21.15.114:0/3946308359 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e40cb290 con 0x7fa5e4070420 2024-09-13T17:53:59.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.050+0000 7fa5dbe00640 1 --2- 172.21.15.114:0/3946308359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5e4070420 0x7fa5e4070890 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc0097c0 tx=0x7fa5cc01c2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83644633caeaf7b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:59.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.050+0000 7fa5e3e00640 1 -- 172.21.15.114:0/3946308359 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc001a20 con 0x7fa5e4070420 2024-09-13T17:53:59.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.050+0000 7fa5e3e00640 1 -- 172.21.15.114:0/3946308359 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5cc0a7050 con 0x7fa5e4070420 2024-09-13T17:53:59.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.050+0000 7fa5e3e00640 1 -- 172.21.15.114:0/3946308359 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc0ab620 con 0x7fa5e4070420 2024-09-13T17:53:59.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.050+0000 7fa5eba00640 1 -- 172.21.15.114:0/3946308359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5e4070420 msgr2=0x7fa5e4070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:59.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.050+0000 7fa5eba00640 1 --2- 172.21.15.114:0/3946308359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5e4070420 0x7fa5e4070890 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc0097c0 tx=0x7fa5cc01c2a0 comp rx=0 tx=0).stop 2024-09-13T17:53:59.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.050+0000 7fa5eba00640 1 -- 172.21.15.114:0/3946308359 shutdown_connections 2024-09-13T17:53:59.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.050+0000 7fa5eba00640 1 --2- 172.21.15.114:0/3946308359 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5e4070420 0x7fa5e4070890 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:59.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.050+0000 7fa5eba00640 1 -- 172.21.15.114:0/3946308359 >> 172.21.15.114:0/3946308359 conn(0x7fa5e40660b0 msgr2=0x7fa5e4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:59.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.050+0000 7fa5eba00640 1 -- 172.21.15.114:0/3946308359 shutdown_connections 2024-09-13T17:53:59.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.050+0000 7fa5eba00640 1 -- 172.21.15.114:0/3946308359 wait complete. 2024-09-13T17:53:59.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.054+0000 7fa5eba00640 1 Processor -- start 2024-09-13T17:53:59.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.054+0000 7fa5eba00640 1 -- start start 2024-09-13T17:53:59.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.054+0000 7fa5eba00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5e406c540 0x7fa5e40afae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:59.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.054+0000 7fa5eba00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5e4070420 0x7fa5e414a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:59.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.054+0000 7fa5eba00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5e4151420 0x7fa5e414a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:59.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.054+0000 7fa5eba00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e40b0020 con 0x7fa5e4070420 2024-09-13T17:53:59.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.054+0000 7fa5eba00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e40b32d0 con 0x7fa5e4151420 2024-09-13T17:53:59.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.054+0000 7fa5eba00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e40ae290 con 0x7fa5e406c540 2024-09-13T17:53:59.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.054+0000 7fa5dbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5e4070420 0x7fa5e414a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:59.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.054+0000 7fa5dbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5e4070420 0x7fa5e414a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48720/0 (socket says 172.21.15.114:48720) 2024-09-13T17:53:59.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.054+0000 7fa5dbe00640 1 -- 172.21.15.114:0/4280928556 learned_addr learned my addr 172.21.15.114:0/4280928556 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:59.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.054+0000 7fa5e9a00640 1 --2- 172.21.15.114:0/4280928556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5e4151420 0x7fa5e414a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:59.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.054+0000 7fa5e9000640 1 --2- 172.21.15.114:0/4280928556 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5e406c540 0x7fa5e40afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:59.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.054+0000 7fa5dbe00640 1 -- 172.21.15.114:0/4280928556 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5e406c540 msgr2=0x7fa5e40afae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:59.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.054+0000 7fa5dbe00640 1 --2- 172.21.15.114:0/4280928556 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5e406c540 0x7fa5e40afae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:59.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.054+0000 7fa5dbe00640 1 -- 172.21.15.114:0/4280928556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5e4151420 msgr2=0x7fa5e414a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:59.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.054+0000 7fa5dbe00640 1 --2- 172.21.15.114:0/4280928556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5e4151420 0x7fa5e414a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:59.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.054+0000 7fa5dbe00640 1 -- 172.21.15.114:0/4280928556 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5cc009420 con 0x7fa5e4070420 2024-09-13T17:53:59.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.054+0000 7fa5e9000640 1 --2- 172.21.15.114:0/4280928556 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5e406c540 0x7fa5e40afae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:53:59.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.054+0000 7fa5dbe00640 1 --2- 172.21.15.114:0/4280928556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5e4070420 0x7fa5e414a2d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc0ae040 tx=0x7fa5cc019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:59.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.054+0000 7fa5e1600640 1 -- 172.21.15.114:0/4280928556 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc004020 con 0x7fa5e4070420 2024-09-13T17:53:59.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.054+0000 7fa5e1600640 1 -- 172.21.15.114:0/4280928556 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5cc004180 con 0x7fa5e4070420 2024-09-13T17:53:59.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.054+0000 7fa5e1600640 1 -- 172.21.15.114:0/4280928556 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc0044f0 con 0x7fa5e4070420 2024-09-13T17:53:59.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.054+0000 7fa5eba00640 1 -- 172.21.15.114:0/4280928556 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e4150c40 con 0x7fa5e4070420 2024-09-13T17:53:59.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.054+0000 7fa5eba00640 1 -- 172.21.15.114:0/4280928556 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e40b2d10 con 0x7fa5e4070420 2024-09-13T17:53:59.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.058+0000 7fa5eba00640 1 -- 172.21.15.114:0/4280928556 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e4070890 con 0x7fa5e4070420 2024-09-13T17:53:59.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.058+0000 7fa5e1600640 1 -- 172.21.15.114:0/4280928556 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa5cc0b2040 con 0x7fa5e4070420 2024-09-13T17:53:59.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.058+0000 7fa5e1600640 1 --2- 172.21.15.114:0/4280928556 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa5c0066690 0x7fa5c0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:59.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.058+0000 7fa5e1600640 1 -- 172.21.15.114:0/4280928556 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fa5cc11e180 con 0x7fa5e4070420 2024-09-13T17:53:59.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.058+0000 7fa5e9000640 1 --2- 172.21.15.114:0/4280928556 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa5c0066690 0x7fa5c0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:59.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.058+0000 7fa5e9000640 1 --2- 172.21.15.114:0/4280928556 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa5c0066690 0x7fa5c0068b50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa5e40af8d0 tx=0x7fa5d4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:59.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.062+0000 7fa5e1600640 1 -- 172.21.15.114:0/4280928556 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa5cc0eb470 con 0x7fa5e4070420 2024-09-13T17:53:59.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.250+0000 7fa5eba00640 1 -- 172.21.15.114:0/4280928556 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "recovery_fs"} v 0) v1 -- 0x7fa5e40b16a0 con 0x7fa5e4070420 2024-09-13T17:53:59.255 INFO:tasks.ceph.mon.a.smithi114.stderr:2024-09-13T17:53:59.250+0000 7f67ad800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T17:53:59.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.258+0000 7fa5e1600640 1 -- 172.21.15.114:0/4280928556 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "recovery_fs"}]=0 recovery_fs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) v1 ==== 171+0+0 (secure 0 0 0) 0x7fa5cc0eea90 con 0x7fa5e4070420 2024-09-13T17:53:59.265 INFO:teuthology.orchestra.run.smithi114.stderr:recovery_fs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T17:53:59.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.262+0000 7fa5eba00640 1 -- 172.21.15.114:0/4280928556 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa5c0066690 msgr2=0x7fa5c0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:59.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.262+0000 7fa5eba00640 1 --2- 172.21.15.114:0/4280928556 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa5c0066690 0x7fa5c0068b50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa5e40af8d0 tx=0x7fa5d4009040 comp rx=0 tx=0).stop 2024-09-13T17:53:59.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.262+0000 7fa5eba00640 1 -- 172.21.15.114:0/4280928556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5e4070420 msgr2=0x7fa5e414a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:59.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.262+0000 7fa5eba00640 1 --2- 172.21.15.114:0/4280928556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5e4070420 0x7fa5e414a2d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc0ae040 tx=0x7fa5cc019040 comp rx=0 tx=0).stop 2024-09-13T17:53:59.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.262+0000 7fa5eba00640 1 -- 172.21.15.114:0/4280928556 shutdown_connections 2024-09-13T17:53:59.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.262+0000 7fa5eba00640 1 --2- 172.21.15.114:0/4280928556 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa5c0066690 0x7fa5c0068b50 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:59.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.262+0000 7fa5eba00640 1 --2- 172.21.15.114:0/4280928556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5e4151420 0x7fa5e414a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:59.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.262+0000 7fa5eba00640 1 --2- 172.21.15.114:0/4280928556 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5e4070420 0x7fa5e414a2d0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:59.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.262+0000 7fa5eba00640 1 --2- 172.21.15.114:0/4280928556 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa5e406c540 0x7fa5e40afae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:59.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.262+0000 7fa5eba00640 1 -- 172.21.15.114:0/4280928556 >> 172.21.15.114:0/4280928556 conn(0x7fa5e40660b0 msgr2=0x7fa5e40cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:59.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.262+0000 7fa5eba00640 1 -- 172.21.15.114:0/4280928556 shutdown_connections 2024-09-13T17:53:59.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.262+0000 7fa5eba00640 1 -- 172.21.15.114:0/4280928556 wait complete. 2024-09-13T17:53:59.272 INFO:tasks.ceph.mds.a.smithi114.stderr: -4726> 2024-09-13T17:53:39.414+0000 7f672e400640 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2024-09-13T17:53:59.275 INFO:tasks.ceph.mds.a.smithi114.stderr: -3264> 2024-09-13T17:53:43.938+0000 7f6732a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T17:53:59.276 INFO:tasks.ceph.mds.a.smithi114.stderr: -3105> 2024-09-13T17:53:44.470+0000 7f672e400640 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000000 2024-09-13T17:53:59.276 INFO:tasks.ceph.mds.a.smithi114.stderr: -2935> 2024-09-13T17:53:44.470+0000 7f672e400640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /subdir/ auth v1 pv4 ap=3 DIRTYPARENT f(v0 1=1+0) n() (inest lock dirty) (ifile lock->sync w=1 flushing) (iversion lock) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x564e5dec1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000000:[<0x1/subdir v1>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=1+0)","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 1=1+0)","memory_value.rstat":"n()","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2024-09-13T17:53:59.276 INFO:tasks.ceph.mds.a.smithi114.stderr: -2876> 2024-09-13T17:53:44.474+0000 7f672e400640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x564e5defa100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(6)0x10000000001:[<0x10000000000/sixmegs v10>,<0x1/subdir v12>]//[]","memoryvalue":"(6)0x10000000001:[<0x10000000000/sixmegs v1>,<0x1/subdir v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-13T17:53:59.277 INFO:tasks.ceph.mds.a.smithi114.stderr: -2637> 2024-09-13T17:53:44.474+0000 7f672e400640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1 [...2,head] / auth v4 ap=5 snaprealm=0x564e5deb8900 DIRTYPARENT f(v1 1=0+1) n(v0 1=0+1)/n() (idft sync r=1) (inest sync r=1) (ifile sync->mix r=1) (iversion lock) | dirtyscattered=0 lock=3 dirfrag=1 openingsnapparents=0 dirtyparent=1 dirty=1 waiter=1 authpin=1 scrubqueue=0 0x564e5dec1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x1:[]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=0+1)","ondisk_value.rstat":"n(v0 2=0+2)","memory_value.dirstat":"f(v1 1=0+1)","memory_value.rstat":"n(v0 1=0+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2024-09-13T17:53:59.289 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm recovery_fs --yes-i-really-mean-it 2024-09-13T17:53:59.327 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2024-09-13T17:53:59.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.426+0000 7f7ff6600640 1 Processor -- start 2024-09-13T17:53:59.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.426+0000 7f7ff6600640 1 -- start start 2024-09-13T17:53:59.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.430+0000 7f7ff6600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7ff015a4a0 0x7f7ff00ce230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:59.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.430+0000 7f7ff6600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ff00cbdb0 0x7f7ff00cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:59.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.430+0000 7f7ff6600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ff0099d70 con 0x7f7ff00ce770 2024-09-13T17:53:59.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.430+0000 7f7ff6600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ff00997b0 con 0x7f7ff015a4a0 2024-09-13T17:53:59.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.430+0000 7f7ff6600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff0099a90 con 0x7f7ff00cbdb0 2024-09-13T17:53:59.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.430+0000 7f7fefe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7ff00ce770 0x7f7ff00b3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56942/0 (socket says 172.21.15.114:56942) 2024-09-13T17:53:59.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.430+0000 7f7fefe00640 1 -- 172.21.15.114:0/505144831 learned_addr learned my addr 172.21.15.114:0/505144831 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:53:59.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.430+0000 7f7ff5200640 1 --2- 172.21.15.114:0/505144831 >> v2:172.21.15.114:3300/0 conn(0x7f7ff015a4a0 0x7f7ff00ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:59.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.430+0000 7f7ff5c00640 1 --2- 172.21.15.114:0/505144831 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ff00cbdb0 0x7f7ff00cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:59.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.430+0000 7f7ff5200640 1 -- 172.21.15.114:0/505144831 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ff00cbdb0 msgr2=0x7f7ff00cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:53:59.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.430+0000 7f7ff5200640 1 --2- 172.21.15.114:0/505144831 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ff00cbdb0 0x7f7ff00cebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:59.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.430+0000 7f7ff5200640 1 -- 172.21.15.114:0/505144831 >> v1:172.21.15.114:6789/0 conn(0x7f7ff00ce770 legacy=0x7f7ff00b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:59.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.430+0000 7f7ff5200640 1 -- 172.21.15.114:0/505144831 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff00b32a0 con 0x7f7ff015a4a0 2024-09-13T17:53:59.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.430+0000 7f7fef400640 1 -- 172.21.15.114:0/505144831 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827648793 0 0) 0x7f7ff0099d70 con 0x7f7ff00ce770 2024-09-13T17:53:59.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.434+0000 7f7ff5200640 1 --2- 172.21.15.114:0/505144831 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ff015a4a0 0x7f7ff00ce230 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0009d90 tx=0x7f7fe001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2bd444d24d7927 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:59.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.434+0000 7f7fef400640 1 -- 172.21.15.114:0/505144831 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe00a5830 con 0x7f7ff015a4a0 2024-09-13T17:53:59.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.434+0000 7f7fef400640 1 -- 172.21.15.114:0/505144831 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe00a5990 con 0x7f7ff015a4a0 2024-09-13T17:53:59.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.434+0000 7f7fef400640 1 -- 172.21.15.114:0/505144831 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe00a5d20 con 0x7f7ff015a4a0 2024-09-13T17:53:59.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.434+0000 7f7ff6600640 1 -- 172.21.15.114:0/505144831 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ff015a4a0 msgr2=0x7f7ff00ce230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:59.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.434+0000 7f7ff6600640 1 --2- 172.21.15.114:0/505144831 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ff015a4a0 0x7f7ff00ce230 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0009d90 tx=0x7f7fe001c970 comp rx=0 tx=0).stop 2024-09-13T17:53:59.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.434+0000 7f7ff6600640 1 -- 172.21.15.114:0/505144831 shutdown_connections 2024-09-13T17:53:59.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.434+0000 7f7ff6600640 1 --2- 172.21.15.114:0/505144831 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ff00cbdb0 0x7f7ff00cebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:59.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.434+0000 7f7ff6600640 1 --2- 172.21.15.114:0/505144831 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ff015a4a0 0x7f7ff00ce230 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:59.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.434+0000 7f7ff6600640 1 -- 172.21.15.114:0/505144831 >> 172.21.15.114:0/505144831 conn(0x7f7ff00d0330 msgr2=0x7f7ff00d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:59.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.434+0000 7f7ff6600640 1 -- 172.21.15.114:0/505144831 shutdown_connections 2024-09-13T17:53:59.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.434+0000 7f7ff6600640 1 -- 172.21.15.114:0/505144831 wait complete. 2024-09-13T17:53:59.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.434+0000 7f7ff6600640 1 Processor -- start 2024-09-13T17:53:59.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.434+0000 7f7ff6600640 1 -- start start 2024-09-13T17:53:59.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.438+0000 7f7ff6600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ff00cbdb0 0x7f7ff00c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:59.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.438+0000 7f7ff6600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ff00ce770 0x7f7ff01562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:59.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.438+0000 7f7ff6600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ff015a4a0 0x7f7ff00b5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:59.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.438+0000 7f7ff6600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff01567e0 con 0x7f7ff015a4a0 2024-09-13T17:53:59.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.438+0000 7f7ff6600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff00c4420 con 0x7f7ff00ce770 2024-09-13T17:53:59.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.438+0000 7f7ff6600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff00c4700 con 0x7f7ff00cbdb0 2024-09-13T17:53:59.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.438+0000 7f7ff5c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ff015a4a0 0x7f7ff00b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:59.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.438+0000 7f7ff5c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ff015a4a0 0x7f7ff00b5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48752/0 (socket says 172.21.15.114:48752) 2024-09-13T17:53:59.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.438+0000 7f7ff5c00640 1 -- 172.21.15.114:0/3111340413 learned_addr learned my addr 172.21.15.114:0/3111340413 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:53:59.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.438+0000 7f7ff5200640 1 --2- 172.21.15.114:0/3111340413 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ff00cbdb0 0x7f7ff00c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:59.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.438+0000 7f7fefe00640 1 --2- 172.21.15.114:0/3111340413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ff00ce770 0x7f7ff01562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:59.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.438+0000 7f7ff5c00640 1 -- 172.21.15.114:0/3111340413 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ff00cbdb0 msgr2=0x7f7ff00c3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:59.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.438+0000 7f7ff5c00640 1 --2- 172.21.15.114:0/3111340413 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ff00cbdb0 0x7f7ff00c3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:59.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.438+0000 7f7ff5c00640 1 -- 172.21.15.114:0/3111340413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ff00ce770 msgr2=0x7f7ff01562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:59.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.438+0000 7f7ff5c00640 1 --2- 172.21.15.114:0/3111340413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ff00ce770 0x7f7ff01562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:59.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.438+0000 7f7ff5c00640 1 -- 172.21.15.114:0/3111340413 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe0009a70 con 0x7f7ff015a4a0 2024-09-13T17:53:59.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.438+0000 7f7ff5c00640 1 --2- 172.21.15.114:0/3111340413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ff015a4a0 0x7f7ff00b5190 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f7fe800e7f0 tx=0x7f7fe800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:59.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.438+0000 7f7fecc00640 1 -- 172.21.15.114:0/3111340413 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe8009530 con 0x7f7ff015a4a0 2024-09-13T17:53:59.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.438+0000 7f7fecc00640 1 -- 172.21.15.114:0/3111340413 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe800eea0 con 0x7f7ff015a4a0 2024-09-13T17:53:59.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.438+0000 7f7ff6600640 1 -- 172.21.15.114:0/3111340413 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff00c49e0 con 0x7f7ff015a4a0 2024-09-13T17:53:59.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.438+0000 7f7fecc00640 1 -- 172.21.15.114:0/3111340413 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe800cb60 con 0x7f7ff015a4a0 2024-09-13T17:53:59.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.438+0000 7f7ff6600640 1 -- 172.21.15.114:0/3111340413 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff00b56d0 con 0x7f7ff015a4a0 2024-09-13T17:53:59.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.438+0000 7f7ff6600640 1 -- 172.21.15.114:0/3111340413 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff00c51e0 con 0x7f7ff015a4a0 2024-09-13T17:53:59.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.438+0000 7f7fecc00640 1 -- 172.21.15.114:0/3111340413 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7fe800ccc0 con 0x7f7ff015a4a0 2024-09-13T17:53:59.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.442+0000 7f7fecc00640 1 --2- 172.21.15.114:0/3111340413 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7fd0066690 0x7f7fd0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:59.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.442+0000 7f7fecc00640 1 -- 172.21.15.114:0/3111340413 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f7fe8084440 con 0x7f7ff015a4a0 2024-09-13T17:53:59.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.442+0000 7f7ff5200640 1 --2- 172.21.15.114:0/3111340413 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7fd0066690 0x7f7fd0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:59.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.442+0000 7f7ff5200640 1 --2- 172.21.15.114:0/3111340413 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7fd0066690 0x7f7fd0068b50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7fe00af000 tx=0x7f7fe00a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:59.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.446+0000 7f7fecc00640 1 -- 172.21.15.114:0/3111340413 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7ff00c51e0 con 0x7f7ff015a4a0 2024-09-13T17:53:59.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:53:59.634+0000 7f7ff6600640 1 -- 172.21.15.114:0/3111340413 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "recovery_fs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7ff00c51e0 con 0x7f7ff015a4a0 2024-09-13T17:54:00.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.262+0000 7f7fecc00640 1 -- 172.21.15.114:0/3111340413 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "recovery_fs", "yes_i_really_mean_it": true}]=0 v32) v1 ==== 109+0+0 (secure 0 0 0) 0x7f7ff00c51e0 con 0x7f7ff015a4a0 2024-09-13T17:54:00.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.266+0000 7f7ff6600640 1 -- 172.21.15.114:0/3111340413 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7fd0066690 msgr2=0x7f7fd0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:00.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.266+0000 7f7ff6600640 1 --2- 172.21.15.114:0/3111340413 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7fd0066690 0x7f7fd0068b50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7fe00af000 tx=0x7f7fe00a7070 comp rx=0 tx=0).stop 2024-09-13T17:54:00.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.266+0000 7f7ff6600640 1 -- 172.21.15.114:0/3111340413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ff015a4a0 msgr2=0x7f7ff00b5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:00.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.266+0000 7f7ff6600640 1 --2- 172.21.15.114:0/3111340413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ff015a4a0 0x7f7ff00b5190 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f7fe800e7f0 tx=0x7f7fe800ecb0 comp rx=0 tx=0).stop 2024-09-13T17:54:00.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.266+0000 7f7ff6600640 1 -- 172.21.15.114:0/3111340413 shutdown_connections 2024-09-13T17:54:00.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.266+0000 7f7ff6600640 1 --2- 172.21.15.114:0/3111340413 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7fd0066690 0x7f7fd0068b50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:00.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.266+0000 7f7ff6600640 1 --2- 172.21.15.114:0/3111340413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ff015a4a0 0x7f7ff00b5190 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:00.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.266+0000 7f7ff6600640 1 --2- 172.21.15.114:0/3111340413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ff00ce770 0x7f7ff01562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:00.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.266+0000 7f7ff6600640 1 --2- 172.21.15.114:0/3111340413 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7ff00cbdb0 0x7f7ff00c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:00.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.266+0000 7f7ff6600640 1 -- 172.21.15.114:0/3111340413 >> 172.21.15.114:0/3111340413 conn(0x7f7ff00d0330 msgr2=0x7f7ff006f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:00.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.266+0000 7f7ff6600640 1 -- 172.21.15.114:0/3111340413 shutdown_connections 2024-09-13T17:54:00.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.266+0000 7f7ff6600640 1 -- 172.21.15.114:0/3111340413 wait complete. 2024-09-13T17:54:00.294 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm recovery_fs_metadata recovery_fs_metadata --yes-i-really-really-mean-it 2024-09-13T17:54:00.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.478+0000 7fceb3600640 1 Processor -- start 2024-09-13T17:54:00.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.478+0000 7fceb3600640 1 -- start start 2024-09-13T17:54:00.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.482+0000 7fceb3600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fceac151420 0x7fceac0cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:00.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.482+0000 7fceb3600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fceac0ccba0 0x7fceac070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:00.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.482+0000 7fceb3600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fceac070960 0x7fceac15df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:00.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.482+0000 7fceb3600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceac0cbc30 con 0x7fceac070960 2024-09-13T17:54:00.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.482+0000 7fceb3600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceac070db0 con 0x7fceac0ccba0 2024-09-13T17:54:00.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.482+0000 7fceb3600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceac151800 con 0x7fceac151420 2024-09-13T17:54:00.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.482+0000 7fceb1600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fceac070960 0x7fceac15df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:00.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.482+0000 7fceb1600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fceac070960 0x7fceac15df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48762/0 (socket says 172.21.15.114:48762) 2024-09-13T17:54:00.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.482+0000 7fceb1600640 1 -- 172.21.15.114:0/2186102791 learned_addr learned my addr 172.21.15.114:0/2186102791 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:00.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.482+0000 7fceb0c00640 1 --2- 172.21.15.114:0/2186102791 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fceac151420 0x7fceac0cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:00.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.482+0000 7fcea3e00640 1 --2- 172.21.15.114:0/2186102791 >> v2:172.21.15.134:3300/0 conn(0x7fceac0ccba0 0x7fceac070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:00.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.482+0000 7fceb1600640 1 -- 172.21.15.114:0/2186102791 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fceac151420 msgr2=0x7fceac0cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:00.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.482+0000 7fceb1600640 1 --2- 172.21.15.114:0/2186102791 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fceac151420 0x7fceac0cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:00.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.482+0000 7fceb1600640 1 -- 172.21.15.114:0/2186102791 >> v2:172.21.15.134:3300/0 conn(0x7fceac0ccba0 msgr2=0x7fceac070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:00.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.482+0000 7fceb1600640 1 --2- 172.21.15.114:0/2186102791 >> v2:172.21.15.134:3300/0 conn(0x7fceac0ccba0 0x7fceac070420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:00.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.482+0000 7fceb1600640 1 -- 172.21.15.114:0/2186102791 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac0cafb0 con 0x7fceac070960 2024-09-13T17:54:00.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.486+0000 7fceb1600640 1 --2- 172.21.15.114:0/2186102791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fceac070960 0x7fceac15df20 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fceac06e6a0 tx=0x7fcea401c5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9730fdcb460ae5f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:00.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.486+0000 7fceabe00640 1 -- 172.21.15.114:0/2186102791 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea40a6470 con 0x7fceac070960 2024-09-13T17:54:00.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.486+0000 7fceabe00640 1 -- 172.21.15.114:0/2186102791 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea40a65d0 con 0x7fceac070960 2024-09-13T17:54:00.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.486+0000 7fceabe00640 1 -- 172.21.15.114:0/2186102791 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea40a6960 con 0x7fceac070960 2024-09-13T17:54:00.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.486+0000 7fceb3600640 1 -- 172.21.15.114:0/2186102791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fceac070960 msgr2=0x7fceac15df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:00.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.486+0000 7fceb3600640 1 --2- 172.21.15.114:0/2186102791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fceac070960 0x7fceac15df20 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fceac06e6a0 tx=0x7fcea401c5e0 comp rx=0 tx=0).stop 2024-09-13T17:54:00.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.486+0000 7fceb3600640 1 -- 172.21.15.114:0/2186102791 shutdown_connections 2024-09-13T17:54:00.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.486+0000 7fceb3600640 1 --2- 172.21.15.114:0/2186102791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fceac070960 0x7fceac15df20 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:00.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.486+0000 7fceb3600640 1 --2- 172.21.15.114:0/2186102791 >> v2:172.21.15.134:3300/0 conn(0x7fceac0ccba0 0x7fceac070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:00.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.486+0000 7fceb3600640 1 --2- 172.21.15.114:0/2186102791 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fceac151420 0x7fceac0cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:00.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.486+0000 7fceb3600640 1 -- 172.21.15.114:0/2186102791 >> 172.21.15.114:0/2186102791 conn(0x7fceac0660b0 msgr2=0x7fceac069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:00.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.486+0000 7fceb3600640 1 -- 172.21.15.114:0/2186102791 shutdown_connections 2024-09-13T17:54:00.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.486+0000 7fceb3600640 1 -- 172.21.15.114:0/2186102791 wait complete. 2024-09-13T17:54:00.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.486+0000 7fceb3600640 1 Processor -- start 2024-09-13T17:54:00.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.486+0000 7fceb3600640 1 -- start start 2024-09-13T17:54:00.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.486+0000 7fceb3600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fceac070960 0x7fceac148c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:00.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.486+0000 7fceb3600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fceac0ccba0 0x7fceac141bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:00.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.486+0000 7fceb3600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fceac151420 0x7fceac14b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:00.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.490+0000 7fceb3600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac147bf0 con 0x7fceac151420 2024-09-13T17:54:00.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.490+0000 7fceb3600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac147ed0 con 0x7fceac0ccba0 2024-09-13T17:54:00.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.490+0000 7fceb3600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceac1481b0 con 0x7fceac070960 2024-09-13T17:54:00.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.490+0000 7fceb1600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fceac151420 0x7fceac14b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:00.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.490+0000 7fceb1600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fceac151420 0x7fceac14b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48770/0 (socket says 172.21.15.114:48770) 2024-09-13T17:54:00.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.490+0000 7fceb1600640 1 -- 172.21.15.114:0/2649577661 learned_addr learned my addr 172.21.15.114:0/2649577661 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:00.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.490+0000 7fceb0c00640 1 --2- 172.21.15.114:0/2649577661 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fceac070960 0x7fceac148c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:00.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.490+0000 7fcea3e00640 1 --2- 172.21.15.114:0/2649577661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fceac0ccba0 0x7fceac141bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:00.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.490+0000 7fceb1600640 1 -- 172.21.15.114:0/2649577661 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fceac070960 msgr2=0x7fceac148c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:00.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.490+0000 7fceb1600640 1 --2- 172.21.15.114:0/2649577661 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fceac070960 0x7fceac148c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:00.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.490+0000 7fceb1600640 1 -- 172.21.15.114:0/2649577661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fceac0ccba0 msgr2=0x7fceac141bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:00.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.490+0000 7fceb1600640 1 --2- 172.21.15.114:0/2649577661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fceac0ccba0 0x7fceac141bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:00.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.490+0000 7fceb1600640 1 -- 172.21.15.114:0/2649577661 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea4009b30 con 0x7fceac151420 2024-09-13T17:54:00.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.490+0000 7fceb1600640 1 --2- 172.21.15.114:0/2649577661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fceac151420 0x7fceac14b6b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fcea401ac90 tx=0x7fcea4019380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:00.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.490+0000 7fcea9600640 1 -- 172.21.15.114:0/2649577661 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea40a6470 con 0x7fceac151420 2024-09-13T17:54:00.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.490+0000 7fcea9600640 1 -- 172.21.15.114:0/2649577661 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea40a7650 con 0x7fceac151420 2024-09-13T17:54:00.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.490+0000 7fcea9600640 1 -- 172.21.15.114:0/2649577661 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea40a79e0 con 0x7fceac151420 2024-09-13T17:54:00.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.490+0000 7fceb3600640 1 -- 172.21.15.114:0/2649577661 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceac148490 con 0x7fceac151420 2024-09-13T17:54:00.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.490+0000 7fceb3600640 1 -- 172.21.15.114:0/2649577661 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceac1478a0 con 0x7fceac151420 2024-09-13T17:54:00.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.490+0000 7fceb3600640 1 -- 172.21.15.114:0/2649577661 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceac070420 con 0x7fceac151420 2024-09-13T17:54:00.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.490+0000 7fcea9600640 1 -- 172.21.15.114:0/2649577661 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcea40a7b40 con 0x7fceac151420 2024-09-13T17:54:00.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.494+0000 7fcea9600640 1 --2- 172.21.15.114:0/2649577661 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fce88066690 0x7fce88068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:00.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.494+0000 7fcea9600640 1 -- 172.21.15.114:0/2649577661 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fcea411dd70 con 0x7fceac151420 2024-09-13T17:54:00.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.494+0000 7fceb0c00640 1 --2- 172.21.15.114:0/2649577661 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fce88066690 0x7fce88068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:00.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.494+0000 7fceb0c00640 1 --2- 172.21.15.114:0/2649577661 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fce88066690 0x7fce88068b50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fce9c009ac0 tx=0x7fce9c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:00.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.498+0000 7fcea9600640 1 -- 172.21.15.114:0/2649577661 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcea40eaed0 con 0x7fceac151420 2024-09-13T17:54:00.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:00.654+0000 7fceb3600640 1 -- 172.21.15.114:0/2649577661 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "recovery_fs_metadata", "pool2": "recovery_fs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fceac148940 con 0x7fceac151420 2024-09-13T17:54:01.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.510+0000 7fcea9600640 1 -- 172.21.15.114:0/2649577661 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "recovery_fs_metadata", "pool2": "recovery_fs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'recovery_fs_metadata' removed v51) v1 ==== 196+0+0 (secure 0 0 0) 0x7fcea4009510 con 0x7fceac151420 2024-09-13T17:54:01.515 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'recovery_fs_metadata' removed 2024-09-13T17:54:01.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.514+0000 7fceb3600640 1 -- 172.21.15.114:0/2649577661 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fce88066690 msgr2=0x7fce88068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:01.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.514+0000 7fceb3600640 1 --2- 172.21.15.114:0/2649577661 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fce88066690 0x7fce88068b50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fce9c009ac0 tx=0x7fce9c009190 comp rx=0 tx=0).stop 2024-09-13T17:54:01.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.514+0000 7fceb3600640 1 -- 172.21.15.114:0/2649577661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fceac151420 msgr2=0x7fceac14b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:01.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.514+0000 7fceb3600640 1 --2- 172.21.15.114:0/2649577661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fceac151420 0x7fceac14b6b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fcea401ac90 tx=0x7fcea4019380 comp rx=0 tx=0).stop 2024-09-13T17:54:01.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.514+0000 7fceb3600640 1 -- 172.21.15.114:0/2649577661 shutdown_connections 2024-09-13T17:54:01.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.514+0000 7fceb3600640 1 --2- 172.21.15.114:0/2649577661 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fce88066690 0x7fce88068b50 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:01.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.514+0000 7fceb3600640 1 --2- 172.21.15.114:0/2649577661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fceac151420 0x7fceac14b6b0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:01.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.514+0000 7fceb3600640 1 --2- 172.21.15.114:0/2649577661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fceac0ccba0 0x7fceac141bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:01.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.514+0000 7fceb3600640 1 --2- 172.21.15.114:0/2649577661 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fceac070960 0x7fceac148c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:01.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.514+0000 7fceb3600640 1 -- 172.21.15.114:0/2649577661 >> 172.21.15.114:0/2649577661 conn(0x7fceac0660b0 msgr2=0x7fceac157c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:01.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.514+0000 7fceb3600640 1 -- 172.21.15.114:0/2649577661 shutdown_connections 2024-09-13T17:54:01.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.514+0000 7fceb3600640 1 -- 172.21.15.114:0/2649577661 wait complete. 2024-09-13T17:54:01.546 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T17:54:01.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.682+0000 7f0665a00640 1 Processor -- start 2024-09-13T17:54:01.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.682+0000 7f0665a00640 1 -- start start 2024-09-13T17:54:01.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.686+0000 7f0665a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f06601538d0 0x7f06600b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:01.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.686+0000 7f0665a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f066006dd70 0x7f0660071280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:01.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.686+0000 7f0665a00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f066015a6c0 con 0x7f066015a1e0 2024-09-13T17:54:01.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.686+0000 7f0665a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0660153cb0 con 0x7f06601538d0 2024-09-13T17:54:01.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.686+0000 7f0665a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06600abe30 con 0x7f066006dd70 2024-09-13T17:54:01.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.686+0000 7f065fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f06601538d0 0x7f06600b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:01.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.686+0000 7f065fe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f06601538d0 0x7f06600b1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47118/0 (socket says 172.21.15.114:47118) 2024-09-13T17:54:01.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.686+0000 7f065fe00640 1 -- 172.21.15.114:0/3714483221 learned_addr learned my addr 172.21.15.114:0/3714483221 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:01.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.686+0000 7f0657400640 1 --2- 172.21.15.114:0/3714483221 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f066006dd70 0x7f0660071280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:01.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.686+0000 7f065fe00640 1 -- 172.21.15.114:0/3714483221 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f066006dd70 msgr2=0x7f0660071280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:01.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.686+0000 7f065fe00640 1 --2- 172.21.15.114:0/3714483221 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f066006dd70 0x7f0660071280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:01.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.686+0000 7f065fe00640 1 -- 172.21.15.114:0/3714483221 >> v1:172.21.15.134:6789/0 conn(0x7f066015a1e0 legacy=0x7f06600acbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:01.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.686+0000 7f065fe00640 1 -- 172.21.15.114:0/3714483221 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06600ac110 con 0x7f06601538d0 2024-09-13T17:54:01.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.690+0000 7f065fe00640 1 --2- 172.21.15.114:0/3714483221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06601538d0 0x7f06600b1080 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f0650009870 tx=0x7f065001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a65ac62689c01c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:01.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.690+0000 7f065f400640 1 -- 172.21.15.114:0/3714483221 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06500a95f0 con 0x7f06601538d0 2024-09-13T17:54:01.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.690+0000 7f065f400640 1 -- 172.21.15.114:0/3714483221 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06500a9750 con 0x7f06601538d0 2024-09-13T17:54:01.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.690+0000 7f065f400640 1 -- 172.21.15.114:0/3714483221 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06500a9ae0 con 0x7f06601538d0 2024-09-13T17:54:01.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.690+0000 7f0665a00640 1 -- 172.21.15.114:0/3714483221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06601538d0 msgr2=0x7f06600b1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:01.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.690+0000 7f0665a00640 1 --2- 172.21.15.114:0/3714483221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06601538d0 0x7f06600b1080 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f0650009870 tx=0x7f065001c530 comp rx=0 tx=0).stop 2024-09-13T17:54:01.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.690+0000 7f0665a00640 1 -- 172.21.15.114:0/3714483221 shutdown_connections 2024-09-13T17:54:01.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.690+0000 7f0665a00640 1 --2- 172.21.15.114:0/3714483221 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f066006dd70 0x7f0660071280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:01.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.690+0000 7f0665a00640 1 --2- 172.21.15.114:0/3714483221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f06601538d0 0x7f06600b1080 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:01.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.690+0000 7f0665a00640 1 -- 172.21.15.114:0/3714483221 >> 172.21.15.114:0/3714483221 conn(0x7f06600ce0d0 msgr2=0x7f06600ce4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:01.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.690+0000 7f0665a00640 1 -- 172.21.15.114:0/3714483221 shutdown_connections 2024-09-13T17:54:01.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.690+0000 7f0665a00640 1 -- 172.21.15.114:0/3714483221 wait complete. 2024-09-13T17:54:01.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.690+0000 7f0665a00640 1 Processor -- start 2024-09-13T17:54:01.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.690+0000 7f0665a00640 1 -- start start 2024-09-13T17:54:01.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.694+0000 7f0665a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f066006dd70 0x7f0660150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:01.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.694+0000 7f0665a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06601538d0 0x7f0660151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:01.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.694+0000 7f0665a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f066015a1e0 0x7f06600adb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:01.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.694+0000 7f0665a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066014b550 con 0x7f066006dd70 2024-09-13T17:54:01.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.694+0000 7f0665a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066015b700 con 0x7f06601538d0 2024-09-13T17:54:01.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.694+0000 7f0665a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066014b300 con 0x7f066015a1e0 2024-09-13T17:54:01.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.694+0000 7f065fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f066006dd70 0x7f0660150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:01.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.694+0000 7f065fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f066006dd70 0x7f0660150fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47132/0 (socket says 172.21.15.114:47132) 2024-09-13T17:54:01.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.694+0000 7f065fe00640 1 -- 172.21.15.114:0/3179433663 learned_addr learned my addr 172.21.15.114:0/3179433663 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:01.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.694+0000 7f0657400640 1 --2- 172.21.15.114:0/3179433663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06601538d0 0x7f0660151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:01.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.694+0000 7f0665000640 1 --2- 172.21.15.114:0/3179433663 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f066015a1e0 0x7f06600adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:01.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.694+0000 7f065fe00640 1 -- 172.21.15.114:0/3179433663 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f066015a1e0 msgr2=0x7f06600adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:01.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.694+0000 7f065fe00640 1 --2- 172.21.15.114:0/3179433663 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f066015a1e0 0x7f06600adb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:01.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.694+0000 7f065fe00640 1 -- 172.21.15.114:0/3179433663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06601538d0 msgr2=0x7f0660151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:01.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.694+0000 7f065fe00640 1 --2- 172.21.15.114:0/3179433663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06601538d0 0x7f0660151520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:01.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.694+0000 7f065fe00640 1 -- 172.21.15.114:0/3179433663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06500094d0 con 0x7f066006dd70 2024-09-13T17:54:01.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.694+0000 7f065fe00640 1 --2- 172.21.15.114:0/3179433663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f066006dd70 0x7f0660150fe0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f065001a160 tx=0x7f065001ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:01.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.694+0000 7f065cc00640 1 -- 172.21.15.114:0/3179433663 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06500b1800 con 0x7f066006dd70 2024-09-13T17:54:01.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.694+0000 7f065cc00640 1 -- 172.21.15.114:0/3179433663 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06500b1980 con 0x7f066006dd70 2024-09-13T17:54:01.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.694+0000 7f0665a00640 1 -- 172.21.15.114:0/3179433663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f066015b420 con 0x7f066006dd70 2024-09-13T17:54:01.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.694+0000 7f065cc00640 1 -- 172.21.15.114:0/3179433663 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06500b1d30 con 0x7f066006dd70 2024-09-13T17:54:01.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.694+0000 7f0665a00640 1 -- 172.21.15.114:0/3179433663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0660151a60 con 0x7f066006dd70 2024-09-13T17:54:01.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.694+0000 7f0665a00640 1 -- 172.21.15.114:0/3179433663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06600af530 con 0x7f066006dd70 2024-09-13T17:54:01.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.694+0000 7f065cc00640 1 -- 172.21.15.114:0/3179433663 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f06500c53a0 con 0x7f066006dd70 2024-09-13T17:54:01.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.698+0000 7f065cc00640 1 --2- 172.21.15.114:0/3179433663 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f063c066690 0x7f063c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:01.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.698+0000 7f065cc00640 1 -- 172.21.15.114:0/3179433663 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5797+0+0 (secure 0 0 0) 0x7f065011ecd0 con 0x7f066006dd70 2024-09-13T17:54:01.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.698+0000 7f0657400640 1 --2- 172.21.15.114:0/3179433663 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f063c066690 0x7f063c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:01.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.698+0000 7f0657400640 1 --2- 172.21.15.114:0/3179433663 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f063c066690 0x7f063c068b50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0660148d70 tx=0x7f0648009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:01.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.702+0000 7f065cc00640 1 -- 172.21.15.114:0/3179433663 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f06600af530 con 0x7f066006dd70 2024-09-13T17:54:01.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:01.858+0000 7f0665a00640 1 -- 172.21.15.114:0/3179433663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f06600ca9d0 con 0x7f066006dd70 2024-09-13T17:54:02.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.514+0000 7f065cc00640 1 -- 172.21.15.114:0/3179433663 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v52) v1 ==== 169+0+0 (secure 0 0 0) 0x7f06600ca9d0 con 0x7f066006dd70 2024-09-13T17:54:02.522 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2024-09-13T17:54:02.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.518+0000 7f0665a00640 1 -- 172.21.15.114:0/3179433663 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f063c066690 msgr2=0x7f063c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:02.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.518+0000 7f0665a00640 1 --2- 172.21.15.114:0/3179433663 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f063c066690 0x7f063c068b50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0660148d70 tx=0x7f0648009190 comp rx=0 tx=0).stop 2024-09-13T17:54:02.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.518+0000 7f0665a00640 1 -- 172.21.15.114:0/3179433663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f066006dd70 msgr2=0x7f0660150fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:02.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.518+0000 7f0665a00640 1 --2- 172.21.15.114:0/3179433663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f066006dd70 0x7f0660150fe0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f065001a160 tx=0x7f065001ad70 comp rx=0 tx=0).stop 2024-09-13T17:54:02.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.518+0000 7f0665a00640 1 -- 172.21.15.114:0/3179433663 shutdown_connections 2024-09-13T17:54:02.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.518+0000 7f0665a00640 1 --2- 172.21.15.114:0/3179433663 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f063c066690 0x7f063c068b50 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:02.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.518+0000 7f0665a00640 1 --2- 172.21.15.114:0/3179433663 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f066015a1e0 0x7f06600adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:02.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.518+0000 7f0665a00640 1 --2- 172.21.15.114:0/3179433663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06601538d0 0x7f0660151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:02.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.518+0000 7f0665a00640 1 --2- 172.21.15.114:0/3179433663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f066006dd70 0x7f0660150fe0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:02.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.518+0000 7f0665a00640 1 -- 172.21.15.114:0/3179433663 >> 172.21.15.114:0/3179433663 conn(0x7f06600ce0d0 msgr2=0x7f0660070160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:02.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.518+0000 7f0665a00640 1 -- 172.21.15.114:0/3179433663 shutdown_connections 2024-09-13T17:54:02.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.518+0000 7f0665a00640 1 -- 172.21.15.114:0/3179433663 wait complete. 2024-09-13T17:54:02.547 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds debug_mds 2024-09-13T17:54:02.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.678+0000 7fab26800640 1 Processor -- start 2024-09-13T17:54:02.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.678+0000 7fab26800640 1 -- start start 2024-09-13T17:54:02.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.682+0000 7fab26800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab200ce0b0 0x7fab2015e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:02.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.682+0000 7fab26800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fab2015e5f0 0x7fab200cb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:02.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.682+0000 7fab26800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab200ce540 con 0x7fab2015a650 2024-09-13T17:54:02.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.682+0000 7fab26800640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab2015ea80 con 0x7fab2015e5f0 2024-09-13T17:54:02.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.682+0000 7fab26800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2015ba40 con 0x7fab200ce0b0 2024-09-13T17:54:02.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.682+0000 7fab1fe00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fab2015e5f0 0x7fab200cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:02.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.682+0000 7fab16a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab200ce0b0 0x7fab2015e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:02.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.682+0000 7fab1fe00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fab2015e5f0 0x7fab200cb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:42340/0 (socket says 172.21.15.114:42340) 2024-09-13T17:54:02.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.682+0000 7fab1fe00640 1 -- 172.21.15.114:0/206027150 learned_addr learned my addr 172.21.15.114:0/206027150 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:02.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.682+0000 7fab1f400640 1 --1- 172.21.15.114:0/206027150 >> v1:172.21.15.134:6789/0 conn(0x7fab2015a650 0x7fab20099480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:44698/0 (socket says 172.21.15.114:44698) 2024-09-13T17:54:02.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.682+0000 7fab1fe00640 1 -- 172.21.15.114:0/206027150 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab200ce0b0 msgr2=0x7fab2015e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:02.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.682+0000 7fab1fe00640 1 --2- 172.21.15.114:0/206027150 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab200ce0b0 0x7fab2015e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:02.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.682+0000 7fab1fe00640 1 -- 172.21.15.114:0/206027150 >> v1:172.21.15.134:6789/0 conn(0x7fab2015a650 legacy=0x7fab20099480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:02.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.682+0000 7fab1fe00640 1 -- 172.21.15.114:0/206027150 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab200ce820 con 0x7fab2015e5f0 2024-09-13T17:54:02.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.682+0000 7fab16a00640 1 --2- 172.21.15.114:0/206027150 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab200ce0b0 0x7fab2015e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:54:02.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.686+0000 7fab1fe00640 1 --2- 172.21.15.114:0/206027150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab2015e5f0 0x7fab200cb180 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fab18009e50 tx=0x7fab1801ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79837bd56861d11a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.686+0000 7fab1ea00640 1 -- 172.21.15.114:0/206027150 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab180a5900 con 0x7fab2015e5f0 2024-09-13T17:54:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.686+0000 7fab1ea00640 1 -- 172.21.15.114:0/206027150 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab180a5a60 con 0x7fab2015e5f0 2024-09-13T17:54:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.686+0000 7fab1ea00640 1 -- 172.21.15.114:0/206027150 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab180a5df0 con 0x7fab2015e5f0 2024-09-13T17:54:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.686+0000 7fab26800640 1 -- 172.21.15.114:0/206027150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab2015e5f0 msgr2=0x7fab200cb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.686+0000 7fab26800640 1 --2- 172.21.15.114:0/206027150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab2015e5f0 0x7fab200cb180 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fab18009e50 tx=0x7fab1801ca30 comp rx=0 tx=0).stop 2024-09-13T17:54:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.686+0000 7fab26800640 1 -- 172.21.15.114:0/206027150 shutdown_connections 2024-09-13T17:54:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.686+0000 7fab26800640 1 --2- 172.21.15.114:0/206027150 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab2015e5f0 0x7fab200cb180 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.686+0000 7fab26800640 1 --2- 172.21.15.114:0/206027150 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab200ce0b0 0x7fab2015e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.686+0000 7fab26800640 1 -- 172.21.15.114:0/206027150 >> 172.21.15.114:0/206027150 conn(0x7fab200d04e0 msgr2=0x7fab200d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.686+0000 7fab26800640 1 -- 172.21.15.114:0/206027150 shutdown_connections 2024-09-13T17:54:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.686+0000 7fab26800640 1 -- 172.21.15.114:0/206027150 wait complete. 2024-09-13T17:54:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.686+0000 7fab26800640 1 Processor -- start 2024-09-13T17:54:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.686+0000 7fab26800640 1 -- start start 2024-09-13T17:54:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.690+0000 7fab26800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab2015a650 0x7fab200c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.690+0000 7fab26800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab2015e5f0 0x7fab200b5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.690+0000 7fab26800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab200c8d30 0x7fab201591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.690+0000 7fab26800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab200b5b80 con 0x7fab200c8d30 2024-09-13T17:54:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.690+0000 7fab26800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab200c7c90 con 0x7fab2015e5f0 2024-09-13T17:54:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.690+0000 7fab26800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab200c7f70 con 0x7fab2015a650 2024-09-13T17:54:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.690+0000 7fab1fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab200c8d30 0x7fab201591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.690+0000 7fab1fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab200c8d30 0x7fab201591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47134/0 (socket says 172.21.15.114:47134) 2024-09-13T17:54:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.690+0000 7fab1fe00640 1 -- 172.21.15.114:0/2745875305 learned_addr learned my addr 172.21.15.114:0/2745875305 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.690+0000 7fab1f400640 1 --2- 172.21.15.114:0/2745875305 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab2015a650 0x7fab200c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.690+0000 7fab16a00640 1 --2- 172.21.15.114:0/2745875305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab2015e5f0 0x7fab200b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.690+0000 7fab1fe00640 1 -- 172.21.15.114:0/2745875305 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab2015a650 msgr2=0x7fab200c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.690+0000 7fab1fe00640 1 --2- 172.21.15.114:0/2745875305 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab2015a650 0x7fab200c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.690+0000 7fab1fe00640 1 -- 172.21.15.114:0/2745875305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab2015e5f0 msgr2=0x7fab200b5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.690+0000 7fab1fe00640 1 --2- 172.21.15.114:0/2745875305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab2015e5f0 0x7fab200b5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.690+0000 7fab1fe00640 1 -- 172.21.15.114:0/2745875305 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab08009420 con 0x7fab200c8d30 2024-09-13T17:54:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.690+0000 7fab16a00640 1 --2- 172.21.15.114:0/2745875305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab2015e5f0 0x7fab200b5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:54:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.690+0000 7fab1fe00640 1 --2- 172.21.15.114:0/2745875305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab200c8d30 0x7fab201591d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fab1801a660 tx=0x7fab180197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.690+0000 7fab17e00640 1 -- 172.21.15.114:0/2745875305 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab180b8670 con 0x7fab200c8d30 2024-09-13T17:54:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.690+0000 7fab17e00640 1 -- 172.21.15.114:0/2745875305 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab180b87f0 con 0x7fab200c8d30 2024-09-13T17:54:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.690+0000 7fab17e00640 1 -- 172.21.15.114:0/2745875305 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab180b8ba0 con 0x7fab200c8d30 2024-09-13T17:54:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.690+0000 7fab26800640 1 -- 172.21.15.114:0/2745875305 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab18009b30 con 0x7fab200c8d30 2024-09-13T17:54:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.690+0000 7fab26800640 1 -- 172.21.15.114:0/2745875305 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab200c8530 con 0x7fab200c8d30 2024-09-13T17:54:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.690+0000 7fab26800640 1 -- 172.21.15.114:0/2745875305 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab2015e0b0 con 0x7fab200c8d30 2024-09-13T17:54:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.690+0000 7fab17e00640 1 -- 172.21.15.114:0/2745875305 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fab180b8d00 con 0x7fab200c8d30 2024-09-13T17:54:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.694+0000 7fab17e00640 1 --2- 172.21.15.114:0/2745875305 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7faafc066690 0x7faafc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:02.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.694+0000 7fab17e00640 1 -- 172.21.15.114:0/2745875305 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fab1811f530 con 0x7fab200c8d30 2024-09-13T17:54:02.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.694+0000 7fab1f400640 1 --2- 172.21.15.114:0/2745875305 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7faafc066690 0x7faafc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:02.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.694+0000 7fab1f400640 1 --2- 172.21.15.114:0/2745875305 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7faafc066690 0x7faafc068b50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fab10000f70 tx=0x7fab10007e50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:02.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.698+0000 7fab17e00640 1 -- 172.21.15.114:0/2745875305 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fab180ec960 con 0x7fab200c8d30 2024-09-13T17:54:02.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.850+0000 7fab26800640 1 -- 172.21.15.114:0/2745875305 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "debug_mds"} v 0) v1 -- 0x7fab201651c0 con 0x7fab200c8d30 2024-09-13T17:54:02.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.854+0000 7fab17e00640 1 -- 172.21.15.114:0/2745875305 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "debug_mds"}]=0 v12) v1 ==== 92+0+0 (secure 0 0 0) 0x7fab180eff80 con 0x7fab200c8d30 2024-09-13T17:54:02.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.858+0000 7fab26800640 1 -- 172.21.15.114:0/2745875305 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7faafc066690 msgr2=0x7faafc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:02.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.858+0000 7fab26800640 1 --2- 172.21.15.114:0/2745875305 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7faafc066690 0x7faafc068b50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fab10000f70 tx=0x7fab10007e50 comp rx=0 tx=0).stop 2024-09-13T17:54:02.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.858+0000 7fab26800640 1 -- 172.21.15.114:0/2745875305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab200c8d30 msgr2=0x7fab201591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:02.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.858+0000 7fab26800640 1 --2- 172.21.15.114:0/2745875305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab200c8d30 0x7fab201591d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fab1801a660 tx=0x7fab180197d0 comp rx=0 tx=0).stop 2024-09-13T17:54:02.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.858+0000 7fab26800640 1 -- 172.21.15.114:0/2745875305 shutdown_connections 2024-09-13T17:54:02.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.858+0000 7fab26800640 1 --2- 172.21.15.114:0/2745875305 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7faafc066690 0x7faafc068b50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:02.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.858+0000 7fab26800640 1 --2- 172.21.15.114:0/2745875305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab200c8d30 0x7fab201591d0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:02.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.858+0000 7fab26800640 1 --2- 172.21.15.114:0/2745875305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab2015e5f0 0x7fab200b5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:02.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.858+0000 7fab26800640 1 --2- 172.21.15.114:0/2745875305 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fab2015a650 0x7fab200c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:02.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.858+0000 7fab26800640 1 -- 172.21.15.114:0/2745875305 >> 172.21.15.114:0/2745875305 conn(0x7fab200d04e0 msgr2=0x7fab2006fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:02.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.858+0000 7fab26800640 1 -- 172.21.15.114:0/2745875305 shutdown_connections 2024-09-13T17:54:02.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:02.858+0000 7fab26800640 1 -- 172.21.15.114:0/2745875305 wait complete. 2024-09-13T17:54:02.884 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T17:54:03.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.018+0000 7f83c3000640 1 Processor -- start 2024-09-13T17:54:03.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.018+0000 7f83c3000640 1 -- start start 2024-09-13T17:54:03.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.018+0000 7f83c3000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f83bc06dc60 0x7f83bc0cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:03.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.018+0000 7f83c3000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83bc0cd220 con 0x7f83bc13f420 2024-09-13T17:54:03.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.018+0000 7f83c3000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83bc15a740 con 0x7f83bc13c240 2024-09-13T17:54:03.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.018+0000 7f83c3000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83bc159bc0 con 0x7f83bc06dc60 2024-09-13T17:54:03.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.018+0000 7f83b3400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f83bc13f420 0x7f83bc06d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49728/0 (socket says 172.21.15.114:49728) 2024-09-13T17:54:03.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.018+0000 7f83b3400640 1 -- 172.21.15.114:0/2314267748 learned_addr learned my addr 172.21.15.114:0/2314267748 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:54:03.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.018+0000 7f83c1000640 1 --2- 172.21.15.114:0/2314267748 >> v2:172.21.15.134:3300/0 conn(0x7f83bc06dc60 0x7f83bc0cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.018+0000 7f83bb400640 1 -- 172.21.15.114:0/2314267748 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2653468156 0 0) 0x7f83bc0cd220 con 0x7f83bc13f420 2024-09-13T17:54:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.018+0000 7f83bb400640 1 -- 172.21.15.114:0/2314267748 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83a0003530 con 0x7f83bc13f420 2024-09-13T17:54:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.018+0000 7f83bb400640 1 -- 172.21.15.114:0/2314267748 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2033827128 0 0) 0x7f83a0003530 con 0x7f83bc13f420 2024-09-13T17:54:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.018+0000 7f83bb400640 1 -- 172.21.15.114:0/2314267748 >> v2:172.21.15.134:3300/0 conn(0x7f83bc06dc60 msgr2=0x7f83bc0cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.018+0000 7f83bb400640 1 --2- 172.21.15.114:0/2314267748 >> v2:172.21.15.134:3300/0 conn(0x7f83bc06dc60 0x7f83bc0cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.018+0000 7f83bb400640 1 -- 172.21.15.114:0/2314267748 >> v1:172.21.15.134:6789/0 conn(0x7f83bc13c240 legacy=0x7f83bc13c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.018+0000 7f83bb400640 1 -- 172.21.15.114:0/2314267748 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc159ea0 con 0x7f83bc13f420 2024-09-13T17:54:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.018+0000 7f83c1000640 1 --2- 172.21.15.114:0/2314267748 >> v2:172.21.15.134:3300/0 conn(0x7f83bc06dc60 0x7f83bc0cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:54:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.018+0000 7f83bb400640 1 -- 172.21.15.114:0/2314267748 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7f83a4001680 con 0x7f83bc13f420 2024-09-13T17:54:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.018+0000 7f83bb400640 1 -- 172.21.15.114:0/2314267748 >> v1:172.21.15.114:6789/0 conn(0x7f83bc13f420 legacy=0x7f83bc06d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.018+0000 7f83bb400640 1 --2- 172.21.15.114:0/2314267748 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83a0003980 0x7f83a0003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.018+0000 7f83bb400640 1 --2- 172.21.15.114:0/2314267748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83a00047d0 0x7f83a0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.022+0000 7f83bb400640 1 --2- 172.21.15.114:0/2314267748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83a00051e0 0x7f83a000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:03.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.022+0000 7f83bb400640 1 -- 172.21.15.114:0/2314267748 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc159bc0 con 0x7f83a00051e0 2024-09-13T17:54:03.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.022+0000 7f83bb400640 1 -- 172.21.15.114:0/2314267748 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a000c110 con 0x7f83a00047d0 2024-09-13T17:54:03.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.022+0000 7f83bb400640 1 -- 172.21.15.114:0/2314267748 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a000c2d0 con 0x7f83a0003980 2024-09-13T17:54:03.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.022+0000 7f83b3400640 1 --2- 172.21.15.114:0/2314267748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83a00047d0 0x7f83a0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:03.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.022+0000 7f83c1000640 1 --2- 172.21.15.114:0/2314267748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83a00051e0 0x7f83a000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:03.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.022+0000 7f83bbe00640 1 --2- 172.21.15.114:0/2314267748 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83a0003980 0x7f83a0003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:03.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.022+0000 7f83c1000640 1 -- 172.21.15.114:0/2314267748 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83a0003980 msgr2=0x7f83a0003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:03.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.022+0000 7f83c1000640 1 --2- 172.21.15.114:0/2314267748 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83a0003980 0x7f83a0003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:03.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.022+0000 7f83c1000640 1 -- 172.21.15.114:0/2314267748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83a00047d0 msgr2=0x7f83a0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:03.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.022+0000 7f83c1000640 1 --2- 172.21.15.114:0/2314267748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83a00047d0 0x7f83a0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:03.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.022+0000 7f83c1000640 1 -- 172.21.15.114:0/2314267748 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a0003530 con 0x7f83a00051e0 2024-09-13T17:54:03.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.022+0000 7f83b3400640 1 --2- 172.21.15.114:0/2314267748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83a00047d0 0x7f83a0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:54:03.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.022+0000 7f83c1000640 1 -- 172.21.15.114:0/2314267748 reap_dead start 2024-09-13T17:54:03.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.022+0000 7f83c1000640 1 --2- 172.21.15.114:0/2314267748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83a00051e0 0x7f83a000b990 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f83b40098d0 tx=0x7f83b401c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce84c603a3bd4b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:03.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.022+0000 7f83bb400640 1 -- 172.21.15.114:0/2314267748 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b40ad070 con 0x7f83a00051e0 2024-09-13T17:54:03.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.022+0000 7f83bb400640 1 -- 172.21.15.114:0/2314267748 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b4006e40 con 0x7f83a00051e0 2024-09-13T17:54:03.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.022+0000 7f83bb400640 1 -- 172.21.15.114:0/2314267748 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b40a9670 con 0x7f83a00051e0 2024-09-13T17:54:03.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.026+0000 7f83c3000640 1 -- 172.21.15.114:0/2314267748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83a00051e0 msgr2=0x7f83a000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:03.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.026+0000 7f83c3000640 1 --2- 172.21.15.114:0/2314267748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83a00051e0 0x7f83a000b990 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f83b40098d0 tx=0x7f83b401c650 comp rx=0 tx=0).stop 2024-09-13T17:54:03.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.026+0000 7f83c3000640 1 -- 172.21.15.114:0/2314267748 shutdown_connections 2024-09-13T17:54:03.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.026+0000 7f83c3000640 1 --2- 172.21.15.114:0/2314267748 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83a00051e0 0x7f83a000b990 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:03.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.026+0000 7f83c3000640 1 -- 172.21.15.114:0/2314267748 >> 172.21.15.114:0/2314267748 conn(0x7f83bc0660b0 msgr2=0x7f83bc069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:03.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.026+0000 7f83c3000640 1 -- 172.21.15.114:0/2314267748 shutdown_connections 2024-09-13T17:54:03.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.026+0000 7f83c3000640 1 -- 172.21.15.114:0/2314267748 wait complete. 2024-09-13T17:54:03.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.026+0000 7f83c3000640 1 Processor -- start 2024-09-13T17:54:03.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.026+0000 7f83c3000640 1 -- start start 2024-09-13T17:54:03.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.026+0000 7f83c3000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83a00051e0 0x7f83bc0a8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:03.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.026+0000 7f83c3000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83bc1567b0 0x7f83bc13dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:03.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.026+0000 7f83c3000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83bc13e280 0x7f83bc0b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:03.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.026+0000 7f83c3000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc13e730 con 0x7f83bc1567b0 2024-09-13T17:54:03.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.026+0000 7f83c3000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc0a8c80 con 0x7f83bc13e280 2024-09-13T17:54:03.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.026+0000 7f83c3000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc0a7650 con 0x7f83a00051e0 2024-09-13T17:54:03.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.026+0000 7f83b3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83bc1567b0 0x7f83bc13dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:03.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.026+0000 7f83b3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83bc1567b0 0x7f83bc13dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47144/0 (socket says 172.21.15.114:47144) 2024-09-13T17:54:03.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.026+0000 7f83b3400640 1 -- 172.21.15.114:0/83825170 learned_addr learned my addr 172.21.15.114:0/83825170 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:03.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.026+0000 7f83c1000640 1 --2- 172.21.15.114:0/83825170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83bc13e280 0x7f83bc0b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:03.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.026+0000 7f83bbe00640 1 --2- 172.21.15.114:0/83825170 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83a00051e0 0x7f83bc0a8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:03.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.026+0000 7f83b3400640 1 -- 172.21.15.114:0/83825170 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83a00051e0 msgr2=0x7f83bc0a8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:03.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.026+0000 7f83b3400640 1 --2- 172.21.15.114:0/83825170 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83a00051e0 0x7f83bc0a8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:03.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.026+0000 7f83b3400640 1 -- 172.21.15.114:0/83825170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83bc13e280 msgr2=0x7f83bc0b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:03.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.026+0000 7f83b3400640 1 --2- 172.21.15.114:0/83825170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83bc13e280 0x7f83bc0b0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:03.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.026+0000 7f83b3400640 1 -- 172.21.15.114:0/83825170 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc0b0ed0 con 0x7f83bc1567b0 2024-09-13T17:54:03.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.030+0000 7f83b3400640 1 --2- 172.21.15.114:0/83825170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83bc1567b0 0x7f83bc13dd40 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f83a40117c0 tx=0x7f83a4011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:03.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.030+0000 7f83b8c00640 1 -- 172.21.15.114:0/83825170 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a400fb60 con 0x7f83bc1567b0 2024-09-13T17:54:03.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.030+0000 7f83b8c00640 1 -- 172.21.15.114:0/83825170 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a400fcc0 con 0x7f83bc1567b0 2024-09-13T17:54:03.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.030+0000 7f83c3000640 1 -- 172.21.15.114:0/83825170 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83bc0a7910 con 0x7f83bc1567b0 2024-09-13T17:54:03.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.030+0000 7f83b8c00640 1 -- 172.21.15.114:0/83825170 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a4011e70 con 0x7f83bc1567b0 2024-09-13T17:54:03.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.030+0000 7f83c3000640 1 -- 172.21.15.114:0/83825170 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83bc156c30 con 0x7f83bc1567b0 2024-09-13T17:54:03.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.030+0000 7f83c3000640 1 -- 172.21.15.114:0/83825170 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83bc070620 con 0x7f83bc1567b0 2024-09-13T17:54:03.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.030+0000 7f83b8c00640 1 -- 172.21.15.114:0/83825170 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f83a4015410 con 0x7f83bc1567b0 2024-09-13T17:54:03.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.030+0000 7f83b8c00640 1 --2- 172.21.15.114:0/83825170 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f83980666c0 0x7f8398068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:03.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.030+0000 7f83b8c00640 1 -- 172.21.15.114:0/83825170 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f83a4086f90 con 0x7f83bc1567b0 2024-09-13T17:54:03.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.030+0000 7f83bbe00640 1 --2- 172.21.15.114:0/83825170 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f83980666c0 0x7f8398068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:03.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.034+0000 7f83bbe00640 1 --2- 172.21.15.114:0/83825170 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f83980666c0 0x7f8398068b80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f83ac001e80 tx=0x7f83ac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:03.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.034+0000 7f83b8c00640 1 -- 172.21.15.114:0/83825170 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f83a4054500 con 0x7f83bc1567b0 2024-09-13T17:54:03.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.190+0000 7f83c3000640 1 -- 172.21.15.114:0/83825170 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f83bc0a7dc0 con 0x7f83bc1567b0 2024-09-13T17:54:03.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.194+0000 7f83b8c00640 1 -- 172.21.15.114:0/83825170 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f83a405ce60 con 0x7f83bc1567b0 2024-09-13T17:54:03.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.194+0000 7f83c3000640 1 -- 172.21.15.114:0/83825170 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f83980666c0 msgr2=0x7f8398068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:03.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.194+0000 7f83c3000640 1 --2- 172.21.15.114:0/83825170 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f83980666c0 0x7f8398068b80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f83ac001e80 tx=0x7f83ac009040 comp rx=0 tx=0).stop 2024-09-13T17:54:03.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.194+0000 7f83c3000640 1 -- 172.21.15.114:0/83825170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83bc1567b0 msgr2=0x7f83bc13dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:03.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.194+0000 7f83c3000640 1 --2- 172.21.15.114:0/83825170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83bc1567b0 0x7f83bc13dd40 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f83a40117c0 tx=0x7f83a4011bc0 comp rx=0 tx=0).stop 2024-09-13T17:54:03.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.194+0000 7f83c3000640 1 -- 172.21.15.114:0/83825170 shutdown_connections 2024-09-13T17:54:03.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.194+0000 7f83c3000640 1 --2- 172.21.15.114:0/83825170 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f83980666c0 0x7f8398068b80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:03.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.194+0000 7f83c3000640 1 --2- 172.21.15.114:0/83825170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83bc13e280 0x7f83bc0b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:03.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.194+0000 7f83c3000640 1 --2- 172.21.15.114:0/83825170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83bc1567b0 0x7f83bc13dd40 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:03.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.194+0000 7f83c3000640 1 --2- 172.21.15.114:0/83825170 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f83a00051e0 0x7f83bc0a8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:03.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.194+0000 7f83c3000640 1 -- 172.21.15.114:0/83825170 >> 172.21.15.114:0/83825170 conn(0x7f83bc0660b0 msgr2=0x7f83bc0caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:03.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.198+0000 7f83c3000640 1 -- 172.21.15.114:0/83825170 shutdown_connections 2024-09-13T17:54:03.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.198+0000 7f83c3000640 1 -- 172.21.15.114:0/83825170 wait complete. 2024-09-13T17:54:03.221 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple' 2024-09-13T17:54:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.354+0000 7f7fe8a00640 1 Processor -- start 2024-09-13T17:54:03.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.354+0000 7f7fe8a00640 1 -- start start 2024-09-13T17:54:03.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.354+0000 7f7fe8a00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7fe415c880 0x7f7fe40d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:03.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.354+0000 7f7fe8a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7fe4099180 0x7f7fe40cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:03.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.354+0000 7f7fe8a00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe40ca980 con 0x7f7fe406bfc0 2024-09-13T17:54:03.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.354+0000 7f7fe8a00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe415cc60 con 0x7f7fe415c880 2024-09-13T17:54:03.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.354+0000 7f7fe8a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe406c450 con 0x7f7fe4099180 2024-09-13T17:54:03.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.354+0000 7f7fe2800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7fe415c880 0x7f7fe40d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:03.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.354+0000 7f7fe2800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7fe415c880 0x7f7fe40d0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47148/0 (socket says 172.21.15.114:47148) 2024-09-13T17:54:03.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.354+0000 7f7fe2800640 1 -- 172.21.15.114:0/2191864259 learned_addr learned my addr 172.21.15.114:0/2191864259 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:03.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.354+0000 7f7fe3200640 1 --2- 172.21.15.114:0/2191864259 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7fe4099180 0x7f7fe40cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:03.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.354+0000 7f7fe2800640 1 -- 172.21.15.114:0/2191864259 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7fe4099180 msgr2=0x7f7fe40cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:03.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.354+0000 7f7fe2800640 1 --2- 172.21.15.114:0/2191864259 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7fe4099180 0x7f7fe40cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:03.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.354+0000 7f7fe2800640 1 -- 172.21.15.114:0/2191864259 >> v1:172.21.15.134:6789/0 conn(0x7f7fe406bfc0 legacy=0x7f7fe4098a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:03.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.354+0000 7f7fe2800640 1 -- 172.21.15.114:0/2191864259 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe406c730 con 0x7f7fe415c880 2024-09-13T17:54:03.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.358+0000 7f7fe2800640 1 --2- 172.21.15.114:0/2191864259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fe415c880 0x7f7fe40d0e50 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4009870 tx=0x7f7fd401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731949b7360d07b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:03.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.358+0000 7f7fe1400640 1 -- 172.21.15.114:0/2191864259 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd40a6040 con 0x7f7fe415c880 2024-09-13T17:54:03.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.358+0000 7f7fe1400640 1 -- 172.21.15.114:0/2191864259 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd40aa600 con 0x7f7fe415c880 2024-09-13T17:54:03.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.358+0000 7f7fe1400640 1 -- 172.21.15.114:0/2191864259 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd40aa990 con 0x7f7fe415c880 2024-09-13T17:54:03.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.358+0000 7f7fe8a00640 1 -- 172.21.15.114:0/2191864259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fe415c880 msgr2=0x7f7fe40d0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:03.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.358+0000 7f7fe8a00640 1 --2- 172.21.15.114:0/2191864259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fe415c880 0x7f7fe40d0e50 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4009870 tx=0x7f7fd401c4a0 comp rx=0 tx=0).stop 2024-09-13T17:54:03.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.358+0000 7f7fe8a00640 1 -- 172.21.15.114:0/2191864259 shutdown_connections 2024-09-13T17:54:03.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.358+0000 7f7fe8a00640 1 --2- 172.21.15.114:0/2191864259 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7fe4099180 0x7f7fe40cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:03.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.358+0000 7f7fe8a00640 1 --2- 172.21.15.114:0/2191864259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fe415c880 0x7f7fe40d0e50 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:03.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.358+0000 7f7fe8a00640 1 -- 172.21.15.114:0/2191864259 >> 172.21.15.114:0/2191864259 conn(0x7f7fe40d0330 msgr2=0x7f7fe40d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:03.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.358+0000 7f7fe8a00640 1 -- 172.21.15.114:0/2191864259 shutdown_connections 2024-09-13T17:54:03.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.358+0000 7f7fe8a00640 1 -- 172.21.15.114:0/2191864259 wait complete. 2024-09-13T17:54:03.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.358+0000 7f7fe8a00640 1 Processor -- start 2024-09-13T17:54:03.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.358+0000 7f7fe8a00640 1 -- start start 2024-09-13T17:54:03.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.362+0000 7f7fe8a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7fe4099180 0x7f7fe41577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:03.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.362+0000 7f7fe8a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fe415c880 0x7f7fe40c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:03.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.362+0000 7f7fe8a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fe4157cf0 0x7f7fe415abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:03.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.362+0000 7f7fe8a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe4159e20 con 0x7f7fe415c880 2024-09-13T17:54:03.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.362+0000 7f7fe8a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe415a100 con 0x7f7fe4157cf0 2024-09-13T17:54:03.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.362+0000 7f7fe8a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe415a3e0 con 0x7f7fe4099180 2024-09-13T17:54:03.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.362+0000 7f7fe1e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fe415c880 0x7f7fe40c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:03.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.362+0000 7f7fe1e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fe415c880 0x7f7fe40c8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47156/0 (socket says 172.21.15.114:47156) 2024-09-13T17:54:03.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.362+0000 7f7fe1e00640 1 -- 172.21.15.114:0/2401449609 learned_addr learned my addr 172.21.15.114:0/2401449609 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:03.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.362+0000 7f7fe2800640 1 --2- 172.21.15.114:0/2401449609 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7fe4099180 0x7f7fe41577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:03.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.362+0000 7f7fe3200640 1 --2- 172.21.15.114:0/2401449609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fe4157cf0 0x7f7fe415abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:03.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.362+0000 7f7fe1e00640 1 -- 172.21.15.114:0/2401449609 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7fe4099180 msgr2=0x7f7fe41577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:03.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.362+0000 7f7fe1e00640 1 --2- 172.21.15.114:0/2401449609 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7fe4099180 0x7f7fe41577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:03.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.362+0000 7f7fe1e00640 1 -- 172.21.15.114:0/2401449609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fe4157cf0 msgr2=0x7f7fe415abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:03.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.362+0000 7f7fe1e00640 1 --2- 172.21.15.114:0/2401449609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fe4157cf0 0x7f7fe415abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:03.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.362+0000 7f7fe1e00640 1 -- 172.21.15.114:0/2401449609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd40094d0 con 0x7f7fe415c880 2024-09-13T17:54:03.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.362+0000 7f7fe1e00640 1 --2- 172.21.15.114:0/2401449609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fe415c880 0x7f7fe40c8b50 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f7fd000c500 tx=0x7f7fd000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:03.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.362+0000 7f7fdaa00640 1 -- 172.21.15.114:0/2401449609 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0005220 con 0x7f7fe415c880 2024-09-13T17:54:03.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.362+0000 7f7fdaa00640 1 -- 172.21.15.114:0/2401449609 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd0005380 con 0x7f7fe415c880 2024-09-13T17:54:03.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.362+0000 7f7fdaa00640 1 -- 172.21.15.114:0/2401449609 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0007270 con 0x7f7fe415c880 2024-09-13T17:54:03.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.362+0000 7f7fe8a00640 1 -- 172.21.15.114:0/2401449609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe415a6c0 con 0x7f7fe415c880 2024-09-13T17:54:03.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.362+0000 7f7fe8a00640 1 -- 172.21.15.114:0/2401449609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe4156a80 con 0x7f7fe415c880 2024-09-13T17:54:03.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.362+0000 7f7fe8a00640 1 -- 172.21.15.114:0/2401449609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe415a900 con 0x7f7fe415c880 2024-09-13T17:54:03.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.362+0000 7f7fdaa00640 1 -- 172.21.15.114:0/2401449609 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7fd00073d0 con 0x7f7fe415c880 2024-09-13T17:54:03.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.366+0000 7f7fdaa00640 1 --2- 172.21.15.114:0/2401449609 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7fc40666c0 0x7f7fc4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:03.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.366+0000 7f7fdaa00640 1 -- 172.21.15.114:0/2401449609 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f7fd0083780 con 0x7f7fe415c880 2024-09-13T17:54:03.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.366+0000 7f7fe2800640 1 --2- 172.21.15.114:0/2401449609 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7fc40666c0 0x7f7fc4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:03.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.366+0000 7f7fe2800640 1 --2- 172.21.15.114:0/2401449609 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7fc40666c0 0x7f7fc4068b80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40ae000 tx=0x7f7fd40b5040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:03.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.370+0000 7f7fdaa00640 1 -- 172.21.15.114:0/2401449609 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7fe415a900 con 0x7f7fe415c880 2024-09-13T17:54:03.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:03.577+0000 7f7fe8a00640 1 -- 172.21.15.114:0/2401449609 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple"]} v 0) v1 -- 0x7f7fe4159f60 con 0x7f7fe415c880 2024-09-13T17:54:04.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:04.525+0000 7f7fdaa00640 1 -- 172.21.15.114:0/2401449609 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_recovery_pool.TestRecoveryPool.test_rebuild_simple"]}]=0 v152) v1 ==== 147+0+0 (secure 0 0 0) 0x7f7fe4159f60 con 0x7f7fe415c880 2024-09-13T17:54:04.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:04.525+0000 7f7fe8a00640 1 -- 172.21.15.114:0/2401449609 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7fc40666c0 msgr2=0x7f7fc4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:04.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:04.525+0000 7f7fe8a00640 1 --2- 172.21.15.114:0/2401449609 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7fc40666c0 0x7f7fc4068b80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40ae000 tx=0x7f7fd40b5040 comp rx=0 tx=0).stop 2024-09-13T17:54:04.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:04.525+0000 7f7fe8a00640 1 -- 172.21.15.114:0/2401449609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fe415c880 msgr2=0x7f7fe40c8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:04.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:04.525+0000 7f7fe8a00640 1 --2- 172.21.15.114:0/2401449609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fe415c880 0x7f7fe40c8b50 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f7fd000c500 tx=0x7f7fd000c9c0 comp rx=0 tx=0).stop 2024-09-13T17:54:04.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:04.525+0000 7f7fe8a00640 1 -- 172.21.15.114:0/2401449609 shutdown_connections 2024-09-13T17:54:04.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:04.525+0000 7f7fe8a00640 1 --2- 172.21.15.114:0/2401449609 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7fc40666c0 0x7f7fc4068b80 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:04.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:04.525+0000 7f7fe8a00640 1 --2- 172.21.15.114:0/2401449609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fe4157cf0 0x7f7fe415abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:04.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:04.525+0000 7f7fe8a00640 1 --2- 172.21.15.114:0/2401449609 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fe415c880 0x7f7fe40c8b50 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:04.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:04.525+0000 7f7fe8a00640 1 --2- 172.21.15.114:0/2401449609 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f7fe4099180 0x7f7fe41577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:04.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:04.525+0000 7f7fe8a00640 1 -- 172.21.15.114:0/2401449609 >> 172.21.15.114:0/2401449609 conn(0x7f7fe40d0330 msgr2=0x7f7fe40ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:04.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:04.525+0000 7f7fe8a00640 1 -- 172.21.15.114:0/2401449609 shutdown_connections 2024-09-13T17:54:04.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:04.525+0000 7f7fe8a00640 1 -- 172.21.15.114:0/2401449609 wait complete. 2024-09-13T17:54:04.556 INFO:tasks.cephfs_test_runner:test_rebuild_simple (tasks.cephfs.test_recovery_pool.TestRecoveryPool) ... ok 2024-09-13T17:54:04.557 INFO:tasks.cephfs_test_runner: 2024-09-13T17:54:04.557 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-13T17:54:04.557 INFO:tasks.cephfs_test_runner:Ran 1 test in 84.094s 2024-09-13T17:54:04.557 INFO:tasks.cephfs_test_runner: 2024-09-13T17:54:04.557 INFO:tasks.cephfs_test_runner:OK 2024-09-13T17:54:04.557 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-13T17:54:04.567 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-13T17:54:04.614 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-13T17:54:04.614 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:54:04.614 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:54:04.623 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350196k,nr_inodes=4087549,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7573 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:54:04.623 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-13T17:54:04.623 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:54:04.674 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350196k,nr_inodes=4087549,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7573 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T17:54:04.674 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:54:04.674 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:54:04.684 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350256k,nr_inodes=4087564,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4616 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:54:04.684 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-13T17:54:04.684 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T17:54:04.734 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350256k,nr_inodes=4087564,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4616 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274984k,nr_inodes=818746,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274988k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T17:54:04.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:54:04.734 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-13T17:54:04.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T17:54:04.743 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T17:54:04.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:54:04.744 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T17:54:04.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:54:04.812 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T17:54:05.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:54:05.274 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-09-13T17:54:05.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:54:05.409 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-13T17:54:05.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:54:05.419 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-09-13T17:54:05.843 INFO:teuthology.orchestra.run.smithi114.stderr:Cannot find device "ceph-brx" 2024-09-13T17:54:05.845 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:54:05.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:54:05.845 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-09-13T17:54:05.855 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T17:54:05.855 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T17:54:05.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:54:05.857 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T17:54:05.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:54:05.922 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T17:54:06.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:54:06.373 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2024-09-13T17:54:06.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:54:06.541 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-09-13T17:54:06.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T17:54:06.550 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2024-09-13T17:54:06.992 INFO:teuthology.orchestra.run.smithi134.stderr:Cannot find device "ceph-brx" 2024-09-13T17:54:06.994 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:54:06.995 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T17:54:07.004 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T17:54:07.004 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:54:07.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.145+0000 7f8abe200640 1 Processor -- start 2024-09-13T17:54:07.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.145+0000 7f8abe200640 1 -- start start 2024-09-13T17:54:07.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.145+0000 7f8abe200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8ab80b4ab0 0x7f8ab80ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:07.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.145+0000 7f8abe200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ab80cada0 0x7f8ab80cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:07.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.145+0000 7f8abe200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab8099d70 con 0x7f8ab815a4a0 2024-09-13T17:54:07.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.145+0000 7f8abe200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab80997b0 con 0x7f8ab80b4ab0 2024-09-13T17:54:07.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.145+0000 7f8abe200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab8099a90 con 0x7f8ab80cada0 2024-09-13T17:54:07.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.145+0000 7f8ab7e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8ab80b4ab0 0x7f8ab80ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:07.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.145+0000 7f8abd800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ab80cada0 0x7f8ab80cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:07.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.145+0000 7f8ab7e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8ab80b4ab0 0x7f8ab80ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:42402/0 (socket says 172.21.15.114:42402) 2024-09-13T17:54:07.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.145+0000 7f8ab7e00640 1 -- 172.21.15.114:0/2656121324 learned_addr learned my addr 172.21.15.114:0/2656121324 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:07.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.145+0000 7f8abce00640 1 --1- 172.21.15.114:0/2656121324 >> v1:172.21.15.134:6789/0 conn(0x7f8ab815a4a0 0x7f8ab80ce230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.114:44728/0 (socket says 172.21.15.114:44728) 2024-09-13T17:54:07.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.145+0000 7f8ab7e00640 1 -- 172.21.15.114:0/2656121324 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ab80cada0 msgr2=0x7f8ab80cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:07.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.145+0000 7f8ab7e00640 1 --2- 172.21.15.114:0/2656121324 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ab80cada0 0x7f8ab80cb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.145+0000 7f8ab7e00640 1 -- 172.21.15.114:0/2656121324 >> v1:172.21.15.134:6789/0 conn(0x7f8ab815a4a0 legacy=0x7f8ab80ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:07.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.145+0000 7f8ab7e00640 1 -- 172.21.15.114:0/2656121324 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab80b32a0 con 0x7f8ab80b4ab0 2024-09-13T17:54:07.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.145+0000 7f8ab7400640 1 -- 172.21.15.114:0/2656121324 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2844756522 0 0) 0x7f8ab8099d70 con 0x7f8ab815a4a0 2024-09-13T17:54:07.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.145+0000 7f8abd800640 1 --2- 172.21.15.114:0/2656121324 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ab80cada0 0x7f8ab80cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:54:07.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.149+0000 7f8ab7e00640 1 --2- 172.21.15.114:0/2656121324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ab80b4ab0 0x7f8ab80ce940 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4009870 tx=0x7f8aa401c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efd9317d791f4ef0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:07.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.149+0000 7f8ab7400640 1 -- 172.21.15.114:0/2656121324 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa40aa430 con 0x7f8ab80b4ab0 2024-09-13T17:54:07.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.149+0000 7f8ab7400640 1 -- 172.21.15.114:0/2656121324 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa40aa590 con 0x7f8ab80b4ab0 2024-09-13T17:54:07.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.149+0000 7f8ab7400640 1 -- 172.21.15.114:0/2656121324 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa40aa920 con 0x7f8ab80b4ab0 2024-09-13T17:54:07.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.149+0000 7f8abe200640 1 -- 172.21.15.114:0/2656121324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ab80b4ab0 msgr2=0x7f8ab80ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:07.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.149+0000 7f8abe200640 1 --2- 172.21.15.114:0/2656121324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ab80b4ab0 0x7f8ab80ce940 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4009870 tx=0x7f8aa401c530 comp rx=0 tx=0).stop 2024-09-13T17:54:07.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.149+0000 7f8abe200640 1 -- 172.21.15.114:0/2656121324 shutdown_connections 2024-09-13T17:54:07.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.149+0000 7f8abe200640 1 --2- 172.21.15.114:0/2656121324 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ab80cada0 0x7f8ab80cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.149+0000 7f8abe200640 1 --2- 172.21.15.114:0/2656121324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ab80b4ab0 0x7f8ab80ce940 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.149+0000 7f8abe200640 1 -- 172.21.15.114:0/2656121324 >> 172.21.15.114:0/2656121324 conn(0x7f8ab80d0330 msgr2=0x7f8ab80d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:07.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.149+0000 7f8abe200640 1 -- 172.21.15.114:0/2656121324 shutdown_connections 2024-09-13T17:54:07.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.149+0000 7f8abe200640 1 -- 172.21.15.114:0/2656121324 wait complete. 2024-09-13T17:54:07.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.153+0000 7f8abe200640 1 Processor -- start 2024-09-13T17:54:07.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.153+0000 7f8abe200640 1 -- start start 2024-09-13T17:54:07.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.153+0000 7f8abe200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ab80b4ab0 0x7f8ab8151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:07.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.153+0000 7f8abe200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ab80cada0 0x7f8ab8150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:07.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.153+0000 7f8abe200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ab815a4a0 0x7f8ab81f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:07.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.153+0000 7f8abe200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab80c4910 con 0x7f8ab80b4ab0 2024-09-13T17:54:07.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.153+0000 7f8abe200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab81510b0 con 0x7f8ab80cada0 2024-09-13T17:54:07.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.153+0000 7f8abe200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab80c3d20 con 0x7f8ab815a4a0 2024-09-13T17:54:07.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.153+0000 7f8abce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ab80b4ab0 0x7f8ab8151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:07.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.153+0000 7f8abce00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ab80b4ab0 0x7f8ab8151720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47166/0 (socket says 172.21.15.114:47166) 2024-09-13T17:54:07.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.153+0000 7f8abce00640 1 -- 172.21.15.114:0/3314216409 learned_addr learned my addr 172.21.15.114:0/3314216409 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:07.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.153+0000 7f8ab7e00640 1 --2- 172.21.15.114:0/3314216409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ab80cada0 0x7f8ab8150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:07.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.153+0000 7f8abd800640 1 --2- 172.21.15.114:0/3314216409 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ab815a4a0 0x7f8ab81f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:07.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.153+0000 7f8abce00640 1 -- 172.21.15.114:0/3314216409 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ab815a4a0 msgr2=0x7f8ab81f5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:07.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.153+0000 7f8abce00640 1 --2- 172.21.15.114:0/3314216409 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ab815a4a0 0x7f8ab81f5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.153+0000 7f8abce00640 1 -- 172.21.15.114:0/3314216409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ab80cada0 msgr2=0x7f8ab8150b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:07.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.153+0000 7f8abce00640 1 --2- 172.21.15.114:0/3314216409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ab80cada0 0x7f8ab8150b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.153+0000 7f8abce00640 1 -- 172.21.15.114:0/3314216409 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab0009a70 con 0x7f8ab80b4ab0 2024-09-13T17:54:07.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.153+0000 7f8abce00640 1 --2- 172.21.15.114:0/3314216409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ab80b4ab0 0x7f8ab8151720 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0011f0 tx=0x7f8aac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:07.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.153+0000 7f8ab4c00640 1 -- 172.21.15.114:0/3314216409 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac0074e0 con 0x7f8ab80b4ab0 2024-09-13T17:54:07.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.153+0000 7f8ab4c00640 1 -- 172.21.15.114:0/3314216409 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aac007640 con 0x7f8ab80b4ab0 2024-09-13T17:54:07.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.153+0000 7f8abe200640 1 -- 172.21.15.114:0/3314216409 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa40094d0 con 0x7f8ab80b4ab0 2024-09-13T17:54:07.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.153+0000 7f8ab4c00640 1 -- 172.21.15.114:0/3314216409 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac0049f0 con 0x7f8ab80b4ab0 2024-09-13T17:54:07.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.153+0000 7f8abe200640 1 -- 172.21.15.114:0/3314216409 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab80c3f70 con 0x7f8ab80b4ab0 2024-09-13T17:54:07.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.153+0000 7f8abe200640 1 -- 172.21.15.114:0/3314216409 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab80cb230 con 0x7f8ab80b4ab0 2024-09-13T17:54:07.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.157+0000 7f8ab4c00640 1 -- 172.21.15.114:0/3314216409 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8aac004b50 con 0x7f8ab80b4ab0 2024-09-13T17:54:07.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.157+0000 7f8ab4c00640 1 --2- 172.21.15.114:0/3314216409 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8a98066690 0x7f8a98068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:07.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.157+0000 7f8ab4c00640 1 -- 172.21.15.114:0/3314216409 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f8aac083d20 con 0x7f8ab80b4ab0 2024-09-13T17:54:07.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.157+0000 7f8ab7e00640 1 --2- 172.21.15.114:0/3314216409 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8a98066690 0x7f8a98068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:07.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.157+0000 7f8ab7e00640 1 --2- 172.21.15.114:0/3314216409 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8a98066690 0x7f8a98068b50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40ae000 tx=0x7f8aa40b5040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:07.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.161+0000 7f8ab4c00640 1 -- 172.21.15.114:0/3314216409 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8aac088070 con 0x7f8ab80b4ab0 2024-09-13T17:54:07.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.313+0000 7f8abe200640 1 -- 172.21.15.114:0/3314216409 --> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8ab806f130 con 0x7f8a98066690 2024-09-13T17:54:07.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.313+0000 7f8ab4c00640 1 -- 172.21.15.114:0/3314216409 <== mgr.4102 v2:172.21.15.114:6832/137691478 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50701 (secure 0 0 0) 0x7f8ab806f130 con 0x7f8a98066690 2024-09-13T17:54:07.322 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:54:07.322 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-13T17:54:07.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.317+0000 7f8abe200640 1 -- 172.21.15.114:0/3314216409 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8a98066690 msgr2=0x7f8a98068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:07.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.317+0000 7f8abe200640 1 --2- 172.21.15.114:0/3314216409 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8a98066690 0x7f8a98068b50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40ae000 tx=0x7f8aa40b5040 comp rx=0 tx=0).stop 2024-09-13T17:54:07.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.317+0000 7f8abe200640 1 -- 172.21.15.114:0/3314216409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ab80b4ab0 msgr2=0x7f8ab8151720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:07.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.317+0000 7f8abe200640 1 --2- 172.21.15.114:0/3314216409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ab80b4ab0 0x7f8ab8151720 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0011f0 tx=0x7f8aac00c8f0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.317+0000 7f8abe200640 1 -- 172.21.15.114:0/3314216409 shutdown_connections 2024-09-13T17:54:07.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.317+0000 7f8abe200640 1 --2- 172.21.15.114:0/3314216409 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f8a98066690 0x7f8a98068b50 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.317+0000 7f8abe200640 1 --2- 172.21.15.114:0/3314216409 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f8ab815a4a0 0x7f8ab81f5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.317+0000 7f8abe200640 1 --2- 172.21.15.114:0/3314216409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ab80cada0 0x7f8ab8150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.317+0000 7f8abe200640 1 --2- 172.21.15.114:0/3314216409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ab80b4ab0 0x7f8ab8151720 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.317+0000 7f8abe200640 1 -- 172.21.15.114:0/3314216409 >> 172.21.15.114:0/3314216409 conn(0x7f8ab80d0330 msgr2=0x7f8ab806ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:07.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.317+0000 7f8abe200640 1 -- 172.21.15.114:0/3314216409 shutdown_connections 2024-09-13T17:54:07.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.317+0000 7f8abe200640 1 -- 172.21.15.114:0/3314216409 wait complete. 2024-09-13T17:54:07.342 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":119,"stamp":"2024-09-13T17:54:05.961721+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":234368,"kb_used_data":18200,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754740352,"statfs":{"total":773094113280,"available":772854120448,"internally_reserved":0,"allocated":18636800,"data_stored":15961209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6322157,"num_objects":-15,"num_object_clones":0,"num_object_copies":-30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-15,"num_whiteouts":0,"num_read":-53,"num_read_kb":-39,"num_write":-50,"num_write_kb":-6193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.704415"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":193,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-13T17:54:01.754835+0000","last_change":"2024-09-13T17:51:40.205691+0000","last_active":"2024-09-13T17:54:01.754835+0000","last_peered":"2024-09-13T17:54:01.754835+0000","last_clean":"2024-09-13T17:54:01.754835+0000","last_became_active":"2024-09-13T17:51:40.204577+0000","last_became_peered":"2024-09-13T17:51:40.204577+0000","last_unstale":"2024-09-13T17:54:01.754835+0000","last_undegraded":"2024-09-13T17:54:01.754835+0000","last_fullsized":"2024-09-13T17:54:01.754835+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_clean_scrub_stamp":"2024-09-13T17:51:38.340495+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:37.899275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30240,"kb_used_data":3220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341600,"statfs":{"total":96636764160,"available":96605798400,"internally_reserved":0,"allocated":3297280,"data_stored":2961466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72099999999999997,"15min":0.72699999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0209999999999999,"5min":1.073,"15min":1.073},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69699999999999995,"15min":0.69799999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.871,"5min":1.012,"15min":1.012},"last":0.75700000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.54200000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92700000000000005,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68000000000000005,"15min":0.67900000000000005},"min":{"1min":0.49199999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.71799999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.51300000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84099999999999997,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.75700000000000001,"15min":0.75800000000000001},"min":{"1min":0.58299999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.91700000000000004,"5min":1.097,"15min":1.097},"last":0.63}]},{"osd":3,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71699999999999997,"15min":0.71099999999999997},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.56999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.98299999999999998,"5min":1.024,"15min":1.024},"last":0.59099999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65400000000000003,"15min":0.65200000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64000000000000001,"15min":0.63200000000000001},"min":{"1min":0.497,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.68500000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.621,"15min":0.622},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.875,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.878,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.879}]},{"osd":6,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68600000000000005,"15min":0.68999999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90800000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72699999999999998,"15min":0.73299999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88300000000000001,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.78100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":273946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.68799999999999994,"15min":0.69599999999999995},"min":{"1min":0.40300000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92700000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.44500000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.91100000000000003,"5min":1.254,"15min":1.254},"last":0.872}]},{"osd":1,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.68300000000000005,"15min":0.69399999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.72199999999999998,"15min":0.73599999999999999},"min":{"1min":0.45400000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.85599999999999998,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.54400000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.74299999999999999,"15min":0.75600000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.98399999999999999,"5min":1.002,"15min":1.002},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.752,"15min":0.76000000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.90700000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.82299999999999995}]},{"osd":3,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.749,"15min":0.75800000000000001},"min":{"1min":0.53700000000000003,"5min":0.503,"15min":0.503},"max":{"1min":0.84699999999999998,"5min":1.008,"15min":1.008},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.76500000000000001,"15min":0.77500000000000002},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.92300000000000004,"5min":1.042,"15min":1.042},"last":0.51100000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.65500000000000003,"15min":0.66800000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.86899999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.71099999999999997,"15min":0.71699999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92800000000000005,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.96199999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68999999999999995,"15min":0.69399999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.97899999999999998,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.92800000000000005,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.81000000000000005,"15min":0.82099999999999995},"min":{"1min":0.57999999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.94899999999999995,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.80900000000000005,"15min":0.82599999999999996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94899999999999995,"5min":1.151,"15min":1.151},"last":0.88800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33756,"kb_used_data":6736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338084,"statfs":{"total":96636764160,"available":96602198016,"internally_reserved":0,"allocated":6897664,"data_stored":6565402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.83299999999999996,"5min":1.929,"15min":1.929},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.75700000000000001,"15min":0.77700000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76500000000000001,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.48499999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.88300000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.71199999999999997,"15min":0.71999999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.85099999999999998,"5min":1.139,"15min":1.139},"last":0.74299999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.73199999999999998,"15min":0.751},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.87,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.71499999999999997,"15min":0.73099999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76500000000000001,"5min":1.052,"15min":1.052},"last":0.52100000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.75600000000000001,"15min":0.77100000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.83599999999999997,"5min":1.385,"15min":1.385},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.75900000000000001,"15min":0.77300000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.85599999999999998,"5min":1.264,"15min":1.264},"last":0.46600000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61799999999999999,"15min":0.623},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.80600000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.624},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.66200000000000003,"15min":0.67100000000000004},"min":{"1min":0.44400000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.82399999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.63600000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85399999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89200000000000002,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.58899999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88900000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.52700000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.91400000000000003,"5min":1.181,"15min":1.181},"last":0.61199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27612,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":606208,"data_stored":273946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.82499999999999996,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.69399999999999995,"15min":0.70199999999999996},"min":{"1min":0.45700000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.876,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.626}]},{"osd":1,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69399999999999995,"15min":0.68999999999999995},"min":{"1min":0.55000000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90200000000000002,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.67100000000000004,"15min":0.67300000000000004},"min":{"1min":0.46800000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85099999999999998,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.82199999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66400000000000003,"15min":0.66000000000000003},"min":{"1min":0.53200000000000003,"5min":0.498,"15min":0.498},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69799999999999995,"15min":0.69599999999999995},"min":{"1min":0.54300000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.84599999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.80200000000000005,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.52000000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65100000000000002,"15min":0.65000000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.90600000000000003,"5min":1.048,"15min":1.048},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70399999999999996,"15min":0.70499999999999996},"min":{"1min":0.40400000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89500000000000002,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.90800000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.97899999999999998,"5min":1.02,"15min":1.02},"last":0.755},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.68200000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85699999999999998,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.88900000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.95799999999999996,"5min":1.161,"15min":1.161},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74299999999999999,"15min":0.748},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.032,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.86399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31708,"kb_used_data":4688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":4800512,"data_stored":4468250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.40100000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.58599999999999997,"15min":0.61299999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.59599999999999997,"5min":4.2460000000000004,"15min":4.2460000000000004},"last":0.38300000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.63800000000000001,"15min":0.67400000000000004},"min":{"1min":0.29999999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.66200000000000003,"5min":5.008,"15min":5.008},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70999999999999996,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.52400000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.69499999999999995,"15min":0.72799999999999998},"min":{"1min":0.38100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.71999999999999997,"5min":4.8570000000000002,"15min":4.8570000000000002},"last":0.433},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.70199999999999996,"15min":0.72999999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.872,"5min":4.8399999999999999,"15min":4.8399999999999999},"last":0.499}]},{"osd":4,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.871,"15min":0.89700000000000002},"min":{"1min":0.52000000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.0429999999999999,"5min":4.4450000000000003,"15min":4.4450000000000003},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.91400000000000003,"15min":0.94399999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.92800000000000005,"5min":4.9000000000000004,"15min":4.9000000000000004},"last":0.89400000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72799999999999998,"15min":0.72299999999999998},"min":{"1min":0.57799999999999996,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.89300000000000002,"15min":0.91400000000000003},"min":{"1min":0.59099999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.083,"5min":4.359,"15min":4.359},"last":0.73299999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.92200000000000004,"15min":0.95199999999999996},"min":{"1min":0.625,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1879999999999999,"5min":4.9710000000000001,"15min":4.9710000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.73499999999999999,"15min":0.72699999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.81999999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.91700000000000004,"15min":0.94299999999999995},"min":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.96299999999999997,"5min":4.4029999999999996,"15min":4.4029999999999996},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.98899999999999999,"15min":1.0189999999999999},"min":{"1min":0.69599999999999995,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2270000000000001,"5min":4.9349999999999996,"15min":4.9349999999999996},"last":0.872}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":606208,"data_stored":273946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.84199999999999997,"15min":0.90900000000000003},"min":{"1min":0.29399999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72799999999999998,"5min":5.5010000000000003,"15min":5.5010000000000003},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.68200000000000005,"15min":0.72299999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63300000000000001,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.54900000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.89100000000000001,"15min":0.95899999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.60899999999999999,"5min":5.3799999999999999,"15min":5.3799999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.77300000000000002,"15min":0.81100000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76800000000000002,"5min":4.2329999999999997,"15min":4.2329999999999997},"last":0.57799999999999996}]},{"osd":3,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.91500000000000004,"15min":0.99099999999999999},"min":{"1min":0.33100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.66700000000000004,"5min":5.032,"15min":5.032},"last":0.496},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.93700000000000006,"15min":1.0109999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.628,"5min":5.4189999999999996,"15min":5.4189999999999996},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":1.1519999999999999,"15min":1.2230000000000001},"min":{"1min":0.59699999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.97199999999999998,"5min":5.4480000000000004,"15min":5.4480000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":1.0069999999999999,"15min":1.0529999999999999},"min":{"1min":0.55800000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.85899999999999999,"5min":4.7460000000000004,"15min":4.7460000000000004},"last":0.83099999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.97899999999999998,"15min":1.02},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.998,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":1.1859999999999999,"15min":1.262},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.89300000000000002,"5min":5.4749999999999996,"15min":5.4749999999999996},"last":0.71299999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":1.0429999999999999,"15min":1.091},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94499999999999995,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":1.1639999999999999,"15min":1.232},"min":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.046,"5min":4.9859999999999998,"15min":4.9859999999999998},"last":0.81999999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":1.0449999999999999,"15min":1.095},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.98699999999999999,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":1.1819999999999999,"15min":1.2470000000000001},"min":{"1min":0.63900000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0029999999999999,"5min":4.8879999999999999,"15min":4.8879999999999999},"last":0.77800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":606208,"data_stored":273946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45500000000000002,"15min":0.45700000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.49099999999999999,"15min":0.49399999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71499999999999997,"5min":1.196,"15min":1.196},"last":0.42299999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77500000000000002,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.442},{"interface":"front","average":{"1min":0.502,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89800000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.55800000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.51500000000000001,"15min":0.52300000000000002},"min":{"1min":0.36599999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.57999999999999996,"5min":1.105,"15min":1.105},"last":0.54300000000000004}]},{"osd":4,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76900000000000002,"15min":0.77800000000000002},"min":{"1min":0.59399999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0740000000000001,"5min":1.175,"15min":1.175},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80600000000000005,"15min":0.81699999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.105,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.80400000000000005,"15min":0.81599999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.115,"5min":1.367,"15min":1.367},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.81399999999999995,"15min":0.82399999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.137,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.69099999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1799999999999999,"5min":1.417,"15min":1.417},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.80900000000000005,"15min":0.82699999999999996},"min":{"1min":0.54800000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.98399999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.78200000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.81100000000000005,"15min":0.81799999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.212,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.997,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.85199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28212,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343628,"statfs":{"total":96636764160,"available":96607875072,"internally_reserved":0,"allocated":1216512,"data_stored":870307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.434,"15min":0.436},"min":{"1min":0.26900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.60799999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.28799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.501}]},{"osd":2,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.50900000000000001,"15min":0.51100000000000001},"min":{"1min":0.35399999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.72399999999999998,"5min":0.88,"15min":0.88},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.77600000000000002,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.434}]},{"osd":3,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71499999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.41999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80200000000000005,"5min":1.089,"15min":1.089},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.79100000000000004,"15min":0.80000000000000004},"min":{"1min":0.51000000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96399999999999997,"5min":3.0350000000000001,"15min":3.0350000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.79000000000000004,"15min":0.80200000000000005},"min":{"1min":0.53700000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0109999999999999,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.65800000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.78900000000000003,"15min":0.80000000000000004},"min":{"1min":0.53800000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0009999999999999,"5min":1.911,"15min":1.911},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80400000000000005,"15min":0.81399999999999995},"min":{"1min":0.54400000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.103,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":0.64500000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.75900000000000001,"15min":0.76100000000000001},"min":{"1min":0.56200000000000006,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.95999999999999996,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.79600000000000004,"15min":0.80400000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.038,"5min":1.742,"15min":1.742},"last":0.56599999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.872,"15min":0.88400000000000001},"min":{"1min":0.56100000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.081,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.86799999999999999,"15min":0.88800000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0609999999999999,"5min":2.75,"15min":2.75},"last":0.73199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:54:07.344 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:54:07.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.469+0000 7f3cae200640 1 Processor -- start 2024-09-13T17:54:07.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.473+0000 7f3cae200640 1 -- start start 2024-09-13T17:54:07.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.473+0000 7f3cae200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3ca815a760 0x7f3ca80acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:07.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.473+0000 7f3cae200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ca80ad280 0x7f3ca80707b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:07.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.473+0000 7f3cae200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca815b700 con 0x7f3ca81548e0 2024-09-13T17:54:07.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.473+0000 7f3cae200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca8154cc0 con 0x7f3ca815a760 2024-09-13T17:54:07.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.473+0000 7f3cae200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca8070320 con 0x7f3ca80ad280 2024-09-13T17:54:07.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.473+0000 7f3cace00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3ca81548e0 0x7f3ca80ab2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49740/0 (socket says 172.21.15.114:49740) 2024-09-13T17:54:07.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.473+0000 7f3cace00640 1 -- 172.21.15.114:0/653917047 learned_addr learned my addr 172.21.15.114:0/653917047 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:54:07.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.473+0000 7f3ca7e00640 1 --2- 172.21.15.114:0/653917047 >> v2:172.21.15.134:3300/0 conn(0x7f3ca815a760 0x7f3ca80acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:07.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.473+0000 7f3cad800640 1 --2- 172.21.15.114:0/653917047 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ca80ad280 0x7f3ca80707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:07.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.473+0000 7f3ca7400640 1 -- 172.21.15.114:0/653917047 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873109042 0 0) 0x7f3ca815b700 con 0x7f3ca81548e0 2024-09-13T17:54:07.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.473+0000 7f3ca7400640 1 -- 172.21.15.114:0/653917047 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c90003530 con 0x7f3ca81548e0 2024-09-13T17:54:07.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.473+0000 7f3ca7e00640 1 -- 172.21.15.114:0/653917047 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ca80ad280 msgr2=0x7f3ca80707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:07.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.473+0000 7f3ca7e00640 1 --2- 172.21.15.114:0/653917047 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ca80ad280 0x7f3ca80707b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.473+0000 7f3ca7e00640 1 -- 172.21.15.114:0/653917047 >> v1:172.21.15.114:6789/0 conn(0x7f3ca81548e0 legacy=0x7f3ca80ab2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:07.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.473+0000 7f3ca7e00640 1 -- 172.21.15.114:0/653917047 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca815aba0 con 0x7f3ca815a760 2024-09-13T17:54:07.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.477+0000 7f3ca7e00640 1 --2- 172.21.15.114:0/653917047 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ca815a760 0x7f3ca80acd40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3c940097c0 tx=0x7f3c9401c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c6d5d84ae797cda server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:07.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.477+0000 7f3ca7400640 1 -- 172.21.15.114:0/653917047 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c940ac640 con 0x7f3ca815a760 2024-09-13T17:54:07.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.477+0000 7f3ca7400640 1 -- 172.21.15.114:0/653917047 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c940ac7a0 con 0x7f3ca815a760 2024-09-13T17:54:07.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.477+0000 7f3ca7400640 1 -- 172.21.15.114:0/653917047 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c940acb30 con 0x7f3ca815a760 2024-09-13T17:54:07.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.477+0000 7f3cae200640 1 -- 172.21.15.114:0/653917047 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ca815a760 msgr2=0x7f3ca80acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:07.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.477+0000 7f3cae200640 1 --2- 172.21.15.114:0/653917047 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ca815a760 0x7f3ca80acd40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3c940097c0 tx=0x7f3c9401c3e0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.477+0000 7f3cae200640 1 -- 172.21.15.114:0/653917047 shutdown_connections 2024-09-13T17:54:07.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.477+0000 7f3cae200640 1 --2- 172.21.15.114:0/653917047 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ca80ad280 0x7f3ca80707b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.477+0000 7f3cae200640 1 --2- 172.21.15.114:0/653917047 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ca815a760 0x7f3ca80acd40 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.477+0000 7f3cae200640 1 -- 172.21.15.114:0/653917047 >> 172.21.15.114:0/653917047 conn(0x7f3ca80ce0d0 msgr2=0x7f3ca80ce4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:07.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.477+0000 7f3cae200640 1 -- 172.21.15.114:0/653917047 shutdown_connections 2024-09-13T17:54:07.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.477+0000 7f3cae200640 1 -- 172.21.15.114:0/653917047 wait complete. 2024-09-13T17:54:07.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.477+0000 7f3cae200640 1 Processor -- start 2024-09-13T17:54:07.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.481+0000 7f3cae200640 1 -- start start 2024-09-13T17:54:07.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.481+0000 7f3cae200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ca80ad280 0x7f3ca814b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:07.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.481+0000 7f3cae200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ca81548e0 0x7f3ca81500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:07.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.481+0000 7f3cae200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ca815a760 0x7f3ca814e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:07.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.481+0000 7f3cae200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca814bd20 con 0x7f3ca80ad280 2024-09-13T17:54:07.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.481+0000 7f3cae200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca8150610 con 0x7f3ca815a760 2024-09-13T17:54:07.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.481+0000 7f3cae200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca814d920 con 0x7f3ca81548e0 2024-09-13T17:54:07.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.481+0000 7f3cace00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ca80ad280 0x7f3ca814b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:07.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.481+0000 7f3cace00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ca80ad280 0x7f3ca814b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47168/0 (socket says 172.21.15.114:47168) 2024-09-13T17:54:07.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.481+0000 7f3cace00640 1 -- 172.21.15.114:0/796912370 learned_addr learned my addr 172.21.15.114:0/796912370 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:07.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.481+0000 7f3cad800640 1 --2- 172.21.15.114:0/796912370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ca815a760 0x7f3ca814e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:07.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.481+0000 7f3ca7e00640 1 --2- 172.21.15.114:0/796912370 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ca81548e0 0x7f3ca81500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:07.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.481+0000 7f3cace00640 1 -- 172.21.15.114:0/796912370 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ca81548e0 msgr2=0x7f3ca81500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:07.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.481+0000 7f3cace00640 1 --2- 172.21.15.114:0/796912370 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ca81548e0 0x7f3ca81500d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.481+0000 7f3cace00640 1 -- 172.21.15.114:0/796912370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ca815a760 msgr2=0x7f3ca814e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:07.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.481+0000 7f3cace00640 1 --2- 172.21.15.114:0/796912370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ca815a760 0x7f3ca814e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.481+0000 7f3cace00640 1 -- 172.21.15.114:0/796912370 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c94009420 con 0x7f3ca80ad280 2024-09-13T17:54:07.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.481+0000 7f3cad800640 1 --2- 172.21.15.114:0/796912370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ca815a760 0x7f3ca814e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:54:07.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.481+0000 7f3cace00640 1 --2- 172.21.15.114:0/796912370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ca80ad280 0x7f3ca814b7e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00c4d0 tx=0x7f3c9c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:07.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.481+0000 7f3ca4c00640 1 -- 172.21.15.114:0/796912370 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c005cf0 con 0x7f3ca80ad280 2024-09-13T17:54:07.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.481+0000 7f3ca4c00640 1 -- 172.21.15.114:0/796912370 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9c005e50 con 0x7f3ca80ad280 2024-09-13T17:54:07.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.481+0000 7f3ca4c00640 1 -- 172.21.15.114:0/796912370 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c007270 con 0x7f3ca80ad280 2024-09-13T17:54:07.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.481+0000 7f3cae200640 1 -- 172.21.15.114:0/796912370 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca814dc00 con 0x7f3ca80ad280 2024-09-13T17:54:07.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.481+0000 7f3cae200640 1 -- 172.21.15.114:0/796912370 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca814e1c0 con 0x7f3ca80ad280 2024-09-13T17:54:07.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.481+0000 7f3cae200640 1 -- 172.21.15.114:0/796912370 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ca8163f00 con 0x7f3ca80ad280 2024-09-13T17:54:07.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.485+0000 7f3ca4c00640 1 -- 172.21.15.114:0/796912370 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3c9c0073d0 con 0x7f3ca80ad280 2024-09-13T17:54:07.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.485+0000 7f3ca4c00640 1 --2- 172.21.15.114:0/796912370 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3c88066690 0x7f3c88068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:07.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.485+0000 7f3ca4c00640 1 -- 172.21.15.114:0/796912370 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f3c9c0834a0 con 0x7f3ca80ad280 2024-09-13T17:54:07.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.485+0000 7f3ca7e00640 1 --2- 172.21.15.114:0/796912370 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3c88066690 0x7f3c88068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:07.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.485+0000 7f3ca7e00640 1 --2- 172.21.15.114:0/796912370 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3c88066690 0x7f3c88068b50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3c940ae000 tx=0x7f3c94008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:07.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.489+0000 7f3ca4c00640 1 -- 172.21.15.114:0/796912370 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3c9c050ab0 con 0x7f3ca80ad280 2024-09-13T17:54:07.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.637+0000 7f3cae200640 1 -- 172.21.15.114:0/796912370 --> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3ca80ad690 con 0x7f3c88066690 2024-09-13T17:54:07.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.641+0000 7f3ca4c00640 1 -- 172.21.15.114:0/796912370 <== mgr.4102 v2:172.21.15.114:6832/137691478 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50701 (secure 0 0 0) 0x7f3c940ac910 con 0x7f3c88066690 2024-09-13T17:54:07.647 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:54:07.647 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-13T17:54:07.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.641+0000 7f3cae200640 1 -- 172.21.15.114:0/796912370 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3c88066690 msgr2=0x7f3c88068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:07.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.641+0000 7f3cae200640 1 --2- 172.21.15.114:0/796912370 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3c88066690 0x7f3c88068b50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3c940ae000 tx=0x7f3c94008040 comp rx=0 tx=0).stop 2024-09-13T17:54:07.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.641+0000 7f3cae200640 1 -- 172.21.15.114:0/796912370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ca80ad280 msgr2=0x7f3ca814b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:07.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.641+0000 7f3cae200640 1 --2- 172.21.15.114:0/796912370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ca80ad280 0x7f3ca814b7e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00c4d0 tx=0x7f3c9c00c990 comp rx=0 tx=0).stop 2024-09-13T17:54:07.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.641+0000 7f3cae200640 1 -- 172.21.15.114:0/796912370 shutdown_connections 2024-09-13T17:54:07.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.641+0000 7f3cae200640 1 --2- 172.21.15.114:0/796912370 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3c88066690 0x7f3c88068b50 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.641+0000 7f3cae200640 1 --2- 172.21.15.114:0/796912370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ca815a760 0x7f3ca814e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.641+0000 7f3cae200640 1 --2- 172.21.15.114:0/796912370 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3ca81548e0 0x7f3ca81500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.641+0000 7f3cae200640 1 --2- 172.21.15.114:0/796912370 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ca80ad280 0x7f3ca814b7e0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.641+0000 7f3cae200640 1 -- 172.21.15.114:0/796912370 >> 172.21.15.114:0/796912370 conn(0x7f3ca80ce0d0 msgr2=0x7f3ca80cd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:07.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.641+0000 7f3cae200640 1 -- 172.21.15.114:0/796912370 shutdown_connections 2024-09-13T17:54:07.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.641+0000 7f3cae200640 1 -- 172.21.15.114:0/796912370 wait complete. 2024-09-13T17:54:07.667 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":119,"stamp":"2024-09-13T17:54:05.961721+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":234368,"kb_used_data":18200,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754740352,"statfs":{"total":773094113280,"available":772854120448,"internally_reserved":0,"allocated":18636800,"data_stored":15961209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6322157,"num_objects":-15,"num_object_clones":0,"num_object_copies":-30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-15,"num_whiteouts":0,"num_read":-53,"num_read_kb":-39,"num_write":-50,"num_write_kb":-6193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.704415"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":193,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-13T17:54:01.754835+0000","last_change":"2024-09-13T17:51:40.205691+0000","last_active":"2024-09-13T17:54:01.754835+0000","last_peered":"2024-09-13T17:54:01.754835+0000","last_clean":"2024-09-13T17:54:01.754835+0000","last_became_active":"2024-09-13T17:51:40.204577+0000","last_became_peered":"2024-09-13T17:51:40.204577+0000","last_unstale":"2024-09-13T17:54:01.754835+0000","last_undegraded":"2024-09-13T17:54:01.754835+0000","last_fullsized":"2024-09-13T17:54:01.754835+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_clean_scrub_stamp":"2024-09-13T17:51:38.340495+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:37.899275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30240,"kb_used_data":3220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341600,"statfs":{"total":96636764160,"available":96605798400,"internally_reserved":0,"allocated":3297280,"data_stored":2961466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72099999999999997,"15min":0.72699999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0209999999999999,"5min":1.073,"15min":1.073},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69699999999999995,"15min":0.69799999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.871,"5min":1.012,"15min":1.012},"last":0.75700000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.54200000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92700000000000005,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68000000000000005,"15min":0.67900000000000005},"min":{"1min":0.49199999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.71799999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.51300000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84099999999999997,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.75700000000000001,"15min":0.75800000000000001},"min":{"1min":0.58299999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.91700000000000004,"5min":1.097,"15min":1.097},"last":0.63}]},{"osd":3,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71699999999999997,"15min":0.71099999999999997},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.56999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.98299999999999998,"5min":1.024,"15min":1.024},"last":0.59099999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65400000000000003,"15min":0.65200000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64000000000000001,"15min":0.63200000000000001},"min":{"1min":0.497,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.68500000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.621,"15min":0.622},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.875,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.878,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.879}]},{"osd":6,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68600000000000005,"15min":0.68999999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90800000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72699999999999998,"15min":0.73299999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88300000000000001,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.78100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":273946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.68799999999999994,"15min":0.69599999999999995},"min":{"1min":0.40300000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92700000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.44500000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.91100000000000003,"5min":1.254,"15min":1.254},"last":0.872}]},{"osd":1,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.68300000000000005,"15min":0.69399999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.72199999999999998,"15min":0.73599999999999999},"min":{"1min":0.45400000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.85599999999999998,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.54400000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.74299999999999999,"15min":0.75600000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.98399999999999999,"5min":1.002,"15min":1.002},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.752,"15min":0.76000000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.90700000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.82299999999999995}]},{"osd":3,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.749,"15min":0.75800000000000001},"min":{"1min":0.53700000000000003,"5min":0.503,"15min":0.503},"max":{"1min":0.84699999999999998,"5min":1.008,"15min":1.008},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.76500000000000001,"15min":0.77500000000000002},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.92300000000000004,"5min":1.042,"15min":1.042},"last":0.51100000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.65500000000000003,"15min":0.66800000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.86899999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.71099999999999997,"15min":0.71699999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92800000000000005,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.96199999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68999999999999995,"15min":0.69399999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.97899999999999998,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.92800000000000005,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.81000000000000005,"15min":0.82099999999999995},"min":{"1min":0.57999999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.94899999999999995,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.80900000000000005,"15min":0.82599999999999996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94899999999999995,"5min":1.151,"15min":1.151},"last":0.88800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33756,"kb_used_data":6736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338084,"statfs":{"total":96636764160,"available":96602198016,"internally_reserved":0,"allocated":6897664,"data_stored":6565402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.83299999999999996,"5min":1.929,"15min":1.929},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.75700000000000001,"15min":0.77700000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76500000000000001,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.48499999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.88300000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.71199999999999997,"15min":0.71999999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.85099999999999998,"5min":1.139,"15min":1.139},"last":0.74299999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.73199999999999998,"15min":0.751},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.87,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.71499999999999997,"15min":0.73099999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76500000000000001,"5min":1.052,"15min":1.052},"last":0.52100000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.75600000000000001,"15min":0.77100000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.83599999999999997,"5min":1.385,"15min":1.385},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.75900000000000001,"15min":0.77300000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.85599999999999998,"5min":1.264,"15min":1.264},"last":0.46600000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61799999999999999,"15min":0.623},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.80600000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.624},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.66200000000000003,"15min":0.67100000000000004},"min":{"1min":0.44400000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.82399999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.63600000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85399999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89200000000000002,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.58899999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88900000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.52700000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.91400000000000003,"5min":1.181,"15min":1.181},"last":0.61199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27612,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":606208,"data_stored":273946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.82499999999999996,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.69399999999999995,"15min":0.70199999999999996},"min":{"1min":0.45700000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.876,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.626}]},{"osd":1,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69399999999999995,"15min":0.68999999999999995},"min":{"1min":0.55000000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90200000000000002,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.67100000000000004,"15min":0.67300000000000004},"min":{"1min":0.46800000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85099999999999998,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.82199999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66400000000000003,"15min":0.66000000000000003},"min":{"1min":0.53200000000000003,"5min":0.498,"15min":0.498},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69799999999999995,"15min":0.69599999999999995},"min":{"1min":0.54300000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.84599999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.80200000000000005,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.52000000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65100000000000002,"15min":0.65000000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.90600000000000003,"5min":1.048,"15min":1.048},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70399999999999996,"15min":0.70499999999999996},"min":{"1min":0.40400000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89500000000000002,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.90800000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.97899999999999998,"5min":1.02,"15min":1.02},"last":0.755},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.68200000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85699999999999998,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.88900000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.95799999999999996,"5min":1.161,"15min":1.161},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74299999999999999,"15min":0.748},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.032,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.86399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31708,"kb_used_data":4688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":4800512,"data_stored":4468250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.40100000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.58599999999999997,"15min":0.61299999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.59599999999999997,"5min":4.2460000000000004,"15min":4.2460000000000004},"last":0.38300000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.63800000000000001,"15min":0.67400000000000004},"min":{"1min":0.29999999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.66200000000000003,"5min":5.008,"15min":5.008},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70999999999999996,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.52400000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.69499999999999995,"15min":0.72799999999999998},"min":{"1min":0.38100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.71999999999999997,"5min":4.8570000000000002,"15min":4.8570000000000002},"last":0.433},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.70199999999999996,"15min":0.72999999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.872,"5min":4.8399999999999999,"15min":4.8399999999999999},"last":0.499}]},{"osd":4,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.871,"15min":0.89700000000000002},"min":{"1min":0.52000000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.0429999999999999,"5min":4.4450000000000003,"15min":4.4450000000000003},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.91400000000000003,"15min":0.94399999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.92800000000000005,"5min":4.9000000000000004,"15min":4.9000000000000004},"last":0.89400000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72799999999999998,"15min":0.72299999999999998},"min":{"1min":0.57799999999999996,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.89300000000000002,"15min":0.91400000000000003},"min":{"1min":0.59099999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.083,"5min":4.359,"15min":4.359},"last":0.73299999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.92200000000000004,"15min":0.95199999999999996},"min":{"1min":0.625,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1879999999999999,"5min":4.9710000000000001,"15min":4.9710000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.73499999999999999,"15min":0.72699999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.81999999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.91700000000000004,"15min":0.94299999999999995},"min":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.96299999999999997,"5min":4.4029999999999996,"15min":4.4029999999999996},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.98899999999999999,"15min":1.0189999999999999},"min":{"1min":0.69599999999999995,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2270000000000001,"5min":4.9349999999999996,"15min":4.9349999999999996},"last":0.872}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":606208,"data_stored":273946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.84199999999999997,"15min":0.90900000000000003},"min":{"1min":0.29399999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72799999999999998,"5min":5.5010000000000003,"15min":5.5010000000000003},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.68200000000000005,"15min":0.72299999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63300000000000001,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.54900000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.89100000000000001,"15min":0.95899999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.60899999999999999,"5min":5.3799999999999999,"15min":5.3799999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.77300000000000002,"15min":0.81100000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76800000000000002,"5min":4.2329999999999997,"15min":4.2329999999999997},"last":0.57799999999999996}]},{"osd":3,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.91500000000000004,"15min":0.99099999999999999},"min":{"1min":0.33100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.66700000000000004,"5min":5.032,"15min":5.032},"last":0.496},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.93700000000000006,"15min":1.0109999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.628,"5min":5.4189999999999996,"15min":5.4189999999999996},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":1.1519999999999999,"15min":1.2230000000000001},"min":{"1min":0.59699999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.97199999999999998,"5min":5.4480000000000004,"15min":5.4480000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":1.0069999999999999,"15min":1.0529999999999999},"min":{"1min":0.55800000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.85899999999999999,"5min":4.7460000000000004,"15min":4.7460000000000004},"last":0.83099999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.97899999999999998,"15min":1.02},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.998,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":1.1859999999999999,"15min":1.262},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.89300000000000002,"5min":5.4749999999999996,"15min":5.4749999999999996},"last":0.71299999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":1.0429999999999999,"15min":1.091},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94499999999999995,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":1.1639999999999999,"15min":1.232},"min":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.046,"5min":4.9859999999999998,"15min":4.9859999999999998},"last":0.81999999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":1.0449999999999999,"15min":1.095},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.98699999999999999,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":1.1819999999999999,"15min":1.2470000000000001},"min":{"1min":0.63900000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0029999999999999,"5min":4.8879999999999999,"15min":4.8879999999999999},"last":0.77800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":606208,"data_stored":273946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45500000000000002,"15min":0.45700000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.49099999999999999,"15min":0.49399999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71499999999999997,"5min":1.196,"15min":1.196},"last":0.42299999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77500000000000002,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.442},{"interface":"front","average":{"1min":0.502,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89800000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.55800000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.51500000000000001,"15min":0.52300000000000002},"min":{"1min":0.36599999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.57999999999999996,"5min":1.105,"15min":1.105},"last":0.54300000000000004}]},{"osd":4,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76900000000000002,"15min":0.77800000000000002},"min":{"1min":0.59399999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0740000000000001,"5min":1.175,"15min":1.175},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80600000000000005,"15min":0.81699999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.105,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.80400000000000005,"15min":0.81599999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.115,"5min":1.367,"15min":1.367},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.81399999999999995,"15min":0.82399999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.137,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.69099999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1799999999999999,"5min":1.417,"15min":1.417},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.80900000000000005,"15min":0.82699999999999996},"min":{"1min":0.54800000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.98399999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.78200000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.81100000000000005,"15min":0.81799999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.212,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.997,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.85199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28212,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343628,"statfs":{"total":96636764160,"available":96607875072,"internally_reserved":0,"allocated":1216512,"data_stored":870307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.434,"15min":0.436},"min":{"1min":0.26900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.60799999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.28799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.501}]},{"osd":2,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.50900000000000001,"15min":0.51100000000000001},"min":{"1min":0.35399999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.72399999999999998,"5min":0.88,"15min":0.88},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.77600000000000002,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.434}]},{"osd":3,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71499999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.41999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80200000000000005,"5min":1.089,"15min":1.089},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.79100000000000004,"15min":0.80000000000000004},"min":{"1min":0.51000000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96399999999999997,"5min":3.0350000000000001,"15min":3.0350000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.79000000000000004,"15min":0.80200000000000005},"min":{"1min":0.53700000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0109999999999999,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.65800000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.78900000000000003,"15min":0.80000000000000004},"min":{"1min":0.53800000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0009999999999999,"5min":1.911,"15min":1.911},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80400000000000005,"15min":0.81399999999999995},"min":{"1min":0.54400000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.103,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":0.64500000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.75900000000000001,"15min":0.76100000000000001},"min":{"1min":0.56200000000000006,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.95999999999999996,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.79600000000000004,"15min":0.80400000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.038,"5min":1.742,"15min":1.742},"last":0.56599999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.872,"15min":0.88400000000000001},"min":{"1min":0.56100000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.081,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.86799999999999999,"15min":0.88800000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0609999999999999,"5min":2.75,"15min":2.75},"last":0.73199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:54:07.669 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T17:54:07.669 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:54:07.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.797+0000 7f3b4e200640 1 Processor -- start 2024-09-13T17:54:07.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.797+0000 7f3b4e200640 1 -- start start 2024-09-13T17:54:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.797+0000 7f3b4e200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3b4813c240 0x7f3b4813f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.797+0000 7f3b4e200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b4813c980 0x7f3b4806d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.797+0000 7f3b4e200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b480cd220 con 0x7f3b4806da90 2024-09-13T17:54:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.797+0000 7f3b4e200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b4813f960 con 0x7f3b4813c240 2024-09-13T17:54:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.797+0000 7f3b4e200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4806ded0 con 0x7f3b4813c980 2024-09-13T17:54:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.797+0000 7f3b47e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3b4806da90 0x7f3b480cd650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49742/0 (socket says 172.21.15.114:49742) 2024-09-13T17:54:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.797+0000 7f3b47e00640 1 -- 172.21.15.114:0/3013857327 learned_addr learned my addr 172.21.15.114:0/3013857327 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:54:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.797+0000 7f3b47400640 1 --2- 172.21.15.114:0/3013857327 >> v2:172.21.15.134:3300/0 conn(0x7f3b4813c240 0x7f3b4813f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:07.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.797+0000 7f3b46a00640 1 --2- 172.21.15.114:0/3013857327 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b4813c980 0x7f3b4806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:07.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.797+0000 7f3b47400640 1 -- 172.21.15.114:0/3013857327 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b4813c980 msgr2=0x7f3b4806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:07.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.797+0000 7f3b47400640 1 --2- 172.21.15.114:0/3013857327 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b4813c980 0x7f3b4806d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.797+0000 7f3b47400640 1 -- 172.21.15.114:0/3013857327 >> v1:172.21.15.114:6789/0 conn(0x7f3b4806da90 legacy=0x7f3b480cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:07.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.797+0000 7f3b46000640 1 -- 172.21.15.114:0/3013857327 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1746030417 0 0) 0x7f3b480cd220 con 0x7f3b4806da90 2024-09-13T17:54:07.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.797+0000 7f3b47400640 1 -- 172.21.15.114:0/3013857327 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4815a740 con 0x7f3b4813c240 2024-09-13T17:54:07.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.801+0000 7f3b47400640 1 --2- 172.21.15.114:0/3013857327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b4813c240 0x7f3b4813f420 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3b380097c0 tx=0x7f3b3801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e50a739a8e47c85 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:07.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.801+0000 7f3b46000640 1 -- 172.21.15.114:0/3013857327 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b380ab670 con 0x7f3b4813c240 2024-09-13T17:54:07.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.801+0000 7f3b46000640 1 -- 172.21.15.114:0/3013857327 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b380ab7d0 con 0x7f3b4813c240 2024-09-13T17:54:07.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.801+0000 7f3b46000640 1 -- 172.21.15.114:0/3013857327 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b380abb60 con 0x7f3b4813c240 2024-09-13T17:54:07.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.801+0000 7f3b4e200640 1 -- 172.21.15.114:0/3013857327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b4813c240 msgr2=0x7f3b4813f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:07.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.801+0000 7f3b4e200640 1 --2- 172.21.15.114:0/3013857327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b4813c240 0x7f3b4813f420 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3b380097c0 tx=0x7f3b3801c470 comp rx=0 tx=0).stop 2024-09-13T17:54:07.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.801+0000 7f3b4e200640 1 -- 172.21.15.114:0/3013857327 shutdown_connections 2024-09-13T17:54:07.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.801+0000 7f3b4e200640 1 --2- 172.21.15.114:0/3013857327 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b4813c980 0x7f3b4806d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.801+0000 7f3b4e200640 1 --2- 172.21.15.114:0/3013857327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b4813c240 0x7f3b4813f420 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.801+0000 7f3b4e200640 1 -- 172.21.15.114:0/3013857327 >> 172.21.15.114:0/3013857327 conn(0x7f3b480660b0 msgr2=0x7f3b48069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:07.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.801+0000 7f3b4e200640 1 -- 172.21.15.114:0/3013857327 shutdown_connections 2024-09-13T17:54:07.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.801+0000 7f3b4e200640 1 -- 172.21.15.114:0/3013857327 wait complete. 2024-09-13T17:54:07.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.805+0000 7f3b4e200640 1 Processor -- start 2024-09-13T17:54:07.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.805+0000 7f3b4e200640 1 -- start start 2024-09-13T17:54:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.805+0000 7f3b4e200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b4806da90 0x7f3b4813dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.805+0000 7f3b4e200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b4813c240 0x7f3b481f62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.805+0000 7f3b4e200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b4813c980 0x7f3b481f6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.805+0000 7f3b4e200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4813d360 con 0x7f3b4806da90 2024-09-13T17:54:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.805+0000 7f3b4e200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4814e8d0 con 0x7f3b4813c240 2024-09-13T17:54:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.805+0000 7f3b4e200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4814ebb0 con 0x7f3b4813c980 2024-09-13T17:54:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.805+0000 7f3b47400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b4806da90 0x7f3b4813dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.805+0000 7f3b47400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b4806da90 0x7f3b4813dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47174/0 (socket says 172.21.15.114:47174) 2024-09-13T17:54:07.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.805+0000 7f3b47400640 1 -- 172.21.15.114:0/609062416 learned_addr learned my addr 172.21.15.114:0/609062416 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:07.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.805+0000 7f3b46a00640 1 --2- 172.21.15.114:0/609062416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b4813c240 0x7f3b481f62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:07.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.805+0000 7f3b47e00640 1 --2- 172.21.15.114:0/609062416 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b4813c980 0x7f3b481f6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:07.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.805+0000 7f3b47400640 1 -- 172.21.15.114:0/609062416 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b4813c980 msgr2=0x7f3b481f6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:07.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.805+0000 7f3b47400640 1 --2- 172.21.15.114:0/609062416 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b4813c980 0x7f3b481f6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.805+0000 7f3b47400640 1 -- 172.21.15.114:0/609062416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b4813c240 msgr2=0x7f3b481f62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:07.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.805+0000 7f3b47400640 1 --2- 172.21.15.114:0/609062416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b4813c240 0x7f3b481f62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.805+0000 7f3b47400640 1 -- 172.21.15.114:0/609062416 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b38009420 con 0x7f3b4806da90 2024-09-13T17:54:07.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.805+0000 7f3b47e00640 1 --2- 172.21.15.114:0/609062416 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b4813c980 0x7f3b481f6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:54:07.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.805+0000 7f3b47400640 1 --2- 172.21.15.114:0/609062416 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b4806da90 0x7f3b4813dbf0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f3b380ad040 tx=0x7f3b3801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:07.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.805+0000 7f3b3f400640 1 -- 172.21.15.114:0/609062416 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b380bf610 con 0x7f3b4806da90 2024-09-13T17:54:07.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.805+0000 7f3b3f400640 1 -- 172.21.15.114:0/609062416 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b380bf7b0 con 0x7f3b4806da90 2024-09-13T17:54:07.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.805+0000 7f3b3f400640 1 -- 172.21.15.114:0/609062416 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b380bfb60 con 0x7f3b4806da90 2024-09-13T17:54:07.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.805+0000 7f3b4e200640 1 -- 172.21.15.114:0/609062416 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b4814ee90 con 0x7f3b4806da90 2024-09-13T17:54:07.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.805+0000 7f3b4e200640 1 -- 172.21.15.114:0/609062416 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b4814f450 con 0x7f3b4806da90 2024-09-13T17:54:07.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.809+0000 7f3b4e200640 1 -- 172.21.15.114:0/609062416 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b480667b0 con 0x7f3b4806da90 2024-09-13T17:54:07.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.809+0000 7f3b3f400640 1 -- 172.21.15.114:0/609062416 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3b380b5400 con 0x7f3b4806da90 2024-09-13T17:54:07.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.809+0000 7f3b3f400640 1 --2- 172.21.15.114:0/609062416 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3b28066710 0x7f3b28068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:07.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.809+0000 7f3b3f400640 1 -- 172.21.15.114:0/609062416 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f3b3811ef50 con 0x7f3b4806da90 2024-09-13T17:54:07.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.809+0000 7f3b46a00640 1 --2- 172.21.15.114:0/609062416 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3b28066710 0x7f3b28068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:07.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.809+0000 7f3b46a00640 1 --2- 172.21.15.114:0/609062416 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3b28066710 0x7f3b28068bd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3b4813b6b0 tx=0x7f3b34008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:07.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.813+0000 7f3b3f400640 1 -- 172.21.15.114:0/609062416 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3b380ec490 con 0x7f3b4806da90 2024-09-13T17:54:07.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.965+0000 7f3b4e200640 1 -- 172.21.15.114:0/609062416 --> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3b4813c620 con 0x7f3b28066710 2024-09-13T17:54:07.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.965+0000 7f3b3f400640 1 -- 172.21.15.114:0/609062416 <== mgr.4102 v2:172.21.15.114:6832/137691478 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50701 (secure 0 0 0) 0x7f3b34011950 con 0x7f3b28066710 2024-09-13T17:54:07.974 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:54:07.975 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-13T17:54:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.969+0000 7f3b4e200640 1 -- 172.21.15.114:0/609062416 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3b28066710 msgr2=0x7f3b28068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.969+0000 7f3b4e200640 1 --2- 172.21.15.114:0/609062416 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3b28066710 0x7f3b28068bd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3b4813b6b0 tx=0x7f3b34008040 comp rx=0 tx=0).stop 2024-09-13T17:54:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.969+0000 7f3b4e200640 1 -- 172.21.15.114:0/609062416 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b4806da90 msgr2=0x7f3b4813dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.969+0000 7f3b4e200640 1 --2- 172.21.15.114:0/609062416 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b4806da90 0x7f3b4813dbf0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f3b380ad040 tx=0x7f3b3801acb0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.969+0000 7f3b4e200640 1 -- 172.21.15.114:0/609062416 shutdown_connections 2024-09-13T17:54:07.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.969+0000 7f3b4e200640 1 --2- 172.21.15.114:0/609062416 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3b28066710 0x7f3b28068bd0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.969+0000 7f3b4e200640 1 --2- 172.21.15.114:0/609062416 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3b4813c980 0x7f3b481f6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.969+0000 7f3b4e200640 1 --2- 172.21.15.114:0/609062416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b4813c240 0x7f3b481f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.969+0000 7f3b4e200640 1 --2- 172.21.15.114:0/609062416 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b4806da90 0x7f3b4813dbf0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:07.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.969+0000 7f3b4e200640 1 -- 172.21.15.114:0/609062416 >> 172.21.15.114:0/609062416 conn(0x7f3b480660b0 msgr2=0x7f3b48156b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:07.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.969+0000 7f3b4e200640 1 -- 172.21.15.114:0/609062416 shutdown_connections 2024-09-13T17:54:07.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:07.969+0000 7f3b4e200640 1 -- 172.21.15.114:0/609062416 wait complete. 2024-09-13T17:54:07.995 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2024-09-13T17:54:07.962028+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":234368,"kb_used_data":18200,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754740352,"statfs":{"total":773094113280,"available":772854120448,"internally_reserved":0,"allocated":18636800,"data_stored":15961209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6322157,"num_objects":-15,"num_object_clones":0,"num_object_copies":-30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-15,"num_whiteouts":0,"num_read":-53,"num_read_kb":-39,"num_write":-50,"num_write_kb":-6193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001307"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":193,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-13T17:54:01.754835+0000","last_change":"2024-09-13T17:51:40.205691+0000","last_active":"2024-09-13T17:54:01.754835+0000","last_peered":"2024-09-13T17:54:01.754835+0000","last_clean":"2024-09-13T17:54:01.754835+0000","last_became_active":"2024-09-13T17:51:40.204577+0000","last_became_peered":"2024-09-13T17:51:40.204577+0000","last_unstale":"2024-09-13T17:54:01.754835+0000","last_undegraded":"2024-09-13T17:54:01.754835+0000","last_fullsized":"2024-09-13T17:54:01.754835+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_clean_scrub_stamp":"2024-09-13T17:51:38.340495+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:37.899275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30240,"kb_used_data":3220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341600,"statfs":{"total":96636764160,"available":96605798400,"internally_reserved":0,"allocated":3297280,"data_stored":2961466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72099999999999997,"15min":0.72699999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0209999999999999,"5min":1.073,"15min":1.073},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69699999999999995,"15min":0.69799999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.871,"5min":1.012,"15min":1.012},"last":0.75700000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.54200000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92700000000000005,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68000000000000005,"15min":0.67900000000000005},"min":{"1min":0.49199999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.71799999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.51300000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84099999999999997,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.75700000000000001,"15min":0.75800000000000001},"min":{"1min":0.58299999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.91700000000000004,"5min":1.097,"15min":1.097},"last":0.63}]},{"osd":3,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71699999999999997,"15min":0.71099999999999997},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.56999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.98299999999999998,"5min":1.024,"15min":1.024},"last":0.59099999999999997}]},{"osd":4,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65400000000000003,"15min":0.65200000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64000000000000001,"15min":0.63200000000000001},"min":{"1min":0.497,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.68500000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.621,"15min":0.622},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.875,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.878,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.879}]},{"osd":6,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68600000000000005,"15min":0.68999999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90800000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72699999999999998,"15min":0.73299999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88300000000000001,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.78100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":273946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.68799999999999994,"15min":0.69599999999999995},"min":{"1min":0.40300000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92700000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.44500000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.91100000000000003,"5min":1.254,"15min":1.254},"last":0.872}]},{"osd":1,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.68300000000000005,"15min":0.69399999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.72199999999999998,"15min":0.73599999999999999},"min":{"1min":0.45400000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.85599999999999998,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.54400000000000004}]},{"osd":2,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.74299999999999999,"15min":0.75600000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.98399999999999999,"5min":1.002,"15min":1.002},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.752,"15min":0.76000000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.90700000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.82299999999999995}]},{"osd":3,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.749,"15min":0.75800000000000001},"min":{"1min":0.53700000000000003,"5min":0.503,"15min":0.503},"max":{"1min":0.84699999999999998,"5min":1.008,"15min":1.008},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.76500000000000001,"15min":0.77500000000000002},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.92300000000000004,"5min":1.042,"15min":1.042},"last":0.51100000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.65500000000000003,"15min":0.66800000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.86899999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.71099999999999997,"15min":0.71699999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92800000000000005,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.96199999999999997}]},{"osd":5,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68999999999999995,"15min":0.69399999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.97899999999999998,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.92800000000000005,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.81000000000000005,"15min":0.82099999999999995},"min":{"1min":0.57999999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.94899999999999995,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.80900000000000005,"15min":0.82599999999999996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94899999999999995,"5min":1.151,"15min":1.151},"last":0.88800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33756,"kb_used_data":6736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338084,"statfs":{"total":96636764160,"available":96602198016,"internally_reserved":0,"allocated":6897664,"data_stored":6565402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.83299999999999996,"5min":1.929,"15min":1.929},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.75700000000000001,"15min":0.77700000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76500000000000001,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.48499999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.88300000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.71199999999999997,"15min":0.71999999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.85099999999999998,"5min":1.139,"15min":1.139},"last":0.74299999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.73199999999999998,"15min":0.751},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.87,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.71499999999999997,"15min":0.73099999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76500000000000001,"5min":1.052,"15min":1.052},"last":0.52100000000000002}]},{"osd":3,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.75600000000000001,"15min":0.77100000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.83599999999999997,"5min":1.385,"15min":1.385},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.75900000000000001,"15min":0.77300000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.85599999999999998,"5min":1.264,"15min":1.264},"last":0.46600000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61799999999999999,"15min":0.623},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.80600000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.624},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.66200000000000003,"15min":0.67100000000000004},"min":{"1min":0.44400000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.82399999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.63600000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85399999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89200000000000002,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.58899999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88900000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.52700000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.91400000000000003,"5min":1.181,"15min":1.181},"last":0.61199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27612,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":606208,"data_stored":273946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.82499999999999996,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.69399999999999995,"15min":0.70199999999999996},"min":{"1min":0.45700000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.876,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.626}]},{"osd":1,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69399999999999995,"15min":0.68999999999999995},"min":{"1min":0.55000000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90200000000000002,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.67100000000000004,"15min":0.67300000000000004},"min":{"1min":0.46800000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85099999999999998,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.82199999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66400000000000003,"15min":0.66000000000000003},"min":{"1min":0.53200000000000003,"5min":0.498,"15min":0.498},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69799999999999995,"15min":0.69599999999999995},"min":{"1min":0.54300000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.84599999999999997}]},{"osd":3,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.80200000000000005,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.52000000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65100000000000002,"15min":0.65000000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.90600000000000003,"5min":1.048,"15min":1.048},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70399999999999996,"15min":0.70499999999999996},"min":{"1min":0.40400000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89500000000000002,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.90800000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.97899999999999998,"5min":1.02,"15min":1.02},"last":0.755},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.68200000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85699999999999998,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.88900000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.95799999999999996,"5min":1.161,"15min":1.161},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74299999999999999,"15min":0.748},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.032,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.86399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31708,"kb_used_data":4688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":4800512,"data_stored":4468250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.40100000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.58599999999999997,"15min":0.61299999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.59599999999999997,"5min":4.2460000000000004,"15min":4.2460000000000004},"last":0.38300000000000001}]},{"osd":1,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.63800000000000001,"15min":0.67400000000000004},"min":{"1min":0.29999999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.66200000000000003,"5min":5.008,"15min":5.008},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70999999999999996,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.52400000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.69499999999999995,"15min":0.72799999999999998},"min":{"1min":0.38100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.71999999999999997,"5min":4.8570000000000002,"15min":4.8570000000000002},"last":0.433},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.70199999999999996,"15min":0.72999999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.872,"5min":4.8399999999999999,"15min":4.8399999999999999},"last":0.499}]},{"osd":4,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.871,"15min":0.89700000000000002},"min":{"1min":0.52000000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.0429999999999999,"5min":4.4450000000000003,"15min":4.4450000000000003},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.91400000000000003,"15min":0.94399999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.92800000000000005,"5min":4.9000000000000004,"15min":4.9000000000000004},"last":0.89400000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72799999999999998,"15min":0.72299999999999998},"min":{"1min":0.57799999999999996,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.89300000000000002,"15min":0.91400000000000003},"min":{"1min":0.59099999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.083,"5min":4.359,"15min":4.359},"last":0.73299999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.92200000000000004,"15min":0.95199999999999996},"min":{"1min":0.625,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1879999999999999,"5min":4.9710000000000001,"15min":4.9710000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.73499999999999999,"15min":0.72699999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.81999999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.91700000000000004,"15min":0.94299999999999995},"min":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.96299999999999997,"5min":4.4029999999999996,"15min":4.4029999999999996},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.98899999999999999,"15min":1.0189999999999999},"min":{"1min":0.69599999999999995,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2270000000000001,"5min":4.9349999999999996,"15min":4.9349999999999996},"last":0.872}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":606208,"data_stored":273946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.84199999999999997,"15min":0.90900000000000003},"min":{"1min":0.29399999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72799999999999998,"5min":5.5010000000000003,"15min":5.5010000000000003},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.68200000000000005,"15min":0.72299999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63300000000000001,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.54900000000000004}]},{"osd":1,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.89100000000000001,"15min":0.95899999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.60899999999999999,"5min":5.3799999999999999,"15min":5.3799999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.77300000000000002,"15min":0.81100000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76800000000000002,"5min":4.2329999999999997,"15min":4.2329999999999997},"last":0.57799999999999996}]},{"osd":3,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.91500000000000004,"15min":0.99099999999999999},"min":{"1min":0.33100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.66700000000000004,"5min":5.032,"15min":5.032},"last":0.496},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.93700000000000006,"15min":1.0109999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.628,"5min":5.4189999999999996,"15min":5.4189999999999996},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":1.1519999999999999,"15min":1.2230000000000001},"min":{"1min":0.59699999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.97199999999999998,"5min":5.4480000000000004,"15min":5.4480000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":1.0069999999999999,"15min":1.0529999999999999},"min":{"1min":0.55800000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.85899999999999999,"5min":4.7460000000000004,"15min":4.7460000000000004},"last":0.83099999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.97899999999999998,"15min":1.02},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.998,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":1.1859999999999999,"15min":1.262},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.89300000000000002,"5min":5.4749999999999996,"15min":5.4749999999999996},"last":0.71299999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":1.0429999999999999,"15min":1.091},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94499999999999995,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":1.1639999999999999,"15min":1.232},"min":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.046,"5min":4.9859999999999998,"15min":4.9859999999999998},"last":0.81999999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":1.0449999999999999,"15min":1.095},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.98699999999999999,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":1.1819999999999999,"15min":1.2470000000000001},"min":{"1min":0.63900000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0029999999999999,"5min":4.8879999999999999,"15min":4.8879999999999999},"last":0.77800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":606208,"data_stored":273946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45500000000000002,"15min":0.45700000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.49099999999999999,"15min":0.49399999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71499999999999997,"5min":1.196,"15min":1.196},"last":0.42299999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77500000000000002,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.442},{"interface":"front","average":{"1min":0.502,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89800000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.55800000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.51500000000000001,"15min":0.52300000000000002},"min":{"1min":0.36599999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.57999999999999996,"5min":1.105,"15min":1.105},"last":0.54300000000000004}]},{"osd":4,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76900000000000002,"15min":0.77800000000000002},"min":{"1min":0.59399999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0740000000000001,"5min":1.175,"15min":1.175},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80600000000000005,"15min":0.81699999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.105,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.80400000000000005,"15min":0.81599999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.115,"5min":1.367,"15min":1.367},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.81399999999999995,"15min":0.82399999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.137,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.69099999999999995}]},{"osd":6,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1799999999999999,"5min":1.417,"15min":1.417},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.80900000000000005,"15min":0.82699999999999996},"min":{"1min":0.54800000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.98399999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.78200000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.81100000000000005,"15min":0.81799999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.212,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.997,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.85199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28212,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343628,"statfs":{"total":96636764160,"available":96607875072,"internally_reserved":0,"allocated":1216512,"data_stored":870307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.434,"15min":0.436},"min":{"1min":0.26900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.60799999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.28799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.501}]},{"osd":2,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.50900000000000001,"15min":0.51100000000000001},"min":{"1min":0.35399999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.72399999999999998,"5min":0.88,"15min":0.88},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.77600000000000002,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.434}]},{"osd":3,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71499999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.41999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80200000000000005,"5min":1.089,"15min":1.089},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.79100000000000004,"15min":0.80000000000000004},"min":{"1min":0.51000000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96399999999999997,"5min":3.0350000000000001,"15min":3.0350000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.79000000000000004,"15min":0.80200000000000005},"min":{"1min":0.53700000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0109999999999999,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.65800000000000003}]},{"osd":5,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.78900000000000003,"15min":0.80000000000000004},"min":{"1min":0.53800000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0009999999999999,"5min":1.911,"15min":1.911},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80400000000000005,"15min":0.81399999999999995},"min":{"1min":0.54400000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.103,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":0.64500000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.75900000000000001,"15min":0.76100000000000001},"min":{"1min":0.56200000000000006,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.95999999999999996,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.79600000000000004,"15min":0.80400000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.038,"5min":1.742,"15min":1.742},"last":0.56599999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.872,"15min":0.88400000000000001},"min":{"1min":0.56100000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.081,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.86799999999999999,"15min":0.88800000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0609999999999999,"5min":2.75,"15min":2.75},"last":0.73199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:54:07.997 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T17:54:08.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.129+0000 7f121a000640 1 Processor -- start 2024-09-13T17:54:08.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.129+0000 7f121a000640 1 -- start start 2024-09-13T17:54:08.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.129+0000 7f121a000640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f12140b5090 0x7f1214167630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:08.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.129+0000 7f121a000640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1214145df0 con 0x7f1214145a10 2024-09-13T17:54:08.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.129+0000 7f121a000640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12141462f0 con 0x7f12141602a0 2024-09-13T17:54:08.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.129+0000 7f121a000640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12141612b0 con 0x7f12140b5090 2024-09-13T17:54:08.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.129+0000 7f1213400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1214145a10 0x7f12140cf610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49748/0 (socket says 172.21.15.114:49748) 2024-09-13T17:54:08.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.129+0000 7f1213400640 1 -- 172.21.15.114:0/4192107141 learned_addr learned my addr 172.21.15.114:0/4192107141 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:54:08.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.129+0000 7f1213e00640 1 --2- 172.21.15.114:0/4192107141 >> v2:172.21.15.134:3300/0 conn(0x7f12140b5090 0x7f1214167630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:08.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.129+0000 7f1212000640 1 -- 172.21.15.114:0/4192107141 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038159582 0 0) 0x7f1214145df0 con 0x7f1214145a10 2024-09-13T17:54:08.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.129+0000 7f1212000640 1 -- 172.21.15.114:0/4192107141 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11f8003530 con 0x7f1214145a10 2024-09-13T17:54:08.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.129+0000 7f1213e00640 1 -- 172.21.15.114:0/4192107141 >> v1:172.21.15.134:6789/0 conn(0x7f12141602a0 legacy=0x7f12140b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:08.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.129+0000 7f1213e00640 1 -- 172.21.15.114:0/4192107141 >> v1:172.21.15.114:6789/0 conn(0x7f1214145a10 legacy=0x7f12140cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:08.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.129+0000 7f1213e00640 1 -- 172.21.15.114:0/4192107141 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1214160730 con 0x7f12140b5090 2024-09-13T17:54:08.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.133+0000 7f1213e00640 1 --2- 172.21.15.114:0/4192107141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12140b5090 0x7f1214167630 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f120c0097c0 tx=0x7f120c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56e4d61cb7b81b1d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:08.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.133+0000 7f1212000640 1 -- 172.21.15.114:0/4192107141 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c0a8050 con 0x7f12140b5090 2024-09-13T17:54:08.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.133+0000 7f1212000640 1 -- 172.21.15.114:0/4192107141 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120c0ac5f0 con 0x7f12140b5090 2024-09-13T17:54:08.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.133+0000 7f1212000640 1 -- 172.21.15.114:0/4192107141 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c0ac980 con 0x7f12140b5090 2024-09-13T17:54:08.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.133+0000 7f121a000640 1 -- 172.21.15.114:0/4192107141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12140b5090 msgr2=0x7f1214167630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:08.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.133+0000 7f121a000640 1 --2- 172.21.15.114:0/4192107141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12140b5090 0x7f1214167630 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f120c0097c0 tx=0x7f120c01c4a0 comp rx=0 tx=0).stop 2024-09-13T17:54:08.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.133+0000 7f121a000640 1 -- 172.21.15.114:0/4192107141 shutdown_connections 2024-09-13T17:54:08.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.133+0000 7f121a000640 1 --2- 172.21.15.114:0/4192107141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12140b5090 0x7f1214167630 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:08.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.133+0000 7f121a000640 1 -- 172.21.15.114:0/4192107141 >> 172.21.15.114:0/4192107141 conn(0x7f1214071a20 msgr2=0x7f1214098a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:08.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.133+0000 7f121a000640 1 -- 172.21.15.114:0/4192107141 shutdown_connections 2024-09-13T17:54:08.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.133+0000 7f121a000640 1 -- 172.21.15.114:0/4192107141 wait complete. 2024-09-13T17:54:08.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.137+0000 7f121a000640 1 Processor -- start 2024-09-13T17:54:08.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.137+0000 7f121a000640 1 -- start start 2024-09-13T17:54:08.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.137+0000 7f121a000640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12140b5090 0x7f12140af5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:08.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.137+0000 7f121a000640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1214145a10 0x7f121415b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:08.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.137+0000 7f121a000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f121415c1d0 0x7f121413c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:08.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.137+0000 7f121a000640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12140ae350 con 0x7f12140b5090 2024-09-13T17:54:08.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.137+0000 7f121a000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12140af150 con 0x7f121415c1d0 2024-09-13T17:54:08.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.137+0000 7f121a000640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12140ae580 con 0x7f1214145a10 2024-09-13T17:54:08.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.137+0000 7f1213400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12140b5090 0x7f12140af5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:08.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.137+0000 7f1213400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12140b5090 0x7f12140af5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47188/0 (socket says 172.21.15.114:47188) 2024-09-13T17:54:08.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.137+0000 7f1213400640 1 -- 172.21.15.114:0/1373844171 learned_addr learned my addr 172.21.15.114:0/1373844171 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:08.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.137+0000 7f1213e00640 1 --2- 172.21.15.114:0/1373844171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f121415c1d0 0x7f121413c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:08.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.137+0000 7f1212a00640 1 --2- 172.21.15.114:0/1373844171 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1214145a10 0x7f121415b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:08.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.137+0000 7f1213400640 1 -- 172.21.15.114:0/1373844171 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1214145a10 msgr2=0x7f121415b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:08.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.137+0000 7f1213400640 1 --2- 172.21.15.114:0/1373844171 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1214145a10 0x7f121415b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:08.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.137+0000 7f1213400640 1 -- 172.21.15.114:0/1373844171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f121415c1d0 msgr2=0x7f121413c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:08.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.137+0000 7f1213400640 1 --2- 172.21.15.114:0/1373844171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f121415c1d0 0x7f121413c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:08.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.137+0000 7f1213400640 1 -- 172.21.15.114:0/1373844171 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f120c009420 con 0x7f12140b5090 2024-09-13T17:54:08.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.137+0000 7f1213400640 1 --2- 172.21.15.114:0/1373844171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12140b5090 0x7f12140af5e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f120400cbc0 tx=0x7f120400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:08.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.137+0000 7f120b400640 1 -- 172.21.15.114:0/1373844171 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120400ad40 con 0x7f12140b5090 2024-09-13T17:54:08.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.137+0000 7f120b400640 1 -- 172.21.15.114:0/1373844171 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1204012400 con 0x7f12140b5090 2024-09-13T17:54:08.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.137+0000 7f121a000640 1 -- 172.21.15.114:0/1373844171 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12140ae820 con 0x7f12140b5090 2024-09-13T17:54:08.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.137+0000 7f120b400640 1 -- 172.21.15.114:0/1373844171 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120400aea0 con 0x7f12140b5090 2024-09-13T17:54:08.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.137+0000 7f121a000640 1 -- 172.21.15.114:0/1373844171 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12140aede0 con 0x7f12140b5090 2024-09-13T17:54:08.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.137+0000 7f121a000640 1 -- 172.21.15.114:0/1373844171 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f121406aae0 con 0x7f12140b5090 2024-09-13T17:54:08.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.141+0000 7f120b400640 1 -- 172.21.15.114:0/1373844171 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1204007070 con 0x7f12140b5090 2024-09-13T17:54:08.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.141+0000 7f120b400640 1 --2- 172.21.15.114:0/1373844171 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f11f40666c0 0x7f11f4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:08.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.141+0000 7f120b400640 1 -- 172.21.15.114:0/1373844171 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f1204083f00 con 0x7f12140b5090 2024-09-13T17:54:08.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.141+0000 7f1212a00640 1 --2- 172.21.15.114:0/1373844171 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f11f40666c0 0x7f11f4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:08.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.141+0000 7f1212a00640 1 --2- 172.21.15.114:0/1373844171 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f11f40666c0 0x7f11f4068b80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f121413c050 tx=0x7f1200009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:08.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.145+0000 7f120b400640 1 -- 172.21.15.114:0/1373844171 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1204051510 con 0x7f12140b5090 2024-09-13T17:54:08.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.297+0000 7f121a000640 1 -- 172.21.15.114:0/1373844171 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f121415bed0 con 0x7f12140b5090 2024-09-13T17:54:08.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.301+0000 7f120b400640 1 -- 172.21.15.114:0/1373844171 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+13373 (secure 0 0 0) 0x7f1204017090 con 0x7f12140b5090 2024-09-13T17:54:08.306 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:54:08.307 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":52,"fsid":"d730423f-882d-4061-b746-f6a7dc2544e0","created":"2024-09-13T17:51:24.941344+0000","modified":"2024-09-13T17:54:02.512387+0000","last_up_change":"2024-09-13T17:51:37.338066+0000","last_in_change":"2024-09-13T17:51:27.591755+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:51:37.996254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f6e4c049-a8f5-471c-940e-fe0ab8337a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6809","nonce":4163905135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6811","nonce":4163905135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6815","nonce":4163905135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":4163905135},{"type":"v1","addr":"172.21.15.114:6813","nonce":4163905135}]},"public_addr":"172.21.15.114:6809/4163905135","cluster_addr":"172.21.15.114:6811/4163905135","heartbeat_back_addr":"172.21.15.114:6815/4163905135","heartbeat_front_addr":"172.21.15.114:6813/4163905135","state":["exists","up"]},{"osd":1,"uuid":"3ff3fff7-0060-40f3-bec0-4c6d44ce2703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6817","nonce":2809354915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6819","nonce":2809354915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6823","nonce":2809354915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":2809354915},{"type":"v1","addr":"172.21.15.114:6821","nonce":2809354915}]},"public_addr":"172.21.15.114:6817/2809354915","cluster_addr":"172.21.15.114:6819/2809354915","heartbeat_back_addr":"172.21.15.114:6823/2809354915","heartbeat_front_addr":"172.21.15.114:6821/2809354915","state":["exists","up"]},{"osd":2,"uuid":"9074d3c3-6f52-4075-b824-908a03d48a70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6801","nonce":1009667871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6803","nonce":1009667871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6807","nonce":1009667871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1009667871},{"type":"v1","addr":"172.21.15.114:6805","nonce":1009667871}]},"public_addr":"172.21.15.114:6801/1009667871","cluster_addr":"172.21.15.114:6803/1009667871","heartbeat_back_addr":"172.21.15.114:6807/1009667871","heartbeat_front_addr":"172.21.15.114:6805/1009667871","state":["exists","up"]},{"osd":3,"uuid":"6fd45617-bfa7-4357-9e25-7d0ad6c493cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6825","nonce":1824187331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6827","nonce":1824187331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6831","nonce":1824187331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1824187331},{"type":"v1","addr":"172.21.15.114:6829","nonce":1824187331}]},"public_addr":"172.21.15.114:6825/1824187331","cluster_addr":"172.21.15.114:6827/1824187331","heartbeat_back_addr":"172.21.15.114:6831/1824187331","heartbeat_front_addr":"172.21.15.114:6829/1824187331","state":["exists","up"]},{"osd":4,"uuid":"c9c2c366-0235-4d84-9bbc-a4c0c84fb156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6809","nonce":3210409298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6811","nonce":3210409298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6815","nonce":3210409298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3210409298},{"type":"v1","addr":"172.21.15.134:6813","nonce":3210409298}]},"public_addr":"172.21.15.134:6809/3210409298","cluster_addr":"172.21.15.134:6811/3210409298","heartbeat_back_addr":"172.21.15.134:6815/3210409298","heartbeat_front_addr":"172.21.15.134:6813/3210409298","state":["exists","up"]},{"osd":5,"uuid":"b00a9566-768b-4761-9c1d-140e3a7491d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6801","nonce":3340754489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6803","nonce":3340754489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6807","nonce":3340754489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3340754489},{"type":"v1","addr":"172.21.15.134:6805","nonce":3340754489}]},"public_addr":"172.21.15.134:6801/3340754489","cluster_addr":"172.21.15.134:6803/3340754489","heartbeat_back_addr":"172.21.15.134:6807/3340754489","heartbeat_front_addr":"172.21.15.134:6805/3340754489","state":["exists","up"]},{"osd":6,"uuid":"59df820f-8786-4389-b433-86c97e2fea8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6825","nonce":1813072387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6827","nonce":1813072387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6831","nonce":1813072387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1813072387},{"type":"v1","addr":"172.21.15.134:6829","nonce":1813072387}]},"public_addr":"172.21.15.134:6825/1813072387","cluster_addr":"172.21.15.134:6827/1813072387","heartbeat_back_addr":"172.21.15.134:6831/1813072387","heartbeat_front_addr":"172.21.15.134:6829/1813072387","state":["exists","up"]},{"osd":7,"uuid":"e436364c-8a68-4325-96c9-47adeaffc343","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6817","nonce":874939117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6819","nonce":874939117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6823","nonce":874939117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":874939117},{"type":"v1","addr":"172.21.15.134:6821","nonce":874939117}]},"public_addr":"172.21.15.134:6817/874939117","cluster_addr":"172.21.15.134:6819/874939117","heartbeat_back_addr":"172.21.15.134:6823/874939117","heartbeat_front_addr":"172.21.15.134:6821/874939117","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:32.969652+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.251056+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.355401+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.319271+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.098113+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.291791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:51:33.354357+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6835/2697286380":"2024-09-14T17:53:59.254959+0000","172.21.15.114:6837/2697286380":"2024-09-14T17:53:59.254959+0000","172.21.15.134:6835/1239035445":"2024-09-14T17:53:22.929223+0000","172.21.15.134:6833/1239035445":"2024-09-14T17:53:22.929223+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T17:54:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.301+0000 7f121a000640 1 -- 172.21.15.114:0/1373844171 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f11f40666c0 msgr2=0x7f11f4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.301+0000 7f121a000640 1 --2- 172.21.15.114:0/1373844171 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f11f40666c0 0x7f11f4068b80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f121413c050 tx=0x7f1200009040 comp rx=0 tx=0).stop 2024-09-13T17:54:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.301+0000 7f121a000640 1 -- 172.21.15.114:0/1373844171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12140b5090 msgr2=0x7f12140af5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.301+0000 7f121a000640 1 --2- 172.21.15.114:0/1373844171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12140b5090 0x7f12140af5e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f120400cbc0 tx=0x7f120400a430 comp rx=0 tx=0).stop 2024-09-13T17:54:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.301+0000 7f121a000640 1 -- 172.21.15.114:0/1373844171 shutdown_connections 2024-09-13T17:54:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.301+0000 7f121a000640 1 --2- 172.21.15.114:0/1373844171 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f11f40666c0 0x7f11f4068b80 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.301+0000 7f121a000640 1 --2- 172.21.15.114:0/1373844171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f121415c1d0 0x7f121413c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.301+0000 7f121a000640 1 --2- 172.21.15.114:0/1373844171 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f1214145a10 0x7f121415b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.301+0000 7f121a000640 1 --2- 172.21.15.114:0/1373844171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12140b5090 0x7f12140af5e0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:08.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.301+0000 7f121a000640 1 -- 172.21.15.114:0/1373844171 >> 172.21.15.114:0/1373844171 conn(0x7f1214071a20 msgr2=0x7f12140cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:08.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.301+0000 7f121a000640 1 -- 172.21.15.114:0/1373844171 shutdown_connections 2024-09-13T17:54:08.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:08.301+0000 7f121a000640 1 -- 172.21.15.114:0/1373844171 wait complete. 2024-09-13T17:54:09.329 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T17:54:09.329 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:54:09.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadbf200640 1 Processor -- start 2024-09-13T17:54:09.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadbf200640 1 -- start start 2024-09-13T17:54:09.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadbf200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fadb813f420 0x7fadb806d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:09.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadbf200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fadb806da90 0x7fadb80cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:09.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadbf200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadb80cd220 con 0x7fadb813c240 2024-09-13T17:54:09.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadbf200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadb806ded0 con 0x7fadb806da90 2024-09-13T17:54:09.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadbf200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb815a740 con 0x7fadb813f420 2024-09-13T17:54:09.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadb7e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fadb813c240 0x7fadb813c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49754/0 (socket says 172.21.15.114:49754) 2024-09-13T17:54:09.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadb7e00640 1 -- 172.21.15.114:0/2392043013 learned_addr learned my addr 172.21.15.114:0/2392043013 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:54:09.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadb7400640 1 -- 172.21.15.114:0/2392043013 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 867807789 0 0) 0x7fadb80cd220 con 0x7fadb813c240 2024-09-13T17:54:09.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadbd200640 1 --2- 172.21.15.114:0/2392043013 >> v2:172.21.15.134:3300/0 conn(0x7fadb806da90 0x7fadb80cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:09.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadb7400640 1 -- 172.21.15.114:0/2392043013 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad9c005740 con 0x7fadb813c240 2024-09-13T17:54:09.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadaf400640 1 --2- 172.21.15.114:0/2392043013 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fadb813f420 0x7fadb806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadb7400640 1 -- 172.21.15.114:0/2392043013 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 760794005 0 0) 0x7fad9c005740 con 0x7fadb813c240 2024-09-13T17:54:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadb7400640 1 -- 172.21.15.114:0/2392043013 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fadb813f420 msgr2=0x7fadb806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadb7400640 1 --2- 172.21.15.114:0/2392043013 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fadb813f420 0x7fadb806d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadb7400640 1 -- 172.21.15.114:0/2392043013 >> v2:172.21.15.134:3300/0 conn(0x7fadb806da90 msgr2=0x7fadb80cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadb7400640 1 --2- 172.21.15.114:0/2392043013 >> v2:172.21.15.134:3300/0 conn(0x7fadb806da90 0x7fadb80cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadb7400640 1 -- 172.21.15.114:0/2392043013 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb8159bc0 con 0x7fadb813c240 2024-09-13T17:54:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadb7400640 1 -- 172.21.15.114:0/2392043013 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7fada8001680 con 0x7fadb813c240 2024-09-13T17:54:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadb7400640 1 -- 172.21.15.114:0/2392043013 >> v1:172.21.15.114:6789/0 conn(0x7fadb813c240 legacy=0x7fadb813c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadb7400640 1 --2- 172.21.15.114:0/2392043013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad9c005b90 0x7fad9c005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadb7400640 1 --2- 172.21.15.114:0/2392043013 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fadb813f420 0x7fad9c0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadb7400640 1 --2- 172.21.15.114:0/2392043013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad9c006f20 0x7fad9c0073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadb7400640 1 -- 172.21.15.114:0/2392043013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb806ded0 con 0x7fad9c005b90 2024-09-13T17:54:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadb7400640 1 -- 172.21.15.114:0/2392043013 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb815a740 con 0x7fad9c006f20 2024-09-13T17:54:09.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadb7400640 1 -- 172.21.15.114:0/2392043013 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c00dba0 con 0x7fadb813f420 2024-09-13T17:54:09.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadb7e00640 1 --2- 172.21.15.114:0/2392043013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad9c005b90 0x7fad9c005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:09.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadbd200640 1 --2- 172.21.15.114:0/2392043013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad9c006f20 0x7fad9c0073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:09.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.473+0000 7fadaf400640 1 --2- 172.21.15.114:0/2392043013 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fadb813f420 0x7fad9c0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:09.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.477+0000 7fadb7e00640 1 -- 172.21.15.114:0/2392043013 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fadb813f420 msgr2=0x7fad9c0069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:09.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.477+0000 7fadb7e00640 1 --2- 172.21.15.114:0/2392043013 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fadb813f420 0x7fad9c0069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:09.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.477+0000 7fadb7e00640 1 -- 172.21.15.114:0/2392043013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad9c006f20 msgr2=0x7fad9c0073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:09.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.477+0000 7fadb7e00640 1 --2- 172.21.15.114:0/2392043013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad9c006f20 0x7fad9c0073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:09.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.477+0000 7fadb7e00640 1 -- 172.21.15.114:0/2392043013 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9c005740 con 0x7fad9c005b90 2024-09-13T17:54:09.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.477+0000 7fadb7e00640 1 --2- 172.21.15.114:0/2392043013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad9c005b90 0x7fad9c005fb0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fada800c210 tx=0x7fada801cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcab735e059be603 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:09.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.477+0000 7fadb7400640 1 -- 172.21.15.114:0/2392043013 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada80a5930 con 0x7fad9c005b90 2024-09-13T17:54:09.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.477+0000 7fadb7400640 1 -- 172.21.15.114:0/2392043013 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada80a5a90 con 0x7fad9c005b90 2024-09-13T17:54:09.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.477+0000 7fadb7400640 1 -- 172.21.15.114:0/2392043013 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada80a5e60 con 0x7fad9c005b90 2024-09-13T17:54:09.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.477+0000 7fadbf200640 1 -- 172.21.15.114:0/2392043013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad9c005b90 msgr2=0x7fad9c005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:09.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.477+0000 7fadbf200640 1 --2- 172.21.15.114:0/2392043013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad9c005b90 0x7fad9c005fb0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fada800c210 tx=0x7fada801cc50 comp rx=0 tx=0).stop 2024-09-13T17:54:09.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.477+0000 7fadbd200640 1 -- 172.21.15.114:0/2392043013 reap_dead start 2024-09-13T17:54:09.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.477+0000 7fadbf200640 1 -- 172.21.15.114:0/2392043013 shutdown_connections 2024-09-13T17:54:09.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.477+0000 7fadbf200640 1 -- 172.21.15.114:0/2392043013 >> 172.21.15.114:0/2392043013 conn(0x7fadb80660b0 msgr2=0x7fadb8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:09.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.477+0000 7fadbf200640 1 -- 172.21.15.114:0/2392043013 shutdown_connections 2024-09-13T17:54:09.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.477+0000 7fadbf200640 1 -- 172.21.15.114:0/2392043013 wait complete. 2024-09-13T17:54:09.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.481+0000 7fadbf200640 1 Processor -- start 2024-09-13T17:54:09.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.481+0000 7fadbf200640 1 -- start start 2024-09-13T17:54:09.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.481+0000 7fadbf200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad9c005b90 0x7fadb80ac460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:09.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.481+0000 7fadbf200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadb815cb20 0x7fadb81585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:09.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.481+0000 7fadbf200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fadb815ee00 0x7fadb815b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:09.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.481+0000 7fadbf200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb80abfd0 con 0x7fadb815cb20 2024-09-13T17:54:09.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.481+0000 7fadbf200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb815f800 con 0x7fad9c005b90 2024-09-13T17:54:09.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.481+0000 7fadbf200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb815fae0 con 0x7fadb815ee00 2024-09-13T17:54:09.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.481+0000 7fadaf400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadb815cb20 0x7fadb81585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:09.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.481+0000 7fadaf400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadb815cb20 0x7fadb81585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47194/0 (socket says 172.21.15.114:47194) 2024-09-13T17:54:09.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.481+0000 7fadaf400640 1 -- 172.21.15.114:0/495176468 learned_addr learned my addr 172.21.15.114:0/495176468 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:09.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.481+0000 7fadb7e00640 1 --2- 172.21.15.114:0/495176468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad9c005b90 0x7fadb80ac460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:09.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.481+0000 7fadbd200640 1 --2- 172.21.15.114:0/495176468 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fadb815ee00 0x7fadb815b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:09.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.481+0000 7fadaf400640 1 -- 172.21.15.114:0/495176468 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fadb815ee00 msgr2=0x7fadb815b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:09.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.481+0000 7fadaf400640 1 --2- 172.21.15.114:0/495176468 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fadb815ee00 0x7fadb815b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:09.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.481+0000 7fadaf400640 1 -- 172.21.15.114:0/495176468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad9c005b90 msgr2=0x7fadb80ac460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:09.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.481+0000 7fadaf400640 1 --2- 172.21.15.114:0/495176468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad9c005b90 0x7fadb80ac460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:09.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.481+0000 7fadaf400640 1 -- 172.21.15.114:0/495176468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb80ab980 con 0x7fadb815cb20 2024-09-13T17:54:09.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.481+0000 7fadaf400640 1 --2- 172.21.15.114:0/495176468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadb815cb20 0x7fadb81585a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fada0007f30 tx=0x7fada00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:09.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.481+0000 7fadb4c00640 1 -- 172.21.15.114:0/495176468 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada000e030 con 0x7fadb815cb20 2024-09-13T17:54:09.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.481+0000 7fadb4c00640 1 -- 172.21.15.114:0/495176468 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada0016470 con 0x7fadb815cb20 2024-09-13T17:54:09.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.481+0000 7fadb4c00640 1 -- 172.21.15.114:0/495176468 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada0016820 con 0x7fadb815cb20 2024-09-13T17:54:09.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.481+0000 7fadbf200640 1 -- 172.21.15.114:0/495176468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb80abc60 con 0x7fadb815cb20 2024-09-13T17:54:09.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.485+0000 7fadbf200640 1 -- 172.21.15.114:0/495176468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb815f280 con 0x7fadb815cb20 2024-09-13T17:54:09.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.485+0000 7fadbf200640 1 -- 172.21.15.114:0/495176468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fadb8070620 con 0x7fadb815cb20 2024-09-13T17:54:09.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.485+0000 7fadb4c00640 1 -- 172.21.15.114:0/495176468 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fada0016980 con 0x7fadb815cb20 2024-09-13T17:54:09.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.485+0000 7fadb4c00640 1 --2- 172.21.15.114:0/495176468 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fad94066690 0x7fad94068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:09.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.485+0000 7fadb4c00640 1 -- 172.21.15.114:0/495176468 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fada000f070 con 0x7fadb815cb20 2024-09-13T17:54:09.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.485+0000 7fadb7e00640 1 --2- 172.21.15.114:0/495176468 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fad94066690 0x7fad94068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:09.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.485+0000 7fadb4c00640 1 --2- 172.21.15.114:0/495176468 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x7fad9406ca30 0x7fad9406ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:09.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.485+0000 7fadb4c00640 1 -- 172.21.15.114:0/495176468 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fad9406f540 con 0x7fad9406ca30 2024-09-13T17:54:09.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.485+0000 7fadb4c00640 1 -- 172.21.15.114:0/495176468 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fada00892a0 con 0x7fadb815cb20 2024-09-13T17:54:09.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.485+0000 7fadbd200640 1 --2- 172.21.15.114:0/495176468 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x7fad9406ca30 0x7fad9406ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:09.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.485+0000 7fadb7e00640 1 --2- 172.21.15.114:0/495176468 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fad94066690 0x7fad94068b50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fada80aa000 tx=0x7fada80b0040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:09.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.485+0000 7fadbd200640 1 --2- 172.21.15.114:0/495176468 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x7fad9406ca30 0x7fad9406ee70 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:09.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.489+0000 7fadb4c00640 1 -- 172.21.15.114:0/495176468 <== osd.0 v2:172.21.15.114:6808/4163905135 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fad9406f540 con 0x7fad9406ca30 2024-09-13T17:54:09.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.501+0000 7fadbf200640 1 -- 172.21.15.114:0/495176468 --> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fadb813c620 con 0x7fad9406ca30 2024-09-13T17:54:09.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.501+0000 7fadb4c00640 1 -- 172.21.15.114:0/495176468 <== osd.0 v2:172.21.15.114:6808/4163905135 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fadb0009750 con 0x7fad9406ca30 2024-09-13T17:54:09.507 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-13T17:54:09.507 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:54:09.507 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-13T17:54:09.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.501+0000 7fadbf200640 1 -- 172.21.15.114:0/495176468 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x7fad9406ca30 msgr2=0x7fad9406ee70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:09.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.501+0000 7fadbf200640 1 --2- 172.21.15.114:0/495176468 >> [v2:172.21.15.114:6808/4163905135,v1:172.21.15.114:6809/4163905135] conn(0x7fad9406ca30 0x7fad9406ee70 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:09.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.501+0000 7fadbf200640 1 -- 172.21.15.114:0/495176468 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fad94066690 msgr2=0x7fad94068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:09.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.501+0000 7fadbf200640 1 --2- 172.21.15.114:0/495176468 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fad94066690 0x7fad94068b50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fada80aa000 tx=0x7fada80b0040 comp rx=0 tx=0).stop 2024-09-13T17:54:09.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.501+0000 7fadbf200640 1 -- 172.21.15.114:0/495176468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadb815cb20 msgr2=0x7fadb81585a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:09.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.501+0000 7fadbf200640 1 --2- 172.21.15.114:0/495176468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadb815cb20 0x7fadb81585a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fada0007f30 tx=0x7fada00115a0 comp rx=0 tx=0).stop 2024-09-13T17:54:09.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.501+0000 7fadbd200640 1 -- 172.21.15.114:0/495176468 reap_dead start 2024-09-13T17:54:09.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.501+0000 7fadbf200640 1 -- 172.21.15.114:0/495176468 shutdown_connections 2024-09-13T17:54:09.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.501+0000 7fadbf200640 1 -- 172.21.15.114:0/495176468 >> 172.21.15.114:0/495176468 conn(0x7fadb80660b0 msgr2=0x7fadb80ad7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:09.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.501+0000 7fadbf200640 1 -- 172.21.15.114:0/495176468 shutdown_connections 2024-09-13T17:54:09.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.501+0000 7fadbf200640 1 -- 172.21.15.114:0/495176468 wait complete. 2024-09-13T17:54:09.526 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T17:54:09.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.653+0000 7f9b92800640 1 Processor -- start 2024-09-13T17:54:09.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.653+0000 7f9b92800640 1 -- start start 2024-09-13T17:54:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.657+0000 7f9b92800640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f9b8c06dc60 0x7f9b8c0cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.657+0000 7f9b92800640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8c0cd220 con 0x7f9b8c13f420 2024-09-13T17:54:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.657+0000 7f9b92800640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8c15a740 con 0x7f9b8c13c240 2024-09-13T17:54:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.657+0000 7f9b92800640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b8c159bc0 con 0x7f9b8c06dc60 2024-09-13T17:54:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.657+0000 7f9b8aa00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9b8c13f420 0x7f9b8c06d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49764/0 (socket says 172.21.15.114:49764) 2024-09-13T17:54:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.657+0000 7f9b8aa00640 1 -- 172.21.15.114:0/3761481952 learned_addr learned my addr 172.21.15.114:0/3761481952 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:54:09.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.657+0000 7f9b8be00640 1 --2- 172.21.15.114:0/3761481952 >> v2:172.21.15.134:3300/0 conn(0x7f9b8c06dc60 0x7f9b8c0cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:09.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.657+0000 7f9b8a000640 1 -- 172.21.15.114:0/3761481952 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532928640 0 0) 0x7f9b8c0cd220 con 0x7f9b8c13f420 2024-09-13T17:54:09.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.657+0000 7f9b8a000640 1 -- 172.21.15.114:0/3761481952 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b70005740 con 0x7f9b8c13f420 2024-09-13T17:54:09.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.657+0000 7f9b8be00640 1 -- 172.21.15.114:0/3761481952 >> v1:172.21.15.134:6789/0 conn(0x7f9b8c13c240 legacy=0x7f9b8c13c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:09.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.657+0000 7f9b8be00640 1 -- 172.21.15.114:0/3761481952 >> v1:172.21.15.114:6789/0 conn(0x7f9b8c13f420 legacy=0x7f9b8c06d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:09.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.657+0000 7f9b8be00640 1 -- 172.21.15.114:0/3761481952 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8c159ea0 con 0x7f9b8c06dc60 2024-09-13T17:54:09.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.661+0000 7f9b8be00640 1 --2- 172.21.15.114:0/3761481952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b8c06dc60 0x7f9b8c0cd650 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9b840097c0 tx=0x7f9b8401c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54285406f6a93bf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:09.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.661+0000 7f9b8a000640 1 -- 172.21.15.114:0/3761481952 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b840ac640 con 0x7f9b8c06dc60 2024-09-13T17:54:09.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.661+0000 7f9b8a000640 1 -- 172.21.15.114:0/3761481952 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b840ac7a0 con 0x7f9b8c06dc60 2024-09-13T17:54:09.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.661+0000 7f9b8a000640 1 -- 172.21.15.114:0/3761481952 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b840acb30 con 0x7f9b8c06dc60 2024-09-13T17:54:09.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.661+0000 7f9b92800640 1 -- 172.21.15.114:0/3761481952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b8c06dc60 msgr2=0x7f9b8c0cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:09.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.661+0000 7f9b92800640 1 --2- 172.21.15.114:0/3761481952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b8c06dc60 0x7f9b8c0cd650 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9b840097c0 tx=0x7f9b8401c3e0 comp rx=0 tx=0).stop 2024-09-13T17:54:09.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.661+0000 7f9b92800640 1 -- 172.21.15.114:0/3761481952 shutdown_connections 2024-09-13T17:54:09.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.661+0000 7f9b92800640 1 --2- 172.21.15.114:0/3761481952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b8c06dc60 0x7f9b8c0cd650 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:09.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.661+0000 7f9b92800640 1 -- 172.21.15.114:0/3761481952 >> 172.21.15.114:0/3761481952 conn(0x7f9b8c0660b0 msgr2=0x7f9b8c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:09.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.661+0000 7f9b92800640 1 -- 172.21.15.114:0/3761481952 shutdown_connections 2024-09-13T17:54:09.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.661+0000 7f9b92800640 1 -- 172.21.15.114:0/3761481952 wait complete. 2024-09-13T17:54:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.661+0000 7f9b92800640 1 Processor -- start 2024-09-13T17:54:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.661+0000 7f9b92800640 1 -- start start 2024-09-13T17:54:09.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.661+0000 7f9b92800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b8c06dc60 0x7f9b8c139860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:09.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.661+0000 7f9b92800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b8c13c240 0x7f9b8c139da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:09.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.661+0000 7f9b92800640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9b8c13f420 0x7f9b8c0b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:09.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.661+0000 7f9b92800640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8c13a2e0 con 0x7f9b8c06dc60 2024-09-13T17:54:09.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.661+0000 7f9b92800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8c151fc0 con 0x7f9b8c13c240 2024-09-13T17:54:09.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.661+0000 7f9b92800640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8c1513b0 con 0x7f9b8c13f420 2024-09-13T17:54:09.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.661+0000 7f9b8b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b8c06dc60 0x7f9b8c139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:09.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.665+0000 7f9b8b400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b8c06dc60 0x7f9b8c139860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47200/0 (socket says 172.21.15.114:47200) 2024-09-13T17:54:09.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.665+0000 7f9b8b400640 1 -- 172.21.15.114:0/2634790494 learned_addr learned my addr 172.21.15.114:0/2634790494 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:09.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.665+0000 7f9b8aa00640 1 --2- 172.21.15.114:0/2634790494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b8c13c240 0x7f9b8c139da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:09.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.665+0000 7f9b8be00640 1 --2- 172.21.15.114:0/2634790494 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9b8c13f420 0x7f9b8c0b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:09.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.665+0000 7f9b8b400640 1 -- 172.21.15.114:0/2634790494 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9b8c13f420 msgr2=0x7f9b8c0b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:09.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.665+0000 7f9b8b400640 1 --2- 172.21.15.114:0/2634790494 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9b8c13f420 0x7f9b8c0b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:09.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.665+0000 7f9b8b400640 1 -- 172.21.15.114:0/2634790494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b8c13c240 msgr2=0x7f9b8c139da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:09.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.665+0000 7f9b8b400640 1 --2- 172.21.15.114:0/2634790494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b8c13c240 0x7f9b8c139da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:09.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.665+0000 7f9b8b400640 1 -- 172.21.15.114:0/2634790494 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b84009420 con 0x7f9b8c06dc60 2024-09-13T17:54:09.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.665+0000 7f9b8b400640 1 --2- 172.21.15.114:0/2634790494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b8c06dc60 0x7f9b8c139860 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00c7f0 tx=0x7f9b7c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:09.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.665+0000 7f9b83400640 1 -- 172.21.15.114:0/2634790494 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c003b80 con 0x7f9b8c06dc60 2024-09-13T17:54:09.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.665+0000 7f9b83400640 1 -- 172.21.15.114:0/2634790494 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7c003ce0 con 0x7f9b8c06dc60 2024-09-13T17:54:09.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.665+0000 7f9b83400640 1 -- 172.21.15.114:0/2634790494 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c00aa90 con 0x7f9b8c06dc60 2024-09-13T17:54:09.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.665+0000 7f9b92800640 1 -- 172.21.15.114:0/2634790494 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b8c151690 con 0x7f9b8c06dc60 2024-09-13T17:54:09.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.665+0000 7f9b92800640 1 -- 172.21.15.114:0/2634790494 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b8c151c50 con 0x7f9b8c06dc60 2024-09-13T17:54:09.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.665+0000 7f9b92800640 1 -- 172.21.15.114:0/2634790494 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b8c151de0 con 0x7f9b8c06dc60 2024-09-13T17:54:09.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.665+0000 7f9b83400640 1 -- 172.21.15.114:0/2634790494 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9b7c00abf0 con 0x7f9b8c06dc60 2024-09-13T17:54:09.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.665+0000 7f9b83400640 1 --2- 172.21.15.114:0/2634790494 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9b6c066690 0x7f9b6c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:09.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.665+0000 7f9b83400640 1 -- 172.21.15.114:0/2634790494 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f9b7c083d40 con 0x7f9b8c06dc60 2024-09-13T17:54:09.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.665+0000 7f9b8aa00640 1 --2- 172.21.15.114:0/2634790494 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9b6c066690 0x7f9b6c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:09.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.669+0000 7f9b8aa00640 1 --2- 172.21.15.114:0/2634790494 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9b6c066690 0x7f9b6c068b50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0adc00 tx=0x7f9b78007d40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:09.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.669+0000 7f9b83400640 1 -- 172.21.15.114:0/2634790494 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9b7c051350 con 0x7f9b8c06dc60 2024-09-13T17:54:09.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.825+0000 7f9b92800640 1 -- 172.21.15.114:0/2634790494 --> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b8c13f830 con 0x7f9b6c066690 2024-09-13T17:54:09.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.825+0000 7f9b83400640 1 -- 172.21.15.114:0/2634790494 <== mgr.4102 v2:172.21.15.114:6832/137691478 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9b78005860 con 0x7f9b6c066690 2024-09-13T17:54:09.831 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T17:54:09.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.825+0000 7f9b92800640 1 -- 172.21.15.114:0/2634790494 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9b6c066690 msgr2=0x7f9b6c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:09.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.825+0000 7f9b92800640 1 --2- 172.21.15.114:0/2634790494 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9b6c066690 0x7f9b6c068b50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0adc00 tx=0x7f9b78007d40 comp rx=0 tx=0).stop 2024-09-13T17:54:09.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.825+0000 7f9b92800640 1 -- 172.21.15.114:0/2634790494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b8c06dc60 msgr2=0x7f9b8c139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:09.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.825+0000 7f9b92800640 1 --2- 172.21.15.114:0/2634790494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b8c06dc60 0x7f9b8c139860 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00c7f0 tx=0x7f9b7c00ccb0 comp rx=0 tx=0).stop 2024-09-13T17:54:09.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.825+0000 7f9b92800640 1 -- 172.21.15.114:0/2634790494 shutdown_connections 2024-09-13T17:54:09.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.825+0000 7f9b92800640 1 --2- 172.21.15.114:0/2634790494 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9b6c066690 0x7f9b6c068b50 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:09.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.825+0000 7f9b92800640 1 --2- 172.21.15.114:0/2634790494 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9b8c13f420 0x7f9b8c0b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:09.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.825+0000 7f9b92800640 1 --2- 172.21.15.114:0/2634790494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b8c13c240 0x7f9b8c139da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:09.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.825+0000 7f9b92800640 1 --2- 172.21.15.114:0/2634790494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b8c06dc60 0x7f9b8c139860 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:09.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.825+0000 7f9b92800640 1 -- 172.21.15.114:0/2634790494 >> 172.21.15.114:0/2634790494 conn(0x7f9b8c0660b0 msgr2=0x7f9b8c06d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:09.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.825+0000 7f9b92800640 1 -- 172.21.15.114:0/2634790494 shutdown_connections 2024-09-13T17:54:09.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.825+0000 7f9b92800640 1 -- 172.21.15.114:0/2634790494 wait complete. 2024-09-13T17:54:09.854 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T17:54:09.854 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:54:09.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.989+0000 7fc268600640 1 Processor -- start 2024-09-13T17:54:09.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.989+0000 7fc268600640 1 -- start start 2024-09-13T17:54:09.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.989+0000 7fc268600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc26013f420 0x7fc26006d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:09.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.989+0000 7fc268600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2600cd220 con 0x7fc26006da90 2024-09-13T17:54:09.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.989+0000 7fc268600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc26015a740 con 0x7fc26013c240 2024-09-13T17:54:09.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.989+0000 7fc268600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc26006df40 con 0x7fc26013f420 2024-09-13T17:54:09.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.989+0000 7fc266600640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc26006da90 0x7fc2600cd650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49772/0 (socket says 172.21.15.114:49772) 2024-09-13T17:54:09.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.989+0000 7fc266600640 1 -- 172.21.15.114:0/3655314255 learned_addr learned my addr 172.21.15.114:0/3655314255 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:54:09.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.989+0000 7fc265200640 1 --2- 172.21.15.114:0/3655314255 >> v2:172.21.15.114:3300/0 conn(0x7fc26013f420 0x7fc26006d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:09.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.989+0000 7fc25fe00640 1 -- 172.21.15.114:0/3655314255 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2325938632 0 0) 0x7fc2600cd220 con 0x7fc26006da90 2024-09-13T17:54:09.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.989+0000 7fc25fe00640 1 -- 172.21.15.114:0/3655314255 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc248005740 con 0x7fc26006da90 2024-09-13T17:54:09.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.989+0000 7fc265200640 1 -- 172.21.15.114:0/3655314255 >> v1:172.21.15.134:6789/0 conn(0x7fc26013c240 legacy=0x7fc26013c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:09.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.989+0000 7fc265200640 1 -- 172.21.15.114:0/3655314255 >> v1:172.21.15.114:6789/0 conn(0x7fc26006da90 legacy=0x7fc2600cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:09.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.989+0000 7fc265200640 1 -- 172.21.15.114:0/3655314255 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc260159bc0 con 0x7fc26013f420 2024-09-13T17:54:09.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.993+0000 7fc265200640 1 --2- 172.21.15.114:0/3655314255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc26013f420 0x7fc26006d550 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc24c0097c0 tx=0x7fc24c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb7cb39ae2136fe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:09.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.993+0000 7fc25fe00640 1 -- 172.21.15.114:0/3655314255 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24c0ab600 con 0x7fc26013f420 2024-09-13T17:54:09.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.993+0000 7fc25fe00640 1 -- 172.21.15.114:0/3655314255 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24c0a7050 con 0x7fc26013f420 2024-09-13T17:54:09.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.993+0000 7fc25fe00640 1 -- 172.21.15.114:0/3655314255 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24c0ab980 con 0x7fc26013f420 2024-09-13T17:54:10.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.993+0000 7fc268600640 1 -- 172.21.15.114:0/3655314255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc26013f420 msgr2=0x7fc26006d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:10.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.993+0000 7fc268600640 1 --2- 172.21.15.114:0/3655314255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc26013f420 0x7fc26006d550 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc24c0097c0 tx=0x7fc24c01c430 comp rx=0 tx=0).stop 2024-09-13T17:54:10.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.993+0000 7fc268600640 1 -- 172.21.15.114:0/3655314255 shutdown_connections 2024-09-13T17:54:10.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.993+0000 7fc268600640 1 --2- 172.21.15.114:0/3655314255 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc26013f420 0x7fc26006d550 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.993+0000 7fc268600640 1 -- 172.21.15.114:0/3655314255 >> 172.21.15.114:0/3655314255 conn(0x7fc2600660b0 msgr2=0x7fc260069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:10.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.993+0000 7fc268600640 1 -- 172.21.15.114:0/3655314255 shutdown_connections 2024-09-13T17:54:10.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.993+0000 7fc268600640 1 -- 172.21.15.114:0/3655314255 wait complete. 2024-09-13T17:54:10.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.997+0000 7fc268600640 1 Processor -- start 2024-09-13T17:54:10.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.997+0000 7fc268600640 1 -- start start 2024-09-13T17:54:10.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.997+0000 7fc268600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc26006da90 0x7fc2600acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:10.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.997+0000 7fc268600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc26013c240 0x7fc26014e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:10.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.997+0000 7fc268600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc26013f420 0x7fc2601f9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:10.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.997+0000 7fc268600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2600ad2c0 con 0x7fc26013f420 2024-09-13T17:54:10.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.997+0000 7fc268600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26014eef0 con 0x7fc26006da90 2024-09-13T17:54:10.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.997+0000 7fc268600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26014fd10 con 0x7fc26013c240 2024-09-13T17:54:10.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.997+0000 7fc266600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc26013f420 0x7fc2601f9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:10.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.997+0000 7fc266600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc26013f420 0x7fc2601f9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47232/0 (socket says 172.21.15.114:47232) 2024-09-13T17:54:10.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.997+0000 7fc266600640 1 -- 172.21.15.114:0/180679805 learned_addr learned my addr 172.21.15.114:0/180679805 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:10.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.997+0000 7fc265c00640 1 --2- 172.21.15.114:0/180679805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc26006da90 0x7fc2600acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:10.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.997+0000 7fc265200640 1 --2- 172.21.15.114:0/180679805 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc26013c240 0x7fc26014e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:10.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.997+0000 7fc266600640 1 -- 172.21.15.114:0/180679805 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc26013c240 msgr2=0x7fc26014e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:10.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.997+0000 7fc266600640 1 --2- 172.21.15.114:0/180679805 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fc26013c240 0x7fc26014e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.997+0000 7fc266600640 1 -- 172.21.15.114:0/180679805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc26006da90 msgr2=0x7fc2600acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:10.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.997+0000 7fc266600640 1 --2- 172.21.15.114:0/180679805 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc26006da90 0x7fc2600acd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.997+0000 7fc266600640 1 -- 172.21.15.114:0/180679805 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24c009420 con 0x7fc26013f420 2024-09-13T17:54:10.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.997+0000 7fc266600640 1 --2- 172.21.15.114:0/180679805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc26013f420 0x7fc2601f9100 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc25800cad0 tx=0x7fc25800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:10.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.997+0000 7fc25d600640 1 -- 172.21.15.114:0/180679805 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25800ac30 con 0x7fc26013f420 2024-09-13T17:54:10.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.997+0000 7fc25d600640 1 -- 172.21.15.114:0/180679805 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25800ad90 con 0x7fc26013f420 2024-09-13T17:54:10.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.997+0000 7fc268600640 1 -- 172.21.15.114:0/180679805 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2601f9640 con 0x7fc26013f420 2024-09-13T17:54:10.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.997+0000 7fc25d600640 1 -- 172.21.15.114:0/180679805 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc258012620 con 0x7fc26013f420 2024-09-13T17:54:10.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:09.997+0000 7fc268600640 1 -- 172.21.15.114:0/180679805 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc26014f3e0 con 0x7fc26013f420 2024-09-13T17:54:10.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.001+0000 7fc268600640 1 -- 172.21.15.114:0/180679805 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc26013f870 con 0x7fc26013f420 2024-09-13T17:54:10.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.001+0000 7fc25d600640 1 -- 172.21.15.114:0/180679805 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc258007070 con 0x7fc26013f420 2024-09-13T17:54:10.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.001+0000 7fc25d600640 1 --2- 172.21.15.114:0/180679805 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc2400666c0 0x7fc240068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:10.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.001+0000 7fc25d600640 1 -- 172.21.15.114:0/180679805 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fc2580846a0 con 0x7fc26013f420 2024-09-13T17:54:10.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.001+0000 7fc265c00640 1 --2- 172.21.15.114:0/180679805 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc2400666c0 0x7fc240068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:10.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.001+0000 7fc25d600640 1 --2- 172.21.15.114:0/180679805 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x7fc24006ca60 0x7fc24006eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:10.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.001+0000 7fc25d600640 1 -- 172.21.15.114:0/180679805 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc24006f570 con 0x7fc24006ca60 2024-09-13T17:54:10.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.001+0000 7fc25d600640 1 -- 172.21.15.114:0/180679805 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc258084a10 con 0x7fc26013f420 2024-09-13T17:54:10.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.001+0000 7fc265200640 1 --2- 172.21.15.114:0/180679805 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x7fc24006ca60 0x7fc24006eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:10.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.001+0000 7fc265c00640 1 --2- 172.21.15.114:0/180679805 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc2400666c0 0x7fc240068b80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc254007fd0 tx=0x7fc254007e40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:10.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.001+0000 7fc265200640 1 --2- 172.21.15.114:0/180679805 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x7fc24006ca60 0x7fc24006eea0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:10.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.001+0000 7fc25d600640 1 -- 172.21.15.114:0/180679805 <== osd.1 v2:172.21.15.114:6816/2809354915 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc24006f570 con 0x7fc24006ca60 2024-09-13T17:54:10.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.017+0000 7fc268600640 1 -- 172.21.15.114:0/180679805 --> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc2600ce170 con 0x7fc24006ca60 2024-09-13T17:54:10.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.017+0000 7fc25d600640 1 -- 172.21.15.114:0/180679805 <== osd.1 v2:172.21.15.114:6816/2809354915 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc24c0ab620 con 0x7fc24006ca60 2024-09-13T17:54:10.022 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-13T17:54:10.023 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:54:10.023 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-13T17:54:10.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.017+0000 7fc268600640 1 -- 172.21.15.114:0/180679805 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x7fc24006ca60 msgr2=0x7fc24006eea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:10.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.017+0000 7fc268600640 1 --2- 172.21.15.114:0/180679805 >> [v2:172.21.15.114:6816/2809354915,v1:172.21.15.114:6817/2809354915] conn(0x7fc24006ca60 0x7fc24006eea0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.017+0000 7fc268600640 1 -- 172.21.15.114:0/180679805 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc2400666c0 msgr2=0x7fc240068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:10.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.017+0000 7fc268600640 1 --2- 172.21.15.114:0/180679805 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fc2400666c0 0x7fc240068b80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc254007fd0 tx=0x7fc254007e40 comp rx=0 tx=0).stop 2024-09-13T17:54:10.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.017+0000 7fc268600640 1 -- 172.21.15.114:0/180679805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc26013f420 msgr2=0x7fc2601f9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:10.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.017+0000 7fc268600640 1 --2- 172.21.15.114:0/180679805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc26013f420 0x7fc2601f9100 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc25800cad0 tx=0x7fc25800cf90 comp rx=0 tx=0).stop 2024-09-13T17:54:10.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.017+0000 7fc266600640 1 -- 172.21.15.114:0/180679805 reap_dead start 2024-09-13T17:54:10.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.017+0000 7fc268600640 1 -- 172.21.15.114:0/180679805 shutdown_connections 2024-09-13T17:54:10.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.017+0000 7fc268600640 1 -- 172.21.15.114:0/180679805 >> 172.21.15.114:0/180679805 conn(0x7fc2600660b0 msgr2=0x7fc2600cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:10.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.017+0000 7fc268600640 1 -- 172.21.15.114:0/180679805 shutdown_connections 2024-09-13T17:54:10.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.017+0000 7fc268600640 1 -- 172.21.15.114:0/180679805 wait complete. 2024-09-13T17:54:10.042 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T17:54:10.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.173+0000 7f60e1200640 1 Processor -- start 2024-09-13T17:54:10.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.173+0000 7f60e1200640 1 -- start start 2024-09-13T17:54:10.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.173+0000 7f60e1200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60dc070420 0x7f60dc070860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:10.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.173+0000 7f60e1200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f60dc06c540 0x7f60dc06c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:10.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.173+0000 7f60e1200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60dc070da0 con 0x7f60dc151420 2024-09-13T17:54:10.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.173+0000 7f60e1200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60dc0cbc30 con 0x7f60dc06c540 2024-09-13T17:54:10.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.173+0000 7f60e1200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc151800 con 0x7f60dc070420 2024-09-13T17:54:10.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.173+0000 7f60d9e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f60dc151420 0x7f60dc0cc660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49782/0 (socket says 172.21.15.114:49782) 2024-09-13T17:54:10.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.173+0000 7f60d9e00640 1 -- 172.21.15.114:0/2490757900 learned_addr learned my addr 172.21.15.114:0/2490757900 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:54:10.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.173+0000 7f60da800640 1 --2- 172.21.15.114:0/2490757900 >> v2:172.21.15.114:3300/0 conn(0x7f60dc06c540 0x7f60dc06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:10.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.173+0000 7f60d1400640 1 --2- 172.21.15.114:0/2490757900 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60dc070420 0x7f60dc070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:10.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.173+0000 7f60da800640 1 -- 172.21.15.114:0/2490757900 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60dc070420 msgr2=0x7f60dc070860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:10.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.173+0000 7f60da800640 1 --2- 172.21.15.114:0/2490757900 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60dc070420 0x7f60dc070860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.173+0000 7f60da800640 1 -- 172.21.15.114:0/2490757900 >> v1:172.21.15.114:6789/0 conn(0x7f60dc151420 legacy=0x7f60dc0cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:10.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.173+0000 7f60da800640 1 -- 172.21.15.114:0/2490757900 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60dc0cafb0 con 0x7f60dc06c540 2024-09-13T17:54:10.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.173+0000 7f60d9400640 1 -- 172.21.15.114:0/2490757900 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176217855 0 0) 0x7f60dc070da0 con 0x7f60dc151420 2024-09-13T17:54:10.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.177+0000 7f60da800640 1 --2- 172.21.15.114:0/2490757900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60dc06c540 0x7f60dc06c990 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f60d4009d90 tx=0x7f60d401c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d0961d551ee345 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:10.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.177+0000 7f60d9400640 1 -- 172.21.15.114:0/2490757900 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d40a58e0 con 0x7f60dc06c540 2024-09-13T17:54:10.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.177+0000 7f60d9400640 1 -- 172.21.15.114:0/2490757900 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d40a5a40 con 0x7f60dc06c540 2024-09-13T17:54:10.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.177+0000 7f60d9400640 1 -- 172.21.15.114:0/2490757900 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d40a5dd0 con 0x7f60dc06c540 2024-09-13T17:54:10.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.177+0000 7f60e1200640 1 -- 172.21.15.114:0/2490757900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60dc06c540 msgr2=0x7f60dc06c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:10.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.177+0000 7f60e1200640 1 --2- 172.21.15.114:0/2490757900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60dc06c540 0x7f60dc06c990 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f60d4009d90 tx=0x7f60d401c820 comp rx=0 tx=0).stop 2024-09-13T17:54:10.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.177+0000 7f60e1200640 1 -- 172.21.15.114:0/2490757900 shutdown_connections 2024-09-13T17:54:10.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.177+0000 7f60e1200640 1 --2- 172.21.15.114:0/2490757900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60dc06c540 0x7f60dc06c990 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.177+0000 7f60e1200640 1 --2- 172.21.15.114:0/2490757900 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60dc070420 0x7f60dc070860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.177+0000 7f60e1200640 1 -- 172.21.15.114:0/2490757900 >> 172.21.15.114:0/2490757900 conn(0x7f60dc0660b0 msgr2=0x7f60dc069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:10.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.177+0000 7f60e1200640 1 -- 172.21.15.114:0/2490757900 shutdown_connections 2024-09-13T17:54:10.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.177+0000 7f60e1200640 1 -- 172.21.15.114:0/2490757900 wait complete. 2024-09-13T17:54:10.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.177+0000 7f60e1200640 1 Processor -- start 2024-09-13T17:54:10.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.181+0000 7f60e1200640 1 -- start start 2024-09-13T17:54:10.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.181+0000 7f60e1200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60dc06c540 0x7f60dc139f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:10.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.181+0000 7f60e1200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60dc070420 0x7f60dc136c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:10.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.181+0000 7f60e1200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60dc151420 0x7f60dc0b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:10.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.181+0000 7f60e1200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc14b600 con 0x7f60dc06c540 2024-09-13T17:54:10.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.181+0000 7f60e1200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc14c940 con 0x7f60dc151420 2024-09-13T17:54:10.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.181+0000 7f60e1200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60dc13a4a0 con 0x7f60dc070420 2024-09-13T17:54:10.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.181+0000 7f60d9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60dc06c540 0x7f60dc139f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:10.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.181+0000 7f60d9e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60dc06c540 0x7f60dc139f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47242/0 (socket says 172.21.15.114:47242) 2024-09-13T17:54:10.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.181+0000 7f60d9e00640 1 -- 172.21.15.114:0/2159708024 learned_addr learned my addr 172.21.15.114:0/2159708024 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:10.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.181+0000 7f60d1400640 1 --2- 172.21.15.114:0/2159708024 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60dc070420 0x7f60dc136c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:10.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.181+0000 7f60da800640 1 --2- 172.21.15.114:0/2159708024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60dc151420 0x7f60dc0b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:10.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.181+0000 7f60d9e00640 1 -- 172.21.15.114:0/2159708024 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60dc070420 msgr2=0x7f60dc136c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:10.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.181+0000 7f60d9e00640 1 --2- 172.21.15.114:0/2159708024 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60dc070420 0x7f60dc136c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.181+0000 7f60d9e00640 1 -- 172.21.15.114:0/2159708024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60dc151420 msgr2=0x7f60dc0b0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:10.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.181+0000 7f60d9e00640 1 --2- 172.21.15.114:0/2159708024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60dc151420 0x7f60dc0b0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.181+0000 7f60d9e00640 1 -- 172.21.15.114:0/2159708024 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d4009a70 con 0x7f60dc06c540 2024-09-13T17:54:10.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.181+0000 7f60d9e00640 1 --2- 172.21.15.114:0/2159708024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60dc06c540 0x7f60dc139f60 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f60cc0011f0 tx=0x7f60cc00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:10.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.181+0000 7f60d2a00640 1 -- 172.21.15.114:0/2159708024 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc0074e0 con 0x7f60dc06c540 2024-09-13T17:54:10.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.181+0000 7f60d2a00640 1 -- 172.21.15.114:0/2159708024 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60cc007640 con 0x7f60dc06c540 2024-09-13T17:54:10.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.181+0000 7f60e1200640 1 -- 172.21.15.114:0/2159708024 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60dc14b8a0 con 0x7f60dc06c540 2024-09-13T17:54:10.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.181+0000 7f60d2a00640 1 -- 172.21.15.114:0/2159708024 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60cc004a10 con 0x7f60dc06c540 2024-09-13T17:54:10.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.181+0000 7f60e1200640 1 -- 172.21.15.114:0/2159708024 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60dc14be60 con 0x7f60dc06c540 2024-09-13T17:54:10.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.181+0000 7f60e1200640 1 -- 172.21.15.114:0/2159708024 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60dc15ccc0 con 0x7f60dc06c540 2024-09-13T17:54:10.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.185+0000 7f60d2a00640 1 -- 172.21.15.114:0/2159708024 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f60cc004b70 con 0x7f60dc06c540 2024-09-13T17:54:10.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.185+0000 7f60d2a00640 1 --2- 172.21.15.114:0/2159708024 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f60b8066690 0x7f60b8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:10.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.185+0000 7f60d2a00640 1 -- 172.21.15.114:0/2159708024 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f60cc083280 con 0x7f60dc06c540 2024-09-13T17:54:10.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.185+0000 7f60d1400640 1 --2- 172.21.15.114:0/2159708024 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f60b8066690 0x7f60b8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:10.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.185+0000 7f60d1400640 1 --2- 172.21.15.114:0/2159708024 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f60b8066690 0x7f60b8068b50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0cd810 tx=0x7f60c4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:10.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.189+0000 7f60d2a00640 1 -- 172.21.15.114:0/2159708024 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f60cc0507e0 con 0x7f60dc06c540 2024-09-13T17:54:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.345+0000 7f60e1200640 1 -- 172.21.15.114:0/2159708024 --> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f60dc0ccd70 con 0x7f60b8066690 2024-09-13T17:54:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.345+0000 7f60d2a00640 1 -- 172.21.15.114:0/2159708024 <== mgr.4102 v2:172.21.15.114:6832/137691478 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f60c4004030 con 0x7f60b8066690 2024-09-13T17:54:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T17:54:10.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.345+0000 7f60e1200640 1 -- 172.21.15.114:0/2159708024 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f60b8066690 msgr2=0x7f60b8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:10.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.345+0000 7f60e1200640 1 --2- 172.21.15.114:0/2159708024 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f60b8066690 0x7f60b8068b50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0cd810 tx=0x7f60c4008040 comp rx=0 tx=0).stop 2024-09-13T17:54:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.345+0000 7f60e1200640 1 -- 172.21.15.114:0/2159708024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60dc06c540 msgr2=0x7f60dc139f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.345+0000 7f60e1200640 1 --2- 172.21.15.114:0/2159708024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60dc06c540 0x7f60dc139f60 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f60cc0011f0 tx=0x7f60cc00c9b0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.345+0000 7f60e1200640 1 -- 172.21.15.114:0/2159708024 shutdown_connections 2024-09-13T17:54:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.345+0000 7f60e1200640 1 --2- 172.21.15.114:0/2159708024 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f60b8066690 0x7f60b8068b50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.345+0000 7f60e1200640 1 --2- 172.21.15.114:0/2159708024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60dc151420 0x7f60dc0b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.345+0000 7f60e1200640 1 --2- 172.21.15.114:0/2159708024 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f60dc070420 0x7f60dc136c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.345+0000 7f60e1200640 1 --2- 172.21.15.114:0/2159708024 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60dc06c540 0x7f60dc139f60 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.345+0000 7f60e1200640 1 -- 172.21.15.114:0/2159708024 >> 172.21.15.114:0/2159708024 conn(0x7f60dc0660b0 msgr2=0x7f60dc159d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.345+0000 7f60e1200640 1 -- 172.21.15.114:0/2159708024 shutdown_connections 2024-09-13T17:54:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.345+0000 7f60e1200640 1 -- 172.21.15.114:0/2159708024 wait complete. 2024-09-13T17:54:10.371 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T17:54:10.371 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:54:10.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.501+0000 7fbb85200640 1 Processor -- start 2024-09-13T17:54:10.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.501+0000 7fbb85200640 1 -- start start 2024-09-13T17:54:10.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.505+0000 7fbb85200640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbb8015c7e0 0x7fbb80071890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:10.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.505+0000 7fbb85200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb800af750 0x7fbb800afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:10.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.505+0000 7fbb85200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb800aec90 con 0x7fbb80069f80 2024-09-13T17:54:10.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.505+0000 7fbb85200640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb8015cbc0 con 0x7fbb8015c7e0 2024-09-13T17:54:10.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.505+0000 7fbb85200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800b0100 con 0x7fbb800af750 2024-09-13T17:54:10.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.505+0000 7fbb7f400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbb8015c7e0 0x7fbb80071890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:10.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.505+0000 7fbb76a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbb80069f80 0x7fbb801608e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49794/0 (socket says 172.21.15.114:49794) 2024-09-13T17:54:10.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.505+0000 7fbb76a00640 1 -- 172.21.15.114:0/3143186146 learned_addr learned my addr 172.21.15.114:0/3143186146 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:54:10.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.505+0000 7fbb7fe00640 1 --2- 172.21.15.114:0/3143186146 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb800af750 0x7fbb800afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:10.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.505+0000 7fbb7f400640 1 -- 172.21.15.114:0/3143186146 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb800af750 msgr2=0x7fbb800afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:10.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.505+0000 7fbb7f400640 1 --2- 172.21.15.114:0/3143186146 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb800af750 0x7fbb800afbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.505+0000 7fbb7f400640 1 -- 172.21.15.114:0/3143186146 >> v1:172.21.15.114:6789/0 conn(0x7fbb80069f80 legacy=0x7fbb801608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:10.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.505+0000 7fbb7f400640 1 -- 172.21.15.114:0/3143186146 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8006a540 con 0x7fbb8015c7e0 2024-09-13T17:54:10.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.505+0000 7fbb7ea00640 1 -- 172.21.15.114:0/3143186146 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410618064 0 0) 0x7fbb800aec90 con 0x7fbb80069f80 2024-09-13T17:54:10.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.505+0000 7fbb7f400640 1 --2- 172.21.15.114:0/3143186146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb8015c7e0 0x7fbb80071890 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fbb700097f0 tx=0x7fbb7001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8040923c1dbe0f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:10.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.509+0000 7fbb7ea00640 1 -- 172.21.15.114:0/3143186146 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb700a6040 con 0x7fbb8015c7e0 2024-09-13T17:54:10.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.509+0000 7fbb7ea00640 1 -- 172.21.15.114:0/3143186146 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb700aa600 con 0x7fbb8015c7e0 2024-09-13T17:54:10.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.509+0000 7fbb7ea00640 1 -- 172.21.15.114:0/3143186146 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb700aa990 con 0x7fbb8015c7e0 2024-09-13T17:54:10.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.509+0000 7fbb85200640 1 -- 172.21.15.114:0/3143186146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb8015c7e0 msgr2=0x7fbb80071890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:10.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.509+0000 7fbb85200640 1 --2- 172.21.15.114:0/3143186146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb8015c7e0 0x7fbb80071890 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fbb700097f0 tx=0x7fbb7001c4a0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.509+0000 7fbb85200640 1 -- 172.21.15.114:0/3143186146 shutdown_connections 2024-09-13T17:54:10.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.509+0000 7fbb85200640 1 --2- 172.21.15.114:0/3143186146 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb800af750 0x7fbb800afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.509+0000 7fbb85200640 1 --2- 172.21.15.114:0/3143186146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb8015c7e0 0x7fbb80071890 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.509+0000 7fbb85200640 1 -- 172.21.15.114:0/3143186146 >> 172.21.15.114:0/3143186146 conn(0x7fbb800b4a30 msgr2=0x7fbb80098a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:10.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.509+0000 7fbb85200640 1 -- 172.21.15.114:0/3143186146 shutdown_connections 2024-09-13T17:54:10.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.509+0000 7fbb85200640 1 -- 172.21.15.114:0/3143186146 wait complete. 2024-09-13T17:54:10.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.509+0000 7fbb85200640 1 Processor -- start 2024-09-13T17:54:10.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.509+0000 7fbb85200640 1 -- start start 2024-09-13T17:54:10.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.509+0000 7fbb85200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb80069f80 0x7fbb800adc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:10.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.509+0000 7fbb85200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb800af750 0x7fbb80150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:10.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.509+0000 7fbb85200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb8015c7e0 0x7fbb801514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:10.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.509+0000 7fbb85200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8015cd40 con 0x7fbb8015c7e0 2024-09-13T17:54:10.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.509+0000 7fbb85200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8015d8c0 con 0x7fbb800af750 2024-09-13T17:54:10.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.509+0000 7fbb85200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8015cf90 con 0x7fbb80069f80 2024-09-13T17:54:10.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.509+0000 7fbb7fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb8015c7e0 0x7fbb801514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:10.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.509+0000 7fbb7fe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb8015c7e0 0x7fbb801514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47252/0 (socket says 172.21.15.114:47252) 2024-09-13T17:54:10.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.509+0000 7fbb7fe00640 1 -- 172.21.15.114:0/72290350 learned_addr learned my addr 172.21.15.114:0/72290350 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:10.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.513+0000 7fbb7f400640 1 --2- 172.21.15.114:0/72290350 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb80069f80 0x7fbb800adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:10.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.513+0000 7fbb76a00640 1 --2- 172.21.15.114:0/72290350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb800af750 0x7fbb80150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:10.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.513+0000 7fbb7fe00640 1 -- 172.21.15.114:0/72290350 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb80069f80 msgr2=0x7fbb800adc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:10.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.513+0000 7fbb7fe00640 1 --2- 172.21.15.114:0/72290350 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb80069f80 0x7fbb800adc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.513+0000 7fbb7fe00640 1 -- 172.21.15.114:0/72290350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb800af750 msgr2=0x7fbb80150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:10.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.513+0000 7fbb7fe00640 1 --2- 172.21.15.114:0/72290350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb800af750 0x7fbb80150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.513+0000 7fbb7fe00640 1 -- 172.21.15.114:0/72290350 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb70009420 con 0x7fbb8015c7e0 2024-09-13T17:54:10.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.513+0000 7fbb7f400640 1 --2- 172.21.15.114:0/72290350 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fbb80069f80 0x7fbb800adc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:54:10.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.513+0000 7fbb76a00640 1 --2- 172.21.15.114:0/72290350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb800af750 0x7fbb80150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:54:10.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.513+0000 7fbb7fe00640 1 --2- 172.21.15.114:0/72290350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb8015c7e0 0x7fbb801514a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fbb78009dd0 tx=0x7fbb7800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:10.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.513+0000 7fbb77e00640 1 -- 172.21.15.114:0/72290350 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb78014480 con 0x7fbb8015c7e0 2024-09-13T17:54:10.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.513+0000 7fbb77e00640 1 -- 172.21.15.114:0/72290350 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7800f040 con 0x7fbb8015c7e0 2024-09-13T17:54:10.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.513+0000 7fbb77e00640 1 -- 172.21.15.114:0/72290350 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb78014840 con 0x7fbb8015c7e0 2024-09-13T17:54:10.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.513+0000 7fbb85200640 1 -- 172.21.15.114:0/72290350 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb8015d270 con 0x7fbb8015c7e0 2024-09-13T17:54:10.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.513+0000 7fbb85200640 1 -- 172.21.15.114:0/72290350 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb800ae180 con 0x7fbb8015c7e0 2024-09-13T17:54:10.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.513+0000 7fbb85200640 1 -- 172.21.15.114:0/72290350 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbb800cc8e0 con 0x7fbb8015c7e0 2024-09-13T17:54:10.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.513+0000 7fbb77e00640 1 -- 172.21.15.114:0/72290350 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbb780149a0 con 0x7fbb8015c7e0 2024-09-13T17:54:10.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.513+0000 7fbb77e00640 1 --2- 172.21.15.114:0/72290350 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbb5c066690 0x7fbb5c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:10.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.513+0000 7fbb77e00640 1 -- 172.21.15.114:0/72290350 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fbb78084d10 con 0x7fbb8015c7e0 2024-09-13T17:54:10.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.513+0000 7fbb7f400640 1 --2- 172.21.15.114:0/72290350 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbb5c066690 0x7fbb5c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:10.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.513+0000 7fbb77e00640 1 --2- 172.21.15.114:0/72290350 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x7fbb5c06ca30 0x7fbb5c06ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:10.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.513+0000 7fbb77e00640 1 -- 172.21.15.114:0/72290350 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbb5c06f540 con 0x7fbb5c06ca30 2024-09-13T17:54:10.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.513+0000 7fbb77e00640 1 -- 172.21.15.114:0/72290350 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb780872f0 con 0x7fbb8015c7e0 2024-09-13T17:54:10.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.517+0000 7fbb76a00640 1 --2- 172.21.15.114:0/72290350 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x7fbb5c06ca30 0x7fbb5c06ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:10.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.517+0000 7fbb7f400640 1 --2- 172.21.15.114:0/72290350 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbb5c066690 0x7fbb5c068b50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbb700ae000 tx=0x7fbb70008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:10.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.517+0000 7fbb76a00640 1 --2- 172.21.15.114:0/72290350 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x7fbb5c06ca30 0x7fbb5c06ee70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:10.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.517+0000 7fbb77e00640 1 -- 172.21.15.114:0/72290350 <== osd.2 v2:172.21.15.114:6800/1009667871 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbb5c06f540 con 0x7fbb5c06ca30 2024-09-13T17:54:10.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.529+0000 7fbb85200640 1 -- 172.21.15.114:0/72290350 --> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbb8015d720 con 0x7fbb5c06ca30 2024-09-13T17:54:10.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.529+0000 7fbb77e00640 1 -- 172.21.15.114:0/72290350 <== osd.2 v2:172.21.15.114:6800/1009667871 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fbb680014a0 con 0x7fbb5c06ca30 2024-09-13T17:54:10.537 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-13T17:54:10.537 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:54:10.537 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-13T17:54:10.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.529+0000 7fbb85200640 1 -- 172.21.15.114:0/72290350 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x7fbb5c06ca30 msgr2=0x7fbb5c06ee70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:10.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.529+0000 7fbb85200640 1 --2- 172.21.15.114:0/72290350 >> [v2:172.21.15.114:6800/1009667871,v1:172.21.15.114:6801/1009667871] conn(0x7fbb5c06ca30 0x7fbb5c06ee70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.529+0000 7fbb85200640 1 -- 172.21.15.114:0/72290350 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbb5c066690 msgr2=0x7fbb5c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:10.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.529+0000 7fbb85200640 1 --2- 172.21.15.114:0/72290350 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fbb5c066690 0x7fbb5c068b50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbb700ae000 tx=0x7fbb70008040 comp rx=0 tx=0).stop 2024-09-13T17:54:10.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.529+0000 7fbb85200640 1 -- 172.21.15.114:0/72290350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb8015c7e0 msgr2=0x7fbb801514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:10.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.529+0000 7fbb85200640 1 --2- 172.21.15.114:0/72290350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb8015c7e0 0x7fbb801514a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fbb78009dd0 tx=0x7fbb7800c490 comp rx=0 tx=0).stop 2024-09-13T17:54:10.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.529+0000 7fbb7fe00640 1 -- 172.21.15.114:0/72290350 reap_dead start 2024-09-13T17:54:10.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.529+0000 7fbb85200640 1 -- 172.21.15.114:0/72290350 shutdown_connections 2024-09-13T17:54:10.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.529+0000 7fbb85200640 1 -- 172.21.15.114:0/72290350 >> 172.21.15.114:0/72290350 conn(0x7fbb800b4a30 msgr2=0x7fbb801566a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:10.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.529+0000 7fbb85200640 1 -- 172.21.15.114:0/72290350 shutdown_connections 2024-09-13T17:54:10.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.529+0000 7fbb85200640 1 -- 172.21.15.114:0/72290350 wait complete. 2024-09-13T17:54:10.555 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T17:54:10.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.681+0000 7fdb97600640 1 Processor -- start 2024-09-13T17:54:10.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb97600640 1 -- start start 2024-09-13T17:54:10.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb97600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fdb9006dc60 0x7fdb900cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:10.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb97600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb900cd220 con 0x7fdb9013f420 2024-09-13T17:54:10.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb97600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb9015a740 con 0x7fdb9013c240 2024-09-13T17:54:10.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb97600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb90159bc0 con 0x7fdb9006dc60 2024-09-13T17:54:10.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb8fe00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fdb9013f420 0x7fdb9006d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49808/0 (socket says 172.21.15.114:49808) 2024-09-13T17:54:10.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb8fe00640 1 -- 172.21.15.114:0/3999312163 learned_addr learned my addr 172.21.15.114:0/3999312163 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:54:10.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb8f400640 1 -- 172.21.15.114:0/3999312163 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1720690956 0 0) 0x7fdb900cd220 con 0x7fdb9013f420 2024-09-13T17:54:10.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb95600640 1 --2- 172.21.15.114:0/3999312163 >> v2:172.21.15.134:3300/0 conn(0x7fdb9006dc60 0x7fdb900cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:10.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb8f400640 1 -- 172.21.15.114:0/3999312163 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb74005740 con 0x7fdb9013f420 2024-09-13T17:54:10.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb8f400640 1 -- 172.21.15.114:0/3999312163 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1519550487 0 0) 0x7fdb74005740 con 0x7fdb9013f420 2024-09-13T17:54:10.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb8f400640 1 -- 172.21.15.114:0/3999312163 >> v2:172.21.15.134:3300/0 conn(0x7fdb9006dc60 msgr2=0x7fdb900cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:10.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb8f400640 1 --2- 172.21.15.114:0/3999312163 >> v2:172.21.15.134:3300/0 conn(0x7fdb9006dc60 0x7fdb900cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb8f400640 1 -- 172.21.15.114:0/3999312163 >> v1:172.21.15.134:6789/0 conn(0x7fdb9013c240 legacy=0x7fdb9013c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:10.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb8f400640 1 -- 172.21.15.114:0/3999312163 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb90159ea0 con 0x7fdb9013f420 2024-09-13T17:54:10.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb8f400640 1 -- 172.21.15.114:0/3999312163 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7fdb7c001680 con 0x7fdb9013f420 2024-09-13T17:54:10.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb8f400640 1 -- 172.21.15.114:0/3999312163 >> v1:172.21.15.114:6789/0 conn(0x7fdb9013f420 legacy=0x7fdb9006d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:10.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb8f400640 1 --2- 172.21.15.114:0/3999312163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb74005b90 0x7fdb74005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:10.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb8f400640 1 --2- 172.21.15.114:0/3999312163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb740069e0 0x7fdb74006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:10.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb8f400640 1 --2- 172.21.15.114:0/3999312163 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdb740073a0 0x7fdb7400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:10.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb8f400640 1 -- 172.21.15.114:0/3999312163 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb90159bc0 con 0x7fdb74005b90 2024-09-13T17:54:10.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb8f400640 1 -- 172.21.15.114:0/3999312163 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7400e340 con 0x7fdb740069e0 2024-09-13T17:54:10.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb8f400640 1 -- 172.21.15.114:0/3999312163 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7400e500 con 0x7fdb740073a0 2024-09-13T17:54:10.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb94c00640 1 --2- 172.21.15.114:0/3999312163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb74005b90 0x7fdb74005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:10.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb8fe00640 1 --2- 172.21.15.114:0/3999312163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb740069e0 0x7fdb74006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:10.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb95600640 1 --2- 172.21.15.114:0/3999312163 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdb740073a0 0x7fdb7400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:10.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb94c00640 1 -- 172.21.15.114:0/3999312163 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdb740073a0 msgr2=0x7fdb7400dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:10.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb94c00640 1 --2- 172.21.15.114:0/3999312163 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdb740073a0 0x7fdb7400dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb94c00640 1 -- 172.21.15.114:0/3999312163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb740069e0 msgr2=0x7fdb74006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:10.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb94c00640 1 --2- 172.21.15.114:0/3999312163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb740069e0 0x7fdb74006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb94c00640 1 -- 172.21.15.114:0/3999312163 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb74005740 con 0x7fdb74005b90 2024-09-13T17:54:10.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb95600640 1 --2- 172.21.15.114:0/3999312163 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdb740073a0 0x7fdb7400dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:54:10.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.685+0000 7fdb95600640 1 -- 172.21.15.114:0/3999312163 reap_dead start 2024-09-13T17:54:10.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.689+0000 7fdb94c00640 1 --2- 172.21.15.114:0/3999312163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb74005b90 0x7fdb74005fb0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fdb80001780 tx=0x7fdb8001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28efe48597490c61 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:10.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.689+0000 7fdb8f400640 1 -- 172.21.15.114:0/3999312163 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb800052d0 con 0x7fdb74005b90 2024-09-13T17:54:10.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.689+0000 7fdb8f400640 1 -- 172.21.15.114:0/3999312163 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb800a7050 con 0x7fdb74005b90 2024-09-13T17:54:10.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.689+0000 7fdb8f400640 1 -- 172.21.15.114:0/3999312163 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb80003600 con 0x7fdb74005b90 2024-09-13T17:54:10.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.689+0000 7fdb97600640 1 -- 172.21.15.114:0/3999312163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb74005b90 msgr2=0x7fdb74005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:10.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.689+0000 7fdb97600640 1 --2- 172.21.15.114:0/3999312163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb74005b90 0x7fdb74005fb0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fdb80001780 tx=0x7fdb8001c3d0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.689+0000 7fdb97600640 1 -- 172.21.15.114:0/3999312163 shutdown_connections 2024-09-13T17:54:10.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.689+0000 7fdb97600640 1 --2- 172.21.15.114:0/3999312163 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb74005b90 0x7fdb74005fb0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.689+0000 7fdb97600640 1 -- 172.21.15.114:0/3999312163 >> 172.21.15.114:0/3999312163 conn(0x7fdb900660b0 msgr2=0x7fdb90069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:10.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.689+0000 7fdb97600640 1 -- 172.21.15.114:0/3999312163 shutdown_connections 2024-09-13T17:54:10.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.689+0000 7fdb97600640 1 -- 172.21.15.114:0/3999312163 wait complete. 2024-09-13T17:54:10.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.693+0000 7fdb97600640 1 Processor -- start 2024-09-13T17:54:10.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.693+0000 7fdb97600640 1 -- start start 2024-09-13T17:54:10.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.693+0000 7fdb97600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb74005b90 0x7fdb9015c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:10.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.693+0000 7fdb97600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb901f5150 0x7fdb901565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:10.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.693+0000 7fdb97600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdb900ae180 0x7fdb9006cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:10.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.693+0000 7fdb97600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb901f5700 con 0x7fdb74005b90 2024-09-13T17:54:10.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.693+0000 7fdb97600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb901f59e0 con 0x7fdb901f5150 2024-09-13T17:54:10.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.693+0000 7fdb97600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb901f5cc0 con 0x7fdb900ae180 2024-09-13T17:54:10.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.693+0000 7fdb94c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb74005b90 0x7fdb9015c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:10.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.693+0000 7fdb94c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb74005b90 0x7fdb9015c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47274/0 (socket says 172.21.15.114:47274) 2024-09-13T17:54:10.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.693+0000 7fdb94c00640 1 -- 172.21.15.114:0/3223263592 learned_addr learned my addr 172.21.15.114:0/3223263592 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:10.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.693+0000 7fdb8fe00640 1 --2- 172.21.15.114:0/3223263592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb901f5150 0x7fdb901565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:10.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.693+0000 7fdb95600640 1 --2- 172.21.15.114:0/3223263592 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdb900ae180 0x7fdb9006cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:10.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.693+0000 7fdb94c00640 1 -- 172.21.15.114:0/3223263592 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdb900ae180 msgr2=0x7fdb9006cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:10.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.693+0000 7fdb94c00640 1 --2- 172.21.15.114:0/3223263592 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdb900ae180 0x7fdb9006cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.693+0000 7fdb94c00640 1 -- 172.21.15.114:0/3223263592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb901f5150 msgr2=0x7fdb901565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:10.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.693+0000 7fdb94c00640 1 --2- 172.21.15.114:0/3223263592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb901f5150 0x7fdb901565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.693+0000 7fdb94c00640 1 -- 172.21.15.114:0/3223263592 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb901f5fa0 con 0x7fdb74005b90 2024-09-13T17:54:10.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.693+0000 7fdb8fe00640 1 --2- 172.21.15.114:0/3223263592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb901f5150 0x7fdb901565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:54:10.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.693+0000 7fdb94c00640 1 --2- 172.21.15.114:0/3223263592 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb74005b90 0x7fdb9015c950 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fdb8001c200 tx=0x7fdb74007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:10.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.693+0000 7fdb8cc00640 1 -- 172.21.15.114:0/3223263592 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb800072f0 con 0x7fdb74005b90 2024-09-13T17:54:10.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.693+0000 7fdb8cc00640 1 -- 172.21.15.114:0/3223263592 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb80007470 con 0x7fdb74005b90 2024-09-13T17:54:10.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.693+0000 7fdb8cc00640 1 -- 172.21.15.114:0/3223263592 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb800067e0 con 0x7fdb74005b90 2024-09-13T17:54:10.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.693+0000 7fdb97600640 1 -- 172.21.15.114:0/3223263592 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb901f8770 con 0x7fdb74005b90 2024-09-13T17:54:10.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.693+0000 7fdb97600640 1 -- 172.21.15.114:0/3223263592 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb90156ae0 con 0x7fdb74005b90 2024-09-13T17:54:10.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.697+0000 7fdb97600640 1 -- 172.21.15.114:0/3223263592 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb90159790 con 0x7fdb74005b90 2024-09-13T17:54:10.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.697+0000 7fdb8cc00640 1 -- 172.21.15.114:0/3223263592 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdb80006940 con 0x7fdb74005b90 2024-09-13T17:54:10.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.697+0000 7fdb8cc00640 1 --2- 172.21.15.114:0/3223263592 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdb70066690 0x7fdb70068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:10.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.697+0000 7fdb8cc00640 1 -- 172.21.15.114:0/3223263592 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fdb8011e000 con 0x7fdb74005b90 2024-09-13T17:54:10.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.697+0000 7fdb8fe00640 1 --2- 172.21.15.114:0/3223263592 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdb70066690 0x7fdb70068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:10.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.697+0000 7fdb8fe00640 1 --2- 172.21.15.114:0/3223263592 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdb70066690 0x7fdb70068b50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c001060 tx=0x7fdb7c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:10.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.701+0000 7fdb8cc00640 1 -- 172.21.15.114:0/3223263592 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdb800eb4d0 con 0x7fdb74005b90 2024-09-13T17:54:10.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.853+0000 7fdb97600640 1 -- 172.21.15.114:0/3223263592 --> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb9013f830 con 0x7fdb70066690 2024-09-13T17:54:10.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.853+0000 7fdb8cc00640 1 -- 172.21.15.114:0/3223263592 <== mgr.4102 v2:172.21.15.114:6832/137691478 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdb7c001560 con 0x7fdb70066690 2024-09-13T17:54:10.861 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T17:54:10.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.857+0000 7fdb97600640 1 -- 172.21.15.114:0/3223263592 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdb70066690 msgr2=0x7fdb70068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:10.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.857+0000 7fdb97600640 1 --2- 172.21.15.114:0/3223263592 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdb70066690 0x7fdb70068b50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c001060 tx=0x7fdb7c009040 comp rx=0 tx=0).stop 2024-09-13T17:54:10.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.857+0000 7fdb97600640 1 -- 172.21.15.114:0/3223263592 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb74005b90 msgr2=0x7fdb9015c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:10.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.857+0000 7fdb97600640 1 --2- 172.21.15.114:0/3223263592 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb74005b90 0x7fdb9015c950 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fdb8001c200 tx=0x7fdb74007a10 comp rx=0 tx=0).stop 2024-09-13T17:54:10.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.857+0000 7fdb97600640 1 -- 172.21.15.114:0/3223263592 shutdown_connections 2024-09-13T17:54:10.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.857+0000 7fdb97600640 1 --2- 172.21.15.114:0/3223263592 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fdb70066690 0x7fdb70068b50 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.857+0000 7fdb97600640 1 --2- 172.21.15.114:0/3223263592 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fdb900ae180 0x7fdb9006cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.857+0000 7fdb97600640 1 --2- 172.21.15.114:0/3223263592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb901f5150 0x7fdb901565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.857+0000 7fdb97600640 1 --2- 172.21.15.114:0/3223263592 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb74005b90 0x7fdb9015c950 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:10.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.857+0000 7fdb97600640 1 -- 172.21.15.114:0/3223263592 >> 172.21.15.114:0/3223263592 conn(0x7fdb900660b0 msgr2=0x7fdb90158c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:10.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.857+0000 7fdb97600640 1 -- 172.21.15.114:0/3223263592 shutdown_connections 2024-09-13T17:54:10.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:10.857+0000 7fdb97600640 1 -- 172.21.15.114:0/3223263592 wait complete. 2024-09-13T17:54:10.883 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T17:54:10.883 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:54:11.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.017+0000 7f2042a00640 1 Processor -- start 2024-09-13T17:54:11.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.017+0000 7f2042a00640 1 -- start start 2024-09-13T17:54:11.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.017+0000 7f2042a00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f203c070420 0x7f203c0708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:11.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.017+0000 7f2042a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f203c0adfb0 con 0x7f203c06d030 2024-09-13T17:54:11.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.017+0000 7f2042a00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f203c0adcd0 con 0x7f203c0cdad0 2024-09-13T17:54:11.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.017+0000 7f2042a00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f203c06cc10 con 0x7f203c070420 2024-09-13T17:54:11.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.017+0000 7f2040a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f203c06d030 0x7f203c06d4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44946/0 (socket says 172.21.15.114:44946) 2024-09-13T17:54:11.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.017+0000 7f2040a00640 1 -- 172.21.15.114:0/3690674649 learned_addr learned my addr 172.21.15.114:0/3690674649 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:54:11.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.017+0000 7f203b400640 1 --2- 172.21.15.114:0/3690674649 >> v2:172.21.15.134:3300/0 conn(0x7f203c070420 0x7f203c0708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:11.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.017+0000 7f203aa00640 1 -- 172.21.15.114:0/3690674649 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1704157691 0 0) 0x7f203c0adfb0 con 0x7f203c06d030 2024-09-13T17:54:11.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.017+0000 7f203aa00640 1 -- 172.21.15.114:0/3690674649 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2020003530 con 0x7f203c06d030 2024-09-13T17:54:11.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.017+0000 7f203b400640 1 -- 172.21.15.114:0/3690674649 >> v1:172.21.15.134:6789/0 conn(0x7f203c0cdad0 legacy=0x7f203c0ad4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.017+0000 7f203b400640 1 -- 172.21.15.114:0/3690674649 >> v1:172.21.15.114:6789/0 conn(0x7f203c06d030 legacy=0x7f203c06d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.017+0000 7f203b400640 1 -- 172.21.15.114:0/3690674649 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203c06c550 con 0x7f203c070420 2024-09-13T17:54:11.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.021+0000 7f203b400640 1 --2- 172.21.15.114:0/3690674649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f203c070420 0x7f203c0708b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f20280097c0 tx=0x7f202801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbd98c9fdfdbf840 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:11.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.021+0000 7f203aa00640 1 -- 172.21.15.114:0/3690674649 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20280a4ea0 con 0x7f203c070420 2024-09-13T17:54:11.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.021+0000 7f203aa00640 1 -- 172.21.15.114:0/3690674649 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20280a7050 con 0x7f203c070420 2024-09-13T17:54:11.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.021+0000 7f203aa00640 1 -- 172.21.15.114:0/3690674649 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20280ab820 con 0x7f203c070420 2024-09-13T17:54:11.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.021+0000 7f2042a00640 1 -- 172.21.15.114:0/3690674649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f203c070420 msgr2=0x7f203c0708b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.021+0000 7f2042a00640 1 --2- 172.21.15.114:0/3690674649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f203c070420 0x7f203c0708b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f20280097c0 tx=0x7f202801c410 comp rx=0 tx=0).stop 2024-09-13T17:54:11.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.021+0000 7f2042a00640 1 -- 172.21.15.114:0/3690674649 shutdown_connections 2024-09-13T17:54:11.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.021+0000 7f2042a00640 1 --2- 172.21.15.114:0/3690674649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f203c070420 0x7f203c0708b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.021+0000 7f2042a00640 1 -- 172.21.15.114:0/3690674649 >> 172.21.15.114:0/3690674649 conn(0x7f203c0660b0 msgr2=0x7f203c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:11.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.021+0000 7f2042a00640 1 -- 172.21.15.114:0/3690674649 shutdown_connections 2024-09-13T17:54:11.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.021+0000 7f2042a00640 1 -- 172.21.15.114:0/3690674649 wait complete. 2024-09-13T17:54:11.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.025+0000 7f2042a00640 1 Processor -- start 2024-09-13T17:54:11.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.025+0000 7f2042a00640 1 -- start start 2024-09-13T17:54:11.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.025+0000 7f2042a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f203c06d030 0x7f203c154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:11.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.025+0000 7f2042a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f203c070420 0x7f203c14f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:11.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.025+0000 7f2042a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f203c0cdad0 0x7f203c14fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:11.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.025+0000 7f2042a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c150c60 con 0x7f203c0cdad0 2024-09-13T17:54:11.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.025+0000 7f2042a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c1517e0 con 0x7f203c070420 2024-09-13T17:54:11.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.025+0000 7f2042a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203c14bf60 con 0x7f203c06d030 2024-09-13T17:54:11.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.025+0000 7f2040a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f203c0cdad0 0x7f203c14fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:11.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.025+0000 7f2040a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f203c0cdad0 0x7f203c14fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50106/0 (socket says 172.21.15.114:50106) 2024-09-13T17:54:11.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.025+0000 7f2040a00640 1 -- 172.21.15.114:0/2641069008 learned_addr learned my addr 172.21.15.114:0/2641069008 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:11.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.025+0000 7f203be00640 1 --2- 172.21.15.114:0/2641069008 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f203c06d030 0x7f203c154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:11.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.025+0000 7f203b400640 1 --2- 172.21.15.114:0/2641069008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f203c070420 0x7f203c14f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:11.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.025+0000 7f2040a00640 1 -- 172.21.15.114:0/2641069008 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f203c06d030 msgr2=0x7f203c154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.025+0000 7f2040a00640 1 --2- 172.21.15.114:0/2641069008 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f203c06d030 0x7f203c154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.025+0000 7f2040a00640 1 -- 172.21.15.114:0/2641069008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f203c070420 msgr2=0x7f203c14f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.025+0000 7f2040a00640 1 --2- 172.21.15.114:0/2641069008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f203c070420 0x7f203c14f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.025+0000 7f2040a00640 1 -- 172.21.15.114:0/2641069008 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2028009420 con 0x7f203c0cdad0 2024-09-13T17:54:11.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.025+0000 7f2040a00640 1 --2- 172.21.15.114:0/2641069008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f203c0cdad0 0x7f203c14fa90 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f203400cad0 tx=0x7f203400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:11.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.025+0000 7f2033e00640 1 -- 172.21.15.114:0/2641069008 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203400ac30 con 0x7f203c0cdad0 2024-09-13T17:54:11.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.025+0000 7f2033e00640 1 -- 172.21.15.114:0/2641069008 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203400ad90 con 0x7f203c0cdad0 2024-09-13T17:54:11.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.025+0000 7f2042a00640 1 -- 172.21.15.114:0/2641069008 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203c150eb0 con 0x7f203c0cdad0 2024-09-13T17:54:11.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.025+0000 7f2033e00640 1 -- 172.21.15.114:0/2641069008 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2034012620 con 0x7f203c0cdad0 2024-09-13T17:54:11.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.025+0000 7f2042a00640 1 -- 172.21.15.114:0/2641069008 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f203c151470 con 0x7f203c0cdad0 2024-09-13T17:54:11.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.025+0000 7f2042a00640 1 -- 172.21.15.114:0/2641069008 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f203c16a480 con 0x7f203c0cdad0 2024-09-13T17:54:11.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.029+0000 7f2033e00640 1 -- 172.21.15.114:0/2641069008 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2034007070 con 0x7f203c0cdad0 2024-09-13T17:54:11.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.029+0000 7f2033e00640 1 --2- 172.21.15.114:0/2641069008 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f201c066690 0x7f201c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:11.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.029+0000 7f2033e00640 1 -- 172.21.15.114:0/2641069008 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f2034084710 con 0x7f203c0cdad0 2024-09-13T17:54:11.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.029+0000 7f203be00640 1 --2- 172.21.15.114:0/2641069008 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f201c066690 0x7f201c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:11.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.029+0000 7f2033e00640 1 --2- 172.21.15.114:0/2641069008 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x7f201c06ca30 0x7f201c06ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:11.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.029+0000 7f2033e00640 1 -- 172.21.15.114:0/2641069008 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f201c06f540 con 0x7f201c06ca30 2024-09-13T17:54:11.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.029+0000 7f2033e00640 1 -- 172.21.15.114:0/2641069008 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2034084a80 con 0x7f203c0cdad0 2024-09-13T17:54:11.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.029+0000 7f203b400640 1 --2- 172.21.15.114:0/2641069008 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x7f201c06ca30 0x7f201c06ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:11.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.029+0000 7f203be00640 1 --2- 172.21.15.114:0/2641069008 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f201c066690 0x7f201c068b50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f203c0b2c60 tx=0x7f202c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:11.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.029+0000 7f203b400640 1 --2- 172.21.15.114:0/2641069008 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x7f201c06ca30 0x7f201c06ee70 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:11.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.029+0000 7f2033e00640 1 -- 172.21.15.114:0/2641069008 <== osd.3 v2:172.21.15.114:6824/1824187331 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f201c06f540 con 0x7f201c06ca30 2024-09-13T17:54:11.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.041+0000 7f2042a00640 1 -- 172.21.15.114:0/2641069008 --> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f203c0708b0 con 0x7f201c06ca30 2024-09-13T17:54:11.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.041+0000 7f2033e00640 1 -- 172.21.15.114:0/2641069008 <== osd.3 v2:172.21.15.114:6824/1824187331 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f203c0708b0 con 0x7f201c06ca30 2024-09-13T17:54:11.050 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-13T17:54:11.050 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:54:11.050 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-13T17:54:11.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.045+0000 7f2042a00640 1 -- 172.21.15.114:0/2641069008 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x7f201c06ca30 msgr2=0x7f201c06ee70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.045+0000 7f2042a00640 1 --2- 172.21.15.114:0/2641069008 >> [v2:172.21.15.114:6824/1824187331,v1:172.21.15.114:6825/1824187331] conn(0x7f201c06ca30 0x7f201c06ee70 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.045+0000 7f2042a00640 1 -- 172.21.15.114:0/2641069008 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f201c066690 msgr2=0x7f201c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.045+0000 7f2042a00640 1 --2- 172.21.15.114:0/2641069008 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f201c066690 0x7f201c068b50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f203c0b2c60 tx=0x7f202c009040 comp rx=0 tx=0).stop 2024-09-13T17:54:11.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.045+0000 7f2042a00640 1 -- 172.21.15.114:0/2641069008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f203c0cdad0 msgr2=0x7f203c14fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.045+0000 7f2042a00640 1 --2- 172.21.15.114:0/2641069008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f203c0cdad0 0x7f203c14fa90 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f203400cad0 tx=0x7f203400cf90 comp rx=0 tx=0).stop 2024-09-13T17:54:11.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.045+0000 7f2040a00640 1 -- 172.21.15.114:0/2641069008 reap_dead start 2024-09-13T17:54:11.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.045+0000 7f2042a00640 1 -- 172.21.15.114:0/2641069008 shutdown_connections 2024-09-13T17:54:11.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.045+0000 7f2042a00640 1 -- 172.21.15.114:0/2641069008 >> 172.21.15.114:0/2641069008 conn(0x7f203c0660b0 msgr2=0x7f203c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:11.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.045+0000 7f2042a00640 1 -- 172.21.15.114:0/2641069008 shutdown_connections 2024-09-13T17:54:11.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.045+0000 7f2042a00640 1 -- 172.21.15.114:0/2641069008 wait complete. 2024-09-13T17:54:11.070 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T17:54:11.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.197+0000 7f07bd400640 1 Processor -- start 2024-09-13T17:54:11.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.201+0000 7f07bd400640 1 -- start start 2024-09-13T17:54:11.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.201+0000 7f07bd400640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f07b806c3b0 0x7f07b806c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:11.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.201+0000 7f07bd400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f07b815af00 0x7f07b815b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:11.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.201+0000 7f07bd400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b8144320 con 0x7f07b8143f40 2024-09-13T17:54:11.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.201+0000 7f07bd400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b815aac0 con 0x7f07b815af00 2024-09-13T17:54:11.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.201+0000 7f07bd400640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b80cda60 con 0x7f07b806c3b0 2024-09-13T17:54:11.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.201+0000 7f07b6800640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f07b8143f40 0x7f07b80cc500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44950/0 (socket says 172.21.15.114:44950) 2024-09-13T17:54:11.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.201+0000 7f07b6800640 1 -- 172.21.15.114:0/340200462 learned_addr learned my addr 172.21.15.114:0/340200462 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:54:11.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.201+0000 7f07b7200640 1 --2- 172.21.15.114:0/340200462 >> v2:172.21.15.114:3300/0 conn(0x7f07b815af00 0x7f07b815b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:11.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.201+0000 7f07ade00640 1 --2- 172.21.15.114:0/340200462 >> v2:172.21.15.134:3300/0 conn(0x7f07b806c3b0 0x7f07b806c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:11.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.201+0000 7f07b5e00640 1 -- 172.21.15.114:0/340200462 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3366456805 0 0) 0x7f07a80014a0 con 0x7f07b8143f40 2024-09-13T17:54:11.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.201+0000 7f07b5e00640 1 -- 172.21.15.114:0/340200462 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f079c003530 con 0x7f07b8143f40 2024-09-13T17:54:11.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.201+0000 7f07b7200640 1 -- 172.21.15.114:0/340200462 >> v2:172.21.15.134:3300/0 conn(0x7f07b806c3b0 msgr2=0x7f07b806c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:11.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.201+0000 7f07b7200640 1 --2- 172.21.15.114:0/340200462 >> v2:172.21.15.134:3300/0 conn(0x7f07b806c3b0 0x7f07b806c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.201+0000 7f07b7200640 1 -- 172.21.15.114:0/340200462 >> v1:172.21.15.114:6789/0 conn(0x7f07b8143f40 legacy=0x7f07b80cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.201+0000 7f07b7200640 1 -- 172.21.15.114:0/340200462 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b806cd30 con 0x7f07b815af00 2024-09-13T17:54:11.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.201+0000 7f07ade00640 1 --2- 172.21.15.114:0/340200462 >> v2:172.21.15.134:3300/0 conn(0x7f07b806c3b0 0x7f07b806c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:54:11.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.205+0000 7f07b7200640 1 --2- 172.21.15.114:0/340200462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07b815af00 0x7f07b815b370 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f07b806c0b0 tx=0x7f07b001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500b7f6b85883047 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:11.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.205+0000 7f07b5e00640 1 -- 172.21.15.114:0/340200462 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b00ac630 con 0x7f07b815af00 2024-09-13T17:54:11.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.205+0000 7f07b5e00640 1 -- 172.21.15.114:0/340200462 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b00ac790 con 0x7f07b815af00 2024-09-13T17:54:11.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.205+0000 7f07b5e00640 1 -- 172.21.15.114:0/340200462 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b00acb20 con 0x7f07b815af00 2024-09-13T17:54:11.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.205+0000 7f07bd400640 1 -- 172.21.15.114:0/340200462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07b815af00 msgr2=0x7f07b815b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.205+0000 7f07bd400640 1 --2- 172.21.15.114:0/340200462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07b815af00 0x7f07b815b370 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f07b806c0b0 tx=0x7f07b001c3d0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.205+0000 7f07bd400640 1 -- 172.21.15.114:0/340200462 shutdown_connections 2024-09-13T17:54:11.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.205+0000 7f07bd400640 1 --2- 172.21.15.114:0/340200462 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07b815af00 0x7f07b815b370 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.205+0000 7f07bd400640 1 --2- 172.21.15.114:0/340200462 >> v2:172.21.15.134:3300/0 conn(0x7f07b806c3b0 0x7f07b806c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.205+0000 7f07bd400640 1 -- 172.21.15.114:0/340200462 >> 172.21.15.114:0/340200462 conn(0x7f07b80b01a0 msgr2=0x7f07b80b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:11.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.205+0000 7f07bd400640 1 -- 172.21.15.114:0/340200462 shutdown_connections 2024-09-13T17:54:11.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.205+0000 7f07bd400640 1 -- 172.21.15.114:0/340200462 wait complete. 2024-09-13T17:54:11.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.205+0000 7f07bd400640 1 Processor -- start 2024-09-13T17:54:11.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.205+0000 7f07bd400640 1 -- start start 2024-09-13T17:54:11.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.209+0000 7f07bd400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07b806c3b0 0x7f07b8159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:11.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.209+0000 7f07bd400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07b8143f40 0x7f07b81386b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:11.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.209+0000 7f07bd400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07b815af00 0x7f07b8159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:11.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.209+0000 7f07bd400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b813f410 con 0x7f07b8143f40 2024-09-13T17:54:11.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.209+0000 7f07bd400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b81596d0 con 0x7f07b815af00 2024-09-13T17:54:11.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.209+0000 7f07bd400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b80af5a0 con 0x7f07b806c3b0 2024-09-13T17:54:11.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.209+0000 7f07ade00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07b8143f40 0x7f07b81386b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:11.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.209+0000 7f07ade00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07b8143f40 0x7f07b81386b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50132/0 (socket says 172.21.15.114:50132) 2024-09-13T17:54:11.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.209+0000 7f07ade00640 1 -- 172.21.15.114:0/406300727 learned_addr learned my addr 172.21.15.114:0/406300727 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:11.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.209+0000 7f07b6800640 1 --2- 172.21.15.114:0/406300727 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07b806c3b0 0x7f07b8159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:11.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.209+0000 7f07b7200640 1 --2- 172.21.15.114:0/406300727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07b815af00 0x7f07b8159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:11.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.209+0000 7f07ade00640 1 -- 172.21.15.114:0/406300727 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07b806c3b0 msgr2=0x7f07b8159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.209+0000 7f07ade00640 1 --2- 172.21.15.114:0/406300727 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07b806c3b0 0x7f07b8159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.209+0000 7f07ade00640 1 -- 172.21.15.114:0/406300727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07b815af00 msgr2=0x7f07b8159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.209+0000 7f07ade00640 1 --2- 172.21.15.114:0/406300727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07b815af00 0x7f07b8159190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.209+0000 7f07ade00640 1 -- 172.21.15.114:0/406300727 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b0009420 con 0x7f07b8143f40 2024-09-13T17:54:11.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.209+0000 7f07ade00640 1 --2- 172.21.15.114:0/406300727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07b8143f40 0x7f07b81386b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f07a000e810 tx=0x7f07a000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:11.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.209+0000 7f07af400640 1 -- 172.21.15.114:0/406300727 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a000c8d0 con 0x7f07b8143f40 2024-09-13T17:54:11.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.209+0000 7f07af400640 1 -- 172.21.15.114:0/406300727 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a000ca30 con 0x7f07b8143f40 2024-09-13T17:54:11.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.209+0000 7f07bd400640 1 -- 172.21.15.114:0/406300727 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b80af880 con 0x7f07b8143f40 2024-09-13T17:54:11.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.209+0000 7f07af400640 1 -- 172.21.15.114:0/406300727 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a000cde0 con 0x7f07b8143f40 2024-09-13T17:54:11.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.209+0000 7f07bd400640 1 -- 172.21.15.114:0/406300727 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b80afe40 con 0x7f07b8143f40 2024-09-13T17:54:11.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.209+0000 7f07bd400640 1 -- 172.21.15.114:0/406300727 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b806c7f0 con 0x7f07b8143f40 2024-09-13T17:54:11.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.209+0000 7f07af400640 1 -- 172.21.15.114:0/406300727 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f07a0013410 con 0x7f07b8143f40 2024-09-13T17:54:11.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.213+0000 7f07af400640 1 --2- 172.21.15.114:0/406300727 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0794066690 0x7f0794068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:11.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.213+0000 7f07af400640 1 -- 172.21.15.114:0/406300727 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f07a0083ee0 con 0x7f07b8143f40 2024-09-13T17:54:11.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.213+0000 7f07b6800640 1 --2- 172.21.15.114:0/406300727 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0794066690 0x7f0794068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:11.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.213+0000 7f07b6800640 1 --2- 172.21.15.114:0/406300727 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0794066690 0x7f0794068b50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f07a8001600 tx=0x7f07a8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:11.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.217+0000 7f07af400640 1 -- 172.21.15.114:0/406300727 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f07a0051310 con 0x7f07b8143f40 2024-09-13T17:54:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.369+0000 7f07bd400640 1 -- 172.21.15.114:0/406300727 --> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f07b80cd4a0 con 0x7f0794066690 2024-09-13T17:54:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.369+0000 7f07af400640 1 -- 172.21.15.114:0/406300727 <== mgr.4102 v2:172.21.15.114:6832/137691478 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f07a8001f00 con 0x7f0794066690 2024-09-13T17:54:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T17:54:11.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.373+0000 7f07bd400640 1 -- 172.21.15.114:0/406300727 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0794066690 msgr2=0x7f0794068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.373+0000 7f07bd400640 1 --2- 172.21.15.114:0/406300727 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0794066690 0x7f0794068b50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f07a8001600 tx=0x7f07a8009040 comp rx=0 tx=0).stop 2024-09-13T17:54:11.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.373+0000 7f07bd400640 1 -- 172.21.15.114:0/406300727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07b8143f40 msgr2=0x7f07b81386b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.373+0000 7f07bd400640 1 --2- 172.21.15.114:0/406300727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07b8143f40 0x7f07b81386b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f07a000e810 tx=0x7f07a000ecd0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.373+0000 7f07bd400640 1 -- 172.21.15.114:0/406300727 shutdown_connections 2024-09-13T17:54:11.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.373+0000 7f07bd400640 1 --2- 172.21.15.114:0/406300727 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f0794066690 0x7f0794068b50 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.373+0000 7f07bd400640 1 --2- 172.21.15.114:0/406300727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07b815af00 0x7f07b8159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.373+0000 7f07bd400640 1 --2- 172.21.15.114:0/406300727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f07b8143f40 0x7f07b81386b0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.373+0000 7f07bd400640 1 --2- 172.21.15.114:0/406300727 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f07b806c3b0 0x7f07b8159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.373+0000 7f07bd400640 1 -- 172.21.15.114:0/406300727 >> 172.21.15.114:0/406300727 conn(0x7f07b80b01a0 msgr2=0x7f07b80cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:11.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.373+0000 7f07bd400640 1 -- 172.21.15.114:0/406300727 shutdown_connections 2024-09-13T17:54:11.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.373+0000 7f07bd400640 1 -- 172.21.15.114:0/406300727 wait complete. 2024-09-13T17:54:11.399 INFO:tasks.ceph:Scrubbing osd.4 2024-09-13T17:54:11.399 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:54:11.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.529+0000 7f3664200640 1 Processor -- start 2024-09-13T17:54:11.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.529+0000 7f3664200640 1 -- start start 2024-09-13T17:54:11.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.533+0000 7f3664200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f365c151420 0x7f365c0cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:11.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.533+0000 7f3664200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f365c070b30 0x7f365c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:11.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.533+0000 7f3664200640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f365c151800 con 0x7f365c0ccba0 2024-09-13T17:54:11.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.533+0000 7f3664200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f365c0cbc30 con 0x7f365c070b30 2024-09-13T17:54:11.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.533+0000 7f3664200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365c0cafb0 con 0x7f365c151420 2024-09-13T17:54:11.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.533+0000 7f3660e00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f365c0ccba0 0x7f365c070420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44958/0 (socket says 172.21.15.114:44958) 2024-09-13T17:54:11.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.533+0000 7f3660e00640 1 -- 172.21.15.114:0/3526422008 learned_addr learned my addr 172.21.15.114:0/3526422008 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:54:11.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.533+0000 7f3661800640 1 --2- 172.21.15.114:0/3526422008 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f365c151420 0x7f365c0cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:11.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.533+0000 7f3662200640 1 --2- 172.21.15.114:0/3526422008 >> v2:172.21.15.134:3300/0 conn(0x7f365c070b30 0x7f365c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:11.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.533+0000 7f365be00640 1 -- 172.21.15.114:0/3526422008 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1905401072 0 0) 0x7f365c151800 con 0x7f365c0ccba0 2024-09-13T17:54:11.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.533+0000 7f365be00640 1 -- 172.21.15.114:0/3526422008 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3644003530 con 0x7f365c0ccba0 2024-09-13T17:54:11.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.533+0000 7f3661800640 1 -- 172.21.15.114:0/3526422008 >> v2:172.21.15.134:3300/0 conn(0x7f365c070b30 msgr2=0x7f365c06c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:11.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.533+0000 7f3661800640 1 --2- 172.21.15.114:0/3526422008 >> v2:172.21.15.134:3300/0 conn(0x7f365c070b30 0x7f365c06c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.533+0000 7f3661800640 1 -- 172.21.15.114:0/3526422008 >> v1:172.21.15.114:6789/0 conn(0x7f365c0ccba0 legacy=0x7f365c070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.533+0000 7f3661800640 1 -- 172.21.15.114:0/3526422008 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c0cb290 con 0x7f365c151420 2024-09-13T17:54:11.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.537+0000 7f3661800640 1 --2- 172.21.15.114:0/3526422008 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f365c151420 0x7f365c0cc660 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f36500097c0 tx=0x7f365001c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dea7caba39417e4a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:11.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.537+0000 7f365be00640 1 -- 172.21.15.114:0/3526422008 <== mon.2 v2:172.21.15.134:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3650004230 con 0x7f365c151420 2024-09-13T17:54:11.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.537+0000 7f365be00640 1 -- 172.21.15.114:0/3526422008 <== mon.2 v2:172.21.15.134:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36500a7050 con 0x7f365c151420 2024-09-13T17:54:11.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.537+0000 7f365be00640 1 -- 172.21.15.114:0/3526422008 <== mon.2 v2:172.21.15.134:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3650003620 con 0x7f365c151420 2024-09-13T17:54:11.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.537+0000 7f3664200640 1 -- 172.21.15.114:0/3526422008 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f365c151420 msgr2=0x7f365c0cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.537+0000 7f3664200640 1 --2- 172.21.15.114:0/3526422008 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f365c151420 0x7f365c0cc660 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f36500097c0 tx=0x7f365001c350 comp rx=0 tx=0).stop 2024-09-13T17:54:11.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.537+0000 7f3664200640 1 -- 172.21.15.114:0/3526422008 shutdown_connections 2024-09-13T17:54:11.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.537+0000 7f3664200640 1 --2- 172.21.15.114:0/3526422008 >> v2:172.21.15.134:3300/0 conn(0x7f365c070b30 0x7f365c06c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.537+0000 7f3664200640 1 --2- 172.21.15.114:0/3526422008 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f365c151420 0x7f365c0cc660 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.537+0000 7f3664200640 1 -- 172.21.15.114:0/3526422008 >> 172.21.15.114:0/3526422008 conn(0x7f365c0660b0 msgr2=0x7f365c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:11.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.537+0000 7f3664200640 1 -- 172.21.15.114:0/3526422008 shutdown_connections 2024-09-13T17:54:11.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.537+0000 7f3664200640 1 -- 172.21.15.114:0/3526422008 wait complete. 2024-09-13T17:54:11.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.537+0000 7f3664200640 1 Processor -- start 2024-09-13T17:54:11.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.537+0000 7f3664200640 1 -- start start 2024-09-13T17:54:11.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.541+0000 7f3664200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f365c070b30 0x7f365c0a8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:11.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.541+0000 7f3664200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f365c0ccba0 0x7f365c159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:11.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.541+0000 7f3664200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f365c151420 0x7f365c14d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:11.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.541+0000 7f3664200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c0a97b0 con 0x7f365c151420 2024-09-13T17:54:11.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.541+0000 7f3664200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365c0a8b30 con 0x7f365c0ccba0 2024-09-13T17:54:11.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.541+0000 7f3664200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f365c0a8e10 con 0x7f365c070b30 2024-09-13T17:54:11.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.541+0000 7f3662200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f365c151420 0x7f365c14d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:11.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.541+0000 7f3662200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f365c151420 0x7f365c14d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50134/0 (socket says 172.21.15.114:50134) 2024-09-13T17:54:11.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.541+0000 7f3662200640 1 -- 172.21.15.114:0/3281515555 learned_addr learned my addr 172.21.15.114:0/3281515555 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:11.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.541+0000 7f3661800640 1 --2- 172.21.15.114:0/3281515555 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f365c070b30 0x7f365c0a8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:11.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.541+0000 7f3660e00640 1 --2- 172.21.15.114:0/3281515555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f365c0ccba0 0x7f365c159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:11.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.541+0000 7f3662200640 1 -- 172.21.15.114:0/3281515555 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f365c070b30 msgr2=0x7f365c0a8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.541+0000 7f3662200640 1 --2- 172.21.15.114:0/3281515555 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f365c070b30 0x7f365c0a8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.541+0000 7f3662200640 1 -- 172.21.15.114:0/3281515555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f365c0ccba0 msgr2=0x7f365c159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.541+0000 7f3662200640 1 --2- 172.21.15.114:0/3281515555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f365c0ccba0 0x7f365c159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.541+0000 7f3662200640 1 -- 172.21.15.114:0/3281515555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3650009420 con 0x7f365c151420 2024-09-13T17:54:11.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.541+0000 7f3662200640 1 --2- 172.21.15.114:0/3281515555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f365c151420 0x7f365c14d8a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f365400efc0 tx=0x7f365400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:11.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.541+0000 7f3659600640 1 -- 172.21.15.114:0/3281515555 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3654014480 con 0x7f365c151420 2024-09-13T17:54:11.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.541+0000 7f3659600640 1 -- 172.21.15.114:0/3281515555 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365400f040 con 0x7f365c151420 2024-09-13T17:54:11.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.541+0000 7f3664200640 1 -- 172.21.15.114:0/3281515555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f365c0a90f0 con 0x7f365c151420 2024-09-13T17:54:11.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.541+0000 7f3659600640 1 -- 172.21.15.114:0/3281515555 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3654014820 con 0x7f365c151420 2024-09-13T17:54:11.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.541+0000 7f3664200640 1 -- 172.21.15.114:0/3281515555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f365c0a8770 con 0x7f365c151420 2024-09-13T17:54:11.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.541+0000 7f3664200640 1 -- 172.21.15.114:0/3281515555 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f365c06c540 con 0x7f365c151420 2024-09-13T17:54:11.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.541+0000 7f3659600640 1 -- 172.21.15.114:0/3281515555 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3654014980 con 0x7f365c151420 2024-09-13T17:54:11.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.545+0000 7f3659600640 1 --2- 172.21.15.114:0/3281515555 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f363c0666c0 0x7f363c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:11.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.545+0000 7f3659600640 1 -- 172.21.15.114:0/3281515555 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f3654084e00 con 0x7f365c151420 2024-09-13T17:54:11.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.545+0000 7f3659600640 1 --2- 172.21.15.114:0/3281515555 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x7f363c06ca60 0x7f363c06eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:11.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.545+0000 7f3659600640 1 -- 172.21.15.114:0/3281515555 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f363c06f570 con 0x7f363c06ca60 2024-09-13T17:54:11.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.545+0000 7f3659600640 1 -- 172.21.15.114:0/3281515555 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36540873e0 con 0x7f365c151420 2024-09-13T17:54:11.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.545+0000 7f3661800640 1 --2- 172.21.15.114:0/3281515555 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f363c0666c0 0x7f363c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:11.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.545+0000 7f3660e00640 1 --2- 172.21.15.114:0/3281515555 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x7f363c06ca60 0x7f363c06eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:11.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.545+0000 7f3661800640 1 --2- 172.21.15.114:0/3281515555 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f363c0666c0 0x7f363c068b80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f36500ad000 tx=0x7f36500a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:11.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.545+0000 7f3660e00640 1 --2- 172.21.15.114:0/3281515555 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x7f363c06ca60 0x7f363c06eea0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:11.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.545+0000 7f3659600640 1 -- 172.21.15.114:0/3281515555 <== osd.4 v2:172.21.15.134:6808/3210409298 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f363c06f570 con 0x7f363c06ca60 2024-09-13T17:54:11.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.557+0000 7f3664200640 1 -- 172.21.15.114:0/3281515555 --> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f365c0a95a0 con 0x7f363c06ca60 2024-09-13T17:54:11.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.561+0000 7f3659600640 1 -- 172.21.15.114:0/3281515555 <== osd.4 v2:172.21.15.134:6808/3210409298 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3648001580 con 0x7f363c06ca60 2024-09-13T17:54:11.566 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-13T17:54:11.566 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:54:11.566 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-13T17:54:11.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.561+0000 7f3664200640 1 -- 172.21.15.114:0/3281515555 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x7f363c06ca60 msgr2=0x7f363c06eea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.561+0000 7f3664200640 1 --2- 172.21.15.114:0/3281515555 >> [v2:172.21.15.134:6808/3210409298,v1:172.21.15.134:6809/3210409298] conn(0x7f363c06ca60 0x7f363c06eea0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.561+0000 7f3664200640 1 -- 172.21.15.114:0/3281515555 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f363c0666c0 msgr2=0x7f363c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.561+0000 7f3664200640 1 --2- 172.21.15.114:0/3281515555 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f363c0666c0 0x7f363c068b80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f36500ad000 tx=0x7f36500a6000 comp rx=0 tx=0).stop 2024-09-13T17:54:11.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.561+0000 7f3664200640 1 -- 172.21.15.114:0/3281515555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f365c151420 msgr2=0x7f365c14d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.561+0000 7f3664200640 1 --2- 172.21.15.114:0/3281515555 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f365c151420 0x7f365c14d8a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f365400efc0 tx=0x7f365400c490 comp rx=0 tx=0).stop 2024-09-13T17:54:11.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.561+0000 7f3662200640 1 -- 172.21.15.114:0/3281515555 reap_dead start 2024-09-13T17:54:11.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.561+0000 7f3664200640 1 -- 172.21.15.114:0/3281515555 shutdown_connections 2024-09-13T17:54:11.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.561+0000 7f3664200640 1 -- 172.21.15.114:0/3281515555 >> 172.21.15.114:0/3281515555 conn(0x7f365c0660b0 msgr2=0x7f365c070420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:11.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.561+0000 7f3664200640 1 -- 172.21.15.114:0/3281515555 shutdown_connections 2024-09-13T17:54:11.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.561+0000 7f3664200640 1 -- 172.21.15.114:0/3281515555 wait complete. 2024-09-13T17:54:11.584 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-13T17:54:11.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.717+0000 7f9b68400640 1 Processor -- start 2024-09-13T17:54:11.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.717+0000 7f9b68400640 1 -- start start 2024-09-13T17:54:11.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.717+0000 7f9b68400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9b60070890 0x7f9b6006cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:11.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.717+0000 7f9b68400640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b60151800 con 0x7f9b60070420 2024-09-13T17:54:11.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.717+0000 7f9b68400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b600cafb0 con 0x7f9b60151420 2024-09-13T17:54:11.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.717+0000 7f9b68400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b600cbc30 con 0x7f9b60070890 2024-09-13T17:54:11.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.717+0000 7f9b66400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9b60070890 0x7f9b6006cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:11.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.717+0000 7f9b65000640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9b60070420 0x7f9b6006c540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44962/0 (socket says 172.21.15.114:44962) 2024-09-13T17:54:11.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.717+0000 7f9b65000640 1 -- 172.21.15.114:0/3052108701 learned_addr learned my addr 172.21.15.114:0/3052108701 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:54:11.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.717+0000 7f9b66400640 1 -- 172.21.15.114:0/3052108701 >> v1:172.21.15.134:6789/0 conn(0x7f9b60151420 legacy=0x7f9b600cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.717+0000 7f9b66400640 1 -- 172.21.15.114:0/3052108701 >> v1:172.21.15.114:6789/0 conn(0x7f9b60070420 legacy=0x7f9b6006c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.717+0000 7f9b66400640 1 -- 172.21.15.114:0/3052108701 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b600cb290 con 0x7f9b60070890 2024-09-13T17:54:11.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.717+0000 7f9b5fe00640 1 -- 172.21.15.114:0/3052108701 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032029318 0 0) 0x7f9b60151800 con 0x7f9b60070420 2024-09-13T17:54:11.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.717+0000 7f9b66400640 1 --2- 172.21.15.114:0/3052108701 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b60070890 0x7f9b6006cc50 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f9b580097c0 tx=0x7f9b5801c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384e43ecd362a690 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:11.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.717+0000 7f9b5fe00640 1 -- 172.21.15.114:0/3052108701 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b58004230 con 0x7f9b60070890 2024-09-13T17:54:11.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.717+0000 7f9b5fe00640 1 -- 172.21.15.114:0/3052108701 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b580a7050 con 0x7f9b60070890 2024-09-13T17:54:11.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.717+0000 7f9b5fe00640 1 -- 172.21.15.114:0/3052108701 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b58003620 con 0x7f9b60070890 2024-09-13T17:54:11.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.717+0000 7f9b68400640 1 -- 172.21.15.114:0/3052108701 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b60070890 msgr2=0x7f9b6006cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.717+0000 7f9b68400640 1 --2- 172.21.15.114:0/3052108701 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b60070890 0x7f9b6006cc50 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f9b580097c0 tx=0x7f9b5801c350 comp rx=0 tx=0).stop 2024-09-13T17:54:11.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.717+0000 7f9b68400640 1 -- 172.21.15.114:0/3052108701 shutdown_connections 2024-09-13T17:54:11.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.717+0000 7f9b68400640 1 --2- 172.21.15.114:0/3052108701 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b60070890 0x7f9b6006cc50 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.717+0000 7f9b68400640 1 -- 172.21.15.114:0/3052108701 >> 172.21.15.114:0/3052108701 conn(0x7f9b600660b0 msgr2=0x7f9b60069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:11.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.717+0000 7f9b68400640 1 -- 172.21.15.114:0/3052108701 shutdown_connections 2024-09-13T17:54:11.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.717+0000 7f9b68400640 1 -- 172.21.15.114:0/3052108701 wait complete. 2024-09-13T17:54:11.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.721+0000 7f9b68400640 1 Processor -- start 2024-09-13T17:54:11.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.721+0000 7f9b68400640 1 -- start start 2024-09-13T17:54:11.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.721+0000 7f9b68400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b60070420 0x7f9b600b0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:11.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.721+0000 7f9b68400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b60070890 0x7f9b60149db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:11.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.721+0000 7f9b68400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9b60151420 0x7f9b6014a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:11.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.721+0000 7f9b68400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6014baf0 con 0x7f9b60070420 2024-09-13T17:54:11.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.721+0000 7f9b68400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6014a830 con 0x7f9b60070890 2024-09-13T17:54:11.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.721+0000 7f9b68400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6014bd00 con 0x7f9b60151420 2024-09-13T17:54:11.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.721+0000 7f9b65a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b60070420 0x7f9b600b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:11.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.721+0000 7f9b65a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b60070420 0x7f9b600b0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50150/0 (socket says 172.21.15.114:50150) 2024-09-13T17:54:11.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.721+0000 7f9b65a00640 1 -- 172.21.15.114:0/2542714575 learned_addr learned my addr 172.21.15.114:0/2542714575 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:11.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.721+0000 7f9b65a00640 1 -- 172.21.15.114:0/2542714575 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9b60151420 msgr2=0x7f9b6014a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.721+0000 7f9b66400640 1 --2- 172.21.15.114:0/2542714575 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9b60151420 0x7f9b6014a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:11.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.721+0000 7f9b65000640 1 --2- 172.21.15.114:0/2542714575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b60070890 0x7f9b60149db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:11.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.721+0000 7f9b65a00640 1 --2- 172.21.15.114:0/2542714575 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9b60151420 0x7f9b6014a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.721+0000 7f9b65a00640 1 -- 172.21.15.114:0/2542714575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b60070890 msgr2=0x7f9b60149db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.721+0000 7f9b65a00640 1 --2- 172.21.15.114:0/2542714575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b60070890 0x7f9b60149db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.721+0000 7f9b65a00640 1 -- 172.21.15.114:0/2542714575 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b58009420 con 0x7f9b60070420 2024-09-13T17:54:11.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.721+0000 7f9b66400640 1 --2- 172.21.15.114:0/2542714575 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9b60151420 0x7f9b6014a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:54:11.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.721+0000 7f9b65000640 1 --2- 172.21.15.114:0/2542714575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b60070890 0x7f9b60149db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:54:11.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.721+0000 7f9b65a00640 1 --2- 172.21.15.114:0/2542714575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b60070420 0x7f9b600b0520 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f9b5400c7f0 tx=0x7f9b5400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:11.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.721+0000 7f9b5d600640 1 -- 172.21.15.114:0/2542714575 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b54003b80 con 0x7f9b60070420 2024-09-13T17:54:11.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.721+0000 7f9b5d600640 1 -- 172.21.15.114:0/2542714575 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b54003ce0 con 0x7f9b60070420 2024-09-13T17:54:11.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.721+0000 7f9b5d600640 1 -- 172.21.15.114:0/2542714575 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5400aa90 con 0x7f9b60070420 2024-09-13T17:54:11.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.721+0000 7f9b68400640 1 -- 172.21.15.114:0/2542714575 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b6014bfe0 con 0x7f9b60070420 2024-09-13T17:54:11.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.721+0000 7f9b68400640 1 -- 172.21.15.114:0/2542714575 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b6014c5a0 con 0x7f9b60070420 2024-09-13T17:54:11.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.725+0000 7f9b68400640 1 -- 172.21.15.114:0/2542714575 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b600cc660 con 0x7f9b60070420 2024-09-13T17:54:11.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.725+0000 7f9b5d600640 1 -- 172.21.15.114:0/2542714575 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9b5400abf0 con 0x7f9b60070420 2024-09-13T17:54:11.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.725+0000 7f9b5d600640 1 --2- 172.21.15.114:0/2542714575 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9b40066690 0x7f9b40068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:11.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.725+0000 7f9b5d600640 1 -- 172.21.15.114:0/2542714575 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f9b54083eb0 con 0x7f9b60070420 2024-09-13T17:54:11.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.725+0000 7f9b65000640 1 --2- 172.21.15.114:0/2542714575 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9b40066690 0x7f9b40068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:11.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.725+0000 7f9b65000640 1 --2- 172.21.15.114:0/2542714575 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9b40066690 0x7f9b40068b50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9b601f8690 tx=0x7f9b4c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:11.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.729+0000 7f9b5d600640 1 -- 172.21.15.114:0/2542714575 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9b54051410 con 0x7f9b60070420 2024-09-13T17:54:11.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.885+0000 7f9b68400640 1 -- 172.21.15.114:0/2542714575 --> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b60071410 con 0x7f9b40066690 2024-09-13T17:54:11.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.885+0000 7f9b5d600640 1 -- 172.21.15.114:0/2542714575 <== mgr.4102 v2:172.21.15.114:6832/137691478 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9b4c001340 con 0x7f9b40066690 2024-09-13T17:54:11.891 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 4 to deep-scrub 2024-09-13T17:54:11.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.885+0000 7f9b68400640 1 -- 172.21.15.114:0/2542714575 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9b40066690 msgr2=0x7f9b40068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.885+0000 7f9b68400640 1 --2- 172.21.15.114:0/2542714575 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9b40066690 0x7f9b40068b50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9b601f8690 tx=0x7f9b4c009040 comp rx=0 tx=0).stop 2024-09-13T17:54:11.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.885+0000 7f9b68400640 1 -- 172.21.15.114:0/2542714575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b60070420 msgr2=0x7f9b600b0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.885+0000 7f9b68400640 1 --2- 172.21.15.114:0/2542714575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b60070420 0x7f9b600b0520 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f9b5400c7f0 tx=0x7f9b5400ccb0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.885+0000 7f9b68400640 1 -- 172.21.15.114:0/2542714575 shutdown_connections 2024-09-13T17:54:11.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.885+0000 7f9b68400640 1 --2- 172.21.15.114:0/2542714575 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f9b40066690 0x7f9b40068b50 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.885+0000 7f9b68400640 1 --2- 172.21.15.114:0/2542714575 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f9b60151420 0x7f9b6014a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.885+0000 7f9b68400640 1 --2- 172.21.15.114:0/2542714575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b60070890 0x7f9b60149db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.885+0000 7f9b68400640 1 --2- 172.21.15.114:0/2542714575 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b60070420 0x7f9b600b0520 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.885+0000 7f9b68400640 1 -- 172.21.15.114:0/2542714575 >> 172.21.15.114:0/2542714575 conn(0x7f9b600660b0 msgr2=0x7f9b60165900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:11.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.885+0000 7f9b68400640 1 -- 172.21.15.114:0/2542714575 shutdown_connections 2024-09-13T17:54:11.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:11.885+0000 7f9b68400640 1 -- 172.21.15.114:0/2542714575 wait complete. 2024-09-13T17:54:11.912 INFO:tasks.ceph:Scrubbing osd.5 2024-09-13T17:54:11.913 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:54:12.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.045+0000 7f5671a00640 1 Processor -- start 2024-09-13T17:54:12.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.045+0000 7f5671a00640 1 -- start start 2024-09-13T17:54:12.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.045+0000 7f5671a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f566c0b1380 0x7f566c0afd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.045+0000 7f5671a00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f566c161310 con 0x7f566c15ff80 2024-09-13T17:54:12.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.045+0000 7f5671a00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f566c06b780 con 0x7f566c0d00d0 2024-09-13T17:54:12.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.045+0000 7f5671a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566c0ce660 con 0x7f566c0b1380 2024-09-13T17:54:12.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.045+0000 7f566aa00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f566c15ff80 0x7f566c160400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44968/0 (socket says 172.21.15.114:44968) 2024-09-13T17:54:12.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.045+0000 7f566aa00640 1 -- 172.21.15.114:0/398436096 learned_addr learned my addr 172.21.15.114:0/398436096 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:54:12.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.045+0000 7f566b400640 1 --2- 172.21.15.114:0/398436096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f566c0b1380 0x7f566c0afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.045+0000 7f566a000640 1 -- 172.21.15.114:0/398436096 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2662945760 0 0) 0x7f566c161310 con 0x7f566c15ff80 2024-09-13T17:54:12.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.045+0000 7f566a000640 1 -- 172.21.15.114:0/398436096 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5650003530 con 0x7f566c15ff80 2024-09-13T17:54:12.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.045+0000 7f566a000640 1 -- 172.21.15.114:0/398436096 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154205544 0 0) 0x7f566c06b780 con 0x7f566c0d00d0 2024-09-13T17:54:12.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.045+0000 7f566a000640 1 -- 172.21.15.114:0/398436096 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f566c161310 con 0x7f566c0d00d0 2024-09-13T17:54:12.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.045+0000 7f566a000640 1 -- 172.21.15.114:0/398436096 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 698275600 0 0) 0x7f5650003530 con 0x7f566c15ff80 2024-09-13T17:54:12.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.045+0000 7f566a000640 1 -- 172.21.15.114:0/398436096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f566c0b1380 msgr2=0x7f566c0afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:12.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.045+0000 7f566a000640 1 --2- 172.21.15.114:0/398436096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f566c0b1380 0x7f566c0afd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.045+0000 7f566a000640 1 -- 172.21.15.114:0/398436096 >> v1:172.21.15.134:6789/0 conn(0x7f566c0d00d0 legacy=0x7f566c160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:12.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.045+0000 7f566a000640 1 -- 172.21.15.114:0/398436096 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566c06b1c0 con 0x7f566c15ff80 2024-09-13T17:54:12.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.045+0000 7f566a000640 1 -- 172.21.15.114:0/398436096 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7f565c001680 con 0x7f566c15ff80 2024-09-13T17:54:12.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.045+0000 7f566b400640 1 --2- 172.21.15.114:0/398436096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f566c0b1380 0x7f566c0afd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:54:12.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.045+0000 7f566a000640 1 -- 172.21.15.114:0/398436096 >> v1:172.21.15.114:6789/0 conn(0x7f566c15ff80 legacy=0x7f566c160400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:12.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.045+0000 7f566a000640 1 --2- 172.21.15.114:0/398436096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f566c0b1380 0x7f5650003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.045+0000 7f566a000640 1 --2- 172.21.15.114:0/398436096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5650004080 0x7f56500047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.045+0000 7f566a000640 1 --2- 172.21.15.114:0/398436096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5650004d10 0x7f5650005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.045+0000 7f566a000640 1 -- 172.21.15.114:0/398436096 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c0ce660 con 0x7f5650004d10 2024-09-13T17:54:12.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.049+0000 7f566a000640 1 -- 172.21.15.114:0/398436096 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565000bad0 con 0x7f5650004080 2024-09-13T17:54:12.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.049+0000 7f566a000640 1 -- 172.21.15.114:0/398436096 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565000bc90 con 0x7f566c0b1380 2024-09-13T17:54:12.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.049+0000 7f566b400640 1 --2- 172.21.15.114:0/398436096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5650004d10 0x7f5650005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.049+0000 7f566aa00640 1 --2- 172.21.15.114:0/398436096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f566c0b1380 0x7f5650003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.049+0000 7f5662000640 1 --2- 172.21.15.114:0/398436096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5650004080 0x7f56500047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.049+0000 7f566b400640 1 -- 172.21.15.114:0/398436096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f566c0b1380 msgr2=0x7f5650003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:12.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.049+0000 7f566b400640 1 --2- 172.21.15.114:0/398436096 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f566c0b1380 0x7f5650003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.049+0000 7f566b400640 1 -- 172.21.15.114:0/398436096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5650004080 msgr2=0x7f56500047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:12.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.049+0000 7f566b400640 1 --2- 172.21.15.114:0/398436096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5650004080 0x7f56500047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.049+0000 7f566b400640 1 -- 172.21.15.114:0/398436096 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5664009a70 con 0x7f5650004d10 2024-09-13T17:54:12.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.049+0000 7f566b400640 1 --2- 172.21.15.114:0/398436096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5650004d10 0x7f5650005190 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f566400e350 tx=0x7f566401ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d07c519be1c5b7b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:12.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.049+0000 7f566a000640 1 -- 172.21.15.114:0/398436096 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56640a5e10 con 0x7f5650004d10 2024-09-13T17:54:12.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.049+0000 7f566a000640 1 -- 172.21.15.114:0/398436096 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566400f040 con 0x7f5650004d10 2024-09-13T17:54:12.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.049+0000 7f566a000640 1 -- 172.21.15.114:0/398436096 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5664003ba0 con 0x7f5650004d10 2024-09-13T17:54:12.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.053+0000 7f5671a00640 1 -- 172.21.15.114:0/398436096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5650004d10 msgr2=0x7f5650005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:12.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.053+0000 7f5671a00640 1 --2- 172.21.15.114:0/398436096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5650004d10 0x7f5650005190 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f566400e350 tx=0x7f566401ce00 comp rx=0 tx=0).stop 2024-09-13T17:54:12.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.053+0000 7f566b400640 1 -- 172.21.15.114:0/398436096 reap_dead start 2024-09-13T17:54:12.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.053+0000 7f5671a00640 1 -- 172.21.15.114:0/398436096 shutdown_connections 2024-09-13T17:54:12.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.053+0000 7f5671a00640 1 -- 172.21.15.114:0/398436096 >> 172.21.15.114:0/398436096 conn(0x7f566c0d04d0 msgr2=0x7f566c0d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:12.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.053+0000 7f5671a00640 1 -- 172.21.15.114:0/398436096 shutdown_connections 2024-09-13T17:54:12.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.053+0000 7f5671a00640 1 -- 172.21.15.114:0/398436096 wait complete. 2024-09-13T17:54:12.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.053+0000 7f5671a00640 1 Processor -- start 2024-09-13T17:54:12.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.053+0000 7f5671a00640 1 -- start start 2024-09-13T17:54:12.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.053+0000 7f5671a00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5650004d10 0x7f566c1f24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.053+0000 7f5671a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f566c15a330 0x7f566c0b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.053+0000 7f5671a00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f566c0cee40 0x7f566c0b5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.053+0000 7f5671a00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c158810 con 0x7f5650004d10 2024-09-13T17:54:12.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.053+0000 7f5671a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c1f2b10 con 0x7f566c15a330 2024-09-13T17:54:12.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.053+0000 7f5671a00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566c1f2df0 con 0x7f566c0cee40 2024-09-13T17:54:12.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.053+0000 7f566aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5650004d10 0x7f566c1f24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.053+0000 7f566aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5650004d10 0x7f566c1f24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50174/0 (socket says 172.21.15.114:50174) 2024-09-13T17:54:12.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.053+0000 7f566aa00640 1 -- 172.21.15.114:0/2011345787 learned_addr learned my addr 172.21.15.114:0/2011345787 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:12.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.053+0000 7f5662000640 1 --2- 172.21.15.114:0/2011345787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f566c15a330 0x7f566c0b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.053+0000 7f566b400640 1 --2- 172.21.15.114:0/2011345787 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f566c0cee40 0x7f566c0b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.053+0000 7f566aa00640 1 -- 172.21.15.114:0/2011345787 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f566c0cee40 msgr2=0x7f566c0b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:12.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.053+0000 7f566aa00640 1 --2- 172.21.15.114:0/2011345787 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f566c0cee40 0x7f566c0b5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.053+0000 7f566aa00640 1 -- 172.21.15.114:0/2011345787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f566c15a330 msgr2=0x7f566c0b3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:12.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.053+0000 7f566aa00640 1 --2- 172.21.15.114:0/2011345787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f566c15a330 0x7f566c0b3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.053+0000 7f566aa00640 1 -- 172.21.15.114:0/2011345787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566c1f30d0 con 0x7f5650004d10 2024-09-13T17:54:12.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.053+0000 7f566b400640 1 --2- 172.21.15.114:0/2011345787 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f566c0cee40 0x7f566c0b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:54:12.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.053+0000 7f5662000640 1 --2- 172.21.15.114:0/2011345787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f566c15a330 0x7f566c0b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:54:12.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.057+0000 7f566aa00640 1 --2- 172.21.15.114:0/2011345787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5650004d10 0x7f566c1f24e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f565c004ea0 tx=0x7f565c004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:12.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.057+0000 7f5663400640 1 -- 172.21.15.114:0/2011345787 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c00f710 con 0x7f5650004d10 2024-09-13T17:54:12.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.057+0000 7f5663400640 1 -- 172.21.15.114:0/2011345787 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565c00f870 con 0x7f5650004d10 2024-09-13T17:54:12.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.057+0000 7f5671a00640 1 -- 172.21.15.114:0/2011345787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f566c1f33b0 con 0x7f5650004d10 2024-09-13T17:54:12.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.057+0000 7f5663400640 1 -- 172.21.15.114:0/2011345787 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c00fc00 con 0x7f5650004d10 2024-09-13T17:54:12.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.057+0000 7f5671a00640 1 -- 172.21.15.114:0/2011345787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f566c0b38a0 con 0x7f5650004d10 2024-09-13T17:54:12.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.057+0000 7f5671a00640 1 -- 172.21.15.114:0/2011345787 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f566c0ce870 con 0x7f5650004d10 2024-09-13T17:54:12.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.057+0000 7f5663400640 1 -- 172.21.15.114:0/2011345787 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f565c00fd60 con 0x7f5650004d10 2024-09-13T17:54:12.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.057+0000 7f5663400640 1 --2- 172.21.15.114:0/2011345787 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f56480666c0 0x7f5648068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.057+0000 7f5663400640 1 -- 172.21.15.114:0/2011345787 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f565c084b20 con 0x7f5650004d10 2024-09-13T17:54:12.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.057+0000 7f5662000640 1 --2- 172.21.15.114:0/2011345787 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f56480666c0 0x7f5648068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.057+0000 7f5663400640 1 --2- 172.21.15.114:0/2011345787 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x7f564806ca60 0x7f564806eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.057+0000 7f5663400640 1 -- 172.21.15.114:0/2011345787 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f564806f570 con 0x7f564806ca60 2024-09-13T17:54:12.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.057+0000 7f5663400640 1 -- 172.21.15.114:0/2011345787 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f565c084e90 con 0x7f5650004d10 2024-09-13T17:54:12.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.057+0000 7f566b400640 1 --2- 172.21.15.114:0/2011345787 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x7f564806ca60 0x7f564806eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.057+0000 7f5662000640 1 --2- 172.21.15.114:0/2011345787 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f56480666c0 0x7f5648068b80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f566c159f10 tx=0x7f5654009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:12.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.061+0000 7f566b400640 1 --2- 172.21.15.114:0/2011345787 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x7f564806ca60 0x7f564806eea0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:12.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.061+0000 7f5663400640 1 -- 172.21.15.114:0/2011345787 <== osd.5 v2:172.21.15.134:6800/3340754489 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f564806f570 con 0x7f564806ca60 2024-09-13T17:54:12.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.073+0000 7f5671a00640 1 -- 172.21.15.114:0/2011345787 --> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f566c158950 con 0x7f564806ca60 2024-09-13T17:54:12.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.073+0000 7f5663400640 1 -- 172.21.15.114:0/2011345787 <== osd.5 v2:172.21.15.134:6800/3340754489 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5664003ac0 con 0x7f564806ca60 2024-09-13T17:54:12.081 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-13T17:54:12.081 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:54:12.081 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-13T17:54:12.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.073+0000 7f5671a00640 1 -- 172.21.15.114:0/2011345787 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x7f564806ca60 msgr2=0x7f564806eea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:12.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.073+0000 7f5671a00640 1 --2- 172.21.15.114:0/2011345787 >> [v2:172.21.15.134:6800/3340754489,v1:172.21.15.134:6801/3340754489] conn(0x7f564806ca60 0x7f564806eea0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.073+0000 7f5671a00640 1 -- 172.21.15.114:0/2011345787 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f56480666c0 msgr2=0x7f5648068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:12.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.073+0000 7f5671a00640 1 --2- 172.21.15.114:0/2011345787 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f56480666c0 0x7f5648068b80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f566c159f10 tx=0x7f5654009040 comp rx=0 tx=0).stop 2024-09-13T17:54:12.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.073+0000 7f5671a00640 1 -- 172.21.15.114:0/2011345787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5650004d10 msgr2=0x7f566c1f24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:12.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.073+0000 7f5671a00640 1 --2- 172.21.15.114:0/2011345787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5650004d10 0x7f566c1f24e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f565c004ea0 tx=0x7f565c004f90 comp rx=0 tx=0).stop 2024-09-13T17:54:12.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.073+0000 7f566b400640 1 -- 172.21.15.114:0/2011345787 reap_dead start 2024-09-13T17:54:12.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.073+0000 7f5671a00640 1 -- 172.21.15.114:0/2011345787 shutdown_connections 2024-09-13T17:54:12.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.073+0000 7f5671a00640 1 -- 172.21.15.114:0/2011345787 >> 172.21.15.114:0/2011345787 conn(0x7f566c0d04d0 msgr2=0x7f566c0af580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:12.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.073+0000 7f5671a00640 1 -- 172.21.15.114:0/2011345787 shutdown_connections 2024-09-13T17:54:12.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.073+0000 7f5671a00640 1 -- 172.21.15.114:0/2011345787 wait complete. 2024-09-13T17:54:12.100 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-13T17:54:12.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.229+0000 7f180be00640 1 Processor -- start 2024-09-13T17:54:12.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.229+0000 7f180be00640 1 -- start start 2024-09-13T17:54:12.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.229+0000 7f180be00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f18040cae20 0x7f18040cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.229+0000 7f180be00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18040b28c0 0x7f18040b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.229+0000 7f180be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1804159990 0x7f1804159e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.229+0000 7f180be00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18040b33f0 con 0x7f1804159990 2024-09-13T17:54:12.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.229+0000 7f180be00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f180415d020 con 0x7f18040cae20 2024-09-13T17:54:12.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.229+0000 7f180be00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180415d300 con 0x7f18040b28c0 2024-09-13T17:54:12.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.233+0000 7f1809e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1804159990 0x7f1804159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.233+0000 7f1809e00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1804159990 0x7f1804159e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50188/0 (socket says 172.21.15.114:50188) 2024-09-13T17:54:12.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.233+0000 7f1809e00640 1 -- 172.21.15.114:0/2128348027 learned_addr learned my addr 172.21.15.114:0/2128348027 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:12.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.233+0000 7f1808a00640 1 --2- 172.21.15.114:0/2128348027 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18040b28c0 0x7f18040b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.233+0000 7f1809400640 1 --2- 172.21.15.114:0/2128348027 >> v2:172.21.15.134:3300/0 conn(0x7f18040cae20 0x7f18040cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.233+0000 7f1809e00640 1 -- 172.21.15.114:0/2128348027 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18040b28c0 msgr2=0x7f18040b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:12.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.233+0000 7f1809e00640 1 --2- 172.21.15.114:0/2128348027 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18040b28c0 0x7f18040b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.233+0000 7f1809e00640 1 -- 172.21.15.114:0/2128348027 >> v2:172.21.15.134:3300/0 conn(0x7f18040cae20 msgr2=0x7f18040cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:12.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.233+0000 7f1809e00640 1 --2- 172.21.15.114:0/2128348027 >> v2:172.21.15.134:3300/0 conn(0x7f18040cae20 0x7f18040cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.233+0000 7f1809e00640 1 -- 172.21.15.114:0/2128348027 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180415d5e0 con 0x7f1804159990 2024-09-13T17:54:12.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.233+0000 7f1809e00640 1 --2- 172.21.15.114:0/2128348027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1804159990 0x7f1804159e00 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f180406b010 tx=0x7f17fc01c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d20bdd9cc9d8ce54 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:12.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.233+0000 7f1803e00640 1 -- 172.21.15.114:0/2128348027 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc0a5720 con 0x7f1804159990 2024-09-13T17:54:12.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.233+0000 7f1803e00640 1 -- 172.21.15.114:0/2128348027 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17fc0a5880 con 0x7f1804159990 2024-09-13T17:54:12.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.233+0000 7f1803e00640 1 -- 172.21.15.114:0/2128348027 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc0a5c10 con 0x7f1804159990 2024-09-13T17:54:12.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.237+0000 7f180be00640 1 -- 172.21.15.114:0/2128348027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1804159990 msgr2=0x7f1804159e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:12.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.237+0000 7f180be00640 1 --2- 172.21.15.114:0/2128348027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1804159990 0x7f1804159e00 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f180406b010 tx=0x7f17fc01c990 comp rx=0 tx=0).stop 2024-09-13T17:54:12.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.237+0000 7f180be00640 1 -- 172.21.15.114:0/2128348027 shutdown_connections 2024-09-13T17:54:12.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.237+0000 7f180be00640 1 --2- 172.21.15.114:0/2128348027 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1804159990 0x7f1804159e00 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.237+0000 7f180be00640 1 --2- 172.21.15.114:0/2128348027 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18040b28c0 0x7f18040b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.237+0000 7f180be00640 1 --2- 172.21.15.114:0/2128348027 >> v2:172.21.15.134:3300/0 conn(0x7f18040cae20 0x7f18040cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.237+0000 7f180be00640 1 -- 172.21.15.114:0/2128348027 >> 172.21.15.114:0/2128348027 conn(0x7f18040b01a0 msgr2=0x7f18040b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:12.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.237+0000 7f180be00640 1 -- 172.21.15.114:0/2128348027 shutdown_connections 2024-09-13T17:54:12.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.237+0000 7f180be00640 1 -- 172.21.15.114:0/2128348027 wait complete. 2024-09-13T17:54:12.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.237+0000 7f180be00640 1 Processor -- start 2024-09-13T17:54:12.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.237+0000 7f180be00640 1 -- start start 2024-09-13T17:54:12.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.237+0000 7f180be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18040b28c0 0x7f18041534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.237+0000 7f180be00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18040cae20 0x7f18041492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.237+0000 7f180be00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1804159990 0x7f18041f5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.237+0000 7f180be00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1804149800 con 0x7f18040b28c0 2024-09-13T17:54:12.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.237+0000 7f180be00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18041f5ce0 con 0x7f1804159990 2024-09-13T17:54:12.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.237+0000 7f180be00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18041f5fc0 con 0x7f18040cae20 2024-09-13T17:54:12.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.237+0000 7f1809400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18040b28c0 0x7f18041534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.237+0000 7f1809400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18040b28c0 0x7f18041534e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50198/0 (socket says 172.21.15.114:50198) 2024-09-13T17:54:12.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.237+0000 7f1809400640 1 -- 172.21.15.114:0/1580529371 learned_addr learned my addr 172.21.15.114:0/1580529371 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:12.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.237+0000 7f1809e00640 1 --2- 172.21.15.114:0/1580529371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1804159990 0x7f18041f5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.237+0000 7f1808a00640 1 --2- 172.21.15.114:0/1580529371 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18040cae20 0x7f18041492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.237+0000 7f1809400640 1 -- 172.21.15.114:0/1580529371 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18040cae20 msgr2=0x7f18041492c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:12.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.237+0000 7f1809400640 1 --2- 172.21.15.114:0/1580529371 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18040cae20 0x7f18041492c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.237+0000 7f1809400640 1 -- 172.21.15.114:0/1580529371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1804159990 msgr2=0x7f18041f5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:12.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.237+0000 7f1809400640 1 --2- 172.21.15.114:0/1580529371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1804159990 0x7f18041f5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.237+0000 7f1809400640 1 -- 172.21.15.114:0/1580529371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17fc009b30 con 0x7f18040b28c0 2024-09-13T17:54:12.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.237+0000 7f1809e00640 1 --2- 172.21.15.114:0/1580529371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1804159990 0x7f18041f5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:54:12.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.241+0000 7f1809400640 1 --2- 172.21.15.114:0/1580529371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18040b28c0 0x7f18041534e0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f17f800d800 tx=0x7f17f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:12.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.241+0000 7f1801600640 1 -- 172.21.15.114:0/1580529371 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f800b6c0 con 0x7f18040b28c0 2024-09-13T17:54:12.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.241+0000 7f1801600640 1 -- 172.21.15.114:0/1580529371 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f800b820 con 0x7f18040b28c0 2024-09-13T17:54:12.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.241+0000 7f1801600640 1 -- 172.21.15.114:0/1580529371 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f800bb90 con 0x7f18040b28c0 2024-09-13T17:54:12.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.241+0000 7f180be00640 1 -- 172.21.15.114:0/1580529371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18041f62a0 con 0x7f18040b28c0 2024-09-13T17:54:12.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.241+0000 7f180be00640 1 -- 172.21.15.114:0/1580529371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180414bf30 con 0x7f18040b28c0 2024-09-13T17:54:12.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.241+0000 7f180be00640 1 -- 172.21.15.114:0/1580529371 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f180414c0c0 con 0x7f18040b28c0 2024-09-13T17:54:12.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.241+0000 7f1801600640 1 -- 172.21.15.114:0/1580529371 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f17f800bcf0 con 0x7f18040b28c0 2024-09-13T17:54:12.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.241+0000 7f1801600640 1 --2- 172.21.15.114:0/1580529371 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f17e4066690 0x7f17e4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.241+0000 7f1801600640 1 -- 172.21.15.114:0/1580529371 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f17f80845c0 con 0x7f18040b28c0 2024-09-13T17:54:12.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.241+0000 7f1808a00640 1 --2- 172.21.15.114:0/1580529371 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f17e4066690 0x7f17e4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.241+0000 7f1808a00640 1 --2- 172.21.15.114:0/1580529371 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f17e4066690 0x7f17e4068b50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f17f000ba30 tx=0x7f17f0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:12.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.249+0000 7f1801600640 1 -- 172.21.15.114:0/1580529371 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f17f8051a90 con 0x7f18040b28c0 2024-09-13T17:54:12.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.405+0000 7f180be00640 1 -- 172.21.15.114:0/1580529371 --> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f180406cbc0 con 0x7f17e4066690 2024-09-13T17:54:12.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.405+0000 7f1801600640 1 -- 172.21.15.114:0/1580529371 <== mgr.4102 v2:172.21.15.114:6832/137691478 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f17f000b620 con 0x7f17e4066690 2024-09-13T17:54:12.407 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 5 to deep-scrub 2024-09-13T17:54:12.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.405+0000 7f180be00640 1 -- 172.21.15.114:0/1580529371 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f17e4066690 msgr2=0x7f17e4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:12.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.405+0000 7f180be00640 1 --2- 172.21.15.114:0/1580529371 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f17e4066690 0x7f17e4068b50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f17f000ba30 tx=0x7f17f0008040 comp rx=0 tx=0).stop 2024-09-13T17:54:12.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.405+0000 7f180be00640 1 -- 172.21.15.114:0/1580529371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18040b28c0 msgr2=0x7f18041534e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:12.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.405+0000 7f180be00640 1 --2- 172.21.15.114:0/1580529371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18040b28c0 0x7f18041534e0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f17f800d800 tx=0x7f17f800dcc0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.405+0000 7f180be00640 1 -- 172.21.15.114:0/1580529371 shutdown_connections 2024-09-13T17:54:12.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.405+0000 7f180be00640 1 --2- 172.21.15.114:0/1580529371 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f17e4066690 0x7f17e4068b50 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.405+0000 7f180be00640 1 --2- 172.21.15.114:0/1580529371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1804159990 0x7f18041f5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.405+0000 7f180be00640 1 --2- 172.21.15.114:0/1580529371 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f18040cae20 0x7f18041492c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.405+0000 7f180be00640 1 --2- 172.21.15.114:0/1580529371 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18040b28c0 0x7f18041534e0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.405+0000 7f180be00640 1 -- 172.21.15.114:0/1580529371 >> 172.21.15.114:0/1580529371 conn(0x7f18040b01a0 msgr2=0x7f1804159130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:12.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.405+0000 7f180be00640 1 -- 172.21.15.114:0/1580529371 shutdown_connections 2024-09-13T17:54:12.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.405+0000 7f180be00640 1 -- 172.21.15.114:0/1580529371 wait complete. 2024-09-13T17:54:12.428 INFO:tasks.ceph:Scrubbing osd.6 2024-09-13T17:54:12.428 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:54:12.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.565+0000 7f142be00640 1 Processor -- start 2024-09-13T17:54:12.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.565+0000 7f142be00640 1 -- start start 2024-09-13T17:54:12.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.565+0000 7f142be00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f142c15c360 0x7f142c0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.565+0000 7f142be00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f142c098a70 0x7f142c069f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.565+0000 7f142be00640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f142c0b28c0 con 0x7f142c15c740 2024-09-13T17:54:12.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.565+0000 7f142be00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f142c0b2320 con 0x7f142c15c360 2024-09-13T17:54:12.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.565+0000 7f142be00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f142c0b0450 con 0x7f142c098a70 2024-09-13T17:54:12.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.565+0000 7f142aa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f142c15c360 0x7f142c0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.565+0000 7f142aa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f142c15c360 0x7f142c0b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50202/0 (socket says 172.21.15.114:50202) 2024-09-13T17:54:12.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.565+0000 7f142aa00640 1 -- 172.21.15.114:0/2864776747 learned_addr learned my addr 172.21.15.114:0/2864776747 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:12.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.565+0000 7f142a000640 1 --2- 172.21.15.114:0/2864776747 >> v2:172.21.15.134:3300/0 conn(0x7f142c098a70 0x7f142c069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.565+0000 7f142aa00640 1 -- 172.21.15.114:0/2864776747 >> v2:172.21.15.134:3300/0 conn(0x7f142c098a70 msgr2=0x7f142c069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:12.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.565+0000 7f142aa00640 1 --2- 172.21.15.114:0/2864776747 >> v2:172.21.15.134:3300/0 conn(0x7f142c098a70 0x7f142c069f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.565+0000 7f142aa00640 1 -- 172.21.15.114:0/2864776747 >> v1:172.21.15.134:6789/0 conn(0x7f142c15c740 legacy=0x7f142c0cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:12.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.565+0000 7f142aa00640 1 -- 172.21.15.114:0/2864776747 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142c0b25e0 con 0x7f142c15c360 2024-09-13T17:54:12.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.569+0000 7f142aa00640 1 --2- 172.21.15.114:0/2864776747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f142c15c360 0x7f142c0b0950 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f142c0d02f0 tx=0x7f141c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af7a79dc65d90d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:12.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.569+0000 7f1429600640 1 -- 172.21.15.114:0/2864776747 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c0ab600 con 0x7f142c15c360 2024-09-13T17:54:12.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.569+0000 7f1429600640 1 -- 172.21.15.114:0/2864776747 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141c0a7050 con 0x7f142c15c360 2024-09-13T17:54:12.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.569+0000 7f1429600640 1 -- 172.21.15.114:0/2864776747 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c0ab980 con 0x7f142c15c360 2024-09-13T17:54:12.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.569+0000 7f142be00640 1 -- 172.21.15.114:0/2864776747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f142c15c360 msgr2=0x7f142c0b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:12.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.569+0000 7f142be00640 1 --2- 172.21.15.114:0/2864776747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f142c15c360 0x7f142c0b0950 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f142c0d02f0 tx=0x7f141c01c430 comp rx=0 tx=0).stop 2024-09-13T17:54:12.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.569+0000 7f142be00640 1 -- 172.21.15.114:0/2864776747 shutdown_connections 2024-09-13T17:54:12.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.569+0000 7f142be00640 1 --2- 172.21.15.114:0/2864776747 >> v2:172.21.15.134:3300/0 conn(0x7f142c098a70 0x7f142c069f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.569+0000 7f142be00640 1 --2- 172.21.15.114:0/2864776747 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f142c15c360 0x7f142c0b0950 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.569+0000 7f142be00640 1 -- 172.21.15.114:0/2864776747 >> 172.21.15.114:0/2864776747 conn(0x7f142c0b48e0 msgr2=0x7f142c0b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.569+0000 7f142be00640 1 -- 172.21.15.114:0/2864776747 shutdown_connections 2024-09-13T17:54:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.569+0000 7f142be00640 1 -- 172.21.15.114:0/2864776747 wait complete. 2024-09-13T17:54:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.573+0000 7f142be00640 1 Processor -- start 2024-09-13T17:54:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.573+0000 7f142be00640 1 -- start start 2024-09-13T17:54:12.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.573+0000 7f142be00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f142c098a70 0x7f142c14d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.573+0000 7f142be00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f142c15c360 0x7f142c14bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.573+0000 7f142be00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f142c15c740 0x7f142c151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.573+0000 7f142be00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142c14c2c0 con 0x7f142c098a70 2024-09-13T17:54:12.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.573+0000 7f142be00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142c0ca530 con 0x7f142c15c740 2024-09-13T17:54:12.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.573+0000 7f142be00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142c14de20 con 0x7f142c15c360 2024-09-13T17:54:12.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.573+0000 7f142aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f142c098a70 0x7f142c14d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.573+0000 7f142aa00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f142c098a70 0x7f142c14d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50204/0 (socket says 172.21.15.114:50204) 2024-09-13T17:54:12.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.573+0000 7f142aa00640 1 -- 172.21.15.114:0/1335983182 learned_addr learned my addr 172.21.15.114:0/1335983182 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:12.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.573+0000 7f142a000640 1 --2- 172.21.15.114:0/1335983182 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f142c15c360 0x7f142c14bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.573+0000 7f142b400640 1 --2- 172.21.15.114:0/1335983182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f142c15c740 0x7f142c151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.573+0000 7f142aa00640 1 -- 172.21.15.114:0/1335983182 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f142c15c360 msgr2=0x7f142c14bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:12.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.573+0000 7f142aa00640 1 --2- 172.21.15.114:0/1335983182 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f142c15c360 0x7f142c14bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.573+0000 7f142aa00640 1 -- 172.21.15.114:0/1335983182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f142c15c740 msgr2=0x7f142c151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:12.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.573+0000 7f142aa00640 1 --2- 172.21.15.114:0/1335983182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f142c15c740 0x7f142c151cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.573+0000 7f142aa00640 1 -- 172.21.15.114:0/1335983182 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c0094d0 con 0x7f142c098a70 2024-09-13T17:54:12.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.573+0000 7f142a000640 1 --2- 172.21.15.114:0/1335983182 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f142c15c360 0x7f142c14bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:54:12.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.573+0000 7f142aa00640 1 --2- 172.21.15.114:0/1335983182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f142c098a70 0x7f142c14d720 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f141c01a060 tx=0x7f141c0191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:12.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.573+0000 7f1422a00640 1 -- 172.21.15.114:0/1335983182 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c0b35d0 con 0x7f142c098a70 2024-09-13T17:54:12.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.573+0000 7f1422a00640 1 -- 172.21.15.114:0/1335983182 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141c0b3730 con 0x7f142c098a70 2024-09-13T17:54:12.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.573+0000 7f1422a00640 1 -- 172.21.15.114:0/1335983182 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c0b3aa0 con 0x7f142c098a70 2024-09-13T17:54:12.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.573+0000 7f142be00640 1 -- 172.21.15.114:0/1335983182 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f142c14e100 con 0x7f142c098a70 2024-09-13T17:54:12.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.573+0000 7f142be00640 1 -- 172.21.15.114:0/1335983182 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142c14e6c0 con 0x7f142c098a70 2024-09-13T17:54:12.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.573+0000 7f142be00640 1 -- 172.21.15.114:0/1335983182 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f142c069f80 con 0x7f142c098a70 2024-09-13T17:54:12.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.573+0000 7f1422a00640 1 -- 172.21.15.114:0/1335983182 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f141c0b2070 con 0x7f142c098a70 2024-09-13T17:54:12.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.577+0000 7f1422a00640 1 --2- 172.21.15.114:0/1335983182 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f140c066690 0x7f140c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.577+0000 7f1422a00640 1 -- 172.21.15.114:0/1335983182 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f141c11e090 con 0x7f142c098a70 2024-09-13T17:54:12.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.577+0000 7f142a000640 1 --2- 172.21.15.114:0/1335983182 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f140c066690 0x7f140c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.577+0000 7f1422a00640 1 --2- 172.21.15.114:0/1335983182 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x7f140c06ca30 0x7f140c06ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.577+0000 7f1422a00640 1 -- 172.21.15.114:0/1335983182 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f140c06f540 con 0x7f140c06ca30 2024-09-13T17:54:12.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.577+0000 7f1422a00640 1 -- 172.21.15.114:0/1335983182 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f141c120670 con 0x7f142c098a70 2024-09-13T17:54:12.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.577+0000 7f142b400640 1 --2- 172.21.15.114:0/1335983182 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x7f140c06ca30 0x7f140c06ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.577+0000 7f142a000640 1 --2- 172.21.15.114:0/1335983182 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f140c066690 0x7f140c068b50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f142c06a2f0 tx=0x7f1418008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:12.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.577+0000 7f142b400640 1 --2- 172.21.15.114:0/1335983182 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x7f140c06ca30 0x7f140c06ee70 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:12.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.577+0000 7f1422a00640 1 -- 172.21.15.114:0/1335983182 <== osd.6 v2:172.21.15.134:6824/1813072387 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f140c06f540 con 0x7f140c06ca30 2024-09-13T17:54:12.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.589+0000 7f142be00640 1 -- 172.21.15.114:0/1335983182 --> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f142c15ddc0 con 0x7f140c06ca30 2024-09-13T17:54:12.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.593+0000 7f1422a00640 1 -- 172.21.15.114:0/1335983182 <== osd.6 v2:172.21.15.134:6824/1813072387 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f142c15ddc0 con 0x7f140c06ca30 2024-09-13T17:54:12.594 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-13T17:54:12.594 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:54:12.594 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-13T17:54:12.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.593+0000 7f142be00640 1 -- 172.21.15.114:0/1335983182 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x7f140c06ca30 msgr2=0x7f140c06ee70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:12.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.593+0000 7f142be00640 1 --2- 172.21.15.114:0/1335983182 >> [v2:172.21.15.134:6824/1813072387,v1:172.21.15.134:6825/1813072387] conn(0x7f140c06ca30 0x7f140c06ee70 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.593+0000 7f142be00640 1 -- 172.21.15.114:0/1335983182 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f140c066690 msgr2=0x7f140c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:12.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.593+0000 7f142be00640 1 --2- 172.21.15.114:0/1335983182 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f140c066690 0x7f140c068b50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f142c06a2f0 tx=0x7f1418008040 comp rx=0 tx=0).stop 2024-09-13T17:54:12.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.593+0000 7f142be00640 1 -- 172.21.15.114:0/1335983182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f142c098a70 msgr2=0x7f142c14d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:12.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.593+0000 7f142be00640 1 --2- 172.21.15.114:0/1335983182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f142c098a70 0x7f142c14d720 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f141c01a060 tx=0x7f141c0191d0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.593+0000 7f142b400640 1 -- 172.21.15.114:0/1335983182 reap_dead start 2024-09-13T17:54:12.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.593+0000 7f142be00640 1 -- 172.21.15.114:0/1335983182 shutdown_connections 2024-09-13T17:54:12.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.593+0000 7f142be00640 1 -- 172.21.15.114:0/1335983182 >> 172.21.15.114:0/1335983182 conn(0x7f142c0b48e0 msgr2=0x7f142c0ccae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:12.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.593+0000 7f142be00640 1 -- 172.21.15.114:0/1335983182 shutdown_connections 2024-09-13T17:54:12.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.593+0000 7f142be00640 1 -- 172.21.15.114:0/1335983182 wait complete. 2024-09-13T17:54:12.612 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-13T17:54:12.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.749+0000 7f72ad600640 1 Processor -- start 2024-09-13T17:54:12.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.749+0000 7f72ad600640 1 -- start start 2024-09-13T17:54:12.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.749+0000 7f72ad600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f72a8070380 0x7f72a806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.749+0000 7f72ad600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f72a80ce500 0x7f72a80ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.749+0000 7f72ad600640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a8099160 con 0x7f72a815dd60 2024-09-13T17:54:12.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.749+0000 7f72ad600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72a80cee50 con 0x7f72a80ce500 2024-09-13T17:54:12.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.749+0000 7f72ad600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72a815ef90 con 0x7f72a8070380 2024-09-13T17:54:12.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.749+0000 7f72a6a00640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f72a815dd60 0x7f72a80caf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44972/0 (socket says 172.21.15.114:44972) 2024-09-13T17:54:12.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.749+0000 7f72a6a00640 1 -- 172.21.15.114:0/3599288492 learned_addr learned my addr 172.21.15.114:0/3599288492 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:54:12.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.749+0000 7f72a7400640 1 --2- 172.21.15.114:0/3599288492 >> v2:172.21.15.114:3300/0 conn(0x7f72a80ce500 0x7f72a80ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.749+0000 7f72a6000640 1 --2- 172.21.15.114:0/3599288492 >> v2:172.21.15.134:3300/0 conn(0x7f72a8070380 0x7f72a806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.749+0000 7f72a5600640 1 -- 172.21.15.114:0/3599288492 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2086526137 0 0) 0x7f72a8099160 con 0x7f72a815dd60 2024-09-13T17:54:12.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.749+0000 7f72a5600640 1 -- 172.21.15.114:0/3599288492 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f728c003530 con 0x7f72a815dd60 2024-09-13T17:54:12.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.749+0000 7f72a7400640 1 -- 172.21.15.114:0/3599288492 >> v2:172.21.15.134:3300/0 conn(0x7f72a8070380 msgr2=0x7f72a806f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:12.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.749+0000 7f72a7400640 1 --2- 172.21.15.114:0/3599288492 >> v2:172.21.15.134:3300/0 conn(0x7f72a8070380 0x7f72a806f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.749+0000 7f72a7400640 1 -- 172.21.15.114:0/3599288492 >> v1:172.21.15.114:6789/0 conn(0x7f72a815dd60 legacy=0x7f72a80caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:12.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.749+0000 7f72a7400640 1 -- 172.21.15.114:0/3599288492 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a815e140 con 0x7f72a80ce500 2024-09-13T17:54:12.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.753+0000 7f72a7400640 1 --2- 172.21.15.114:0/3599288492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72a80ce500 0x7f72a80ce910 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f72a806a900 tx=0x7f72a001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ec934245c0b296 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:12.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.753+0000 7f72a5600640 1 -- 172.21.15.114:0/3599288492 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a00a59e0 con 0x7f72a80ce500 2024-09-13T17:54:12.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.753+0000 7f72a5600640 1 -- 172.21.15.114:0/3599288492 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a00a5b40 con 0x7f72a80ce500 2024-09-13T17:54:12.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.753+0000 7f72a5600640 1 -- 172.21.15.114:0/3599288492 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a00ad440 con 0x7f72a80ce500 2024-09-13T17:54:12.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.753+0000 7f72ad600640 1 -- 172.21.15.114:0/3599288492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72a80ce500 msgr2=0x7f72a80ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:12.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.753+0000 7f72ad600640 1 --2- 172.21.15.114:0/3599288492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72a80ce500 0x7f72a80ce910 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f72a806a900 tx=0x7f72a001c900 comp rx=0 tx=0).stop 2024-09-13T17:54:12.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.753+0000 7f72ad600640 1 -- 172.21.15.114:0/3599288492 shutdown_connections 2024-09-13T17:54:12.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.753+0000 7f72ad600640 1 --2- 172.21.15.114:0/3599288492 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72a80ce500 0x7f72a80ce910 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.753+0000 7f72ad600640 1 --2- 172.21.15.114:0/3599288492 >> v2:172.21.15.134:3300/0 conn(0x7f72a8070380 0x7f72a806f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.753+0000 7f72ad600640 1 -- 172.21.15.114:0/3599288492 >> 172.21.15.114:0/3599288492 conn(0x7f72a80d0570 msgr2=0x7f72a80d0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:12.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.753+0000 7f72ad600640 1 -- 172.21.15.114:0/3599288492 shutdown_connections 2024-09-13T17:54:12.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.753+0000 7f72ad600640 1 -- 172.21.15.114:0/3599288492 wait complete. 2024-09-13T17:54:12.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.757+0000 7f72ad600640 1 Processor -- start 2024-09-13T17:54:12.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.757+0000 7f72ad600640 1 -- start start 2024-09-13T17:54:12.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.757+0000 7f72ad600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72a8070380 0x7f72a806cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.757+0000 7f72ad600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72a80ce500 0x7f72a80b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.757+0000 7f72ad600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72a815dd60 0x7f72a8163af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.757+0000 7f72ad600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a80b5f20 con 0x7f72a815dd60 2024-09-13T17:54:12.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.757+0000 7f72ad600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a8155b10 con 0x7f72a80ce500 2024-09-13T17:54:12.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.757+0000 7f72ad600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a80ad6d0 con 0x7f72a8070380 2024-09-13T17:54:12.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.757+0000 7f72a7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72a815dd60 0x7f72a8163af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.757+0000 7f72a7400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72a815dd60 0x7f72a8163af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50218/0 (socket says 172.21.15.114:50218) 2024-09-13T17:54:12.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.757+0000 7f72a7400640 1 -- 172.21.15.114:0/2918165567 learned_addr learned my addr 172.21.15.114:0/2918165567 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:12.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.757+0000 7f72a6000640 1 --2- 172.21.15.114:0/2918165567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72a80ce500 0x7f72a80b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.757+0000 7f72a6a00640 1 --2- 172.21.15.114:0/2918165567 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72a8070380 0x7f72a806cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.761+0000 7f72a7400640 1 -- 172.21.15.114:0/2918165567 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72a8070380 msgr2=0x7f72a806cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:12.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.761+0000 7f72a7400640 1 --2- 172.21.15.114:0/2918165567 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72a8070380 0x7f72a806cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.761+0000 7f72a7400640 1 -- 172.21.15.114:0/2918165567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72a80ce500 msgr2=0x7f72a80b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:12.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.761+0000 7f72a7400640 1 --2- 172.21.15.114:0/2918165567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72a80ce500 0x7f72a80b59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.761+0000 7f72a7400640 1 -- 172.21.15.114:0/2918165567 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a0009a70 con 0x7f72a815dd60 2024-09-13T17:54:12.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.761+0000 7f72a6a00640 1 --2- 172.21.15.114:0/2918165567 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72a8070380 0x7f72a806cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:54:12.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.761+0000 7f72a7400640 1 --2- 172.21.15.114:0/2918165567 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72a815dd60 0x7f72a8163af0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f72a00b0040 tx=0x7f72a00196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:12.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.761+0000 7f729ea00640 1 -- 172.21.15.114:0/2918165567 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a00adcc0 con 0x7f72a815dd60 2024-09-13T17:54:12.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.761+0000 7f729ea00640 1 -- 172.21.15.114:0/2918165567 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a00ade20 con 0x7f72a815dd60 2024-09-13T17:54:12.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.761+0000 7f72ad600640 1 -- 172.21.15.114:0/2918165567 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a80ad9b0 con 0x7f72a815dd60 2024-09-13T17:54:12.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.761+0000 7f729ea00640 1 -- 172.21.15.114:0/2918165567 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a00b9690 con 0x7f72a815dd60 2024-09-13T17:54:12.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.761+0000 7f72ad600640 1 -- 172.21.15.114:0/2918165567 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a8155d60 con 0x7f72a815dd60 2024-09-13T17:54:12.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.761+0000 7f72ad600640 1 -- 172.21.15.114:0/2918165567 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72a80673b0 con 0x7f72a815dd60 2024-09-13T17:54:12.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.761+0000 7f729ea00640 1 -- 172.21.15.114:0/2918165567 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f72a00b97f0 con 0x7f72a815dd60 2024-09-13T17:54:12.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.765+0000 7f729ea00640 1 --2- 172.21.15.114:0/2918165567 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7288066690 0x7f7288068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:12.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.765+0000 7f729ea00640 1 -- 172.21.15.114:0/2918165567 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f72a011f480 con 0x7f72a815dd60 2024-09-13T17:54:12.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.765+0000 7f72a6a00640 1 --2- 172.21.15.114:0/2918165567 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7288066690 0x7f7288068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:12.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.765+0000 7f72a6a00640 1 --2- 172.21.15.114:0/2918165567 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7288066690 0x7f7288068b50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f72980011f0 tx=0x7f7298009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:12.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.769+0000 7f729ea00640 1 -- 172.21.15.114:0/2918165567 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f72a00ec9e0 con 0x7f72a815dd60 2024-09-13T17:54:12.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.925+0000 7f72ad600640 1 -- 172.21.15.114:0/2918165567 --> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f72a80cf2d0 con 0x7f7288066690 2024-09-13T17:54:12.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.925+0000 7f729ea00640 1 -- 172.21.15.114:0/2918165567 <== mgr.4102 v2:172.21.15.114:6832/137691478 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7298001480 con 0x7f7288066690 2024-09-13T17:54:12.928 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 6 to deep-scrub 2024-09-13T17:54:12.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.929+0000 7f72ad600640 1 -- 172.21.15.114:0/2918165567 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7288066690 msgr2=0x7f7288068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:12.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.929+0000 7f72ad600640 1 --2- 172.21.15.114:0/2918165567 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7288066690 0x7f7288068b50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f72980011f0 tx=0x7f7298009040 comp rx=0 tx=0).stop 2024-09-13T17:54:12.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.929+0000 7f72ad600640 1 -- 172.21.15.114:0/2918165567 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72a815dd60 msgr2=0x7f72a8163af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:12.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.929+0000 7f72ad600640 1 --2- 172.21.15.114:0/2918165567 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72a815dd60 0x7f72a8163af0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f72a00b0040 tx=0x7f72a00196a0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.929+0000 7f72ad600640 1 -- 172.21.15.114:0/2918165567 shutdown_connections 2024-09-13T17:54:12.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.929+0000 7f72ad600640 1 --2- 172.21.15.114:0/2918165567 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f7288066690 0x7f7288068b50 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.929+0000 7f72ad600640 1 --2- 172.21.15.114:0/2918165567 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72a815dd60 0x7f72a8163af0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.929+0000 7f72ad600640 1 --2- 172.21.15.114:0/2918165567 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72a80ce500 0x7f72a80b59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.929+0000 7f72ad600640 1 --2- 172.21.15.114:0/2918165567 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f72a8070380 0x7f72a806cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:12.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.929+0000 7f72ad600640 1 -- 172.21.15.114:0/2918165567 >> 172.21.15.114:0/2918165567 conn(0x7f72a80d0570 msgr2=0x7f72a80b1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:12.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.929+0000 7f72ad600640 1 -- 172.21.15.114:0/2918165567 shutdown_connections 2024-09-13T17:54:12.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:12.929+0000 7f72ad600640 1 -- 172.21.15.114:0/2918165567 wait complete. 2024-09-13T17:54:12.951 INFO:tasks.ceph:Scrubbing osd.7 2024-09-13T17:54:12.952 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-13T17:54:13.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.089+0000 7f90d1c00640 1 Processor -- start 2024-09-13T17:54:13.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.093+0000 7f90d1c00640 1 -- start start 2024-09-13T17:54:13.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.093+0000 7f90d1c00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f90cc15a4a0 0x7f90cc0ce230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:13.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.093+0000 7f90d1c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90cc0ce770 0x7f90cc0cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:13.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.093+0000 7f90d1c00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f90cc0b3aa0 0x7f90cc0b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:13.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.093+0000 7f90d1c00640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90cc099d70 con 0x7f90cc15a4a0 2024-09-13T17:54:13.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.093+0000 7f90d1c00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90cc0997b0 con 0x7f90cc0b3aa0 2024-09-13T17:54:13.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.093+0000 7f90d1c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc099a90 con 0x7f90cc0ce770 2024-09-13T17:54:13.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.093+0000 7f90cbe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f90cc15a4a0 0x7f90cc0ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:13.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.093+0000 7f90cbe00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f90cc15a4a0 0x7f90cc0ce230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50222/0 (socket says 172.21.15.114:50222) 2024-09-13T17:54:13.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.093+0000 7f90cbe00640 1 -- 172.21.15.114:0/3256352799 learned_addr learned my addr 172.21.15.114:0/3256352799 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:13.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.093+0000 7f90cb400640 1 --2- 172.21.15.114:0/3256352799 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90cc0ce770 0x7f90cc0cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:13.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.093+0000 7f90d1200640 1 --2- 172.21.15.114:0/3256352799 >> v2:172.21.15.134:3300/0 conn(0x7f90cc0b3aa0 0x7f90cc0b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:13.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.093+0000 7f90cbe00640 1 -- 172.21.15.114:0/3256352799 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90cc0ce770 msgr2=0x7f90cc0cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:13.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.093+0000 7f90cbe00640 1 --2- 172.21.15.114:0/3256352799 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90cc0ce770 0x7f90cc0cebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.093+0000 7f90cbe00640 1 -- 172.21.15.114:0/3256352799 >> v2:172.21.15.134:3300/0 conn(0x7f90cc0b3aa0 msgr2=0x7f90cc0b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:13.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.093+0000 7f90cbe00640 1 --2- 172.21.15.114:0/3256352799 >> v2:172.21.15.134:3300/0 conn(0x7f90cc0b3aa0 0x7f90cc0b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.093+0000 7f90cbe00640 1 -- 172.21.15.114:0/3256352799 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90cc0b32a0 con 0x7f90cc15a4a0 2024-09-13T17:54:13.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.097+0000 7f90cbe00640 1 --2- 172.21.15.114:0/3256352799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90cc15a4a0 0x7f90cc0ce230 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f90cc15e000 tx=0x7f90bc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8fa49404bd89d33 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:13.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.097+0000 7f90caa00640 1 -- 172.21.15.114:0/3256352799 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc0ab600 con 0x7f90cc15a4a0 2024-09-13T17:54:13.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.097+0000 7f90caa00640 1 -- 172.21.15.114:0/3256352799 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90bc0a7050 con 0x7f90cc15a4a0 2024-09-13T17:54:13.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.097+0000 7f90caa00640 1 -- 172.21.15.114:0/3256352799 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc0ab980 con 0x7f90cc15a4a0 2024-09-13T17:54:13.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.097+0000 7f90d1c00640 1 -- 172.21.15.114:0/3256352799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90cc15a4a0 msgr2=0x7f90cc0ce230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:13.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.097+0000 7f90d1c00640 1 --2- 172.21.15.114:0/3256352799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90cc15a4a0 0x7f90cc0ce230 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f90cc15e000 tx=0x7f90bc01c520 comp rx=0 tx=0).stop 2024-09-13T17:54:13.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.097+0000 7f90d1c00640 1 -- 172.21.15.114:0/3256352799 shutdown_connections 2024-09-13T17:54:13.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.097+0000 7f90d1c00640 1 --2- 172.21.15.114:0/3256352799 >> v2:172.21.15.134:3300/0 conn(0x7f90cc0b3aa0 0x7f90cc0b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.097+0000 7f90d1c00640 1 --2- 172.21.15.114:0/3256352799 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90cc0ce770 0x7f90cc0cebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.097+0000 7f90d1c00640 1 --2- 172.21.15.114:0/3256352799 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90cc15a4a0 0x7f90cc0ce230 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.097+0000 7f90d1c00640 1 -- 172.21.15.114:0/3256352799 >> 172.21.15.114:0/3256352799 conn(0x7f90cc0d0330 msgr2=0x7f90cc0d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:13.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.097+0000 7f90d1c00640 1 -- 172.21.15.114:0/3256352799 shutdown_connections 2024-09-13T17:54:13.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.097+0000 7f90d1c00640 1 -- 172.21.15.114:0/3256352799 wait complete. 2024-09-13T17:54:13.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.097+0000 7f90d1c00640 1 Processor -- start 2024-09-13T17:54:13.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.097+0000 7f90d1c00640 1 -- start start 2024-09-13T17:54:13.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.101+0000 7f90d1c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90cc0b3aa0 0x7f90cc1f80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:13.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.101+0000 7f90d1c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90cc0ce770 0x7f90cc1f5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:13.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.101+0000 7f90d1c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90cc15a4a0 0x7f90cc0c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:13.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.101+0000 7f90d1c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc142440 con 0x7f90cc0ce770 2024-09-13T17:54:13.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.101+0000 7f90d1c00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc1f5a70 con 0x7f90cc0b3aa0 2024-09-13T17:54:13.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.101+0000 7f90d1c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc0c71c0 con 0x7f90cc15a4a0 2024-09-13T17:54:13.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.101+0000 7f90cb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90cc0ce770 0x7f90cc1f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:13.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.101+0000 7f90cb400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90cc0ce770 0x7f90cc1f5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50232/0 (socket says 172.21.15.114:50232) 2024-09-13T17:54:13.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.101+0000 7f90cb400640 1 -- 172.21.15.114:0/3296416272 learned_addr learned my addr 172.21.15.114:0/3296416272 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:13.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.101+0000 7f90cbe00640 1 --2- 172.21.15.114:0/3296416272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90cc0b3aa0 0x7f90cc1f80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:13.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.101+0000 7f90d1200640 1 --2- 172.21.15.114:0/3296416272 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90cc15a4a0 0x7f90cc0c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:13.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.101+0000 7f90cb400640 1 -- 172.21.15.114:0/3296416272 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90cc15a4a0 msgr2=0x7f90cc0c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:13.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.101+0000 7f90cb400640 1 --2- 172.21.15.114:0/3296416272 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f90cc15a4a0 0x7f90cc0c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.101+0000 7f90cb400640 1 -- 172.21.15.114:0/3296416272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90cc0b3aa0 msgr2=0x7f90cc1f80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:13.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.101+0000 7f90cb400640 1 --2- 172.21.15.114:0/3296416272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90cc0b3aa0 0x7f90cc1f80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.101+0000 7f90cb400640 1 -- 172.21.15.114:0/3296416272 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90bc0094d0 con 0x7f90cc0ce770 2024-09-13T17:54:13.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.101+0000 7f90cb400640 1 --2- 172.21.15.114:0/3296416272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90cc0ce770 0x7f90cc1f5530 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f90b800d800 tx=0x7f90b800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:13.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.101+0000 7f90c3e00640 1 -- 172.21.15.114:0/3296416272 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b8018070 con 0x7f90cc0ce770 2024-09-13T17:54:13.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.101+0000 7f90c3e00640 1 -- 172.21.15.114:0/3296416272 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b8004020 con 0x7f90cc0ce770 2024-09-13T17:54:13.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.101+0000 7f90c3e00640 1 -- 172.21.15.114:0/3296416272 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b80041d0 con 0x7f90cc0ce770 2024-09-13T17:54:13.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.101+0000 7f90d1c00640 1 -- 172.21.15.114:0/3296416272 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90cc1f87f0 con 0x7f90cc0ce770 2024-09-13T17:54:13.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.101+0000 7f90d1c00640 1 -- 172.21.15.114:0/3296416272 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90cc1f8db0 con 0x7f90cc0ce770 2024-09-13T17:54:13.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.101+0000 7f90d1c00640 1 -- 172.21.15.114:0/3296416272 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f90cc0b4140 con 0x7f90cc0ce770 2024-09-13T17:54:13.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.101+0000 7f90c3e00640 1 -- 172.21.15.114:0/3296416272 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f90b8004330 con 0x7f90cc0ce770 2024-09-13T17:54:13.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.105+0000 7f90c3e00640 1 --2- 172.21.15.114:0/3296416272 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f90ac066690 0x7f90ac068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:13.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.105+0000 7f90c3e00640 1 -- 172.21.15.114:0/3296416272 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f90b8083df0 con 0x7f90cc0ce770 2024-09-13T17:54:13.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.105+0000 7f90cbe00640 1 --2- 172.21.15.114:0/3296416272 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f90ac066690 0x7f90ac068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:13.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.105+0000 7f90c3e00640 1 --2- 172.21.15.114:0/3296416272 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x7f90ac06ca30 0x7f90ac06ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:13.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.105+0000 7f90c3e00640 1 -- 172.21.15.114:0/3296416272 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f90ac06f540 con 0x7f90ac06ca30 2024-09-13T17:54:13.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.105+0000 7f90c3e00640 1 -- 172.21.15.114:0/3296416272 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90b80863d0 con 0x7f90cc0ce770 2024-09-13T17:54:13.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.105+0000 7f90d1200640 1 --2- 172.21.15.114:0/3296416272 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x7f90ac06ca30 0x7f90ac06ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:13.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.105+0000 7f90cbe00640 1 --2- 172.21.15.114:0/3296416272 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f90ac066690 0x7f90ac068b50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f90bc0ad000 tx=0x7f90bc0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:13.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.105+0000 7f90d1200640 1 --2- 172.21.15.114:0/3296416272 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x7f90ac06ca30 0x7f90ac06ee70 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:13.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.105+0000 7f90c3e00640 1 -- 172.21.15.114:0/3296416272 <== osd.7 v2:172.21.15.134:6816/874939117 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f90ac06f540 con 0x7f90ac06ca30 2024-09-13T17:54:13.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.117+0000 7f90d1c00640 1 -- 172.21.15.114:0/3296416272 --> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f90cc0cafe0 con 0x7f90ac06ca30 2024-09-13T17:54:13.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.117+0000 7f90c3e00640 1 -- 172.21.15.114:0/3296416272 <== osd.7 v2:172.21.15.134:6816/874939117 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f90cc0cafe0 con 0x7f90ac06ca30 2024-09-13T17:54:13.122 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-13T17:54:13.122 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T17:54:13.122 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-13T17:54:13.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.121+0000 7f90d1c00640 1 -- 172.21.15.114:0/3296416272 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x7f90ac06ca30 msgr2=0x7f90ac06ee70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:13.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.121+0000 7f90d1c00640 1 --2- 172.21.15.114:0/3296416272 >> [v2:172.21.15.134:6816/874939117,v1:172.21.15.134:6817/874939117] conn(0x7f90ac06ca30 0x7f90ac06ee70 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.121+0000 7f90d1c00640 1 -- 172.21.15.114:0/3296416272 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f90ac066690 msgr2=0x7f90ac068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:13.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.121+0000 7f90d1c00640 1 --2- 172.21.15.114:0/3296416272 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f90ac066690 0x7f90ac068b50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f90bc0ad000 tx=0x7f90bc0a6000 comp rx=0 tx=0).stop 2024-09-13T17:54:13.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.121+0000 7f90d1c00640 1 -- 172.21.15.114:0/3296416272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90cc0ce770 msgr2=0x7f90cc1f5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:13.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.121+0000 7f90d1c00640 1 --2- 172.21.15.114:0/3296416272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90cc0ce770 0x7f90cc1f5530 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f90b800d800 tx=0x7f90b800dcc0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.121+0000 7f90d1200640 1 -- 172.21.15.114:0/3296416272 reap_dead start 2024-09-13T17:54:13.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.121+0000 7f90d1c00640 1 -- 172.21.15.114:0/3296416272 shutdown_connections 2024-09-13T17:54:13.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.121+0000 7f90d1c00640 1 -- 172.21.15.114:0/3296416272 >> 172.21.15.114:0/3296416272 conn(0x7f90cc0d0330 msgr2=0x7f90cc098a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:13.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.121+0000 7f90d1c00640 1 -- 172.21.15.114:0/3296416272 shutdown_connections 2024-09-13T17:54:13.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.121+0000 7f90d1c00640 1 -- 172.21.15.114:0/3296416272 wait complete. 2024-09-13T17:54:13.140 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-13T17:54:13.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.273+0000 7f3ce2400640 1 Processor -- start 2024-09-13T17:54:13.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.273+0000 7f3ce2400640 1 -- start start 2024-09-13T17:54:13.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.273+0000 7f3ce2400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3cdc13f420 0x7f3cdc06d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:13.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.273+0000 7f3ce2400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3cdc06da90 0x7f3cdc0cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:13.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.273+0000 7f3ce2400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cdc0cd220 con 0x7f3cdc13c240 2024-09-13T17:54:13.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.273+0000 7f3ce2400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cdc06df40 con 0x7f3cdc13f420 2024-09-13T17:54:13.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.273+0000 7f3ce2400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc15a740 con 0x7f3cdc06da90 2024-09-13T17:54:13.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.273+0000 7f3cdaa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3cdc13f420 0x7f3cdc06d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:13.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.273+0000 7f3cdaa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f3cdc13f420 0x7f3cdc06d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50238/0 (socket says 172.21.15.114:50238) 2024-09-13T17:54:13.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.273+0000 7f3cdaa00640 1 -- 172.21.15.114:0/224240947 learned_addr learned my addr 172.21.15.114:0/224240947 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:13.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.273+0000 7f3cdbe00640 1 --2- 172.21.15.114:0/224240947 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3cdc06da90 0x7f3cdc0cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:13.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.277+0000 7f3cdaa00640 1 -- 172.21.15.114:0/224240947 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3cdc06da90 msgr2=0x7f3cdc0cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:13.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.277+0000 7f3cdaa00640 1 --2- 172.21.15.114:0/224240947 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3cdc06da90 0x7f3cdc0cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.277+0000 7f3cdaa00640 1 -- 172.21.15.114:0/224240947 >> v1:172.21.15.134:6789/0 conn(0x7f3cdc13c240 legacy=0x7f3cdc13c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:13.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.277+0000 7f3cdaa00640 1 -- 172.21.15.114:0/224240947 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc159bc0 con 0x7f3cdc13f420 2024-09-13T17:54:13.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.277+0000 7f3cdaa00640 1 --2- 172.21.15.114:0/224240947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cdc13f420 0x7f3cdc06d550 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8009870 tx=0x7f3cc801e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=262f919f61451f6d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:13.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.277+0000 7f3cda000640 1 -- 172.21.15.114:0/224240947 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc80a7a30 con 0x7f3cdc13f420 2024-09-13T17:54:13.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.277+0000 7f3cda000640 1 -- 172.21.15.114:0/224240947 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc80a7b90 con 0x7f3cdc13f420 2024-09-13T17:54:13.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.277+0000 7f3cda000640 1 -- 172.21.15.114:0/224240947 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc80af440 con 0x7f3cdc13f420 2024-09-13T17:54:13.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.277+0000 7f3ce2400640 1 -- 172.21.15.114:0/224240947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cdc13f420 msgr2=0x7f3cdc06d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:13.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.277+0000 7f3ce2400640 1 --2- 172.21.15.114:0/224240947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cdc13f420 0x7f3cdc06d550 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8009870 tx=0x7f3cc801e960 comp rx=0 tx=0).stop 2024-09-13T17:54:13.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.277+0000 7f3ce2400640 1 -- 172.21.15.114:0/224240947 shutdown_connections 2024-09-13T17:54:13.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.277+0000 7f3ce2400640 1 --2- 172.21.15.114:0/224240947 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3cdc06da90 0x7f3cdc0cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.277+0000 7f3ce2400640 1 --2- 172.21.15.114:0/224240947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cdc13f420 0x7f3cdc06d550 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.277+0000 7f3ce2400640 1 -- 172.21.15.114:0/224240947 >> 172.21.15.114:0/224240947 conn(0x7f3cdc0660b0 msgr2=0x7f3cdc069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:13.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.277+0000 7f3ce2400640 1 -- 172.21.15.114:0/224240947 shutdown_connections 2024-09-13T17:54:13.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.277+0000 7f3ce2400640 1 -- 172.21.15.114:0/224240947 wait complete. 2024-09-13T17:54:13.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.281+0000 7f3ce2400640 1 Processor -- start 2024-09-13T17:54:13.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.281+0000 7f3ce2400640 1 -- start start 2024-09-13T17:54:13.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.281+0000 7f3ce2400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3cdc06da90 0x7f3cdc1392a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:13.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.281+0000 7f3ce2400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3cdc13c240 0x7f3cdc0ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:13.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.281+0000 7f3ce2400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cdc13f420 0x7f3cdc155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:13.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.281+0000 7f3ce2400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc1397e0 con 0x7f3cdc13f420 2024-09-13T17:54:13.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.281+0000 7f3ce2400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc0b09a0 con 0x7f3cdc06da90 2024-09-13T17:54:13.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.281+0000 7f3ce2400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc0ad6d0 con 0x7f3cdc13c240 2024-09-13T17:54:13.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.281+0000 7f3cdbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cdc13f420 0x7f3cdc155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:13.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.281+0000 7f3cdbe00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cdc13f420 0x7f3cdc155420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50248/0 (socket says 172.21.15.114:50248) 2024-09-13T17:54:13.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.281+0000 7f3cdbe00640 1 -- 172.21.15.114:0/3068281385 learned_addr learned my addr 172.21.15.114:0/3068281385 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:13.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.281+0000 7f3cdaa00640 1 --2- 172.21.15.114:0/3068281385 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3cdc13c240 0x7f3cdc0ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:13.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.281+0000 7f3cdb400640 1 --2- 172.21.15.114:0/3068281385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3cdc06da90 0x7f3cdc1392a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:13.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.281+0000 7f3cdbe00640 1 -- 172.21.15.114:0/3068281385 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3cdc13c240 msgr2=0x7f3cdc0ac2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:13.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.281+0000 7f3cdbe00640 1 --2- 172.21.15.114:0/3068281385 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3cdc13c240 0x7f3cdc0ac2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.281+0000 7f3cdbe00640 1 -- 172.21.15.114:0/3068281385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3cdc06da90 msgr2=0x7f3cdc1392a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:13.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.281+0000 7f3cdbe00640 1 --2- 172.21.15.114:0/3068281385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3cdc06da90 0x7f3cdc1392a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.281+0000 7f3cdbe00640 1 -- 172.21.15.114:0/3068281385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc80094d0 con 0x7f3cdc13f420 2024-09-13T17:54:13.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.281+0000 7f3cdbe00640 1 --2- 172.21.15.114:0/3068281385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cdc13f420 0x7f3cdc155420 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009dd0 tx=0x7f3cd400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:13.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.281+0000 7f3cd3400640 1 -- 172.21.15.114:0/3068281385 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4014480 con 0x7f3cdc13f420 2024-09-13T17:54:13.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.281+0000 7f3cd3400640 1 -- 172.21.15.114:0/3068281385 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd400f040 con 0x7f3cdc13f420 2024-09-13T17:54:13.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.281+0000 7f3cd3400640 1 -- 172.21.15.114:0/3068281385 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4014840 con 0x7f3cdc13f420 2024-09-13T17:54:13.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.281+0000 7f3ce2400640 1 -- 172.21.15.114:0/3068281385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cdc0ac830 con 0x7f3cdc13f420 2024-09-13T17:54:13.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.281+0000 7f3ce2400640 1 -- 172.21.15.114:0/3068281385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cdc0afbe0 con 0x7f3cdc13f420 2024-09-13T17:54:13.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.285+0000 7f3ce2400640 1 -- 172.21.15.114:0/3068281385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cdc159790 con 0x7f3cdc13f420 2024-09-13T17:54:13.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.285+0000 7f3cd3400640 1 -- 172.21.15.114:0/3068281385 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3cd40149a0 con 0x7f3cdc13f420 2024-09-13T17:54:13.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.285+0000 7f3cd3400640 1 --2- 172.21.15.114:0/3068281385 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3cbc066690 0x7f3cbc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:13.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.285+0000 7f3cd3400640 1 -- 172.21.15.114:0/3068281385 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f3cd4084b20 con 0x7f3cdc13f420 2024-09-13T17:54:13.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.285+0000 7f3cdb400640 1 --2- 172.21.15.114:0/3068281385 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3cbc066690 0x7f3cbc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:13.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.285+0000 7f3cdb400640 1 --2- 172.21.15.114:0/3068281385 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3cbc066690 0x7f3cbc068b50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc007fd0 tx=0x7f3ccc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:13.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.289+0000 7f3cd3400640 1 -- 172.21.15.114:0/3068281385 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3cd4052000 con 0x7f3cdc13f420 2024-09-13T17:54:13.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.441+0000 7f3ce2400640 1 -- 172.21.15.114:0/3068281385 --> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f3cdc13f870 con 0x7f3cbc066690 2024-09-13T17:54:13.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.441+0000 7f3cd3400640 1 -- 172.21.15.114:0/3068281385 <== mgr.4102 v2:172.21.15.114:6832/137691478 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3ccc0014f0 con 0x7f3cbc066690 2024-09-13T17:54:13.446 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 7 to deep-scrub 2024-09-13T17:54:13.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.445+0000 7f3ce2400640 1 -- 172.21.15.114:0/3068281385 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3cbc066690 msgr2=0x7f3cbc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:13.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.445+0000 7f3ce2400640 1 --2- 172.21.15.114:0/3068281385 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3cbc066690 0x7f3cbc068b50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc007fd0 tx=0x7f3ccc009040 comp rx=0 tx=0).stop 2024-09-13T17:54:13.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.445+0000 7f3ce2400640 1 -- 172.21.15.114:0/3068281385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cdc13f420 msgr2=0x7f3cdc155420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:13.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.445+0000 7f3ce2400640 1 --2- 172.21.15.114:0/3068281385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cdc13f420 0x7f3cdc155420 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009dd0 tx=0x7f3cd400c490 comp rx=0 tx=0).stop 2024-09-13T17:54:13.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.445+0000 7f3ce2400640 1 -- 172.21.15.114:0/3068281385 shutdown_connections 2024-09-13T17:54:13.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.445+0000 7f3ce2400640 1 --2- 172.21.15.114:0/3068281385 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f3cbc066690 0x7f3cbc068b50 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.445+0000 7f3ce2400640 1 --2- 172.21.15.114:0/3068281385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3cdc13f420 0x7f3cdc155420 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.445+0000 7f3ce2400640 1 --2- 172.21.15.114:0/3068281385 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f3cdc13c240 0x7f3cdc0ac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.445+0000 7f3ce2400640 1 --2- 172.21.15.114:0/3068281385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3cdc06da90 0x7f3cdc1392a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.445+0000 7f3ce2400640 1 -- 172.21.15.114:0/3068281385 >> 172.21.15.114:0/3068281385 conn(0x7f3cdc0660b0 msgr2=0x7f3cdc139f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:13.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.445+0000 7f3ce2400640 1 -- 172.21.15.114:0/3068281385 shutdown_connections 2024-09-13T17:54:13.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.445+0000 7f3ce2400640 1 -- 172.21.15.114:0/3068281385 wait complete. 2024-09-13T17:54:13.467 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:54:13.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.597+0000 7fa505400640 1 Processor -- start 2024-09-13T17:54:13.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.597+0000 7fa505400640 1 -- start start 2024-09-13T17:54:13.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.601+0000 7fa505400640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa50013c240 0x7fa50013f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:13.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.601+0000 7fa505400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa50006dc60 0x7fa5000cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:13.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.601+0000 7fa505400640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5000cd220 con 0x7fa50013c980 2024-09-13T17:54:13.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.601+0000 7fa505400640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa50013f960 con 0x7fa50013c240 2024-09-13T17:54:13.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.601+0000 7fa505400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50015a740 con 0x7fa50006dc60 2024-09-13T17:54:13.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.601+0000 7fa4fe800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa50013c240 0x7fa50013f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:13.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.601+0000 7fa4fe800640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa50013c240 0x7fa50013f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50262/0 (socket says 172.21.15.114:50262) 2024-09-13T17:54:13.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.601+0000 7fa4fe800640 1 -- 172.21.15.114:0/3514805755 learned_addr learned my addr 172.21.15.114:0/3514805755 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:13.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.601+0000 7fa4ff200640 1 --2- 172.21.15.114:0/3514805755 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa50006dc60 0x7fa5000cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:13.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.601+0000 7fa4fe800640 1 -- 172.21.15.114:0/3514805755 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa50006dc60 msgr2=0x7fa5000cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:13.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.601+0000 7fa4fe800640 1 --2- 172.21.15.114:0/3514805755 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa50006dc60 0x7fa5000cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.601+0000 7fa4fe800640 1 -- 172.21.15.114:0/3514805755 >> v1:172.21.15.134:6789/0 conn(0x7fa50013c980 legacy=0x7fa50006d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:13.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.601+0000 7fa4fe800640 1 -- 172.21.15.114:0/3514805755 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa500159bc0 con 0x7fa50013c240 2024-09-13T17:54:13.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.605+0000 7fa4fe800640 1 --2- 172.21.15.114:0/3514805755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa50013c240 0x7fa50013f420 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0009870 tx=0x7fa4f001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7cff5068c82f7b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:13.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.605+0000 7fa4fd400640 1 -- 172.21.15.114:0/3514805755 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f00aa610 con 0x7fa50013c240 2024-09-13T17:54:13.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.605+0000 7fa4fd400640 1 -- 172.21.15.114:0/3514805755 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f00a6040 con 0x7fa50013c240 2024-09-13T17:54:13.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.605+0000 7fa4fd400640 1 -- 172.21.15.114:0/3514805755 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f00aa990 con 0x7fa50013c240 2024-09-13T17:54:13.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.605+0000 7fa505400640 1 -- 172.21.15.114:0/3514805755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa50013c240 msgr2=0x7fa50013f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:13.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.605+0000 7fa505400640 1 --2- 172.21.15.114:0/3514805755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa50013c240 0x7fa50013f420 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0009870 tx=0x7fa4f001c4f0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.605+0000 7fa505400640 1 -- 172.21.15.114:0/3514805755 shutdown_connections 2024-09-13T17:54:13.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.605+0000 7fa505400640 1 --2- 172.21.15.114:0/3514805755 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa50006dc60 0x7fa5000cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.605+0000 7fa505400640 1 --2- 172.21.15.114:0/3514805755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa50013c240 0x7fa50013f420 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.605+0000 7fa505400640 1 -- 172.21.15.114:0/3514805755 >> 172.21.15.114:0/3514805755 conn(0x7fa5000660b0 msgr2=0x7fa500069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:13.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.605+0000 7fa505400640 1 -- 172.21.15.114:0/3514805755 shutdown_connections 2024-09-13T17:54:13.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.605+0000 7fa505400640 1 -- 172.21.15.114:0/3514805755 wait complete. 2024-09-13T17:54:13.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.605+0000 7fa505400640 1 Processor -- start 2024-09-13T17:54:13.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.605+0000 7fa505400640 1 -- start start 2024-09-13T17:54:13.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.605+0000 7fa505400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa50006dc60 0x7fa50013af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:13.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.605+0000 7fa505400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa50013c240 0x7fa50013e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:13.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.605+0000 7fa505400640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa50013c980 0x7fa5000a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:13.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.605+0000 7fa505400640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50013f180 con 0x7fa50006dc60 2024-09-13T17:54:13.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.605+0000 7fa505400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5000a8010 con 0x7fa50013c240 2024-09-13T17:54:13.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.605+0000 7fa505400640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50013b460 con 0x7fa50013c980 2024-09-13T17:54:13.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.605+0000 7fa4fe800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa50006dc60 0x7fa50013af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:13.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.605+0000 7fa4fe800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa50006dc60 0x7fa50013af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50270/0 (socket says 172.21.15.114:50270) 2024-09-13T17:54:13.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.605+0000 7fa4fe800640 1 -- 172.21.15.114:0/1439876543 learned_addr learned my addr 172.21.15.114:0/1439876543 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:13.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.605+0000 7fa4fde00640 1 --2- 172.21.15.114:0/1439876543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa50013c240 0x7fa50013e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:13.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.609+0000 7fa4ff200640 1 --2- 172.21.15.114:0/1439876543 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa50013c980 0x7fa5000a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:13.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.609+0000 7fa4fe800640 1 -- 172.21.15.114:0/1439876543 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa50013c980 msgr2=0x7fa5000a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:13.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.609+0000 7fa4fe800640 1 --2- 172.21.15.114:0/1439876543 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa50013c980 0x7fa5000a84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.609+0000 7fa4fe800640 1 -- 172.21.15.114:0/1439876543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa50013c240 msgr2=0x7fa50013e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:13.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.609+0000 7fa4fe800640 1 --2- 172.21.15.114:0/1439876543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa50013c240 0x7fa50013e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.609+0000 7fa4fe800640 1 -- 172.21.15.114:0/1439876543 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f00094d0 con 0x7fa50006dc60 2024-09-13T17:54:13.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.609+0000 7fa4fe800640 1 --2- 172.21.15.114:0/1439876543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa50006dc60 0x7fa50013af20 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fa4f00ac040 tx=0x7fa4f0019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:13.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.609+0000 7fa4f6a00640 1 -- 172.21.15.114:0/1439876543 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f00bd5f0 con 0x7fa50006dc60 2024-09-13T17:54:13.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.609+0000 7fa4f6a00640 1 -- 172.21.15.114:0/1439876543 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f00bd770 con 0x7fa50006dc60 2024-09-13T17:54:13.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.609+0000 7fa4f6a00640 1 -- 172.21.15.114:0/1439876543 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f00bdb20 con 0x7fa50006dc60 2024-09-13T17:54:13.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.609+0000 7fa505400640 1 -- 172.21.15.114:0/1439876543 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5000ace70 con 0x7fa50006dc60 2024-09-13T17:54:13.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.609+0000 7fa505400640 1 -- 172.21.15.114:0/1439876543 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5000ad430 con 0x7fa50006dc60 2024-09-13T17:54:13.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.609+0000 7fa505400640 1 -- 172.21.15.114:0/1439876543 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50013cdb0 con 0x7fa50006dc60 2024-09-13T17:54:13.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.609+0000 7fa4f6a00640 1 -- 172.21.15.114:0/1439876543 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa4f00b33f0 con 0x7fa50006dc60 2024-09-13T17:54:13.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.609+0000 7fa4f6a00640 1 --2- 172.21.15.114:0/1439876543 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa4e0066690 0x7fa4e0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:13.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.609+0000 7fa4f6a00640 1 -- 172.21.15.114:0/1439876543 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fa4f011eb50 con 0x7fa50006dc60 2024-09-13T17:54:13.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.613+0000 7fa4fde00640 1 --2- 172.21.15.114:0/1439876543 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa4e0066690 0x7fa4e0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:13.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.613+0000 7fa4fde00640 1 --2- 172.21.15.114:0/1439876543 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa4e0066690 0x7fa4e0068b50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa5001f8360 tx=0x7fa4ec007e40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:13.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.613+0000 7fa4f6a00640 1 -- 172.21.15.114:0/1439876543 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa50013cdb0 con 0x7fa50006dc60 2024-09-13T17:54:13.761 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:54:13.764 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:54:13.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.765+0000 7fa505400640 1 -- 172.21.15.114:0/1439876543 --> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa500070620 con 0x7fa4e0066690 2024-09-13T17:54:13.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.769+0000 7fa4f6a00640 1 -- 172.21.15.114:0/1439876543 <== mgr.4102 v2:172.21.15.114:6832/137691478 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50623 (secure 0 0 0) 0x7fa4ec004c00 con 0x7fa4e0066690 2024-09-13T17:54:13.771 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:54:13.771 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-13T17:54:13.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.769+0000 7fa505400640 1 -- 172.21.15.114:0/1439876543 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa4e0066690 msgr2=0x7fa4e0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:13.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.769+0000 7fa505400640 1 --2- 172.21.15.114:0/1439876543 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa4e0066690 0x7fa4e0068b50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa5001f8360 tx=0x7fa4ec007e40 comp rx=0 tx=0).stop 2024-09-13T17:54:13.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.769+0000 7fa505400640 1 -- 172.21.15.114:0/1439876543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa50006dc60 msgr2=0x7fa50013af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:13.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.769+0000 7fa505400640 1 --2- 172.21.15.114:0/1439876543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa50006dc60 0x7fa50013af20 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fa4f00ac040 tx=0x7fa4f0019290 comp rx=0 tx=0).stop 2024-09-13T17:54:13.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.769+0000 7fa505400640 1 -- 172.21.15.114:0/1439876543 shutdown_connections 2024-09-13T17:54:13.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.769+0000 7fa505400640 1 --2- 172.21.15.114:0/1439876543 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7fa4e0066690 0x7fa4e0068b50 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.769+0000 7fa505400640 1 --2- 172.21.15.114:0/1439876543 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7fa50013c980 0x7fa5000a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.769+0000 7fa505400640 1 --2- 172.21.15.114:0/1439876543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa50013c240 0x7fa50013e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.769+0000 7fa505400640 1 --2- 172.21.15.114:0/1439876543 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa50006dc60 0x7fa50013af20 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.769+0000 7fa505400640 1 -- 172.21.15.114:0/1439876543 >> 172.21.15.114:0/1439876543 conn(0x7fa5000660b0 msgr2=0x7fa500156940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:13.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.769+0000 7fa505400640 1 -- 172.21.15.114:0/1439876543 shutdown_connections 2024-09-13T17:54:13.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:13.769+0000 7fa505400640 1 -- 172.21.15.114:0/1439876543 wait complete. 2024-09-13T17:54:13.791 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2024-09-13T17:54:11.962581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":222200,"kb_used_data":6024,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752520,"statfs":{"total":773094113280,"available":772866580480,"internally_reserved":0,"allocated":6168576,"data_stored":3420248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6291456,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":-16,"num_read_kb":-9,"num_write":-8,"num_write_kb":-6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001600"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":193,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-13T17:54:01.754835+0000","last_change":"2024-09-13T17:51:40.205691+0000","last_active":"2024-09-13T17:54:01.754835+0000","last_peered":"2024-09-13T17:54:01.754835+0000","last_clean":"2024-09-13T17:54:01.754835+0000","last_became_active":"2024-09-13T17:51:40.204577+0000","last_became_peered":"2024-09-13T17:51:40.204577+0000","last_unstale":"2024-09-13T17:54:01.754835+0000","last_undegraded":"2024-09-13T17:54:01.754835+0000","last_fullsized":"2024-09-13T17:54:01.754835+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:51:38.340495+0000","last_clean_scrub_stamp":"2024-09-13T17:51:38.340495+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:37.899275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28212,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343628,"statfs":{"total":96636764160,"available":96607875072,"internally_reserved":0,"allocated":1216512,"data_stored":870307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72099999999999997,"15min":0.72699999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0209999999999999,"5min":1.073,"15min":1.073},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69699999999999995,"15min":0.69799999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.871,"5min":1.012,"15min":1.012},"last":0.70799999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.54200000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92700000000000005,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68000000000000005,"15min":0.67900000000000005},"min":{"1min":0.49199999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.68400000000000005}]},{"osd":2,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.51300000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84099999999999997,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.75700000000000001,"15min":0.75800000000000001},"min":{"1min":0.58299999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.91700000000000004,"5min":1.097,"15min":1.097},"last":0.81100000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71699999999999997,"15min":0.71099999999999997},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.747},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.56999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.98299999999999998,"5min":1.024,"15min":1.024},"last":0.77300000000000002}]},{"osd":4,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65400000000000003,"15min":0.65200000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64000000000000001,"15min":0.63200000000000001},"min":{"1min":0.497,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.54700000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.621,"15min":0.622},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.875,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.878,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.66100000000000003}]},{"osd":6,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68600000000000005,"15min":0.68999999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90800000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72699999999999998,"15min":0.73299999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88300000000000001,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.63300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":279939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.68799999999999994,"15min":0.69599999999999995},"min":{"1min":0.40300000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92700000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.44500000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.91100000000000003,"5min":1.254,"15min":1.254},"last":0.81000000000000005}]},{"osd":1,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.68300000000000005,"15min":0.69399999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.62},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.72199999999999998,"15min":0.73599999999999999},"min":{"1min":0.45400000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.85599999999999998,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.70899999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.74299999999999999,"15min":0.75600000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.98399999999999999,"5min":1.002,"15min":1.002},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.752,"15min":0.76000000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.90700000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.72599999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.749,"15min":0.75800000000000001},"min":{"1min":0.53700000000000003,"5min":0.503,"15min":0.503},"max":{"1min":0.84699999999999998,"5min":1.008,"15min":1.008},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.76500000000000001,"15min":0.77500000000000002},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.92300000000000004,"5min":1.042,"15min":1.042},"last":0.78100000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.65500000000000003,"15min":0.66800000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.86899999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.71099999999999997,"15min":0.71699999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92800000000000005,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.746}]},{"osd":5,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68999999999999995,"15min":0.69399999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.97899999999999998,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.92800000000000005,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.628}]},{"osd":7,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.81000000000000005,"15min":0.82099999999999995},"min":{"1min":0.57999999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.94899999999999995,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.80900000000000005,"15min":0.82599999999999996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94899999999999995,"5min":1.151,"15min":1.151},"last":0.73399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":279939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.83299999999999996,"5min":1.929,"15min":1.929},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.75700000000000001,"15min":0.77700000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76500000000000001,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.71999999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.88300000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.71199999999999997,"15min":0.71999999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.85099999999999998,"5min":1.139,"15min":1.139},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.73199999999999998,"15min":0.751},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.87,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.71499999999999997,"15min":0.73099999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76500000000000001,"5min":1.052,"15min":1.052},"last":0.66400000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.75600000000000001,"15min":0.77100000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.83599999999999997,"5min":1.385,"15min":1.385},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.75900000000000001,"15min":0.77300000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.85599999999999998,"5min":1.264,"15min":1.264},"last":0.78300000000000003}]},{"osd":4,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61799999999999999,"15min":0.623},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.80600000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.502},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.66200000000000003,"15min":0.67100000000000004},"min":{"1min":0.44400000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.82399999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.73899999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85399999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89200000000000002,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.82399999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88900000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.52700000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.91400000000000003,"5min":1.181,"15min":1.181},"last":0.84799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":279939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.82499999999999996,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.69399999999999995,"15min":0.70199999999999996},"min":{"1min":0.45700000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.876,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.623}]},{"osd":1,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69399999999999995,"15min":0.68999999999999995},"min":{"1min":0.55000000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90200000000000002,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.75},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.67100000000000004,"15min":0.67300000000000004},"min":{"1min":0.46800000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85099999999999998,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.84099999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66400000000000003,"15min":0.66000000000000003},"min":{"1min":0.53200000000000003,"5min":0.498,"15min":0.498},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69799999999999995,"15min":0.69599999999999995},"min":{"1min":0.54300000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.70299999999999996}]},{"osd":3,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.80200000000000005,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.74299999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65100000000000002,"15min":0.65000000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.90600000000000003,"5min":1.048,"15min":1.048},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70399999999999996,"15min":0.70499999999999996},"min":{"1min":0.40400000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89500000000000002,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.79400000000000004}]},{"osd":6,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.97899999999999998,"5min":1.02,"15min":1.02},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.68200000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85699999999999998,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.77600000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.95799999999999996,"5min":1.161,"15min":1.161},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74299999999999999,"15min":0.748},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.032,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.71599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":279939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.40100000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.58599999999999997,"15min":0.61299999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.59599999999999997,"5min":4.2460000000000004,"15min":4.2460000000000004},"last":0.49099999999999999}]},{"osd":1,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.63800000000000001,"15min":0.67400000000000004},"min":{"1min":0.29999999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.66200000000000003,"5min":5.008,"15min":5.008},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70999999999999996,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.57199999999999995}]},{"osd":2,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.69499999999999995,"15min":0.72799999999999998},"min":{"1min":0.38100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.71999999999999997,"5min":4.8570000000000002,"15min":4.8570000000000002},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.70199999999999996,"15min":0.72999999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.872,"5min":4.8399999999999999,"15min":4.8399999999999999},"last":0.74199999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.871,"15min":0.89700000000000002},"min":{"1min":0.52000000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.0429999999999999,"5min":4.4450000000000003,"15min":4.4450000000000003},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.91400000000000003,"15min":0.94399999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.92800000000000005,"5min":4.9000000000000004,"15min":4.9000000000000004},"last":0.89500000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72799999999999998,"15min":0.72299999999999998},"min":{"1min":0.57799999999999996,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.89300000000000002,"15min":0.91400000000000003},"min":{"1min":0.59099999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.083,"5min":4.359,"15min":4.359},"last":0.96599999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.92200000000000004,"15min":0.95199999999999996},"min":{"1min":0.625,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1879999999999999,"5min":4.9710000000000001,"15min":4.9710000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.73499999999999999,"15min":0.72699999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.92800000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.91700000000000004,"15min":0.94299999999999995},"min":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.96299999999999997,"5min":4.4029999999999996,"15min":4.4029999999999996},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.98899999999999999,"15min":1.0189999999999999},"min":{"1min":0.69599999999999995,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2270000000000001,"5min":4.9349999999999996,"15min":4.9349999999999996},"last":1.0509999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":279939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.84199999999999997,"15min":0.90900000000000003},"min":{"1min":0.29399999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72799999999999998,"5min":5.5010000000000003,"15min":5.5010000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.436,"5min":0.68200000000000005,"15min":0.72299999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63300000000000001,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.33200000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.89100000000000001,"15min":0.95899999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.60899999999999999,"5min":5.3799999999999999,"15min":5.3799999999999999},"last":0.499},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.77300000000000002,"15min":0.81100000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76800000000000002,"5min":4.2329999999999997,"15min":4.2329999999999997},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.91500000000000004,"15min":0.99099999999999999},"min":{"1min":0.33100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.66700000000000004,"5min":5.032,"15min":5.032},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.93700000000000006,"15min":1.0109999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.628,"5min":5.4189999999999996,"15min":5.4189999999999996},"last":0.432}]},{"osd":4,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":1.1519999999999999,"15min":1.2230000000000001},"min":{"1min":0.59699999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.97199999999999998,"5min":5.4480000000000004,"15min":5.4480000000000004},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":1.0069999999999999,"15min":1.0529999999999999},"min":{"1min":0.55800000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.85899999999999999,"5min":4.7460000000000004,"15min":4.7460000000000004},"last":0.76800000000000002}]},{"osd":5,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.97899999999999998,"15min":1.02},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.998,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":1.1859999999999999,"15min":1.262},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.89300000000000002,"5min":5.4749999999999996,"15min":5.4749999999999996},"last":0.755}]},{"osd":6,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":1.0429999999999999,"15min":1.091},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94499999999999995,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":1.1639999999999999,"15min":1.232},"min":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.046,"5min":4.9859999999999998,"15min":4.9859999999999998},"last":0.93899999999999995}]},{"osd":7,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":1.0449999999999999,"15min":1.095},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.98699999999999999,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":1.1819999999999999,"15min":1.2470000000000001},"min":{"1min":0.63900000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0029999999999999,"5min":4.8879999999999999,"15min":4.8879999999999999},"last":0.89800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":279939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45500000000000002,"15min":0.45700000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.49099999999999999,"15min":0.49399999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71499999999999997,"5min":1.196,"15min":1.196},"last":0.47099999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77500000000000002,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.502,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89800000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.55200000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.51500000000000001,"15min":0.52300000000000002},"min":{"1min":0.36599999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.57999999999999996,"5min":1.105,"15min":1.105},"last":0.45400000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76900000000000002,"15min":0.77800000000000002},"min":{"1min":0.59399999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0740000000000001,"5min":1.175,"15min":1.175},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80600000000000005,"15min":0.81699999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.105,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.86899999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.80400000000000005,"15min":0.81599999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.115,"5min":1.367,"15min":1.367},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.81399999999999995,"15min":0.82399999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.137,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.92800000000000005}]},{"osd":6,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1799999999999999,"5min":1.417,"15min":1.417},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.80900000000000005,"15min":0.82699999999999996},"min":{"1min":0.54800000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.98399999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.026}]},{"osd":7,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.81100000000000005,"15min":0.81799999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.212,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.997,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.94799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28212,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343628,"statfs":{"total":96636764160,"available":96607875072,"internally_reserved":0,"allocated":1216512,"data_stored":870307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.434,"15min":0.436},"min":{"1min":0.26900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.60799999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.28799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.36699999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.50900000000000001,"15min":0.51100000000000001},"min":{"1min":0.35399999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.72399999999999998,"5min":0.88,"15min":0.88},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.77600000000000002,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.40600000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71499999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.41999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80200000000000005,"5min":1.089,"15min":1.089},"last":0.44500000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.79100000000000004,"15min":0.80000000000000004},"min":{"1min":0.51000000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96399999999999997,"5min":3.0350000000000001,"15min":3.0350000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.79000000000000004,"15min":0.80200000000000005},"min":{"1min":0.53700000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0109999999999999,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.80900000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.78900000000000003,"15min":0.80000000000000004},"min":{"1min":0.53800000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0009999999999999,"5min":1.911,"15min":1.911},"last":0.874},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80400000000000005,"15min":0.81399999999999995},"min":{"1min":0.54400000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.103,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":0.84499999999999997}]},{"osd":6,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.75900000000000001,"15min":0.76100000000000001},"min":{"1min":0.56200000000000006,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.95999999999999996,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.79600000000000004,"15min":0.80400000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.038,"5min":1.742,"15min":1.742},"last":0.75600000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.872,"15min":0.88400000000000001},"min":{"1min":0.56100000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.081,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.86799999999999999,"15min":0.88800000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0609999999999999,"5min":2.75,"15min":2.75},"last":0.94399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:54:13.796 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T17:51:38.340495+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=51, tm_sec=38, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=17, tm_min=54, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T17:54:13.796 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T17:54:33.797 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T17:54:33.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.941+0000 7ff5fc200640 1 Processor -- start 2024-09-13T17:54:33.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.941+0000 7ff5fc200640 1 -- start start 2024-09-13T17:54:33.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.941+0000 7ff5fc200640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff5f413f420 0x7ff5f406d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:33.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.945+0000 7ff5fc200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5f406da90 0x7ff5f40cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:33.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.945+0000 7ff5fc200640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f40cd220 con 0x7ff5f413c240 2024-09-13T17:54:33.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.945+0000 7ff5fc200640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f406df40 con 0x7ff5f413f420 2024-09-13T17:54:33.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.945+0000 7ff5fc200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f415a740 con 0x7ff5f406da90 2024-09-13T17:54:33.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.945+0000 7ff5f8e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff5f413f420 0x7ff5f406d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:33.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.945+0000 7ff5fa200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5f406da90 0x7ff5f40cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:33.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.945+0000 7ff5f8e00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff5f413f420 0x7ff5f406d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.114:41334/0 (socket says 172.21.15.114:41334) 2024-09-13T17:54:33.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.945+0000 7ff5f8e00640 1 -- 172.21.15.114:0/3359121665 learned_addr learned my addr 172.21.15.114:0/3359121665 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:33.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.945+0000 7ff5f8e00640 1 -- 172.21.15.114:0/3359121665 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5f406da90 msgr2=0x7ff5f40cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:33.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.945+0000 7ff5f8e00640 1 --2- 172.21.15.114:0/3359121665 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5f406da90 0x7ff5f40cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:33.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.945+0000 7ff5f8e00640 1 -- 172.21.15.114:0/3359121665 >> v1:172.21.15.134:6789/0 conn(0x7ff5f413c240 legacy=0x7ff5f413c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:33.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.945+0000 7ff5f8e00640 1 -- 172.21.15.114:0/3359121665 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f4159bc0 con 0x7ff5f413f420 2024-09-13T17:54:33.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.945+0000 7ff5f3e00640 1 -- 172.21.15.114:0/3359121665 <== mon.1 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2910343928 0 0) 0x7ff5f40cd220 con 0x7ff5f413c240 2024-09-13T17:54:33.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.945+0000 7ff5fa200640 1 --2- 172.21.15.114:0/3359121665 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5f406da90 0x7ff5f40cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:54:33.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.949+0000 7ff5f8e00640 1 --2- 172.21.15.114:0/3359121665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5f413f420 0x7ff5f406d550 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0009870 tx=0x7ff5e001c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e8ac824588af638 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:33.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.949+0000 7ff5f3e00640 1 -- 172.21.15.114:0/3359121665 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e00a95f0 con 0x7ff5f413f420 2024-09-13T17:54:33.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.949+0000 7ff5f3e00640 1 -- 172.21.15.114:0/3359121665 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e00a9750 con 0x7ff5f413f420 2024-09-13T17:54:33.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.949+0000 7ff5f3e00640 1 -- 172.21.15.114:0/3359121665 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e00a9ae0 con 0x7ff5f413f420 2024-09-13T17:54:33.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.949+0000 7ff5fc200640 1 -- 172.21.15.114:0/3359121665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5f413f420 msgr2=0x7ff5f406d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:33.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.949+0000 7ff5fc200640 1 --2- 172.21.15.114:0/3359121665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5f413f420 0x7ff5f406d550 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0009870 tx=0x7ff5e001c530 comp rx=0 tx=0).stop 2024-09-13T17:54:33.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.949+0000 7ff5fc200640 1 -- 172.21.15.114:0/3359121665 shutdown_connections 2024-09-13T17:54:33.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.949+0000 7ff5fc200640 1 --2- 172.21.15.114:0/3359121665 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5f406da90 0x7ff5f40cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:33.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.949+0000 7ff5fc200640 1 --2- 172.21.15.114:0/3359121665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5f413f420 0x7ff5f406d550 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:33.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.949+0000 7ff5fc200640 1 -- 172.21.15.114:0/3359121665 >> 172.21.15.114:0/3359121665 conn(0x7ff5f40660b0 msgr2=0x7ff5f4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:33.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.949+0000 7ff5fc200640 1 -- 172.21.15.114:0/3359121665 shutdown_connections 2024-09-13T17:54:33.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.949+0000 7ff5fc200640 1 -- 172.21.15.114:0/3359121665 wait complete. 2024-09-13T17:54:33.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.949+0000 7ff5fc200640 1 Processor -- start 2024-09-13T17:54:33.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.949+0000 7ff5fc200640 1 -- start start 2024-09-13T17:54:33.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.949+0000 7ff5fc200640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5f406da90 0x7ff5f4138890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:33.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.949+0000 7ff5fc200640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5f413c240 0x7ff5f40ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:33.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.949+0000 7ff5fc200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5f413f420 0x7ff5f40ad360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:33.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.949+0000 7ff5fc200640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f4138dd0 con 0x7ff5f406da90 2024-09-13T17:54:33.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.949+0000 7ff5fc200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f413c9f0 con 0x7ff5f413f420 2024-09-13T17:54:33.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.949+0000 7ff5fc200640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f40b3750 con 0x7ff5f413c240 2024-09-13T17:54:33.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.953+0000 7ff5f9800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5f406da90 0x7ff5f4138890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:33.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.953+0000 7ff5f9800640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5f406da90 0x7ff5f4138890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36114/0 (socket says 172.21.15.114:36114) 2024-09-13T17:54:33.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.953+0000 7ff5f9800640 1 -- 172.21.15.114:0/1292586739 learned_addr learned my addr 172.21.15.114:0/1292586739 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:33.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.953+0000 7ff5fa200640 1 --2- 172.21.15.114:0/1292586739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5f413f420 0x7ff5f40ad360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:33.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.953+0000 7ff5f8e00640 1 --2- 172.21.15.114:0/1292586739 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5f413c240 0x7ff5f40ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:33.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.953+0000 7ff5f9800640 1 -- 172.21.15.114:0/1292586739 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5f413c240 msgr2=0x7ff5f40ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:33.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.953+0000 7ff5f9800640 1 --2- 172.21.15.114:0/1292586739 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5f413c240 0x7ff5f40ab8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:33.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.953+0000 7ff5f9800640 1 -- 172.21.15.114:0/1292586739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5f413f420 msgr2=0x7ff5f40ad360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:33.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.953+0000 7ff5f9800640 1 --2- 172.21.15.114:0/1292586739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5f413f420 0x7ff5f40ad360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:33.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.953+0000 7ff5f9800640 1 -- 172.21.15.114:0/1292586739 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ec009a70 con 0x7ff5f406da90 2024-09-13T17:54:33.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.953+0000 7ff5fa200640 1 --2- 172.21.15.114:0/1292586739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5f413f420 0x7ff5f40ad360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:54:33.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.953+0000 7ff5f9800640 1 --2- 172.21.15.114:0/1292586739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5f406da90 0x7ff5f4138890 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7ff5e800c4d0 tx=0x7ff5e800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:33.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.953+0000 7ff5f1600640 1 -- 172.21.15.114:0/1292586739 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e8005480 con 0x7ff5f406da90 2024-09-13T17:54:33.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.953+0000 7ff5f1600640 1 -- 172.21.15.114:0/1292586739 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e8003600 con 0x7ff5f406da90 2024-09-13T17:54:33.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.953+0000 7ff5f1600640 1 -- 172.21.15.114:0/1292586739 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e80039b0 con 0x7ff5f406da90 2024-09-13T17:54:33.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.953+0000 7ff5fc200640 1 -- 172.21.15.114:0/1292586739 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e00094d0 con 0x7ff5f406da90 2024-09-13T17:54:33.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.953+0000 7ff5fc200640 1 -- 172.21.15.114:0/1292586739 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f40b2eb0 con 0x7ff5f406da90 2024-09-13T17:54:33.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.953+0000 7ff5fc200640 1 -- 172.21.15.114:0/1292586739 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f4159790 con 0x7ff5f406da90 2024-09-13T17:54:33.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.953+0000 7ff5f1600640 1 -- 172.21.15.114:0/1292586739 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff5e8003b10 con 0x7ff5f406da90 2024-09-13T17:54:33.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.953+0000 7ff5f1600640 1 --2- 172.21.15.114:0/1292586739 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff5d40666c0 0x7ff5d4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:33.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.953+0000 7ff5f1600640 1 -- 172.21.15.114:0/1292586739 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7ff5e80835f0 con 0x7ff5f406da90 2024-09-13T17:54:33.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.957+0000 7ff5f8e00640 1 --2- 172.21.15.114:0/1292586739 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff5d40666c0 0x7ff5d4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:33.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.957+0000 7ff5f8e00640 1 --2- 172.21.15.114:0/1292586739 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff5d40666c0 0x7ff5d4068b80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff5e00ae000 tx=0x7ff5e0004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:33.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:33.961+0000 7ff5f1600640 1 -- 172.21.15.114:0/1292586739 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff5e8050b70 con 0x7ff5f406da90 2024-09-13T17:54:34.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.113+0000 7ff5fc200640 1 -- 172.21.15.114:0/1292586739 --> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff5f413f870 con 0x7ff5d40666c0 2024-09-13T17:54:34.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.113+0000 7ff5f1600640 1 -- 172.21.15.114:0/1292586739 <== mgr.4102 v2:172.21.15.114:6832/137691478 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50493 (secure 0 0 0) 0x7ff5e00a98c0 con 0x7ff5d40666c0 2024-09-13T17:54:34.118 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:54:34.118 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2024-09-13T17:54:34.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.117+0000 7ff5fc200640 1 -- 172.21.15.114:0/1292586739 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff5d40666c0 msgr2=0x7ff5d4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:34.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.117+0000 7ff5fc200640 1 --2- 172.21.15.114:0/1292586739 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff5d40666c0 0x7ff5d4068b80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff5e00ae000 tx=0x7ff5e0004740 comp rx=0 tx=0).stop 2024-09-13T17:54:34.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.117+0000 7ff5fc200640 1 -- 172.21.15.114:0/1292586739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5f406da90 msgr2=0x7ff5f4138890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:34.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.117+0000 7ff5fc200640 1 --2- 172.21.15.114:0/1292586739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5f406da90 0x7ff5f4138890 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7ff5e800c4d0 tx=0x7ff5e800c990 comp rx=0 tx=0).stop 2024-09-13T17:54:34.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.117+0000 7ff5fc200640 1 -- 172.21.15.114:0/1292586739 shutdown_connections 2024-09-13T17:54:34.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.117+0000 7ff5fc200640 1 --2- 172.21.15.114:0/1292586739 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7ff5d40666c0 0x7ff5d4068b80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:34.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.117+0000 7ff5fc200640 1 --2- 172.21.15.114:0/1292586739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5f413f420 0x7ff5f40ad360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:34.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.117+0000 7ff5fc200640 1 --2- 172.21.15.114:0/1292586739 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7ff5f413c240 0x7ff5f40ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:34.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.117+0000 7ff5fc200640 1 --2- 172.21.15.114:0/1292586739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5f406da90 0x7ff5f4138890 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:34.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.117+0000 7ff5fc200640 1 -- 172.21.15.114:0/1292586739 >> 172.21.15.114:0/1292586739 conn(0x7ff5f40660b0 msgr2=0x7ff5f413b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:34.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.117+0000 7ff5fc200640 1 -- 172.21.15.114:0/1292586739 shutdown_connections 2024-09-13T17:54:34.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.117+0000 7ff5fc200640 1 -- 172.21.15.114:0/1292586739 wait complete. 2024-09-13T17:54:34.138 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-09-13T17:54:33.966557+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":222184,"kb_used_data":6024,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752536,"statfs":{"total":773094113280,"available":772866596864,"internally_reserved":0,"allocated":6168576,"data_stored":3420248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":221236794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002190"},"pg_stats":[{"pgid":"1.0","version":"52'119","reported_seq":207,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T17:54:16.131906+0000","last_change":"2024-09-13T17:54:16.132044+0000","last_active":"2024-09-13T17:54:16.131906+0000","last_peered":"2024-09-13T17:54:16.131906+0000","last_clean":"2024-09-13T17:54:16.131906+0000","last_became_active":"2024-09-13T17:51:40.204577+0000","last_became_peered":"2024-09-13T17:51:40.204577+0000","last_unstale":"2024-09-13T17:54:16.131906+0000","last_undegraded":"2024-09-13T17:54:16.131906+0000","last_fullsized":"2024-09-13T17:54:16.131906+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'119","last_scrub_stamp":"2024-09-13T17:54:16.131867+0000","last_deep_scrub":"52'119","last_deep_scrub_stamp":"2024-09-13T17:54:16.131867+0000","last_clean_scrub_stamp":"2024-09-13T17:54:16.131867+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:43.093792+0000","scrub_duration":0.0062366660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28204,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343636,"statfs":{"total":96636764160,"available":96607883264,"internally_reserved":0,"allocated":1216512,"data_stored":870307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72099999999999997,"15min":0.72699999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0209999999999999,"5min":1.073,"15min":1.073},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69699999999999995,"15min":0.69799999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.871,"5min":1.012,"15min":1.012},"last":0.77100000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.54200000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.92700000000000005,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68000000000000005,"15min":0.67900000000000005},"min":{"1min":0.49199999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.72799999999999998}]},{"osd":2,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.51300000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84099999999999997,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.75700000000000001,"15min":0.75800000000000001},"min":{"1min":0.58299999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.91700000000000004,"5min":1.097,"15min":1.097},"last":0.78300000000000003}]},{"osd":3,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71699999999999997,"15min":0.71099999999999997},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73599999999999999,"15min":0.73699999999999999},"min":{"1min":0.56999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.98299999999999998,"5min":1.024,"15min":1.024},"last":0.751}]},{"osd":4,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.65400000000000003,"15min":0.65200000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64000000000000001,"15min":0.63200000000000001},"min":{"1min":0.497,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.66500000000000004}]},{"osd":5,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.621,"15min":0.622},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.875,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.878,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.61299999999999999}]},{"osd":6,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.68600000000000005,"15min":0.68999999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90800000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72699999999999998,"15min":0.73299999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.88300000000000001,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.63800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":279939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.68799999999999994,"15min":0.69599999999999995},"min":{"1min":0.40300000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92700000000000005,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.44500000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.91100000000000003,"5min":1.254,"15min":1.254},"last":0.83599999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.68300000000000005,"15min":0.69399999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.72199999999999998,"15min":0.73599999999999999},"min":{"1min":0.45400000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.85599999999999998,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.96799999999999997}]},{"osd":2,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.74299999999999999,"15min":0.75600000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.98399999999999999,"5min":1.002,"15min":1.002},"last":0.746},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.752,"15min":0.76000000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.90700000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.86899999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.749,"15min":0.75800000000000001},"min":{"1min":0.53700000000000003,"5min":0.503,"15min":0.503},"max":{"1min":0.84699999999999998,"5min":1.008,"15min":1.008},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.76500000000000001,"15min":0.77500000000000002},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.92300000000000004,"5min":1.042,"15min":1.042},"last":0.81799999999999995}]},{"osd":4,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.65500000000000003,"15min":0.66800000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.86899999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.71099999999999997,"15min":0.71699999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92800000000000005,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.70099999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68999999999999995,"15min":0.69399999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.97899999999999998,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.92800000000000005,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.80100000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.81000000000000005,"15min":0.82099999999999995},"min":{"1min":0.57999999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.94899999999999995,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.80900000000000005,"15min":0.82599999999999996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.94899999999999995,"5min":1.151,"15min":1.151},"last":0.65100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":279939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.83299999999999996,"5min":1.929,"15min":1.929},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.75700000000000001,"15min":0.77700000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76500000000000001,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.58399999999999996}]},{"osd":1,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.67700000000000005,"15min":0.68700000000000006},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.88300000000000001,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.753},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.71199999999999997,"15min":0.71999999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.85099999999999998,"5min":1.139,"15min":1.139},"last":0.64400000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.73199999999999998,"15min":0.751},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.87,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.71499999999999997,"15min":0.73099999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76500000000000001,"5min":1.052,"15min":1.052},"last":0.63700000000000001}]},{"osd":3,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.75600000000000001,"15min":0.77100000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.83599999999999997,"5min":1.385,"15min":1.385},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.75900000000000001,"15min":0.77300000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.85599999999999998,"5min":1.264,"15min":1.264},"last":0.628}]},{"osd":4,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61799999999999999,"15min":0.623},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.80600000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.66200000000000003,"15min":0.67100000000000004},"min":{"1min":0.44400000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.82399999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.45800000000000002}]},{"osd":6,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85399999999999998,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89200000000000002,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.51900000000000002}]},{"osd":7,"last update":"Fri Sep 13 17:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88900000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.78700000000000003,"15min":0.79500000000000004},"min":{"1min":0.52700000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.91400000000000003,"5min":1.181,"15min":1.181},"last":0.60199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":279939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.82499999999999996,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.621},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.69399999999999995,"15min":0.70199999999999996},"min":{"1min":0.45700000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.876,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.59199999999999997}]},{"osd":1,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69399999999999995,"15min":0.68999999999999995},"min":{"1min":0.55000000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90200000000000002,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.67100000000000004,"15min":0.67300000000000004},"min":{"1min":0.46800000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85099999999999998,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.64500000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66400000000000003,"15min":0.66000000000000003},"min":{"1min":0.53200000000000003,"5min":0.498,"15min":0.498},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.878},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69799999999999995,"15min":0.69599999999999995},"min":{"1min":0.54300000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.83299999999999996}]},{"osd":3,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.80200000000000005,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.95399999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65100000000000002,"15min":0.65000000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.90600000000000003,"5min":1.048,"15min":1.048},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70399999999999996,"15min":0.70499999999999996},"min":{"1min":0.40400000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.89500000000000002,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.753}]},{"osd":6,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.97899999999999998,"5min":1.02,"15min":1.02},"last":1},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.67800000000000005,"15min":0.68200000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85699999999999998,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.96899999999999997}]},{"osd":7,"last update":"Fri Sep 13 17:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.95799999999999996,"5min":1.161,"15min":1.161},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74299999999999999,"15min":0.748},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.032,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":1.0409999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":279939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.40100000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.58599999999999997,"15min":0.61299999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.59599999999999997,"5min":4.2460000000000004,"15min":4.2460000000000004},"last":0.57199999999999995}]},{"osd":1,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.63800000000000001,"15min":0.67400000000000004},"min":{"1min":0.29999999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.66200000000000003,"5min":5.008,"15min":5.008},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.505,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70999999999999996,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.64700000000000002}]},{"osd":2,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.69499999999999995,"15min":0.72799999999999998},"min":{"1min":0.38100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.71999999999999997,"5min":4.8570000000000002,"15min":4.8570000000000002},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.70199999999999996,"15min":0.72999999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.872,"5min":4.8399999999999999,"15min":4.8399999999999999},"last":0.76500000000000001}]},{"osd":4,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.871,"15min":0.89700000000000002},"min":{"1min":0.52000000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.0429999999999999,"5min":4.4450000000000003,"15min":4.4450000000000003},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.91400000000000003,"15min":0.94399999999999995},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.92800000000000005,"5min":4.9000000000000004,"15min":4.9000000000000004},"last":0.92700000000000005}]},{"osd":5,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72799999999999998,"15min":0.72299999999999998},"min":{"1min":0.57799999999999996,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.89300000000000002,"15min":0.91400000000000003},"min":{"1min":0.59099999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.083,"5min":4.359,"15min":4.359},"last":0.877}]},{"osd":6,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.92200000000000004,"15min":0.95199999999999996},"min":{"1min":0.625,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1879999999999999,"5min":4.9710000000000001,"15min":4.9710000000000001},"last":1.004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.73499999999999999,"15min":0.72699999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.90500000000000003}]},{"osd":7,"last update":"Fri Sep 13 17:53:41 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.91700000000000004,"15min":0.94299999999999995},"min":{"1min":0.54100000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.96299999999999997,"5min":4.4029999999999996,"15min":4.4029999999999996},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.98899999999999999,"15min":1.0189999999999999},"min":{"1min":0.69599999999999995,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2270000000000001,"5min":4.9349999999999996,"15min":4.9349999999999996},"last":1.034}]}]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":279939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.84199999999999997,"15min":0.90900000000000003},"min":{"1min":0.29399999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72799999999999998,"5min":5.5010000000000003,"15min":5.5010000000000003},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.68200000000000005,"15min":0.72299999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63300000000000001,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.46500000000000002}]},{"osd":1,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.89100000000000001,"15min":0.95899999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.60899999999999999,"5min":5.3799999999999999,"15min":5.3799999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.77300000000000002,"15min":0.81100000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76800000000000002,"5min":4.2329999999999997,"15min":4.2329999999999997},"last":0.73399999999999999}]},{"osd":3,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.91500000000000004,"15min":0.99099999999999999},"min":{"1min":0.33100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.66700000000000004,"5min":5.032,"15min":5.032},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.93700000000000006,"15min":1.0109999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.628,"5min":5.4189999999999996,"15min":5.4189999999999996},"last":0.70099999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":1.1519999999999999,"15min":1.2230000000000001},"min":{"1min":0.59699999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.97199999999999998,"5min":5.4480000000000004,"15min":5.4480000000000004},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":1.0069999999999999,"15min":1.0529999999999999},"min":{"1min":0.55800000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.85899999999999999,"5min":4.7460000000000004,"15min":4.7460000000000004},"last":0.82799999999999996}]},{"osd":5,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.97899999999999998,"15min":1.02},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.998,"5min":4.4710000000000001,"15min":4.4710000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":1.1859999999999999,"15min":1.262},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.89300000000000002,"5min":5.4749999999999996,"15min":5.4749999999999996},"last":0.76600000000000001}]},{"osd":6,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":1.0429999999999999,"15min":1.091},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94499999999999995,"5min":4.7789999999999999,"15min":4.7789999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":1.1639999999999999,"15min":1.232},"min":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.046,"5min":4.9859999999999998,"15min":4.9859999999999998},"last":0.67900000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:53:39 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":1.0449999999999999,"15min":1.095},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.98699999999999999,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":1.1819999999999999,"15min":1.2470000000000001},"min":{"1min":0.63900000000000001,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0029999999999999,"5min":4.8879999999999999,"15min":4.8879999999999999},"last":0.79500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":279939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45500000000000002,"15min":0.45700000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.49099999999999999,"15min":0.49399999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71499999999999997,"5min":1.196,"15min":1.196},"last":0.48899999999999999}]},{"osd":2,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77500000000000002,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89800000000000002,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.56100000000000005}]},{"osd":3,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.51500000000000001,"15min":0.52300000000000002},"min":{"1min":0.36599999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.57999999999999996,"5min":1.105,"15min":1.105},"last":0.57699999999999996}]},{"osd":4,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76900000000000002,"15min":0.77800000000000002},"min":{"1min":0.59399999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0740000000000001,"5min":1.175,"15min":1.175},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80600000000000005,"15min":0.81699999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.105,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.86199999999999999}]},{"osd":5,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.80400000000000005,"15min":0.81599999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.115,"5min":1.367,"15min":1.367},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.81399999999999995,"15min":0.82399999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.137,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.72899999999999998}]},{"osd":6,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1799999999999999,"5min":1.417,"15min":1.417},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.80900000000000005,"15min":0.82699999999999996},"min":{"1min":0.54800000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.98399999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.80300000000000005}]},{"osd":7,"last update":"Fri Sep 13 17:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.81100000000000005,"15min":0.81799999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.212,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.748},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.997,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.88}]}]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28204,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343636,"statfs":{"total":96636764160,"available":96607883264,"internally_reserved":0,"allocated":1216512,"data_stored":870307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.434,"15min":0.436},"min":{"1min":0.26900000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.60799999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.28799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.95399999999999996}]},{"osd":2,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.50900000000000001,"15min":0.51100000000000001},"min":{"1min":0.35399999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.72399999999999998,"5min":0.88,"15min":0.88},"last":1.05},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.77600000000000002,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":1.071}]},{"osd":3,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71499999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56999999999999995,"15min":0.57599999999999996},"min":{"1min":0.41999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80200000000000005,"5min":1.089,"15min":1.089},"last":0.98499999999999999}]},{"osd":4,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.79100000000000004,"15min":0.80000000000000004},"min":{"1min":0.51000000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96399999999999997,"5min":3.0350000000000001,"15min":3.0350000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.79000000000000004,"15min":0.80200000000000005},"min":{"1min":0.53700000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0109999999999999,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.81899999999999995}]},{"osd":5,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.78900000000000003,"15min":0.80000000000000004},"min":{"1min":0.53800000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0009999999999999,"5min":1.911,"15min":1.911},"last":1.028},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80400000000000005,"15min":0.81399999999999995},"min":{"1min":0.54400000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.103,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":1.093}]},{"osd":6,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.75900000000000001,"15min":0.76100000000000001},"min":{"1min":0.56200000000000006,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.95999999999999996,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.125},{"interface":"front","average":{"1min":0.748,"5min":0.79600000000000004,"15min":0.80400000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.038,"5min":1.742,"15min":1.742},"last":1.2250000000000001}]},{"osd":7,"last update":"Fri Sep 13 17:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.872,"15min":0.88400000000000001},"min":{"1min":0.56100000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.081,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.86799999999999999,"15min":0.88800000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0609999999999999,"5min":2.75,"15min":2.75},"last":0.91100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T17:54:34.140 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T17:54:34.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2489c00640 1 Processor -- start 2024-09-13T17:54:34.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2489c00640 1 -- start start 2024-09-13T17:54:34.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2489c00640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f248415c880 0x7f24840d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:34.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2489c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2484099180 0x7f24840cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:34.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2489c00640 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24840ca980 con 0x7f248406bfc0 2024-09-13T17:54:34.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2489c00640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f248415cc60 con 0x7f248415c880 2024-09-13T17:54:34.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2489c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f248406c450 con 0x7f2484099180 2024-09-13T17:54:34.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f247b400640 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f248406bfc0 0x7f2484098a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38690/0 (socket says 172.21.15.114:38690) 2024-09-13T17:54:34.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f247b400640 1 -- 172.21.15.114:0/1479751477 learned_addr learned my addr 172.21.15.114:0/1479751477 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-09-13T17:54:34.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2489200640 1 --2- 172.21.15.114:0/1479751477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2484099180 0x7f24840cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:34.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2483e00640 1 --2- 172.21.15.114:0/1479751477 >> v2:172.21.15.134:3300/0 conn(0x7f248415c880 0x7f24840d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:34.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2483400640 1 -- 172.21.15.114:0/1479751477 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170270061 0 0) 0x7f24840ca980 con 0x7f248406bfc0 2024-09-13T17:54:34.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2483400640 1 -- 172.21.15.114:0/1479751477 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2468003530 con 0x7f248406bfc0 2024-09-13T17:54:34.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2483400640 1 -- 172.21.15.114:0/1479751477 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2562517768 0 0) 0x7f2468003530 con 0x7f248406bfc0 2024-09-13T17:54:34.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2483400640 1 -- 172.21.15.114:0/1479751477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2484099180 msgr2=0x7f24840cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:34.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2483400640 1 --2- 172.21.15.114:0/1479751477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2484099180 0x7f24840cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:34.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2483400640 1 -- 172.21.15.114:0/1479751477 >> v2:172.21.15.134:3300/0 conn(0x7f248415c880 msgr2=0x7f24840d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:34.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2483400640 1 --2- 172.21.15.114:0/1479751477 >> v2:172.21.15.134:3300/0 conn(0x7f248415c880 0x7f24840d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:34.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2483400640 1 -- 172.21.15.114:0/1479751477 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248406c730 con 0x7f248406bfc0 2024-09-13T17:54:34.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2483400640 1 -- 172.21.15.114:0/1479751477 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 6655449 0 0) 0x7f246c001680 con 0x7f248406bfc0 2024-09-13T17:54:34.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2483400640 1 -- 172.21.15.114:0/1479751477 >> v1:172.21.15.114:6789/0 conn(0x7f248406bfc0 legacy=0x7f2484098a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:34.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2483400640 1 --2- 172.21.15.114:0/1479751477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2484099180 0x7f2468003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:34.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2483400640 1 --2- 172.21.15.114:0/1479751477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2468003f00 0x7f24680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:34.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2483400640 1 --2- 172.21.15.114:0/1479751477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2468004d10 0x7f2468005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:34.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2483400640 1 -- 172.21.15.114:0/1479751477 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248415cc60 con 0x7f2468004d10 2024-09-13T17:54:34.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2483400640 1 -- 172.21.15.114:0/1479751477 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248406c450 con 0x7f2468003f00 2024-09-13T17:54:34.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2483400640 1 -- 172.21.15.114:0/1479751477 --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246800b9e0 con 0x7f2484099180 2024-09-13T17:54:34.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2489200640 1 --2- 172.21.15.114:0/1479751477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2468004d10 0x7f2468005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:34.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2483e00640 1 --2- 172.21.15.114:0/1479751477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2484099180 0x7f2468003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:34.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f247b400640 1 --2- 172.21.15.114:0/1479751477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2468003f00 0x7f24680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:34.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2489200640 1 -- 172.21.15.114:0/1479751477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2484099180 msgr2=0x7f2468003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:34.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2489200640 1 --2- 172.21.15.114:0/1479751477 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f2484099180 0x7f2468003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:34.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2489200640 1 -- 172.21.15.114:0/1479751477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2468003f00 msgr2=0x7f24680047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:34.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2489200640 1 --2- 172.21.15.114:0/1479751477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2468003f00 0x7f24680047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:34.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f2489200640 1 -- 172.21.15.114:0/1479751477 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2468003530 con 0x7f2468004d10 2024-09-13T17:54:34.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.273+0000 7f247b400640 1 --2- 172.21.15.114:0/1479751477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2468003f00 0x7f24680047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:54:34.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.277+0000 7f2489200640 1 --2- 172.21.15.114:0/1479751477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2468004d10 0x7f2468005190 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f247c009f90 tx=0x7f247c01cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b2af2def4b407a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:34.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.277+0000 7f2483400640 1 -- 172.21.15.114:0/1479751477 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c0a5c10 con 0x7f2468004d10 2024-09-13T17:54:34.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.277+0000 7f2483400640 1 -- 172.21.15.114:0/1479751477 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247c00f040 con 0x7f2468004d10 2024-09-13T17:54:34.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.277+0000 7f2483400640 1 -- 172.21.15.114:0/1479751477 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c0ad440 con 0x7f2468004d10 2024-09-13T17:54:34.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.277+0000 7f2489c00640 1 -- 172.21.15.114:0/1479751477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2468004d10 msgr2=0x7f2468005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:34.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.277+0000 7f2489c00640 1 --2- 172.21.15.114:0/1479751477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2468004d10 0x7f2468005190 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f247c009f90 tx=0x7f247c01cc00 comp rx=0 tx=0).stop 2024-09-13T17:54:34.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.277+0000 7f2489200640 1 -- 172.21.15.114:0/1479751477 reap_dead start 2024-09-13T17:54:34.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.277+0000 7f2489c00640 1 -- 172.21.15.114:0/1479751477 shutdown_connections 2024-09-13T17:54:34.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.277+0000 7f2489c00640 1 -- 172.21.15.114:0/1479751477 >> 172.21.15.114:0/1479751477 conn(0x7f24840d0330 msgr2=0x7f24840d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:34.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.277+0000 7f2489c00640 1 -- 172.21.15.114:0/1479751477 shutdown_connections 2024-09-13T17:54:34.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.277+0000 7f2489c00640 1 -- 172.21.15.114:0/1479751477 wait complete. 2024-09-13T17:54:34.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.281+0000 7f2489c00640 1 Processor -- start 2024-09-13T17:54:34.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.281+0000 7f2489c00640 1 -- start start 2024-09-13T17:54:34.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.281+0000 7f2489c00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2468004d10 0x7f248409d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:34.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.281+0000 7f2489c00640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24840c8450 0x7f24840c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:34.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.281+0000 7f2489c00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2484159440 0x7f24841598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:34.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.281+0000 7f2489c00640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24840c9bd0 con 0x7f2468004d10 2024-09-13T17:54:34.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.281+0000 7f2489c00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248409a660 con 0x7f2484159440 2024-09-13T17:54:34.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.281+0000 7f2489c00640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24840c8fc0 con 0x7f24840c8450 2024-09-13T17:54:34.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.281+0000 7f2483e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2468004d10 0x7f248409d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:34.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.281+0000 7f2483e00640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2468004d10 0x7f248409d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36124/0 (socket says 172.21.15.114:36124) 2024-09-13T17:54:34.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.281+0000 7f2483e00640 1 -- 172.21.15.114:0/1564434117 learned_addr learned my addr 172.21.15.114:0/1564434117 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:34.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.281+0000 7f2483e00640 1 -- 172.21.15.114:0/1564434117 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24840c8450 msgr2=0x7f24840c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:34.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.281+0000 7f2483e00640 1 --2- 172.21.15.114:0/1564434117 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24840c8450 0x7f24840c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:34.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.281+0000 7f2483e00640 1 -- 172.21.15.114:0/1564434117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2484159440 msgr2=0x7f24841598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:34.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.281+0000 7f2483e00640 1 --2- 172.21.15.114:0/1564434117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2484159440 0x7f24841598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:34.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.281+0000 7f2483e00640 1 -- 172.21.15.114:0/1564434117 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24840c92a0 con 0x7f2468004d10 2024-09-13T17:54:34.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.281+0000 7f2483e00640 1 --2- 172.21.15.114:0/1564434117 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2468004d10 0x7f248409d870 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f2474011aa0 tx=0x7f2474011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:34.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.281+0000 7f2480c00640 1 -- 172.21.15.114:0/1564434117 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247400fb00 con 0x7f2468004d10 2024-09-13T17:54:34.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.281+0000 7f2480c00640 1 -- 172.21.15.114:0/1564434117 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247400fc60 con 0x7f2468004d10 2024-09-13T17:54:34.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.281+0000 7f2480c00640 1 -- 172.21.15.114:0/1564434117 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474014440 con 0x7f2468004d10 2024-09-13T17:54:34.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.281+0000 7f2489c00640 1 -- 172.21.15.114:0/1564434117 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24840c9580 con 0x7f2468004d10 2024-09-13T17:54:34.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.281+0000 7f2489c00640 1 -- 172.21.15.114:0/1564434117 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2484159de0 con 0x7f2468004d10 2024-09-13T17:54:34.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.281+0000 7f2489c00640 1 -- 172.21.15.114:0/1564434117 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24840d0e50 con 0x7f2468004d10 2024-09-13T17:54:34.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.285+0000 7f2480c00640 1 -- 172.21.15.114:0/1564434117 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f24740145a0 con 0x7f2468004d10 2024-09-13T17:54:34.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.285+0000 7f2480c00640 1 --2- 172.21.15.114:0/1564434117 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2460066690 0x7f2460068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:34.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.285+0000 7f2480c00640 1 -- 172.21.15.114:0/1564434117 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f2474084970 con 0x7f2468004d10 2024-09-13T17:54:34.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.285+0000 7f247b400640 1 --2- 172.21.15.114:0/1564434117 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2460066690 0x7f2460068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:34.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.285+0000 7f247b400640 1 --2- 172.21.15.114:0/1564434117 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2460066690 0x7f2460068b50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f24841ef9e0 tx=0x7f246c001d80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:34.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.289+0000 7f2480c00640 1 -- 172.21.15.114:0/1564434117 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2474051da0 con 0x7f2468004d10 2024-09-13T17:54:34.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.445+0000 7f2489c00640 1 -- 172.21.15.114:0/1564434117 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f24840cb7c0 con 0x7f2468004d10 2024-09-13T17:54:34.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.449+0000 7f2480c00640 1 -- 172.21.15.114:0/1564434117 <== mon.0 v2:172.21.15.114:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2474051da0 con 0x7f2468004d10 2024-09-13T17:54:34.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.449+0000 7f2480c00640 1 -- 172.21.15.114:0/1564434117 <== mon.0 v2:172.21.15.114:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) v1 ==== 123+0+0 (secure 0 0 0) 0x7f2474022020 con 0x7f2468004d10 2024-09-13T17:54:34.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.453+0000 7f2489c00640 1 -- 172.21.15.114:0/1564434117 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2460066690 msgr2=0x7f2460068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:34.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.453+0000 7f2489c00640 1 --2- 172.21.15.114:0/1564434117 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2460066690 0x7f2460068b50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f24841ef9e0 tx=0x7f246c001d80 comp rx=0 tx=0).stop 2024-09-13T17:54:34.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.453+0000 7f2489c00640 1 -- 172.21.15.114:0/1564434117 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2468004d10 msgr2=0x7f248409d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:34.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.453+0000 7f2489c00640 1 --2- 172.21.15.114:0/1564434117 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2468004d10 0x7f248409d870 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f2474011aa0 tx=0x7f2474011f60 comp rx=0 tx=0).stop 2024-09-13T17:54:34.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.453+0000 7f2489c00640 1 -- 172.21.15.114:0/1564434117 shutdown_connections 2024-09-13T17:54:34.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.453+0000 7f2489c00640 1 --2- 172.21.15.114:0/1564434117 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7f2460066690 0x7f2460068b50 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:34.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.453+0000 7f2489c00640 1 --2- 172.21.15.114:0/1564434117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2484159440 0x7f24841598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:34.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.453+0000 7f2489c00640 1 --2- 172.21.15.114:0/1564434117 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7f24840c8450 0x7f24840c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:34.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.453+0000 7f2489c00640 1 --2- 172.21.15.114:0/1564434117 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2468004d10 0x7f248409d870 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:34.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.453+0000 7f2489c00640 1 -- 172.21.15.114:0/1564434117 >> 172.21.15.114:0/1564434117 conn(0x7f24840d0330 msgr2=0x7f24840b55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:34.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.453+0000 7f2489c00640 1 -- 172.21.15.114:0/1564434117 shutdown_connections 2024-09-13T17:54:34.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.453+0000 7f2489c00640 1 -- 172.21.15.114:0/1564434117 wait complete. 2024-09-13T17:54:34.474 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T17:54:34.475 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T17:54:34.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.605+0000 7facca600640 1 Processor -- start 2024-09-13T17:54:34.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.605+0000 7facca600640 1 -- start start 2024-09-13T17:54:34.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.609+0000 7facca600640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7facc4070420 0x7facc40708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:34.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.609+0000 7facca600640 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7facc406d030 0x7facc406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:34.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.609+0000 7facca600640 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc40adfb0 con 0x7facc40cdad0 2024-09-13T17:54:34.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.609+0000 7facca600640 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc406cc10 con 0x7facc4070420 2024-09-13T17:54:34.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.609+0000 7facca600640 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc4070df0 con 0x7facc406d030 2024-09-13T17:54:34.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.609+0000 7facbaa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7facc4070420 0x7facc40708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:34.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.609+0000 7facbaa00640 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7facc4070420 0x7facc40708b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36128/0 (socket says 172.21.15.114:36128) 2024-09-13T17:54:34.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.609+0000 7facbaa00640 1 -- 172.21.15.114:0/1380744221 learned_addr learned my addr 172.21.15.114:0/1380744221 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:34.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.609+0000 7facc3e00640 1 --2- 172.21.15.114:0/1380744221 >> v2:172.21.15.134:3300/0 conn(0x7facc406d030 0x7facc406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:34.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.609+0000 7facbaa00640 1 -- 172.21.15.114:0/1380744221 >> v2:172.21.15.134:3300/0 conn(0x7facc406d030 msgr2=0x7facc406d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:34.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.609+0000 7facbaa00640 1 --2- 172.21.15.114:0/1380744221 >> v2:172.21.15.134:3300/0 conn(0x7facc406d030 0x7facc406d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:34.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.609+0000 7facbaa00640 1 -- 172.21.15.114:0/1380744221 >> v1:172.21.15.134:6789/0 conn(0x7facc40cdad0 legacy=0x7facc40ad4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T17:54:34.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.609+0000 7facbaa00640 1 -- 172.21.15.114:0/1380744221 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc40adcd0 con 0x7facc4070420 2024-09-13T17:54:34.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.613+0000 7facbaa00640 1 --2- 172.21.15.114:0/1380744221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7facc4070420 0x7facc40708b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7facc406e3a0 tx=0x7facac01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace9a173092942cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:34.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.613+0000 7facc2a00640 1 -- 172.21.15.114:0/1380744221 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac0ab620 con 0x7facc4070420 2024-09-13T17:54:34.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.613+0000 7facc2a00640 1 -- 172.21.15.114:0/1380744221 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7facac0ab780 con 0x7facc4070420 2024-09-13T17:54:34.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.613+0000 7facc2a00640 1 -- 172.21.15.114:0/1380744221 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac0abb30 con 0x7facc4070420 2024-09-13T17:54:34.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.613+0000 7facca600640 1 -- 172.21.15.114:0/1380744221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7facc4070420 msgr2=0x7facc40708b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:34.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.613+0000 7facca600640 1 --2- 172.21.15.114:0/1380744221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7facc4070420 0x7facc40708b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7facc406e3a0 tx=0x7facac01c420 comp rx=0 tx=0).stop 2024-09-13T17:54:34.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.613+0000 7facca600640 1 -- 172.21.15.114:0/1380744221 shutdown_connections 2024-09-13T17:54:34.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.613+0000 7facca600640 1 --2- 172.21.15.114:0/1380744221 >> v2:172.21.15.134:3300/0 conn(0x7facc406d030 0x7facc406d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:34.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.613+0000 7facca600640 1 --2- 172.21.15.114:0/1380744221 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7facc4070420 0x7facc40708b0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:34.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.613+0000 7facca600640 1 -- 172.21.15.114:0/1380744221 >> 172.21.15.114:0/1380744221 conn(0x7facc40660b0 msgr2=0x7facc4069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:34.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.613+0000 7facca600640 1 -- 172.21.15.114:0/1380744221 shutdown_connections 2024-09-13T17:54:34.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.613+0000 7facca600640 1 -- 172.21.15.114:0/1380744221 wait complete. 2024-09-13T17:54:34.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.613+0000 7facca600640 1 Processor -- start 2024-09-13T17:54:34.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.613+0000 7facca600640 1 -- start start 2024-09-13T17:54:34.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.613+0000 7facca600640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7facc406d030 0x7facc414d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:34.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.613+0000 7facca600640 1 --2- >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facc4070420 0x7facc4150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:34.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.613+0000 7facca600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facc40cdad0 0x7facc4150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:34.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.613+0000 7facca600640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc415a6e0 con 0x7facc406d030 2024-09-13T17:54:34.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.613+0000 7facca600640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc415a980 con 0x7facc40cdad0 2024-09-13T17:54:34.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.613+0000 7facca600640 1 -- --> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc415ac60 con 0x7facc4070420 2024-09-13T17:54:34.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.613+0000 7facc3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7facc406d030 0x7facc414d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:34.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.613+0000 7facc3400640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7facc406d030 0x7facc414d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36134/0 (socket says 172.21.15.114:36134) 2024-09-13T17:54:34.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.613+0000 7facc3400640 1 -- 172.21.15.114:0/3100973330 learned_addr learned my addr 172.21.15.114:0/3100973330 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-13T17:54:34.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.617+0000 7facc3e00640 1 --2- 172.21.15.114:0/3100973330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facc40cdad0 0x7facc4150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:34.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.617+0000 7facbaa00640 1 --2- 172.21.15.114:0/3100973330 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facc4070420 0x7facc4150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:34.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.617+0000 7facc3400640 1 -- 172.21.15.114:0/3100973330 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facc4070420 msgr2=0x7facc4150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:34.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.617+0000 7facc3400640 1 --2- 172.21.15.114:0/3100973330 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facc4070420 0x7facc4150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:34.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.617+0000 7facc3400640 1 -- 172.21.15.114:0/3100973330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facc40cdad0 msgr2=0x7facc4150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:34.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.617+0000 7facc3400640 1 --2- 172.21.15.114:0/3100973330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facc40cdad0 0x7facc4150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:34.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.617+0000 7facc3400640 1 -- 172.21.15.114:0/3100973330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facac0094d0 con 0x7facc406d030 2024-09-13T17:54:34.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.617+0000 7facc3400640 1 --2- 172.21.15.114:0/3100973330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7facc406d030 0x7facc414d790 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7facb400b410 tx=0x7facb400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:34.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.617+0000 7facbbe00640 1 -- 172.21.15.114:0/3100973330 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb4004020 con 0x7facc406d030 2024-09-13T17:54:34.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.617+0000 7facbbe00640 1 -- 172.21.15.114:0/3100973330 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7facb4004180 con 0x7facc406d030 2024-09-13T17:54:34.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.617+0000 7facbbe00640 1 -- 172.21.15.114:0/3100973330 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb4011630 con 0x7facc406d030 2024-09-13T17:54:34.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.617+0000 7facca600640 1 -- 172.21.15.114:0/3100973330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc415af40 con 0x7facc406d030 2024-09-13T17:54:34.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.617+0000 7facca600640 1 -- 172.21.15.114:0/3100973330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc414dcd0 con 0x7facc406d030 2024-09-13T17:54:34.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.617+0000 7facca600640 1 -- 172.21.15.114:0/3100973330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc415b460 con 0x7facc406d030 2024-09-13T17:54:34.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.617+0000 7facbbe00640 1 -- 172.21.15.114:0/3100973330 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7facb4011790 con 0x7facc406d030 2024-09-13T17:54:34.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.617+0000 7facbbe00640 1 --2- 172.21.15.114:0/3100973330 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7faca0066690 0x7faca0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:34.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.617+0000 7facbbe00640 1 -- 172.21.15.114:0/3100973330 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5349+0+0 (secure 0 0 0) 0x7facb4083db0 con 0x7facc406d030 2024-09-13T17:54:34.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.617+0000 7facbaa00640 1 --2- 172.21.15.114:0/3100973330 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7faca0066690 0x7faca0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:34.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.621+0000 7facbaa00640 1 --2- 172.21.15.114:0/3100973330 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7faca0066690 0x7faca0068b50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7facac0af000 tx=0x7facac0b6040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:34.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.621+0000 7facbbe00640 1 -- 172.21.15.114:0/3100973330 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7facc415b460 con 0x7facc406d030 2024-09-13T17:54:34.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.809+0000 7facca600640 1 -- 172.21.15.114:0/3100973330 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7facc40708b0 con 0x7facc406d030 2024-09-13T17:54:34.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.809+0000 7facbbe00640 1 -- 172.21.15.114:0/3100973330 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+3541 (secure 0 0 0) 0x7facb4015070 con 0x7facc406d030 2024-09-13T17:54:34.811 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-13T17:54:34.811 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":32,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5129,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/1758700058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1758700058},{"type":"v1","addr":"172.21.15.134:6833","nonce":1758700058}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/4015015784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4015015784},{"type":"v1","addr":"172.21.15.134:6835","nonce":4015015784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6836/2696640153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":2696640153},{"type":"v1","addr":"172.21.15.114:6836","nonce":2696640153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":6132,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6837/3825560738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6835","nonce":3825560738},{"type":"v1","addr":"172.21.15.114:6837","nonce":3825560738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[]} 2024-09-13T17:54:34.811 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 32 2024-09-13T17:54:34.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.809+0000 7facca600640 1 -- 172.21.15.114:0/3100973330 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7faca0066690 msgr2=0x7faca0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:34.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.809+0000 7facca600640 1 --2- 172.21.15.114:0/3100973330 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7faca0066690 0x7faca0068b50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7facac0af000 tx=0x7facac0b6040 comp rx=0 tx=0).stop 2024-09-13T17:54:34.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.809+0000 7facca600640 1 -- 172.21.15.114:0/3100973330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7facc406d030 msgr2=0x7facc414d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:34.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.809+0000 7facca600640 1 --2- 172.21.15.114:0/3100973330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7facc406d030 0x7facc414d790 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7facb400b410 tx=0x7facb400b8d0 comp rx=0 tx=0).stop 2024-09-13T17:54:34.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.809+0000 7facca600640 1 -- 172.21.15.114:0/3100973330 shutdown_connections 2024-09-13T17:54:34.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.809+0000 7facca600640 1 --2- 172.21.15.114:0/3100973330 >> [v2:172.21.15.114:6832/137691478,v1:172.21.15.114:6833/137691478] conn(0x7faca0066690 0x7faca0068b50 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:34.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.809+0000 7facca600640 1 --2- 172.21.15.114:0/3100973330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7facc40cdad0 0x7facc4150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:34.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.809+0000 7facca600640 1 --2- 172.21.15.114:0/3100973330 >> [v2:172.21.15.134:3301/0,v1:172.21.15.134:6790/0] conn(0x7facc4070420 0x7facc4150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:34.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.809+0000 7facca600640 1 --2- 172.21.15.114:0/3100973330 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7facc406d030 0x7facc414d790 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:34.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.809+0000 7facca600640 1 -- 172.21.15.114:0/3100973330 >> 172.21.15.114:0/3100973330 conn(0x7facc40660b0 msgr2=0x7facc40ad280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:34.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.809+0000 7facca600640 1 -- 172.21.15.114:0/3100973330 shutdown_connections 2024-09-13T17:54:34.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-13T17:54:34.809+0000 7facca600640 1 -- 172.21.15.114:0/3100973330 wait complete. 2024-09-13T17:54:34.834 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-13T17:54:34.834 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T17:54:34.835 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T17:54:34.835 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:54:34.847 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T17:54:34.847 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T17:54:34.847 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:54:34.901 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T17:54:34.901 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T17:54:34.901 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:54:34.915 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T17:54:34.915 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T17:54:34.915 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:54:34.976 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T17:54:34.976 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T17:54:34.977 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T17:54:34.977 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:54:35.072 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T17:54:35.072 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T17:54:35.072 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:54:35.160 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T17:54:35.160 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T17:54:35.161 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:54:36.531 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-13T17:54:41.263 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T17:54:41.263 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T17:54:41.264 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:54:41.328 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T17:54:41.329 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-13T17:54:41.329 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:54:41.425 INFO:tasks.ceph.osd.4:Stopped 2024-09-13T17:54:41.425 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-13T17:54:41.426 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:54:41.500 INFO:tasks.ceph.osd.5:Stopped 2024-09-13T17:54:41.501 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-13T17:54:41.501 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:54:42.225 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-13T17:54:42.225 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-13T17:54:43.816 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:54:43.822 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:54:47.603 INFO:tasks.ceph.osd.6:Stopped 2024-09-13T17:54:47.603 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-13T17:54:47.603 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:54:47.686 INFO:tasks.ceph.osd.7:Stopped 2024-09-13T17:54:47.686 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T17:54:47.687 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-13T17:54:47.687 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:54:47.747 INFO:tasks.ceph.mgr.y:Stopped 2024-09-13T17:54:47.747 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T17:54:47.747 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:54:47.802 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~6s 2024-09-13T17:54:47.802 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-09-13T17:54:47.803 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T17:54:47.803 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T17:54:47.803 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T17:54:47.803 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:54:47.821 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T17:54:47.821 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-13T17:54:47.822 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:54:47.840 INFO:tasks.ceph.mon.b:Stopped 2024-09-13T17:54:47.841 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-13T17:54:47.841 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T17:54:47.898 INFO:tasks.ceph.mon.c:Stopped 2024-09-13T17:54:47.898 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T17:54:47.898 DEBUG:teuthology.orchestra.run.smithi114:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'bad backtrace' | egrep -v 'object missing on disk' | egrep -v 'error reading table object' | egrep -v 'error reading sessionmap' | egrep -v 'unmatched fragstat' | egrep -v 'unmatched rstat' | egrep -v 'was unreadable, recreating it now' | egrep -v 'Scrub error on inode' | egrep -v 'Metadata damage detected' | egrep -v MDS_FAILED | egrep -v MDS_DAMAGE | head -n 1 2024-09-13T17:54:47.939 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi114.front.sepia.ceph.com 2024-09-13T17:54:47.939 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T17:54:48.239 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi114.front.sepia.ceph.com 2024-09-13T17:54:48.239 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T17:54:48.409 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi114.front.sepia.ceph.com 2024-09-13T17:54:48.409 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T17:54:48.610 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi114.front.sepia.ceph.com 2024-09-13T17:54:48.610 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T17:54:48.787 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-13T17:54:48.787 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-13T17:54:49.053 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-13T17:54:49.054 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-13T17:54:49.240 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-13T17:54:49.240 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-13T17:54:49.449 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-13T17:54:49.449 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-13T17:54:49.652 INFO:tasks.ceph:Archiving mon data... 2024-09-13T17:54:49.653 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903930/data/mon.a.tgz 2024-09-13T17:54:49.653 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2024-09-13T17:54:49.662 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.wrnD0e5mYI 2024-09-13T17:54:49.663 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.wrnD0e5mYI 2024-09-13T17:54:49.792 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.wrnD0e5mYI 2024-09-13T17:54:49.870 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.wrnD0e5mYI is 338KB 2024-09-13T17:54:49.936 DEBUG:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.wrnD0e5mYI 2024-09-13T17:54:49.945 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903930/data/mon.b.tgz 2024-09-13T17:54:49.945 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-09-13T17:54:49.954 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.fcCf8GTVMv 2024-09-13T17:54:49.954 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.fcCf8GTVMv 2024-09-13T17:54:50.109 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.fcCf8GTVMv 2024-09-13T17:54:50.184 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.fcCf8GTVMv is 446KB 2024-09-13T17:54:50.247 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.fcCf8GTVMv 2024-09-13T17:54:50.256 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903930/data/mon.c.tgz 2024-09-13T17:54:50.256 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-09-13T17:54:50.305 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.Cm4tyal95b 2024-09-13T17:54:50.305 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Cm4tyal95b 2024-09-13T17:54:50.458 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.Cm4tyal95b 2024-09-13T17:54:50.534 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.Cm4tyal95b is 446KB 2024-09-13T17:54:50.600 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.Cm4tyal95b 2024-09-13T17:54:50.608 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T17:54:50.609 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T17:54:50.612 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T17:54:50.671 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-13T17:54:50.672 DEBUG:teuthology.orchestra.run.smithi114:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T17:54:50.675 DEBUG:teuthology.orchestra.run.smithi134:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T17:54:50.706 INFO:teuthology.orchestra.run.smithi114.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T17:54:50.750 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T17:54:50.757 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T17:54:50.758 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903930/remote/smithi114/crash 2024-09-13T17:54:50.759 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T17:54:50.778 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903930/remote/smithi134/crash 2024-09-13T17:54:50.779 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T17:54:50.815 INFO:tasks.ceph:Shutting down logrotate 2024-09-13T17:54:50.815 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:54:50.824 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T17:54:50.905 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T17:54:50.927 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T17:54:50.945 INFO:tasks.ceph:Compressing logs... 2024-09-13T17:54:50.946 DEBUG:teuthology.orchestra.run.smithi114:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:54:50.972 DEBUG:teuthology.orchestra.run.smithi134:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:54:52.803 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-13T17:54:52.803 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-09-13T17:54:54.785 INFO:tasks.ceph:Archiving logs... 2024-09-13T17:54:54.786 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903930/remote/smithi114/log 2024-09-13T17:54:54.787 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T17:54:55.392 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903930/remote/smithi134/log 2024-09-13T17:54:55.393 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T17:54:55.770 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T17:54:55.778 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T17:54:55.778 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T17:54:55.781 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T17:54:55.882 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T17:54:55.890 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T17:54:55.891 DEBUG:teuthology.orchestra.run.smithi114:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:54:55.894 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:54:55.906 INFO:teuthology.orchestra.run.smithi114.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T17:54:55.906 INFO:teuthology.orchestra.run.smithi114.stdout:============================================================================== 2024-09-13T17:54:55.906 INFO:teuthology.orchestra.run.smithi114.stdout:*hv01.front.sepi 67.205.162.81 3 u 9 64 177 0.098 -0.315 1.078 2024-09-13T17:54:55.906 INFO:teuthology.orchestra.run.smithi114.stdout:+hv02.front.sepi 63.231.80.2 3 u 12 64 177 0.110 -2.534 0.962 2024-09-13T17:54:55.906 INFO:teuthology.orchestra.run.smithi114.stdout:+hv03.front.sepi 74.6.168.72 3 u 15 64 177 0.106 +0.316 1.037 2024-09-13T17:54:55.906 INFO:teuthology.orchestra.run.smithi114.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T17:54:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T17:54:55.909 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================== 2024-09-13T17:54:55.909 INFO:teuthology.orchestra.run.smithi134.stdout:+hv01.front.sepi 67.205.162.81 3 u 5 64 177 0.090 -0.245 1.107 2024-09-13T17:54:55.909 INFO:teuthology.orchestra.run.smithi134.stdout:+hv02.front.sepi 63.231.80.2 3 u 13 64 177 0.140 -2.587 1.107 2024-09-13T17:54:55.909 INFO:teuthology.orchestra.run.smithi134.stdout:*hv03.front.sepi 74.6.168.72 3 u 7 64 177 0.133 +0.322 1.077 2024-09-13T17:54:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T17:54:55.911 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T17:54:55.930 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T17:54:55.930 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T17:54:55.986 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T17:54:56.049 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T17:54:56.059 INFO:teuthology.task.internal:Duration was 906.601729 seconds 2024-09-13T17:54:56.060 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T17:54:56.070 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T17:54:56.070 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T17:54:56.074 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T17:54:56.167 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T17:54:56.167 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi114.front.sepia.ceph.com 2024-09-13T17:54:56.168 DEBUG:teuthology.orchestra.run.smithi114:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T17:54:56.189 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2024-09-13T17:54:56.190 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T17:54:56.211 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T17:54:56.212 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:54:56.240 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T17:54:56.291 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T17:54:56.292 DEBUG:teuthology.orchestra.run.smithi114:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T17:54:56.320 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T17:54:56.408 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T17:54:56.419 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T17:54:56.419 DEBUG:teuthology.orchestra.run.smithi114:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T17:54:56.441 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T17:54:56.461 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T17:54:56.545 DEBUG:teuthology.orchestra.run.smithi114:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:54:56.548 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:54:56.562 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = core 2024-09-13T17:54:56.565 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2024-09-13T17:54:56.583 DEBUG:teuthology.orchestra.run.smithi114:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:54:56.628 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:54:56.628 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T17:54:56.638 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:54:56.638 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T17:54:56.649 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T17:54:56.650 DEBUG:teuthology.misc:Transferring archived files from smithi114:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903930/remote/smithi114 2024-09-13T17:54:56.650 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T17:54:56.697 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903930/remote/smithi134 2024-09-13T17:54:56.697 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T17:54:56.723 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T17:54:56.723 DEBUG:teuthology.orchestra.run.smithi114:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T17:54:56.736 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T17:54:56.770 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T17:54:56.780 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T17:54:56.780 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T17:54:56.802 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T17:54:56.802 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T17:54:56.805 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T17:54:56.810 INFO:teuthology.orchestra.run.smithi114.stdout: 658142 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 17:54 /home/ubuntu/cephtest 2024-09-13T17:54:56.821 INFO:teuthology.orchestra.run.smithi134.stdout: 658143 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 17:54 /home/ubuntu/cephtest 2024-09-13T17:54:56.823 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T17:54:56.860 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T17:54:56.953 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a client.1-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/alternate-pool} duration: 906.6017291545868 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-13T17:54:56.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T17:54:57.047 INFO:teuthology.run:pass